Skip to content

List Runs Command

The list-runs command shows all your submitted runs for a specific subset and split.

Usage

sb-cli list-runs <subset> <split>

Arguments

  • subset: Dataset subset (swe-bench-m or swe-bench_lite)
  • split: Dataset split (dev or test)

Output

The command displays a list of all run IDs associated with your API key for the specified subset and split. If no runs are found, it will indicate this.

Examples

  1. List runs for main dataset:

    sb-cli list-runs swe-bench-m dev
    

  2. List runs for lite dataset:

    sb-cli list-runs swe-bench_lite dev
    

Common Use Cases

  • Finding old run IDs before deletion
  • Checking submission history
  • Verifying successful submissions
  • Managing multiple experiments