PatchBenchShowcase
showcase · captured run · execution disabled

New benchmark

Point PatchBench at a local repository and describe the defect. Nothing is patched until the bug is reproduced as a failing test.

Showcase mode

Repository execution runs locally in PatchBench.

This hosted build uses a captured, verified benchmark. Its evidence is read from the persisted run artifact; the form below shows what a local run starts from, with every execution control disabled.

auth-expiry-bugCOMPLETE2 eligible · 1 rejected
View captured benchmark

Repository

local git · node.js / typescript
Branch
—
Baseline commit
resolved from HEAD after inspection

Defect

bob turns this into the regression test
Write it as something a test could assert: a status, a return value, a thrown error.
01
Baseline
clean detached worktree
02 · GATE
Reproduce
test must fail on baseline
03
Strategize
up to 3 strategies
04
Patch
1 isolated worktree each
05
Verify
identical checks, sequential
If the regression test doesn't fail on the untouched baseline, the run stops as UNVERIFIED. No candidates are generated from an unreproduced bug.Pre-existing baseline failures are recorded, not blocking. Candidates are rejected only for newly introduced failures. A dirty primary working tree is allowed: checks run in a clean detached worktree at the recorded commit.

Verification commands

from package.json

Not available in showcase mode.

Only these commands run, and every candidate gets exactly the same set.

Run policy

defaults
Candidates
independent strategies
3
Timeout
per command
120s
Bob turn cap
per task
20 turns
Bob cost cap
per task
1
Typecheck / build
hard gates when configured
required / required
Excluded from Bob context
.gitnode_modules.nextdistbuild.env.env.*
  • Repository inspected — missing
  • Bug title — missing
  • Description — missing
  • Expected behavior — missing
  • Script execution acknowledged — missing

Execution is disabled in showcase mode. Benchmarks start from a local PatchBench install; open the captured benchmark to inspect real evidence.