nharnessedThe runUnharnessed on GitHubInstall
Terminal-Bench 4.0

47 of 66 tasks. Every turn is here.

Claude Opus 5.5 at max effort. Open a task to read what the model thought, the code it sent, what came back, and what the verifier said. Next to each task is what it took Claude Code with the same model, on average over its five official runs.

The list runs from the task where the harness saved the most to the ones where it cost more. A time is how long the run took, without the waits on our subscription’s quota.

71.2%Score
5,993Turns
$12.19Per task
nharnessedClaude CodeTaskTurnsTimeCostTurnsTimeCost
Average per task911h11$12.19981h20$14.30
distributed-dedup632h25$20.201424h30$42.76layout-config-recreation3011h29$23.473304h03$44.99ctr-optimization1532h09$8.362164h39$24.92live-database-cutover1431h08$18.611782h09$33.09biped-contact-dynamics555h37$9.931272h32$24.39vba-userform-port12353m$17.081931h41$30.46math-eval-grader10844m$11.241311h27$23.61retro-console-soc1051h25$17.111762h14$28.92takens-embedding-lean8053m$13.152341h01$22.83rs-archive-clone19553m$15.842081h50$24.09fp8-rmsnorm-gemm8553m$11.711351h28$19.70payments-pipeline-fix1531h31$21.681842h41$29.50photonic-waveguide-routing2141m$6.59311h51$14.27cumulative-layout-shift1522h53$24.452053h06$31.80interleaved-vigenere1031h12$8.721141h41$15.73ontology-kg-querying6737m$11.149255m$17.48formal-crypto9339m$12.721191h12$18.24uefi-bootkit981h25$10.281121h08$14.52sglang-qwen-burst2131h09$23.312211h38$27.48cargo-flight-dispatch2319m$3.613738m$7.63freight-dispatch-shift1131h06$19.211252h00$22.84heat-pump-warranty7327m$7.535446m$10.96react-lead-form6139m$9.049251m$12.21music-harmony9944m$12.51891h09$14.82wal-recovery-ordering4231m$6.135346m$8.44legacy-utility-triage1421h20$9.311791h00$11.59embedding-drift-monitor6740m$6.57631h00$8.54fin-saccr-rwa3519m$4.153235m$6.02risk-scorer-replay8335m$6.268341m$7.64atrx-vep-crispr3814m$3.093823m$4.44ks-solver-cpp7853m$10.50831h15$11.63batched-eval-parity8535m$8.247744m$9.05lake-temp-glm1703h26$25.961383h17$26.58vllm-deepseek-streaming1231h01$16.891541h17$17.48session-window-debug3338m$8.313355m$8.74bun-sourcemap-leak3829m$6.244934m$6.53production-planning *4129m$7.053843m$7.31freecad-spring-clip3624m$4.982526m$4.98shadow-relay265m$1.14178m$1.14nextjs-performance1201h03$13.311221h16$13.16mp-checkpoint-consolidation4939m$3.563624m$3.39cad-model5015m$2.822918m$2.62hof-topology-interpenetration4017m$3.312622m$2.96sound-change-cascade7347m$6.88621h02$6.51freecad-platform-drawing4715m$3.104416m$2.68data-anonymization981h11$15.10951h38$14.66coq-block-bound1616m$2.931717m$2.47medical-claims-processing9326m$9.787036m$9.28intrastat-meldung9216m$5.676718m$4.92layout-config-recreation28520m$3.054721m$2.28roy-polymorph-cn3516m$2.651215m$1.88foodstuff-beta-activity2837m$8.692740m$7.68protein-autointerp-disulfide2829m$4.32728m$3.26mvcc-lsm-compaction2735m$4.512431m$3.40freecad-impeller3543m$6.893235m$5.64satb-audio-transcription8033m$4.914725m$3.43pretrain-shard-corruption845h29$6.155736m$4.45gsea-proteomics6634m$5.374923m$3.29glycan-ms2-elucidation4330m$6.952730m$4.59vpp-loss-divergence1371h00$15.0911357m$12.21telecom-entity-resolution2291h00$19.961461h40$16.78kv-live-surgery1141h18$17.667646m$10.90wdm-design1603h12$27.281573h02$16.55html-js-filter1242h27$33.841311h14$21.64vf2-speedup-networkx1623h29$52.271572h12$32.90jax-speedrun-gpu *1616h41$56.161825h54$32.83

* jax-speedrun-gpu: The first attempt died when the sandbox ran out of memory; this run passed.

* production-planning: Ran after a fix to the system prompt: the old one asked the model to state its assumptions, and it took that literally, assuming where the task was explicit.