Stop reviewing runner noise
Separate code failures from install, network, and runner failures before CI and review time disappear.
See the execution trail →Run AI-written patches in a clean project copy. Separate code failures from runner failures. Get one readable receipt.
Starter runs on your own machine, with your own API key. Your code goes to the AI provider you already use — and nowhere else.
Already have a coding agent? Wire it up in one line.
claude mcp add --transport http adaptorch https://adaptorch.com/mcp
Every square is one recorded synthetic task. Green passed the recorded check; the red outline marks the gate’s own miss.
In this 30-task synthetic ledger, verification moved 8 tasks from fail to pass and moved 1 the other way. Both arms and the evidence JSON is public.
Works beside the tools you already use
Compatible workflow surfaces; logos are not endorsements.
Engineering teams need faster reviews. Solo builders need a clear pass, block, and next step. Both need the same execution evidence.
Separate code failures from install, network, and runner failures before CI and review time disappear.
See the execution trail →Read Pass, Needs review, or Block without understanding every line. Send the receipt back to your coding agent as fix context.
Connect a repository, run the patch in isolation, then open the generated run ID and receipt.
Not a dashboard you have to learn. Not a score you have to trust. A slip that tells you what the AI touched, whether it ran, and what looked wrong — in the order you would ask.
correctness_claim: false — it ran and this is what happened. We do not claim it is right.
Ask an AI for an essay and nobody can prove it’s right. Ask an AI for code and you can just run it. It works or it doesn’t. There is a right answer and a machine can find it. AdaptOrch is built on that one fact.
So we don’t ask your AI whether it did a good job. We run what it wrote and read the result. And we don’t run it once — we solve the same task a few different ways and compare. Where the attempts disagree is where bugs live.
The box is thrown away when the run ends. Nothing it wrote survives.
Failing before and passing after is the strongest thing software can show. A green suite on its own is not.
correctness_claim: false — it ran and this is what happened. We do not claim it is right.
None of these are made up. Ship AI code for a week and you will meet at least two.
That test was already passing before the fix. We run it before and after. Broken first, working after — that is a fix. Anything else is a story.
Agents wander. We list every file the change actually touched and flag the ones nobody asked for.
Or wrapped it so it can never fail. A green check you got by deleting the check is the most expensive green there is.
Most tools count a dead network as a broken change. So you hunt a bug that was never there. We tell you which one it was.
Plate 00 is a measured paired run — baseline 86.7% against
verified 100.0% within one session on 30 ledger tasks, +13.3pp
(95% CI +3.3 to +26.7). It is a different experiment from the
receipt at the top of this page: that one is
verifier_gate_ledger (73.3% → 96.7%, compared
across separate arms), this one is
paired_confirmatory_ledger (same units inside one
session). Both run 30 ledger tasks, which is why two different
pairs of numbers appear — both blocks are in the evidence JSON
under those names. The aggregate paired verdict did not reach
significance and the family gate did not pass, so read Plate
00 as directional, not proven. Validate against your own
repositories before making a deployment decision.
When an answer matters, everyone does the same thing: ask a second model, then a third, and take whatever two of them agree on. We ran that exact procedure on twenty ARC-AGI-2 puzzles. The vote got half. The best single model got seven in ten — for less than half the money.
We publish this because it points the wrong way for us.
Fanning a question out to more models is what our own engine
used to do, and we retracted that claim the day this run
finished. On this run the vote fixed nothing and broke four
answers that were already right. Agreement between the two
cheaper models was rare — 4 of the 20 puzzles — and right on
3 of those 4. Every one of those counts is in the evidence
JSON under
arc_agi2_majority_vote.
n = 20 · McNemar exact p = 0.125 — directional, not proven.
Pick what your AI just did. We copy your project, run the change, work out whether a failure was the code or the machine, and write the receipt.
Candidate patch modifies astropy/table.py to repair issue
behavior.
The patch applies cleanly, but we cannot call it correct. The test evidence came back inconclusive, and the shadow check flagged repair risk with no reproducible run behind it.
Starter is free forever and runs on your own machine. Paid plans add a hosted dashboard, shared projects, and exports. Audit work for companies lives on the enterprise page.
Bring your own key (BYOK) is required on every plan, including Starter. In plain terms: you use your own AI key, we do not resell model calls, and your AI provider bills you directly for the tokens. No key, no run — the API answers 401 and nothing executes.
Optional ensemble fan-out calls 2–5 of your own models in one run. You are still charged one call from your plan quota, but your provider bills the tokens for every member — a 3-member run uses roughly 3× the tokens of a single-model run. Agreement and consensus figures on the receipt are measurements, not an accuracy guarantee.
AdaptOrch runs generative AI models. Everything it hands back is AI-generated, labelled as such in the API response, and needs a human to look at it before you rely on it.
† AdaptOrch reports what it found. It never edits your code and never swaps in a different answer for you. Anything that would change a result stays switched off until we have paired evidence that it actually helps.
Move the sliders to your own numbers. This is the time you spend re-reading AI code that was never going to work.
Nobody can — not us, not your AI, not the person reviewing your pull request. Any tool that tells you otherwise is selling you something.
What we prove is narrower and real: it ran, here is exactly what it touched, here is what the tests said before and after, and here is how to run the whole thing again yourself. That is less than magic. It is still more than you have right now.
We also publish the checks we got wrong. On that synthetic ledger, verification improved 8 task outcomes and regressed 1. Both arms are in the file you can download.
If anything on this page promises more than we can show you, tell us. We will fix the page.
No. It checks the AI you already use. Keep Cursor, Claude Code, Codex, or whatever you have. AdaptOrch sits next to them and grades their work.
No, and neither can anyone else. What we prove is narrower and real: it ran, here is exactly what it touched, here is what the tests said, and here is how to run it again yourself.
No. It watches and reports. It does not rewrite your code, pick a different answer, or merge anything on your behalf.
On the 30-task ledger run we publish, the checked path took a median of 60 seconds and 126 seconds at the 95th percentile (gemma-4-31b on Cerebras — a synthetic suite, not your repo). Your number is mostly your test suite: we add a sandbox run and the check on top of whatever your tests already cost. It runs while you keep working and tells you when the receipt is ready.
We say so, in those words. A failed download is not a failed change, and we refuse to let you waste an hour finding that out yourself.
A crash, a broken import, a syntax error, or a test that used to pass and now does not — where the trail leads back to the change itself.
Never. Official results, hidden tests, and reference solutions are banned as inputs. A checker that has seen the answer key is not checking anything.
Yes, and with anything else that produces a code change — including your own scripts. We take the change, not the tool.
Every file the change touched, whether it ran, what the tests said before and after, anything suspicious we noticed, and a link that replays the whole check from scratch.
Yes. Starter is self-hosted and free. Companies that need it inside their own network can run a private version.
On Starter we never see it — it runs on your machine. On paid plans, reports store fingerprints and redacted text by default, not your raw source.
Only once it can show paired evidence — broken before, working after — on your own code. Until then it reports and you decide. We would rather be useful than impressive.
Point AdaptOrch at one change your AI made today. Read the receipt. If it tells you something you did not already know, keep it.