From 91aef5dfefa986cb87e4557b95970eeb6b149c03 Mon Sep 17 00:00:00 2001 From: DietrichGebert Date: Thu, 18 Jun 2026 19:25:18 +0200 Subject: [PATCH] docs(readme): note the up-to-94% peak in the hero line (#165) The hero showed only ~54% (the mean); the rigorous agentic run also reaches 94% on the over-build tasks (the date picker), so the headline now reads "~54% (up to 94%)". The sub-line is reworded so 80-94% reads as the per-task ceiling against a fair baseline, not the old single-shot figure, which would otherwise contradict the hero. Co-authored-by: Claude Opus 4.8 (1M context) --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 1c201f9..7962d5a 100644 --- a/README.md +++ b/README.md @@ -19,8 +19,8 @@

- ~54% less code · ~20% cheaper · ~27% faster · 100% safe
- Measured on real Claude Code sessions editing a real open-source repo (FastAPI + React), against the same agent with no skill. Mean across 12 feature tasks (Haiku 4.5, n=4). ponytail keeps every safety guard while a bare "write one-liners" prompt drops one. (An older single-shot test showed a larger 80-94% gap, but that counted a chatty model's prose; this is the honest multi-turn number.) Full writeup · reproduce it. + ~54% less code (up to 94%) · ~20% cheaper · ~27% faster · 100% safe
+ Measured on real Claude Code sessions editing a real open-source repo (FastAPI + React), against the same agent with no skill. ~54% is the mean across 12 feature tasks (Haiku 4.5, n=4); it reaches 94% where an agent over-builds (a date picker) and is near zero where the code is already minimal. ponytail keeps every safety guard while a bare "write one-liners" prompt drops one. (The earlier single-shot benchmark reported 80-94% as a flat figure; against a fair agentic baseline that is the per-task ceiling, not the average.) Full writeup · reproduce it.

---