Hashline editing: The failure

One engineer. The most fashionable trick in AI coding. And the eval that says it doesn't help. In Episode 02, I test the first of many harness mechanisms that are supposed to win the bet: hashline editing — the anchor-based edit trick a viral blog post claims took a cheap model from 6.7% to 68.3% on an editing benchmark. Same model, different edit tool, ten times better. So I built it. Two weeks ago. And then — this is the embarrassing part — I shipped it without ever testing whether it worked on my models. This episode is me finally testing it. On camera. With the bill shown. What's in it: The trick. What hashline / anchor editing actually is, and the failure mode it's built to prevent — the agent editing a file that drifted underneath it. The confession. I added a mechanism to the harness before I measured it. The someone who didn't test it is me. The someone is always me. The experiment. Four cheap open-source models. Three conditions — hashlines off, optional, forced. Same tasks, same grader, no cherry-picking. The result. Three completely different responses to the same toggle. One model went 1/8 → 6/8 — six times the score, and ten times the bill (3¢ → 30¢). One didn't care at all. The model I actually ship got slightly worse. The receipt. Same task, same perfect 8/8 score: 1.3¢ on DeepSeek v4, $1.37 on GLM 5.1. A 100× cost gap living inside the "cheap" tier. The verdict: the fashionable trick doesn't help. Not universally, not for free, and not for the model I run. A harness mechanism only pays off when the task's failure mode is the exact one it fixes — and most of the time, it isn't. The labs sell you the expensive model. The influencers sell you the trick. I'm selling you the eval. It's going to be Ugly. That's the whole point. ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 🔔 Subscribe so you don't miss the part where the trick I built doesn't work ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ LINKS 🌐 Platform → https://ugly.bot 🛠 Studio (download) → https://ugly.bot/studio 📦 Framework → https://www.npmjs.com/package/ugly-app 💻 GitHub → https://github.com/justinmann 💼 LinkedIn →   / thejustinmann   ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ #codingagent #claudecode #opensource #glm #deepseek #hashline #llm #softwareengineering #developertools #indiehackers #aicoding #buildinpublic #UglyStudio