Skip to content
tomo-labs

2026-07-16

Experiment reports captured on 2026-07-16, one tool on one task each, newest first.

Runs captured on 2026-07-16, newest first. Each is one tool on one task with the full trace read closely.

July 2026

Thursday, 16 July

20:41 python-2303, five free models The earlier python-2303 run left the five free zen models unmeasured, since the free tier was rate limited all session, and it guessed the defensive-coding paragraph would matter most for a weak model. This run measures them. 17:04 python-2303, code-as-action wins An earlier run called kubernetes-client python-2303 an unwinnable hidden-contract coin flip for tomo-cx, the structured-tools engine, which lost every one of five attempts on three gpt-5.6 models. 15:14 new OI is a Codex fork, ~2x the cost Open Interpreter's Python code-as-action loop ended at 0.4.2, and its main line is now a Rust program, a fork of OpenAI Codex tuned for low-cost models. The lab's openinterpreter column now tracks that rewrite, release rust-v0.0. 11:11 oi dialect zoo, four fences A cheap model told to write a Markdown code fence keeps its shell or python command but wraps it in a different costume from turn to turn, and tomo's oi engine only read the Markdown one. 06:19 oi glued fence, a cheap-model harness fix tomo's oi engine acts by writing fenced code blocks, so its block parser is on the hot path of every round. A cheap model routinely writes a closing fence glued straight onto the next opening fence, with no blank line between them, so two fence lines arrive as one. 03:39 bridge cache hole and prompt_cache_key The 2026-07-15 dynaconf run named the bridge's zero percent cache-read rate as its most actionable finding, so this run tries to close it. 02:59 cx compaction mirage under prefix cache Tomo's cx engine rebuilds every request as the whole conversation plus the running turn, so an offline replay of six recorded runs showed a 76 to 86 percent cut in wire bytes once older tool results are stubbed. That headline did not survive the live check.