22
July 2026
Wednesday, 22 July
faithful swebench-live container, deepseek three-way
We were grading swebench-live wrong. The old path built one shared image and ran every task in a host venv pinned to Python 3.12, which is not the environment the task ships with.
laguna-s three-way comparison
Poolside's Laguna-S-2.1 is a 118B mixture-of-experts coder, free to call on the opencode.ai/zen tier as laguna-s-2.1-free.
pi + laguna-s, incomplete
Third of the three per-tool boards on laguna-s-2.1-free, and the one that did not finish. pi was the last tool in the sweep, and by the time it started the free zen account was already deep into its rate-limit window from the two streams ahead of it.
opencode + laguna-s, partial board
Second of the three per-tool boards on laguna-s-2.1-free. OpenCode, the containerized coding agent, runs the same swebench-live tasks through the same free zen endpoint.
tomo-agent + laguna-s, fair board
Poolside shipped Laguna-S-2.1, a 118B mixture-of-experts coder, and opencode.ai/zen serves it free as laguna-s-2.1-free. This runs the whole fifteen-task swebench-live board against it through tomo's own agent engine, the one that drives native structured tool_calls.