Files
buzz/benchmarks
Eva a3624185eb bench: add the Meli solo cells -- gmicloud pin (run 1) and baseten/fp8 pin (run 2)
Commits the tb21 Meli-solo condition that until now lived only as
untracked files on the runner box, plus the take-2 variant Tyler asked
for (thread 74a65a09, event f7457e0b):

- tb-meli-solo.yaml + personas/bench/meli-solo.md: the exact manifest
  and persona (sha256 de633019...) that produced run tb21-solo-1 on the
  gmicloud/fp8 pin. Recorded for provenance.
- tb-meli-solo-baseten.yaml: identical cell, condition
  tb-meli-solo-baseten, priced at the baseten/fp8 listed rates
  (prompt $0.13/M, completion $0.26/M — OpenRouter endpoints API,
  2026-08-07).
- testbed/endpoints/openrouter-baseten.json: the provider pin,
  OPENROUTER_PROVIDER_ORDER=baseten/fp8. A separate endpoint file so
  openrouter-live.json (which run 1's provenance points at) stays
  byte-identical.

Run 2 executes on the post-merge harness (9cafe8f1, PR #5145), which
carries #4896 (vision-input recovery) and #5136 (explicit-mention task
post) that run 1 predated.

Originating Buzz thread:
buzz://message?channel=c3252dd2-0142-4e01-88c7-a2183c3960a5&id=74a65a0990fd2197882b66b5ea2707169d4a3dbd2020d1610c45150fb99f140b

Co-authored-by: Eva <011987e296fd5006292d2f930b574be47c7801048d1983c46c425d3c95f0cffd@buzz.block.builderlab.xyz>
Signed-off-by: Eva <011987e296fd5006292d2f930b574be47c7801048d1983c46c425d3c95f0cffd@buzz.block.builderlab.xyz>
2026-08-18 13:04:01 -05:00
..