Benchmarks Studio · blind comparison

Judge the work before you know who made it.

One frozen brief, passed unchanged to every recorded configuration, three times each. The labels, model ids and judge results stay hidden until you record a choice. The choice is written to the server record, not to this browser, so it survives a reload and survives this device.

Task
Build a one-page project home v1
Brief hash
sha256:c9609d7d70cd24c…
Recorded
2026-11-15 08:42 UTC
Source
1c97c3d · link on the run record
Sample
3 configurations · 9 takes · 9 pairs

A preference recorded here is one unauthenticated label's judgement of these recorded takes. It is not a model leaderboard, a provider invoice, a deployment claim or proof of the owner's judgement.

How the blind reveal works

  1. Open both takes in a pair. The previews are the committed pages, mounted from an opaque route.
  2. Choose A is better, B is better, Tie or Can't tell. The server resolves the pair and appends a submission.
  3. The response reveals the two configuration labels and the judge's deterministic results. Reloading the page restores the reveal for this browser token.
  4. After a recorded observation, Record another observation appends a second row. The earlier row is kept and both are counted.
  5. If you need to see the labels before choosing, use Reveal without choosing. That is recorded as unblinded and is never counted as a blind preference.

A self-declared display label, not a sign-in. It is stored with the observation; no email, account id or commenter data is written.

Observations are unauthenticated. Submissions are stored server-side, but this page does not sign anyone in. Anyone can submit under any reviewer label and any browser token. The record counts independent submissions, not verified people; a label called “owner” is not the owner's verified judgement. A random token in this browser's localStorage restores this browser's own observations and is published only as a hash.

The authoritative record is server-side but unauthenticated. Checking the record…

0 of 9 pairs have a submission from this browser. Votes are unauthenticated.

Nine pairs, labels hidden

Pair order and the A/B side are derived from the run, not from configuration order, so the layout does not encode the answer. Preview addresses name only the run, the pair and the side; the server maps them back to the committed trial files.

Pair 1

Two recorded takes. Judge the work, not the name.

Pair 1

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

Pair 2

Two recorded takes. Judge the work, not the name.

Pair 2

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

Pair 3

Two recorded takes. Judge the work, not the name.

Pair 3

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

Pair 4

Two recorded takes. Judge the work, not the name.

Pair 4

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

Pair 5

Two recorded takes. Judge the work, not the name.

Pair 5

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

Pair 6

Two recorded takes. Judge the work, not the name.

Pair 6

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

Pair 7

Two recorded takes. Judge the work, not the name.

Pair 7

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

Pair 8

Two recorded takes. Judge the work, not the name.

Pair 8

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

Pair 9

Two recorded takes. Judge the work, not the name.

Pair 9

Loading the recorded page…

Take ALabels and judge results stay hidden until you record a choice.

Loading the recorded page…

Take BLabels and judge results stay hidden until you record a choice.

What this comparison does not prove