All runs
One official ranking run per month, permanently addressable.
One entry per run with date, panel, item count and question-bank version. Each detail page freezes the leaderboard for exactly that run — score, confidence interval, hallucination rate per domain and the diff to the previous run — and links the raw data. This is the URL to cite.
Machine-readable: /runs/latest.json · /runs/index.json · /feed.xml (Atom) · /rss.xml
· per domain Steuerrecht, Medizin, Jura, Wirtschaftsrecht
Official runs (6)
| Date | Run-ID | Models | Items | Recommendation · score | Domain winners | Question bank |
|---|---|---|---|---|---|---|
| 2026-09-10 | run-20260910T064154-bada0b | 14 | 126 | Claude Opus 5 · 88 | Tax law Claude Opus 5 Medicine Claude Opus 5 Law Claude Fable 5.1 Business law Claude Opus 5 | 2026-09-09-v5 |
| 2026-09-07 | run-20260907T181839-5742df | 14 | 100 | Claude Opus 5 · 86 | Tax law Claude Opus 5 Medicine Claude Fable 5.1 Law Claude Opus 5 Business law Claude Opus 5 | 2026-05-17-v1 |
| 2026-08-01 | run-20260801T055440-452791 | 9 | 100 | Claude Opus 4.7 · 81 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5.6 Sol | 2026-05-17-v1 |
| 2026-07-19 | run-20260719T120108-c40839 | 9 | 100 | Claude Opus 4.7 · 80 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law Claude Opus 4.7 | 2026-05-17-v1 |
| 2026-06-21 | run-20260621T143914-12112d | 9 | 100 | GPT-5.5 Pro · 80 | Tax law Claude Opus 4.7 Medicine GPT-5.5 Pro Law Claude Opus 4.7 Business law GPT-5.5 Pro | 2026-05-17-v1 |
| 2026-05-29 | run-20260529T043500-b4ffe0 | 6 | 100 | Claude Opus 4.7 · 79 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
Development runs (25)
Roster tests, interim runs after model changes and the May 2026 pilot runs. Fully archived and individually addressable, but not in the feed and not on the homepage — one official run per calendar month, so subscribers never see three conflicting rankings in one week.
| Date | Run-ID | Models | Items | Best model · score | Domain winners | Question bank |
|---|---|---|---|---|---|---|
| 2026-09-04 | run-20260904T151155-c623e0 | 14 | 100 | Claude Opus 5 · 86 | Tax law Claude Opus 5 Medicine Claude Opus 5 Law Claude Opus 5 Business law Claude Opus 5 | 2026-05-17-v1 |
| 2026-09-01 | run-20260901T060205-7d51d0 | 9 | 100 | Claude Opus 4.7 · 78 | Tax law Kimi K3 Medicine GPT-5.6 Sol Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-07-15 | run-20260715T040307-80bf67 | 9 | 100 | Claude Opus 4.7 · 79 | Tax law Claude Opus 4.7 Medicine GPT-5.6 Sol Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-07-11 | run-20260711T103548-436ac1 | 9 | 100 | Claude Opus 4.7 · 79 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-07-01 | run-20260701T043526-2a195e | 9 | 100 | Claude Opus 4.7 · 80 | Tax law Claude Opus 4.7 Medicine GPT-5.5 Pro Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-06-20 | run-20260620T073912-d2125c | 8 | 100 | Claude Opus 4.7 · 80 | Tax law Claude Opus 4.7 Medicine GPT-5.5 Pro Law Claude Opus 4.7 Business law GPT-5.5 Pro | 2026-05-17-v1 |
| 2026-06-19 | run-20260619T195640-4ce8c8 | 8 | 100 | Claude Opus 4.7 · 78 | Tax law Claude Opus 4.7 Medicine GPT-5.5 Pro Law Claude Opus 4.7 Business law GPT-5.5 Pro | 2026-05-17-v1 |
| 2026-06-18 | run-20260618T165158-d2543a | 7 | 100 | Claude Opus 4.7 · 80 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-06-15 | run-20260615T043639-30c761 | 6 | 100 | Claude Opus 4.7 · 79 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-06-07 | run-20260607T181746-23cbb6 | 6 | 100 | Claude Opus 4.7 · 81 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-05-28 | run-20260528T202802-6ce096 | 5 | 100 | Claude Opus 4.7 · 79 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-05-20 | run-20260520T074328-4a549c | 5 | 100 | Claude Opus 4.7 · 76 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-05-18 | run-20260518T043700-b4a380 | 5 | 100 | Claude Opus 4.7 · 79 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-05-17 | run-20260517T131406-f96128 | 5 | 100 | Claude Opus 4.7 · 79 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-17-v1 |
| 2026-05-16 | run-20260516T200347-bc6991 | 5 | 33 | Claude Opus 4.7 · 76 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-08-pilot |
| 2026-05-16 | run-20260516T101429-0435c4 | 5 | 33 | Claude Opus 4.7 · 78 | Tax law Claude Opus 4.7 Medicine GPT-5 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-08-pilot |
| 2026-05-14 | run-20260514T075711-8acb3a | 4 | 99 | Claude Opus 4.7 · 75 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-08-pilot |
| 2026-05-12 | run-20260512T135155-40f852 | 4 | 33 | Claude Opus 4.7 · 77 | Tax law Claude Opus 4.7 Medicine GPT-5 Law Claude Opus 4.7 Business law Claude Opus 4.7 | 2026-05-08-pilot |
| 2026-05-12 | run-20260512T105829-f0ac95 | 4 | 33 | Claude Opus 4.7 · 78 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-08-pilot |
| 2026-05-12 | run-20260512T081552-d5fb45 | 4 | 33 | Claude Opus 4.7 · 77 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-08-pilot |
| 2026-05-11 | run-20260511T051320-09184c | 4 | 99 | Claude Opus 4.7 · 75 | Tax law Claude Opus 4.7 Medicine GPT-5 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-08-pilot |
| 2026-05-10 | run-20260510T190628-59fc01 | 4 | 33 | Claude Opus 4.7 · 76 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-08-pilot |
| 2026-05-10 | run-20260510T175034-5e294d | 4 | 33 | Claude Opus 4.7 · 77 | Tax law Claude Opus 4.7 Medicine GPT-5 Law Claude Opus 4.7 Business law GPT-5 | 2026-05-08-pilot |
| 2026-05-10 | run-20260510T164305-2c7b16 | 4 | 33 | Claude Opus 4.7 · 78 | Tax law GPT-5 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law Claude Opus 4.7 | 2026-05-08-pilot |
| 2026-05-10 | run-20260510T121001-e3a863 | 4 | 33 | Claude Opus 4.7 · 77 | Tax law Claude Opus 4.7 Medicine Claude Opus 4.7 Law Claude Opus 4.7 Business law Claude Opus 4.7 | 2026-05-08-pilot |
Rule for “official”: since code_version 0.2.10 the cron run sets a flag in the MANIFEST; older runs count as official when they are the last full run (≥ 50 items, non-pilot bank) of their calendar month. Runs are never altered after publication (append-only) — the one exception is a documented single-model merge, shown as “merged” on the detail page.