AI-Roundtable Ranking — one entry per benchmark run — Tax law

Tax law 2026-09-10: Claude Opus 5 (89)

2026-09-10T06:41:54.000Z

Tax law: Claude Opus 5 89/100.

In Tax law, Claude Opus 5 (top score) contradicts a stored key fact on average 0,3 times per answer and adds avg 3,9 claims the judge panel flags as false or unsupported; 100 % of answers carry at least one flag. The lowest value is Gemini 3.1 Pro at avg 1,0 per answer. Relative to answer length: 0,59 per 1000 output tokens, lowest DeepSeek V4 Pro at 0,26.

Full run with confidence intervals, diff to the previous run and raw data

Tax law 2026-09-07: Claude Opus 5 (82)

2026-09-07T18:18:39.000Z

Tax law: Claude Opus 5 82/100.

In Tax law, Claude Opus 5 (top score) contradicts a stored key fact on average 1,0 times per answer and adds avg 2,4 claims the judge panel flags as false or unsupported; 100 % of answers carry at least one flag. The lowest value is Grok 4.5 at avg 1,2 per answer. Relative to answer length: 0,43 per 1000 output tokens, lowest DeepSeek V4 Pro at 0,26.

Full run with confidence intervals, diff to the previous run and raw data

Tax law 2026-08-01: Claude Opus 4.7 (75)

2026-08-01T05:54:40.000Z

Tax law: Claude Opus 4.7 75/100.

In Tax law, Claude Opus 4.7 (top score) contradicts a stored key fact on average 0,5 times per answer and adds avg 1,6 claims the judge panel flags as false or unsupported; 100 % of answers carry at least one flag. The lowest value is Gemini 3.1 Pro at avg 1,3 per answer. Relative to answer length: 1,60 per 1000 output tokens, lowest GPT-5.6 Sol at 0,27.

Full run with confidence intervals, diff to the previous run and raw data

Tax law 2026-07-19: Claude Opus 4.7 (78)

2026-07-19T12:01:08.000Z

Tax law: Claude Opus 4.7 78/100.

In Tax law, Claude Opus 4.7 (top score) contradicts a stored key fact on average 0,5 times per answer and adds avg 1,9 claims the judge panel flags as false or unsupported; 100 % of answers carry at least one flag. The lowest value is Grok 4.5 at avg 1,2 per answer. Relative to answer length: 1,72 per 1000 output tokens, lowest GPT-5.6 Sol at 0,27.

Full run with confidence intervals, diff to the previous run and raw data

Tax law 2026-06-21: Claude Opus 4.7 (74)

2026-06-21T14:39:14.000Z

Tax law: Claude Opus 4.7 74/100.

In Tax law, Claude Opus 4.7 (top score) contradicts a stored key fact on average 0,5 times per answer and adds avg 1,8 claims the judge panel flags as false or unsupported; 100 % of answers carry at least one flag. The lowest value is Gemini 3.1 Pro at avg 0,9 per answer. Relative to answer length: 1,89 per 1000 output tokens, lowest GPT-5.5 Pro at 0,13.

Full run with confidence intervals, diff to the previous run and raw data

Tax law 2026-05-29: Claude Opus 4.7 (71)

2026-05-29T04:35:00.000Z

Tax law: Claude Opus 4.7 71/100.

In Tax law, Claude Opus 4.7 (top score) contradicts a stored key fact on average 0,5 times per answer and adds avg 2,0 claims the judge panel flags as false or unsupported; 100 % of answers carry at least one flag. The lowest value is Claude Opus 4.8 at avg 1,4 per answer. Relative to answer length: 1,95 per 1000 output tokens, lowest GPT-5 at 0,83.

Full run with confidence intervals, diff to the previous run and raw data