University of Basel RISE · Research and Infrastructure SupportHumanities Data Benchmark

fireworks/ember-1

Fireworks AIvia OpenRouter
average±3.8 (95%)
79.5
leaderboard rankof 114
≈25
benchmarksof 12
12
per 1,000 documentsmean over its benchmarks
$115
seconds per inputmean response time
112.1
Compare with other models Its row in the Matrix All its test runs

By task

  • Data correction

    76.0

    Best of 114 models with all its benchmarks: claude-opus-5-5, 82.7.

  • Document understanding

    91.8

    Best of 107 models with all its benchmarks: gpt-6-astra, 97.0.

  • Information extraction

    87.6

    Best of 107 models with all its benchmarks: grok-4.6, 90.8.

  • Transcription

    62.7

    Best of 114 models with all its benchmarks: gemini-4-argon, 96.2.

By benchmark

BenchmarkScoreThe best current run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error.Per 1,000 docss / inputBest run
Bibliographic Dataother prompt 97.9±1.7 ≈8of 115 $112$0.56 run 73.94 T2152 · 24 Oct 2026prompt_v2.txt
Blacklist Cards 90.8±3.9 ≈51of 114 $29$0.96 run 16.66 T2159 · 25 Oct 2026prompt.txt
Book Advert XML Repairother prompt 57.9±10.1 ≈1of 119 $71$3.53 run 58.95 T2161 · 25 Oct 2026prompt_v2.txt
Business Letters 61.0±6.6 ≈24of 114 $57$3.27 run 33.65 T2153 · 25 Oct 2026prompt.txt
Company Listsother prompt 97.3±2.1 ≈1of 114 $100$1.51 run 75.65 T2160 · 25 Oct 2026prompt_v2.txt
Duty Rosters 86.6±2.9 ≈18of 107 $213$4.48 run 168.77 T2165 · 25 Oct 2026prompt.txt
Fraktur Adverts 76.9±37.7 ≈32of 114 $187$0.94 run 280.08 T2156 · 25 Oct 2026prompt_optimized.txt
General Meeting Minutes 88.7±8.0 ≈1of 108 $216$1.94 run 157.16 T2164 · 25 Oct 2026prompt.txt
Library Cardsother prompt 90.8±1.3 ≈1of 114 $28$7.31 run 17.95 T2157 · 25 Oct 2026prompt_year-string.txt
Magazine Pagesother prompt 94.7±4.9 ≈1of 115 $54$2.46 run 35.74 T2163 · 25 Oct 2026prompt_explicit-json.txt
Medieval Manuscripts 17.0±18.9 ≈107of 114 $243$2.92 run 384.97 T2158 · 25 Oct 2026prompt.txt
Personnel Cards 94.2±3.9 ≈58of 114 $65$3.98 run 41.57 T2162 · 25 Oct 2026prompt.txt

Price

FromInput, $ per million tokensOutput, $ per million tokensSource
24 Oct 20263.015.0archived price page

Every run

  1. T2165Duty Rosters25 Oct 202686.6$4.48
  2. T2164General Meeting Minutes25 Oct 202688.7$1.94
  3. T2163Magazine Pages25 Oct 202694.7$2.46
  4. T2162Personnel Cards25 Oct 202694.2$3.98
  5. T2161Book Advert XML Repair25 Oct 202657.9$3.53
  6. T2160Company Lists25 Oct 202697.3$1.51
  7. T2159Blacklist Cards25 Oct 202690.8$0.96
  8. T2158Medieval Manuscripts25 Oct 202617.0$2.92
  9. T2157Library Cards25 Oct 202690.8$7.31
  10. T2156Fraktur Adverts25 Oct 202676.9$0.94
  11. T2155Business Letters25 Oct 2026 · 32 signed letters64.0$1.41
  12. T2154Business Letters25 Oct 2026 · 25 unsigned letters61.0$1.00
  13. T2153Business Letters25 Oct 2026 · all 57 letters61.0$3.27
  14. T2152Bibliographic Data24 Oct 202697.9$0.56