gemini-1.5-pro

Google

legacy model Its test configurations are retired, so it is no longer run. The figures are from its best legacy runs, scored as they ran at the time; it is not ranked.

average
46.0
benchmarksof 12
3
seconds per inputmean response time
16.1

By benchmark

BenchmarkScoreThe best legacy run on each benchmark, on the benchmark's metric scaled to 0–100. ± is the 95% sampling margin, from resampling the run's inputs.RankRank among all current models on that benchmark; ≈ for models that cannot be told apart within sampling error. Legacy models are not ranked.Per 1,000 docss / inputBest run
Bibliographic Dataolder run 28.0 – –– run 17.71 T0030 · 8 Apr 2025prompt.txt
Business Lettersolder run 46.0 – –– run 5.97 T0016 · 1 Apr 2025prompt.txt
Fraktur Advertsolder run 63.9 – –– run 24.7 T0089 · 9 May 2025prompt_optimized.txt

Not run on: Blacklist Cards, Book Advert XML Repair, Company Lists, Duty Rosters, General Meeting Minutes, Library Cards, Magazine Pages, Medieval Manuscripts, Personnel Cards.

Every run

  1. T0089Fraktur Adverts9 May 2025 · legacy configuration63.9–
  2. T0089Fraktur Adverts7 May 2025 · legacy configuration42.3–
  3. T0016Business Letters11 Apr 2025 · all 57 letters · legacy configuration46.0–
  4. T0030Bibliographic Data8 Apr 2025 · legacy configuration28.0–
  5. T0016Business Letters1 Apr 2025 · all 57 letters · legacy configuration46.0–
  6. T0016Business Letters5 Mar 2025 · all 57 letters · legacy configuration45.0–