RISE Humanities Data Benchmark, 0.5.2-pre1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV

Your search for Benchmark 'magazine_pages__true' with Search Hidden 'False' returned 80 results, showing page 1 of 8.
Result 1 of 80

Test T1114 at 2026-06-08

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Providerx-ai
Modelgrok-4.3
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score61.80 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 125.3K IT + 3.0K OT = 128.3K TTCost: 0.157$ + 0.008$ = 0.164$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 2 of 80

Test T1140 at 2026-06-05

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Provideropenrouter
Modelstepfun/step-3.7-flash-20260528
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score12.00 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 57.0K IT + 211.1K OT = 268.1K TTCost: 0.011$ + 0.243$ = 0.254$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 3 of 80

Test T1127 at 2026-06-05

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Provideropenrouter
Modelmeta-llama/llama-4-scout-17b-16e-instruct
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score0.00 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 109.8K IT + 4.7K OT = 114.5K TTCost: 0.009$ + 0.001$ = 0.010$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 4 of 80

Test T0796 at 2026-06-04

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Providermistral
Modelmistral-small-2506
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score3.40 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 27.0K IT + 949 OT = 28.0K TTCost: 0.003$ + 0.000$ = 0.003$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 5 of 80

Test T1075 at 2026-06-04

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Provideropenrouter
Modelqwen/qwen3.7-plus-20260602
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score10.90 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 128.2K IT + 7.8K OT = 136.0K TTCost: 0.051$ + 0.012$ = 0.064$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 6 of 80

Test T0795 at 2026-06-04

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Providermistral
Modelmagistral-medium-2509
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score7.60 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 49.1K IT + 4.0K OT = 53.1K TTCost: 0.098$ + 0.020$ = 0.118$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 7 of 80

Test T0771 at 2026-06-04

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Providermistral
Modelpixtral-large-2411
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score1.10 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 29.5K IT + 1.2K OT = 30.7K TTCost: 0.059$ + 0.007$ = 0.066$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 8 of 80

Test T0808 at 2026-06-04

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Providermistral
Modelministral-14b-2512
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score36.40 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 112.9K IT + 4.8K OT = 117.8K TTCost: 0.023$ + 0.001$ = 0.024$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 9 of 80

Test T0810 at 2026-06-04

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Providermistral
Modelmagistral-small-2509
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score2.20 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 22.1K IT + 778 OT = 22.9K TTCost: 0.011$ + 0.001$ = 0.012$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752
Result 10 of 80

Test T0807 at 2026-06-04

{'century': [20], 'document-type': ['newspaper-page'], 'language': ['en'], 'layout': ['prose', 'columns'], 'script': ['latin'], 'task': ['document-understanding'], 'writing': ['printed']}

Configuration
Providermistral
Modelmistral-large-2512
  
Temperature0.0
DataclassMagazinePage
  
Normalized Score18.10 %
Test timeunknown seconds
Prompt 

Extract all advertisements and return their bounding boxes.
The original size of the page is {width} x {height} pixels.

Results 

no valid result

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
n/a n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/a, n/a. Tokens: 78.6K IT + 3.3K OT = 81.8K TTCost: 0.039$ + 0.005$ = 0.044$
Cite: Hindermann, Marti, Alberto, et al., (2025). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.16941752