RISE Humanities Data Benchmark, 0.6.1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results
Show compact results Refine Search New Search
Download JSON Download CSV

Your search for Benchmark 'bibliographic_data__true' with Search Hidden 'False' returned 208 results, showing page 10 of 21.
Result 91 of 208

Test T1630 at 2026-08-18

book-page information-extraction printed 20 en list bibliographic

openrouter z-ai/glm-5v-turbo · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.3%

{"metadata":{"title":"Bibliography","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"Abridgement of vols. I-VI of A Study of History","publisher":"Oxford","editor":["D. C. Somervell"],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":null,"author":null,"note":null,"publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":null,"event_date":"15-20 November, 1946","related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"146","type":"journal-article","title":"Storia e materialismo storico","container_title":null,"author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"145","volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"147","type":"journal-article","title":"Critica del giudizio storico","container_title":null,"author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"145","volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"148","type":"journal-article","title":"Forza e spirito nella storia","container_title":null,"author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"145","volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"150","type":"journal-article","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":null},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring

Fuzzy score66.9%

Speed

Model time, all inputs438.2 s
Mean per input87.64 s
Slowest input102.82 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens22.1K
Output tokens17.5K
Total tokens39.6K
Input cost$0.0266
Output cost$0.07
Total cost$0.0965

Priced from 2026-08-18 · Input $/M $1.20 · Output $/M $4.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 92 of 208

Test T1600 at 2026-08-18

book-page information-extraction printed 20 en list bibliographic

x-ai grok-4.6 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.3%

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"abridged by D. C. Somervell (Abridgement of vols. I-VI of A Study of History)","publisher":"Oxford","editor":["D. C. Somervell"],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"145","type":"other","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":null,"author":null,"note":"Relevant articles:","publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":null,"event_date":"15-20 November, 1946","related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"146","type":"journal-article","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"147","type":"journal-article","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"148","type":"journal-article","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"150","type":"other","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":false},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring

Fuzzy score69.1%

Speed

Model time, all inputs553.1 s
Mean per input110.62 s
Slowest input128.91 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens17.5K
Output tokens12.3K
Total tokens29.9K
Input cost$0.0351
Output cost$0.074
Total cost$0.247
Reasoning cost usd$0.1379
Total reasoning tokens23K

Priced from 2026-08-18 · Input $/M $2.00 · Output $/M $6.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 93 of 208

Test T1615 at 2026-08-18

book-page information-extraction printed 20 en list bibliographic

openrouter meta/muse-spark-1.2 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score41.1%

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"Abridgement of vols. I-VI of A Study of History","publisher":"Oxford","editor":null,"publisher_place":"New York","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"10","fascicle":null,"reprint":null,"edition":"abridged by D. C. Somervell","incomplete":false},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia","container_title":null,"author":[],"note":"Relevant articles: 146, 147, 148","publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":"1947","event_date":"15-20 November, 1946","related":null,"relation":null,"volume":null,"page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"146","type":"book","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"I, 109-117","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"147","type":"book","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"I, 281-290","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"148","type":"book","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"I, 191-200","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"II, 623-634","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"150","type":"book","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":"1947","event_date":null,"related":null,"relation":null,"volume":"89-106","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"II, 57-85","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"10","fascicle":"3-4","reprint":"reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":false},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"XXXVIII, 11-18","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III, 153-175","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"CCLIV, 166-184","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III, 44-53","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"LII, 231-246","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"VIII, 39-65","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"XVI, 59-69","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III, 23-24","page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring

Fuzzy score70.9%

Speed

Model time, all inputs1284.1 s
Mean per input256.83 s
Slowest input663.74 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens21.1K
Output tokens22.1K
Total tokens43.2K
Input cost$0.0264
Output cost$0.094
Total cost$0.1204

Priced from 2026-08-18 · Input $/M $1.25 · Output $/M $4.25

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 94 of 208

Test T1525 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

huggingface MiniMaxAI/MiniMax-M3 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score0.0%

{}

Scoring

Fuzzy score20.6%

Speed

Model time, all inputs1773.3 s
Mean per input354.66 s
Slowest input449.97 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens7.6K
Output tokens3.7K
Total tokens11.3K
Input cost$0.0021
Output cost$0.0041
Total cost$0.0062

Priced from 2026-08-15 · Input $/M $0.28 · Output $/M $1.10

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 95 of 208

Test T1510 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

huggingface Qwen/Qwen3-VL-235B-A22B-Instruct · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score29.5%

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"{\"id\": 140, \"page\": 10}","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":[],"publisher_place":"London","issued":null,"event_date":null,"related":[],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 141, \"page\": 10}","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"abridged by D. C. Somervell","publisher":"Oxford","editor":[],"publisher_place":"New York","issued":null,"event_date":null,"related":[],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":"Abri
degement of vols. I-VI of A Study of History","edition":null,"incomplete":false},{"id":"{\"id\": 142, \"page\": 10}","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":[],"publisher_place":"Utrecht, Antwerpen","issued":null,"event_date":null,"related":[],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 143, \"page\": 10}","type":"book","title":"Esquemas de metodologia eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":[],"publisher_place":"Barcelona","issued":null,"event_date":null,"related":[],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 144, \"page\": 10}","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":[],"publisher_place":"Bonn","issued":null,"event_date":null,"related":[],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 145, \"page\": 10}","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":null,"author":[],"note":"Relevant articles:","publisher":"Castellani","editor":[],"publisher_place":"Milano","issued":null,"event_date":"15-20 November, 1946","related":[],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 146, \"page\": 10}","type":"journal-article","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":"{\"id\": 145, \"page\": 10}","volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 147, \"page\": 10}","type":"journal-article","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":"{\"id\": 145, \"page\": 10}","volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 148, \"page\": 10}","type":"journal-article","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":"{\"id\": 145, \"page\": 10}","volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 149, \"page\": 10}","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 150, \"page\": 10}","type":"book","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":null,"event_date":null,"related":[],"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 151, \"page\": 10}","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 152, \"page\": 10}","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":"Einaudi","editor":[],"publisher_place":"Torino","issued":"1959","event_date":null,"related":[],"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"reprinted in D. Cantimori, Studi di storia","edition":null,"incomplete":false},{"id":"{\"id\": 153, \"page\": 10}","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 154, \"page\": 10}","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 155, \"page\": 10}","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 156, \"page\": 10}","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 157, \"page\": 10}","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 158, \"page\": 10}","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 159, \"page\": 10}","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"{\"id\": 160, \"page\": 10}","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":[],"publisher_place":null,"issued":null,"event_date":null,"related":[],"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring

Fuzzy score60.7%

Speed

Model time, all inputs1098.3 s
Mean per input219.66 s
Slowest input424.88 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens14.3K
Output tokens14.6K
Total tokens28.9K
Input cost$0.0029
Output cost$0.0129
Total cost$0.0157

Priced from 2026-08-15 · Input $/M $0.20 · Output $/M $0.88

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 96 of 208

Test T1555 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

huggingface thinkingmachines/Inkling · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score0.0%

We need parse image page 10 (actually page number printed 9? Wait additional info says page number of this page is 10. The printed page number at top right is 9, but we should use 10 for metadata page_number? The schema has metadata with title, year, page_number. Need determine title and year. The header shows "1947 BIBLIOGRAPHY 9". So year 1947, title "BIBLIOGRAPHY". Page number given as 10. So metadata: {"title":"BIBLIOGRAPHY","year":"1947","page_number":10}.

Now need extract entries 140-160, with possible incomplete last entry 160? Let's examine image carefully.

Entries:
140 Smellie, K. B., Why We Read History, London: P. Elek.
141 Toynbee, Arnold J., A Study of History, abridged by D. C. Somervell, New York: Oxford (Abridgement of vols. I-VI of A Study of History).
142 Verberne, L. G. J., In den spiegel van het verleden: historische opstellen, Utrecht, Antwerpen: Bruna.
143 Vevir, José, Esquemas de metodología eclesiástica, Barcelona: Instituto.
144 Walz, Hans H., Sinn und Ziel der Geschichte, Bonn: Universitäts-Verlag.

Then section "Articles"

145 Atti del congresso internazionale di filosofia 15-20 November, 1946, Milano: Castellani.
Relevant articles:
146 Pietro C. Drago, "Storia e materialismo storico", vol. I, 109-117.
147 Vito Fazio-Allmayer, "Critica del giudizio storico", vol. I, 281-290.
148 A. Nyman, "Forza e spirito nella storia", vol. I, 191-200.
149 Benjamin, Walter, "Sur le concept d'histoire", Les temps modernes II, 623-634.
150 Boodin, John E., "Philosophy of History", in Dagobert D. Runes, ed., 20th Century Philosophy, New York: Philosophical Library, 89-106.
151 Caillois, R. P., "De la perception à l'histoire. La philosophie de M. Merleau-Ponty", Deucation II, 57-85. (Note "Deucation"? Actually "Deucation"? Let's keep as printed.)
152 Cantimori, Delio, "Commemorazione di Adolfo Omodeo", Annali della Scuola Normale di Pisa, fasc. 3-4; (reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959).
153 Cowan, Thomas, "The Historian and the Philosophy of Science", Isis XXXVIII, 11-18.
154 Crawford, R. M., "History as a Science", Historical Studies: Australia and New Zealand III, 153-175.
155 Danielou, J., "Christianisme et histoire", Etudes CCLIV, 166-184.
156 Dell, Stanley, "Wahrheit der Geschichte. Geschichte der Wahrheit", Amerikanische Rundschau III, 44-53.
157 Fay, Sidney B., "The Idea of Progress", American Historical Review LII, 231-246.
158 Fessard, Gaston, "Théologie et histoire", Dieu vivant VIII, 39-65.
159 Fish, Andrew, "Acton, Creighton, and Lea: a Study in History and Ethics", Pacific Historical Review XVI, 59-69.
160 Garosci, A., "Le conscience historique en Italie", Les temps modernes III, 23-24.

Need determine types: likely "book" for 140-144, "other" or "journal-article"? The schema allows book, journal-article, other. For articles section, entry 145 is maybe "other" (conference proceedings?). Entries 146-160 are journal articles? Actually they are articles within volumes/journals. So type "journal-article". For 145, it's conference proceedings published? Could be "other" or "book". Let's assign "other" for conference proceedings? But maybe "book". Let's think. The schema requires one of enum. We'll assign 145 as "other" since it's conference acts. Or "book"? Let's see context: "Atti del congresso..." published Milano: Castellani. That sounds like a book of proceedings. Could be "book". But then "Relevant articles:" lists articles within it. So 145 is container, and 146-149 are articles in vol. I of that container? Actually 146-149 cite vol. I, 109-117 etc. So they are related to 145? The instruction: "If an entry reviews another entry, the relation field should contain the id of the reviewed entry." Not exactly this. But maybe 146-149 are part of 145? However they have their own entries. There's no explicit relation field required except if reviews another entry. So we can leave relation null.

But need check if any entry reviews another. Doesn't seem so.

Need parse authors correctly with family and given.

Let's list precisely with fields:

Entry 140:
id "140"
type "book"
title "Why We Read History"
author: [{"family":"Smellie","given":"K. B."}]
publisher "P. Elek"
publisher_place "London"
incomplete false? Not last? Actually 140 is not last on page? Wait page ends at 160, but 140 is not last entry on page. Only last entry on page might be incomplete. The last entry visible is 160, which seems complete? Let's check: "Garosci, A., "Le conscience historique en Italie", Les temps modernes III, 23-24." That looks complete, no continuation indicated. But the instruction says "The last entry on a page might be incomplete. This means that the entry continues on the next page. If so, set the incomplete field to true." Since 160 ends with page range 23-24 and no indication of continuation, likely incomplete false. However sometimes the last entry on page is cut off in image? Here 160 is fully visible at bottom. So incomplete false for all? Wait but they said "The last entry on a page might be incomplete." We need check if entry 160 is cut off? The image shows entry 160 fully, then blank space. So not incomplete.

But wait page number is 10, and printed page is 9. The entries go from 140 to 160. The last entry 160 might continue? No, looks complete.

Thus all entries have incomplete null or false? The schema allows boolean or null. We'll set false? Or null? The instruction: "If so, set the incomplete field to true." So if not, we can omit or set false/null. Let's set null for all except if true. But easier set false? The schema allows boolean or null. Let's use null for non-incomplete, but maybe false is okay. Let's use null except true.

Now parse each entry with correct fields.

140:
author: Smellie, K. B. => family "Smellie", given "K. B."
title: "Why We Read History"
publisher_place: "London"
publisher: "P. Elek"
No container, volume, page, etc.

141:
author: Toynbee, Arnold J. => family "Toynbee", given "Arnold J."
title: "A Study of History"
note? There's "abridged by D. C. Somervell" => maybe editor? Actually abridged by is like editor? The schema has editor field (array of strings). So editor: ["D. C. Somervell"]? Or note? Let's put in note? But there is specific "abridged by D. C. Somervell, New York: Oxford (Abridgement of vols. I-VI of A Study of History)." The publisher is Oxford? Actually "New York: Oxford" => publisher_place "New York", publisher "Oxford". The parenthetical "(Abridgement of vols. I-VI of A Study of History)" is part of title? Or note? Let's include in title? Actually title is "A Study of History". The rest is publication info and note. Let's parse:
publisher_place: "New York"
publisher: "Oxford"
editor: ["D. C. Somervell"]? The field is "editor" array of strings. Yes, abridged by can be considered editor.
note: "Abridgement of vols. I-VI of A Study of History" maybe in note.
But also there is "(Abridgement of vols. I-VI of A Study of History)" right after publisher. Let's assign note: "Abridgement of vols. I-VI of A Study of History". Or include in title? Probably note.

Let's do:
id "141"
type "book"
title "A Study of History"
author [{"family":"Toynbee","given":"Arnold J."}]
editor ["D. C. Somervell"]
publisher "Oxford"
publisher_place "New York"
note "Abridgement of vols. I-VI of A Study of History"

142:
author Verberne, L. G. J. => family "Verberne", given "L. G. J."
title "In den spiegel van het verleden: historische opstellen"
publisher_place "Utrecht, Antwerpen"
publisher "Bruna"
type "book"

143:
author Vevir, José => family "Vevir", given "José"
title "Esquemas de metodología eclesiástica"
publisher_place "Barcelona"
publisher "Instituto"
type "book"

144:

Scoring

Fuzzy score0.0%

Speed

Model time, all inputs229.4 s
Mean per input45.89 s
Slowest input50.38 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens13.5K
Output tokens10.2K
Total tokens23.7K
Input cost$0.0135
Output cost$0.0415
Total cost$0.055

Priced from 2026-08-15 · Input $/M $1.00 · Output $/M $4.05

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 97 of 208

Test T1570 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

huggingface meta-models/Muse-Glimmer-30B · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.5%

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":"London: P. Elek.","publisher":"P. Elek","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"abridged by D. C. Somervell, New York: Oxford (Abridgement of vols. I-VI of A Study of History).","publisher":"Oxford","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":"abridged","incomplete":false},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":"Utrecht, Antwerpen: Bruna.","publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":"Barcelona: Instituto.","publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":"Bonn: Universitäts-Verlag.","publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":null,"author":null,"note":"Milano: Castellani. Relevant articles:","publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":null,"event_date":"15-20 November, 1946","related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"146","type":"journal-article","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Drago","given":"Pietro C."}],"note":"vol. I, 109-117.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"145","volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"147","type":"journal-article","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":"vol. I, 281-290.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"145","volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"148","type":"journal-article","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Nyman","given":"A."}],"note":"vol. I, 191-200.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"145","volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":"II, 623-634.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"150","type":"book","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":"in Dagobert D. Runes, ed., New York: Philosophical Library, 89-106.","publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":"II, 57-85.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":"fasc. 3-4; (reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959).","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":false},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":"XXXVIII, 11-18.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":"III, 153-175.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":"CCLIV, 166-184.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":"III, 44-53.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":"LII, 231-246.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":"VIII, 39-65.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":"XVI, 59-69.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":"III, 23-24.","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring

Fuzzy score60.7%

Speed

Model time, all inputs485.0 s
Mean per input97.01 s
Slowest input166.27 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens17.7K
Output tokens23.6K
Total tokens41.3K
Input cost$0.0062
Output cost$0.0354
Total cost$0.0416

Priced from 2026-08-15 · Input $/M $0.35 · Output $/M $1.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 98 of 208

Test T1540 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

huggingface thinkingmachines/Inkling-Small · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score21.0%

{"metadata":{"title":"Bibliography","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Smellie, K. B., Why We Read History, London: P. Elek.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"141","type":"book","title":"Toynbee, Arnold J., A Study of History, abridged by D. C. Somervell, New York: Oxford (Abridgement of vols. I-VI of A Study of History).","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"142","type":"book","title":"Verberne, L. G. J., In den spiegel van het verleden: historische opstellen, Utrecht, Antwerpen: Bruna.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"143","type":"book","title":"Vevir, José, Esquemas de metodología eclesiástica, Barcelona: Instituto.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"144","type":"book","title":"Walz, Hans H., Sinn und Ziel der Geschichte, Bonn: Universitäts-Verlag.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946, Milano: Castellani.","container_title":null,"author":null,"note":"Relevant articles:","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"146","type":"journal-article","title":"Pietro C. Drago, “Storia e materialismo storico”, vol. I, 109-117.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"147","type":"journal-article","title":"Vito Fazio-Allmayer, “Critica del giudizio storico”, vol. I, 281-290.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"148","type":"journal-article","title":"A. Nyman, “Forza e spirito nella storia”, vol. I, 191-200.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"149","type":"journal-article","title":"Benjamin, Walter, “Sur le concept d’histoire”, Les temps modernes II, 623-634.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"150","type":"book","title":"Boodin, John E., “Philosophy of History”, in Dagobert D. Runes, ed., 20th Century Philosophy, New York: Philosophical Library, 89-106.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"151","type":"journal-article","title":"Caillois, R. P., “De la perception à l’histoire. La philosophie de M. Merleau-Ponty”, Deucalion II, 57-85.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"152","type":"journal-article","title":"Cantimori, Delio, “Commemorazione di Adolfo Omodeo”, Annali della Scuola Normale di Pisa, fasc. 3-4; (reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959).","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"fasc. 3-4","fascicle":"3-4","reprint":"D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":false},{"id":"153","type":"journal-article","title":"Cowan, Thomas, “The Historian and the Philosophy of Science”, Isis XXXVIII, 11-18.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"154","type":"journal-article","title":"Crawford, R. M., “History as a Science”, Historical Studies: Australia and New Zealand III, 153-175.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"155","type":"journal-article","title":"Daniélou, J., “Christianisme et histoire”, Etudes CCLIV, 166-184.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"156","type":"journal-article","title":"Dell, Stanley, “Wahrheit der Geschichte”, Geschichte der Wahrheit”, Amerikanische Rundschau III, 44-53.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"157","type":"journal-article","title":"Fay, Sidney B., “The Idea of Progress”, American Historical Review LII, 231-246.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"158","type":"journal-article","title":"Fessard, Gaston, “Théologie et histoire”, Dieu vivant VIII, 39-65.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"159","type":"journal-article","title":"Fish, Andrew, “Acton, Creighton, and Lea: a Study in History and Ethics”, Pacific Historical Review XVII, 59-69.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XVII","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"160","type":"journal-article","title":"Garosci, A., “Le conscience historique en Italie”, Les temps modernes III, 23-24.","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring

Fuzzy score43.3%

Speed

Model time, all inputs785.4 s
Mean per input157.09 s
Slowest input238.85 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens9.1K
Output tokens26.5K
Total tokens35.6K
Input cost$0.0041
Output cost$0.0318
Total cost$0.0359

Priced from 2026-08-15 · Input $/M $0.45 · Output $/M $1.20

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 99 of 208

Test T1495 at 2026-08-14

book-page information-extraction printed 20 en list bibliographic

huggingface swiss-ai/apertus-v1.5-8b · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score0.0%

{"$defs": {"Author": {"properties": {"family": {"title": "Family", "type": "string"}, "given": {"title": "Given", "type": "string"}}, "required": ["family", "given"], "title": "Author", "type": "object"}, "Entry": {"properties": {"id": {"title": "Id", "type": "string"}, "type": {"$ref": "#/$defs/EntryType"}, "title": {"title": "Title", "type": "string"}, "container_title": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Container Title"}, "author": {"anyOf": [{"items": {"$ref": "#/$defs/Author"}, "type": "array"}, {"type": "null"}], "default": null, "title": "Author"}, "note": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Note"}, "publisher": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Publisher"}, "editor": {"anyOf": [{"items": {"type": "string"}, "type": "array"}, {"type": "null"}], "default": null, "title": "Editor"}, "publisher_place": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Publisher Place"}, "issued": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Issued"}, "event_date": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Event Date"}, "related": {"anyOf": [{"items": {"type": "string"}, "type": "array"}, {"type": "null"}], "default": null, "title": "Related"}, "relation": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Relation"}, "volume": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Volume"}, "page": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Page"}, "fascicle": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Fascicle"}, "reprint": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Reprint"}, "edition": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null, "title": "Edition"}, "incomplete": {"anyOf": [{"type": "boolean"}, {"type": "null"}], "default": null, "title": "Incomplete"}}, "EntryType": {"enum": ["book", "journal-article", "other"], "title": "EntryType", "type": "string"}, "Metadata": {"properties": {"title": {"title": "Title", "type": "string"}, "year": {"title": "Year", "type": "string"}, "page_number": {"anyOf": [{"type": "integer"}, {"type": "null"}], "default": null, "title": "Page Number"}}, "required": ["title", "year"], "title": "Metadata", "type": "object"}}, "properties": {"metadata": {"$ref": "#/$defs/Metadata"}, "entries": {"items": {"$ref": "#/$defs/Entry"}, "title": "Entries", "type": "array"}}, "required": ["metadata", "entries"], "title": "Document", "type": "object"}}

Scoring

Fuzzy score6.6%

Speed

Model time, all inputs822.9 s
Mean per input164.58 s
Slowest input198.02 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens42.9K
Output tokens7.1K
Total tokens50K
Input cost$0.0043
Output cost$0.0014
Total cost$0.0057

Priced from 2026-08-10 · Input $/M $0.10 · Output $/M $0.20

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827
Result 100 of 208

Test T1480 at 2026-08-14

book-page information-extraction printed 20 en list bibliographic

huggingface swiss-ai/apertus-v1.5-70b · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score1.4%

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"relation_to_other_entry_id","type":"book","title":"Smellie, K. B., Why We Read History, London: P. Elek.","container_title":"BIBLIOGRAPHY","author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring

Fuzzy score16.1%

Speed

Model time, all inputs357.2 s
Mean per input71.45 s
Slowest input203.78 s
Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens40.2K
Output tokens7.6K
Total tokens47.8K
Input cost$0.033
Output cost$0.0221
Total cost$0.055

Priced from 2026-08-10 · Input $/M $0.82 · Output $/M $2.92

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827