RISE Humanities Data Benchmark

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
Model configuration – provider, model version, temperature, and other generation parameters.
Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
Usage and cost data – token counts and calculated API costs.
Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Result 1 of 208

Test T1795 at 2026-09-29

book-page information-extraction printed 20 en list bibliographic

scicore Qwen3.8-Flash-Next-FP8 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.5%

{"metadata":{"title":"Bibliography","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":"","author":[{"family":"Smellie","given":"K. B."}],"note":"London: P. Elek.","publisher":"P. Elek","editor":[],"publisher_place":"London","issued":"","event_date":"","related":[],"relation":"","volume":"","page":"","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"141","type":"book","title":"A Study of History","container_title":"","author":[{"family":"Toynbee","given":"Arnold J."}],"note":"abridged by D. C. Somervell, New York: Oxford (Abridgement of vols. I-VI of A Study of History).","publisher":"Oxford","editor":["Somervell, D. C."],"publisher_place":"New York","issued":"","event_date":"","related":[],"relation":"","volume":"","page":"","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":"","author":[{"family":"Verberne","given":"L. G. J."}],"note":"Utrecht, Antwerpen: Bruna.","publisher":"Bruna","editor":[],"publisher_place":"Utrecht, Antwerpen","issued":"","event_date":"","related":[],"relation":"","volume":"","page":"","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":"","author":[{"family":"Vevir","given":"José"}],"note":"Barcelona: Instituto.","publisher":"Instituto","editor":[],"publisher_place":"Barcelona","issued":"","event_date":"","related":[],"relation":"","volume":"","page":"","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":"","author":[{"family":"Walz","given":"Hans H."}],"note":"Bonn: Universitäts-Verlag.","publisher":"Universitäts-Verlag","editor":[],"publisher_place":"Bonn","issued":"","event_date":"","related":[],"relation":"","volume":"","page":"","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":"","author":[],"note":"Milano: Castellani. Relevant articles:","publisher":"Castellani","editor":[],"publisher_place":"Milano","issued":"","event_date":"15-20 November, 1946","related":[],"relation":"","volume":"","page":"","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"146","type":"journal-article","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Drago","given":"Pietro C."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"I","page":"109-117","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"147","type":"journal-article","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"I","page":"281-290","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"148","type":"journal-article","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Nyman","given":"A."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"I","page":"191-200","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"II","page":"623-634","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"150","type":"book","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":"in Dagobert D. Runes, ed., 20th Century Philosophy, New York: Philosophical Library, 89-106.","publisher":"Philosophical Library","editor":["Runes, Dagobert D."],"publisher_place":"New York","issued":"","event_date":"","related":[],"relation":"","volume":"","page":"89-106","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"II","page":"57-85","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":"fasc. 3-4; (reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959).","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"","page":"","fascicle":"3-4","reprint":"D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":"","incomplete":false},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"XXXVIII","page":"11-18","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"III","page":"153-175","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"CCLIV","page":"166-184","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"III","page":"44-53","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"LII","page":"231-246","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"VIII","page":"39-65","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"XVI","page":"59-69","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"","event_date":"","related":[],"relation":"","volume":"III","page":"23-24","fascicle":"","reprint":"","edition":"","incomplete":false}]}

Scoring

Fuzzy score67.2%

Speed

Model time, all inputs226.3 s

Mean per input45.25 s

Slowest input64.46 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens13.7K

Output tokens28.7K

Total tokens42.4K

Input cost$0.00

Output cost$0.00

Total cost$0.00

Priced from 2026-09-27 · Input $/M $0.00 · Output $/M $0.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 2 of 208

Test T1675 at 2026-09-29

book-page information-extraction printed 20 en list bibliographic

anthropic claude-fable-5-1 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score44.3%

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"abridged by D. C. Somervell. Abridgement of vols. I-VI of A Study of History","publisher":"Oxford","editor":["D. C. Somervell"],"publisher_place":"New York","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia","container_title":null,"author":null,"note":"Relevant articles: 146, 147, 148","publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":"1947","event_date":"15-20 November, 1946","related":["146","147","148"],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"146","type":"other","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":["145"],"relation":null,"volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"147","type":"other","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":["145"],"relation":null,"volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"148","type":"other","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":["145"],"relation":null,"volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"150","type":"other","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":null},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring

Fuzzy score82.8%

Speed

Model time, all inputs139.8 s

Mean per input27.95 s

Slowest input34.62 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens26.1K

Output tokens13.2K

Total tokens39.3K

Input cost$0.2606

Output cost$0.6594

Total cost$0.9201

Priced from 2026-09-08 · Input $/M $10.00 · Output $/M $50.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 3 of 208

Test T1810 at 2026-09-29

book-page information-extraction printed 20 en list bibliographic

anthropic claude-opus-5-5 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score43.9%

{"metadata":{"title":"Bibliography","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"abridged by D. C. Somervell; Abridgement of vols. I-VI of A Study of History","publisher":"Oxford","editor":["D. C. Somervell"],"publisher_place":"New York","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":null,"author":null,"note":null,"publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":"1947","event_date":null,"related":["146","147","148"],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"146","type":"other","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":"145","volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"147","type":"other","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":"145","volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"148","type":"other","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":"145","volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"150","type":"other","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":null},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring

Fuzzy score71.1%

Speed

Model time, all inputs89.8 s

Mean per input17.97 s

Slowest input22.61 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens26.1K

Output tokens11K

Total tokens37.1K

Input cost$0.1043

Output cost$0.2205

Total cost$0.3248

Priced from 2026-09-27 · Input $/M $4.00 · Output $/M $20.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 4 of 208

Test T1870 at 2026-09-29

book-page information-extraction printed 20 en list bibliographic

anthropic claude-sonnet-5-5 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.7%

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"abridged by D. C. Somervell (Abridgement of vols. I-VI of A Study of History)","publisher":"Oxford","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":null,"author":null,"note":null,"publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":"1946","event_date":null,"related":["146","147","148"],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"146","type":"other","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"147","type":"other","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"148","type":"other","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"150","type":"other","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":null},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring

Fuzzy score78.7%

Speed

Model time, all inputs46.8 s

Mean per input9.36 s

Slowest input10.34 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens26.1K

Output tokens8.6K

Total tokens34.7K

Input cost$0.0521

Output cost$0.0862

Total cost$0.1383

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 5 of 208

Test T1870 at 2026-09-28

book-page information-extraction printed 20 en list bibliographic

anthropic claude-sonnet-5-5 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score22.8%

```json
{
  "page_number": 10,
  "printed_page_number": "9",
  "header": {
    "left": "1947",
    "center": "BIBLIOGRAPHY"
  },
  "entries": [
    {
      "id": "140",
      "type": "book",
      "authors": ["Smellie, K. B."],
      "title": "Why We Read History",
      "place": "London",
      "publisher": "P. Elek",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "141",
      "type": "book",
      "authors": ["Toynbee, Arnold J."],
      "title": "A Study of History",
      "note": "abridged by D. C. Somervell (Abridgement of vols. I-VI of A Study of History)",
      "place": "New York",
      "publisher": "Oxford",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "142",
      "type": "book",
      "authors": ["Verberne, L. G. J."],
      "title": "In den spiegel van het verleden: historische opstellen",
      "place": "Utrecht, Antwerpen",
      "publisher": "Bruna",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "143",
      "type": "book",
      "authors": ["Vevir, José"],
      "title": "Esquemas de metodología eclesiástica",
      "place": "Barcelona",
      "publisher": "Instituto",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "144",
      "type": "book",
      "authors": ["Walz, Hans H."],
      "title": "Sinn und Ziel der Geschichte",
      "place": "Bonn",
      "publisher": "Universitäts-Verlag",
      "relation": null,
      "incomplete": false
    },
    {
      "section": "Articles"
    },
    {
      "id": "145",
      "type": "conference proceedings",
      "authors": [],
      "title": "Atti del congresso internazionale di filosofia 15-20 November, 1946",
      "place": "Milano",
      "publisher": "Castellani",
      "note": "Relevant articles:",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "146",
      "type": "article",
      "authors": ["Drago, Pietro C."],
      "title": "Storia e materialismo storico",
      "container": "Atti del congresso internazionale di filosofia",
      "volume": "I",
      "pages": "109-117",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "147",
      "type": "article",
      "authors": ["Fazio-Allmayer, Vito"],
      "title": "Critica del giudizio storico",
      "container": "Atti del congresso internazionale di filosofia",
      "volume": "I",
      "pages": "281-290",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "148",
      "type": "article",
      "authors": ["Nyman, A."],
      "title": "Forza e spirito nella storia",
      "container": "Atti del congresso internazionale di filosofia",
      "volume": "I",
      "pages": "191-200",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "149",
      "type": "article",
      "authors": ["Benjamin, Walter"],
      "title": "Sur le concept d'histoire",
      "journal": "Les temps modernes",
      "volume": "II",
      "pages": "623-634",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "150",
      "type": "article",
      "authors": ["Boodin, John E."],
      "title": "Philosophy of History",
      "container": "20th Century Philosophy",
      "editors": ["Runes, Dagobert D."],
      "place": "New York",
      "publisher": "Philosophical Library",
      "pages": "89-106",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "151",
      "type": "article",
      "authors": ["Caillois, R. P."],
      "title": "De la perception à l'histoire. La philosophie de M. Merleau-Ponty",
      "journal": "Deucalion",
      "volume": "II",
      "pages": "57-85",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "152",
      "type": "article",
      "authors": ["Cantimori, Delio"],
      "title": "Commemorazione di Adolfo Omodeo",
      "journal": "Annali della Scuola Normale di Pisa",
      "issue": "fasc. 3-4",
      "note": "reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "153",
      "type": "article",
      "authors": ["Cowan, Thomas"],
      "title": "The Historian and the Philosophy of Science",
      "journal": "Isis",
      "volume": "XXXVIII",
      "pages": "11-18",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "154",
      "type": "article",
      "authors": ["Crawford, R. M."],
      "title": "History as a Science",
      "journal": "Historical Studies: Australia and New Zealand",
      "volume": "III",
      "pages": "153-175",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "155",
      "type": "article",
      "authors": ["Daniélou, J."],
      "title": "Christianisme et histoire",
      "journal": "Etudes",
      "volume": "CCLIV",
      "pages": "166-184",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "156",
      "type": "article",
      "authors": ["Dell, Stanley"],
      "title": "Wahrheit der Geschichte. Geschichte der Wahrheit",
      "journal": "Amerikanische Rundschau",
      "volume": "III",
      "pages": "44-53",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "157",
      "type": "article",
      "authors": ["Fay, Sidney B."],
      "title": "The Idea of Progress",
      "journal": "American Historical Review",
      "volume": "LII",
      "pages": "231-246",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "158",
      "type": "article",
      "authors": ["Fessard, Gaston"],
      "title": "Théologie et histoire",
      "journal": "Dieu vivant",
      "volume": "VIII",
      "pages": "39-65",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "159",
      "type": "article",
      "authors": ["Fish, Andrew"],
      "title": "Acton, Creighton, and Lea: a Study in History and Ethics",
      "journal": "Pacific Historical Review",
      "volume": "XVI",
      "pages": "59-69",
      "relation": null,
      "incomplete": false
    },
    {
      "id": "160",
      "type": "article",
      "authors": ["Garosci, A."],
      "title": "Le conscience historique en Italie",
      "journal": "Les temps modernes",
      "volume": "III",
      "pages": "23-24",
      "relation": null,
      "incomplete": false
    }
  ]
}
```

Scoring

Fuzzy score31.6%

Speed

Model time, all inputs71.5 s

Mean per input14.30 s

Slowest input15.74 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens18.1K

Output tokens12.6K

Total tokens30.6K

Input cost$0.0361

Output cost$0.1257

Total cost$0.1619

Priced from 2026-09-28 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 6 of 208

Test T1810 at 2026-09-27

book-page information-extraction printed 20 en list bibliographic

anthropic claude-opus-5-5 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score23.5%

```json
{
  "page": 10,
  "printed_page_number": 9,
  "year": 1947,
  "entries": [
    {
      "id": 140,
      "type": "book",
      "author": "Smellie, K. B.",
      "title": "Why We Read History",
      "place": "London",
      "publisher": "P. Elek",
      "section": "Books",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 141,
      "type": "book",
      "author": "Toynbee, Arnold J.",
      "title": "A Study of History",
      "editor": "D. C. Somervell (abridged by)",
      "place": "New York",
      "publisher": "Oxford",
      "notes": "Abridgement of vols. I-VI of A Study of History",
      "section": "Books",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 142,
      "type": "book",
      "author": "Verberne, L. G. J.",
      "title": "In den spiegel van het verleden: historische opstellen",
      "place": "Utrecht, Antwerpen",
      "publisher": "Bruna",
      "section": "Books",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 143,
      "type": "book",
      "author": "Vevir, José",
      "title": "Esquemas de metodología eclesiástica",
      "place": "Barcelona",
      "publisher": "Instituto",
      "section": "Books",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 144,
      "type": "book",
      "author": "Walz, Hans H.",
      "title": "Sinn und Ziel der Geschichte",
      "place": "Bonn",
      "publisher": "Universitäts-Verlag",
      "section": "Books",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 145,
      "type": "proceedings",
      "author": null,
      "title": "Atti del congresso internazionale di filosofia",
      "date": "15-20 November, 1946",
      "place": "Milano",
      "publisher": "Castellani",
      "notes": "Relevant articles: 146-148",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 146,
      "type": "article_in_proceedings",
      "author": "Drago, Pietro C.",
      "title": "Storia e materialismo storico",
      "container": "Atti del congresso internazionale di filosofia",
      "container_id": 145,
      "volume": "I",
      "pages": "109-117",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 147,
      "type": "article_in_proceedings",
      "author": "Fazio-Allmayer, Vito",
      "title": "Critica del giudizio storico",
      "container": "Atti del congresso internazionale di filosofia",
      "container_id": 145,
      "volume": "I",
      "pages": "281-290",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 148,
      "type": "article_in_proceedings",
      "author": "Nyman, A.",
      "title": "Forza e spirito nella storia",
      "container": "Atti del congresso internazionale di filosofia",
      "container_id": 145,
      "volume": "I",
      "pages": "191-200",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 149,
      "type": "journal_article",
      "author": "Benjamin, Walter",
      "title": "Sur le concept d'histoire",
      "journal": "Les temps modernes",
      "volume": "II",
      "pages": "623-634",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 150,
      "type": "book_chapter",
      "author": "Boodin, John E.",
      "title": "Philosophy of History",
      "editor": "Dagobert D. Runes",
      "container": "20th Century Philosophy",
      "place": "New York",
      "publisher": "Philosophical Library",
      "pages": "89-106",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 151,
      "type": "journal_article",
      "author": "Caillois, R. P.",
      "title": "De la perception à l'histoire. La philosophie de M. Merleau-Ponty",
      "journal": "Deucalion",
      "volume": "II",
      "pages": "57-85",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 152,
      "type": "journal_article",
      "author": "Cantimori, Delio",
      "title": "Commemorazione di Adolfo Omodeo",
      "journal": "Annali della Scuola Normale di Pisa",
      "issue": "fasc. 3-4",
      "notes": "Reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 153,
      "type": "journal_article",
      "author": "Cowan, Thomas",
      "title": "The Historian and the Philosophy of Science",
      "journal": "Isis",
      "volume": "XXXVIII",
      "pages": "11-18",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 154,
      "type": "journal_article",
      "author": "Crawford, R. M.",
      "title": "History as a Science",
      "journal": "Historical Studies: Australia and New Zealand",
      "volume": "III",
      "pages": "153-175",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 155,
      "type": "journal_article",
      "author": "Daniélou, J.",
      "title": "Christianisme et histoire",
      "journal": "Etudes",
      "volume": "CCLIV",
      "pages": "166-184",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 156,
      "type": "journal_article",
      "author": "Dell, Stanley",
      "title": "Wahrheit der Geschichte. Geschichte der Wahrheit",
      "journal": "Amerikanische Rundschau",
      "volume": "III",
      "pages": "44-53",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 157,
      "type": "journal_article",
      "author": "Fay, Sidney B.",
      "title": "The Idea of Progress",
      "journal": "American Historical Review",
      "volume": "LII",
      "pages": "231-246",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 158,
      "type": "journal_article",
      "author": "Fessard, Gaston",
      "title": "Théologie et histoire",
      "journal": "Dieu vivant",
      "volume": "VIII",
      "pages": "39-65",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 159,
      "type": "journal_article",
      "author": "Fish, Andrew",
      "title": "Acton, Creighton, and Lea: a Study in History and Ethics",
      "journal": "Pacific Historical Review",
      "volume": "XVI",
      "pages": "59-69",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    },
    {
      "id": 160,
      "type": "journal_article",
      "author": "Garosci, A.",
      "title": "Le conscience historique en Italie",
      "journal": "Les temps modernes",
      "volume": "III",
      "pages": "23-24",
      "section": "Articles",
      "relation": null,
      "incomplete": false
    }
  ]
}
```

Notes:
- The page number is recorded as 10, as instructed. The number printed on the page is 9, and it is kept separately as `printed_page_number`.
- No entry on this page reviews another entry, so every `relation` field is `null`.
- Entries 146–148 are articles within the conference proceedings (entry 145). This is shown with `container_id` rather than `relation`, since they are not reviews.
- The last entry (160) ends with its page range, so it appears complete and `incomplete` is `false`.

Scoring

Fuzzy score37.7%

Speed

Model time, all inputs117.9 s

Mean per input23.59 s

Slowest input30.01 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens18.1K

Output tokens14.8K

Total tokens32.9K

Input cost$0.0723

Output cost$0.2964

Total cost$0.3687

Priced from 2026-09-27 · Input $/M $4.00 · Output $/M $20.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 7 of 208

Test T1840 at 2026-09-27

book-page information-extraction printed 20 en list bibliographic

openai gpt-6-luna · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.4%

{"metadata":{"title":"Bibliography","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"Abridged by D. C. Somervell; abridgement of vols. I–VI of A Study of History.","publisher":"Oxford","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia","container_title":null,"author":null,"note":null,"publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":"1946","event_date":"15–20 November 1946","related":["146","147","148"],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"146","type":"journal-article","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":["145"],"relation":null,"volume":"I","page":"109–117","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"147","type":"journal-article","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":["145"],"relation":null,"volume":"I","page":"281–290","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"148","type":"journal-article","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":["145"],"relation":null,"volume":"I","page":"191–200","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"149","type":"journal-article","title":"Sur le concept d’histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"623–634","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"150","type":"other","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"89–106","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"151","type":"journal-article","title":"De la perception à l’histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"57–85","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3–4","reprint":"Reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959.","edition":null,"incomplete":null},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11–18","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"153–175","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166–184","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"44–53","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LII","page":"231–246","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39–65","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59–69","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"160","type":"journal-article","title":"La conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"23–24","fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring

Fuzzy score67.7%

Speed

Model time, all inputs113.5 s

Mean per input22.70 s

Slowest input28.96 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.3K

Output tokens19.3K

Total tokens38.6K

Input cost$0.0019

Output cost$0.0096

Total cost$0.0116

Priced from 2026-09-27 · Input $/M $0.10 · Output $/M $0.50

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 8 of 208

Test T1795 at 2026-09-27

book-page information-extraction printed 20 en list bibliographic

scicore Qwen3.8-Flash-Next-FP8 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.7%

{"metadata":{"title":"Bibliography","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"Abridgement of vols. I-VI of A Study of History","publisher":"Oxford","editor":["Somervell, D. C."],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":null,"author":null,"note":"Relevant articles: 146-148","publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":null,"event_date":"15-20 November, 1946","related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"146","type":"journal-article","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"147","type":"journal-article","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"148","type":"journal-article","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"150","type":"journal-article","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Runes, Dagobert D."],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":false},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring

Speed

Model time, all inputs56.0 s

Mean per input28.02 s

Slowest input29.28 s

Inputs timed2

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

No cost recorded for this run

Priced from 2026-09-27 · Input $/M $0.00 · Output $/M $0.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 9 of 208

Test T1825 at 2026-09-27

book-page information-extraction printed 20 en list bibliographic

openai gpt-6-sol · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score43.7%

{"metadata":{"title":"Bibliography","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"Abridged by D. C. Somervell; abridgement of volumes I–VI of A Study of History.","publisher":"Oxford","editor":null,"publisher_place":"New York","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevír","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia","container_title":null,"author":null,"note":"Relevant articles listed in entries 146–148.","publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":"1947","event_date":"15–20 November 1946","related":["146","147","148"],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"146","type":"other","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":["145"],"relation":null,"volume":"I","page":"109–117","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"147","type":"other","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":["145"],"relation":null,"volume":"I","page":"281–290","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"148","type":"other","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":["145"],"relation":null,"volume":"I","page":"191–200","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"149","type":"journal-article","title":"Sur le concept d’histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"II","page":"623–634","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"150","type":"other","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"89–106","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"151","type":"journal-article","title":"De la perception à l’histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"II","page":"57–85","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3–4","reprint":"Reprinted in D. Cantimori, Studi di storia (Torino: Einaudi, 1959).","edition":null,"incomplete":false},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11–18","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"153–175","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Études","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166–184","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte, Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"44–53","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"LII","page":"231–246","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39–65","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59–69","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"160","type":"journal-article","title":"Le coscienze historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":"III","page":"23–24","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring

Fuzzy score70.5%

Speed

Model time, all inputs125.6 s

Mean per input25.12 s

Slowest input32.14 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens19.3K

Output tokens14.8K

Total tokens34K

Input cost$0.0385

Output cost$0.1476

Total cost$0.1861

Priced from 2026-09-27 · Input $/M $2.00 · Output $/M $10.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Result 10 of 208

Test T1855 at 2026-09-27

book-page information-extraction printed 20 en list bibliographic

x-ai grok-4.7 · temp 0.0 · dataclass Document

Response vs ground truth

One model response from this run. The per-input comparison needs JavaScript.

Fuzzy score34.3%

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"140","type":"book","title":"Why We Read History","container_title":null,"author":[{"family":"Smellie","given":"K. B."}],"note":null,"publisher":"P. Elek","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"141","type":"book","title":"A Study of History","container_title":null,"author":[{"family":"Toynbee","given":"Arnold J."}],"note":"abridged by D. C. Somervell (Abridgement of vols. I-VI of A Study of History)","publisher":"Oxford","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"142","type":"book","title":"In den spiegel van het verleden: historische opstellen","container_title":null,"author":[{"family":"Verberne","given":"L. G. J."}],"note":null,"publisher":"Bruna","editor":null,"publisher_place":"Utrecht, Antwerpen","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"143","type":"book","title":"Esquemas de metodología eclesiástica","container_title":null,"author":[{"family":"Vevir","given":"José"}],"note":null,"publisher":"Instituto","editor":null,"publisher_place":"Barcelona","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"144","type":"book","title":"Sinn und Ziel der Geschichte","container_title":null,"author":[{"family":"Walz","given":"Hans H."}],"note":null,"publisher":"Universitäts-Verlag","editor":null,"publisher_place":"Bonn","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"145","type":"book","title":"Atti del congresso internazionale di filosofia 15-20 November, 1946","container_title":null,"author":null,"note":null,"publisher":"Castellani","editor":null,"publisher_place":"Milano","issued":null,"event_date":"15-20 November, 1946","related":["146","147","148"],"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"146","type":"other","title":"Storia e materialismo storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Drago","given":"Pietro C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":["145"],"relation":null,"volume":"I","page":"109-117","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"147","type":"other","title":"Critica del giudizio storico","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Fazio-Allmayer","given":"Vito"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":["145"],"relation":null,"volume":"I","page":"281-290","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"148","type":"other","title":"Forza e spirito nella storia","container_title":"Atti del congresso internazionale di filosofia","author":[{"family":"Nyman","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":["145"],"relation":null,"volume":"I","page":"191-200","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"149","type":"journal-article","title":"Sur le concept d'histoire","container_title":"Les temps modernes","author":[{"family":"Benjamin","given":"Walter"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"623-634","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"150","type":"other","title":"Philosophy of History","container_title":"20th Century Philosophy","author":[{"family":"Boodin","given":"John E."}],"note":null,"publisher":"Philosophical Library","editor":["Dagobert D. Runes"],"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":"89-106","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"151","type":"journal-article","title":"De la perception à l'histoire. La philosophie de M. Merleau-Ponty","container_title":"Deucalion","author":[{"family":"Caillois","given":"R. P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"II","page":"57-85","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"152","type":"journal-article","title":"Commemorazione di Adolfo Omodeo","container_title":"Annali della Scuola Normale di Pisa","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":"3-4","reprint":"reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959","edition":null,"incomplete":null},{"id":"153","type":"journal-article","title":"The Historian and the Philosophy of Science","container_title":"Isis","author":[{"family":"Cowan","given":"Thomas"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"11-18","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"154","type":"journal-article","title":"History as a Science","container_title":"Historical Studies: Australia and New Zealand","author":[{"family":"Crawford","given":"R. M."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"153-175","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"155","type":"journal-article","title":"Christianisme et histoire","container_title":"Etudes","author":[{"family":"Daniélou","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CCLIV","page":"166-184","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"156","type":"journal-article","title":"Wahrheit der Geschichte. Geschichte der Wahrheit","container_title":"Amerikanische Rundschau","author":[{"family":"Dell","given":"Stanley"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"44-53","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"157","type":"journal-article","title":"The Idea of Progress","container_title":"American Historical Review","author":[{"family":"Fay","given":"Sidney B."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LII","page":"231-246","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"158","type":"journal-article","title":"Théologie et histoire","container_title":"Dieu vivant","author":[{"family":"Fessard","given":"Gaston"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VIII","page":"39-65","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"159","type":"journal-article","title":"Acton, Creighton, and Lea: a Study in History and Ethics","container_title":"Pacific Historical Review","author":[{"family":"Fish","given":"Andrew"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XVI","page":"59-69","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"160","type":"journal-article","title":"Le conscience historique en Italie","container_title":"Les temps modernes","author":[{"family":"Garosci","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"III","page":"23-24","fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring

Fuzzy score69.0%

Speed

Model time, all inputs1366.3 s

Mean per input273.26 s

Slowest input423.30 s

Inputs timed5

Summed model time, not elapsed: requests run in parallel and the worker count is not recorded, so the run finished sooner than this.

Costs / Pricing

Input tokens22.9K

Output tokens11.8K

Total tokens34.6K

Input cost$0.0458

Output cost$0.0705

Total cost$0.7667

Reasoning cost usd$0.6504

Total reasoning tokens108.4K

Priced from 2026-09-27 · Input $/M $2.00 · Output $/M $6.00

Cite: Hindermann, Marti, Alberto, et al., (2026). RISE-UNIBAS/humanities_data_benchmark, 10.5281/zenodo.21975827

Search Test Runs

Search Results
Show compact results Refine Search New Search

Download JSON Download CSV

Test T1795 at 2026-09-29

Test T1675 at 2026-09-29

Test T1810 at 2026-09-29

Test T1870 at 2026-09-29

Test T1870 at 2026-09-28

Test T1810 at 2026-09-27

Test T1840 at 2026-09-27

Test T1795 at 2026-09-27

Test T1825 at 2026-09-27

Test T1855 at 2026-09-27

Search Test Runs

Search Results Show compact results Refine Search New Search Download Download JSON Download CSV

Test T1795 at 2026-09-29

Test T1675 at 2026-09-29

Test T1810 at 2026-09-29

Test T1870 at 2026-09-29

Test T1870 at 2026-09-28

Test T1810 at 2026-09-27

Test T1840 at 2026-09-27

Test T1795 at 2026-09-27

Test T1825 at 2026-09-27

Test T1855 at 2026-09-27

Search Results
Show compact results Refine Search New Search

Download JSON Download CSV