RISE Humanities Data Benchmark, 0.5.5-pre1

Search Test Runs

 

A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.

A test run includes:

  • Prompt and role definition – what the model was asked to do and from what perspective (e.g. “as a historian”).
  • Model configuration – provider, model version, temperature, and other generation parameters.
  • Results – the model’s actual response and its evaluation (scores such as F1 or accuracy).
  • Usage and cost data – token counts and calculated API costs.
  • Metadata – information like the test date, benchmark name, and person who executed it.

Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.

Search Results

Your search for Benchmark 'bibliographic_data__true' with Search Hidden 'False' returned 124 results, showing page 1 of 13.
Result 1 of 124

Test T1630 at 2026-08-18

book-page information-extraction printed 20 en list bibliographic

Configuration
Provideropenrouter
Modelz-ai/glm-5v-turbo
  
Temperature0.0
DataclassDocument
  
Normalized Score66.88 %
Test time102.82 seconds
Prompt
Results

{"metadata":{"title":"HISTORY AND THEORY","year":"1945","page_number":3},"entries":[{"id":"15","type":"journal-article","title":"The Open Society and Its Enemies","container_title":"British Journal of Sociology","author":[{"family":"Plamenatz","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1952","event_date":null,"related":null,"relation":null,"volume":"III","page":"264-273","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"16","type":"journal-article","title":"The Open Society – a Comment","container_title":"British Journal of Sociology","author":[{"family":"Gombrich","given":"E. H."}],"note":"[On Plamenatz]","publisher":null,"editor":null,"publisher_place":null,"issued":"1952","event_date":null,"related":null,"relation":"15","volume":"III","page":"358-360","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"17","type":"journal-article","title":"The Open Society – a Rejoinder","container_title":"British Journal of Sociology","author":[{"family":"Plamenatz","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1953","event_date":null,"related":null,"relation":"16","volume":"IV","page":"76-77","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"18","type":"journal-article","title":"The Open Society: a Reconsideration","container_title":"Political Science Quarterly","author":[{"family":"Cobban","given":"Alfred"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1954","event_date":null,"related":null,"relation":null,"volume":"LXIX","page":"119-126","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"19","type":"journal-article","title":"Has History a Meaning?","container_title":"British Journal for the Philosophy of Science","author":[{"family":"Bernal","given":"J. D."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1955","event_date":null,"related":null,"relation":null,"volume":"VI","page":"164-169","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"20","type":"book","title":"War and History","container_title":null,"author":[{"family":"Sumner","given":"B. H."}],"note":null,"publisher":"Oliver and Boyd","editor":null,"publisher_place":"Edinburgh","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"21","type":"book","title":"The Philosophy of American History","container_title":null,"author":[{"family":"Zucker","given":"Morris"}],"note":null,"publisher":"Arnold and Howard","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":"2 vols.","page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"22","type":"journal-article","title":"History as a Liberal Art","container_title":"Journal of the History of Ideas","author":[{"family":"Barzun","given":"Jacques"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VI","page":"81-88","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"23","type":"journal-article","title":"The Study of Contemporary History: Some Further Reflections","container_title":"History N. S.","author":[{"family":"Beloff","given":"Max"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXX","page":"75-84","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"24","type":"journal-article","title":"Appunti sullo 'storicismo'","container_title":"Società","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"1-45","fascicle":null,"reprint":"D. Cantimori, Studi di storia, Torino: Einaudi, 1959, 1-45","edition":null,"incomplete":null},{"id":"25","type":"journal-article","title":"The Meaning of History","container_title":"Ethics","author":[{"family":"Coulborn","given":"Rushton"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LV","page":"46-63","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"26","type":"journal-article","title":"History – a Science?","container_title":"Mississippi Valley Historical Review","author":[{"family":"Gould","given":"Clarence P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXII","page":"375-388","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"27","type":"journal-article","title":"Generality and Singularity in Historical Judgment","container_title":"Journal of Philosophy","author":[{"family":"Hofstadter","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XLII","page":"57-65","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"28","type":"journal-article","title":"Les nouvelles conceptions de l'histoire","container_title":"Revue philosophique","author":[{"family":"Lenoble","given":"R."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CXXXV","page":"193-208, 324-348","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"29","type":"journal-article","title":"In History or Beyond History","container_title":"Harvard Theological Review","author":[{"family":"McCown","given":"C. C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"151-175","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"30","type":"journal-article","title":"History and the Social Science Research Council","container_title":"American Historical Review","author":[{"family":"Nichols","given":"Roy F."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"L","page":"491-499","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"31","type":"journal-article","title":"The Poverty of Historicism, Part III","container_title":"Economica","author":[{"family":"Popper","given":"Karl"}],"note":"(Parts I and II appeared in 1944. Cf. also #1233).","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XII","page":"69-89","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"32","type":"journal-article","title":"History and the Historian","container_title":"Journal of Philosophy","author":[{"family":"Weiss","given":"Paul"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XLII","page":"169-179","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"33","type":"journal-article","title":"The Attack on the Historical Method","container_title":"Journal of Philosophy","author":[{"family":"White","given":"Morton G."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XLII","page":"314-331","fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.67 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 22.1K IT + 17.5K OT = 39.6K TTCost: 0.027$0.070$0.097$
Result 2 of 124

Test T1615 at 2026-08-18

book-page information-extraction printed 20 en list bibliographic

Configuration
Provideropenrouter
Modelmeta/muse-spark-1.2
  
Temperature0.0
DataclassDocument
  
Normalized Score70.89 %
Test time196.67 seconds
Prompt
Results

{"metadata":{"title":"HISTORY AND THEORY","year":"1945","page_number":3},"entries":[{"id":"15","type":"journal-article","title":"The Open Society and Its Enemies","container_title":"British Journal of Sociology","author":[{"family":"Plamenatz","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1952","event_date":null,"related":null,"relation":null,"volume":"III","page":"264-273","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"16","type":"journal-article","title":"The Open Society – a Comment","container_title":"British Journal of Sociology","author":[{"family":"Gombrich","given":"E. H."}],"note":"On Plamenatz","publisher":null,"editor":null,"publisher_place":null,"issued":"1952","event_date":null,"related":null,"relation":"15","volume":"III","page":"358-360","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"17","type":"journal-article","title":"The Open Society – a Rejoinder","container_title":"British Journal of Sociology","author":[{"family":"Plamenatz","given":"J."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1953","event_date":null,"related":null,"relation":null,"volume":"IV","page":"76-77","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"18","type":"journal-article","title":"The Open Society: a Reconsideration","container_title":"Political Science Quarterly","author":[{"family":"Cobban","given":"Alfred"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1954","event_date":null,"related":null,"relation":null,"volume":"LXIX","page":"119-126","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"19","type":"journal-article","title":"Has History a Meaning?","container_title":"British Journal for the Philosophy of Science","author":[{"family":"Bernal","given":"J. D."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1955","event_date":null,"related":null,"relation":null,"volume":"VI","page":"164-169","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"20","type":"book","title":"War and History","container_title":null,"author":[{"family":"Sumner","given":"B. H."}],"note":null,"publisher":"Oliver and Boyd","editor":null,"publisher_place":"Edinburgh","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"21","type":"book","title":"The Philosophy of American History","container_title":null,"author":[{"family":"Zucker","given":"Morris"}],"note":null,"publisher":"Arnold and Howard","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":"2 vols.","page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"22","type":"journal-article","title":"History as a Liberal Art","container_title":"Journal of the History of Ideas","author":[{"family":"Barzun","given":"Jacques"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"VI","page":"81-88","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"23","type":"journal-article","title":"The Study of Contemporary History: Some Further Reflections","container_title":"History","author":[{"family":"Beloff","given":"Max"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXX","page":"75-84","fascicle":"N. S.","reprint":null,"edition":null,"incomplete":null},{"id":"24","type":"journal-article","title":"Appunti sullo ‘storicismo’","container_title":"Società","author":[{"family":"Cantimori","given":"Delio"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"I","page":"1-45","fascicle":null,"reprint":"Reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959, 1-45","edition":null,"incomplete":null},{"id":"25","type":"journal-article","title":"The Meaning of History","container_title":"Ethics","author":[{"family":"Coulborn","given":"Rushton"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"LV","page":"46-63","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"26","type":"journal-article","title":"History – a Science?","container_title":"Mississippi Valley Historical Review","author":[{"family":"Gould","given":"Clarence P."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXII","page":"375-388","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"27","type":"journal-article","title":"Generality and Singularity in Historical Judgment","container_title":"Journal of Philosophy","author":[{"family":"Hofstadter","given":"A."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XLII","page":"57-65","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"28","type":"journal-article","title":"Les nouvelles conceptions de l’histoire","container_title":"Revue philosophique","author":[{"family":"Lenoble","given":"R."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CXXXV","page":"193-208, 324-348","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"29","type":"journal-article","title":"In History or Beyond History","container_title":"Harvard Theological Review","author":[{"family":"McCown","given":"C. C."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XXXVIII","page":"151-175","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"30","type":"journal-article","title":"History and the Social Science Research Council","container_title":"American Historical Review","author":[{"family":"Nichols","given":"Roy F."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"L","page":"491-499","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"31","type":"journal-article","title":"The Poverty of Historicism, Part III","container_title":"Economica","author":[{"family":"Popper","given":"Karl"}],"note":"Parts I and II appeared in 1944. Cf. also #1233","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":["1233"],"relation":null,"volume":"XII","page":"69-89","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"32","type":"journal-article","title":"History and the Historian","container_title":"Journal of Philosophy","author":[{"family":"Weiss","given":"Paul"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XLII","page":"169-179","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"33","type":"journal-article","title":"The Attack on the Historical Method","container_title":"Journal of Philosophy","author":[{"family":"White","given":"Morton G."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"XLII","page":"314-331","fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.71 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 21.1K IT + 22.1K OT = 43.2K TTCost: 0.026$0.094$0.120$
Result 3 of 124

Test T1600 at 2026-08-18

book-page information-extraction printed 20 en list bibliographic

Configuration
Providerx-ai
Modelgrok-4.6
  
Temperature0.0
DataclassDocument
  
Normalized Score69.09 %
Test time119.11 seconds
Prompt
Results

{"metadata":{"title":"Books","year":"1945","page_number":2},"entries":[{"id":"1","type":"book","title":"Time as Dimension and History","container_title":null,"author":[{"family":"Alexander","given":"Hubert G."}],"note":null,"publisher":"University of New Mexico Press","editor":null,"publisher_place":"Albuquerque","issued":"1945","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"2","type":"book","title":"Wahrheit und Ideologie","container_title":null,"author":[{"family":"Barth","given":"Hans"}],"note":null,"publisher":"Manesse","editor":null,"publisher_place":"Zürich","issued":"1945","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"3","type":"book","title":"Las generaciones en la historia","container_title":null,"author":[{"family":"Entralgo Laín","given":"Pedro"}],"note":null,"publisher":"Instituto de estudios políticos","editor":null,"publisher_place":"Madrid","issued":"1945","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"4","type":"book","title":"Cuatro visiones de la historia universal","container_title":null,"author":[{"family":"Ferrater Mora","given":"José"}],"note":null,"publisher":"Editorial Losada","editor":null,"publisher_place":"Buenos Aires","issued":"1945","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"5","type":"book","title":"The Use of Personal Documents in History, Anthropology, and Sociology","container_title":null,"author":[{"family":"Gottschalk","given":"L."},{"family":"Kluckhohn","given":"C."},{"family":"Angell","given":"R."}],"note":"Bulletin 53","publisher":"Social Science Research Council","editor":null,"publisher_place":"New York","issued":"1945","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"6","type":"journal-article","title":"","container_title":"The American Journal of Sociology","author":[{"family":"Lapiere","given":"R. T."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1946","event_date":null,"related":null,"relation":"5","volume":"LII","page":"156-157","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"7","type":"book","title":"El problema de la historia y su lugar en el conocimiento","container_title":null,"author":[{"family":"Jasinowski","given":"Bogumil"}],"note":null,"publisher":"Universidad de Chile","editor":null,"publisher_place":"Santiago, Chile","issued":"1945","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"8","type":"journal-article","title":"","container_title":"Revue philosophique","author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1950","event_date":null,"related":null,"relation":"7","volume":"CXL","page":"528","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"9","type":"book","title":"Man the Measure: a New Approach to History","container_title":null,"author":[{"family":"Kahler","given":"Erich"}],"note":"1st ed. New York: Pantheon, 1943","publisher":"Jonathan Cape","editor":null,"publisher_place":"London","issued":"1945","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":"2nd ed.","incomplete":false},{"id":"10","type":"journal-article","title":"The Flight from Reason","container_title":"Journal of Modern History","author":[{"family":"Savelle","given":"Max"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1945","event_date":null,"related":null,"relation":"9","volume":"XVII","page":"153-162","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"11","type":"book","title":"The Social Interpretation of History","container_title":null,"author":[{"family":"Maurice","given":"William"}],"note":null,"publisher":"Scribner","editor":null,"publisher_place":"New York","issued":"1945","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"12","type":"book","title":"The Open Society and Its Enemies","container_title":null,"author":[{"family":"Popper","given":"Karl"}],"note":"Revised ed. Princeton: Princeton University Press, 1950","publisher":"Routledge","editor":null,"publisher_place":"London","issued":"1945","event_date":null,"related":null,"relation":null,"volume":"2","page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"13","type":"journal-article","title":"","container_title":"Journal of Philosophy","author":[{"family":"Aiken","given":"H. D."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":"12","volume":"XLIV","page":"459-479","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"14","type":"journal-article","title":"The Social Scientist in the ‘Open Society’","container_title":null,"author":[{"family":"Bock","given":"Kenneth E."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"12","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":true}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.69 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 17.5K IT + 12.3K OT = 29.9K TTCost: 0.035$0.074$0.109$
Result 4 of 124

Test T1585 at 2026-08-18

book-page information-extraction printed 20 en list bibliographic

Configuration
Providergenai
Modelgemini-3.7-flash
  
Temperature0.0
DataclassDocument
  
Normalized Score66.46 %
Test time14.02 seconds
Prompt
Results

{"metadata":{"title":"HISTORY AND THEORY","year":"1946","page_number":5},"entries":[{"id":"49","type":"journal-article","title":"Review of the German translation","container_title":null,"author":[{"family":"Schlenke","given":"Manfred"}],"note":"Review of the German translation","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":"CLXXXIV","page":"594-597","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"50","type":"book","title":"Introduzione allo studio della storia","container_title":null,"author":[{"family":"Cusin","given":"Fabio"}],"note":null,"publisher":"Cedam","editor":null,"publisher_place":"Padova","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"51","type":"journal-article","title":"Sophia I (1947), 206-207","container_title":"Sophia","author":[{"family":"Cafaro","given":"F."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":"50","volume":"I","page":"206-207","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"52","type":"book","title":"L'histoire, science du concret","container_title":null,"author":[{"family":"Dardel","given":"Eric"}],"note":null,"publisher":"Presses Universitaires de France","editor":null,"publisher_place":"Paris","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"53","type":"book","title":"Historical Change","container_title":null,"author":[{"family":"Einstein","given":"Lewis"}],"note":null,"publisher":"Cambridge University Press","editor":null,"publisher_place":"Cambridge","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"54","type":"book","title":"The Place of War in History","container_title":null,"author":[{"family":"Falls","given":"Cyril"}],"note":null,"publisher":"Clarendon","editor":null,"publisher_place":"Oxford","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"55","type":"book","title":"A Guide to Historical Method","container_title":null,"author":[{"family":"Garraghan","given":"Gilbert J."}],"note":null,"publisher":"Fordham University Press","editor":["Jean Delanglez"],"publisher_place":"New York","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"56","type":"book","title":"Leçons sur la philosophie de l'histoire","container_title":null,"author":[{"family":"Gibelin","given":"J."}],"note":null,"publisher":"Vrin","editor":null,"publisher_place":"Paris","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"57","type":"book","title":"Bilan de l'histoire","container_title":null,"author":[{"family":"Grousset","given":"René"}],"note":null,"publisher":"Plon","editor":null,"publisher_place":"Paris","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"58","type":"book","title":"Introduction à l'histoire","container_title":null,"author":[{"family":"Halphen","given":"Louis"}],"note":null,"publisher":"Presses Universitaires de France","editor":null,"publisher_place":"Paris","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"59","type":"journal-article","title":"Sur une forme d'histoire qui n'est pas la nôtre","container_title":"Annales: Economies-sociétés-civilisations","author":[{"family":"Febvre","given":"Lucien"}],"note":"* Annales: Economies-sociétés-civilisations will be cited hereafter as Annales.","publisher":null,"editor":null,"publisher_place":null,"issued":"1946","event_date":null,"related":null,"relation":"58","volume":"III","page":"21-24","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"60","type":"journal-article","title":"Avenir de l'histoire","container_title":"Revue historique","author":[{"family":"Lefebvre","given":"Georges"}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":"58","volume":"CXCVII","page":"55-61","fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"61","type":"book","title":"Hoe bepaalt de geschiedenis het heden? Een niet gehouden rede","container_title":null,"author":[{"family":"Huizinga","given":"J."}],"note":null,"publisher":"Tjeenk Willink","editor":null,"publisher_place":"Haarlem","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"62","type":"book","title":"De mensch en de beschaving","container_title":null,"author":[{"family":"Huizinga","given":"J."}],"note":null,"publisher":"Pantheon","editor":null,"publisher_place":"Amsterdam, Antwerpen","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"63","type":"book","title":"Historische Meditationen","container_title":null,"author":[{"family":"Kaegi","given":"W."}],"note":null,"publisher":"Fritz und Washmuth","editor":null,"publisher_place":"Zürich","issued":"1946","event_date":null,"related":null,"relation":null,"volume":"2 vols.","page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"64","type":"book","title":"Notions d'historiographie moderne","container_title":null,"author":[{"family":"Lefebvre","given":"G."}],"note":"dactylographed for his students","publisher":"Centre de Documentation Universitaire","editor":null,"publisher_place":"Paris","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"65","type":"book","title":"Essays on Historiography","container_title":null,"author":[{"family":"Malin","given":"James C."}],"note":null,"publisher":"the Author","editor":null,"publisher_place":"Lawrence, Kansas","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"66","type":"book","title":"The Old Testament Interpretation of History","container_title":null,"author":[{"family":"North","given":"C. R."}],"note":null,"publisher":"The Epworth Press","editor":null,"publisher_place":"London","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"67","type":"book","title":"Concord and Liberty","container_title":null,"author":[{"family":"Ortega y Gasset","given":"José"}],"note":"trans. by Helene Weyl","publisher":"Norton","editor":null,"publisher_place":"New York","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"68","type":"book","title":"Sociolvidenbakelig Metodelaere","container_title":null,"author":[{"family":"Ranulf","given":"Svend"}],"note":null,"publisher":"Einar Munksgaard","editor":null,"publisher_place":"København","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null},{"id":"69","type":"book","title":"Geschichte als Bildungsmacht","container_title":null,"author":[{"family":"Ritter","given":"Gerhard"}],"note":null,"publisher":"Deutsche Verlags-Anstalt","editor":null,"publisher_place":"Stuttgart","issued":"1946","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":null}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.66 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 5.8K IT + 13.8K OT = 19.6K TTCost: 0.004$0.052$0.056$
Result 5 of 124

Test T1570 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

Configuration
Providerhuggingface
Modelmeta-models/Muse-Glimmer-30B
  
Temperature0.0
DataclassDocument
  
Normalized Score60.69 %
Test time166.27 seconds
Prompt
Results

{"metadata":{"title":"HISTORY AND THEORY","year":"1946","page_number":5},"entries":[{"id":"49","type":"book","title":"Manfred Schlenke, Historische Zeitschrift CLXXXIV (1957), 594-597 [Review of the German translation].","container_title":null,"author":null,"note":"[Review of the German translation].","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"50","type":"book","title":"Introduzione allo studio della storia","container_title":null,"author":null,"note":null,"publisher":"Cedam","editor":null,"publisher_place":"Padova","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"51","type":"book","title":"Sophia I (1947), 206-207","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"50","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"52","type":"book","title":"L'histoire, science du concret","container_title":null,"author":null,"note":null,"publisher":"Presses Universitaires de France","editor":null,"publisher_place":"Paris","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"53","type":"book","title":"Historical Change","container_title":null,"author":null,"note":null,"publisher":"Cambridge University Press","editor":null,"publisher_place":"Cambridge","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"54","type":"book","title":"The Place of War in History","container_title":null,"author":null,"note":null,"publisher":"Clarendon","editor":null,"publisher_place":"Oxford","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"55","type":"book","title":"A Guide to Historical Method","container_title":null,"author":null,"note":null,"publisher":"Fordham University Press","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"56","type":"book","title":"Leçons sur la philosophie de l'histoire","container_title":null,"author":null,"note":null,"publisher":"Vrin","editor":null,"publisher_place":"Paris","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"57","type":"book","title":"Bilan de l'histoire","container_title":null,"author":null,"note":null,"publisher":"Plon","editor":null,"publisher_place":"Paris","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"58","type":"book","title":"Introduction à l'histoire","container_title":null,"author":null,"note":null,"publisher":"Presses Universitaires de France","editor":null,"publisher_place":"Paris","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"59","type":"book","title":"Sur une forme d'histoire qui n'est pas la nôtre","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"60","type":"book","title":"Avenir de l'histoire","container_title":null,"author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"61","type":"book","title":"Hoe bepaalt de geschiedenis het heden? Een niet gehouden rede","container_title":null,"author":null,"note":null,"publisher":"Tjeenk Willink","editor":null,"publisher_place":"Haarlem","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"62","type":"book","title":"De mensch en de beschaving","container_title":null,"author":null,"note":null,"publisher":"Pantheon","editor":null,"publisher_place":"Amsterdam, Antwerpen","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"63","type":"book","title":"Historische Meditationen","container_title":null,"author":null,"note":null,"publisher":"Fritz und Washmuth","editor":null,"publisher_place":"Zürich","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"64","type":"book","title":"Notions d'historiographie moderne","container_title":null,"author":null,"note":null,"publisher":"Centre de Documentation Universitaire","editor":null,"publisher_place":"Paris","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"65","type":"book","title":"Essays on Historiography","container_title":null,"author":null,"note":null,"publisher":"the Author","editor":null,"publisher_place":"Lawrence, Kansas","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"66","type":"book","title":"The Old Testament Interpretation of History","container_title":null,"author":null,"note":null,"publisher":"The Epworth Press","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"67","type":"book","title":"Concord and Liberty","container_title":null,"author":null,"note":null,"publisher":"Norton","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"68","type":"book","title":"Sociolvidenbakelig Metodelaere","container_title":null,"author":null,"note":null,"publisher":"Einar Munksgaard","editor":null,"publisher_place":"København","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"69","type":"book","title":"Geschichte als Bildungsmacht","container_title":null,"author":null,"note":null,"publisher":"Deutsche Verlags-Anstalt","editor":null,"publisher_place":"Stuttgart","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.61 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 17.7K IT + 23.6K OT = 41.3K TTCost: 0.006$0.035$0.042$
Result 6 of 124

Test T1540 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

Configuration
Providerhuggingface
Modelthinkingmachines/Inkling-Small
  
Temperature0.0
DataclassDocument
  
Normalized Score43.30 %
Test time181.80 seconds
Prompt
Results

{"metadata":{"title":"Books","year":"1945","page_number":2},"entries":[{"id":"1","type":"book","title":"Time as Dimension and History","container_title":null,"author":[{"family":"Alexander","given":"Hubert G."}],"note":null,"publisher":"University of New Mexico Press","editor":null,"publisher_place":"Albuquerque","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"2","type":"book","title":"Wahrheit und Ideologie","container_title":null,"author":[{"family":"Barth","given":"Hans"}],"note":null,"publisher":"Manesse","editor":null,"publisher_place":"Zürich","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"3","type":"book","title":"Las generaciones en la historia","container_title":null,"author":[{"family":"Entralyo Laín","given":"Pedro"}],"note":null,"publisher":"Instituto de estudios políticos","editor":null,"publisher_place":"Madrid","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"4","type":"book","title":"Cuatro visiones de la historia universal","container_title":null,"author":[{"family":"Ferrater Mora","given":"José"}],"note":null,"publisher":"Editorial Losada","editor":null,"publisher_place":"Buenos Aires","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"5","type":"book","title":"The Use of Personal Documents in History, Anthropology, and Sociology","container_title":null,"author":[{"family":"Gottschalk","given":"L."},{"family":"Kluckhohn","given":"C."},{"family":"Angell","given":"R."}],"note":null,"publisher":"Social Science Research Council","editor":null,"publisher_place":"New York","issued":"Bulletin 53","event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"6","type":"journal-article","title":"The American Journal of Sociology LII (1946), 156-157","container_title":"The American Journal of Sociology","author":[{"family":"Lapiere","given":"R. T."}],"note":"Review","publisher":null,"editor":null,"publisher_place":null,"issued":"LII (1946)","event_date":null,"related":null,"relation":"5","volume":"LII","page":"156-157","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"7","type":"book","title":"El problema de la historia y su lugar en el conocimiento","container_title":null,"author":[{"family":"Jasinowski","given":"Bogumil"}],"note":null,"publisher":"Universidad de Chile","editor":null,"publisher_place":"Santiago, Chile","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"8","type":"journal-article","title":"Revue philosophique CXL (1950), 528","container_title":"Revue philosophique","author":[],"note":"Review","publisher":null,"editor":null,"publisher_place":null,"issued":"CXL (1950)","event_date":null,"related":null,"relation":"7","volume":"CXL","page":"528","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"9","type":"book","title":"Man the Measure: a New Approach to History","container_title":null,"author":[{"family":"Kahler","given":"Erich"}],"note":"2nd ed. (1st ed. New York: Pantheon, 1943)","publisher":"Jonathan Cape","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":"2nd ed.","incomplete":false},{"id":"10","type":"journal-article","title":"The Flight from Reason","container_title":"Journal of Modern History","author":[{"family":"Savelle","given":"Max"}],"note":"Review","publisher":null,"editor":null,"publisher_place":null,"issued":"XVII (1945)","event_date":null,"related":null,"relation":"9","volume":"XVII","page":"153-162","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"11","type":"book","title":"The Social Interpretation of History","container_title":null,"author":[{"family":"Maurice","given":"William"}],"note":null,"publisher":"Scribner","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"12","type":"book","title":"The Open Society and Its Enemies","container_title":null,"author":[{"family":"Popper","given":"Karl"}],"note":"2 vols. (Revised ed. Princeton: Princeton University Press, 1950)","publisher":"Routledge","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":"2","page":null,"fascicle":null,"reprint":null,"edition":"Revised ed.","incomplete":false},{"id":"13","type":"journal-article","title":"Journal of Philosophy XLIV (1947), 459-479","container_title":"Journal of Philosophy","author":[{"family":"Aiken","given":"H. D."}],"note":"Review / review-article","publisher":null,"editor":null,"publisher_place":null,"issued":"XLIV (1947)","event_date":null,"related":null,"relation":"12","volume":"XLIV","page":"459-479","fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"14","type":"journal-article","title":"The Social Scientist in the 'Open Society'","container_title":null,"author":[{"family":"Bock","given":"Kenneth E."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"12","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":true}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.43 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 9.1K IT + 26.5K OT = 35.6K TTCost: 0.004$0.032$0.036$
Result 7 of 124

Test T1555 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

Configuration
Providerhuggingface
Modelthinkingmachines/Inkling
  
Temperature0.0
DataclassDocument
  
Normalized Score0.00 %
Test time47.01 seconds
Prompt
Results

We need parse image page 10 (actually page number printed 9? Wait additional info says page number of this page is 10. The printed page number at top right is 9, but we should use 10 for metadata page_number? The schema has metadata with title, year, page_number. Need determine title and year. The header shows "1947 BIBLIOGRAPHY 9". So year 1947, title "BIBLIOGRAPHY". Page number given as 10. So metadata: {"title":"BIBLIOGRAPHY","year":"1947","page_number":10}.

Now need extract entries 140-160, with possible incomplete last entry 160? Let's examine image carefully.

Entries:
140 Smellie, K. B., Why We Read History, London: P. Elek.
141 Toynbee, Arnold J., A Study of History, abridged by D. C. Somervell, New York: Oxford (Abridgement of vols. I-VI of A Study of History).
142 Verberne, L. G. J., In den spiegel van het verleden: historische opstellen, Utrecht, Antwerpen: Bruna.
143 Vevir, José, Esquemas de metodología eclesiástica, Barcelona: Instituto.
144 Walz, Hans H., Sinn und Ziel der Geschichte, Bonn: Universitäts-Verlag.

Then section "Articles"

145 Atti del congresso internazionale di filosofia 15-20 November, 1946, Milano: Castellani.
Relevant articles:
146 Pietro C. Drago, "Storia e materialismo storico", vol. I, 109-117.
147 Vito Fazio-Allmayer, "Critica del giudizio storico", vol. I, 281-290.
148 A. Nyman, "Forza e spirito nella storia", vol. I, 191-200.
149 Benjamin, Walter, "Sur le concept d'histoire", Les temps modernes II, 623-634.
150 Boodin, John E., "Philosophy of History", in Dagobert D. Runes, ed., 20th Century Philosophy, New York: Philosophical Library, 89-106.
151 Caillois, R. P., "De la perception à l'histoire. La philosophie de M. Merleau-Ponty", Deucation II, 57-85. (Note "Deucation"? Actually "Deucation"? Let's keep as printed.)
152 Cantimori, Delio, "Commemorazione di Adolfo Omodeo", Annali della Scuola Normale di Pisa, fasc. 3-4; (reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959).
153 Cowan, Thomas, "The Historian and the Philosophy of Science", Isis XXXVIII, 11-18.
154 Crawford, R. M., "History as a Science", Historical Studies: Australia and New Zealand III, 153-175.
155 Danielou, J., "Christianisme et histoire", Etudes CCLIV, 166-184.
156 Dell, Stanley, "Wahrheit der Geschichte. Geschichte der Wahrheit", Amerikanische Rundschau III, 44-53.
157 Fay, Sidney B., "The Idea of Progress", American Historical Review LII, 231-246.
158 Fessard, Gaston, "Théologie et histoire", Dieu vivant VIII, 39-65.
159 Fish, Andrew, "Acton, Creighton, and Lea: a Study in History and Ethics", Pacific Historical Review XVI, 59-69.
160 Garosci, A., "Le conscience historique en Italie", Les temps modernes III, 23-24.

Need determine types: likely "book" for 140-144, "other" or "journal-article"? The schema allows book, journal-article, other. For articles section, entry 145 is maybe "other" (conference proceedings?). Entries 146-160 are journal articles? Actually they are articles within volumes/journals. So type "journal-article". For 145, it's conference proceedings published? Could be "other" or "book". Let's assign "other" for conference proceedings? But maybe "book". Let's think. The schema requires one of enum. We'll assign 145 as "other" since it's conference acts. Or "book"? Let's see context: "Atti del congresso..." published Milano: Castellani. That sounds like a book of proceedings. Could be "book". But then "Relevant articles:" lists articles within it. So 145 is container, and 146-149 are articles in vol. I of that container? Actually 146-149 cite vol. I, 109-117 etc. So they are related to 145? The instruction: "If an entry reviews another entry, the relation field should contain the id of the reviewed entry." Not exactly this. But maybe 146-149 are part of 145? However they have their own entries. There's no explicit relation field required except if reviews another entry. So we can leave relation null.

But need check if any entry reviews another. Doesn't seem so.

Need parse authors correctly with family and given.

Let's list precisely with fields:

Entry 140:
id "140"
type "book"
title "Why We Read History"
author: [{"family":"Smellie","given":"K. B."}]
publisher "P. Elek"
publisher_place "London"
incomplete false? Not last? Actually 140 is not last on page? Wait page ends at 160, but 140 is not last entry on page. Only last entry on page might be incomplete. The last entry visible is 160, which seems complete? Let's check: "Garosci, A., "Le conscience historique en Italie", Les temps modernes III, 23-24." That looks complete, no continuation indicated. But the instruction says "The last entry on a page might be incomplete. This means that the entry continues on the next page. If so, set the incomplete field to true." Since 160 ends with page range 23-24 and no indication of continuation, likely incomplete false. However sometimes the last entry on page is cut off in image? Here 160 is fully visible at bottom. So incomplete false for all? Wait but they said "The last entry on a page might be incomplete." We need check if entry 160 is cut off? The image shows entry 160 fully, then blank space. So not incomplete.

But wait page number is 10, and printed page is 9. The entries go from 140 to 160. The last entry 160 might continue? No, looks complete.

Thus all entries have incomplete null or false? The schema allows boolean or null. We'll set false? Or null? The instruction: "If so, set the incomplete field to true." So if not, we can omit or set false/null. Let's set null for all except if true. But easier set false? The schema allows boolean or null. Let's use null for non-incomplete, but maybe false is okay. Let's use null except true.

Now parse each entry with correct fields.

140:
author: Smellie, K. B. => family "Smellie", given "K. B."
title: "Why We Read History"
publisher_place: "London"
publisher: "P. Elek"
No container, volume, page, etc.

141:
author: Toynbee, Arnold J. => family "Toynbee", given "Arnold J."
title: "A Study of History"
note? There's "abridged by D. C. Somervell" => maybe editor? Actually abridged by is like editor? The schema has editor field (array of strings). So editor: ["D. C. Somervell"]? Or note? Let's put in note? But there is specific "abridged by D. C. Somervell, New York: Oxford (Abridgement of vols. I-VI of A Study of History)." The publisher is Oxford? Actually "New York: Oxford" => publisher_place "New York", publisher "Oxford". The parenthetical "(Abridgement of vols. I-VI of A Study of History)" is part of title? Or note? Let's include in title? Actually title is "A Study of History". The rest is publication info and note. Let's parse:
publisher_place: "New York"
publisher: "Oxford"
editor: ["D. C. Somervell"]? The field is "editor" array of strings. Yes, abridged by can be considered editor.
note: "Abridgement of vols. I-VI of A Study of History" maybe in note.
But also there is "(Abridgement of vols. I-VI of A Study of History)" right after publisher. Let's assign note: "Abridgement of vols. I-VI of A Study of History". Or include in title? Probably note.

Let's do:
id "141"
type "book"
title "A Study of History"
author [{"family":"Toynbee","given":"Arnold J."}]
editor ["D. C. Somervell"]
publisher "Oxford"
publisher_place "New York"
note "Abridgement of vols. I-VI of A Study of History"

142:
author Verberne, L. G. J. => family "Verberne", given "L. G. J."
title "In den spiegel van het verleden: historische opstellen"
publisher_place "Utrecht, Antwerpen"
publisher "Bruna"
type "book"

143:
author Vevir, José => family "Vevir", given "José"
title "Esquemas de metodología eclesiástica"
publisher_place "Barcelona"
publisher "Instituto"
type "book"

144:

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.00 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 13.5K IT + 10.2K OT = 23.7K TTCost: 0.013$0.041$0.055$
Result 8 of 124

Test T1525 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

Configuration
Providerhuggingface
ModelMiniMaxAI/MiniMax-M3
  
Temperature0.0
DataclassDocument
  
Normalized Score20.65 %
Test time228.70 seconds
Prompt
Results

{"metadata":{"title":"Books","year":"1945","page_number":2},"entries":[{"id":"1","type":"book","title":"Time as Dimension and History","container_title":null,"author":[{"family":"Alexander","given":"Hubert G."}],"note":null,"publisher":"University of New Mexico Press","editor":null,"publisher_place":"Albuquerque","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"2","type":"book","title":"Wahrheit und Ideologie","container_title":null,"author":[{"family":"Barth","given":"Hans"}],"note":null,"publisher":"Manesse","editor":null,"publisher_place":"Zürich","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"3","type":"book","title":"Las generaciones en la historia","container_title":null,"author":[{"family":"Entralgo Lain","given":"Pedro"}],"note":null,"publisher":"Instituto de estudios políticos","editor":null,"publisher_place":"Madrid","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"4","type":"book","title":"Cuatro visiones de la historia universal","container_title":null,"author":[{"family":"Ferrater Mora","given":"José"}],"note":null,"publisher":"Editorial Losada","editor":null,"publisher_place":"Buenos Aires","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"5","type":"book","title":"The Use of Personal Documents in History, Anthropology, and Sociology","container_title":null,"author":[{"family":"Gottschalk","given":"L."},{"family":"Kluckhohn","given":"C."},{"family":"Angell","given":"R."}],"note":"Social Science Research Council, Bulletin 53","publisher":"Social Science Research Council","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"6","type":"book","title":"The American Journal of Sociology LII (1946), 156-157","container_title":null,"author":[{"family":"Lapierre","given":"R. T."}],"note":"Review","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"5","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"7","type":"book","title":"El problema de la historia y su lugar en el conocimiento","container_title":null,"author":[{"family":"Jasinowski","given":"Bogumil"}],"note":"Review","publisher":"Universidad de Chile","editor":null,"publisher_place":"Santiago","issued":null,"event_date":null,"related":null,"relation":"5","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"8","type":"book","title":"Revue philosophique CXL (1950), 528","container_title":null,"author":null,"note":"Review","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"5","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"9","type":"book","title":"Man the Measure: a New Approach to History","container_title":null,"author":[{"family":"Kahler","given":"Erich"}],"note":"Review","publisher":"Jonathan Cape","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":"5","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":"2nd ed.","incomplete":false},{"id":"10","type":"book","title":"\"The Flight from Reason\"","container_title":"Journal of Modern History XVII (1945), 153-162","author":[{"family":"Savelle","given":"Max"}],"note":"Review","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"5","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"11","type":"book","title":"The Social Interpretation of History","container_title":null,"author":[{"family":"Maurice","given":"William"}],"note":null,"publisher":"Scribner","editor":null,"publisher_place":"New York","issued":null,"event_date":null,"related":null,"relation":null,"volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"12","type":"book","title":"The Open Society and Its Enemies","container_title":null,"author":[{"family":"Popper","given":"Karl"}],"note":"Reviews and review-articles","publisher":"Routledge (Revised ed. Princeton: Princeton University Press, 1950)","editor":null,"publisher_place":"London","issued":null,"event_date":null,"related":null,"relation":null,"volume":"2 vols.","page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"13","type":"book","title":"Journal of Philosophy XLIV (1947), 459-479","container_title":null,"author":[{"family":"Aiken","given":"H. D."}],"note":"Reviews and review-articles","publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"12","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":false},{"id":"14","type":"book","title":"\"The Social Scientist in the 'Open Society'\"","container_title":null,"author":[{"family":"Bock","given":"Kenneth E."}],"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":null,"event_date":null,"related":null,"relation":"12","volume":null,"page":null,"fascicle":null,"reprint":null,"edition":null,"incomplete":true}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.21 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 7.6K IT + 3.7K OT = 11.3K TTCost: 0.002$0.004$0.006$
Result 9 of 124

Test T1510 at 2026-08-15

book-page information-extraction printed 20 en list bibliographic

Configuration
Providerhuggingface
ModelQwen/Qwen3-VL-235B-A22B-Instruct
  
Temperature0.0
DataclassDocument
  
Normalized Score60.68 %
Test time99.43 seconds
Prompt
Results

{"metadata":{"title":"HISTORY AND THEORY","year":"}, 1945","page_number":3},"entries":[{"id":"","type":"book","title":"War and History","container_title":"","author":[{"family":"Sumner","given":"B. H."}],"note":"","publisher":"Oliver and Boyd","editor":[],"publisher_place":"Edinburgh","issued":"1955","event_date":"","related":[],"relation":"","volume":"","page":"","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"book","title":"The Philosophy of American History","container_title":"","author":[{"family":"Zucker","given":"Morris"}],"note":"","publisher":"Arnold and Howard","editor":[],"publisher_place":"New York","issued":"1955","event_date":"","related":[],"relation":"","volume":"2 vols.","page":"","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"History as a Liberal Art","container_title":"Journal of the History of Ideas","author":[{"family":"Barzun","given":"Jacques"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"VI","page":"81-88","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"The Study of Contemporary History: Some Further Reflections","container_title":"History","author":[{"family":"Beloff","given":"Max"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"N. S. XXX","page":"75-84","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"Appunti sullo 'storicismo'","container_title":"Società","author":[{"family":"Cantimori","given":"Delio"}],"note":"Reprinted in D. Cantimori, Studi di storia, Torino: Einaudi, 1959, 1-45.","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"I","page":"1-45","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"The Meaning of History","container_title":"Ethics","author":[{"family":"Coulborn","given":"Rushton"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"LV","page":"46-63","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"History – a Science?","container_title":"Mississippi Valley Historical Review","author":[{"family":"Gould","given":"Clarence P."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"XXXII","page":"375-388","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"Generality and Singularity in Historical Judgment","container_title":"Journal of Philosophy","author":[{"family":"Hofstadter","given":"A."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"XLII","page":"57-65","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"Les nouvelles conceptions de l’histoire","container_title":"Revue philosophique","author":[{"family":"Lenoble","given":"R."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"CXXXV","page":"193-208, 324-348","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"In History or Beyond History","container_title":"Harvard Theological Review","author":[{"family":"McCown","given":"C. C."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"XXXVIII","page":"151-175","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"History and the Social Science Research Council","container_title":"American Historical Review","author":[{"family":"Nichols","given":"Roy F."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"L","page":"491-499","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"The Poverty of Historicism, Part III","container_title":"Economica","author":[{"family":"Popper","given":"Karl"}],"note":"Parts I and II appeared in 1944. Cf. also #1233.","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"XII","page":"69-89","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"History and the Historian","container_title":"Journal of Philosophy","author":[{"family":"Weiss","given":"Paul"}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"XLII","page":"169-179","fascicle":"","reprint":"","edition":"","incomplete":false},{"id":"","type":"journal-article","title":"The Attack on the Historical Method","container_title":"Journal of Philosophy","author":[{"family":"White","given":"Morton G."}],"note":"","publisher":"","editor":[],"publisher_place":"","issued":"1955","event_date":"","related":[],"relation":"","volume":"XLII","page":"314-331","fascicle":"","reprint":"","edition":"","incomplete":false}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.61 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 14.3K IT + 14.6K OT = 28.9K TTCost: 0.003$0.013$0.016$
Result 10 of 124

Test T1480 at 2026-08-14

book-page information-extraction printed 20 en list bibliographic

Configuration
Providerhuggingface
Modelswiss-ai/apertus-v1.5-70b
  
Temperature0.0
DataclassDocument
  
Normalized Score16.06 %
Test time30.16 seconds
Prompt
Results

{"metadata":{"title":"BIBLIOGRAPHY","year":"1947","page_number":10},"entries":[{"id":"relation_to_other_entry_id","type":"book","title":"Smellie, K. B., Why We Read History, London: P. Elek.","container_title":"BIBLIOGRAPHY","author":null,"note":null,"publisher":null,"editor":null,"publisher_place":null,"issued":"1947","event_date":null,"related":null,"relation":null,"volume":null,"page":"10","fascicle":null,"reprint":null,"edition":null,"incomplete":false}]}

Scoring
Fuzzy Score F1 micro / macro Micro precision/recall Tue/False Positives
0.16 n/a n/a n/a n/a n/a n/a n/a n/a
      Micro Precision Micro Recall Instances TP FP FN
Costs / Pricing
Pricing Date: n/an/aTokens: 40.2K IT + 7.6K OT = 47.8K TTCost: 0.033$0.022$0.055$