A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.
A test run includes:
Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.
newspaper-page data-correction 18 en
openrouter qwen/qwen3.7-plus · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening tag for the title element was malformed and missing a closing angle bracket ('<TITLEEine' instead of '<TITLE>'). This has been corrected to ensure the XML is well-formed. As a historian, I also note that 'Tossanische' is likely an OCR error or archaic spelling for 'Toskanische' (Tuscan), but the structural XML fault has been resolved."}newspaper-page data-correction 18 en
openrouter qwen/qwen3.8-max-0902 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening tag <TITLE> was malformed because its closing angle bracket was missing, causing the element name to run into the text content. I corrected it to <TITLE> so the TITLE element is properly opened and closed within BIBL and ITEM."}newspaper-page data-correction 18 en
huggingface Qwen/Qwen3-VL-235B-A22B-Instruct · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"Added missing closing angle bracket '>' after 'TITLE' to properly close the opening tag. The original tag '<TITLEEine Tossanische Bibel' was malformed and should be '<TITLE>Eine Tossanische Bibel</TITLE>'."}newspaper-page data-correction 18 en
openrouter meta-llama/llama-4-maverick · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEMS><ITEM><TEXT>37.</TEXT><BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM></ITEMS>","number_of_corrections":3,"explanation":"The provided XML string is mostly well-formed but lacks a proper root element and has some formatting issues. The 'TITLE' element contains text that starts with a capital letter but is not properly separated from the preceding element. I've added a root element 'ITEMS' to encapsulate the 'ITEM' element. I've also added a 'TEXT' element around the text '37.' to structure it properly within the 'ITEM' element. The 'TITLE' element's content has been adjusted to be properly formatted."}newspaper-page data-correction 18 en
openrouter z-ai/glm-5.3-flash · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening <TITLE> tag was malformed: it was missing the closing angle bracket (>), so the tag name and its text content were merged into '<TITLEEine Tossanische Bibel'. Inserting '>' after 'TITLE' produces a well-formed element: <TITLE>Eine Tossanische Bibel</TITLE>. All other tags (<ITEM>, <BIBL>) were correctly formed and properly nested, so no further changes were necessary."}newspaper-page data-correction 18 en
openrouter qwen/qwen3.8-flash · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"Added the missing closing angle bracket '>' to the opening <TITLE> tag so that the XML is well-formed."}newspaper-page data-correction 18 en
openrouter qwen/qwen3.8-27b · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The start tag was malformed as <TITLEEine Tossanische Bibel>. A space was added after the tag name TITLE so that the title text is properly enclosed in <TITLE>...</TITLE>."}newspaper-page data-correction 18 en
openrouter google/gemma-4-31b-it · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening tag for the title was malformed; it lacked the closing angle bracket ('>'), causing the text 'Eine Tossanische Bibel' to be treated as part of the tag definition rather than the element content. I closed the <TITLE> tag to properly encapsulate the bibliographic data."}newspaper-page data-correction 18 en
openrouter z-ai/glm-5v-turbo · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening tag for the element 'TITLE' was malformed, missing the closing angle bracket (>). I inserted the bracket to properly delimit the tag from the text content."}newspaper-page data-correction 18 en
openrouter qwen/qwen3.5-35b-a3b · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.