A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.
A test run includes:
Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.
newspaper-page data-correction 18 en
openrouter meta-llama/llama-4-maverick · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"description": "Main output structure for Book Advert XML files from Avisblatt.", "properties": {"fixed_xml": {"description": "The corrected XML content as a string.", "title": "Fixed Xml", "type": "string"}, "number_of_corrections": {"description": "The number of corrections made to the original XML.", "title": "Number Of Corrections", "type": "integer"}, "explanation": {"default": null, "description": "Optional explanation of the corrections made.", "title": "Explanation", "type": "string"}}, "required": ["fixed_xml", "number_of_corrections"], "title": "CorrectedAdvert", "type": "object"}newspaper-page data-correction 18 en
openai gpt-4.1-mini-2025-04-14 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"Added missing closing '>' in the <TITLE> tag to correct the XML syntax."}newspaper-page data-correction 18 en
mistral ministral-8b-2512 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>
<BIBL>
<TITLE>Eine Tossanische Bibel</TITLE>
<NUMBER>37</NUMBER>
</BIBL>
</ITEM>","number_of_corrections":3,"explanation":"1. Added missing `<NUMBER>` tag to encapsulate the number '37' for proper bibliographic structure.
2. Fixed the formatting to ensure proper indentation and readability.
3. Removed the stray space before the number '37' to adhere to standard XML formatting conventions."}newspaper-page data-correction 18 en
openrouter qwen/qwen3-vl-8b-thinking · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
newspaper-page data-correction 18 en
genai gemini-3-flash-preview · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM><LABEL>37.</LABEL> <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":2,"explanation":"Fixed the malformed opening tag for TITLE by adding the missing bracket and wrapped the leading item number in a LABEL tag for structural consistency."}newspaper-page data-correction 18 en
openrouter qwen/qwen3-vl-30b-a3b-instruct · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":2,"explanation":"The original XML was missing a space after the title text and had a missing closing quote for the title. The corrected version adds a space after 'Bibel' and closes the TITLE tag properly."}newspaper-page data-correction 18 en
mistral ministral-14b-2512 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>
<BIBL>
<TITLE>Eine Tossanische Bibel</TITLE>
</BIBL>
</ITEM>","number_of_corrections":3,"explanation":"1. Added missing closing tag for `<TITLE>` (originally had no closing tag).
2. Fixed malformed XML structure by removing the erroneous `37. ` text outside any tag (likely a line number or artifact).
3. Improved formatting for readability and compliance with XML standards (indentation and line breaks)."}newspaper-page data-correction 18 en
openai gpt-4.1-nano-2025-04-14 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"Added missing '>' after <TITLE> tag to properly close the tag."}newspaper-page data-correction 18 en
openai gpt-4o-2024-08-06 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"Added a closing angle bracket '>' to the <TITLE> tag to properly close it."}newspaper-page data-correction 18 en
openai gpt-4o-mini-2024-07-18 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening tag <TITLE> was missing a closing angle bracket, which has been corrected."}