A test run is a single execution of a benchmark test using a defined model configuration.
Each run represents how a particular large language model (LLM) — such as GPT-4, Claude-3, or Gemini — performed on a given task at a specific time, with specific settings.
A test run includes:
Together, test runs make it possible to compare models, providers, and configurations across benchmarks in a transparent and reproducible way.
newspaper-page data-correction 18 en
openrouter google/gemma-4-26b-a4b-it · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Toskanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":2,"explanation":"The XML was missing a space between the title and the closing tag of the title element, and the title content 'Eine Tossanische Bibel' likely contains a typo (should be 'Toskanische'). I have added the necessary space and corrected the spelling to ensure valid and meaningful content."}
newspaper-page data-correction 18 en
openrouter meta/muse-spark-1.3 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"Corrected malformed opening TITLE tag: '<TITLEEine' was missing the closing '>' and was fixed to '<TITLE>'. No other structural changes were needed as ITEM, BIBL and closing TITLE tags were well-formed."}
newspaper-page data-correction 18 en
openrouter qwen/qwen3.5-397b-a17b · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The primary fault identified was a malformed opening tag for the TITLE element. The string '<TITLEEine' lacked the closing angle bracket ('>') required to delimit the tag name from its content. This has been corrected to '<TITLE>'. No additional tags were added to the numbering '37.' as it functions validly as character data within the ITEM element, though in a strict schema it might alternatively be an attribute."}
newspaper-page data-correction 18 en
anthropic claude-opus-5 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"Fixed the malformed opening tag <TITLEEine Tossanische Bibel</TITLE>: the <TITLE> start-tag was missing its closing angle bracket, so the title text was fused into the tag name. It is now properly written as <TITLE>Eine Tossanische Bibel</TITLE>, which yields a well-formed nesting of ITEM > BIBL > TITLE. The item number \"37.\" remains as text directly inside <ITEM>, preserving the original structure."}
newspaper-page data-correction 18 en
openrouter qwen/qwen3.5-122b-a10b · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening <TITLE> tag was malformed, missing the closing angle bracket '>' before the text content. This caused the parser to interpret 'TITLEEine' as the tag name. The fix inserts the missing delimiter to properly close the tag."}
newspaper-page data-correction 18 en
openrouter qwen/qwen3-vl-8b-instruct · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM><BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":5,"explanation":"The XML string contains several issues: 1) The opening tag for <ITEM> is not properly closed with a closing tag. 2) The title text 'Eine Tossanische Bibel' has an incorrect encoding — it should be properly escaped or corrected if it's meant to be literal. 3) The <BIBL> tag is missing a closing tag. 4) The <TITLE> tag is incorrectly nested inside the <BIBL> tag without proper closure. 5) There’s no root element enclosing the entire structure. I will fix these by adding appropriate closing tags, escaping special characters, and wrapping the content in a valid root element."}
newspaper-page data-correction 18 en
huggingface thinkingmachines/Inkling-Small · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening <TITLE> tag was malformed because it was missing its closing angle bracket (e.g., <TITLE... instead of <TITLE>...). Added the missing '>' so the tag is properly formed as <TITLE>, allowing the XML to parse correctly. No additional structural tags were needed as the rest of the hierarchy (<ITEM>, <BIBL>, closing tags) was intact."}
newspaper-page data-correction 18 en
cohere command-a-vision-07-2025 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{
"fixed_xml": "<book><title>Book Title</title><author>Author Name</author><price>19.99</price></book>",
"number_of_fixes": 3,
"explanation": "Added missing book tags, corrected title and author format, and added price tag."
}
newspaper-page data-correction 18 en
openrouter qwen/qwen3.5-27b · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening tag for the title element was malformed. The closing angle bracket '>' was missing after the tag name 'TITLE', causing the text content 'Eine' to be merged into the tag name. I inserted the missing bracket to properly close the opening tag."}
newspaper-page data-correction 18 en
openrouter meta/muse-spark-1.2 · temp 0.0 · dataclass CorrectedAdvert
One model response from this run. The per-input comparison needs JavaScript.
{"fixed_xml":"<ITEM>37. <BIBL><TITLE>Eine Tossanische Bibel</TITLE></BIBL></ITEM>","number_of_corrections":1,"explanation":"The opening <TITLE> tag was malformed as '<TITLEEine' - missing the closing '>' bracket. Added '>' to correctly form '<TITLE>Eine Tossanische Bibel</TITLE>'."}