{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.27061324601527303, "total_s": 15.281935428007273, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "bc5c18e6c76743a5", "decode_tps": 34.041230902376505, "e2e_tps": 33.50385987679163, "rep": 0}
{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2677587879879866, "total_s": 15.418127509998158, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "9a2d1e1116fc37df", "decode_tps": 33.72904682082692, "e2e_tps": 33.20814280976846, "rep": 1}
{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2691149339952972, "total_s": 15.171614368999144, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "9a2d1e1116fc37df", "decode_tps": 34.28991546355345, "e2e_tps": 33.74758593501977, "rep": 2}
{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2711216130119283, "total_s": 15.111368142999709, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "bf816ce1b3b452fa", "decode_tps": 34.43377281113764, "e2e_tps": 33.88214632037344, "rep": 3}
{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.273678904020926, "total_s": 15.076512413012097, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "455f08ca731d22aa", "decode_tps": 34.52085181814676, "e2e_tps": 33.96052772598421, "rep": 4}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.27220050399773754, "total_s": 8.414148226991529, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 62.7621930995119, "e2e_tps": 60.85063913295529, "rep": 0}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3059174049994908, "total_s": 8.54776733298786, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 62.00184858196798, "e2e_tps": 59.89980478240101, "rep": 1}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.28659858999890275, "total_s": 8.438582509988919, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 62.68534917680779, "e2e_tps": 60.67483946534688, "rep": 2}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.29033614599029534, "total_s": 8.439705047989264, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 62.70578994150147, "e2e_tps": 60.6670732548735, "rep": 3}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.2822864440095145, "total_s": 8.456791767996037, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 62.512809047476935, "e2e_tps": 60.544346946278104, "rep": 4}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2772643289936241, "total_s": 13.372948268020991, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a security team guarding a huge building. The problem is, the team has never seen the int", "text_sha": "3e2c86bba5a1be33", "decode_tps": 39.02099594356964, "e2e_tps": 38.2867333998844, "rep": 0}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.24918443599017337, "total_s": 14.284990184998605, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a really well-run security team. It has guards, cameras, and \u2014 most importantly \u2014 a filin", "text_sha": "1c6c82b6a1eb15e2", "decode_tps": 36.40711511753985, "e2e_tps": 35.84203695211126, "rep": 1}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2591008619929198, "total_s": 14.233696209994378, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a really good security team that's never seen a particular intruder before. The first tim", "text_sha": "6b7d727cb00f3a7b", "decode_tps": 36.56672971866727, "e2e_tps": 35.97134278870293, "rep": 2}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.24549048399785534, "total_s": 14.529038652981399, "error": null, "text_head": "# Your Immune System Is Basically a Very Fast Learner\n\nImagine your body has a security team that's incredible at its job \u2014 but only *after* it's seen the intru", "text_sha": "9fb94be5bd0f3c39", "decode_tps": 35.775746406303256, "e2e_tps": 35.24008301399718, "rep": 3}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.25050187099259347, "total_s": 14.144773278996581, "error": null, "text_head": "# Your Immune System Is Basically a Really Good Bouncer\n\nImagine your body is a nightclub, and viruses are troublemakers trying to sneak in. Your immune system ", "text_sha": "f874c4e2ac9441d7", "decode_tps": 36.77818773475322, "e2e_tps": 36.19754205493495, "rep": 4}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.27208537800470367, "total_s": 16.015350684989244, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "4a472561f283d832", "decode_tps": 32.45865791149364, "e2e_tps": 31.969651729154773, "rep": 0}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.28647045500110835, "total_s": 16.12151180402725, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "989d0d9ff903ddca", "decode_tps": 32.27055203210613, "e2e_tps": 31.75914544730853, "rep": 1}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2853941710200161, "total_s": 16.076366838999093, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "16081b7b253ffd5b", "decode_tps": 32.360397725668456, "e2e_tps": 31.848123833469344, "rep": 2}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2474136910168454, "total_s": 16.2540549080004, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "814903af6d82434d", "decode_tps": 31.92449016174957, "e2e_tps": 31.50006639169791, "rep": 3}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.24595804602722637, "total_s": 16.289433620026102, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "b47324c1784bd8f5", "decode_tps": 31.851292650972663, "e2e_tps": 31.43174747453415, "rep": 4}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3570362140017096, "total_s": 27.30717793898657, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "86aae29e47de1591", "decode_tps": 18.961072352234655, "e2e_tps": 18.749778842795195, "wave": 0}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3563177459873259, "total_s": 15.831958926981315, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "ee658a11f649f021", "decode_tps": 33.020115101674676, "e2e_tps": 32.3401104022681, "wave": 0}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.35582759900717065, "total_s": 26.609908943006303, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "7f92d0aceeff1507", "decode_tps": 19.463837609377826, "e2e_tps": 19.241145008829346, "wave": 0}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6731036480050534, "total_s": 18.189650849002646, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "f80c2b4ae13f34d8", "decode_tps": 29.173019459655663, "e2e_tps": 28.148434805015665, "wave": 0}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3670690350118093, "total_s": 27.058960219001165, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "86aae29e47de1591", "decode_tps": 19.1445181482922, "e2e_tps": 18.921767560044355, "wave": 1}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3664208230038639, "total_s": 15.816212183999596, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "ee658a11f649f021", "decode_tps": 33.07519022893233, "e2e_tps": 32.372143249368364, "wave": 1}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3653645599843003, "total_s": 26.381336046993965, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "eeac14b1bcee35ca", "decode_tps": 19.641923604409378, "e2e_tps": 19.407799481283913, "wave": 1}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6766273329849355, "total_s": 18.11742527098977, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "f80c2b4ae13f34d8", "decode_tps": 29.299447293296257, "e2e_tps": 28.26039178978885, "wave": 1}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.6984363149967976, "total_s": 26.809184429992456, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a solitary tower where the vast, indifferent sea meets the steadfast ingenuity o", "text_sha": "4abf8ac14212fc77", "decode_tps": 19.57052948183767, "e2e_tps": 19.097975134799174, "wave": 2}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.35960110899759457, "total_s": 16.279369361000136, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that implements a\nLeast Recently Used (LRU) cache with a fi", "text_sha": "6468ecaca2984153", "decode_tps": 32.09897438414604, "e2e_tps": 31.451345310317134, "wave": 2}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.35918187399511226, "total_s": 26.88781005999772, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring architectural archetypes, a structure whose essential purpose has remained unchanged for millennia even as its", "text_sha": "35ec825d3d157ec2", "decode_tps": 19.26231477761855, "e2e_tps": 19.042188774333244, "wave": 2}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3589036009798292, "total_s": 16.278179865999846, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that implements a\nLeast-Recently-Used cache with a fixed ma", "text_sha": "3d907f046ec9ac16", "decode_tps": 32.09989586292486, "e2e_tps": 31.4535759754045, "wave": 2}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.36156148099689744, "total_s": 26.867469289980363, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "cc2e546871e37f6b", "decode_tps": 19.278811122632664, "e2e_tps": 19.05659060052359, "wave": 3}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3609708049916662, "total_s": 15.619693301006919, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "dc4fc55a075a5fe6", "decode_tps": 33.48943550690583, "e2e_tps": 32.779508907606484, "wave": 3}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3602779050124809, "total_s": 26.084977263992187, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "7e5821ebe5eff443", "decode_tps": 19.864346027237726, "e2e_tps": 19.628319890367262, "wave": 3}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6743747769796755, "total_s": 18.100452239974402, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "2fdf8936ac99f4ed", "decode_tps": 29.324265058554342, "e2e_tps": 28.286954551028884, "wave": 3}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3633221880008932, "total_s": 26.93744444102049, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "5222fa44b6454a78", "decode_tps": 19.229278780019236, "e2e_tps": 19.00704398038761, "wave": 4}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.36242926999693736, "total_s": 15.72145325699239, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "ee658a11f649f021", "decode_tps": 33.270544307043075, "e2e_tps": 32.56715612840457, "wave": 4}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3622639089880977, "total_s": 26.154226810002, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "5e871d21ea0b609b", "decode_tps": 19.81246710333757, "e2e_tps": 19.576276959682975, "wave": 4}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6687690170074347, "total_s": 18.146083054016344, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "2fdf8936ac99f4ed", "decode_tps": 29.238243885324316, "e2e_tps": 28.215773066172567, "wave": 4}