{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.30009768600575626, "total_s": 19.528371244989103, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "5a880c2f3e84aaa0", "decode_tps": 26.575666760214414, "e2e_tps": 26.21847606911791, "rep": 0}
{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3071267190098297, "total_s": 19.326902195985895, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "916521a0d7d520ee", "decode_tps": 26.866988565404657, "e2e_tps": 26.49177959003907, "rep": 1}
{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2979864460066892, "total_s": 19.512353654019535, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "5ecff445f5849ec2", "decode_tps": 26.594951906660135, "e2e_tps": 26.240048324044963, "rep": 2}
{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3143154710123781, "total_s": 19.487559260014677, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "d1296a381e32b574", "decode_tps": 26.65194227698271, "e2e_tps": 26.273383979399163, "rep": 3}
{"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.31225819600513205, "total_s": 19.375350687012542, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "5a880c2f3e84aaa0", "decode_tps": 26.805851603759546, "e2e_tps": 26.425451710885266, "rep": 4}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.30299046699656174, "total_s": 9.859952289989451, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "a1942996057f5b51", "decode_tps": 53.46958858346519, "e2e_tps": 51.92790037684898, "rep": 0}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.30700487599824555, "total_s": 9.878882824996253, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "a1942996057f5b51", "decode_tps": 53.38602176113889, "e2e_tps": 51.82816343594825, "rep": 1}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3093616570113227, "total_s": 9.90068973499001, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "a1942996057f5b51", "decode_tps": 53.278380367372165, "e2e_tps": 51.71459092929944, "rep": 2}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3137310119927861, "total_s": 9.883241522999015, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "6849c96ee67800e8", "decode_tps": 53.399770489486755, "e2e_tps": 51.80581444843791, "rep": 3}
{"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3226510109961964, "total_s": 9.885762985009933, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "a1942996057f5b51", "decode_tps": 53.436079515837, "e2e_tps": 51.79314383093831, "rep": 4}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2930894090095535, "total_s": 18.470321959001012, "error": null, "text_head": "# Your Immune System Is Basically a Very Fast Learner\n\nImagine your body has a security team that's incredible at its job \u2014 but only *after* it's seen a threat ", "text_sha": "6eb5174e8c2e4fed", "decode_tps": 28.11224232664131, "e2e_tps": 27.72029252339613, "rep": 0}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.28170862901606597, "total_s": 16.79417648600065, "error": null, "text_head": "# Your Immune System Is Basically a Really Good Bouncer\n\nImagine a nightclub. The bouncer's job is to keep out anyone who doesn't belong. The problem is, a new ", "text_sha": "4f8a23c0e5bece0f", "decode_tps": 30.946496774932257, "e2e_tps": 30.486936270105748, "rep": 1}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.28185919899260625, "total_s": 17.768105160997948, "error": null, "text_head": "# Your Immune System Is Basically a Very Fast Learner\n\nImagine your body hires security guards. Not many at first \u2014 just a few wandering around, each trained to", "text_sha": "7bf7b9b4bb720e80", "decode_tps": 29.223089630676597, "e2e_tps": 28.81579654573845, "rep": 2}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.285276081005577, "total_s": 16.78675161700812, "error": null, "text_head": "# Your Immune System Is Basically a Really Good Bouncer\n\nImagine a nightclub. The bouncer's job is to keep out anyone who isn't supposed to be there. The proble", "text_sha": "7d8ce9913be16240", "decode_tps": 30.967130023600127, "e2e_tps": 30.500438671697896, "rep": 3}
{"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.28894522102200426, "total_s": 17.788108937005745, "error": null, "text_head": "# Your Immune System Is Basically a Really Good Bouncer\n\nImagine a nightclub. The bouncer's job is to keep out anyone who doesn't belong \u2014 but here's the catch:", "text_sha": "96838a3ea8493c62", "decode_tps": 29.20163771631635, "e2e_tps": 28.78350814504271, "rep": 4}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2789238120021764, "total_s": 21.016415054997196, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the village of Saltmarsh, a thick, crystalline blanket that muffled every soun", "text_sha": "2e71aa422ee3d03e", "decode_tps": 24.64151254373325, "e2e_tps": 24.362057635410686, "rep": 0}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.28071513000759296, "total_s": 20.74843796901405, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the village of Saltmarsh, a thick, crystalline blanket that muffled every soun", "text_sha": "1841f4a4cfb61087", "decode_tps": 24.966216879364005, "e2e_tps": 24.676632985355404, "rep": 1}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2800692449964117, "total_s": 20.983039644022938, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the village of Saltmarsh, a thick, crystalline blanket that muffled every soun", "text_sha": "1841f4a4cfb61087", "decode_tps": 24.682578545216654, "e2e_tps": 24.40078610794326, "rep": 2}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.3799264869885519, "total_s": 20.765135202003876, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the village of Saltmarsh, a thick, crystalline blanket that muffled every soun", "text_sha": "339ba8ad55dd8904", "decode_tps": 25.067353936862673, "e2e_tps": 24.656867574784773, "rep": 3}
{"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.27888751099817455, "total_s": 20.69525081900065, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the village of Saltmarsh, a thick, crystalline blanket that muffled every soun", "text_sha": "6cbe33d0f3aae7b0", "decode_tps": 25.02910531921714, "e2e_tps": 24.74013355833017, "rep": 4}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3962066659878474, "total_s": 32.56237439898541, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. It", "text_sha": "93920ea017730df6", "decode_tps": 15.886309543544481, "e2e_tps": 15.723720690327537, "wave": 0}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.7584168640023563, "total_s": 19.15122180301114, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an `LRUCache` class that supports:\n- O(1) get, p", "text_sha": "347dc0e4358bd4ee", "decode_tps": 27.78291831085306, "e2e_tps": 26.7348779995565, "wave": 0}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3948034410132095, "total_s": 32.37279739801306, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "1d8b5845b1efe33a", "decode_tps": 15.97984861859736, "e2e_tps": 15.815854908033888, "wave": 0}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3949458890128881, "total_s": 19.150466693012277, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "645f87ca5bd3084c", "decode_tps": 27.2458713503655, "e2e_tps": 26.736179258079705, "wave": 0}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.39440062301582657, "total_s": 33.61731725701247, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "82153ca04c1217be", "decode_tps": 15.381007455007909, "e2e_tps": 15.230302454395446, "wave": 1}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.394232093996834, "total_s": 19.075054757006, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map with a\ndoubly lin", "text_sha": "980a06516cb8775f", "decode_tps": 27.354712815405897, "e2e_tps": 26.84177767800245, "wave": 1}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3935452739824541, "total_s": 32.4953365479887, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. It", "text_sha": "93920ea017730df6", "decode_tps": 15.918167479403714, "e2e_tps": 15.75615848549033, "wave": 1}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.7446440999920014, "total_s": 19.073944044997916, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an `LRUCache` class that supports:\n- O(1) get, p", "text_sha": "347dc0e4358bd4ee", "decode_tps": 27.87929294709162, "e2e_tps": 26.84330136798213, "wave": 1}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.42844638801761903, "total_s": 32.147319003008306, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "a40c2dc7a72bbfea", "decode_tps": 16.11039411250605, "e2e_tps": 15.926786873108055, "wave": 2}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.4274209580034949, "total_s": 19.367784959991695, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that implements a Least\nRecently Used (LRU) eviction policy", "text_sha": "1b0cdd7de9998fcb", "decode_tps": 26.979695481463736, "e2e_tps": 26.435916562627014, "wave": 2}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.7743920309876557, "total_s": 32.79402020398993, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization an", "text_sha": "ec744c19fbd2fe6d", "decode_tps": 15.95906112880281, "e2e_tps": 15.612698004909184, "wave": 2}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.42672703199787065, "total_s": 19.815930344018852, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "782facafe266f424", "decode_tps": 26.355070577147007, "e2e_tps": 25.837986804172175, "wave": 2}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3991284240037203, "total_s": 32.64937151200138, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "e88648900b33a2f3", "decode_tps": 15.844884076963051, "e2e_tps": 15.681813322670829, "wave": 3}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.39834889900521375, "total_s": 18.730682619003346, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that combines a hash map\n(``dict``) with a doubly linked li", "text_sha": "c4ad343aa7a18448", "decode_tps": 27.874486780753905, "e2e_tps": 27.335058701349357, "wave": 3}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.398534196021501, "total_s": 31.931797846016707, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "1e96cd1df63ac022", "decode_tps": 16.205196768299977, "e2e_tps": 16.034258883206785, "wave": 3}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.7517495909996796, "total_s": 19.047937866998836, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an `LRUCache` class that supports:\n- O(1) get, p", "text_sha": "f9c86a4ce5396ae3", "decode_tps": 27.92962512823872, "e2e_tps": 26.879837067528577, "wave": 3}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.752567575982539, "total_s": 32.50571968298755, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization an", "text_sha": "77eb35899730eb08", "decode_tps": 16.09299746242486, "e2e_tps": 15.751176381790161, "wave": 4}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.40456093099783175, "total_s": 18.990951205982128, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "a3c2e17879e6719b", "decode_tps": 27.49369408723635, "e2e_tps": 26.960648653401478, "wave": 4}
{"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.40475384501041844, "total_s": 33.30255966100958, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "ff6161d33bb347fb", "decode_tps": 15.5330549811367, "e2e_tps": 15.374295450230049, "wave": 4}
{"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.4039433109865058, "total_s": 19.30111924200901, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that implements a Least\nRecently Used (LRU) eviction policy", "text_sha": "1b0cdd7de9998fcb", "decode_tps": 27.041372684741198, "e2e_tps": 26.5272425181849, "wave": 4}