| 12345678910111213141516171819202122232425262728293031323334353637383940 |
- {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2751575889997184, "total_s": 15.284945685009006, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "22918d1b753aaa3c", "decode_tps": 34.04496907702633, "e2e_tps": 33.497511679954734, "rep": 0}
- {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2728552079934161, "total_s": 15.366409542009933, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "22918d1b753aaa3c", "decode_tps": 33.85576228350857, "e2e_tps": 33.3196721180645, "rep": 1}
- {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.26407793001271784, "total_s": 15.347308794996934, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "22918d1b753aaa3c", "decode_tps": 33.8790546887795, "e2e_tps": 33.36125730949891, "rep": 2}
- {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2756941659899894, "total_s": 15.535509219014784, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "22918d1b753aaa3c", "decode_tps": 33.48715511676022, "e2e_tps": 32.95725059196105, "rep": 3}
- {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.26849139799014665, "total_s": 15.47989380999934, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "22918d1b753aaa3c", "decode_tps": 33.59373956861311, "e2e_tps": 33.075664193303645, "rep": 4}
- {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.27515586800291203, "total_s": 8.569370414013974, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n - O(1) ", "text_sha": "b44eda09390e25bd", "decode_tps": 61.60999657061878, "e2e_tps": 59.74841881021729, "rep": 0}
- {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.2825298529933207, "total_s": 8.737253444007365, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n - O(1) ", "text_sha": "547b9fd23f3256e0", "decode_tps": 60.4408443769496, "e2e_tps": 58.60083061556281, "rep": 1}
- {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.28402224302408285, "total_s": 8.56982843001606, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n - O(1) ", "text_sha": "b44eda09390e25bd", "decode_tps": 61.67339825485386, "e2e_tps": 59.74604940761201, "rep": 2}
- {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.2839623800246045, "total_s": 8.489170722023118, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n - O(1) ", "text_sha": "053c0f237271e3ae", "decode_tps": 62.278749410815294, "e2e_tps": 60.313287571375184, "rep": 3}
- {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.28534747299272567, "total_s": 8.571791881986428, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n - O(1) ", "text_sha": "b44eda09390e25bd", "decode_tps": 61.66845311220679, "e2e_tps": 59.732181115500694, "rep": 4}
- {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2737172379856929, "total_s": 14.186815684981411, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a security team that's never seen the actual burglar\u2014only heard rumors. A vaccine is basi", "text_sha": "58c0034c8d973206", "decode_tps": 36.72841059069013, "e2e_tps": 36.090261521903685, "rep": 0}
- {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.24945770899648778, "total_s": 13.973854447976919, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a security team that's never seen a particular burglar before. The first time the burglar", "text_sha": "dc2f4a10400db244", "decode_tps": 37.23334267813609, "e2e_tps": 36.6402188052045, "rep": 1}
- {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2623474420106504, "total_s": 14.562821572995745, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a massive security team that's never seen the actual criminal\u2014just rumors. A vaccine is b", "text_sha": "d06bc419cab5b670", "decode_tps": 35.733569969158296, "e2e_tps": 35.15849437862833, "rep": 2}
- {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.25056098101777025, "total_s": 13.795029935019556, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a really good security team that's never seen a particular intruder before. The first tim", "text_sha": "4cad1fbd0f4e4743", "decode_tps": 37.72802832598771, "e2e_tps": 37.11525176510721, "rep": 3}
- {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.29858965598396026, "total_s": 14.26127685100073, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a security team that's never seen a particular intruder before. A real infection is like ", "text_sha": "8d842a7ee418507e", "decode_tps": 36.597906358300506, "e2e_tps": 35.901765771933796, "rep": 4}
- {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2527412860072218, "total_s": 16.445191200997215, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "5e257c28b73ce452", "decode_tps": 31.558330148500712, "e2e_tps": 31.134122083181317, "rep": 0}
- {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.24519410397624597, "total_s": 16.163942204992054, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "bc005587fb464af7", "decode_tps": 32.100750186782534, "e2e_tps": 31.675670442618898, "rep": 1}
- {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2502157650014851, "total_s": 16.073214391974034, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "5c8ef9c0e46c3319", "decode_tps": 32.295224280705234, "e2e_tps": 31.854685536436353, "rep": 2}
- {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2537234619958326, "total_s": 16.09698278599535, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "5e257c28b73ce452", "decode_tps": 32.25375061513519, "e2e_tps": 31.807480894066373, "rep": 3}
- {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2436112399736885, "total_s": 15.954328901978442, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "1c7a45584b1417fa", "decode_tps": 32.52607524491929, "e2e_tps": 32.092097476149966, "rep": 4}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.35919627000112087, "total_s": 26.506423485989217, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "9d748e06ac29a47d", "decode_tps": 19.54332253208995, "e2e_tps": 19.316210356911593, "wave": 0}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6948353180196136, "total_s": 17.10129417400458, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n - O(1) ", "text_sha": "598ffa472882d35b", "decode_tps": 31.146541203416884, "e2e_tps": 29.939504532410666, "wave": 0}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3585761539870873, "total_s": 26.094376781984465, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "e30d26c67b8d39cc", "decode_tps": 19.85571322509664, "e2e_tps": 19.621186953318414, "wave": 0}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.358464072982315, "total_s": 15.819317319983384, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "f6b833122e02a0ca", "decode_tps": 33.05169392465095, "e2e_tps": 32.36595016499253, "wave": 0}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.38212315100827254, "total_s": 26.667194556008326, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure that has evolved from a simple fire on a hill to a marvel of modern ", "text_sha": "2013e68a1756b912", "decode_tps": 19.440838405640225, "e2e_tps": 19.199761607831576, "wave": 1}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.38155300298240036, "total_s": 15.474360897991573, "error": null, "text_head": "```python\n\"\"\"Thread-safe LRU cache implementation using a doubly linked list and a dict.\"\"\"\n\nfrom __future__ import annotations\n\nimport threading\nfrom typing im", "text_sha": "492819f8d9d0d8a5", "decode_tps": 33.85770208032423, "e2e_tps": 33.08748059791978, "wave": 1}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.697081224003341, "total_s": 26.666647735983133, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a solitary tower where the vast, indifferent sea meets the steadfast ingenuity o", "text_sha": "c2efd98df03eadd9", "decode_tps": 19.677090914770403, "e2e_tps": 19.200215660185517, "wave": 1}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3806438600004185, "total_s": 16.58359009498963, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that implements a\nLeast Recently Used (LRU) cache with a fi", "text_sha": "e033c1d78cd1428c", "decode_tps": 31.537911768254407, "e2e_tps": 30.874312296404526, "wave": 1}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3760074599995278, "total_s": 26.595773497014306, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and hope, a structure whose history stretches back to the dawn of recorded civilization. It", "text_sha": "a10015e09e237713", "decode_tps": 19.489194336266657, "e2e_tps": 19.251257722356005, "wave": 2}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.7580548989935778, "total_s": 16.04316482998547, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "e60ff86ae8b56625", "decode_tps": 33.43153816921011, "e2e_tps": 31.914184423615875, "wave": 2}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.7574858539737761, "total_s": 26.67506468598731, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization an", "text_sha": "ea36f26ba4102532", "decode_tps": 19.716467585586987, "e2e_tps": 19.194068571205275, "wave": 2}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.37553681700956076, "total_s": 16.175656450999668, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides :class:`LRUCache`, a fixed-capacity cache that e", "text_sha": "c254c904de286a55", "decode_tps": 32.3417420822638, "e2e_tps": 31.652707468928554, "wave": 2}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3629266030038707, "total_s": 26.59699888699106, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "a0b30f81b9d9006b", "decode_tps": 19.47864394235671, "e2e_tps": 19.25044651457629, "wave": 3}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.36267581800348125, "total_s": 15.979458521993365, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "005be4af28994ba9", "decode_tps": 32.72222972904274, "e2e_tps": 32.04211325584128, "wave": 3}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3625004409987014, "total_s": 25.781630675977794, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "30cefa9cdb445396", "decode_tps": 20.103084783840135, "e2e_tps": 19.85921298513246, "wave": 3}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6725892540125642, "total_s": 17.11257758800639, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n - O(1) ", "text_sha": "598ffa472882d35b", "decode_tps": 31.083032871739274, "e2e_tps": 29.91977797339679, "wave": 3}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3825234760006424, "total_s": 27.184457105991896, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "e6427814ce6a9f3a", "decode_tps": 19.065932305752323, "e2e_tps": 18.834431877081492, "wave": 4}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3826713979942724, "total_s": 17.740207500988618, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "f7fc6ba096c6283d", "decode_tps": 29.440118144080767, "e2e_tps": 28.861430058315815, "wave": 4}
- {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3817345910065342, "total_s": 26.8706519860134, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "f5acf0b535fdd0bf", "decode_tps": 19.29122956393509, "e2e_tps": 19.054384692533766, "wave": 4}
- {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6969417650252581, "total_s": 17.247808336018352, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n - O(1) ", "text_sha": "598ffa472882d35b", "decode_tps": 30.87478685324516, "e2e_tps": 29.685180581700546, "wave": 4}
|