Home Explore Help
Sign In
sm121
/
recipes
2
0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Tree: 50b1f75ee4
Branches Tags
recipes
/
docker-images
/
mia-tp4
/
docs
/
results
/
overnight-20260924-0311
/
ob-e7-draft-tau.jsonl

ob-e7-draft-tau.jsonl 19 KB
History Raw

12345678910111213141516171819202122232425262728293031323334353637383940 
  1. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2846033129899297, "total_s": 16.439052247995278, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "9e43f7485dc64e65", "decode_tps": 31.632364048553768, "e2e_tps": 31.145552037761643, "rep": 0}
    2. 

  2. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.30623288700007834, "total_s": 16.37408270200831, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "c824868bc1b390ec", "decode_tps": 31.802978160873074, "e2e_tps": 31.269256065523074, "rep": 1}
    3. 

  3. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.29017082101199776, "total_s": 16.44888125100988, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "c52ec87c453ce713", "decode_tps": 31.624286713867498, "e2e_tps": 31.127197214859542, "rep": 2}
    4. 

  4. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.29333797699655406, "total_s": 16.457884373987326, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "3f740d7238aa5fa2", "decode_tps": 31.61273038419295, "e2e_tps": 31.110035091946585, "rep": 3}
    5. 

  5. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.28411847600364126, "total_s": 16.307741120981518, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "c824868bc1b390ec", "decode_tps": 31.890700007101092, "e2e_tps": 31.396406687352496, "rep": 4}
    6. 

  6. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.29328147100750357, "total_s": 9.365021668025292, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "787b5ff22342656b", "decode_tps": 56.32956634123361, "e2e_tps": 54.67226855749809, "rep": 0}
    7. 

  7. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.2945310640207026, "total_s": 9.328854860999854, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "787b5ff22342656b", "decode_tps": 56.562882841577895, "e2e_tps": 54.88424748194204, "rep": 1}
    8. 

  8. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.2968174460111186, "total_s": 9.329742937989067, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "787b5ff22342656b", "decode_tps": 56.571671614696804, "e2e_tps": 54.87905377803036, "rep": 2}
    9. 

  9. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.30259003801620565, "total_s": 9.361870590015315, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "787b5ff22342656b", "decode_tps": 56.40674957193174, "e2e_tps": 54.69039818883452, "rep": 3}
    10. 

  10. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.2981162090145517, "total_s": 9.397555542003829, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "787b5ff22342656b", "decode_tps": 56.15823372874459, "e2e_tps": 54.4831245526331, "rep": 4}
    11. 

  11. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.26825139397988096, "total_s": 15.546403460990405, "error": null, "text_head": "# Your Immune System Is Basically a Very Fast Learner\n\nImagine your body has a security team. It's good, but it has one weakness: it can only fight off intruder", "text_sha": "5d6f2a3cbe981fa6", "decode_tps": 33.44682401875833, "e2e_tps": 32.934020911617104, "rep": 0}
    12. 

  12. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.26881458298885264, "total_s": 15.472592534992145, "error": null, "text_head": "# Your Immune System Is Basically a Really Good Bouncer\n\nImagine your body is a nightclub. Pathogens \u2014 viruses, bacteria \u2014 are crashers trying to get in and cau", "text_sha": "0e3efbcf73708b8b", "decode_tps": 33.61030855011303, "e2e_tps": 33.09100335069414, "rep": 1}
    13. 

  13. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.259499528008746, "total_s": 14.26180813400424, "error": null, "text_head": "# Your Immune System Is Basically a Really Good Bouncer\n\nImagine a nightclub. The bouncer's job is to keep out troublemakers. But here's the catch: the bouncer ", "text_sha": "46e4edfb4a2e4446", "decode_tps": 36.49448079106804, "e2e_tps": 35.900557910092324, "rep": 2}
    14. 

  14. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2617421339964494, "total_s": 15.394078101991909, "error": null, "text_head": "# Your Immune System Is Basically a Very Fast Learner\n\nImagine your body hires a security team the day you're born. The problem is, none of them have ever seen ", "text_sha": "fdd1f02029f24b4e", "decode_tps": 33.769108199847665, "e2e_tps": 33.25989412505348, "rep": 3}
    15. 

  15. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.26343931298470125, "total_s": 15.820408047002275, "error": null, "text_head": "# Your Immune System Is Basically a Really Good Bouncer\n\nImagine a nightclub. The bouncer's job is to keep out anyone dangerous. The problem is, on day one, the", "text_sha": "dd312b1c40bb9ff4", "decode_tps": 32.84740268896944, "e2e_tps": 32.36363603857518, "rep": 4}
    16. 

  16. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2660649140016176, "total_s": 17.959362493013032, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the small fishing village, a frozen breath that would not exhale. For the fami", "text_sha": "df77ba5af67e7ed6", "decode_tps": 28.881264552307893, "e2e_tps": 28.509071322449447, "rep": 0}
    17. 

  17. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2663027419766877, "total_s": 17.577932247979334, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the small fishing village, a frozen breath that would not exhale. For the fami", "text_sha": "1d1314bd2bfbfcbb", "decode_tps": 29.518134946376176, "e2e_tps": 29.127824359961362, "rep": 1}
    18. 

  18. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.26674601100967266, "total_s": 17.807272737991298, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the small fishing village, a frozen breath that would not exhale. For the fami", "text_sha": "4db896727fc204f0", "decode_tps": 29.13266415345017, "e2e_tps": 28.75242335320216, "rep": 2}
    19. 

  19. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.27881956700002775, "total_s": 17.834770991001278, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the small fishing village, a frozen breath that would not exhale. For the fami", "text_sha": "67d46ef28855d4df", "decode_tps": 29.107129879925626, "e2e_tps": 28.708151760956667, "rep": 3}
    20. 

  20. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.26907306801876985, "total_s": 17.84470396101824, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the houses in the small fishing village, a frozen breath that would not exhale. For the fami", "text_sha": "0512fd35fcef5a2d", "decode_tps": 29.074622154858265, "e2e_tps": 28.692253173816333, "rep": 4}
    21. 

  21. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3781962420034688, "total_s": 29.070511183992494, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "e9b3138f47d3f2c6", "decode_tps": 17.8097575816858, "e2e_tps": 17.612457351579586, "wave": 0}
    22. 

  22. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.37798459199257195, "total_s": 16.987413428985747, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "46ddf78d62e773e5", "decode_tps": 30.766030731549776, "e2e_tps": 30.140319720771313, "wave": 0}
    23. 

  23. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.7096050279797055, "total_s": 27.677676134975627, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization an", "text_sha": "28fda7fb0453a1a6", "decode_tps": 18.948467448077913, "e2e_tps": 18.498790475121776, "wave": 0}
    24. 

  24. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.37721583602251485, "total_s": 17.50862788001541, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "7e2721115ec83e98", "decode_tps": 29.828423041731398, "e2e_tps": 29.242893861045342, "wave": 0}
    25. 

  25. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3727762650232762, "total_s": 29.208256136014825, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "782d472d95be3744", "decode_tps": 17.72131909874225, "e2e_tps": 17.52938306541933, "wave": 1}
    26. 

  26. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6920397089852486, "total_s": 18.672099467978114, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "32d3764218b8689a", "decode_tps": 28.42074329058207, "e2e_tps": 27.420935136390103, "wave": 1}
    27. 

  27. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.37221434200182557, "total_s": 29.066596782009583, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. It", "text_sha": "b79379c7585ff13b", "decode_tps": 17.808523363529176, "e2e_tps": 17.614877108657872, "wave": 1}
    28. 

  28. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3714428330131341, "total_s": 17.90428879400133, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that combines a hash map\n(``dict``) with a doubly linked li", "text_sha": "b746ca6fe54e5eeb", "decode_tps": 29.14585034269273, "e2e_tps": 28.59703211983382, "wave": 1}
    29. 

  29. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3946013170061633, "total_s": 29.08659791800892, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "7312b32f04c5eb35", "decode_tps": 17.809938408920168, "e2e_tps": 17.602700130426864, "wave": 2}
    30. 

  30. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.7225146999990102, "total_s": 18.32498749200022, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "771f898a60ba4325", "decode_tps": 29.030302548645075, "e2e_tps": 27.940260209112125, "wave": 2}
    31. 

  31. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3937537930032704, "total_s": 29.30088072901708, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "4eff969a4b508b16", "decode_tps": 17.677398472115645, "e2e_tps": 17.473971995171688, "wave": 2}
    32. 

  32. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3933895349910017, "total_s": 16.813266676006606, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that combines a hash map\n(``dict``) with a doubly linked li", "text_sha": "c4ad343aa7a18448", "decode_tps": 31.12108961813845, "e2e_tps": 30.452402967731327, "wave": 2}
    33. 

  33. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3669933619967196, "total_s": 29.636264019005466, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "caa0f856090a1c5c", "decode_tps": 17.458625353826736, "e2e_tps": 17.276172785806335, "wave": 3}
    34. 

  34. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.36561825100216083, "total_s": 16.841502107010456, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that combines a hash map\n(``dict``) with a doubly linked li", "text_sha": "c4ad343aa7a18448", "decode_tps": 31.01559117601979, "e2e_tps": 30.401628728171296, "wave": 3}
    35. 

  35. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3654589210054837, "total_s": 29.71640580400708, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "4bb255d14afa6711", "decode_tps": 17.410037203600417, "e2e_tps": 17.22957579073736, "wave": 3}
    36. 

  36. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6929312339925673, "total_s": 18.42935396701796, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "6c15dc1eb90af108", "decode_tps": 28.810992549548523, "e2e_tps": 27.781972352166125, "wave": 3}
    37. 

  37. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.37217440200038254, "total_s": 28.740088360995287, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization and", "text_sha": "a03c057faec2bf5c", "decode_tps": 18.01339505060383, "e2e_tps": 17.814921359309544, "wave": 4}
    38. 

  38. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.37165126399486326, "total_s": 16.252775966975605, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "ee658a11f649f021", "decode_tps": 32.17678287310612, "e2e_tps": 31.502521724195887, "wave": 4}
    39. 

  39. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.6969658079906367, "total_s": 29.030318810982862, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization an", "text_sha": "25b1f4e8d37b501c", "decode_tps": 18.035363278814625, "e2e_tps": 17.636811586774705, "wave": 4}
    40. 

  40. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3704988899989985, "total_s": 17.392986095976084, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "7e2721115ec83e98", "decode_tps": 30.019679583678446, "e2e_tps": 29.437695314469238, "wave": 4}
    41.