Home Explore Help
Sign In
sm121
/
recipes
2
0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Tree: d74b8f37af
Branches Tags
recipes
/
docker-images
/
mia-tp4
/
docs
/
results
/
overnight-20260924-0311
/
ob-f2-final-reuse.jsonl

ob-f2-final-reuse.jsonl 19 KB
History Raw

12345678910111213141516171819202122232425262728293031323334353637383940 
  1. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.27170867199311033, "total_s": 15.363467855990166, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "bc5c18e6c76743a5", "decode_tps": 33.85988724492192, "e2e_tps": 33.32614655198231, "rep": 0}
    2. 

  2. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.27087125901016407, "total_s": 15.235982565005543, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "bc5c18e6c76743a5", "decode_tps": 34.14652405666999, "e2e_tps": 33.60508109290937, "rep": 1}
    3. 

  3. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.26574828498996794, "total_s": 15.12925085198367, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "17d67a6e33323dc4", "decode_tps": 34.37971206308655, "e2e_tps": 33.84191970542153, "rep": 2}
    4. 

  4. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.2913744800025597, "total_s": 15.340981471992563, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "bc5c18e6c76743a5", "decode_tps": 33.95465015131224, "e2e_tps": 33.37492262618796, "rep": 3}
    5. 

  5. {"tag": "c1-prose", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.28405837301397696, "total_s": 15.085233894991688, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a structure whose history stretches back to the dawn of recorded civilization. I", "text_sha": "455f08ca731d22aa", "decode_tps": 34.52475906528059, "e2e_tps": 33.940932149480815, "rep": 4}
    6. 

  6. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.27195627099717967, "total_s": 8.482118303014431, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 62.24104837155688, "e2e_tps": 60.363319584036006, "rep": 0}
    7. 

  7. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.28570359700825065, "total_s": 8.415811606013449, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 62.85357491360117, "e2e_tps": 60.83859443499137, "rep": 1}
    8. 

  8. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3009387729980517, "total_s": 8.432000328000868, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 62.84668208386175, "e2e_tps": 60.7222336890914, "rep": 2}
    9. 

  9. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.2854100909898989, "total_s": 8.599213248002343, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 61.46504315335072, "e2e_tps": 59.54126223094562, "rep": 3}
    10. 

  10. {"tag": "c1-code", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.2823904250108171, "total_s": 8.535224004008342, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation using a doubly linked list and a dict.\n\nThis module provides an ``LRUCache`` class that supports:\n    - O(1) ", "text_sha": "c0c447b3c4c5dd6e", "decode_tps": 61.91934802702962, "e2e_tps": 59.987852701079476, "rep": 4}
    11. 

  11. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2597504220029805, "total_s": 13.995297090004897, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a security team guarding a huge building. The problem is, they've never seen the burglar ", "text_sha": "955874edcbad337c", "decode_tps": 37.20330727837108, "e2e_tps": 36.58426333185751, "rep": 0}
    12. 

  12. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.251845095976023, "total_s": 13.871054730989272, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a security team that's never seen a particular intruder before. A real infection is like ", "text_sha": "1f641930d252d2ef", "decode_tps": 37.52107190184483, "e2e_tps": 36.91191727392831, "rep": 1}
    13. 

  13. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.24551763600902632, "total_s": 14.106482264003716, "error": null, "text_head": "# Your Immune System Is Basically a Really Good Bouncer\n\nImagine a nightclub. The bouncer's job is to keep troublemakers out. But here's the catch: the bouncer ", "text_sha": "83af304e59db8420", "decode_tps": 36.86635669153015, "e2e_tps": 36.29559842897364, "rep": 2}
    14. 

  14. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2520815610187128, "total_s": 14.349456384021323, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a really well-run neighborhood watch. It's always patrolling, checking IDs, and it has an", "text_sha": "22ed6c533562a631", "decode_tps": 36.248058082039485, "e2e_tps": 35.680963039867294, "rep": 3}
    15. 

  15. {"tag": "c1-chat_sampled", "workload": "chat_sampled", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.25659238602383994, "total_s": 13.788162669021403, "error": null, "text_head": "# How Vaccines Teach Your Body to Fight\n\nImagine your immune system as a security team guarding a huge building \u2014 your body. The problem is, the team has never ", "text_sha": "e864cafc246aace0", "decode_tps": 37.763801676830276, "e2e_tps": 37.133553600396496, "rep": 4}
    16. 

  16. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2517438460199628, "total_s": 15.94765182500123, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "902a89157ecda8dc", "decode_tps": 32.55656103431811, "e2e_tps": 32.10533596989721, "rep": 0}
    17. 

  17. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.25432440399890766, "total_s": 15.912775879987748, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "902a89157ecda8dc", "decode_tps": 32.634566768830716, "e2e_tps": 32.175824553956744, "rep": 1}
    18. 

  18. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.2567485769977793, "total_s": 15.903074272995582, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "16081b7b253ffd5b", "decode_tps": 32.659714023506226, "e2e_tps": 32.19531328660531, "rep": 2}
    19. 

  19. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.24908237301860936, "total_s": 16.219252471026266, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "8cf06f71917dd57b", "decode_tps": 31.997337897613313, "e2e_tps": 31.56760094132209, "rep": 3}
    20. 

  20. {"tag": "c1-prose2", "workload": "prose2", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 41, "ttft_s": 0.24810012700618245, "total_s": 16.063297018990852, "error": null, "text_head": "The winter had been a long, white silence. It clung to the roofs of the village like a stubborn memory, and the sea, a sullen grey beast, heaved against the bla", "text_sha": "350c8e950e17cedb", "decode_tps": 32.311071932118125, "e2e_tps": 31.87427108904432, "rep": 4}
    21. 

  21. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.35781200299970806, "total_s": 26.88852452998981, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of organized seafaring", "text_sha": "32a6e1123993934e", "decode_tps": 19.260773789147976, "e2e_tps": 19.041655801038235, "wave": 0}
    22. 

  22. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3576777470007073, "total_s": 18.115037165000103, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "e484bf71f7eb0d6e", "decode_tps": 28.777115672636146, "e2e_tps": 28.264114600957374, "wave": 0}
    23. 

  23. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.35680220602080226, "total_s": 26.17894227200304, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "41d88b09ab32d55e", "decode_tps": 19.78929918090842, "e2e_tps": 19.557781437176978, "wave": 0}
    24. 

  24. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6891122229862958, "total_s": 17.74181473700446, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "f80c2b4ae13f34d8", "decode_tps": 29.966202353618012, "e2e_tps": 28.858635197232662, "wave": 0}
    25. 

  25. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3613330789958127, "total_s": 26.734184464003192, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring architectural archetypes, a structure whose essential purpose has remained unchanged for millennia even as its", "text_sha": "35ec825d3d157ec2", "decode_tps": 19.37607595673969, "e2e_tps": 19.151597642522482, "wave": 1}
    26. 

  26. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3606703229888808, "total_s": 16.182133719004923, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that implements a\nLeast-Recently-Used cache with a fixed ma", "text_sha": "053f18e198bb4ffb", "decode_tps": 32.29823161107042, "e2e_tps": 31.640152671684895, "wave": 1}
    27. 

  27. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.6764226759842131, "total_s": 26.529760716977762, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring symbols of hope and guidance, a solitary tower where the vast, indifferent sea meets the steadfast ingenuity o", "text_sha": "fc71a187879f89cd", "decode_tps": 19.76544782545669, "e2e_tps": 19.29918416813119, "wave": 1}
    28. 

  28. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.35956717998487875, "total_s": 16.18079073500121, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an :class:`LRUCache` class that implements a\nLeast Recently Used (LRU) cache with a fi", "text_sha": "bc0f724791882702", "decode_tps": 32.298844416036566, "e2e_tps": 31.64289678200678, "wave": 1}
    29. 

  29. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3629290069802664, "total_s": 27.91430073097581, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and hope, a structure whose history stretches back to the dawn of organized seafaring and w", "text_sha": "b6149984189c736e", "decode_tps": 18.5472707733846, "e2e_tps": 18.34195045821361, "wave": 2}
    30. 

  30. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.3634465940122027, "total_s": 15.735526158008724, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "aef5ea5422b2231e", "decode_tps": 33.242378311279985, "e2e_tps": 32.538116879817046, "wave": 2}
    31. 

  31. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.36286590198869817, "total_s": 27.1581731220067, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "8c29890982bd14fd", "decode_tps": 19.070615912900447, "e2e_tps": 18.852629575980203, "wave": 2}
    32. 

  32. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6821398910251446, "total_s": 17.924913909024326, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "f80c2b4ae13f34d8", "decode_tps": 29.635868061268702, "e2e_tps": 28.563842085068117, "wave": 2}
    33. 

  33. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.36676390701904893, "total_s": 27.621968966006534, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and hope, a structure whose history stretches back to the dawn of organized seafaring and w", "text_sha": "0d6e6d407ef24ceb", "decode_tps": 18.74881061590412, "e2e_tps": 18.536066280857273, "wave": 3}
    34. 

  34. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.365941310999915, "total_s": 15.743595296982676, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "aef5ea5422b2231e", "decode_tps": 33.23032340382344, "e2e_tps": 32.521435625194705, "wave": 3}
    35. 

  35. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.3663990419881884, "total_s": 27.313340944994707, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "24bce0778ad06601", "decode_tps": 18.963252856430834, "e2e_tps": 18.74547880585037, "wave": 3}
    36. 

  36. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.6764258240000345, "total_s": 17.93497490999289, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "f80c2b4ae13f34d8", "decode_tps": 29.60866152452925, "e2e_tps": 28.547709149736587, "wave": 3}
    37. 

  37. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.4876744550128933, "total_s": 27.019720893003978, "error": null, "text_head": "The lighthouse is among humanity\u2019s most enduring symbols of guidance and resilience, a structure whose history stretches back to the dawn of recorded civilizati", "text_sha": "86aae29e47de1591", "decode_tps": 19.259836858334495, "e2e_tps": 18.94922754379813, "wave": 4}
    38. 

  38. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.48804093699436635, "total_s": 15.852930602006381, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU (Least Recently Used) cache implementation.\n\nThis module provides an ``LRUCache`` class that combines a hash map (dict)\nwith a dou", "text_sha": "ee658a11f649f021", "decode_tps": 33.25823915382336, "e2e_tps": 32.29742959480546, "wave": 4}
    39. 

  39. {"tag": "c4", "workload": "prose", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 52, "ttft_s": 0.48744061301113106, "total_s": 26.232419461011887, "error": null, "text_head": "The lighthouse is one of humanity\u2019s most enduring and poetic structures, a marriage of practical engineering and symbolic resonance that has guided mariners for", "text_sha": "7f92d0aceeff1507", "decode_tps": 19.848690488892842, "e2e_tps": 19.517987998299446, "wave": 4}
    40. 

  40. {"tag": "c4", "workload": "code", "max_tokens": 512, "finish": "length", "completion_tokens": 512, "prompt_tokens": 67, "ttft_s": 0.8598674639943056, "total_s": 18.181414210004732, "error": null, "text_head": "```python\n\"\"\"\nThread-safe LRU cache implementation.\n\nThis module provides an LRUCache class that combines a hash map (dict) with a\ndoubly linked list to achieve", "text_sha": "f80c2b4ae13f34d8", "decode_tps": 29.501133611971337, "e2e_tps": 28.16090210704796, "wave": 4}
    41.