Status
All systems operational Uptime, last 90 days API gateway 99.85% uptime
90 days ago today
Live status from the gateway; bars are daily history from the status monitor (UTC). Latency history is coming.
Service quality by model last 24 hours, per hour, through Sun, Oct 18 · 02:00–03:00 UTC · success = HTTP 200 share of requests, client errors (4xx) excluded · TTFT = mean time to first token · tok/s = mean decode speed
99.9% success · 842ms TTFT · 102 tok/s · 278.32K requests
success ≤ 100% failed · Oct 17 03:00: 0% success · Oct 17 03:00: 100% failed · Oct 17 04:00: 0% success · Oct 17 04:00: 100% success · Oct 17 05:00: 100% failed · Oct 17 06:00: 0.1% success · Oct 17 06:00: 99.9% failed · Oct 17 07:00: 0.1% success · Oct 17 07:00: 99.9% failed · Oct 17 08:00: 0.2% success · Oct 17 08:00: 99.8% failed · Oct 17 09:00: 0% success · Oct 17 09:00: 100% failed · Oct 17 10:00: 0% success · Oct 17 10:00: 100% failed · Oct 17 11:00: 0% success · Oct 17 11:00: 100% failed · Oct 17 12:00: 0.1% success · Oct 17 12:00: 99.9% failed · Oct 17 13:00: 0.2% success · Oct 17 13:00: 99.8% failed · Oct 17 14:00: 0.3% success · Oct 17 14:00: 99.7% failed · Oct 17 15:00: 0.5% success · Oct 17 15:00: 99.5% failed · Oct 17 16:00: 0.1% success · Oct 17 16:00: 99.9% failed · Oct 17 17:00: 0% success · Oct 17 17:00: 100% failed · Oct 17 18:00: 0% success · Oct 17 18:00: 100% failed · Oct 17 19:00: 0.1% success · Oct 17 19:00: 99.9% failed · Oct 17 20:00: 0% success · Oct 17 20:00: 100% failed · Oct 17 21:00: 0% success · Oct 17 21:00: 100% success · Oct 17 22:00: 100% failed · Oct 17 23:00: 0% success · Oct 17 23:00: 100% success · Oct 18 00:00: 100% success · Oct 18 01:00: 100% success · Oct 18 02:00: 100% TTFT ≤ 2s TTFT · Oct 17 03:00: 925ms TTFT · Oct 17 04:00: 823ms TTFT · Oct 17 05:00: 926ms TTFT · Oct 17 06:00: 1.15s TTFT · Oct 17 07:00: 1.9s TTFT · Oct 17 08:00: 1.04s TTFT · Oct 17 09:00: 689ms TTFT · Oct 17 10:00: 625ms TTFT · Oct 17 11:00: 829ms TTFT · Oct 17 12:00: 1.07s TTFT · Oct 17 13:00: 800ms TTFT · Oct 17 14:00: 767ms TTFT · Oct 17 15:00: 716ms TTFT · Oct 17 16:00: 803ms TTFT · Oct 17 17:00: 892ms TTFT · Oct 17 18:00: 661ms TTFT · Oct 17 19:00: 754ms TTFT · Oct 17 20:00: 742ms TTFT · Oct 17 21:00: 565ms TTFT · Oct 17 22:00: 623ms TTFT · Oct 17 23:00: 739ms TTFT · Oct 18 00:00: 752ms TTFT · Oct 18 01:00: 746ms TTFT · Oct 18 02:00: 751ms tok/s ≤ 150 tok/s tok/s · Oct 17 03:00: 88 tok/s tok/s · Oct 17 04:00: 93 tok/s tok/s · Oct 17 05:00: 81 tok/s tok/s · Oct 17 06:00: 88 tok/s tok/s · Oct 17 07:00: 95 tok/s tok/s · Oct 17 08:00: 79 tok/s tok/s · Oct 17 09:00: 104 tok/s tok/s · Oct 17 10:00: 115 tok/s tok/s · Oct 17 11:00: 108 tok/s tok/s · Oct 17 12:00: 91 tok/s tok/s · Oct 17 13:00: 92 tok/s tok/s · Oct 17 14:00: 93 tok/s tok/s · Oct 17 15:00: 112 tok/s tok/s · Oct 17 16:00: 115 tok/s tok/s · Oct 17 17:00: 145 tok/s tok/s · Oct 17 18:00: 128 tok/s tok/s · Oct 17 19:00: 108 tok/s tok/s · Oct 17 20:00: 111 tok/s tok/s · Oct 17 21:00: 123 tok/s tok/s · Oct 17 22:00: 123 tok/s tok/s · Oct 17 23:00: 104 tok/s tok/s · Oct 18 00:00: 107 tok/s tok/s · Oct 18 01:00: 117 tok/s tok/s · Oct 18 02:00: 123 tok/s Oct 17 03:00 Oct 18 02:00 99.9% success · 1.65s TTFT · 49 tok/s · 428.06K requests
success ≤ 100% failed · Oct 17 03:00: 0% success · Oct 17 03:00: 100% failed · Oct 17 04:00: 0% success · Oct 17 04:00: 100% failed · Oct 17 05:00: 0.1% success · Oct 17 05:00: 99.9% failed · Oct 17 06:00: 0% success · Oct 17 06:00: 100% failed · Oct 17 07:00: 0% success · Oct 17 07:00: 100% failed · Oct 17 08:00: 0.4% success · Oct 17 08:00: 99.6% success · Oct 17 09:00: 100% failed · Oct 17 10:00: 0.2% success · Oct 17 10:00: 99.8% success · Oct 17 11:00: 100% failed · Oct 17 12:00: 0.1% success · Oct 17 12:00: 99.9% failed · Oct 17 13:00: 0% success · Oct 17 13:00: 100% failed · Oct 17 14:00: 0.2% success · Oct 17 14:00: 99.8% failed · Oct 17 15:00: 0.1% success · Oct 17 15:00: 99.9% failed · Oct 17 16:00: 0% success · Oct 17 16:00: 100% failed · Oct 17 17:00: 0.2% success · Oct 17 17:00: 99.8% success · Oct 17 18:00: 100% failed · Oct 17 19:00: 0% success · Oct 17 19:00: 100% success · Oct 17 20:00: 100% failed · Oct 17 21:00: 0% success · Oct 17 21:00: 100% success · Oct 17 22:00: 100% success · Oct 17 23:00: 100% success · Oct 18 00:00: 100% success · Oct 18 01:00: 100% failed · Oct 18 02:00: 0.2% success · Oct 18 02:00: 99.8% TTFT ≤ 3s TTFT · Oct 17 03:00: 2.15s TTFT · Oct 17 04:00: 1.76s TTFT · Oct 17 05:00: 2.09s TTFT · Oct 17 06:00: 1.9s TTFT · Oct 17 07:00: 2.6s TTFT · Oct 17 08:00: 2.11s TTFT · Oct 17 09:00: 622ms TTFT · Oct 17 10:00: 679ms TTFT · Oct 17 11:00: 698ms TTFT · Oct 17 12:00: 915ms TTFT · Oct 17 13:00: 904ms TTFT · Oct 17 14:00: 639ms TTFT · Oct 17 15:00: 642ms TTFT · Oct 17 16:00: 875ms TTFT · Oct 17 17:00: 961ms TTFT · Oct 17 18:00: 695ms TTFT · Oct 17 19:00: 974ms TTFT · Oct 17 20:00: 932ms TTFT · Oct 17 21:00: 719ms TTFT · Oct 17 22:00: 750ms TTFT · Oct 17 23:00: 760ms TTFT · Oct 18 00:00: 782ms TTFT · Oct 18 01:00: 812ms TTFT · Oct 18 02:00: 734ms tok/s ≤ 100 tok/s tok/s · Oct 17 03:00: 53 tok/s tok/s · Oct 17 04:00: 56 tok/s tok/s · Oct 17 05:00: 51 tok/s tok/s · Oct 17 06:00: 49 tok/s tok/s · Oct 17 07:00: 43 tok/s tok/s · Oct 17 08:00: 42 tok/s tok/s · Oct 17 09:00: 77 tok/s tok/s · Oct 17 10:00: 93 tok/s tok/s · Oct 17 11:00: 75 tok/s tok/s · Oct 17 12:00: 52 tok/s tok/s · Oct 17 13:00: 47 tok/s tok/s · Oct 17 14:00: 65 tok/s tok/s · Oct 17 15:00: 58 tok/s tok/s · Oct 17 16:00: 43 tok/s tok/s · Oct 17 17:00: 46 tok/s tok/s · Oct 17 18:00: 52 tok/s tok/s · Oct 17 19:00: 39 tok/s tok/s · Oct 17 20:00: 41 tok/s tok/s · Oct 17 21:00: 46 tok/s tok/s · Oct 17 22:00: 47 tok/s tok/s · Oct 17 23:00: 43 tok/s tok/s · Oct 18 00:00: 38 tok/s tok/s · Oct 18 01:00: 39 tok/s tok/s · Oct 18 02:00: 41 tok/s Oct 17 03:00 Oct 18 02:00 99.8% success · 9.12s TTFT · 34 tok/s · 76.17K requests
success ≤ 100% success · Oct 17 03:00: 100% success · Oct 17 04:00: 100% success · Oct 17 05:00: 100% success · Oct 17 06:00: 100% failed · Oct 17 07:00: 0.1% success · Oct 17 07:00: 99.9% success · Oct 17 08:00: 100% failed · Oct 17 09:00: 0.2% success · Oct 17 09:00: 99.8% success · Oct 17 10:00: 100% failed · Oct 17 11:00: 0.4% success · Oct 17 11:00: 99.6% failed · Oct 17 12:00: 0.1% success · Oct 17 12:00: 99.9% success · Oct 17 13:00: 100% failed · Oct 17 14:00: 0.1% success · Oct 17 14:00: 99.9% failed · Oct 17 15:00: 0.3% success · Oct 17 15:00: 99.7% failed · Oct 17 16:00: 0.7% success · Oct 17 16:00: 99.3% failed · Oct 17 17:00: 0.2% success · Oct 17 17:00: 99.8% failed · Oct 17 18:00: 0.1% success · Oct 17 18:00: 99.9% success · Oct 17 19:00: 100% success · Oct 17 20:00: 100% failed · Oct 17 21:00: 0.2% success · Oct 17 21:00: 99.8% failed · Oct 17 22:00: 0.1% success · Oct 17 22:00: 99.9% failed · Oct 17 23:00: 0.1% success · Oct 17 23:00: 99.9% success · Oct 18 00:00: 100% failed · Oct 18 01:00: 0.2% success · Oct 18 01:00: 99.8% failed · Oct 18 02:00: 1.4% success · Oct 18 02:00: 98.6% TTFT ≤ 20s TTFT · Oct 17 03:00: 1.19s TTFT · Oct 17 04:00: 1.36s TTFT · Oct 17 05:00: 1.59s TTFT · Oct 17 06:00: 1.51s TTFT · Oct 17 07:00: 1.38s TTFT · Oct 17 08:00: 1.8s TTFT · Oct 17 09:00: 2.01s TTFT · Oct 17 10:00: 1.97s TTFT · Oct 17 11:00: 1.62s TTFT · Oct 17 12:00: 1.83s TTFT · Oct 17 13:00: 1.95s TTFT · Oct 17 14:00: 4.9s TTFT · Oct 17 15:00: 3.25s TTFT · Oct 17 16:00: 9.4s TTFT · Oct 17 17:00: 6.79s TTFT · Oct 17 18:00: 8.39s TTFT · Oct 17 19:00: 11.47s TTFT · Oct 17 20:00: 13.79s TTFT · Oct 17 21:00: 14.52s TTFT · Oct 17 22:00: 18.59s TTFT · Oct 17 23:00: 16.03s TTFT · Oct 18 00:00: 11.49s TTFT · Oct 18 01:00: 9.84s TTFT · Oct 18 02:00: 19.2s tok/s ≤ 50 tok/s tok/s · Oct 17 03:00: 34 tok/s tok/s · Oct 17 04:00: 28 tok/s tok/s · Oct 17 05:00: 25 tok/s tok/s · Oct 17 06:00: 27 tok/s tok/s · Oct 17 07:00: 26 tok/s tok/s · Oct 17 08:00: 24 tok/s tok/s · Oct 17 09:00: 37 tok/s tok/s · Oct 17 10:00: 42 tok/s tok/s · Oct 17 11:00: 48 tok/s tok/s · Oct 17 12:00: 49 tok/s tok/s · Oct 17 13:00: 35 tok/s tok/s · Oct 17 14:00: 36 tok/s tok/s · Oct 17 15:00: 33 tok/s tok/s · Oct 17 16:00: 33 tok/s tok/s · Oct 17 17:00: 34 tok/s tok/s · Oct 17 18:00: 31 tok/s tok/s · Oct 17 19:00: 31 tok/s tok/s · Oct 17 20:00: 33 tok/s tok/s · Oct 17 21:00: 33 tok/s tok/s · Oct 17 22:00: 34 tok/s tok/s · Oct 17 23:00: 34 tok/s tok/s · Oct 18 00:00: 36 tok/s tok/s · Oct 18 01:00: 37 tok/s tok/s · Oct 18 02:00: 40 tok/s Oct 17 03:00 Oct 18 02:00 99.8% success · 644ms TTFT · 46 tok/s · 19.67K requests
success ≤ 100% success · Oct 17 03:00: 100% success · Oct 17 04:00: 100% success · Oct 17 05:00: 100% success · Oct 17 06:00: 100% success · Oct 17 07:00: 100% failed · Oct 17 08:00: 0.3% success · Oct 17 08:00: 99.7% success · Oct 17 09:00: 100% success · Oct 17 10:00: 100% failed · Oct 17 11:00: 0.8% success · Oct 17 11:00: 99.2% failed · Oct 17 12:00: 0.3% success · Oct 17 12:00: 99.7% failed · Oct 17 13:00: 0.2% success · Oct 17 13:00: 99.8% failed · Oct 17 14:00: 0.4% success · Oct 17 14:00: 99.6% failed · Oct 17 15:00: 0.2% success · Oct 17 15:00: 99.8% failed · Oct 17 16:00: 0.3% success · Oct 17 16:00: 99.7% success · Oct 17 17:00: 100% failed · Oct 17 18:00: 0.2% success · Oct 17 18:00: 99.8% failed · Oct 17 19:00: 0.2% success · Oct 17 19:00: 99.8% failed · Oct 17 20:00: 0.1% success · Oct 17 20:00: 99.9% failed · Oct 17 21:00: 0.2% success · Oct 17 21:00: 99.8% success · Oct 17 22:00: 100% failed · Oct 17 23:00: 0.1% success · Oct 17 23:00: 99.9% success · Oct 18 00:00: 100% failed · Oct 18 01:00: 0.2% success · Oct 18 01:00: 99.8% failed · Oct 18 02:00: 0.9% success · Oct 18 02:00: 99.1% TTFT ≤ 1s TTFT · Oct 17 03:00: 569ms TTFT · Oct 17 04:00: 847ms TTFT · Oct 17 05:00: 572ms TTFT · Oct 17 06:00: 550ms TTFT · Oct 17 07:00: 573ms TTFT · Oct 17 08:00: 615ms TTFT · Oct 17 09:00: 604ms TTFT · Oct 17 10:00: 606ms TTFT · Oct 17 11:00: 832ms TTFT · Oct 17 12:00: 822ms TTFT · Oct 17 13:00: 661ms TTFT · Oct 17 14:00: 672ms TTFT · Oct 17 15:00: 780ms TTFT · Oct 17 16:00: 719ms TTFT · Oct 17 17:00: 662ms TTFT · Oct 17 18:00: 598ms TTFT · Oct 17 19:00: 646ms TTFT · Oct 17 20:00: 617ms TTFT · Oct 17 21:00: 615ms TTFT · Oct 17 22:00: 613ms TTFT · Oct 17 23:00: 572ms TTFT · Oct 18 00:00: 579ms TTFT · Oct 18 01:00: 658ms TTFT · Oct 18 02:00: 608ms tok/s ≤ 60 tok/s tok/s · Oct 17 03:00: 51 tok/s tok/s · Oct 17 04:00: 57 tok/s tok/s · Oct 17 05:00: 54 tok/s tok/s · Oct 17 06:00: 50 tok/s tok/s · Oct 17 07:00: 45 tok/s tok/s · Oct 17 08:00: 48 tok/s tok/s · Oct 17 09:00: 51 tok/s tok/s · Oct 17 10:00: 49 tok/s tok/s · Oct 17 11:00: 52 tok/s tok/s · Oct 17 12:00: 58 tok/s tok/s · Oct 17 13:00: 51 tok/s tok/s · Oct 17 14:00: 46 tok/s tok/s · Oct 17 15:00: 54 tok/s tok/s · Oct 17 16:00: 50 tok/s tok/s · Oct 17 17:00: 53 tok/s tok/s · Oct 17 18:00: 45 tok/s tok/s · Oct 17 19:00: 40 tok/s tok/s · Oct 17 20:00: 44 tok/s tok/s · Oct 17 21:00: 52 tok/s tok/s · Oct 17 22:00: 41 tok/s tok/s · Oct 17 23:00: 43 tok/s tok/s · Oct 18 00:00: 39 tok/s tok/s · Oct 18 01:00: 39 tok/s tok/s · Oct 18 02:00: 45 tok/s Oct 17 03:00 Oct 18 02:00 100% success · 2.88s TTFT · 21 tok/s · 330.43K requests
success ≤ 100% success · Oct 17 03:00: 100% failed · Oct 17 04:00: 0% success · Oct 17 04:00: 100% success · Oct 17 05:00: 100% success · Oct 17 06:00: 100% failed · Oct 17 07:00: 0% success · Oct 17 07:00: 100% success · Oct 17 08:00: 100% success · Oct 17 09:00: 100% success · Oct 17 10:00: 100% failed · Oct 17 11:00: 0.1% success · Oct 17 11:00: 99.9% failed · Oct 17 12:00: 0.1% success · Oct 17 12:00: 99.9% success · Oct 17 13:00: 100% failed · Oct 17 14:00: 0% success · Oct 17 14:00: 100% failed · Oct 17 15:00: 0.1% success · Oct 17 15:00: 99.9% failed · Oct 17 16:00: 0.1% success · Oct 17 16:00: 99.9% failed · Oct 17 17:00: 0.1% success · Oct 17 17:00: 99.9% failed · Oct 17 18:00: 0% success · Oct 17 18:00: 100% failed · Oct 17 19:00: 0% success · Oct 17 19:00: 100% failed · Oct 17 20:00: 0% success · Oct 17 20:00: 100% failed · Oct 17 21:00: 0% success · Oct 17 21:00: 100% success · Oct 17 22:00: 100% success · Oct 17 23:00: 100% success · Oct 18 00:00: 100% failed · Oct 18 01:00: 0% success · Oct 18 01:00: 100% failed · Oct 18 02:00: 0.6% success · Oct 18 02:00: 99.4% TTFT ≤ 6s TTFT · Oct 17 03:00: 3.09s TTFT · Oct 17 04:00: 2.18s TTFT · Oct 17 05:00: 2.31s TTFT · Oct 17 06:00: 3.2s TTFT · Oct 17 07:00: 3.55s TTFT · Oct 17 08:00: 2.51s TTFT · Oct 17 09:00: 3.02s TTFT · Oct 17 10:00: 5.22s TTFT · Oct 17 11:00: 4.09s TTFT · Oct 17 12:00: 2.56s TTFT · Oct 17 13:00: 2.69s TTFT · Oct 17 14:00: 2.74s TTFT · Oct 17 15:00: 2.6s TTFT · Oct 17 16:00: 4.5s TTFT · Oct 17 17:00: 4.17s TTFT · Oct 17 18:00: 3.04s TTFT · Oct 17 19:00: 2.62s TTFT · Oct 17 20:00: 1.99s TTFT · Oct 17 21:00: 2.05s TTFT · Oct 17 22:00: 2.31s TTFT · Oct 17 23:00: 3.94s TTFT · Oct 18 00:00: 2.01s TTFT · Oct 18 01:00: 2.1s TTFT · Oct 18 02:00: 2s tok/s ≤ 50 tok/s tok/s · Oct 17 03:00: 13 tok/s tok/s · Oct 17 04:00: 10 tok/s tok/s · Oct 17 05:00: 10 tok/s tok/s · Oct 17 06:00: 13 tok/s tok/s · Oct 17 07:00: 19 tok/s tok/s · Oct 17 08:00: 31 tok/s tok/s · Oct 17 09:00: 30 tok/s tok/s · Oct 17 10:00: 33 tok/s tok/s · Oct 17 11:00: 30 tok/s tok/s · Oct 17 12:00: 24 tok/s tok/s · Oct 17 13:00: 25 tok/s tok/s · Oct 17 14:00: 25 tok/s tok/s · Oct 17 15:00: 31 tok/s tok/s · Oct 17 16:00: 19 tok/s tok/s · Oct 17 17:00: 20 tok/s tok/s · Oct 17 18:00: 25 tok/s tok/s · Oct 17 19:00: 31 tok/s tok/s · Oct 17 20:00: 36 tok/s tok/s · Oct 17 21:00: 23 tok/s tok/s · Oct 17 22:00: 40 tok/s tok/s · Oct 17 23:00: 29 tok/s tok/s · Oct 18 00:00: 34 tok/s tok/s · Oct 18 01:00: 30 tok/s tok/s · Oct 18 02:00: 28 tok/s Oct 17 03:00 Oct 18 02:00 100% success · 2.46s TTFT · 60 tok/s · 106.61K requests
success ≤ 100% success · Oct 17 03:00: 100% success · Oct 17 04:00: 100% success · Oct 17 05:00: 100% success · Oct 17 06:00: 100% success · Oct 17 07:00: 100% success · Oct 17 08:00: 100% success · Oct 17 09:00: 100% failed · Oct 17 10:00: 0.1% success · Oct 17 10:00: 99.9% success · Oct 17 11:00: 100% success · Oct 17 12:00: 100% failed · Oct 17 13:00: 0% success · Oct 17 13:00: 100% failed · Oct 17 14:00: 0% success · Oct 17 14:00: 100% failed · Oct 17 15:00: 0.2% success · Oct 17 15:00: 99.8% success · Oct 17 16:00: 100% success · Oct 17 17:00: 100% success · Oct 17 18:00: 100% success · Oct 17 19:00: 100% success · Oct 17 20:00: 100% success · Oct 17 21:00: 100% success · Oct 17 22:00: 100% failed · Oct 17 23:00: 0% success · Oct 17 23:00: 100% success · Oct 18 00:00: 100% success · Oct 18 01:00: 100% failed · Oct 18 02:00: 0.2% success · Oct 18 02:00: 99.8% TTFT ≤ 5s TTFT · Oct 17 03:00: 1.98s TTFT · Oct 17 04:00: 1.73s TTFT · Oct 17 05:00: 2.05s TTFT · Oct 17 06:00: 1.9s TTFT · Oct 17 07:00: 2.04s TTFT · Oct 17 08:00: 2.17s TTFT · Oct 17 09:00: 2.76s TTFT · Oct 17 10:00: 3.41s TTFT · Oct 17 11:00: 1.76s TTFT · Oct 17 12:00: 1.54s TTFT · Oct 17 13:00: 2.21s TTFT · Oct 17 14:00: 2.34s TTFT · Oct 17 15:00: 2.26s TTFT · Oct 17 16:00: 3.54s TTFT · Oct 17 17:00: 4.7s TTFT · Oct 17 18:00: 2.7s TTFT · Oct 17 19:00: 1.65s TTFT · Oct 17 20:00: 2.49s TTFT · Oct 17 21:00: 1.98s TTFT · Oct 17 22:00: 1.66s TTFT · Oct 17 23:00: 2.51s TTFT · Oct 18 00:00: 2.38s TTFT · Oct 18 01:00: 3.71s TTFT · Oct 18 02:00: 2.97s tok/s ≤ 200 tok/s tok/s · Oct 17 03:00: 186 tok/s tok/s · Oct 17 04:00: 170 tok/s tok/s · Oct 17 05:00: 181 tok/s tok/s · Oct 17 06:00: 197 tok/s tok/s · Oct 17 07:00: 125 tok/s tok/s · Oct 17 08:00: 86 tok/s tok/s · Oct 17 09:00: 51 tok/s tok/s · Oct 17 10:00: 47 tok/s tok/s · Oct 17 11:00: 79 tok/s tok/s · Oct 17 12:00: 179 tok/s tok/s · Oct 17 13:00: 49 tok/s tok/s · Oct 17 14:00: 32 tok/s tok/s · Oct 17 15:00: 25 tok/s tok/s · Oct 17 16:00: 26 tok/s tok/s · Oct 17 17:00: 23 tok/s tok/s · Oct 17 18:00: 40 tok/s tok/s · Oct 17 19:00: 130 tok/s tok/s · Oct 17 20:00: 96 tok/s tok/s · Oct 17 21:00: 175 tok/s tok/s · Oct 17 22:00: 162 tok/s tok/s · Oct 17 23:00: 93 tok/s tok/s · Oct 18 00:00: 111 tok/s tok/s · Oct 18 01:00: 46 tok/s tok/s · Oct 18 02:00: 148 tok/s Oct 17 03:00 Oct 18 02:00 99.9% success · 581ms TTFT · 57 tok/s · 46.97K requests
success ≤ 100% success · Oct 17 03:00: 100% success · Oct 17 04:00: 100% failed · Oct 17 05:00: 0% success · Oct 17 05:00: 100% success · Oct 17 06:00: 100% success · Oct 17 07:00: 100% success · Oct 17 08:00: 100% failed · Oct 17 09:00: 0% success · Oct 17 09:00: 100% success · Oct 17 10:00: 100% failed · Oct 17 11:00: 0.1% success · Oct 17 11:00: 99.9% failed · Oct 17 12:00: 0.1% success · Oct 17 12:00: 99.9% success · Oct 17 13:00: 100% success · Oct 17 14:00: 100% failed · Oct 17 15:00: 0.1% success · Oct 17 15:00: 99.9% failed · Oct 17 16:00: 0.1% success · Oct 17 16:00: 99.9% failed · Oct 17 17:00: 0.1% success · Oct 17 17:00: 99.9% success · Oct 17 18:00: 100% failed · Oct 17 19:00: 0.1% success · Oct 17 19:00: 99.9% success · Oct 17 20:00: 100% success · Oct 17 21:00: 100% success · Oct 17 22:00: 100% success · Oct 17 23:00: 100% success · Oct 18 00:00: 100% failed · Oct 18 01:00: 0.3% success · Oct 18 01:00: 99.7% failed · Oct 18 02:00: 0.8% success · Oct 18 02:00: 99.2% TTFT ≤ 1s TTFT · Oct 17 03:00: 449ms TTFT · Oct 17 04:00: 513ms TTFT · Oct 17 05:00: 476ms TTFT · Oct 17 06:00: 660ms TTFT · Oct 17 07:00: 589ms TTFT · Oct 17 08:00: 554ms TTFT · Oct 17 09:00: 480ms TTFT · Oct 17 10:00: 552ms TTFT · Oct 17 11:00: 619ms TTFT · Oct 17 12:00: 522ms TTFT · Oct 17 13:00: 477ms TTFT · Oct 17 14:00: 529ms TTFT · Oct 17 15:00: 538ms TTFT · Oct 17 16:00: 546ms TTFT · Oct 17 17:00: 824ms TTFT · Oct 17 18:00: 578ms TTFT · Oct 17 19:00: 637ms TTFT · Oct 17 20:00: 671ms TTFT · Oct 17 21:00: 595ms TTFT · Oct 17 22:00: 684ms TTFT · Oct 17 23:00: 606ms TTFT · Oct 18 00:00: 630ms TTFT · Oct 18 01:00: 632ms TTFT · Oct 18 02:00: 602ms tok/s ≤ 100 tok/s tok/s · Oct 17 03:00: 78 tok/s tok/s · Oct 17 04:00: 90 tok/s tok/s · Oct 17 05:00: 80 tok/s tok/s · Oct 17 06:00: 77 tok/s tok/s · Oct 17 07:00: 73 tok/s tok/s · Oct 17 08:00: 73 tok/s tok/s · Oct 17 09:00: 74 tok/s tok/s · Oct 17 10:00: 90 tok/s tok/s · Oct 17 11:00: 92 tok/s tok/s · Oct 17 12:00: 80 tok/s tok/s · Oct 17 13:00: 66 tok/s tok/s · Oct 17 14:00: 72 tok/s tok/s · Oct 17 15:00: 62 tok/s tok/s · Oct 17 16:00: 49 tok/s tok/s · Oct 17 17:00: 76 tok/s tok/s · Oct 17 18:00: 51 tok/s tok/s · Oct 17 19:00: 49 tok/s tok/s · Oct 17 20:00: 53 tok/s tok/s · Oct 17 21:00: 41 tok/s tok/s · Oct 17 22:00: 52 tok/s tok/s · Oct 17 23:00: 42 tok/s tok/s · Oct 18 00:00: 36 tok/s tok/s · Oct 18 01:00: 33 tok/s tok/s · Oct 18 02:00: 39 tok/s Oct 17 03:00 Oct 18 02:00 99.9% success · 2.6s TTFT · 99 tok/s · 4.58K requests
success ≤ 100% success · Oct 17 03:00: 100% success · Oct 17 04:00: 100% success · Oct 17 05:00: 100% success · Oct 17 06:00: 100% success · Oct 17 07:00: 100% success · Oct 17 08:00: 100% success · Oct 17 09:00: 100% success · Oct 17 10:00: 100% success · Oct 17 11:00: 100% success · Oct 17 12:00: 100% failed · Oct 17 13:00: 0.5% success · Oct 17 13:00: 99.5% success · Oct 17 14:00: 100% success · Oct 17 15:00: 100% success · Oct 17 16:00: 100% success · Oct 17 17:00: 100% success · Oct 17 18:00: 100% success · Oct 17 19:00: 100% failed · Oct 17 20:00: 0.8% success · Oct 17 20:00: 99.2% success · Oct 17 21:00: 100% success · Oct 17 22:00: 100% success · Oct 17 23:00: 100% success · Oct 18 00:00: 100% success · Oct 18 01:00: 100% success · Oct 18 02:00: 100% TTFT ≤ 10s TTFT · Oct 17 03:00: 1.38s TTFT · Oct 17 04:00: 1.16s TTFT · Oct 17 05:00: 1.18s TTFT · Oct 17 06:00: 1.41s TTFT · Oct 17 07:00: 1.48s TTFT · Oct 17 08:00: 1.41s TTFT · Oct 17 09:00: 1.15s TTFT · Oct 17 10:00: 1.08s TTFT · Oct 17 11:00: 1.14s TTFT · Oct 17 12:00: 1.52s TTFT · Oct 17 13:00: 1.28s TTFT · Oct 17 14:00: 1.53s TTFT · Oct 17 15:00: 1.53s TTFT · Oct 17 16:00: 1.32s TTFT · Oct 17 17:00: 1.51s TTFT · Oct 17 18:00: 1.22s TTFT · Oct 17 19:00: 1.16s TTFT · Oct 17 20:00: 1.29s TTFT · Oct 17 21:00: 1.15s TTFT · Oct 17 22:00: 989ms TTFT · Oct 17 23:00: 886ms TTFT · Oct 18 00:00: 9.73s TTFT · Oct 18 01:00: 4.94s TTFT · Oct 18 02:00: 1.16s tok/s ≤ 150 tok/s tok/s · Oct 17 03:00: 105 tok/s tok/s · Oct 17 04:00: 113 tok/s tok/s · Oct 17 05:00: 116 tok/s tok/s · Oct 17 06:00: 143 tok/s tok/s · Oct 17 07:00: 115 tok/s tok/s · Oct 17 08:00: 100 tok/s tok/s · Oct 17 09:00: 110 tok/s tok/s · Oct 17 10:00: 131 tok/s tok/s · Oct 17 11:00: 120 tok/s tok/s · Oct 17 12:00: 115 tok/s tok/s · Oct 17 13:00: 106 tok/s tok/s · Oct 17 14:00: 139 tok/s tok/s · Oct 17 15:00: 137 tok/s tok/s · Oct 17 16:00: 138 tok/s tok/s · Oct 17 17:00: 134 tok/s tok/s · Oct 17 18:00: 136 tok/s tok/s · Oct 17 19:00: 130 tok/s tok/s · Oct 17 20:00: 126 tok/s tok/s · Oct 17 21:00: 124 tok/s tok/s · Oct 17 22:00: 117 tok/s tok/s · Oct 17 23:00: 106 tok/s tok/s · Oct 18 00:00: 53 tok/s tok/s · Oct 18 01:00: 77 tok/s tok/s · Oct 18 02:00: 103 tok/s Oct 17 03:00 Oct 18 02:00 
engy