engyProviders
69
clusters
172
machines
812
GPUs
63
independent providers
| cluster | hardware | model | ttft | single | throughput↓ | cache hit |
|---|---|---|---|---|---|---|
| 2× | 8x NVIDIA B300 SXM6 AC | kimi-k3 | 0.70s | 79 tps | 753 tps | 72% |
| 1× | 8x NVIDIA B300 SXM6 AC | kimi-k3 | 0.69s | 131 tps | 547 tps | 95% |
| 1× | 8x NVIDIA B300 SXM6 AC | kimi-k3 | 1.37s | 49 tps | 406 tps | 73% |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | 2.66s | 60 tps | 28 tps | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | 0.32s | 61 tps | 27 tps | — |
| 1× | 2x NVIDIA H100 80GB HBM3 | qwen3.6-35b-a3b | — | — | 20 tps | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | 19 tps | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | 17 tps | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | 14 tps | — |
| 1× | 8x NVIDIA GeForce RTX 5090 | qwen3.6-35b-a3b | — | — | 13 tps | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | 0.29s | 56 tps | 13 tps | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | 1.10s | 65 tps | 12 tps | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | 10 tps | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | 9 tps | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | 8 tps | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | 5 tps | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | 5 tps | — |
| 2× | 8x RTX 5090 (32GB) | deepseek-v4-flash-0731 | — | — | — | — |
| 3× | 8x4090 | qwen3.6-35b-a3b | — | — | — | — |
| 42× | 8x RTX 5090 (32GB) | qwen3.8-27b | — | — | — | — |
| 10× | 8x NVIDIA GeForce RTX 5090 +1 configs | glm-5.2 | — | — | — | — |
| 2× | 32x RTX 5090 (32GB) | glm-5.3 | — | — | — | — |
| 2× | 16x RTX 5090 (32GB) | glm-5.3-flash | — | — | — | — |
| 3× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 3× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 4x NVIDIA GeForce RTX 5090 | qwen3.6-35b-a3b | — | — | — | — |
| 3× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 3× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 8x NVIDIA B200 | glm-5.2 | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 3× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 3× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 4× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 2× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |
| 1× | 1x NVIDIA RTX PRO 6000 Blackwell Server Edition | qwen3.6-35b-a3b | — | — | — | — |