Serving-Engine Bake-off: Ollama vs SGLang vs vLLM
Pod iy5fajwwpky2d4 · GPU NVIDIA RTX A6000 · Datacenter US-KS-2 · Cost/hr $0.53 · Spend $0.02
Last updated
2026-08-16 12:44 AM ET
2026-08-16 12:44 AM ET
GPU
NVIDIA RTX A6000
Datacenter
US-KS-2
Cost/hr
$0.53
Cumulative spend
$0.02
Current run started
-
Running Results
| Run # | Engine | Parsed | Errors | Rows/hr | $/1k rows | JSON valid % | Avg latency (s) | Avg key-resp len |
|---|---|---|---|---|---|---|---|---|
| No completed runs yet. | ||||||||
Mean Throughput
No chart data yet.