Total Requests
-
-
Avg TPS
-
Tokens per second
Avg Latency
-
End-to-end
Success Rate
-
-
TPS Comparison
Latency Distribution
Model Comparison
Sort by: TPS | Latency
| Model | Requests | Success | Avg TPS | P50 Latency | P95 Latency | Avg Tokens In | Avg Tokens Out | Cache Read | Reasoning |
|---|
Recent Requests
| Time | Model | Provider | Status | Latency | TPS | Tokens In | Tokens Out | Cache | Reasoning |
|---|