AI API latency
Compare endpoint response times and availability across regions.
Fireworks AI · Asia (Tokyo)
51,809 network probes · last 24h
API endpoints monitored
Independent probe locations
Response time over 24 hours
Typical response (p50 TTFB) · Europe (Germany)
View hourly values
Hourly median (p50), in milliseconds. Times are UTC. A dash means no measurement.
| Date · UTC | OpenAI | Anthropic | |
|---|---|---|---|
| 11-18 12:00 | 212 | 195 | 96 |
| 11-18 11:00 | 331 | 201 | 95 |
| 11-18 10:00 | 277 | 199 | 96 |
| 11-18 09:00 | 232 | 202 | 98 |
| 11-18 08:00 | 222 | 200 | 97 |
| 11-18 07:00 | 213 | 188 | 95 |
| 11-18 06:00 | 321 | 198 | 76 |
| 11-18 05:00 | 326 | 198 | 95 |
| 11-18 04:00 | 207 | 197 | 96 |
| 11-18 03:00 | 323 | 197 | 94 |
| 11-18 02:00 | 208 | 196 | 78 |
| 11-18 01:00 | 331 | 196 | 30 |
| 11-18 00:00 | 209 | 198 | 89 |
| 11-17 23:00 | 214 | 198 | 80 |
| 11-17 22:00 | 209 | 199 | 94 |
| 11-17 21:00 | 212 | 198 | 87 |
| 11-17 20:00 | 208 | 200 | 86 |
| 11-17 19:00 | 217 | 196 | 91 |
| 11-17 18:00 | 224 | 200 | 89 |
| 11-17 17:00 | 333 | 202 | 95 |
| 11-17 16:00 | 331 | 197 | 94 |
| 11-17 15:00 | 208 | 198 | 94 |
| 11-17 14:00 | 215 | 198 | 98 |
| 11-17 13:00 | 226 | 200 | 96 |
Speed index
Relative endpoint speed · 4 measured regions
100 matches the fastest endpoint in every measured region. 50 means twice the latency in a region; scores are averaged across regions.
Full rankings & scoring methodProvider rankings
Choose the region closest to your application’s server · last 24 hours
How to read these metrics
Typical response · p50Half of successful timed probes were this fast or faster. Lower is better.
Slower responses · p9595% of successful timed probes were this fast or faster. This shows how latency behaves on slower requests.
AvailabilityThe share of successful network probes. Higher is better. Samples show how many probes were made.
TTFB measures the network and API endpoint, before a model generates an answer. It does not measure answer quality or generation speed. Compare model TTFT or read the measurement method. A dash means no timing data.
Asia (Tokyo)
| Rank | Provider | Typical responsep50 TTFB · ms | Slower responsesp95 TTFB · ms | AvailabilitySuccessful probes | SamplesLast 24 hours |
|---|---|---|---|---|---|
| 01 | Fireworks AI | 20 ms | 65 ms | 100% | 288 |
| 02 | SambaNova | 26 ms | 80 ms | 100% | 289 |
| 03 | OpenRouter | 55 ms | 110 ms | 100% | 288 |
| 04 | upstage | 59 ms | 84 ms | 100% | 288 |
| 05 | 68 ms | 124 ms | 100% | 289 | |
| 06 | glm | 92 ms | 149 ms | 100% | 288 |
| 07 | meta-llama | 118 ms | 292 ms | 100% | 288 |
| 08 | kimi | 125 ms | 187 ms | 100% | 289 |
| 09 | ernie | 135 ms | 144 ms | 100% | 288 |
| 10 | TypeSafe | 145 ms | 153 ms | 100% | 288 |
| 11 | baichuan | 146 ms | 877 ms | 98.6% | 288 |
| 12 | novita | 151 ms | 234 ms | 100% | 288 |
| 13 | QwenCloud | 158 ms | 218 ms | 100% | 288 |
| 14 | Groq | 159 ms | 218 ms | 100% | 289 |
| 15 | Together AI | 160 ms | 289 ms | 100% | 289 |
| 16 | baseten | 163 ms | 190 ms | 100% | 288 |
| 17 | qwen | 165 ms | 234 ms | 100% | 288 |
| 18 | minimax | 167 ms | 218 ms | 100% | 288 |
| 19 | Cohere | 176 ms | 217 ms | 100% | 288 |
| 20 | xAI | 180 ms | 254 ms | 100% | 288 |
| 21 | DeepSeek | 183 ms | 253 ms | 100% | 288 |
| 22 | OpenAI | 209 ms | 294 ms | 100% | 289 |
| 23 | Cerebras | 209 ms | 271 ms | 100% | 289 |
| 24 | Anthropic | 225 ms | 292 ms | 100% | 289 |
| 25 | Perplexity | 232 ms | 305 ms | 100% | 288 |
| 26 | writer | 234 ms | 281 ms | 100% | 288 |
| 27 | reka | 239 ms | 577 ms | 100% | 288 |
| 28 | sarvam | 247 ms | 280 ms | 100% | 288 |
| 29 | Tencent TokenHub | 249 ms | 296 ms | 100% | 288 |
| 30 | iflytek | 271 ms | 1,724 ms | 98.3% | 288 |
| 31 | friendli | 276 ms | 455 ms | 100% | 288 |
| 32 | Mistral | 313 ms | 393 ms | 100% | 289 |
| 33 | stepfun | 325 ms | 819 ms | 100% | 288 |
| 34 | ai21 | 328 ms | 439 ms | 100% | 288 |
| 35 | replicate | 329 ms | 426 ms | 99.7% | 288 |
| 36 | inference-net | 344 ms | 664 ms | 100% | 288 |
| 37 | hyperbolic | 372 ms | 450 ms | 100% | 288 |
| 38 | siliconflow | 373 ms | 405 ms | 100% | 288 |
| 39 | featherless | 374 ms | 461 ms | 100% | 288 |
| 40 | sensenova | 439 ms | 1,220 ms | 99.0% | 288 |
| 41 | deepinfra | 451 ms | 818 ms | 100% | 288 |
| 42 | nebius | 477 ms | 532 ms | 100% | 288 |
| 43 | doubao | 490 ms | 1,902 ms | 99.7% | 288 |
| 44 | nscale | 537 ms | 546 ms | 100% | 288 |
| 45 | aleph-alpha | 548 ms | 579 ms | 100% | 288 |
No matching providers. Try another name.
Europe (Germany)
| Rank | Provider | Typical responsep50 TTFB · ms | Slower responsesp95 TTFB · ms | AvailabilitySuccessful probes | SamplesLast 24 hours |
|---|---|---|---|---|---|
| 01 | nebius | 33 ms | 96 ms | 100% | 288 |
| 02 | aleph-alpha | 56 ms | 90 ms | 100% | 288 |
| 03 | nscale | 70 ms | 73 ms | 100% | 288 |
| 04 | meta-llama | 90 ms | 152 ms | 100% | 288 |
| 05 | Fireworks AI | 91 ms | 339 ms | 100% | 288 |
| 06 | 92 ms | 102 ms | 100% | 288 | |
| 07 | OpenRouter | 97 ms | 107 ms | 100% | 288 |
| 08 | Mistral | 116 ms | 193 ms | 100% | 288 |
| 09 | baseten | 123 ms | 136 ms | 100% | 288 |
| 10 | Cohere | 132 ms | 194 ms | 100% | 288 |
| 11 | glm | 145 ms | 200 ms | 100% | 288 |
| 12 | inference-net | 146 ms | 390 ms | 100% | 288 |
| 13 | TypeSafe | 158 ms | 164 ms | 100% | 288 |
| 14 | reka | 176 ms | 212 ms | 100% | 288 |
| 15 | baichuan | 183 ms | 606 ms | 100% | 288 |
| 16 | Cerebras | 189 ms | 206 ms | 100% | 288 |
| 17 | Perplexity | 192 ms | 217 ms | 100% | 288 |
| 18 | Anthropic | 198 ms | 216 ms | 100% | 288 |
| 19 | replicate | 211 ms | 350 ms | 97.2% | 288 |
| 20 | OpenAI | 215 ms | 351 ms | 100% | 288 |
| 21 | Groq | 219 ms | 246 ms | 100% | 288 |
| 22 | writer | 223 ms | 295 ms | 100% | 288 |
| 23 | novita | 231 ms | 257 ms | 100% | 288 |
| 24 | Together AI | 234 ms | 283 ms | 100% | 288 |
| 25 | friendli | 245 ms | 385 ms | 99.3% | 288 |
| 26 | siliconflow | 248 ms | 275 ms | 100% | 288 |
| 27 | minimax | 254 ms | 282 ms | 100% | 288 |
| 28 | sarvam | 265 ms | 274 ms | 100% | 288 |
| 29 | hyperbolic | 272 ms | 632 ms | 100% | 288 |
| 30 | ernie | 282 ms | 310 ms | 100% | 288 |
| 31 | DeepSeek | 284 ms | 336 ms | 100% | 288 |
| 32 | iflytek | 286 ms | 760 ms | 99.7% | 288 |
| 33 | xAI | 307 ms | 325 ms | 100% | 288 |
| 34 | kimi | 312 ms | 404 ms | 100% | 288 |
| 35 | SambaNova | 331 ms | 370 ms | 99.7% | 288 |
| 36 | ai21 | 336 ms | 471 ms | 100% | 288 |
| 37 | doubao | 350 ms | 808 ms | 99.7% | 288 |
| 38 | QwenCloud | 356 ms | 408 ms | 100% | 288 |
| 39 | qwen | 393 ms | 445 ms | 100% | 288 |
| 40 | sensenova | 397 ms | 1,160 ms | 99.0% | 288 |
| 41 | stepfun | 432 ms | 1,203 ms | 100% | 288 |
| 42 | Tencent TokenHub | 467 ms | 638 ms | 100% | 288 |
| 43 | deepinfra | 509 ms | 922 ms | 100% | 288 |
| 44 | upstage | 517 ms | 575 ms | 100% | 288 |
| 45 | featherless | 536 ms | 600 ms | 100% | 288 |
No matching providers. Try another name.
South America (Santiago)
| Rank | Provider | Typical responsep50 TTFB · ms | Slower responsesp95 TTFB · ms | AvailabilitySuccessful probes | SamplesLast 24 hours |
|---|---|---|---|---|---|
| 01 | OpenRouter | 58 ms | 102 ms | 100% | 288 |
| 02 | baseten | 168 ms | 196 ms | 100% | 288 |
| 03 | TypeSafe | 175 ms | 187 ms | 100% | 288 |
| 04 | Cohere | 188 ms | 230 ms | 100% | 288 |
| 05 | Groq | 189 ms | 232 ms | 100% | 288 |
| 06 | xAI | 197 ms | 283 ms | 100% | 288 |
| 07 | Cerebras | 199 ms | 251 ms | 100% | 288 |
| 08 | Anthropic | 203 ms | 265 ms | 100% | 288 |
| 09 | OpenAI | 209 ms | 292 ms | 100% | 288 |
| 10 | inference-net | 220 ms | 418 ms | 100% | 288 |
| 11 | novita | 227 ms | 310 ms | 100% | 288 |
| 12 | Perplexity | 230 ms | 487 ms | 100% | 288 |
| 13 | Together AI | 249 ms | 643 ms | 100% | 288 |
| 14 | reka | 255 ms | 554 ms | 100% | 288 |
| 15 | meta-llama | 263 ms | 318 ms | 100% | 288 |
| 16 | Fireworks AI | 265 ms | 284 ms | 100% | 288 |
| 17 | writer | 268 ms | 367 ms | 100% | 288 |
| 18 | friendli | 269 ms | 402 ms | 100% | 288 |
| 19 | siliconflow | 280 ms | 285 ms | 100% | 288 |
| 20 | Mistral | 291 ms | 362 ms | 100% | 288 |
| 21 | kimi | 363 ms | 509 ms | 100% | 288 |
| 22 | SambaNova | 383 ms | 404 ms | 100% | 288 |
| 23 | baichuan | 396 ms | 1,383 ms | 99.3% | 288 |
| 24 | ai21 | 404 ms | 513 ms | 99.3% | 288 |
| 25 | ernie | 426 ms | 607 ms | 100% | 288 |
| 26 | replicate | 433 ms | 629 ms | 99.0% | 288 |
| 27 | nebius | 435 ms | 479 ms | 100% | 288 |
| 28 | nscale | 440 ms | 446 ms | 100% | 288 |
| 29 | minimax | 444 ms | 621 ms | 100% | 288 |
| 30 | DeepSeek | 455 ms | 519 ms | 100% | 288 |
| 31 | aleph-alpha | 466 ms | 491 ms | 99.7% | 288 |
| 32 | glm | 533 ms | 548 ms | 100% | 288 |
| 33 | deepinfra | 570 ms | 944 ms | 100% | 288 |
| 34 | sarvam | 673 ms | 697 ms | 100% | 288 |
| 35 | sensenova | 693 ms | 1,914 ms | 98.3% | 288 |
| 36 | stepfun | 696 ms | 1,758 ms | 99.3% | 288 |
| 37 | featherless | 708 ms | 1,182 ms | 99.7% | 288 |
| 38 | upstage | 709 ms | 1,314 ms | 99.3% | 288 |
| 39 | iflytek | 735 ms | 1,766 ms | 99.7% | 288 |
| 40 | QwenCloud | 738 ms | 1,079 ms | 100% | 288 |
| 41 | qwen | 754 ms | 1,106 ms | 100% | 288 |
| 42 | doubao | 768 ms | 1,856 ms | 99.0% | 288 |
| 43 | hyperbolic | 770 ms | 810 ms | 100% | 288 |
| 44 | Tencent TokenHub | 793 ms | 1,077 ms | 100% | 288 |
| 45 | 949 ms | 1,090 ms | 100% | 288 |
No matching providers. Try another name.
US (Central)
| Rank | Provider | Typical responsep50 TTFB · ms | Slower responsesp95 TTFB · ms | AvailabilitySuccessful probes | SamplesLast 24 hours |
|---|---|---|---|---|---|
| 01 | Fireworks AI | 29 ms | 88 ms | 100% | 288 |
| 02 | 44 ms | 106 ms | 100% | 287 | |
| 03 | baseten | 48 ms | 61 ms | 100% | 288 |
| 04 | OpenRouter | 59 ms | 129 ms | 100% | 288 |
| 05 | Cohere | 63 ms | 111 ms | 100% | 288 |
| 06 | Cerebras | 74 ms | 145 ms | 100% | 288 |
| 07 | replicate | 78 ms | 153 ms | 99.3% | 288 |
| 08 | TypeSafe | 79 ms | 94 ms | 100% | 288 |
| 09 | siliconflow | 82 ms | 119 ms | 100% | 288 |
| 10 | novita | 91 ms | 163 ms | 100% | 288 |
| 11 | Perplexity | 91 ms | 151 ms | 100% | 288 |
| 12 | reka | 93 ms | 174 ms | 100% | 288 |
| 13 | Anthropic | 93 ms | 156 ms | 100% | 287 |
| 14 | inference-net | 100 ms | 445 ms | 100% | 288 |
| 15 | xAI | 105 ms | 193 ms | 100% | 287 |
| 16 | Together AI | 118 ms | 206 ms | 100% | 288 |
| 17 | writer | 124 ms | 184 ms | 100% | 288 |
| 18 | Groq | 126 ms | 201 ms | 100% | 288 |
| 19 | OpenAI | 136 ms | 211 ms | 100% | 287 |
| 20 | meta-llama | 141 ms | 237 ms | 100% | 288 |
| 21 | friendli | 162 ms | 220 ms | 100% | 288 |
| 22 | deepinfra | 176 ms | 373 ms | 100% | 288 |
| 23 | SambaNova | 179 ms | 237 ms | 100% | 288 |
| 24 | nebius | 179 ms | 222 ms | 100% | 288 |
| 25 | Mistral | 187 ms | 268 ms | 100% | 287 |
| 26 | nscale | 237 ms | 249 ms | 100% | 288 |
| 27 | featherless | 242 ms | 441 ms | 100% | 288 |
| 28 | baichuan | 245 ms | 1,005 ms | 98.3% | 288 |
| 29 | glm | 251 ms | 318 ms | 100% | 288 |
| 30 | ai21 | 257 ms | 380 ms | 100% | 288 |
| 31 | aleph-alpha | 264 ms | 347 ms | 100% | 288 |
| 32 | ernie | 271 ms | 292 ms | 100% | 288 |
| 33 | hyperbolic | 275 ms | 460 ms | 100% | 288 |
| 34 | kimi | 286 ms | 497 ms | 100% | 288 |
| 35 | minimax | 286 ms | 305 ms | 100% | 288 |
| 36 | DeepSeek | 321 ms | 387 ms | 100% | 287 |
| 37 | upstage | 369 ms | 919 ms | 99.7% | 288 |
| 38 | sensenova | 403 ms | 1,167 ms | 98.6% | 288 |
| 39 | iflytek | 405 ms | 1,561 ms | 98.3% | 288 |
| 40 | qwen | 420 ms | 467 ms | 100% | 288 |
| 41 | QwenCloud | 422 ms | 458 ms | 100% | 288 |
| 42 | doubao | 448 ms | 1,496 ms | 98.3% | 288 |
| 43 | stepfun | 456 ms | 1,738 ms | 99.7% | 288 |
| 44 | sarvam | 478 ms | 520 ms | 100% | 288 |
| 45 | Tencent TokenHub | 581 ms | 631 ms | 100% | 288 |
No matching providers. Try another name.
Is any AI API down right now?
2 confirmed outage(s) in the last 24 hours: sensenova, iflytek
45 providers · probed every 5 minutes from 4 regions · last probe Nov 18, 12:13 UTC
Status pages currently reporting an open incident: Anthropic (minor “Claude unable to join meetings”), OpenAI (minor “Costs API data is delayed”) — self-reported by the provider, checked Nov 18, 11:17 UTC. Our probes test the API host; errors limited to individual models are visible only to the provider.
Live status per provider: OpenAI API · Claude API (Anthropic) · Gemini API (Google) · Mistral API · DeepSeek API · xAI API · Groq API · Cerebras API · SambaNova API · Together AI API · Fireworks AI API · OpenRouter API · TypeSafe API
Endpoint availability · hourly probe results
Last 72 hours · UTC · newest time on the right · current hour is incomplete.
One row per provider. Each block shows the results of one hour’s endpoint probes, combined across regions. Adjacent hours with all successes or no data are joined.
all probes succeededsome failed (under half)half or more failedno probes recorded
Probe counts by provider
Fastest by region
Lowest typical response (p50 TTFB) · last 24 hours
Which AI API is fastest right now?
As of November 18, 2026, the fastest-responding AI inference API by edge latency (time-to-first-byte) is fireworks at 20 ms p50, measured from Asia (Tokyo) (100% uptime, n=288). Rankings differ by region.
Edge latency (TTFB) measures the network and API endpoint; inference TTFT is measured separately. Methodology