Rate limits
| MODEL ID | RPM | RPD | TPM | TPD | ASH | ASD |
|---|
| compound-beta | 15 | 200 | 70,000 | - | - | - |
| compound-beta-mini | 15 | 200 | 70,000 | - | - | - |
| deepseek-r1-distill-llama-70b | 30 | 1,000 | 6,000 | - | - | - |
| distil-whisper-large-v3-en | 20 | 2,000 | - | - | 7,200 | 28,800 |
| gemma2-9b-it | 30 | 14,400 | 15,000 | 500,000 | - | - |
| llama-3.1-8b-instant | 30 | 14,400 | 6,000 | 500,000 | - | - |
| llama-3.3-70b-versatile | 30 | 1,000 | 6,000 | 100,000 | - | - |
| llama-guard-3-8b | 30 | 14,400 | 15,000 | 500,000 | - | - |
| llama3-70b-8192 | 30 | 14,400 | 6,000 | 500,000 | - | - |
| llama3-8b-8192 | 30 | 14,400 | 6,000 | 500,000 | - | - |
| meta-llama/llama-4-maverick-17b-128e-instruct | 30 | 1,000 | 6,000 | 500,000 | - | - |
| meta-llama/llama-4-scout-17b-16e-instruct | 30 | 1,000 | 6,000 | 500,000 | - | - |
| mistral-saba-24b | 30 | 1,000 | 6,000 | - | - | - |
| playai-tts | 2 | 500 | 600 | 2,000 | - | - |
| playai-tts-arabic | 2 | 500 | 600 | 2,000 | - | - |
| qwen-qwq-32b | 30 | 1,000 | 6,000 | - | - | - |
| whisper-large-v3 | 20 | 2,000 | - | - | 7,200 | 28,800 |
| whisper-large-v3-turbo | 20 | 2,000 | - | - | 7,200 | 28,800 |