Rate limits
MODEL ID | RPM | RPD | TPM | TPD | ASH | ASD |
---|
compound-beta | 15 | 200 | 70,000 | - | - | - |
compound-beta-mini | 15 | 200 | 70,000 | - | - | - |
deepseek-r1-distill-llama-70b | 30 | 1,000 | 6,000 | - | - | - |
distil-whisper-large-v3-en | 20 | 2,000 | - | - | 7,200 | 28,800 |
gemma2-9b-it | 30 | 14,400 | 15,000 | 500,000 | - | - |
llama-3.1-8b-instant | 30 | 14,400 | 6,000 | 500,000 | - | - |
llama-3.3-70b-versatile | 30 | 1,000 | 6,000 | 100,000 | - | - |
llama-guard-3-8b | 30 | 14,400 | 15,000 | 500,000 | - | - |
llama3-70b-8192 | 30 | 14,400 | 6,000 | 500,000 | - | - |
llama3-8b-8192 | 30 | 14,400 | 6,000 | 500,000 | - | - |
meta-llama/llama-4-maverick-17b-128e-instruct | 30 | 1,000 | 6,000 | 500,000 | - | - |
meta-llama/llama-4-scout-17b-16e-instruct | 30 | 1,000 | 6,000 | 500,000 | - | - |
mistral-saba-24b | 30 | 1,000 | 6,000 | - | - | - |
playai-tts | 2 | 500 | 600 | 2,000 | - | - |
playai-tts-arabic | 2 | 500 | 600 | 2,000 | - | - |
qwen-qwq-32b | 30 | 1,000 | 6,000 | - | - | - |
whisper-large-v3 | 20 | 2,000 | - | - | 7,200 | 28,800 |
whisper-large-v3-turbo | 20 | 2,000 | - | - | 7,200 | 28,800 |