Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More

Memberships

AI Developer Accelerator

10.8k members • Free

KubeCraft (Free)

11.1k members • Free

AndyNoCode

25.8k members • Free

1 contribution to AI Developer Accelerator
Groq- RateLimitError : tokens per minute
Hi Community, I've been trying to figure out how to set up my agents to handle Groq rate limits. However not too much luck. Error during LLM call: litellm.RateLimitError: RateLimitError: GroqException - {"error":{"message":"Rate limit reached for model `mistral-saba-24b` in organization `org_01jm5kkpbkeb7s86t477m0xj9k` service tier `on_demand` on tokens per minute (TPM): Limit 6000, Used 4747, Requested 1691. Please try again in 4.375s. Need more tokens? Upgrade to Dev Tier today at https://console.groq.com/settings/billing","type":"tokens","code":"rate_limit_exceeded"}} Agent config: max_iter=5, max_rpm=28, respect_context_window=True Any idea? 🙃
1-1 of 1
Robert Toth
1
4points to level up
@robert-toth-8854
Interested in AI development and DevOps

Active 66d ago
Joined Mar 18, 2025
Budapest
Powered by