You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat: Add Cerebras and Google Gemini as fallbacks for Groq
Implement intelligent fallback chain:
1. Groq (primary) - fastest, free tier
2. Cerebras (fallback 1) - fast inference
3. Google Gemini (fallback 2) - reliable
4. HuggingFace (fallback 3) - final option
Features:
- Automatic provider switching on failure
- Provider priority ordering
- Try up to 3 models for better reliability
- Improved error messages mentioning all providers
This ensures the AI always responds even if Groq is down.
0 commit comments