docs(llms): add Auxen provider configuration example#5911
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (1)
📝 WalkthroughWalkthroughA new Auxen LLM provider section is added to the LLM concepts documentation, covering environment configuration, instantiation example using OpenAI-compatible endpoints, key features, and LiteLLM setup requirements. ChangesLLM Provider Documentation
Estimated Code Review Effort🎯 1 (Trivial) | ⏱️ ~3 minutes Poem
🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Adds an Auxen accordion to the Provider Configuration Examples section on `docs/en/concepts/llms.mdx`, following the same shape as the existing Fireworks AI / Nebius AI Studio entries.
Auxen hosts per-customer dedicated LLM endpoints (Llama 3.1/3.2, Qwen 2.5, Mistral, Gemma 2, Mixtral, Phi-3, Command R) with an OpenAI-compatible `/v1/chat/completions` API. Each instance is a dedicated GPU billed per-minute of runtime — no token charges, no monthly minimums.
Because Auxen instances are OpenAI-wire-compatible, the example uses LiteLLM's `openai/` model prefix with a custom `base_url` — works with the current CrewAI install.
Companion PRs (Auxen distribution series)
AI agent (Claude) assisted in drafting this PR.
Summary by CodeRabbit