Skip to content

Docs: Document dynamic model fetching feature #12467

@continue

Description

@continue

Summary

PR #12046 added support for dynamically fetching provider models, which is a significant user-facing feature with no documentation.

Feature Details

  • Users can now dynamically fetch models from providers using their API key
  • A refresh icon appears after entering an API key to "update models list using my API key"
  • Supported for:
    • Ollama (using tags API - auto-loads)
    • OpenRouter (public API - auto-loads)
    • Anthropic (/v1/models)
    • Gemini (v1beta/models)
    • Other providers via listModels() methods
  • Results include context length, max tokens, and tool use capabilities
  • Fetched models are deduplicated with hardcoded models

Documentation Needed

  1. Add a section to the Add Model documentation explaining the dynamic model fetching
  2. Document which providers support this feature
  3. Explain how the refresh button works and when it appears
  4. Document the auto-loading behavior for Ollama and OpenRouter

Related PR

Generated with Continue

Co-Authored-By: Continue noreply@continue.dev
Co-authored-by: bekahhw rhawrot@gmail.com

Metadata

Metadata

Assignees

Labels

area:docsRelates to documentationarea:integrationIntegrations (context providers, model providers, etc.)kind:enhancementIndicates a new feature request, imrovement, or extension

Type

No type
No fields configured for issues without a type.

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions