Skip to content

docs: Document dynamic model fetching feature #12468

@continue

Description

@continue

Summary

Recently merged PR #12046 added support for dynamically fetching provider models. This feature needs documentation.

Feature Details (from PR #12046)

  • Unified dynamic model fetching across providers via a core models/fetch protocol
  • Auto-loads models from ollama and openrouter providers
  • Refresh button appears after entering API key to fetch provider models
  • Merges and de-duplicates fetched models with hardcoded ones
  • Persists contextLength, maxTokens, and capabilities to config.yaml when adding a model
  • Supports anthropic, gemini, ollama, openrouter, and providers using listModels()

Suggested Documentation

  • Add a section in /docs/customize/models.mdx or a new guide explaining:
    • How to use the dynamic model fetching feature
    • Which providers support dynamic fetching
    • How the refresh button works in the GUI
    • What model properties are automatically detected and saved

Related

Generated with Continue

Co-Authored-By: Continue noreply@continue.dev
Co-authored-by: bekahhw rhawrot@gmail.com

Metadata

Metadata

Assignees

Labels

area:docsRelates to documentationarea:integrationIntegrations (context providers, model providers, etc.)kind:enhancementIndicates a new feature request, imrovement, or extension

Type

No type
No fields configured for issues without a type.

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions