如何配置本地私有模型？本地运行是否有像dashboard一样的可视化界面

[sunhao-Y]

1、如何配置本地私有模型？即自己指定base url为localhost，而不是各种llm供应商
2、本地运行是否有像dashboard一样的可视化界面

[SuyashR25]

You can add these lines at the start of your code (after importing litellm, os, dotenv)

litellm.api_base = "YOUR_LOCAL_ENDPOINT_URL"
litellm.api_key = "YOUR_LOCAL_KEY"
litellm.drop_params = True
os.environ["SSL_VERIFY"] = "0"