feat(deepinfra): update model YAMLs [bot]#1736
Conversation
|
/test-models |
![cursor[bot]](https://avatars.githubusercontent.com/in/1210556?s=60&v=4){kind=small}
Gateway test results
Failures (2)
ErrorCode snippetfrom openai import OpenAI
client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")
response = client.chat.completions.create(
model="test-v2-deepinfra/ByteDance-Seed-2.0-code",
messages=[
{"role": "user", "content": "List 3 colors with their hex codes in JSON."},
],
response_format={"type": "json_object"},
stream=True,
)
import json as _json
_accumulated = ""
for chunk in response:
if chunk.choices and len(chunk.choices) > 0:
delta = chunk.choices[0].delta
if delta.content is not None:
_accumulated += delta.content
print(delta.content, end="", flush=True)
if not _accumulated:
raise Exception("VALIDATION FAILED: json-output stream - no content received")
_json.loads(_accumulated)
print("\nVALIDATION: json-output stream SUCCESS")
ErrorCode snippetfrom openai import OpenAI
client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")
response = client.chat.completions.create(
model="test-v2-deepinfra/ByteDance-Seed-2.0-code",
messages=[
{"role": "user", "content": "List 3 colors with their hex codes in JSON."},
],
response_format={"type": "json_object"},
stream=False,
)
import json as _json
_content = response.choices[0].message.content
print(_content)
if not _content:
raise Exception("VALIDATION FAILED: json-output - response content is empty")
_json.loads(_content)
print("VALIDATION: json-output SUCCESS")Successes (16)
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
OutputSkipped (2)
Skip reason
Skip reason |
|
/test-models |
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.
There are 2 total unresolved issues (including 1 from previous review).
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit d96a58d. Configure here.
Gateway test results
Failures (2)
ErrorCode snippetfrom openai import OpenAI
client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")
response = client.chat.completions.create(
model="test-v2-deepinfra/ByteDance-Seed-2.0-code",
messages=[
{"role": "user", "content": "List 3 colors with their hex codes in JSON."},
],
response_format={"type": "json_object"},
stream=True,
)
import json as _json
_accumulated = ""
for chunk in response:
if chunk.choices and len(chunk.choices) > 0:
delta = chunk.choices[0].delta
if delta.content is not None:
_accumulated += delta.content
print(delta.content, end="", flush=True)
if not _accumulated:
raise Exception("VALIDATION FAILED: json-output stream - no content received")
_json.loads(_accumulated)
print("\nVALIDATION: json-output stream SUCCESS")
ErrorCode snippetfrom openai import OpenAI
client = OpenAI(api_key="***", base_url="https://internal.devtest.truefoundry.tech/api/llm")
response = client.chat.completions.create(
model="test-v2-deepinfra/ByteDance-Seed-2.0-code",
messages=[
{"role": "user", "content": "List 3 colors with their hex codes in JSON."},
],
response_format={"type": "json_object"},
stream=False,
)
import json as _json
_content = response.choices[0].message.content
print(_content)
if not _content:
raise Exception("VALIDATION FAILED: json-output - response content is empty")
_json.loads(_content)
print("VALIDATION: json-output SUCCESS")Successes (16)
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
OutputSkipped (2)
Skip reason
Skip reason |
|
/test-models |
|
/test-models |
Gateway test results
Successes (12)
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
OutputSkipped (2)
Skip reason
Skip reason |
Gateway test results
Successes (12)
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
Output
OutputSkipped (2)
Skip reason
Skip reason |
2 participants
Auto-generated by poc-agent for provider
deepinfra.Note
Low Risk
Metadata-only catalog updates with no runtime or pricing changes.
Overview
Adds
deprecationDate: "2026-07-16"to the DeepInfra catalog entries formeta-llama/Meta-Llama-3.1-8B-Instructandnvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning. No pricing, limits, features, orstatusfields change in this diff—only the scheduled deprecation metadata is introduced.Reviewed by Cursor Bugbot for commit 0262475. Bugbot is set up for automated code reviews on this repo. Configure here.