Skip to content

Commit 804bf0a

Browse files
authored
Merge pull request #549 from future-agi/doc/voice-observe
voice observability doc
2 parents 7f4f3a0 + 8258be6 commit 804bf0a

6 files changed

Lines changed: 111 additions & 128 deletions

File tree

src/lib/navigation.ts

Lines changed: 2 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -198,14 +198,8 @@ export const tabNavigation: NavTab[] = [
198198
{ title: 'Group Traces by Session', href: '/docs/observe/features/session' },
199199
{ title: 'Users', href: '/docs/observe/features/users' },
200200
{ title: 'Alerts & Monitors', href: '/docs/observe/features/alerts' },
201-
{ title: 'Dashboards', href: '/docs/observe/features/dashboard' },
202-
]
203-
},
204-
{
205-
title: 'Voice Observability',
206-
items: [
207-
{ title: 'Overview', href: '/docs/observe/voice' },
208-
{ title: 'Set Up Voice Observability', href: '/docs/observe/voice/set-up' },
201+
{ title: 'Annotation Queue Using SDK', href: '/docs/observe/features/annotation-queue-using-sdk' },
202+
{ title: 'Voice Observability', href: '/docs/observe/features/voice' },
209203
]
210204
},
211205
{

src/pages/docs/integrations/index.mdx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,8 +55,8 @@ The Langfuse card above is for SDK-level tracing integration (sending new traces
5555
<CardGroup cols={2}>
5656
<Card title="LiveKit" href="/docs/integrations/traceai/livekit" />
5757
<Card title="Pipecat" href="/docs/integrations/traceai/pipecat" />
58-
<Card title="VAPI" href="/docs/observe/voice/set-up" />
59-
<Card title="Retell" href="/docs/observe/voice/set-up" />
58+
<Card title="VAPI" href="/docs/observe/features/voice" />
59+
<Card title="Retell" href="/docs/observe/features/voice" />
6060
</CardGroup>
6161

6262
### Other
Lines changed: 106 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,106 @@
1+
---
2+
title: "Voice Observability"
3+
description: "Connect a voice provider (Vapi, Retell) and get call logs as traces in Observe without any SDK instrumentation."
4+
---
5+
6+
7+
## About
8+
9+
Voice agents are hard to debug. Conversations happen in real time, across multiple turns, and when something goes wrong you usually find out from a user complaint, not a log. **Voice observability** fixes this by pulling call logs from your voice provider into Observe automatically. No SDK or code changes needed. Connect a provider (Vapi, or Retell) using its API key and assistant ID, and every call shows up as a trace with its transcript, recording URLs, cost, and duration. From there you can run [evaluations](/docs/observe/features/evals), set [alerts](/docs/observe/features/alerts), search, filter, and export, the same way you would with any other trace.
10+
11+
<iframe
12+
className="w-full aspect-video rounded-xl"
13+
src="https://www.youtube.com/embed/9XHrT2VFbjQ"
14+
title="YouTube video player"
15+
frameBorder="0"
16+
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture"
17+
allowFullScreen
18+
></iframe>
19+
---
20+
21+
## When to use
22+
23+
- **Visibility into voice agent calls**: See all conversations for a voice agent in one project without adding SDK instrumentation.
24+
- **Evaluate voice conversations**: Run evals (quality, bias, adherence) on conversation spans from voice calls.
25+
- **Alerts on voice metrics**: Set monitors on voice project metrics and get notified when something degrades.
26+
- **Transcripts and recordings for debugging**: Access transcript and recording URLs from the trace view.
27+
- **Multiple voice providers**: Support for Vapi, Retell so you can monitor agents regardless of provider.
28+
29+
---
30+
31+
## How to
32+
33+
<Steps>
34+
<Step title="Get provider credentials">
35+
From your voice provider's dashboard, obtain:
36+
- **API key**
37+
- **Assistant ID** (or agent ID)
38+
39+
These are required when observability is enabled. Supported providers: [Vapi](https://dashboard.vapi.ai), [Retell](https://www.retellai.com/).
40+
</Step>
41+
42+
<Step title="Create an agent definition with observability">
43+
Go to the **Agent definition** section and click **Create agent definition**.
44+
![Agent definition list](/screenshot/product/observe/voice/agent_definition_list.png)
45+
46+
Fill in agent name, provider, and other required fields. The API key and Assistant ID are masked for security.
47+
![Create agent definition form](/screenshot/product/observe/voice/agent_definition_filled.png)
48+
49+
Check **Enable Observability**. The API key and Assistant ID are required only if observability is enabled.
50+
![Agent definition details](/screenshot/product/observe/voice/agent_definition_details.jpeg)
51+
52+
Click **Create**. You are redirected to the agent list where the new agent is now visible.
53+
![Agent definition list with new agent](/screenshot/product/observe/voice/agent_definition_list_with_new.jpeg)
54+
</Step>
55+
56+
<Step title="View call logs in Observe">
57+
Open the **Projects** tab. A project with the same name as your agent lists all call logs.
58+
![Projects list](/screenshot/product/observe/voice/project_list.png)
59+
60+
Open the project to see the voice observability table (calls with status, duration, cost).
61+
![Voice observability table](/screenshot/product/observe/voice/voice_observability_table.png)
62+
63+
Click a call to open the detail drawer (transcript, recording URLs, call data).
64+
![Call log detail drawer](/screenshot/product/observe/voice/call_log_detail_drawer_marked.jpeg)
65+
</Step>
66+
67+
<Step title="Update or disable observability">
68+
Click an agent definition to open the edit form. You can edit any field.
69+
70+
- If you **disable** observability, the API key and Assistant ID become optional.
71+
- If you **enable** observability (or keep it on), API key and Assistant ID are required.
72+
73+
<Tabs>
74+
<Tab title="Observability disabled">
75+
![Agent with observability disabled](/screenshot/product/observe/voice/agent_update_observability_disabled.png)
76+
</Tab>
77+
<Tab title="Observability enabled">
78+
![Agent with observability enabled](/screenshot/product/observe/voice/agent_update_observability_enabled.png)
79+
</Tab>
80+
</Tabs>
81+
</Step>
82+
</Steps>
83+
84+
## Supported providers
85+
86+
- [Vapi](https://dashboard.vapi.ai)
87+
- [Retell](https://www.retellai.com/)
88+
89+
---
90+
91+
## Next Steps
92+
93+
<CardGroup cols={2}>
94+
<Card title="Set Up Observability" icon="play" href="/docs/observe/features/quickstart">
95+
Connect the SDK and start capturing traces.
96+
</Card>
97+
<Card title="Run Evals on Traces" icon="chart-line" href="/docs/observe/features/evals">
98+
Run evaluations on your traced spans to score quality.
99+
</Card>
100+
<Card title="Alerts & Monitors" icon="zap" href="/docs/observe/features/alerts">
101+
Get notified when metrics cross a threshold.
102+
</Card>
103+
<Card title="Users" icon="tags" href="/docs/observe/features/users">
104+
View activity and metrics per end user.
105+
</Card>
106+
</CardGroup>

src/pages/docs/observe/index.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ It tracks every response your application generates, groups them by session and
3939
<Card title="Alerts & Monitors" icon="zap" href="/docs/observe/features/alerts">
4040
Configure alerts for real-time issue detection.
4141
</Card>
42-
<Card title="Voice Observability" icon="plug" href="/docs/observe/voice">
42+
<Card title="Voice Observability" icon="plug" href="/docs/observe/features/voice">
4343
Monitor voice agent interactions and call quality.
4444
</Card>
4545
</CardGroup>

src/pages/docs/observe/voice/index.mdx

Lines changed: 0 additions & 36 deletions
This file was deleted.

src/pages/docs/observe/voice/set-up.mdx

Lines changed: 0 additions & 81 deletions
This file was deleted.

0 commit comments

Comments
 (0)