Error in connecting remote user

[akaminnovations]

Log as below

ERROR - Error waiting for remote user
ERROR - Error running agent

[satizzz39]

While running python -m realtime_agent.main server, after hit [start_agent] -> (http://localhost:8080/start_agent), I'm facing issue with remote user joining in my channel.
from logs I could see my OpenAI session created, Web socket connected successfully, MY OPENAI key has right access to the model, also MY Appid, and certificate id also mentioned properly in .env file. here I attcahed some logs and traces tried in multiple ways Agora devs please help me to resolve this issue.

Python version: 3.12

agora_openai_remote_user_not_joined_traces.txt
@plutoless @digitallysavvy @LichKing-2234 @sidsharma27

cc: @akaminnovations

[digitallysavvy]

Do you see any errors on the front-end console?

[satizzz39]

@digitallysavvy , No I just run the backend server in localhost and invoked http://localhost:8080/start_agent via postman, api receives success response as "Agent Created", post that in backend console the attached error came from Agora.

[digitallysavvy]

Do you have a live user in the Agora channel?

[satizzz39]

After channel created It authorising OPENAI session are created, But conversional AI not joined in call , Even live user in the channel or not Same Timeout Issue. I tried with both

[plutoless]

@satizzz39 do you have the channel name you were using?

[satizzz39]

@plutoless , These are the channel names I passed for local host start_agent endpoint

90bb692f-1d9b-4b3a-b492-4df7d2064i2k
60bb692f-1d9b-4b3a-b492-4df7d2064i2k
test

[satizzz39]

@plutoless @digitallysavvy , Any update on this please ?

[plutoless]

hi @satizzz39 i checked the logs and it seems no user is joinning as client. this is the reason, the agent will quit if no user exists in channel for 15 seconds. which client do you use to join agora rtc?

[satizzz39]

Yes after ws scocket connected and session created, I'm expecting OPENAI gpt-4o-realtime-preview conversational AI needs to join that channel, but its not joining.
@plutoless

[plutoless]

@satizzz39 ai is joinning the channel. but you will need to have a client joinning to send voice to it.
so it's like
client -> rtc network -> python ai agent -> openai

the python ai agent joined successfully according to the logs i find for your channel. it will wait for client end user to join to talk to it and will quit if no human joins after 15 secs.

[satizzz39]

@plutoless
Even I joined as user this side from the channel, the interface given by agora for frontend testing mentined in README, https://webdemo.agora.io/basicVoiceCall/index.html, Same error I got I joined and in the channel and spoke Same issue here is the logs and traces.

App id: 99a9308db8364fe49bab7159f05c4c10
channel id: 10bb692f-1d9b-4b3a-b492-4df7d2064i2k

[plutoless]

from the logs it seems you failed to join web. could you pls take a look at the browser console logs?

[satizzz39]

@plutoless , could please check the root cause of this failure to join in channel, All I followed exact steps in documentations

[plutoless]

@satizzz39 you will need to use a token instead of your appid when you join the channel on web.
i think on console you should be able to easily generate a temp token. the error message basically tells you are not using a correct token.