Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorrect transcription on failing audio capture #1259

Open
IngLP opened this issue Dec 19, 2024 · 0 comments
Open

Incorrect transcription on failing audio capture #1259

IngLP opened this issue Dec 19, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@IngLP
Copy link

IngLP commented Dec 19, 2024

Hi,
I want to report that when this error occurs: #863 , the WHOLE audio transcription is committed as agent speech, but NONE of that speech has been said:

2024-12-18 21:52:43,520 DEBUG livekit.agents.pipeline: speech playout started
2024-12-18 21:52:43,523 ERROR livekit.agents.pipeline: Error in _capture_task
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/livekit/agents/utils/log.py", line 16, in async_fn_logs
    return await fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/livekit/agents/pipeline/agent_playout.py", line 148, in _capture_task
    await self._audio_source.capture_frame(frame)
  File "/usr/local/lib/python3.12/site-packages/livekit/rtc/audio_source.py", line 152, in capture_frame
    raise Exception(cb.capture_audio_frame.error)
Exception: an RtcError occured: InvalidState - failed to capture frame
2024-12-18 21:52:43,543 DEBUG livekit.agents.pipeline: speech playout finished
2024-12-18 21:52:43,543 INFO voicebot.db.conversations: User speech committed: Pronto?
2024-12-18 21:52:43,543 INFO voicebot.db.conversations: Agent speech committed:  [THE WHOLE AGENT TRANSCRIPTION - but not even a single word was heard]
2024-12-18 21:52:43,543 DEBUG livekit.agents.pipeline: committed agent speech

I can live with that issue occurring sometimes, but the agent should be aware that no speech has been produced. This is causing huge problems in user interaction.

Any help?

@IngLP IngLP added the bug Something isn't working label Dec 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant