Realtime client
ElevenLabs provides customized, conversational voice agents, that can be easily integrated into your Voxipmlant applications via the WebSocket protocol. It offers a custom TTS and ASR modules, several LLMs, such as Google Gemini, Claude, OpenAI and more, and a turn talking model, which can scale to thousands of calls per day.
In this article, you will learn how to integrate ElevenLabs realtime client into your application.
Usage
- Require the
Modules.ElevenLabsmodule in your VoxEngine scenario. - Create an
ElevenLabs.ConversationalAIClientinstance and provide your parameters. - Send media between a
CallandElevenLabs.ConversationalAIClientvia the*.sendMediaorVoxEngine.sendMediaBetweenmethods. - Listen to the
ElevenLabs.ConversationalAIClientevents and implement you application business logic.
Bot audio settings
You need to specify the 16000 Hz PCM audio format on the ElevenLabs side of the bot.
Here is the complete scenario example for your reference:
Conversational AI client
If you want to use the ElevenLabs.conversationInitiationClientData method, you should allow the override functionality:
conversationInitiationClientData usage example