Vonage Video API + AI

Vonage Video provides APIs and SDK methods that allow you to access both the video and audio streams from a live video session. You can then modify these streams using third-party services such as AI tools.

These modifications can be made in real time within an ongoing Vonage video session. This means members of the session get to experience the modifications as they happen.

Capturing and modifying video & audio streams

The Vonage Media Processor provides you access to the live Vonage video stream which you can then funnel through third-party services to make your desired modifications.

Similarly, you can use the Audio Connector to gain access to the raw audio of a Vonage video session. You can then process the audio using third-party services like Microsoft's Azure AI Speech Service.

Check out the Related resources section below to get started.

Media Processor: Discover how to capture and modify video streams.
Audio Connector: Learn how to access and modify raw audio from live Vonage video sessions.
Blog Posts: See example tutorials on how live Vonage video sessions can be improved using AI.