Experience Composer

Overview

Experience Composer is a cloud-based service that allows to capture any publicly available website and publish it as a stream in an existing Vonage Video API session. This composed stream can be used for archive recording, broadcasting, and streaming into other interactive Vonage Video sessions, while keeping the rich UI/UX experiences of the website intact.

Use cases

Experience Composer Archive

You can use the Vonage Video archive feature to record audio and video of a Vonage Video session. However, the video layout for the composed archive is limited to supported video layout options.

You can use Experience Composer to use your site's actual layout for the archive layout:

  1. Create an Experience Composer, with the URL pointing to a web page that subscribes to the streams in a session, applying the appropriate layout.

  2. Have the Experience Composer publish the page to a stream in a new Vonage Video session.

  3. Use the Vonage Video REST API or Vonage Video server SDK method to archive the Experience Composer stream.

Set the resolution of the archive to match the resolution of the Experience Composer (which is set when you start the Experience Composer).

Experience Composer Broadcast

With the Vonage Video live streaming broadcast feature, you can broadcast a Vonage Video session to an HLS or RTMP stream. However, the video layout for a live streaming broadcast is limited to supported video layout options.

You can use Experience Composer to use your site's actual layout for the broadcast layout:

  1. Create an Experience Composer, with the URL pointing to a web page that subscribes to the streams in a session, applying the appropriate layout.

  2. Have the Experience Composer publish the page to a stream in a new Vonage Video session.

  3. Use the Vonage Video REST API or Vonage Video server SDK method to broadcast the Experience Composer stream to an HLS or RTMP stream.

Set the resolution of the archive to match the resolution of the Experience Composer (which is set when you start the Experience Composer).

Expand live interactive broadcasts to include more participants (up to millions)

Vonage Video live streaming broadcasts let you up to 15,000 clients view an interactive Vonage Video session. The number supported depends on the number of clients publishing streams in the session (see the Live interactive broadcasts guide).

You can use Experience Composer to expand the number of viewers:

  1. Create an Experience Composer, with the URL pointing to a web page that subscribes to the streams in the main Vonage Video session to be broadcast.

  2. Have the Experience Composer publish the page to a new Vonage Video session.

  3. Repeat this with a number of other Experience Composer instances — each subscribing to the streams in the first session and publishing them to a new session.

  4. Your application server will send the session IDs for the Experience Composer sessions to each of the viewing clients (clients that are not publishing to the first session). The application server will need to keep track of how many clients are added to each experience composer session, so that no more than 15,000 connect to any one.

The resulting array of Experience Composer sessions will support up to 15,000 * (15,000 - 2) viewers (224,970,000 viewers) when there are two publishers. For other numbers of publishers, see the table of supported clients in the Live interactive broadcasts guide, and this technique will support 15,000 * ([number supported from that table] - [number of publishers]) clients.

Experience composer

Other use cases

You can use Experience Composer to capture any web page and send it as an audio-video stream into a Vonage Video session for others to view. The page may include audio and video from sources other than Vonage Video streams. Or it may include dynamic content with complex UI layout that clients connected to the Vonage Video session can view.

Limitations

No GPU support

The Experience Composer rendering servers do not have GPU support. They are not capable of running web applications that would typically use more than 10% of the GPU running in Chrome on a desktop. If the web application you send to Experience Composer uses OpenGL (or other code that would benefit from a GPU), performance and rendering in Experience Composer may be degraded.

Routed sessions required

Experience Composer is only compatible with routed sessions (sessions that use the Vonage Video Media Router).

Server rotation

An Experience Composer ends during server rotation for the session it uses. You can restart an Experience Composer in response to server rotation notification events. See Server Rotation and Session Migration.

REST-API only

As of the time of writing the Experience Composer can be accessed only via a REST API interface. See the REST documentation for more information.

Configuring callbacks

In order to configure secure callbacks for Experience Composer webhooks please refer to this guide.

When the status of an Experience Composer changes, an HTTP POST will be delivered to the URL configured. If no callback URL is configured, no status update will be delivered. The raw data of the HTTP request is a JSON-encoded message of the following form:

{
  "id": "<experience-composer-id>",
  "sessionId": "<session-id>",
  "streamId": "<output-stream-id>",
  "status": "stopped",
  "reason": "Max duration exceeded."
}

The JSON object includes the following properties:

  • id: The unique ID for the Experience Composer.
  • sessionId: The Vonage Video session ID.
  • streamId: The ID of the composed stream being published. The streamId may not be available when the status is "failed".
  • status: The status of the Experience Composer. This property is set to one of the following:
    • "started": The Vonage Video API platform has successfully connected to the remote application server and is publishing the web view to a Vonage Video stream.
    • "stopped": The Experience Composer has stopped.
    • "failed": An error occurred and the Experience Composer could not proceed. This may occur at startup if the Vonage Video server cannot connect to the remote application server or republish the stream. It may also occur at any point during the process due to a Vonage Video API platform error.
  • reason: This field is only available when the status is either "stopped" or "failed". If the status is "stopped", the reason field will contain either "Max Duration Exceeded" or "Stop Requested." If the status is "failed", the reason field will contain "Internal server failure".

Data visualization

View data in Video Analytics Dashboard

The Video Analytics at Vonage Dashboard provides data at the API Key and Application ID level. You can navigate to it by logging into your Vonage Video API account, go to Analytics, and then Video Analytics section.

View data in Video Insights API

You can use the Insights API to view Experience Composer usage data.

The experienceComposer usage data shows the minutes published by Experience Composer.

The experienceComposerArchive and experienceComposerBroadcast usage properties are deprecated. Previously, the experienceComposer usage data did not include minutes from periods when an Experience Composer was connected to an archive or broadcast. However, this is no longer the case. (The Experience Composer Archive and Experience Composer Broadcast bundles are no longer available.).