Reference
Wire Protocol — Socket.IO + WebRTC Reference
This is the complete, verified map of every event, payload, config, and flow on the two channels that power the interactive live avatar. Those two channels are the Socket.IO control plane and the two WebRTC peer connections (ASR mic-uplink + STV video-downlink).
This is the deep reference behind Platform Overview → "Video Runtime Protocol". Read ARCHITECTURE.md first for the big picture. Come back to the pages below when you need an exact event field, the exact ICE config, or the exact order events fire.
| Doc | Covers |
|---|---|
| Wire Protocol · Connection Basics | Provenance/components, channels at a glance, the Socket.IO connection, the connect sequence (state-machine order) |
| Wire Protocol · Events Catalog | The full Socket.IO events catalog: client→server emits, server→client events, the agent_raw_text.delta brain stream, speechId/barge-in |
| Wire Protocol · Audio Channels | The ASR uplink (pc1) and STV downlink (pc2) WebRTC peer connections, ICE config, WHEP signaling |
| Wire Protocol · Client Configuration | clientConfiguration fields and structured experiences (force_experience + unisphere-tool) |
| Wire Protocol · End-to-End Turn | A full turn trace, event by event, plus how to reproduce/re-capture your own |