Reference
Wire Protocol — Socket.IO + WebRTC Reference
This is the complete, verified map of every event, payload, config, and flow on the two channels that power the interactive live avatar. Those two channels are the Socket.IO control plane and the two WebRTC peer connections (ASR mic-uplink + STV video-downlink).
This is the deep reference behind Platform Overview → "Video Runtime Protocol". Read ARCHITECTURE.md first for the big picture. Come back to the pages below when you need an exact event field, the exact ICE config, or the exact order events fire.
| Doc | Covers |
|---|---|
| Wire Protocol · Connection Basics | Channels at a glance, the Socket.IO connection, and a pointer to the connect sequence |
| Wire Protocol · Events Catalog | The full Socket.IO events catalog: client→server emits, server→client events, the agent_raw_text.delta agent stream, and speechId grouping |
| Wire Protocol · Audio Channels | The ASR uplink (pc1) and STV downlink (pc2) WebRTC peer connections, TURN and ICE options, WHEP signaling |
| Wire Protocol · Client Configuration | clientConfiguration fields and structured experiences (force_experience + unisphere-tool) |
| Wire Protocol · End-to-End Turn | A full turn trace, event by event, plus how to reproduce/re-capture your own |
