Challenge
Red Bull E-Sports Studio needed AR graphics in broadcast without $100k+ tracking rigs. Unity had no live broadcast support, so everything from frame-sync, camera tracking, keying, lighting—had to be engineered.
Approach
Developed a custom rendering PC with camera-to-engine sync (frame rate + shutter), tracker-to-camera offset calibration (Vive), and chroma-key output for live mixing. Injected the broadcast feed back into Unity as a render texture for reflections, and matched virtual lighting to the set with a custom reflection probe. Added runtime scene-edit tools: manipulate objects in VR with controllers. Built composition tools to lock 3D scenes to the real world for reliable AR placement.
Outcome
Delivered a reusable AR broadcast platform used live on Fox Sports 1, Red Bull TV, and Beyond The Summit (millions of Twitch viewers), enabling premium AR on commodity hardware.
Media
Clips and captures
