Digital elements overlay live camera feed in real time — applied in viewfinder or post on footage. Eliminates green screen for live broadcast compositions.
If you're broadcasting live or shooting documentary footage and suddenly want to overlay a graphic, a 3D figure, or a map directly onto the live image — without having set up a green screen — you're working with Augmented Reality. The system captures your real environment via tracking markers or GPS data and renders digital objects in real-time over the camera feed. Unlike Virtual Reality, the viewer isn't in a completely synthetic world; they see their normal environment with overlaid elements.
In live practice, this happens directly in the viewfinder or on the on-air feed. Broadcast stations for weather, sports, and news have been using this for a long time — the meteorologist stands in front of their green screen, but in the final product, the viewer sees them in front of a photorealistic weather map. That's AR. For this, you need a tracking system (motion capture, camera tracking, or marker-based tracking), specialized software like Unreal Engine with Live Link, or proprietary systems like Vizrt or Ross OverDrive, and extremely stable network latency. A frame delay of more than 100 milliseconds destroys credibility — the digital content then visibly 'floats' behind.
In post-production, you also use AR-like techniques downstream. After shooting, tracking data is extracted from the camera movement (3D tracking, rotoscoping), and then you overlay your digital assets onto the footage with correct perspective. This is less true AR — more digital compositing with AR-like principles. The advantage over classic green screen: you don't need a production environment with a screen, no complex lighting adjustments, you simply shoot a normal location and overlay later.
Practical tip: AR tracking needs anchors — points or surfaces to which the system can geometrically 'attach'. In news studios, these are specially marked walls; for mobile use (reports from the field), you use GPS or Natural Feature Tracking, which recognizes the existing structures of the environment. The more structured and constant your environment, the more stable the system runs. Motion tracking in chaotic outdoor scenes is still a challenge — the CPU and GPU load is considerable.