Unreal Engine technology for rendering synchronized content across multiple displays in virtual production LED volumes – manages cluster rendering, frustum warping, and camera tracking integration for in-camera visual effects (ICVFX) in film and broadcast.
What is nDisplay?
nDisplay is an Unreal Engine technology for synchronized multi-display rendering. It enables the display of virtual environments on LED volumes for In-Camera Visual Effects (ICVFX) in film and broadcast productions.
Basic Principle
| Aspect | Description |
|---|---|
| Engine | Unreal Engine |
| Function | Multi-Display Synchronization |
| Application | LED Volume, ICVFX |
| Core | Cluster Rendering |
Main Functions
| Function | Description |
|---|---|
| Cluster Rendering | Multiple GPUs synchronized |
| Frustum Tracking | Perspective follows camera |
| Warping | Distortion correction |
| Genlock | Frame synchronization |
Architecture
| Component | Role |
|---|---|
| Primary Node | Master control |
| Render Nodes | GPU cluster |
| nDisplay Config | Setup definitions |
| Sync | Timecode/Genlock |
Cluster Setup
| Element | Description |
|---|---|
| Viewports | Defined screen areas |
| Projection | Camera frustum matching |
| Overlap | Edge blending |
| Resolution | Per display segment |
Frustum Rendering
| Aspect | Description |
|---|---|
| Inner Frustum | Camera-visible area |
| Outer Frustum | Environment/Reflections |
| Tracking Data | Position, Rotation, Lens |
| Real-Time | < 10ms latency |
Hardware Requirements
| Component | Specification |
|---|---|
| GPUs | NVIDIA Quadro/RTX |
| Network | 10GbE minimum |
| Sync | NVIDIA Quadro Sync II |
| Nodes | Per LED section |
Typical Setup
| Size | Nodes | GPUs |
|---|---|---|
| Small | 2-4 | 4-8 |
| Medium | 6-10 | 12-20 |
| Large | 12-20+ | 24-40+ |
Integration
| System | Connection |
|---|---|
| Motion Capture | Position/Rotation |
| Camera Tracking | Mo-Sys, Ncam, Stype |
| LED Processor | Brompton, Megapixel |
| DMX | Lighting control |
Camera Tracking
| System | Description |
|---|---|
| Mo-Sys StarTracker | Infrared ceiling |
| Ncam | Marker-based |
| Stype | Sensor fusion |
| OptiTrack | Mocap-based |
Configuration
| File | Content |
|---|---|
| nDisplay Config | Cluster topology |
| Viewport Config | Display mapping |
| Projection Policy | Render settings |
| Calibration | Geometry correction |
Workflow
| Step | Description |
|---|---|
| 1 | Create config |
| 2 | Set up nodes |
| 3 | Calibration |
| 4 | Tracking integration |
| 5 | Load content |
Live Features
| Feature | Description |
|---|---|
| LiveLink | Tracking data stream |
| Remote Control | Parameter changes |
| Switchboard | Multi-user setup |
| Take Recorder | Performance capture |
ICVFX Specifics
| Element | Description |
|---|---|
| Color Correction | Per-display grading |
| Light Cards | Virtual light sources |
| Stage Geometry | LED wall mapping |
| Occlusion | Foreground masking |
Performance
| Aspect | Target |
|---|---|
| Framerate | 23.98-120 fps |
| Latency | < 2 frames |
| Sync | Frame-accurate |
| Resolution | 4K+ per viewport |
Challenges
| Problem | Solution |
|---|---|
| Latency | Optimized rendering |
| Sync drift | Genlock system |
| Calibration | Precise measurement |
| Content | LOD management |
Competition
| System | Manufacturer |
|---|---|
| nDisplay | Epic Games |
| Disguise | Disguise |
| TouchDesigner | Derivative |
| Notch | Notch |
Best Practices
| Practice | Reason |
|---|---|
| Dedicated nodes | Stable performance |
| Isolate network | No interference |
| Backup config | Quick recovery |
| Testing | Complete before shoot |
Today
nDisplay is the standard technology for Unreal Engine-based virtual production. The ability to render photorealistic environments synchronized on LED volumes has revolutionized film production. Projects like The Mandalorian have brought nDisplay and similar technologies into the mainstream.