The latest edition of the most powerful and versatile live graphics platform in the world includes Reality Connect™ talent immersion, extended Adaptive Graphics™ workflows for video walls, and an enhanced Unreal® Engine 5.1 integration.

Bergen, Norway—31 August 2023 — Vizrt, the leader in real-time graphics and live production solutions for content creators, today announces the release of Viz Engine 5.1 which includes several leading-edge advances to live graphics workflows.

Introducing Reality Connect™

Building on the groundbreaking debut of Viz Engine 5, this version introduces Reality Connect – powered by Viz AI, marking a new era of AI-driven 3D talent immersion. Among its many anticipated uses, Reality Connect uses advanced AI algorithms to enable hyper-realistic talent immersion, including shadow casting and reflections within virtual studios and XR sets.

“Reality Connect solves the problem of people appearing to float in a virtual studio by enabling realistic shadow casting and reflections,” says Gerhard Lang, CTO at Vizrt. “Reality Connect anchors the talent within the virtual studio by utilizing virtual 3D models of the talent, which are continuously updated using Vizrt’s AI pose estimation. Our AI pose estimation operates on the same GPU and utilizes the live video feed used for keying.”

Saving on cost, Reality Connect does not require additional hardware. Presently, Reality Connect is exclusively compatible with the Viz Engine 5 native render pipeline and works in conjunction with the Precision Keyer. Reality Connect also offers the flexibility to seamlessly integrate data from any Mocap (motion capture) system, as an alternative option.

A new take on the Virtual Window for virtual studios

Vizrt’s invention of the Virtual Window™ transformed the utilization of video walls as far back as 2011, marking a significant industry shift and expanding their capabilities. This innovation serves as a fundamental component of Vizrt’s virtual studio offering.

Viz Engine 5.1 evolves the way Virtual Windows are created when using Viz Engine’s native render pipeline or Unreal’s render blade. The resulting solution takes advantage of the increased sensitivity of both new renderers to screen resolutions, and supports Vizrt’s mandate to enhance usability, particularly when working with intricate video wall configurations, such as curved surfaces and floors.

“With the updated version of the Virtual Window effect, no compromises in scene complexity and effects must be made. All shapes and forms of video walls, floors, and ceiling are covered by our new method,” adds Lang.

The combined output resolution of Vizrt’s new Virtual Window effect, video walls, ceilings, and floors can be up to four times UHD, allowing for large setups to be managed by a single Viz Engine.

reality connect

Enabling previews when working with XR sets

Previously, one of the challenges users faced when using an XR sets was the lack of a proper preview. Vizrt works with ROE Visual to combine Viz Engine 5 and GhostFrame™ to introduce a better experience that is more comfortable and natural for talent.

GhostFrame enables up to four content feeds into an LED screen – which can be individually captured by a camera. You can select which feeds are visible for the presenter and production crew and which will be your live broadcast feed. The talent can truly interact with an AR object for example, without the hazard for virtual collisions, or look directly at the video wall for markers, teleprompting cues, or when conducting a remote interview; all of which are not visible in the live
broadcast feed.

GhostFrame can also incorporate four different brandings or implement multiple video wall layouts using Viz Multiplay. Vizrt and GhostFrame partner ROE Visual will continue collaborating on the numerous creative workflows and possibilities achievable by uniting these innovative technologies.

Adaptive Graphics™ extend and adapt to video walls

Another Viz Engine 5.1 advancement is an extension of Adaptive Graphics – which now includes user-defined aspect-ratio support for video walls. Now, Adaptive Graphics can be intelligently adjusted to fit any video wall size, shape, and resolution.

By extending Adaptive Graphics’ faster and more efficient graphics production line to studio video walls, customers ensure a consistent look and unified brand identity across all platforms and displays, protecting the most vital asset of any media provider – its brand.

Viz Engine 5.1 and Unreal® Engine 5.1: The best graphics workflow in the industry

Viz Engine 5 introduced a completely new integration with Unreal Engine 5, one that addressed performance, workflow, controllability, and asset management. Viz Engine 5.1 supports both Unreal Engine 5.0 and 5.1 releases and includes nearly a dozen new advancements and features.

“Customer feedback regarding Unreal Engine 5 was a significant contributor to the development of Viz Engine 5.1. It stands as a signal to the industry that Vizrt continues to invest in this important partnership,” concludes Lang.

Beyond the features described here, Viz Engine 5.1 includes numerous improvements to the Viz Engine Renderer, the addition of Clip Player Pro as a value-added item available to Flexible Access customers, support for nearly 100 Data Connectors, and multiple Video I/O and security improvements.

Learn more about the latest version of Viz Engine by visiting: Viz Engine – Vizrt


About Vizrt:

Vizrt is the world’s leading provider of visual storytelling tools for media content creators in the broadcast, sports, digital and esports industries. Vizrt offers market-defining software-based solutions for real-time 3D graphics, video playout, studio automation, sports analysis, media asset management, and journalist story tools. Vizrt’s promise is to master complexity and maximize creativity.

More than three billion people watch stories told by Vizrt customers every day including from media companies such as CNN, CBS, NBC, Fox, BBC, Sky Group, Al Jazeera, NDR, ZDF, Network 18, Tencent, and many more. Vizrt is part of the Vizrt Group along with its sister brands, NewTek and NDI®. Vizrt follows the single purpose of this Group; more stories, better told.


About GhostFrame

GhostFrame is a powerful suite of features for virtual production and XR stages, broadcast, film, and live production. GhostFrame makes it possible to simultaneously capture multiple independent images on camera by interleaving multiple frames of different content between each regular video frame. You choose which elements are visible to the human eye and only to the camera. Combining the strengths and possibilities of LED and camera technology, GhostFrame enables creative and powerful use of video and broadcast technology. GhostFrame is a collaboration of AGS, Megapixel VR, and ROE Visual. Exclusively available for ROE Visual LED panels and Megapixel’s HELIOS LED processing, a GhostFrame license key can release this multi-patented touch of magic. For more information, please visit: