Broadcast News

Bookmark and Share
07/06/2017

Advanced Rendering For Augmented Reality Applications

News Image
Virtual Reality (VR) can be defined as the method to display synthetic images along with real ones, explains Miguel Churruca, Marketing and Communications Director, Brainstorm.

Some have started to talk about Mixed Reality, understood as the combination of virtual and real environments which, in essence, is yet another way to define Virtual Reality or Augmented Reality. Others use "Enhanced Reality" to define any of the above "realities", where real footage or live videos are mixed with virtual backgrounds or scenes, chroma keyed talents and additional broadcast graphics or data-driven objects.

But regardless how we call it, when facing an Augmented/Mixed Reality project, the integration between the real and virtual objects and environments becomes essential, so the next step in virtual set production and Augmented Reality applications is to increase the realism of the content. This not only involves high quality rendering, but also requires perfect integration between the different elements of the scene to provide a sense of realism, with precise perspective matching and correct broadcast continuity.

Photorealistic results can be achieved using advanced imaging and rendering techniques such as HDR (High Dynamic range), PBR (Physically Based Rendering) or using specialised render engines like Unreal Engine. Gaming engines achieve excellent rendering results for backgrounds and scenes, allowing for realistic results, but Augmented Reality broadcast applications also require the interaction between sets, talents and virtual objects, many of them created out of external data sources such as statistics, charts, bars, and many others. These allow for visually engaging representations of the data, which can then be better explained by the presenters placed on the set.

All Brainstorm products run on the eStudio render engine, considered the fastest in the industry. Additionally, Brainstorm supports gaming and architectural engines such as Unreal Engine. These highly complex engines provide realistic scenes with great possibilities, and played along with the eStudio render engine allows InfinitySet not only to show excellently rendered realistic background scenes, but also to integrate graphics elements in the final scene, like 3D motion graphics, lower-thirds, tickers, CG and many other elements. With the inclusion of these graphic elements, the scene can result in a highly complex composition, seamlessly integrating in real-time different render engines, virtual 3D backgrounds, real characters and synthetic graphics elements.

Brainstorm's approach to external render engine support is unique in the industry, as it allows control of Unreal engine's parameters from InfinitySet in real-time, and allows merging of both engines' render parameters and buffers to make them work as a single render engine (Combined Render Engine). This greatly simplifies the setup, as a single engine can handle all requirements and elements in the scene: chroma keyed talent, virtual set background, real footage and broadcast graphics. InfinitySet can control, from its own GUI, many Unreal Engine's Scenegraph parameters, including cameras, geometry or object visibility. This integration allows Unreal Engine's scene objects to be managed directly from InfinitySet, which can then add the chroma keyed talent and the data-driven graphics to complete the real-time output.

In addition, new InfinitySet features like VirtualGate allow for integrating the presenter not only in the virtual set but also inside additional content, so the talent in the virtual world to be "tele-transported" to any video with full broadcast continuity. This means that a presenter in the virtual set can walk into a virtual screen or into the featured news (which can be shown on a virtual videowall or similar) and become part of the video itself with full realism. The talent enters and exits the video with full precise and accurately matched perspective, and once inside the clip it behaves correctly in terms of spatial reference while adding true shadows, selective defocus and bokeh, etc.

VirtualGate extends the virtual scenario beyond the virtual set and creates an infinite world for the presenters to be in, allowing for better real-time content possibilities and interaction. So, the presenter on the set, for instance, can walk into a sports event with full broadcast continuity (without editing, cuts or multi-camera production), remotely walk on the field, explain whatever is required while being perfectly matched in the video regardless the movement difference between shots, and finally return to the set as if the camera was shooting a sequence shot.

www.brainstorm3d.com

This article is also available to read in the June edition of Broadcast Film & Video.

(JP/LM)
Solidmate Ltd Memory Card Hire London

Top Related Stories
Click here for the latest broadcast news stories.

23/10/2019
Matthews Redefines Rugged Movement On-Set With Rock n' Rollers Wheel Sets
Matthews Studio Equipment turns 50 this year and like any spry 50-year-old, they're thinking about ways prevent back ache. To help their contemporary
23/09/2019
ERA Teams Up With On-Set Tech
ERA has announced it is working with On Set Tech on the dailies and DIT (Digital Imaging Technicians) specialists recently opened facility. Work began
09/10/2019
Production News : Melanie Leach And Andrew MacKenzie To Set Up South Shore
Melanie Leach, CEO Twofour and Andrew MacKenzie, CCO, are in the concluding phase of talks that will see ITV Studios take a minority stake in their ne
15/12/2017
NewTek Make IP-Based Sports Production A Reality
NewTek have announced the introduction of the NewTek 3Play® 3P1 – the most cost-effective, easy-to-use and feature-rich replay solution in the world w
15/08/2017
Production News : BBC Three Announce New Holiday Reality Show
BBC Three has announced a new series following young Britons on a "holiday of a lifetime" with 'Croatia 2017: The Brits Are Coming'. BBC Three will be
17/10/2017
Maverick TV Selects Canon For Reality Series
Maverick TV has utilised a Canon kit on the new reality television series Escape for Channel 4. Maverick TV selected a range of Canon's broadcast equi
27/09/2017
Zero Density Reality Technology Powers Winner Of IBC 2017 Innovation Award
At NAB 2016, a chance meeting between virtual studio company Zero Density and Groupe Média TFO, a public media organisation created by the government
07/07/2017
Production News : BBC Taster Unveils New Virtual Reality App
BBC Taster has today launched a new virtual reality app. The app is available for free on Android and iOS and includes content from BBC Three and Plan
10/05/2018
What's New For Photorealistic Virtual Reality – Tell Me It's Not Real
What would you think if you were able to create, in real-time, photorealistic scenes adding green screen shots of talents and augmented reality graphi
02/05/2017
Virtual Applications, The Cloud And IP Dominate The Playout Picture
Virtual machine level: George Jarrett talks to a service company and two vendors about the trend driving the market away from SDI. The abandonment of
29/03/2017
Brainstorm At NAB 2017
Brainstorm has announced that it will feature the latest versions of its product line of virtual sets and motion graphics solutions, as well as showca
24/04/2017
Brainstorm Announce NAB InfinitySet Showcase
Brainstorm has announced that it will showcase the new version of InfinitySet, its award-winning Augmented Reality and Virtual Set solution, at NAB 20
03/08/2017
Brainstorm To Exhibit Virtual Sets And Motion Graphics Solutions At IBC 2017
Brainstorm will be exhibiting at IBC 2017 and showcasing the latest versions of its product line of virtual sets and motion graphics solutions. Also,
27/07/2017
Lawo Adds SIP to RƎLAY Virtual Radio Mixer Software
Lawo's RƎLAY Virtual Radio Mixer software has been upgraded with the ability to use SIP streams as on-the-air audio sources, as well as several o
04/02/2019
Ross Video To Launch Virtual Studio Rendering Solution At NAB 2019
Ross Video is launching a new virtual studio rendering solution at NAB 2019. The new solution will be based on Epic Game's Unreal™ 4 gaming engine, br