Broadcast News

Bookmark and Share

What's New For Photorealistic Virtual Reality – Tell Me It's Not Real

News Image
What would you think if you were able to create, in real-time, photorealistic scenes adding green screen shots of talents and augmented reality graphics, then mix them all together so seamlessly that the audience could not tell which are real and which are not?

You will probably think that people are already used to visual effects, and that achieving such results is a common task in today's film making. However, for live, on-air broadcast operation, photorealism is one of the toughest challenges, if we are thinking on real-time virtual set production, because what really makes the difference for the viewers is to be unable to tell whether the images they are watching are real videos or digital renders.

Creating such realism requires the combination of a number of technologies, hardware and software. Camera tracking is almost mandatory to perfectly match the camera movements of the scene and the characters, while allows shooting the talents as required. But also, the background scenes must have an extremely high render quality, which can only be achieved using hyper realistic rendering technology and carefully designed sets to create photorealistic images. Thanks to its Combined Render Engine, InfinitySet can combine the Epic Games' Unreal engine with Brainstorm's own eStudio render engine, resulting in a perfect solution to create state-of-the-art hyper realistic scenes, which can also integrate essential elements for broadcast operation, such as 3D data-driven motion graphics, charts and many other, providing results which are indistinguishable to real footage, no matter if we are working in HD, 4K or even higher resolutions.

Amazingly enough, InfinitySet not only matches the tracking data of any number of cameras in the scene with the real-time rendered Unreal background, but also controls the parameters of the real lights or the Chroma Keyer as the set conditions require such changes. For instance, if the talent is walking around the green screen and the light conditions change in the virtual set, InfinitySet can tell the real lights on the green studio to change accordingly, and also remotely alter the Chroma keyer settings to maintain the best quality, even when using external hardware. Because of this, InfinitySet can simulate different conditions of the day, different lights, different ambiences, using a single scenario, in real-time and with full control, and even adding volumetric illumination.

Another interesting feature is InfinitySet's ability to cast virtual shadows over the real chroma keyed shadows. These virtual shadows depend on the virtual scene illumination and can affect the virtual elements. On top of that, InfinitySet is also capable of creating accurate selective defocus and bokeh, matching the depth of field of the lenses on a given scene. All of the above adds up to the advanced features which make InfinitySet the most advanced virtual set and Augmented Reality solution: TrackFree™, TeleTransporter, 3D Presenter or VideoGate, to name just a few.

Once the scene is solved, it is also important to understand that Broadcast graphics workflows have specific requirements that are far beyond from what a game engine can do, often requiring external database connections, statistics, tickers, social media or lower-thirds, such a variety of graphics that are alien to the game engine framework but essential for broadcast operation. With the Combined Render Engine, InfinitySet can effortlessly integrate Aston graphics as Augmented Reality objects within the scene, with a render quality that matches that of the Unreal Engine by using Brainstorm's PBR (Physically Based Rendering) rendering capabilities. This allows for adding advanced audio-visual aids such as in-context typography, motion graphics, statistics, charts and many more, all perfectly integrated in the composition both in animation, tracking, perspective matching and of course image quality.

With all the above, InfinitySet's advanced virtual technology represents a real cost-saving solution, as it provides new possibilities for production houses and broadcasters for creating different scenes and environments, no matter if we are talking about sitcoms, news, sports or entertainment shows. Also, this approach avoids one of the common complaints broadcasters have when using virtual technology, that is the quality of the virtual sets, so it makes this technology a real alternative to remote live outdoor shooting or physical set construction.

Author: Miguel Churruca, Marketing and Communications Director, Brainstorm

This article is also available in the May edition of Broadcast Film & Video.
Solidmate Ltd Memory Card Hire London

Top Related Stories
Click here for the latest broadcast news stories.

Channel 4 Breached Conditions Of Its Broadcast Licence - Ofcom
An Ofcom investigation has found Channel 4 breached the conditions of its broadcast licence following an extended outage of its subtitling, signing an
Brainstorm Announce NAB InfinitySet Showcase
Brainstorm has announced that it will showcase the new version of InfinitySet, its award-winning Augmented Reality and Virtual Set solution, at NAB 20
Videosys Broadcast Unveils Epsilon 4K Base Station CCU
Broadcast engineers can now streamline their workflow with a new tool from Videosys Broadcast, a leading manufacturer and supplier of quality camera c
Advanced Rendering For Augmented Reality Applications
Virtual Reality (VR) can be defined as the method to display synthetic images along with real ones, explains Miguel Churruca, Marketing and Communicat
Production News : WWII Drama Scenes Filmed In Bristol
Princes Wharf in Bristol is set to hit cinema screens later this month with the UK premiere of British World War II film, Another Mother's Son. Suppor
Production News : BBC Taster Unveils New Virtual Reality App
BBC Taster has today launched a new virtual reality app. The app is available for free on Android and iOS and includes content from BBC Three and Plan
Brainstorm To Exhibit Virtual Sets And Motion Graphics Solutions At IBC 2017
Brainstorm will be exhibiting at IBC 2017 and showcasing the latest versions of its product line of virtual sets and motion graphics solutions. Also,
Lawo Adds SIP to RƎLAY Virtual Radio Mixer Software
Lawo's RƎLAY Virtual Radio Mixer software has been upgraded with the ability to use SIP streams as on-the-air audio sources, as well as several o
NewTek Make IP-Based Sports Production A Reality
NewTek have announced the introduction of the NewTek 3Play® 3P1 – the most cost-effective, easy-to-use and feature-rich replay solution in the world w
Production News : BBC Three Announce New Holiday Reality Show
BBC Three has announced a new series following young Britons on a "holiday of a lifetime" with 'Croatia 2017: The Brits Are Coming'. BBC Three will be
Maverick TV Selects Canon For Reality Series
Maverick TV has utilised a Canon kit on the new reality television series Escape for Channel 4. Maverick TV selected a range of Canon's broadcast equi
Zero Density Reality Technology Powers Winner Of IBC 2017 Innovation Award
At NAB 2016, a chance meeting between virtual studio company Zero Density and Groupe Média TFO, a public media organisation created by the government
Lanterna Magica's reality cuts production time and expense of reality TV
Lanterna Magica, the video indexing and logging specialist, has announced the launch of Reality, an innovative new system that greatly streamlines the
PROVYS Turns Virtual Poland Into Reality
Wirtualna Polska (Virtual Poland, in English), the leading Polish news and information portal, have recently decided to expand into television and hav
Sky Launches New Virtual Reality App
Sky has launched a new app, Sky Virutal Reality (VR). The app, which is available to download free, features a range of immersive, 360-degree videos f