dock10 and University of York team on AI research project for Virtual Studios

~ Joint research project, awarded an R&D grant from XR Network+, will see AI researchers from the university work with virtual production experts from the Salford facility ~

14 December 2023: dock10, the UK’s leading television facility, has teamed with the University of York for a joint research project to explore how AI can tackle a major challenge for programmes filming in virtual studios – simulating realistic light interactions.

The project, which brings together leading AI researchers from the university and virtual production experts from dock10, has been awarded an embedded R&D grant from XR Network+. Led by XR Stories at the University of York, the XR Network+ project provides funding and support to researchers working in virtual production technologies, facilitating collaboration between academia and industry.

It is currently difficult to achieve realistic lighting interactions for live or ‘as live’ TV productions – including sports programmes, game shows and music performances – that film in multi-camera green screen studios. For example, an actor will not automatically cast a shadow or pick up reflections when placed into a computer-generated world. These have to be added in post-production.

In single-camera film or drama productions, these effects can be achieved with an LED volume, but this technique is not suitable for multi-camera productions which need to capture multiple angles simultaneously.

dock10 and University of York’s research project explores how AI can help simulate accurate light interactions between physical actors and virtual environments in multi-camera virtual studios. Senior University of York academics and PhD students with a track record of research in AI and digital creativity will work on the project alongside dock10’s virtual studio experts who will provide industry expertise and production workflows.

The research project aims to lay the foundations for the creation of innovative AI-powered compositing tools that ultimately will be applicable in real-time, making them suitable for live or ‘as live’ productions.

Dr. Florian Block, R&D Lead, AI & Immersive at dock10 studios and a Reader in Digital Creativity at the University of York, said: “Lighting is one of the core elements of creative expression in any TV show, but the lighting options for virtual studio productions are currently extremely constrained. That’s what makes this foundational research project so exciting. We are aiming to create a proof of concept that will ultimately lead to the development of a bespoke AI tool for delivering realistic lighting interactions in virtual studio productions in real-time.”

Richard Wormwell, dock10 Head of Production Innovation, said: “dock10 is the UK leader in virtual studios production and the University of York is the UK leader for research into digital creativity. We are combining our industry and academic expertise to try to crack one of the great challenges for virtual studio productions. To do so, we are exploring innovative, AI driven solutions that have the potential to radically improve virtual production workflows. We are hugely excited to see where this research project might lead.”

SCROLL POSTS

A Few Kind Words...

Kapil Gadhire, Head of Marketing, Magnifi

From the word go, team Bubble was super detailed, efficient, and exhaustive in their approach. They are true partners and make an effort to understand the ideology and end goal to plan the perfect media pitch and strategy.

Lauren Myers, Director, Integrated Marketing – Ross Video

Working with Bubble during and after IBC 2022 for PR and press support was exceptional. Their professional approach, strategic communication, and extensive media network generated significant exposure for our brand. Bubble's on-site support was outstanding, ensuring our story was accurately told to a global audience. Their post-IBC efforts further amplified our reach and provided valuable analytics. An experienced, professional team and a total joy to work with.

Andrew McKinlay, Marketing Director, Avolites

All amazing, just grateful I know I can rely on Bubble to get the job done brilliantly.

Tanya Rai, Marketing and Communications Manager, Pebble

Team Bubble are an extension of our own team. They are wonderful to work with, reliable, get the job done and gain great exposure for our business in key publications.

Mike Ward, Head of Marketing, Singular.live

Since we first started working with them, our team at Bubble have acted very much like an extension of our team. They work with us to try and help us achieve our goals and we very much feel that they have our interests at heart as well as having our backs when we need it!

Gavin Bunker, AE Live

Bubble were fantastic throughout the whole process and helped us deliver a successful event to celebrate our 30th corporate anniversary with industry peers.

Robert Cloudt, Synchronized

Bubble has been tremendously helpful to bring our marketing communication to the next level, very responsive and thinking with us together on the rightful messaging and timing across different media’s. Definitely a recommendation in case you need a well balanced media agency to help you out.

Carla Molina Whyte, Farmerswife

Working with Bubble Agency for a tradeshow has been truly amazing. The bubble team is incredibly helpful and talented. We are very happy with the results and with all the coverage we got prior and during the tradeshow!

Silvia Candido, Ateme

As usual, we were super busy before and during a tradeshow this year. What a luxury to have Bubble take care of our media relations and our social media accounts! We saw a surge of followers on LinkedIn and got good coverage in a number of publications.

Meg Travis, Iron Mountain Entertainment Services, Director, Global Head of Marketing & Communications, Entertainment Services

The Bubble team made everything easy at MPTS! From advising before the show, to facilitating client and press conversations during the show, to making recommendations on how to make the most of the connections we made there - we rely on Bubble as a key strategic partner for our sales and marketing teams.