BTS World Tour Showcases Breathtaking AR Content

- Innovative tour utilises disguise workflow solutions and powerful disguise hardware to power largest touring AR content -

Boy band BTS have sold over 15 million albums worldwide, making them South Korea’s best-selling artist of all time. They are continuing their world domination by thrilling fans around the globe with their ‘Love Yourself: Speak Yourself’ World tour.

The 20-date tour is a stadium extension of the band’s successful headlining tour that began in 2018 and has been very well received, with the London Wembley Stadium dates selling out within two minutes of tickets being released. The innovative production uses disguise gx 2 media servers to drive video content, integrate generative content and render AR content.

Management company Big Hit Entertainment, creative directors Plan A and production designers FragmentNine conceived the tour as a big festival with every song on the setlist designed to communicate with fans, known collectively as the ARMY. Performances include inflatables, a water cannon, gun powder and fireworks as well as audience participation with handheld ARMY BOMB sticks. For the song “Trivia: Love” a mysterious mood is created by using live AR, a first for a live concert.

LIVE-LAB Co., Ltd. (Lighting and Visual Expression Laboratory) recommended using disguise for the tour “because of its flexibility and stability in coping with changing variables during the long tour,” says CEO Alvin Chu. LIVE-LAB is a disguise studio partner based in Seoul.

Born out of conversations between Big Hit, Plan A, and FragmentNine came the idea of using Augmented Reality for Trivia: Love. The team had some reference videos that were a compelling jumping off point, but AR had barely found its way into the entertainment industry.

Tasked with turning these napkin ideas into reality, FragmentNine, consisting of principal designers Jeremy Lechterman and Jackson Gallagher, reached out to their long-time associates and friends at All of it Now (AOIN) to begin exploring possibilities.

Over the following weeks, several ideas bounced around between everyone until they ultimately homed in on the style and progression of the song. The AR content ultimately consisted of words, shapes, and a heart motif that the artist could interact with.

In production rehearsals, AOIN constructed a half scale model of the stage to test out AR cameras and motion tracking since this wasn’t just an idea that could come off the shelf, it needed to be workshopped. This also allowed FragmentNine, Plan A, and AOIN to make revisions to the content together before full on-site rehearsals.

AOIN were tasked with integrating AR into the stadium-scale tour using the existing camera and video system, which was no small feat. The tour is believed to be the first to use AR on a global multidate stadium tour.

“Creatively we needed to help the artists, management and production understand what AR content entailed and how it would look,” explains Kevin Zhu, one of AOIN’s AR Content Designers. “This involved a lot of discussion and client education on the variables that impact the end product: lighting, size/scale, colour, front plate compositing and more. This kind of discussion was necessary because the technology and implementation of AR graphics was so new to the major stakeholders. Ultimately, it was a good learning experience all around, and we will be taking some of those lessons forward into projects.”

On the technical side, AOIN had to overcome the unknowns associated with the integration of AR workflows, notes Producer and AR Content Designer, Berto Mora. “We have done many tests within our studio where everything works in a controlled environment, but when you are on-site you have to deal with real-world issues. Since a lot of this technology is relatively new, we have to deal with a lot of unknown issues and unwritten features. Working closely with our partners, such as disguise, allows us to accomplish what we need to make these workflows operational in the real world.”

According to AOIN Executive Producer Danny Firpo, “Understanding the performance on a stadium scale was an important factor. The sheer scale of a stadium setting meant that the performer was almost too small to see in person except for those in the front row. A significant percentage of the audience would experience the show and watch the performer through the IMAG screens with the AR effects.”

The disguise workflow was vital in making creative content decisions without having the full AR rig set up. Firpo explains, “We used the spatial mapping feature on the gx 2 pretty heavily, which allowed us to virtually block out all the camera positions and AR effects on stage from within our studio. Management could approve the changes and revisions remotely using disguise’s stage render video as a virtual proxy of the actual performance.”

The integration of disguise with the stYpe camera tracking system allowed AOIN to link virtual camera objects in disguise’s software GUI with real-time lens and 6D positional data the stYpe unit received from a camera and broadcasting output. stYpe’s Redspy system was used for the handheld camera, and a Vinten Tracking head was used for tracking a stationary camera at the FOH camera riser position.

“We had to make a virtual stage line up perfectly with the real stage, and we were only able to see this alignment through the live camera feed into the gx 2,” explains Touring AR Engineer Neil Carman. “So disguise became a powerful real-time compositing tool that helped us understand adjustments we needed to make for perspective and position. The virtual stage assets that FragmentNine delivered to us for the project were scaled perfectly for the real-world space. Being able to verify scale within the disguise software made aligning the real world and the virtual world much simpler.”

Once disguise had all the connected Stype systems agree on a universal zero point, from which all graphics would emanate, the server allowed AOIN to precisely move around individual elements of the graphics from different sections during rehearsals. This aided AOIN in choreographing interactive movements between the performers and the graphics. “The stability of the hardware and flexibility of the software on the disguise server contributes greatly to the success of a long tour,” says LIVE-LAB’s Chu.

“Controlling the image projected on the large LED screen is important for the overall harmony of the elements, and disguise shows stable and powerful operating capabilities,” adds Creative Director Kevin Kim of Plan A.

Jackson Gallagher and Jeremy Lechterman were the tour’s Production Designers from FragmentNine.


A Few Kind Words...

Catherine Watling – Visual Data
Visual Data - Catherine Watling

The Bubble team have been fantastic and the quality of the work is always exceptional – even at short notice. Our work with Bubble has produced some of the best coverage we have ever had!

Mark Forth – CVP
CVP - Mark Forth

Working with Bubble has been integral to a rapid improvement in the delivery of our PR and communication strategy. The entire Bubble team are always friendly and professional as well as knowledgeable and well-connected. A real joy to work with!

Nik Forman – Masstech
Masstech - Nik Forman

Bubble are a great bunch to have on your team. The whole staff combine high degrees of professionalism and diligence with an impressive depth of industry knowledge and reach, all delivered with huge fun and energy.

Tom Rockhill – disguise
disguise - Tom Rockhill

Since working with Bubble, we have been able to target key industries and sectors in a much more strategic way, which has been instrumental the growth of our business. Bubble is an invaluable part of our team and is really helping us to drive our business presence forward both through PR and at trade shows.

Charlotte Wheeler – The Media Production and Technology Show
The Media Production and Technology Show - Charlotte Wheeler

Bubble Agency has worked with The Media Production Show for the last few years to provide exhibitor PR to clients and show PR to the wider industry press. We have always been impressed with their professionalism, the ability to tun around requests quickly and run our PR Lounge to a high standard during the show.

Robert Lisman – Primestream
Primestream - Robert Lisman

Bubble Agency is made up of hardworking, passionate and caring professionals. They have great knowledge of the PR world, true specialists in the broadcast and video industry and they always have great ideas to increase our exposure.

Bob Boster – Clear-Com
Clear-Com - Bob Boster

One thing that really sets them apart is the depth of their relationships with the editors and the community that serves our space.

Brian Clark – NEP UK
NEP UK - Brian Clark

They're a nice, easy, straightforward, honest company to deal with.

Jon Finegold – Signiant
Signiant - Jon Finegold

As Signiant’s core market is M&E, Bubble has proven to be the perfect agency for us. They understand our market and are well-connected with the key influencers, publications and events in the industry. Day-to-day they are always on top of every detail and are a joy to work with. They are, after all, Bubbles.

Kimberley Zajicek – PHABRIX
PHABRIX - Kimberley Zajicek

The Bubbles are highly knowledgeable, reliable and have become an integral part of our team. Their winning combination of industry passion and communications expertise has generated a significant increase in our media presence, both in print and online.