TYMBARK: Campaign with deepfake technology

case studies

published

Video Production

Michał Fałat (East Eventz) / MOON Films

Panowie Programiści

Technology & UX & QA & PM

Client

Maspex, właściciel marki Tymbark

Creative Concept

Brainbox / Reżyser: Grajper Krzysztof

01 challenge

Tymbark has been accompanying Poles for decades. It is at breakfast, lunch and dinner. At the picnic, match and canoe. During birthdays, name days and weddings. Irreplaceable, beloved, ours. A true lovemark, full of positive emotions. How to express it? How to enhance the feeling? How to involve new recipients in it?

02 solution

"Everything tells me that someone loved me". - With the words of the well-known song, Tymbark decided to express the feeling that unites it with the Poles. The Skaldow hit in new arrangements was recorded for the brand by Sanah, Artur Rojek, Vito Bambino and Kwiat Jabłoni. Thanks to the application we built, each user could decide which artist would sing the next verse of the song, as well as join the singers and perform with them on Tymbark's virtual stage. So how many users, so many versions of the music video.

 

03 technological must haves

In the first phase, we faced the key challenge of creating a deepfake technology solution that would generate personalized video in the shortest possible time, with the highest possible image quality. Quality, stabilization and speed of video creation was our priority from the beginning. The interactive video was to become a showcase for the campaign, so we counted on massive user engagement.


In the first phase of dev work, we analyzed dozens of off-the-shelf solutions available on the market, but none gave satisfactory results. During the trials, it turned out that they require gigantic computing power, and it takes im.... several hours to generate an animation with a user's photo. This was unacceptable. So we made the decision to build the mechanism from scratch.

 

04 our experiments

From the beginning, we experimented in search of an optimal solution. First, we created a mechanism to perform machine learning calculations on graphics cards, and although it worked really well, it required the purchase of server space for several hundred thousand zlotys.


After many optimizations and the use of innovative caching of the layout of characteristic facial points, we achieved incredible results! We reduced the video clip generation time from the initial 50 seconds to just 2.5 seconds. We were able to do this despite the limitations of the server infrastructure. Although it supported a load of several hundred thousand users, the cost of using it dropped tenfold!

 

05 the magic of UX

After three months of experimentation and testing, we were able to create software that took less than 2.5 seconds to generate a personalized, high-quality video. However, we recognized that even that much might be too long for some. In order not to lose engagement at the last stage, we used a UX trick familiar from airport queue management. Our system started generating a video as soon as a photo was taken. The unsuspecting user was then prompted to enter his name and choose the order of the artists. When he did so, we could immediately present him with a video using his photo.


We took care of the user experience from the very beginning of the work. We analyzed possible navigation paths and UX architecture. We aimed to make the use of advanced technology as easy and pleasant as possible. We reduced potential barriers to a minimum, such as the number of form fields needed to be filled out, and most importantly, we simplified the steps for generating and sharing video on social media.

06 results

visits to the wszystkomimowi.pl campaign website


X - number of personalized vidoclips 


X - number of users who used deepfake technology in the application 

07 awards

KTR
Silver sword in Craft Audio category

Innovation 2021
Silver in the category Innovation in Communications - Tech
Silver in the category Innovation in Communication - Content/Entertainment

Kreatura 2021
Award in the Digital category - Integrated digital campaign
Distinction in the Campaign category

08 responsibilities

Our responsibilities:

  • technical and UX consultation,

  • development of a technological solution - building a prototype and then a target deepfake solution,

  • selection of servers to ensure stability and fast operation of the application,

  • cooperation with the film crew in working out the best frame so that the footage can be later processed by the application,

  • developing a system for mixing different videos, the combinations of which were generated depending on the user's choices,

  • implementing the frontend of the campaign website and connecting it to the backend,

  • performance and manual testing,

  • implementation of analytical tools,

  • project management and smooth coordination of all parties involved in the activation implementation.