The realtime deepfakes of the Innovation Hacking Team of TNG Technology Consulting GmbH was shown on German state television ZDF. You can watch the current issue of “Leschs Kosmos – Der Manipulation ausgeliefert?” at the Mediathek.
The “Die Reporter” team of German television station WDR made a report about the realtime deepfakes implementation. You can view the whole report on YouTube.
On WDR the story was also broadcasted on “Aktuelle Stunde” on 1st of June 2020. You can watch the report for some days following this link to the WDR Mediathek.
Our talk about Realtime Deepfakes is now available in an English recording session on YouTube. Enjoy!
Ever wondered how we realized doing Deepfakes in realtime? Watch our talk on YouTube.
At this point in time there the video is only available in German language. We hope to serve you an English recording as soon as the J-Fall is over. Bert van Schrijver doing organization at J-Fall told us that presentations will be recorded and uploaded to YouTube. As we will have our Deepfake talk there it shouldn’t take much time to be available. 😉
Within the last week a few news articles were published about our realtime deepfakes implementation. Here are some articles linked to their original sources.
Furthermore Daniel Fritzler, a visitor of our booth at TDWI conference, tested our realtime deepfake showcase and wrote a Science Fiction short story on this.
- Herbstcampus, Nuremberg, Germany, 4th of September, 10am
- Nerd Nite Munich Special, Munich, Germany, Hochschule München, 5th of September, 20pm
- JavaZone, Oslo, Norway, 12th of September, 15.40pm
Deep fakes are fake images or videos generated by Artificial Intelligence. The media produced by deep neural networks can seem deceptively real. In the most common case, faces are exchanged, creating the illusion of seeing another person in a video which wasn’t orignally there.
Software developers of the IT consulting company TNG Technology Consulting GmbH based in Unterföhring near Munich have succeeded in developing a software that enables deep fakes to be generated in realtime. This makes it possible to distort live images from cameras in such a way that the face in front of the camera is swapped with that of another person.
The facial expressions of a person standing in front of a camera are recognized and displayed on the faces of known persons, such as, for example, Angela Merkel, Barack Obama or Elon Musk, broadcast. In the final video stream, the software first removes the input face completely, and then replaces it with the Deep Fake. The prototype presented by TNG is a kind of mirror, in which one recognizes his facial expressions, but not his face.
The basis for this is Artificial Intelligence. Through the use of various computer vision and neural network techniques, faces are recognized in the video input, translated and integrated back into the video output. Through this technique, it is possible to project deceptively real imitations on other people.
Auto-encoder networks were trained by means of so-called GANs (Generative Adversarial Networks). In addition, the researchers used various other neural networks for facial recognition and facial segmentation.
It has been quiet on our blog for a while. The reason for that is that we were working very hard on new awesome showcases. There was a mission we defined for our team:
“Make deepfakes work in realtime on video streams”
Deepfake is a technique for human face synthesis based on artificial intelligence. It is used to combine and superimpose existing images and videos onto source images or videos using a machine learning technique known as generative adversarial network.
Long story short – We did it!
The hardware hacking team of Unterföhring near Munich based IT consulting company TNG Technology Consulting GmbH wrote a new software based on DeepFaceLab.
The result is a software realizing Deepfakes in realtime, instead of postprocessing video sequences like in the original understanding of Deepfakes.
A person is filmed by an RGB webcam and the face will be replaced by someone else‘s face, e.g. Barack Obama, with the corresponding facial expression.
At this point in time we only want to show you a short sequence of our Deepfakes 2.0 implementation as our neural networks are still in training mode! Stay tuned!
For Deepfakes 2.0 a new conference talk was written as well. It was premiered at Big Techday 2019 in Munich, Germany.
If you are interested into Deepfakes 2.0 and want to invite us for giving a talk on that don’t hesitate to contact us!
If you want to enjoy our talk about Augmented Reality and an app which enables you to have “Star Wars” like telephony calls enjoy the video footage made by the great guys at JavaZone Oslo! JavaZone is the largest community driven conference which is always worth a visit!
We are working hard on new showcases and talks about Deep Learning and neural networks. This is the reason why there aren’t many new posts on this page.
Please enjoy our “elevator pitch” about our new Stereoscopic Realtime Style Transfer showcase based on the Dell Visor Mixed Reality headset. We were able to train our neural network with the style of the music video from A-ha “Take on me”.
Furthermore we wrote a technical article for JavaPRO. You can order an issue for free at https://magazin.java-pro.de/