June 4, 2020
The “Die Reporter” team of German television station WDR made a report about the realtime deepfakes implementation. You can view the whole report on YouTube.
On WDR the story was also broadcasted on “Aktuelle Stunde” on 1st of June 2020. You can watch the report for some days following this link to the WDR Mediathek.
February 17, 2020
Our talk about Realtime Deepfakes is now available in an English recording session on YouTube. Enjoy!
September 11, 2019
Ever wondered how we realized doing Deepfakes in realtime? Watch our talk on YouTube.
At this point in time there the video is only available in German language. We hope to serve you an English recording as soon as the J-Fall is over. Bert van Schrijver doing organization at J-Fall told us that presentations will be recorded and uploaded to YouTube. As we will have our Deepfake talk there it shouldn’t take much time to be available. 😉
September 3, 2019
Within the last week a few news articles were published about our realtime deepfakes implementation. Here are some articles linked to their original sources.
Furthermore Daniel Fritzler, a visitor of our booth at TDWI conference, tested our realtime deepfake showcase and wrote a Science Fiction short story on this.
- Herbstcampus, Nuremberg, Germany, 4th of September, 10am
- Nerd Nite Munich Special, Munich, Germany, Hochschule München, 5th of September, 20pm
- JavaZone, Oslo, Norway, 12th of September, 15.40pm
August 19, 2019
Deep fakes are fake images or videos generated by Artificial Intelligence. The media produced by deep neural networks can seem deceptively real. In the most common case, faces are exchanged, creating the illusion of seeing another person in a video which wasn’t orignally there.
Software developers of the IT consulting company TNG Technology Consulting GmbH based in Unterföhring near Munich have succeeded in developing a software that enables deep fakes to be generated in realtime. This makes it possible to distort live images from cameras in such a way that the face in front of the camera is swapped with that of another person.
The facial expressions of a person standing in front of a camera are recognized and displayed on the faces of known persons, such as, for example, Angela Merkel, Barack Obama or Elon Musk, broadcast. In the final video stream, the software first removes the input face completely, and then replaces it with the Deep Fake. The prototype presented by TNG is a kind of mirror, in which one recognizes his facial expressions, but not his face.
The basis for this is Artificial Intelligence. Through the use of various computer vision and neural network techniques, faces are recognized in the video input, translated and integrated back into the video output. Through this technique, it is possible to project deceptively real imitations on other people.
Auto-encoder networks were trained by means of so-called GANs (Generative Adversarial Networks). In addition, the researchers used various other neural networks for facial recognition and facial segmentation.
June 19, 2019
It has been quiet on our blog for a while. The reason for that is that we were working very hard on new awesome showcases. There was a mission we defined for our team:
“Make deepfakes work in realtime on video streams”
Deepfake is a technique for human face synthesis based on artificial intelligence. It is used to combine and superimpose existing images and videos onto source images or videos using a machine learning technique known as generative adversarial network.
Long story short – We did it!
The hardware hacking team of Unterföhring near Munich based IT consulting company TNG Technology Consulting GmbH wrote a new software based on DeepFaceLab.
The result is a software realizing Deepfakes in realtime, instead of postprocessing video sequences like in the original understanding of Deepfakes.
A person is filmed by an RGB webcam and the face will be replaced by someone else‘s face, e.g. Barack Obama, with the corresponding facial expression.
At this point in time we only want to show you a short sequence of our Deepfakes 2.0 implementation as our neural networks are still in training mode! Stay tuned!
For Deepfakes 2.0 a new conference talk was written as well. It was premiered at Big Techday 2019 in Munich, Germany.
If you are interested into Deepfakes 2.0 and want to invite us for giving a talk on that don’t hesitate to contact us!
September 25, 2018
If you want to enjoy our talk about Augmented Reality and an app which enables you to have “Star Wars” like telephony calls enjoy the video footage made by the great guys at JavaZone Oslo! JavaZone is the largest community driven conference which is always worth a visit!
August 20, 2018
We are working hard on new showcases and talks about Deep Learning and neural networks. This is the reason why there aren’t many new posts on this page.
Please enjoy our “elevator pitch” about our new Stereoscopic Realtime Style Transfer showcase based on the Dell Visor Mixed Reality headset. We were able to train our neural network with the style of the music video from A-ha “Take on me”.
Furthermore we wrote a technical article for JavaPRO. You can order an issue for free at https://magazin.java-pro.de/
April 27, 2018
Our talk about the Avatar telepresence robotics system using the Softbank Nao and the Microsoft Kinect at the goto meeting in Amsterdam is now available on Youtube. It features a demonstration of the system as well as live coding the robot and some chocolate. Enjoy!