The Mandalorian Luke Skywalker Deepfake
Shamook1 HN recommender · recommended in 1 month, 2021–2024
demo · general · 2021–2024 on HN
Deepfake artist Shamook's improved version of the Luke Skywalker scene from The Mandalorian season 2 finale, replacing the official CGI face with a deepfake.
HN cites it as an example of deepfakes producing a more convincing CGI human than the studio's own effort.
Up next
13 mo on HNThe Beauty of Bézier Curves
Freya Holmér
16 HN recommender · 2021–2026
10 mo on HNEd Catmull, Pixar: Keep Your Crises Small
Stanford Graduate School of Business
9 HN recommender · 2010–2017
8 mo on HN"Money doesn't interest me" - Ton Roosendaal 2017 Interview
Blender Guru
7 HN recommender · 2018–2025
8 mo on HNDNA animation (2002-2014) by Drew Berry and Etsuko Uno wehi.tv #ScienceArt
WEHImovies
9 HN recommender · 2020–2026
6 mo on HN"NO CGI" is really just INVISIBLE CGI - 1
The Movie Rabbit Hole
6 HN recommender · 2024–2026
5 mo on HNCaptain Disillusion: World's Greatest Blenderer - Live at the Blender Conference 2018
Captain Disillusion
4 HN recommender · 2019–2022
5 mo on HNThe Inner Life of the Cell Animation
XVIVO Scientific Animation
5 HN recommender · 2017–2024
5 mo on HNWorld Building in Blender - Ian Hubert
Blender
4 HN recommender · 2019–2026
4 mo on HNLearn Low Poly Modeling in Blender 2.9 / 2.8
Imphenzia
4 HN recommender · 2020–2025
4 mo on HNHow Prince of Persia Defeated Apple II's Memory Limitations | War Stories | Ars Technica
Ars Technica
5 HN recommender · 2020–2026
4 mo on HNChinese Invisibility Cloak Hoax DESTROYED!!!
Captain Disillusion
4 HN recommender · 2021–2025
3 mo on HNCD / Color
Captain Disillusion
3 HN recommender · 2020–2021
4 comments from Hacker News
The best results I've seen are analogous to a modern version of rotoscoping. It involves creating a fully animated 3d model of a person and then using a well trained deep fake of the actor's face in combination. Youtuber Shamook did just that with the finale of the Mandalorian season 2. ▶ this video He actually got a job with ILM out of it. The future of CGI actors will probably involve a fusion of techniques like this in order to get it right.
It's a question of cost, knowledge and time. Avatar was in 2009 and the motion capture there was well beyond what was on display in Rogue One. My take on it is that ILM had their own in house animation process and rather than admit that it was costly, slow and gave abysmal results, they doubled down and tried to push it through. Again, there might be some excuses that can be made for Rogue One, but none for Mandolorian and the later Star Wars movies. The Luke Skywalker scene was deepfaked days after the episode aired [0] and, again, the DeepFake version is much better but still horrible because of the animation. [0] ▶ this video
Related: Lucasfilm hired a digital artist, Shamook, who re-did Luke's scene in The Mandalorian with some improved deepfake techniques[1]. Here's his video comparison: ▶ this video [1] link
I don't think you have to watch anything to learn what gives CGI humans away. I don't think anyone has actually managed a truly convincing one yet. This is the closest I've seen: ▶ this video