Disney’s latest AI tool de-ages actors in seconds

2 min


147
86 shares, 147 points

Remember when making actors look older or younger in movies was a huge deal? The amount of postproduction work to achieve realistic results was immense back in the day, but now, researchers from Disney have revealed FRAN, a new artificial intelligence tool that can convincingly age or de-age an actor in a fraction of the time.

In an academic paper, Disney Research Studios explains that FRAN (which stands for face re-aging network) is a neural network that was trained using a large database containing pairs of randomly generated synthetic faces at varying ages, which bypasses the need to otherwise find thousands of images of real people at different (documented) ages that depict the same facial expression, pose, lighting, and background. 

FRAN (face re-aging network) is a neural network that’s been trained using thousands of images of synthetic human faces, projecting how an actor’s face could look on camera at different stages of life.
Image: Disney

FRAN uses this information to come up with a prediction about which areas of a real person’s face would age and how and then overlays the new details — such as adding or erasing wrinkles and jowls — onto video footage. The result is what Disney Research Studios claims is “the first practical, fully-automatic and production-ready method for re-aging faces in video images.” Looking at video examples provided by Disney, the tech definitely blows Snapchat’s aging filter out of the water.

There are a few limitations, however, and this sort of research isn’t unique. Disney noted in its research that FRAN may be unsuitable for significant alterations such as re-aging to and from very young ages and that the graying of scalp hair isn’t reflected when aging up an actor, as this wasn’t present in the dataset used to train the tool. Given manual VFX work and even practical prosthetic makeup application don’t have these restrictions, FRAN is unlikely to be replacing many industry jobs for a good while.

A man’s face aged from 20 to 75, with motion blur still showing the addition and subtraction of wrinkles.

FRAN shown aging a subject even in the presence of typical video effects such as motion blur.
Image: Disney

It’s little wonder that Disney has been working on automating visual effects given it’s one of the biggest names recreating or de-aging actors on the big screen. Characters in the Marvel Cinematic Universe such as Nick Fury (Samuel L. Jackson), Hank Pym (Michael Douglas), and Ego the Living Planet (Kurt Russell) have all been visually adjusted in recent years, in addition to Star Wars characters like Leia Organa (Carrie Fisher) and Wilhuff Tarkin (Peter Cushing).

Despite its potential benefits in filmmaking, it isn’t clear if Disney intends to make this technology available to the public, and there’s still certainly some room for improvement, so it could be a while until we see this level of intricate visual effects work practically automated within the industry.

Source: The Verge


Like it? Share with your friends!

147
86 shares, 147 points

What's Your Reaction?

Cute Cute
16
Cute
Fun Fun
8
Fun
Hate Hate
2
Hate
Confused Confused
18
Confused
Fail Fail
10
Fail
Geeky Geeky
5
Geeky
Love Love
24
Love
OMG OMG
18
OMG
Choose A Format
Personality quiz
Series of questions that intends to reveal something about the personality
Trivia quiz
Series of questions with right and wrong answers that intends to check knowledge
Poll
Voting to make decisions or determine opinions
Story
Formatted Text with Embeds and Visuals
List
The Classic Internet Listicles
Countdown
The Classic Internet Countdowns
Open List
Submit your own item and vote up for the best submission
Ranked List
Upvote or downvote to decide the best list item
Meme
Upload your own images to make custom memes
Video
Youtube, Vimeo or Vine Embeds
Audio
Soundcloud or Mixcloud Embeds
Image
Photo or GIF
Gif
GIF format