Disney Uses AI To Re-Age Faces
Written by David Conrad   
Sunday, 15 January 2023

Disney Research has a new visual effects tool that can make actors look older or younger for movies without needing to collect longitudinal data using photographs. 

disney res banner

Remember the breakthrough when AI was first used to estimate a person's age? We had great fun trying to fool Microsoft's implementation of it but we probably underestimated how important facial recognition would become.

A paper recently presented at ACM SIGGRAPH Asia (2022) introduced FRAN, a "Face Re-Aging Network" that can:

automatically re-age face images in video without identity loss

Intended for visual effects, FRAN comes from a team of researchers from the Zurich-based Disney Research Studios,  and ETH Zurich. Setting the scene the paper states:

The use of digitally aged or de-aged human characters in movie productions and advertising has increased dramatically over the last few years. Whether for making Robert De Niro younger in The Irishman [2020], or David Beckham older in an ad campaign against malaria [2020], digital re-aging is quickly becoming an essential tool in every visual effects studio. 

This video presents the research, opening with video frames of an male aged 35, re-aged to 65 (top row) and to 18 (bottom row):

As an AI-based, fully-automatic tool, FRAN is intended to replace the predominant 2D painting workflow which often requires frame-by-frame manual work that can take days to accomplish, even by skilled artists.The research paper states:

Although research on facial image reaging has attempted to automate and solve this problem, current techniques are of little practical use as they typically suffer from facial identity loss, poor resolution, and unstable results across subsequent video frames.  

The approach used for FRAN that overcomes these problems dispensed with collecting data from real human subjects. Instead the neural network was trained with a  large database containing pairs of randomly generated synthetic faces at varying ages.

disneyfran2

FRAN also provides artists with localized control and creative freedom to direct and fine-tune the re-aging effect, such as adding or erasing wrinkles and jowls, something the paper suggests is important in real production pipelines and often overlooked in related research work.

The results seem impressively credible but it isn’t clear if Disney intends to make this technology available to the public.

disneyfran

More Information

Production-Ready Face Re-Aging for Visual Effects (pdf)

Related Articles

Face Recognition Adds Age Estimation

How Old - Eun, Wrong, Potentially Risky

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


The Art and Science of Conversational AI
08/01/2023

Nine teams have been selected for the fifth iteration of the Alexa Prize SocialBot Grand Challenge. Will one of them succeed this year in claiming the $1 Million that is on offer for the&nbs [ ... ]



Bjarne Stroustrup Defends C++ As Safe
25/01/2023

It isn't surprising to find the creator of a language defending the language they created and so it is with the latest paper from Bjarne Stroustrup. Is it fair for the NSA to tell programmers to stay  [ ... ]


More News

picobook

 



 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Sunday, 15 January 2023 )