>
Disney Uses AI To Re-Age Faces
Written by David Conrad   
Sunday, 15 January 2023

Disney Research has a new visual effects tool that can make actors look older or younger for movies without needing to collect longitudinal data using photographs. 

disney res banner

Remember the breakthrough when AI was first used to estimate a person's age? We had great fun trying to fool Microsoft's implementation of it but we probably underestimated how important facial recognition would become.

A paper recently presented at ACM SIGGRAPH Asia (2022) introduced FRAN, a "Face Re-Aging Network" that can:

automatically re-age face images in video without identity loss

Intended for visual effects, FRAN comes from a team of researchers from the Zurich-based Disney Research Studios,  and ETH Zurich. Setting the scene the paper states:

The use of digitally aged or de-aged human characters in movie productions and advertising has increased dramatically over the last few years. Whether for making Robert De Niro younger in The Irishman [2020], or David Beckham older in an ad campaign against malaria [2020], digital re-aging is quickly becoming an essential tool in every visual effects studio. 

This video presents the research, opening with video frames of an male aged 35, re-aged to 65 (top row) and to 18 (bottom row):

As an AI-based, fully-automatic tool, FRAN is intended to replace the predominant 2D painting workflow which often requires frame-by-frame manual work that can take days to accomplish, even by skilled artists.The research paper states:

Although research on facial image reaging has attempted to automate and solve this problem, current techniques are of little practical use as they typically suffer from facial identity loss, poor resolution, and unstable results across subsequent video frames.  

The approach used for FRAN that overcomes these problems dispensed with collecting data from real human subjects. Instead the neural network was trained with a  large database containing pairs of randomly generated synthetic faces at varying ages.

disneyfran2

FRAN also provides artists with localized control and creative freedom to direct and fine-tune the re-aging effect, such as adding or erasing wrinkles and jowls, something the paper suggests is important in real production pipelines and often overlooked in related research work.

The results seem impressively credible but it isn’t clear if Disney intends to make this technology available to the public.

disneyfran

More Information

Production-Ready Face Re-Aging for Visual Effects (pdf)

Related Articles

Face Recognition Adds Age Estimation

How Old - Eun, Wrong, Potentially Risky

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Golang Back In TIOBE Top 10
21/02/2024

Google's system language Go is ranked #8 in the TIOBE Index for February 2024. This is the third time it has entered the Top 10. However, it is now in the highest position it has ever had to date.



CSS Test of Time Award 2023
18/02/2024

The ACM CCS Test-of-Time Award honors research with long-lasting influence, which have had significant impacts on systems security and privacy. The 2023 award in respect of a paper by Marten van Dijk  [ ... ]


More News

raspberry pi books

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Sunday, 15 January 2023 )