close menu

Digital Wizard Creates Living Makeup With Face-Tracking Tech

You may already know how amazing so-called “projection mapping” technology can be. If you follow pop music, you might have caught IRMA’s latest music video, a single-shot romp through a beautifully rendered projection space. If you’ve been to a high-end sports area, you may have been treated to a full-court projection extravaganza. But you have never seen anything like the work of digital artist Nobumichi Asai and his team of digital designers, CGI experts, and make-up artists.

I’m not even sure how to describe the video below other than “electronic makeup.” It’s astounding. Take a look:

It seems like the “OMOTE” demonstration is a perfect coupling of two technologies that are just starting to blossom: face-tracking and projection-mapping tech. Projection-mapping, like what you’ll see at a lot of sports events these days, is like augmented reality. By first scanning in the surface that will be projected on, designers are able to project and then alter that surface to great effect. In OMOTE, you can see that under everything there is a model’s face (eyes closed, eyebrows covered), but the features of her face are being projected back onto her skin by powerful lights and software. It looks nearly perfect.

Face Tech 5

The other tech featured here is sophisticated face tracking. The dots spread across the model’s face? Those are infrared markers that help whatever software Asai is using keep up with the model’s movements and change accordingly. It also appears as though the model’s face is scanned beforehand, but that might be a bit of flourish on Asai’s part.

Face Tech 4

Obviously, the movement of the model has to be fairly slow and smooth to accommodate the software. If you look closely, you can see the slight shaking in the digital makeup as the tracking tech tries to keep up.

Face Tech 3

Technical details on how Asai’s team crafted this digital makeup haven’t yet been released. I think I like the mystery a bit more.

Face Tech 2

We have seen how movies and video games have been taking advantage of nearly perfect facial mapping/tracking before, from Dawn of the Planet of the Apes to L.A. Noire, but this is clearly the next step. Imagine being able to project high-resolution renderings of makeup and clothing directly onto actor’s bodies as they performed a scene.

Face Tech 1

But for me, I love the odd and slightly out-of-place future-tech feel.

HT TechTimes

Kyle Hill is the Chief Science Officer of the Nerdist enterprise. Follow the continued nerdery on Twitter @Sci_Phile.

Help Bring The

Help Bring The "This is Fine" Dog Meme to Life as a Plush Doll

Prince's 10 Most Controversial Songs

Prince's 10 Most Controversial Songs

The Biggest Differences Between THE MARTIAN Movie and Novel

The Biggest Differences Between THE MARTIAN Movie and Novel



  1. Barry Gates says:

    I want it for my DJ set

  2. Ron says:

    It would be awesome if I could actually watch the video in this article without the annoying sidebar taking up half my screen and not letting me close it 

  3. Urkel says:

    Very cool, but I kinda wish they used a person who didn’t look so shiny and plasticky for the demo.

    • PeacefulCamisado says:

      My guess is they made her look ‘plasticky’ on purpose–they likely put on a heavy foundation in order to get her skin as even and ‘plain’ as possible, so that the projection has the best effect possible. Her skin probably doesn’t look anything like that on a day-to-day basis. 

  4. Wardster_ says:

    This is insane. Augmented reality is the way forward, so cool