Master Thesis - Smartphone Facial Tracking

We are creating Frever - The Future of Expression

Make an animated version of yourself, or who you want to be, and start expressing yourself. Create music videos, stories or vlogs. With the world’s first mobile 3D creation platform anything is possible.

Job Description

We are looking for a master thesis student that can integrate a mobile friendly smartphone facial tracking system using normal smartphone cameras together with the Frever avatar system running on the latest version of Unity 2019.3. Your responsibility is to integrate an existing open source or commercial smartphone real-time facial tracking system to be used with iOS and Android. 


What You’ll Do

  • Research and use best practices around smartphone facial tracking technologies, including commercial and open source solutions

  • The solution to be integrated with Unitys AR Foundation framework and both support Android and iOS (e.g. by ARCore Augmented Faces for iOS)

  • The solution should be able to translate the raw data from the selected smartphone facial tracking technology to iOS ARKit blendshapes 

  • Apply the real-time facial tracking technology in order to drive the facial animations of the Frever 3D avatar models

  • Map devices reach (models for iOS and Android) and minimum processor, memory and GPU requirements with selected facial tracking technology

  • Research and investigate solution for full body motion capture using normal smartphone cameras

  • The goal of the master thesis will result in an end-to-end prototype that can be used for production


Who You Are

  • Fluent in English 

  • Knowledge of C#

  • A deep interest in facial tracking technologies 


Bonus Points

  • Experience with iOS ARKit and Android ARCore

  • Experience with Unity

  • Experience within Vision Machine Learning


What We Offer

  • The opportunity to work with the latest technological tools within AR, Depth Camera, 3D rendering and Machine Learning

  • The opportunity to quickly assume responsibility and get a steep learning curve as we are small, nimble and ambitious team that need to face new challenges constantly

  • The opportunity to be part of building a global product from its very foundations and have true impact of its design and final result


Application Details

We will be reviewing applications and interviewing candidates continuously throughout the application period which runs from April 1 to May 31 2020. We highly welcome female applicants.   To apply please email your cover letter and CV to: 

Location: Södermalm, Stockholm.

Start: As soon as possible


If you have any questions about the job, please email or call Erik Wahlberg (CEO) at +46 70 - 42 42 195