How Our Face Tracking Differs
Most face tracking solutions need significant computing power. They impose limitations to Face AR experiences, especially on mobile devices with limited CPU. To solve that, we trained the technology to “see” the face in 3D.
Live face tracking in 3D
Unlike face landmark SDKs, our facial tracking technology builds on the 3D math model. It tracks the face by identifying 37 characteristics represented as face morphs. They include different facial expressions, anthropometry and face position in the video frame. It allows us to accurately track the face in the camera and optimize our face detection software for mobile platforms.
Mobile-first
We optimize our technology for mobile devices. It functions well on iPhone-Xs and $100-Androids, at low lighting, and with up to 70% occlusion. Our device support starts with iPhone 5S, Android 5.0 with Camera 2 API and OpenGL ES 3.0. It covers 97% of all iOS devices and 80% of all Android ones.
Made for Face AR
Our Face Tracking SDK precisely detects and tracks several faces in a video stream in real-time. We develop it for Face AR, enabling you to create the most realistic and feature-rich facial animation. You can overlay 3D objects on the face, ad AR lens or turn faces into live avatars and emojis.
How We Achieve Industry-Best Face Tracking
Our face capture software runs anywhere – on mobile, web and desktop. It adapts to the device capacity and delivers exceptional performance of Face AR experiences.
Patented anti-jitter
We run algorithms several times within one frame to process the noises. It results in jitter-free user experience without lag.
Adaptive
Our face tracking supports low lighting, 360-degree device rotation and up to 70% occlusion.
Efficient energy use
Less battery drain due to the saved capacity makes your apps lightweight and energy-efficient.
Runs anywhere
You’re not limited to ARCore or ARKit. We optimize our face tracking for low-end mobile devices allowing you to maximize your audience reach.
Customization
We can adapt our face detection and tracking algorithms to custom hardware.
Robust
We use compressed neural networks trained on balanced datasets. It ensures our technology works well for all types of skin color, ages, genders and nationalities.
Performance
- Multi-face tracking
- Distance up to 7 meters
- High performance (min 25-30 fps on early devices)
- Extreme angles, ranging from –90 to +90
- Operates in poor lighting
- Supports up to 70% face occlusion
- Stable detection with glasses and complex haircuts
- A 3D model of a face with up to 3,308 vertices
- Supports 360 degrees rotation of the camera
Application Fields
Face tracking can serve as a key component for Face AR apps or as the first step of any face-related computer vision task. It includes facial features classification, emotion recognition or liveness detection.
Face filtering
Immerse your users with Snapchat-like face filters, lenses, 3D masks for any camera app.
Try-on
Boost sales and advertise new products with realistic virtual try-on tools for facewear.
AR beauty
Add virtual makeup testing to help your consumers innovatively experience beauty products.
Face modification
Empower the camera with face touch up tools that slim down the contour, emphasize eyes, smooth skin, whiten teeth.
Games
Create the shared in-game experience where players can see each other, overlay face filters or avatars.
Photo / video editing
Allow users to enhance videos and photos with Face AR effects and boost engagement and content sharing in your app.