Up

Face

Toolkit

• 4dface.org
• OpenFace: an open source facial behavior analysis toolkit - Tadas Baltrušaitis, Peter Robinson, and Louis-Philippe Morency, in IEEE Winter Conference on Applications of Computer Vision, 2016

Face Recognition

• SphereFace: Deep Hypersphere Embedding for Face Recognition paper

Face Detection

• Real-Time Rotation-Invariant Face Detection with Progressive Calibration Networks - Xuepeng Shi, Shiguang Shan, Meina Kan, Shuzhe Wu, Xilin Chen - 2018 paper
  • Real-Time Rotation-Invariant Face Detection with Progressive Calibration Networks - jiwoopapa blog
  • Real-Time Rotation-Invariant Face Detection with Progressive Calibration Networks github

Facial landmark detection and tracking

• Constrained Local Neural Fields for robust facial landmark detection in the wild - Tadas Baltrušaitis, Peter Robinson, and Louis-Philippe Morency. in IEEE Int. Conference on Computer Vision Workshops, 300 Faces in-the-Wild Challenge, 2013.
• Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Neural Networks paper

Eye gaze tracking

• Rendering of Eyes for Eye-Shape Registration and Gaze Estimation - Erroll Wood, Tadas Baltrušaitis, Xucong Zhang, Yusuke Sugano, Peter Robinson, and Andreas Bulling in IEEE International. Conference on Computer Vision (ICCV), 2015

Facial Action Unit detection

• Cross-dataset learning and person-specific normalisation for automatic Action Unit detection - Tadas Baltrušaitis, Marwa Mahmoud, and Peter Robinson in Facial Expression Recognition and Analysis Challenge, IEEE International Conference on Automatic Face and Gesture Recognition, 2015

3D Face Reconstruction

• A Morphable Model For The Synthesis Of 3D Faces - 1999 paper
  • Slow, Non-convex optimization problem
• Estimating 3D Shape and Texture Using Pixel Intensity, Edges, Specular Highlights, Texture Constraints and a Prior - 2005 paper
  • Slow, Non-convex optimization problem
• 3D face reconstruction from a single image using a single reference face shape - 2011 paper
  • 2.5D, Non-convex optimization problem, Difficulty.
• Face Reconstruction in the Wild - 2011 paper
  • Solved many problems.
• Improving 3D Facial Action Unit Detection with Intrinsic Normalization - 2015 paper
• Learning Detailed Face Reconstruction from a Single Image - 2016 paper
• 3D Face Reconstruction by Learning from Synthetic Data - 2016 paper
• 3DFaceNet: Real-time Dense Face Reconstruction via Synthesizing Photo-realistic Face Images - 2017 paper
• Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression - 2017 paper
• 3D Face Reconstruction with Geometry Details from a Single Image - 2017 paper ***
• Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translation - 2017 paper, github

3DMM

3DMM: 3D face modelling using a 3D morphable model

3D Morphable Models are used for face analysis because the intrinsic^본질적인^ properties of 3D faces provide a representation that is immune^면제된^ to intra-personal variations such as pose and illumination. Given a single facial input image, a 3DMM can recover 3D face (shape and texture) and scene properties (pose and illumination) via a fitting process. site model download

License: Free for non- commercial use, Commercial license.

• 3D Morphable Model Fitting For Low-Resolution Facial Images - Pouria Mortazavian, Josef Kittler, William Christmas - 2012 paper

• Face Recognition in Low Resolution Using a 3D Morphable Model - Pouria Mortazavian thesis

• Robust face recognition by an albedo based 3D morphable model - Hu, G, Chan, CH, Yan, F, Christmas, W and Kittler, J - 2014 paper

• Face Analysis using 3D Morphable Models - Guosheng Hu - 2015 thesis

• A Facial Symmetry Prior for Improved Illumination Fitting of 3D Morphable

  Model - Guosheng Hu, Pouria Mortazavian, Josef Kittler, William Christmas - 2013 paper

• Resolution-Aware 3D Morphable Model - Guosheng Hu, Chi Ho Chan, Josef Kittler, William Christmas - 2012 paper

• A Multiresolution 3D Morphable Face Model and Fitting Framework - Patrik Huber, Guosheng Hu, Pouria Mortazavian, W.P. Koppen - 2015 paper

  • eos: A lightweight header-only 3D Morphable Face Model fitting library in modern C++11/14 github

• Fitting 3D Morphable Models using Local Features - Patrik Huber, Zhen-Hua Feng, William Christmas, Josef Kittler - 2015 paper

Pose

• Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields paper
• Hand Keypoint Detection in Single Images using Multiview Bootstrapping paper
• Convolutional pose machines paper ​