Journal article
Dynamic texture recognition using local binary patterns with an application to facial expressions
Machine Vision Group, Department of Electrical and Information Engineering, University of Oulu, FI-90014 Oulu, Finland. gyzhao@ee.oulu.fi1
Dynamic texture (DT) is an extension of texture to the temporal domain. Description and recognition of DTs have attracted growing attention. In this paper, a novel approach for recognizing DTs is proposed and its simplifications and extensions to facial image analysis are also considered. First, the textures are modeled with volume local binary patterns (VLBP), which are an extension of the LBP operator widely used in ordinary texture analysis, combining motion and appearance.
To make the approach computationally simple and easy to extend, only the co-occurrences of the local binary patterns on three orthogonal planes (LBP-TOP) are then considered. A block-based method is also proposed to deal with specific dynamic events such as facial expressions in which local information and its spatial locations should also be taken into account.
In experiments with two DT databases, DynTex and Massachusetts Institute of Technology (MIT), both the VLBP and LBP-TOP clearly outperformed the earlier approaches. The proposed block-based method was evaluated with the Cohn-Kanade facial expression database with excellent results. The advantages of our approach include local processing, robustness to monotonic gray-scale changes, and simple computation.
Language: | English |
---|---|
Publisher: | IEEE |
Year: | 2007 |
Pages: | 915-28 |
ISSN: | 21609292 , 01628828 and 19393539 |
Types: | Journal article |
DOI: | 10.1109/TPAMI.2007.1110 |
Algorithms Artificial Intelligence Biometry Computer Security Face Face recognition Facial Expression Gray-scale Humans Image Enhancement Image Interpretation, Computer-Assisted Image motion analysis Image recognition Image texture analysis Motion analysis Pattern Recognition, Automated Pattern analysis Pattern recognition Reproducibility of Results Robustness Sensitivity and Specificity Signal Processing, Computer-Assisted Spatial databases Temporal texture Video Recording dynamic texture recognition face recognition facial expression facial expressions facial image analysis image texture local binary pattern. motion volume local binary patterns