| 1. |
|
|
| 2. |
- Faraj, Maycel Isaac, 1979-, et al.
(författare)
-
Audio–visual person authentication using lip-motion from orientation maps
- 2007
-
Ingår i: Pattern Recognition Letters. - Amsterdam : North-Holland. - 0167-8655 .- 1872-7344. ; 28:11, s. 1368-1382
-
Tidskriftsartikel (refereegranskat)abstract
- This paper describes a new identity authentication technique by a synergetic use of lip-motion and speech. The lip-motion is defined as the distribution of apparent velocities in the movement of brightness patterns in an image and is estimated by computing the velocity components of the structure tensor by 1D processing, in 2D manifolds. Since the velocities are computed without extracting the speaker’s lip-contours, more robust visual features can be obtained in comparison to motion features extracted from lip-contours. The motion estimations are performed in a rectangular lip-region, which affords increased computational efficiency. A person authentication implementation based on lip-movements and speech is presented along with experiments exhibiting a recognition rate of 98%. Besides its value in authentication, the technique can be used naturally to evaluate the “liveness” of someone speaking as it can be used in text-prompted dialogue. The XM2VTS database was used for performance quantification as it is currently the largest publicly available database (≈300 persons) containing both lip-motion and speech. Comparisons with other techniques are presented.
|
|
| 3. |
- Faraj, Maycel Isaac, 1979-, et al.
(författare)
-
Lip Biometrics for Digit Recognition
- 2007
-
Ingår i: Computer Analysis of Images and Patterns, Proceedings. - Berlin : Springer Berlin/Heidelberg. - 9783540742715 ; , s. 360-365
-
Konferensbidrag (refereegranskat)abstract
- This paper presents a speaker-independent audio-visual digit recognition system that utilizes speech and visual lip signals. The extracted visual features are based on line-motion estimation obtained from video sequences with low resolution (128 ×128 pixels) to increase the robustness of audio recognition. The core experiments investigate lip motion biometrics as stand-alone as well as merged modality in speech recognition system. It uses Support Vector Machines, showing favourable experimental results with digit recognition featuring 83% to 100% on the XM2VTS database depending on the amount of available visual information.
|
|
| 4. |
- Faraj, Maycel Isaac, 1979-, et al.
(författare)
-
Speaker and Digit Recognition by Audio-Visual Lip Biometrics
- 2007
-
Ingår i: Advances in biometrics. - Berlin : Springer. - 9783540745488 ; , s. 1016-1024
-
Konferensbidrag (populärvet., debatt m.m.)abstract
- This paper proposes a new robust bi-modal audio visual digit and speaker recognition system by lip-motion and speech biometrics. To increase the robustness of digit and speaker recognition, we have proposed a method using speaker lip motion information extracted from video sequences with low resolution (128 ×128 pixels). In this paper we investigate a biometric system for digit recognition and speaker identification based using line-motion estimation with speech information and Support Vector Machines. The acoustic and visual features are fused at the feature level showing favourable results with digit recognition being 83% to 100% and speaker recognition 100% on the XM2VTS database.
|
|
