Abstract
A system is presented that tracks in 3D a person's unadorned lips, and outputs the 3D locations of the mouth corners and ten points describing the outer lip contour. This output is suitable for audio visual speech processing, 3D animation, or expression recognition. A stereo head tracker is used to track the subject's head, allowing for robust performance whilst the subject's head is moving and turning with respect to the cameras. The head pose is used in conjunction with the novel adaptable templates to generate a robust estimate of the deforming mouth corner locations. A 3D geometric model is used to generate search paths for key points on the outer lip contour which are subsequently located using adaptable templates and geometric constraints. The system is demonstrated robustly tracking the head pose and 3D mouth shape on a person speaking while moving his head.
| Original language | English |
|---|---|
| Title of host publication | Sixth International Coference on Control, Automation, Robotics and Vision Conference Proceedings (ICARCV 2000) |
| Subtitle of host publication | Intelligent Automation in the New Millennium |
| Place of Publication | Singapore |
| Publisher | Nanyang Technological University |
| Pages | 1-6 |
| Number of pages | 6 |
| ISBN (Electronic) | 9810434456 |
| Publication status | Published - 5 Dec 2000 |
| Event | International Conference on Control, Automation, Robotics and Vision 2000 - Marina Mandarin, Singapore, Singapore Duration: 5 Dec 2000 → 8 Dec 2000 Conference number: 6th https://www.tib.eu/en/search/id/TIBKAT%3A333978609/Conference-proceedings-ICARCV-2000-Sixth-International/ |
Conference
| Conference | International Conference on Control, Automation, Robotics and Vision 2000 |
|---|---|
| Abbreviated title | ICARCV 2000 |
| Country/Territory | Singapore |
| City | Singapore |
| Period | 5/12/00 → 8/12/00 |
| Internet address |