DeepLip: block-based lip pixel detection by deep neural networks

References

• Fuhrimann S, Schüpbach A, Thüer U, et al. Natural lip function in wind instrument players. Eur J Orthod. 1987;9(1):216–223. doi: 10.1093/ejo/9.1.216
   PubMedGoogle Scholar
• Je C, Lee SW, Park RH. Colour-stripe permutation pattern for rapid structured-light range imaging. Opt Commun. 2012;285(9):2320–2331. doi: 10.1016/j.optcom.2012.01.025
   Web of Science ®Google Scholar
• Je C. Color structured light for rapid range imaging [dissertation]. Sogang University; 2008.
   Google Scholar
• Matthews I, Cootes TF, Bangham JA, et al. Extraction of visual features for lipreading. IEEE Trans Pattern Anal Mach Intell. 2002;24(2):198–213. doi: 10.1109/34.982900
   Web of Science ®Google Scholar
• Je C, Park HM. BREN: body reflection essence-neuter model for separation of reflection components. Opt Lett. 2015 May;40(9):1940–1943. doi: 10.1364/OL.40.001940
   PubMed Web of Science ®Google Scholar
• Jang W, Je C, Seo Y, et al. Structured-light stereo: comparative analysis and integration of structured-light and active stereo for measuring dynamic shape. Opt Lasers Eng. 2013;51(11):1255–1264. doi: 10.1016/j.optlaseng.2013.05.001
   Web of Science ®Google Scholar
• Je C, Lee S, Park RH. Color-phase analysis for sinusoidal structured light in rapid range imaging. Proceedings of the 6th Asian Conference on Computer Vision (ACCV 2004); Vol. 1; Jeju, Korea. 2004 Jan. p. 270–275.
   Google Scholar
• Je C, Lee S, Park RH. High-contrast color-stripe pattern for rapid structured-light range imaging. In: Pajdla T, Matas J, editors. Computer vision–ECCV 2004. Berlin: Springer; 2004. p. 95–107. (Lecture notes in computer science; vol. 3021).
   Google Scholar
• Cootes TF, Taylor CJ, Cooper DH, et al.Active shape models-their training and application. Comput Vis Image Underst. 1995;61(1):38–59. doi: 10.1006/cviu.1995.1004
   Web of Science ®Google Scholar
• Milborrow S, Nicolls F. Locating facial features with an extended active shape model. In: Forsyth D, Torr P, Zisserman A, editors. Computer vision–ECCV 2008. Lecture notes in computer science, vol. 5305. Berlin: Springer; 2008. p. 504–513.
   Google Scholar
• Cootes TF, Edwards GJ, Taylor CJ. Active appearance models. In: Burkhardt H, Neumann B, editors. Computer vision–ECCV '98. Lecture notes in computer science, vol. 1407. Berlin: Springer; 1998. p. 484–498.
   Google Scholar
• Cristinacce D, Cootes TF. Feature detection and tracking with constrained local models. Proceedings of the British Machine Vision Conference; Edinburgh, UK. BMVA Press; 2006. p. 95.1–95.10.
   Google Scholar
• Hsu RL, Abdel-Mottaleb M, Jain AK. Face detection in color images. IEEE Trans Pattern Anal Mach Intell. 2002;24(5):696–706. doi: 10.1109/34.1000242
   Web of Science ®Google Scholar
• Je C, Jo W, Park HM. Mouth map-assisted localisation of ASM lip landmarks. Image Sci J. 2016;64(8):419–424. doi: 10.1080/13682199.2016.1224031
   Web of Science ®Google Scholar
• Kaucic R, Dalton B, Blake A. Real-time lip tracking for audio-visual speech recognition applications. In: Buxton B, Cipolla R, editors. Computer vision–ECCV '96. Berlin: Springer; 1996. p. 376–387.
   Google Scholar
• Je C, Tang M, Lee Y, et al. PolyDepth: Real-time penetration depth computation using iterative contact-space projection. ACM Trans Graph. 2012 Feb;31(1):5:1–5:14. doi: 10.1145/2077341.2077346
   Web of Science ®Google Scholar
• Liévin M, Luthon F. Unsupervised lip segmentation under natural conditions. In: 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing; Proceedings, 1999; Vol. 6; Phoenix, Arizona, USA. 1999 Mar. p. 3065–3068.
   Google Scholar
• Eveno N, Caplier A, Coulon PY. A parametric model for realistic lip segmentation. In: 2002 7th International Conference on Control, Automation, Robotics and Vision; ICARCV 2002; Vol. 3; Singapore. 2002 Dec. p. 1426–1431.
   Google Scholar
• Liew AWC, Leung SH, Lau WH. Segmentation of color lip images by spatial fuzzy clustering. IEEE Trans Fuzzy Syst. 2003 Aug;11(4):542–549. doi: 10.1109/TFUZZ.2003.814843
   Web of Science ®Google Scholar
• Wang SL, Lau WH, Leung SH. Automatic lip contour extraction from color images. Pattern Recognit. 2004;37(12):2375–2387. doi: 10.1016/S0031-3203(04)00196-7
   Web of Science ®Google Scholar
• Wang SL, Lau WH, Liew AWC, et al. Robust lip region segmentation for lip images with complex background. Pattern Recognit. 2007;40(12):3481–3491. doi: 10.1016/j.patcog.2007.03.016
   Web of Science ®Google Scholar
• Li M, Cheung Ym. Automatic lip localization under face illumination with shadow consideration. Signal Process. 2009;89(12):2425–2434. doi: 10.1016/j.sigpro.2009.05.027
   Web of Science ®Google Scholar
• Hosseini M, Ghofrani S. Automatic lip extraction based on wavelet transform. 2009 WRI Global Congress on Intelligent Systems; GCIS'09; Xiamen, China. Vol. 4. IEEE; 2009. p. 393–396.
   Google Scholar
• Saeed U, Dugelay JL. Combining edge detection and region segmentation for lip contour extraction. In: Perales FJ, Fisher RB, editors Articulated motion and deformable objects. Berlin: Springer; 2010. p. 11–20.
   Google Scholar
• Atharifard A, Ghofrani S. Robust component-based face detection using color feature. Proceedings of the World Congress on Engineering; London. Vol. 2; 2011. p. 6–8.
   Google Scholar
• Skodras E, Fakotakis N. An unconstrained method for lip detection in color images. 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); Prague, Czech Republic. IEEE; 2011. p. 1013–1016.
   Google Scholar
• Das A, Ghoshal D. Extraction of time invariant lips based on morphological operation and corner detection method. Int J Comput Appl. 2012;48(21):7–11.
   Google Scholar
• Kalbkhani H, Amirani MC. An efficient algorithm for lip segmentation in color face images based on local information. J World's Elect Eng Technol. 2012;1(1):12–16.
   Google Scholar
• Pan J, Guan Y, Wang S. A new color transformation based fast outer lip contour extraction. J Inform Comput Sci. 2012;9(9):2505–2514.
   Google Scholar
• Nasuha A, Sardjono TA, Purnomo MH. Lip segmentation and tracking based on chan-vese model. 2013 International Conference on Information Technology and Electrical Engineering (ICITEE); Yogyakarta, Indonesia. IEEE; 2013. p. 155–158.
   Google Scholar
• Cheung Ym, Li M, Cao X. Lip segmentation and tracking under map-mrf framework with unknown segment number. Neurocomputing. 2013;104:155–169. doi: 10.1016/j.neucom.2012.10.009
   Web of Science ®Google Scholar
• Dalka P, Bratoszewski P, Czyzewski A. Visual lip contour detection for the purpose of speech recognition. 2014 International Conference on Signals and Electronic Systems (ICSES); Poznan, Poland. IEEE; 2014. p. 1–4.
   Google Scholar
• Sun C, Lu H, Zhang W, et al. Lip segmentation based on facial complexion template. Advances in multimedia information processing–PCM 2014; Kuching, Malaysia. Springer; 2014. p. 193–202.
   Google Scholar
• Bao PT, Nguyen H, Nhan D. A new approach to mouth detection using neural network. 2009 IITA International Conference on Control, Automation and Systems Engineering; CASE 2009; Zhangjiajie, China. IEEE; 2009. p. 616–619.
   Google Scholar
• Hassanat A, Alkasassbeh M, Al-awadi M, et al. Colour-based lips segmentation method using artificial neural networks. 2015 6th International Conference on Information and Communication Systems (ICICS); Amman, Jordan. IEEE; 2015. p. 188–193.
   Google Scholar
• Patterson EK, Gurbuz S, Tufekci Z, et al. CUAVE: A new audio-visual database for multimodal human-computer interface research. 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP); Vol. 2; 2002 May; Orlando, Florida, USA. p. II–2017–II–2020.
   Google Scholar
• Je C, Park HM. Optimized hierarchical block matching for fast and accurate image registration. Signal Process Image Commun. 2013;28(7):779–791. doi: 10.1016/j.image.2013.04.002
   Web of Science ®Google Scholar
• Je C, Lee KH, Lee SW. Multi-projector color structured-light vision. Signal Process Image Commun. 2013;28(9):1046–1058. doi: 10.1016/j.image.2013.05.005
   Web of Science ®Google Scholar
• Je C, Lee SW. Method for generating structured-light pattern. US Patent No 7,929,752. 2011 Apr.
   Google Scholar
• Je C, Park HM. Homographic p-norms: metrics of homographic image transformation. Signal Process Image Commun. 2015;39(Part A):185–201. doi: 10.1016/j.image.2015.08.009
   Web of Science ®Google Scholar
• Je C, Jeon HS, Son CH, et al. Disparity-based space-variant image deblurring. Signal Process Image Commun. 2013;28(7):792–808. doi: 10.1016/j.image.2013.04.005
   Web of Science ®Google Scholar