Efficient 3D point clouds classification for face detection using linear programming and data mining

ABSTRACT

Most of the applications related to security and biometric rely on skin region detection such as face detection, adult 3D objects filtering, and gesture recognition. In this paper, we propose a robust method for skin detection on 3D coloured point clouds. Then, we extend this method to solve the problem of 3D face detection. To do so, we construct a weighted graph from initial coloured 3D point clouds. Then, we present a linear programming algorithm using a predictive model based on a data mining approach to classify and label graph vertices as skin and non-skin regions. Moreover, we apply some refinement rules on skin regions to confirm the presence of a face. Furthermore, we demonstrate the robustness of our method by showing and analysing some experimental results. Finally, we show that our method deals with many data that can be represented by a weighted graph such as 2D images and 3D models.

KEYWORDS:

• 3D point clouds
• face detection
• face model
• skin detection
• data mining
• linear programming

Disclosure statement

No potential conflict of interest was reported by the authors.

Notes on contributors

Abdul Rahman El Sayed received the Master I degree in applied mathematics, from the Lebanese University, in 2002, the Master II degree (with honours) in informatics, from the Lebanese University, in 2008 and the M. Eng. in computer engineering from the University of CNAM, Beirut, Lebanon, Centre affiliated to CNAM Paris, in 2015. He has held lecturing positions at Tripoli Technical Institute and Tripoli Industrial Institute, Lebanon. In addition, he is an IT manager at Tripoli Governmental Hospital and the owner of a programming company in North of Lebanon. His research interests cover image processing in 2D and 3D with many publications in this scope.

Abdallah El Chakik received his Ph.D. and M.S. in computer science, both from the University of Caen, France. He received his B.S. in computer science from the University of Saint Etienne-France in 2006. He is an assistant professor in the Department of Computer Science at Beirut Arab University. He worked as a research engineer in Euridis Ingénierie, France.

Hassan Alabboud has been an assistant professor in the Lebanese University in Tripoli, Lebanon, since 2008. He received his Ph.D. in 2007 from the University of Le Havre in Le Havre, France. His Ph.D. thesis developed several methods and approaches in numerical optimization and operations research for binary and continuous Quadratic Programming Problems. He obtained the Master II degree in Pure Mathematics from the University of Sciences and Technology of Lille, France, in 2003 and the Master I degree in Pure Mathematics from the Lebanese University in Tripoli, Lebanon, in 2002. His research interests are combinatorial optimization, DC optimization, semidefinite programming, quadratic programming, crisis management and Image processing.

Adnan Yassine is a full professor in the University of Le Havre to Normandy in France and a member of the Laboratory of Applied Mathematics of Le Havre (LMAH). He teaches optimization and logistics in the Superior Institute of Logistic Studies (ISEL). He is author and co-author of numerous international publications in numerical and combinatorial optimization some of which concern the scheduling and logistics problems. He has supervised some thirty Ph.Ds. He obtained a Ph.D. in Applied Mathematics from the University of Grenoble (France) in 1989 and Habilitation to Supervise Research (HDR) from the University of Nancy (France) in 1998.

Images Notes

Figures 4, 8, 12 and 14. 3D Objects, which can be obtained from https://sketchfab.com/models

https://www.artec3d.com/3d-models

Figure 15. 3D meshes created from 2D images using specific tools. Original images are obtained from the following repositories:

https://www.ronitbaras.com/family-matters/parenting-family/three-is-a-crowd/

http://www.bytedigital.co.uk/who-we-are/our-company/

Figure 18:

Image (b1) Used from dataset in Reference [1] (Moudani W, Sayed AR, 2011)

Image (c1) abtained from:

http://www.aiai.ed.ac.uk/project/plan/peapod/2002-05-13.html

Image (d1) Used from dataset in Reference [1] (Moudani W, Sayed AR, 2011)

Image (e1) Used from dataset in Reference [14]

Figure 19 Image obtained from:

https://www.google.com.lb/imgres?imgurl=http%3A%2F%2Ftopfonpack.ru%2Fuploads%2Fimages%2Fk%2Fa%2Fr%2Fkartinki_s_emotsijami_1.jpg&imgrefurl=http%3A%2F%2Ftopfonpack.ru%2Fwallpaper%2Fopredelenie-emotsij-cheloveka&docid=znHp-lwDo3TZ_M&tbnid=rwOgkoyCLeuv-M%3A&vet=10ahUKEwjXyJjVgvzVAhVQkRQKHZfUBkQQMwglKAAwAA..i&w=1610&h=1200&itg=1&hl=en-LB&safe=strict&bih=602&biw=1242&q=facial%20expression%20children&ved=0ahUKEwjXyJjVgvzVAhVQkRQKHZfUBkQQMwglKAAwAA&iact=mrc&uact=8