The Cosmetic Surgery Recommendation: Facial Acne Localization and Recognition

Pakpoom Mookdarsanit, Lawankorn Mookdarsanit, Lawankorn Mookdarsanit

Abstract


Oftentimes, patients took their facial images to be recommended by the doctor about the cosmetic surgery across the official social media. The doctors could classified the skin disease type and remedy as the new normal. This paper introduced the acne localization and recognition from the patient’s image as a facial surgery recommendation. The proposed system was based on “You only look once version 3 (YOLOv3)” that was fast and high correctness in both position detection and acne name recognition. This facial acne localization and recognition covered 7 different acne’s types for the cosmetic surgety recommendation: (1) Conglobata,
(2) Nodular, (3) Comedone, (4) Pustule, (5) Papule,
(6) Blackheads and (7) Whiteheads. For the contribution, this showed a concrete practice to adopt deep learning in surgery industry. It is possible to use artificial general intelligence (AGI) to leverage the remedy recommendation process in cosmetic surgery industry by any AGI start-ups.


Full Text:

PDF

References


H-T. Chan, T-Y. Lin, S-C. Deng, C-H. Hsia, and C-F. Lai, " Smart Facial Skincare Products Using Computer Vision Technologies," The 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, Tokyo, Japan, 2021.

L. Soimart and P. Mookdarsanit, “Ingredients estimation and recommendation of Thai-foods,” in SNRU Journal of Science and Technology, vol.9, no.2, pp.509-520, 2017.

P. Mookdarsanit and L. Mookdarsanit, “Name and Recipe Estimation of Thai-desserts beyond Image Tagging,” in Kasembundit Engineering Journal, vol.8, Special Issue, pp.193-203, May. 2018.

S. Turmchokkasam and K. Chamnongthai, "The Design and Implementation of an Ingredient-Based Food Calorie Estimation System Using Nutrition Knowledge and Fusion of Brightness and Heat Information," in IEEE Access, vol. 6, pp. 46863-46876, 2018.

P. Mookdarsanit and L. Mookdarsanit, “The Autonomous Nutrient and Calorie Analytics from a Thai Food Image,” in Journal of Faculty Home Economics Technology RMUTP, vol.8, no.1, pp.1-12, . 2020.

P. Sharma and N. Sharma, "Gesture Recognition System," The 4th International Conference on Internet of Things: Smart Innovation and Usages, Ghaziabad, India, 2019, pp. 1-3.

P. Mookdarsanit, et al., “A Content-based Image Retrieval of Muay-Thai Folklores by Salient Region Matching,” in International Journal of Applied Computer Technology and Information Systems, vol.7, no.2, pp.21-26, 2018.

P. Mookdarsanit and L. Mookdarsanit, “An Automatic Image Tagging of Thai Dance’s Gestures,” Joint Conference on ACTIS & NCOBA, Ayutthaya, Thailand, January 2018, pp. 76-80.

C. Yang and H. Wei, "Plant Species Recognition Using Triangle-Distance Representation," in IEEE Access, vol. 7, pp. 178108-178120, 2019.

L. Mookdarsanit and P. Mookdarsanit, "Thai Herb Identification with Medicinal Properties Using Convolutional Neural Network," in Suan Sunandha Science and Technology Journal, vol. 6, no.2, pp. 34-40, 2019.

P. Mookdarsanit and L. Mookdarsanit, “PhosopNet: An Improved Grain Localization and Classification by Image Augmentation,” in TELKOMNIKA Telecommunication, Computing, Electronics and Control, vol.19, no.2, pp. 479-490, 2021.

T. Kobchaisawat and T. H. Chalidabhongse, “Thai Text Localization in Natural Scene Images using Convolutional Neural Network,” The 2014 Signal and Information Processing Association Annual Summit and Conference, Siem Reap, Cambodia, 2014.

L. Mookdarsanit and P. Mookdarsanit, "Combating the Hate Speech in Thai Textual Memes," in Indonesian Journal of Electrical Engineering and Computer Science, vol. 21, no. 3, pp.1493-1502, 2021.

P. Mookdarsanit and M. Rattanasiriwongwut, “Location Estimation of a Photo: A geo-signature MapReduce Workflow,” in Engineering Journal, vol.21, no.3, pp.295-308, May 2017.

P. Mookdarsanit and L. Mookdarsanit, “Contextual Image Classification towards Metadata Annotation of Thai-tourist Attractions,” in ITMSoc Transactions on Information Technology Management, vol.3, no.1, pp. 32-40, 2018.

L. Soimart and P. Mookdarsanit, “Name with GPS Auto-tagging of Thai-tourist Attractions from An Image,” The 1017 Technology Innovation Management and Engineering Science International Conference, Nakhon Pathom, Thailand, 2017, pp. 211-217.

P. Fugthong and P. Meesad, “Buddha Amulet Information Retrieval using Digital Images Combined with Feature Extraction and K-nearest Neighbor Techniques,” in Information Technology Journal, vol.6, no. 2, pp. 34-40, 2013. [in Thai].

L. Mookdarsanit, “The Intelligent Genuine Validation beyond Online Buddhist Amulet Market,” in International Journal of Applied Computer Technology and Information Systems, vol.9, no.2, pp.7-11, 2019.

M. Rattanasiriwongwut and P. Mookdarsanit, “MONTEAN Framework: A Magnificent Outstanding Native-Thai and Ecclesiastical Art Network,” in International Journal of Applied Computer Technology and Information Systems, vol.6, no.2, pp.17-22, 2017.

P. Mookdarsanit and M. Rattanasiriwongwut, "GPS Determination of Thai-temple Arts from a Single Photo," The 11th International Conference on Applied Computer Technology and Information Systems, Bangkok, January 2017, pp. 42-47.

L. Soimart, et al., “The Segmentation of Satellite Image Using Transport Mean-shift Algorithm,” 13th International Conference on IT Applications and Management, 2015, pp. 124-128.

L. Soimart and M. Ketcham, “An efficient algorithm for earth surface interpretation from satellite imagery,” in Engineering Journal, vol.20, no.5, pp.215-228, Nov. 2016.

L. Mookdarsanit and P. Mookdarsanit, "The Insights in Computer Literacy toward HR Intelligence: Some Associative Patterns between IT Subjects and Job Positions," in Journal of Science and Technology RMUTSB, vol. 6, no. 2, pp. 12-23, 2020.

L. Soimart, et al., “Gender Estimation of a Portrait: Asian Facial-significance Framework,” The 6th International Conference on Sciences and Social Sciences, Mahasarakham, Thailand, 2016.

H. A. Son, W. Jeon, J. Kim, C. Y. Heo, H. J. Yoon, J-U. Park and T-M. Chung AI-based Localization and Classification of Skin Disease with Erythema," in Scientific Reports , vol. 11, no.1, 2021.

H-H. Li, Y-H. Liao, Y-N Huang and P-J. Cheng, "Based on Machine Learning for Personalized Skin Care Products Recommendation Engine," The 2020 International Symposium on Computer, Consumer and Control, Taiwan, November 2020, pp. 460-462.

K. Min, G-H. Lee and S-W. Lee, “ACNet: Mask-Aware Attention with Dynamic Context Enhancement for Robust Acne Detection,” The 2021 IEEE International Conference on Systems, Man, and Cybernetics, Melbourne, Australia, 2021, pp. 2724-2729.

A. K. Prodeep, R. Araf, P. Ray, Md. S. A. Ulubbi, S. N. Ananna and M. F. Mridha, “Acne and Rosacea Detection from Images using Deep CNN's EfficientNet,” The 2022 International Conference on Advances in Computing, Communication and Applied Informatics, Chennai, India, 2022, pp. 1-7.

J. Redmon and A. Farhadi, “YOLOv3: An Incremental Improvement,” in arXiv:1804.02767, 2018.

Z. Zou, Z. Shi, Y. Guo and J. Ye, “Object Detection in 20 Years: A Survey,” in arXiv:1905.05055, 2019.

S. Ren, K. He, R. Girshick and J. Sun, “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,” in arXiv:1506.01497, 2015.

P. Mookdarsanit, et al., "ThaiWrittenNet: Thai Handwritten Script Recognition Using Deep Neural Networks," in Azerbaijan Journal of High Performance Computing, vol. 3, no. 1, pp. 75-93.

P. Mookdarsanit and L. Mookdarsanit, "TGF-GRU: A Cyber-bullying Autonomous Detector of Lexical Thai across Social Media," in NKRAFA Journal of Science and Technology, vol. 15, no. 1, pp.50-58, 2019.

L. Mookdarsanit and P. Mookdarsanit, "Thai NLP-based Text Classification of the 21st-century Skills toward Educational Curriculum and Project Design," in International Journal of Applied Computer Technology and Information Systems, vol. 11, no. 2, pp.62-67, 2021.

L. Mookdarsanit and P. Mookdarsanit, " ThaiWritableGAN: Handwriting Generation under Given Information," in International Journal of Computing and Digital Systems, vol. 10, no. 1, pp. 689-699, 2021.

Shuster, S. Humeau, H. Hu, A. Bordes and J. Weston, "Engaging Image Captioning via Personality," The 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 2019, pp. 12508-12518.

P. Mookdarsanit and L. Mookdarsanit, "Thai-IC: Thai Image Captioning based on CNN-RNN Architecture," in International Journal of Applied Computer Technology and Information Systems, vol. 10, no. 1, pp.40-45, 2020.

C. Saharia, et al., “Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding,” in arXiv: 2205.11487, 2022.

R. Rombach, A. Blattmann, D. Lorenz, P. Esser and B. Ommer, “High-Resolution Image Synthesis with Latent Diffusion Models,” in arXiv:2112.10752, 2021.

A. Ramesh, et al., “Zero-Shot Text-to-Image Generation,” in arXiv: 2102.12092, 2021.

A. Ramesh, et al., “Hierarchical Text-Conditional Image Generation with CLIP Latents,” in arXiv: 2204.06125, 2022.

O. Gafni, A. Polyak, O. Ashual, S. Sheynin, D. Parikh and Y. Taigman., “Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors,” in arXiv: 2203.13131, 2022.

S. Loffe and C. Szegedy, “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift,” in arXiv: 1502.03167, 2015.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” in arXiv: 1512.03385, 2015.

P. Jiang, D. Ergu, F. Liu, Y. Cai and B. Ma, "A Review of YOLO Algorithm Developments," in Procedia Computer Science, vol. 199, pp. 1066-1073, 2022.

J. Redmon and A. Farhadi, “YOLO9000: Better, Faster, Stronger,” in arXiv: 1612.08242, 2016.

“LabelImg,” [Online]. Available: https://github.com/heartexlabs/labelImg

W. Lui, et al. , “SSD: Single Shot MultiBox Detector,” in arXiv:1512.02325, 2015.


Refbacks

  • There are currently no refbacks.