Sistem Pengolahan Citra Digital Untuk Mendeteksi Ekspresi Wajah Secara Real-Time Menggunakan Deep Learning YOLOv5

Authors

  • Putri Adelia Khairunnisa Politeknik Negeri Jember
  • Rachmadani Anggowo Rizky Politeknik Negeri Jember
  • Moh. Ferdi Ardiansyah Politeknik Negeri Jember
  • Miftahur Rahman Politeknik Negeri Jember
  • Herlambang Satria Wijaya Politeknik Negeri Jember
  • Mochammad Rifki Ulil Albaab Politeknik Negeri Jember

DOI:

https://doi.org/10.61722/jirs.v2i1.3917

Keywords:

Face Expression detection, Yolov5, Deep Learning, Confusion Matrix

Abstract

The development of artificial intelligence (AI) technology encourages innovation in image processing and computer vision, one of which is a real-time facial expression detection system. This research aims to develop a system based on the YOLOv5 method and deep learning algorithms to detect facial expressions, such as neutral and smile, with high accuracy. The system is designed using training data processed through Roboflow, including dataset collection, labeling, and augmentation. The performance evaluation of the model was conducted using confusion matrix with accuracy, precision, recall, and F1-Score values, which showed an average accuracy of up to 99.6% with increasing datasets. The real-time system test results show the success of detecting facial expressions even when faced with variations in environmental conditions. This system has the potential to be applied in various fields, such as human-machine interaction, security, and education, and can be improved by increasing the variety of expressions recognized and integrating expert systems for more complex emotion analysis.

References

Agustinus, Andi, Rudi Kurniawan, And Harma Oktafia Lingga Wijaya. 2023. “Klasifikasi Emosi Melalui Ekspresi Wajah Menggunakan Algoritma Deep Learning.”

Amanda, Afdal Zikri, Dyta Puji Lestari, Junaidi Ahmad Basori, And Risa Satifa. 2023. “Perbandingan Metode You Only Look Once (Yolo) Dan Metode Single Shot Detector (Ssd) Dalam Pendeteksian Objek Dengan Fokus Pada Wajah.” 1(1).

Daffa Ulhaq, Muhammad Rifqi, Muammar Alfien Zaidan, And Diash Firdaus. 2023. “Pengenalan Ekspresi Wajah Secara Real-Time Menggunakan Metode Ssd Mobilenet Berbasis Android.” Journal Of Technology And Informatics (Joti) 5(1):48–52. Doi: 10.37802/Joti.V5i1.387.

Manongga, Danny, Untung Rahardja, Irwan Sembiring, Ninda Lutfiani, And Ahmad Bayu Yadila. 2022. “Dampak Kecerdasan Buatan Bagi Pendidikan.” Adi Bisnis Digital Interdisiplin Jurnal 3(2):41–55. Doi: 10.34306/Abdi.V3i2.792.

Mulyana, Dadang Iskandar, Aris Sufriman, And Mesra Betty Yel. 2023. “Implementasi Deteksi Emosional Pada Wajah Menggunakan Deep Learning - Yolov5.” 4.

Saputri, Anisa Pratiwi, Ahmad Taqwa, And Sopian Soim. 2022. “Analisis Deteksi Objek Citra Digital Menggunakan Algoritma Yolo Dan Cnn Dengan Arsitektur Repvgg Pada Sistem Pendeteksian Dan Pengenalan Ekspresi Wajah.” 7(9).

Downloads

Published

2025-01-22

Issue

Section

Articles