Detection And Classification Of Post-Harvest Quality Using A Hybrid Ssd-Efficientnetv2 Model Based On Transfer Learning For Tomato Fruit

Authors

  • Edga Sukma Pratama Universitas Nusantara PGRI Kediri
  • Danar Putra Pamungkas Faculty of Engineering and Computer Science, Informatics Engineering, Universitas Nusantara PGRI Kediri
  • Made Ayu Dusea Widyadara Faculty of Engineering and Computer Science, Informatics Engineering, Universitas Nusantara PGRI Kediri
  • Boyang (Tony) Yu Electrical and Computer Engineering, Rice University, Houston, Texas, United States

DOI:

https://doi.org/10.24269/mtkind.v20i1.13819

Keywords:

Deep Learning, Single Shot Detector, EfficientNetV2, Tomato Classification, Object Detection

Abstract

Manual post-harvest sorting of tomato fruit is prone to subjectivity and inconsistency, necessitating an automated quality assessment approach. Single Shot Detector (SSD) and EfficientNetV2 are both included in the Deep Learning architecture for efficient object detection and classification. This research develops a hybrid model that processes SSD data through a single direct detection, making it lighter than other methods, while EfficientNetV2 serves as the backbone model, capable of producing deep features efficiently. The design of the hybrid SSD-EfficientNetV2 model for the automatic detection and classification of tomato fruit quality (Solanum lycopersicum) into two classes, namely Grade A with fresh and marketable fruit conditions and Grade B with damaged or rotten conditions, is expected to replace the manual sorting process, which is prone to inconsistencies. The data was directly collected from the sales centers and local tomato farms in Nganjuk Regency. The obtained data underwent preprocessing, including resizing, normalization, and augmentation in the form of brightness adjustment, contrast, and hue saturation manipulation. The data is divided into 60% training data, 15% validation data, and 25% testing data. The model was trained for 32 epochs using the AdamW optimizer with a learning rate warm-up and cosine decay scheme. The final evaluation resulted in a classification accuracy of 95.12%, a macro F1 Score of 95.11%, and a Mean Average Precision (mAP) of 85.70% with a precision of Grade A at 94.87% and Grade B at 95.35%. The proposed model offers a reliable contribution as a foundation for an artificial intelligence-based sorting system in the post-harvest tomato industry.

Downloads

Download data is not yet available.

References

[1] J. Vitasari, R. R. Nugroho, Muhammad Andra Kusuma Ramadhan, Owen Pratama Endramawan, and Mochammad Rifki Ulil Albaab, “Smart Conveyor Real-Time Sort Rotten Tomatoes With Deep Learning Method Integrated IoT Control,” JURNAL ILMIAH RESEARCH AND DEVELOPMENT STUDENT, vol. 3, no. 1, pp. 242–255, Jan. 2025, doi: 10.59024/jis.v3i1.1135.

[2] M. Tan and Q. V Le, “EfficientNetV2: Smaller Models and Faster Training,” CoRR, vol. abs/2104.00298, 2021, [Online]. Available: https://arxiv.org/abs/2104.00298

[3] H. S. Mputu, A. Abdel-Mawgood, A. Shimada, and M. S. Sayed, “Tomato Quality Classification Based on Transfer Learning Feature Extraction and Machine Learning Algorithm Classifiers,” IEEE Access, vol. 12, pp. 8283–8295, 2024, doi: 10.1109/ACCESS.2024.3352745.

[4] S. Aras, P. Tanra, and M. Bazhar, “Deteksi Tingkat Kematangan Buah Tomat Menggunakan YOLOv5,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 4, no. 2, pp. 623–628, Mar. 2024, doi: 10.57152/malcom.v4i2.1270.

[5] A. Mustopa, U. Khultsum, R. Sabaruddin, R. Ikhsanda, and H. Firmansyah, “Penerapan Model EfficientNetV2L Dalam Mendeteksi Citra Penyakit Daun Tomat untuk Meningkatkan Hasil Panen Petani,” Journal of Information System Research (JOSH), vol. 6, no. 1, pp. 100–107, Oct. 2024, doi: 10.47065/josh.v6i1.5886.

[6] M. R. Adidama, R. B. Samudra, W. A. Arrosyid, R. Samsinar, and R. D. Risanty, “Comparison of You Only Look Once (YOLO) and Single Shot Multibox Detector (SSD) Methods for Object Detection Using OpenCV,” 2025.

[7] M. Xu et al., “Embracing Limited and Imperfect Data: A Review on Plant Stress Recognition Using Deep Learning,” CoRR, vol. abs/2305.11533, 2023, doi: 10.48550/ARXIV.2305.11533.

[8] M. Palumbo, M. Cefola, B. Pace, G. Attolico, and G. Colelli, “Computer vision system based on conventional imaging for non-destructively evaluating quality attributes in fresh and packaged fruit and vegetables,” Jun. 01, 2023, Elsevier B.V. doi: 10.1016/j.postharvbio.2023.112332.

[9] R. Nithya, B. Santhi, R. Manikandan, M. Rahimi, and A. H. Gandomi, “Computer Vision System for Mango Fruit Defect Detection Using Deep Convolutional Neural Network,” Foods, vol. 11, no. 21, Nov. 2022, doi: 10.3390/foods11213483.

[10] M. Iqbal, D. M. Midyanti, and S. Bahri, “Deteksi Objek Manusia Pada Citra Menggunakan Single Shot Detector (SSD) Berbasis Edge Computing,” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 11, no. 3, pp. 547–556, Jul. 2024, doi: 10.25126/jtiik.938446.

[11] Badan Pusat Statistik Indonesia, “Statistik Indonesia Statistical yearbook of Indonesia,” Feb. 2024.

[12] G. Liu, Z. Hou, H. Liu, J. Liu, W. Zhao, and K. Li, “TomatoDet: Anchor-free detector for tomato detection,” Front. Plant Sci., vol. Volume 13-2022, 2022, doi: 10.3389/fpls.2022.942875.

[13] M. Tan and Q. V Le, “EfficientNetV2: Smaller Models and Faster Training,” 2021. [Online]. Available: https://github.com/google/

[14] R. R. Pratama, “Analisis Model Machine Learning Terhadap Pengenalan Aktifitas Manusia,” MATRIK: Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer, vol. 19, no. 2, pp. 302–311, May 2020, doi: 10.30812/matrik.v19i2.688.

[15] X. Ye, T. Ma, and B. Xiao, “Starting from Zero: A No-Pretraining Object Detectors,” Jun. 26, 2024. doi: 10.21203/rs.3.rs-4557206/v1.

[16] S. Elfwing, E. Uchibe, and K. Doya, “Sigmoid-weighted linear units for neural network function approximation in reinforcement learning,” Neural Networks, vol. 107, pp. 3–11, 2018, doi: https://doi.org/10.1016/j.neunet.2017.12.012.

[17] M. Zand, A. Etemad, and M. Greenspan, “Oriented Bounding Boxes for Small and Freely Rotated Objects,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1–15, 2022, doi: 10.1109/tgrs.2021.3076050.

[18] N. Thakur, P. Nagrath, R. Jain, D. S. Saini, N. Sharma, and J. D. Hemanth, “Object Detection in Deep Surveillance,” 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:243490911

[19] W. Liu et al., “SSD: Single Shot MultiBox Detector,” Dec. 2016, doi: 10.1007/978-3-319-46448-0_2.

[20] N. Thakur, P. Nagrath, R. Jain, D. Saini, N. Sharma, and J. Hemanth, “Object Detection in Deep Surveillance,” Res. Sq., 2021, doi: 10.21203/rs.3.rs-901583/v1.

[21] J. M. López-Correa, H. Moreno, A. Ribeiro, and D. Andújar, “Intelligent Weed Management Based on Object Detection Neural Networks in Tomato Crops,” Agronomy, vol. 12, no. 12, 2022, doi: 10.3390/agronomy12122953.

[22] A. Tharwat, “Classification assessment methods,” Applied Computing and Informatics, p., 2020, doi: 10.1016/j.aci.2018.08.003.

[23] M. Sokolova and G. Lapalme, “A systematic analysis of performance measures for classification tasks,” Inf. Process. Manag., vol. 45, no. 4, pp. 427–437, 2009, doi: https://doi.org/10.1016/j.ipm.2009.03.002.

[24] D. P. Pamungkas and M. F. Amrulloh, “ANALISIS HASIL KLASIFIKASI PENYAKIT DAUN BAWANG MERAH MENGGUNAKAN CNN ARSITEKTUR EXCEPTION,” JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika), vol. 10, no. 1, pp. 359–366, Jan. 2025, doi: 10.29100/jipi.v10i1.5875.

Downloads

Published

2026-05-30

How to Cite

Edga Sukma Pratama, Danar Putra Pamungkas, Made Ayu Dusea Widyadara, & Boyang (Tony) Yu. (2026). Detection And Classification Of Post-Harvest Quality Using A Hybrid Ssd-Efficientnetv2 Model Based On Transfer Learning For Tomato Fruit. MULTITEK INDONESIA : JURNAL ILMIAH, 20(1), 58–70. https://doi.org/10.24269/mtkind.v20i1.13819