Open Access

BRIDGING DEEP LEARNING AND ADAPTIVE SYSTEMS: A PERFORMANCE STUDY ON CIFAR-10 IMAGE CLASSIFICATION

https://doi.org/10.55640/ijidml-v02i03-01

pdf

Dr. Hannah Brown ¹ , Ahmed Al-Farsi ¹ ,

⁴ School of Computing and Information Systems, University of Melbourne, Australia

⁴ College of Information Technology, Sultan Qaboos University, Oman

Abstract

Image classification is a fundamental task in computer vision, with applications spanning from medical diagnostics to autonomous driving. This study presents a comparative analysis of Convolutional Neural Networks (CNNs) and a representative adaptive system approach, specifically K-Nearest Neighbors (KNN), for image classification on the CIFAR-10 dataset. CNNs, known for their hierarchical feature learning capabilities, have revolutionized the field, while adaptive systems like KNN represent a class of algorithms that dynamically adjust their decision boundaries based on data relationships. The CIFAR-10 dataset, comprising 60,000 32x32 color images across 10 classes, serves as the benchmark [1]. Our methodology involves training a custom CNN architecture and applying KNN, with careful consideration of preprocessing and hyperparameter tuning for both models. Performance is evaluated using accuracy, precision, recall, and F1-score. Experimental results indicate that CNNs significantly outperform the KNN approach on this dataset, demonstrating their superior ability to extract and learn complex, invariant features from raw image data. This research highlights the inherent strengths of deep learning architectures in handling the intricacies of visual data while also providing insights into the characteristics where simpler adaptive systems might fall short or excel.

Keywords

Deep learning, Adaptive systems, Image classification, CIFAR-10

References

The CIFAR-10 dataset, https://www.cs.toronto.edu/~kriz/cifar.html

Krizhevsky, A., Sutskever, I. and Hinton, G. E., ImageNet Classification with Deep Convolutional Neural Networks NIPS 2012: Neural Information Processing Systems, Lake Tahoe, Nevada

Hinton, G. E., Krizhevsky, A., & Wang, S. (2011). Transforming auto-encoders. In International Conference on Artificial Neural Networks. Helsinki, Finland.

Sharma, N., Jain, V., & Mishra, A. (2018). An analysis of convolutional neural networks for image classification. In International Conference on Computational Intelligence and Data Science (ICCIDS 2018). Procedia Computer Science, 132, 377-384.

Brownlee, J. (2019). How to develop a CNN from scratch for CIFAR-10 photo classification

Yang, L., He, Z., & Fan, D. (2018). A fully on-chip binarized convolutional neural network FPGA implementation with accurate inference. In Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED '18) (pp. 50-55). July, 2018. doi: 10.1145/3218603.3218615.

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional Neural Networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS 2012), (pp. 1097-1105). Lake Tahoe, Nevada, USA.

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84-90. doi: 10.1145/3065386.

Mukta Jagdish, E.R. Aruna, Gaddam Hrithik Goud, Tejashwini Gundlapally, Katteboina Sai Charan Tej, Digital Method to Talk with Machine Using Image Processing and Machine Learning Techniques, International Journal of Advanced Research in Engineering and Technology (IJARET), 13(8), 2022, pp. 18-26. doi: https://doi.org/10.17605/OSF.IO/B2MXH

Fei-Fei, L., Fergus, R., & Perona, P. (2007). Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories. Computer Vision and Image Understanding, 106(1), 59-70.

Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2013). Improving neural networks by preventing co-adaptation of feature detectors. In Proceedings of the 30th International Conference on Machine Learning (ICML 2013), (pp. 1-9). Atlanta, Georgia, USA

Fang, U., Li, J., Lu, X., Mian, A., & Gu, Z. (2023). Robust image clustering via context-aware contrastive graph learning. Pattern Recognition, 138, 109340. doi: 10.1016/j.patcog.2023.109340.

S. Balasubramanian, SQuAD 2.0: A Comprehensive Overview of the Dataset and Its Significance in Question Answering Research, International Journal of Artificial Intelligence Research and Development (IJAIRD), 1(1), 2023, pp. 1-14 doi: https://doi.org/10.17605/OSF.IO/ENKPH

P Manjula and R Kalaivani, Processing of Medical Images from Large Datasets using Convolutional Neural Network, International Journal of Advanced Research in Engineering and Technology (IJARET), 12(3), 2021, pp. 922-927 doi: https://doi.org/10.17605/OSF.IO/9SCV7

K K Ramachandran, Predicting Supermarket Sales with Big Data Analytics: A Comparative Study of Machine Learning Techniques, International Journal of Data Analytics (IJDA), 1(1), 2023, pp. 1-11 doi: https://doi.org/10.17605/OSF.IO/UTNMW

Mayank R. Kapadia and Chirag N. Paunwala, Multi-Channel Convolution Neural Network for Accurate CBMIR System with Reduced Semantic Gap, International Journal of Advanced Research in Engineering and Technology, 12(1), 2021, pp. 159-172. doi: 10.34218/IJARET.12.1.2021.013

Buda, M., Maki, A., & Mazurowski, M. A. (2018). A systematic study of the class imbalance problem in convolutional neural networks. Neural Networks, 106, 249-259.

Adiwangsa, M. (2018). Classification of Images from the CIFAR10 Dataset: A Deep Learning Approach Using Convolutional Neural Networks. http://users.cecs.anu.edu.au/~Tom.Gedeon/conf/ABCs2018/paper/ABCs2018_paper_124.pdf

Abouelnaga, Y., Girgis, M., & Elsharnoby, M. (2016). CIFAR-10: KNN-Based Ensemble of Classifiers. 2016 International Conference on Computational Science and Computational Intelligence (CSCI), 1192-1195. doi: 10.1109/CSCI.2016.0107

Majumdar, S., & Jain, I. (2016). Deep Columnar Convolutional Neural Network. International Journal of Computer Applications, 145(12), 25-32.

Lecun, Y., Huang, F. J., & Bottou, L. (2004). Learning methods for generic object recognition with invariance to pose and lighting. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004 (Vol. 2, pp. II-97). IEEE.

PapersWithCode. (2023). Image Classification on CIFAR-10 - SOTA. Retrieved May 5, 2022, from https://paperswithcode.com/sota/image-classification-on-cifar-10

Melnik, E.V., Klimenko, A.B. (2020). A Peer-to-Peer Crowdsourcing Platform for the Labeled Datasets Forming. In: Silhavy, R. (eds) Applied Informatics and Cybernetics in Intelligent Systems. CSOC 2020. Advances in Intelligent Systems and Computing, vol 1226. Springer, Cham. https://doi.org/10.1007/978-3-030-51974-2_9

Rohit Khankhoje, "Beyond Coding: A Comprehensive Study of Low-Code, No-Code and Traditional Automation," Journal of Artificial Intelligence & Cloud Computing, vol. 1, no. 4, pp. 1-5, 2022. DOI: 10.47363/JAICC/2022(1)148.

International Journal of Intelligent Data and Machine Learning

BRIDGING DEEP LEARNING AND ADAPTIVE SYSTEMS: A PERFORMANCE STUDY ON CIFAR-10 IMAGE CLASSIFICATION

Abstract

Keywords

References

Most read articles by the same author(s)

Similar Articles