BRIDGING DEEP LEARNING AND ADAPTIVE SYSTEMS: A PERFORMANCE STUDY ON CIFAR-10 IMAGE CLASSIFICATION
DOI:
https://doi.org/10.55640/ijidml-v02i03-01Keywords:
Deep learning, Adaptive systems, Image classification, CIFAR-10Abstract
Image classification is a fundamental task in computer vision, with applications spanning from medical diagnostics to autonomous driving. This study presents a comparative analysis of Convolutional Neural Networks (CNNs) and a representative adaptive system approach, specifically K-Nearest Neighbors (KNN), for image classification on the CIFAR-10 dataset. CNNs, known for their hierarchical feature learning capabilities, have revolutionized the field, while adaptive systems like KNN represent a class of algorithms that dynamically adjust their decision boundaries based on data relationships. The CIFAR-10 dataset, comprising 60,000 32x32 color images across 10 classes, serves as the benchmark [1]. Our methodology involves training a custom CNN architecture and applying KNN, with careful consideration of preprocessing and hyperparameter tuning for both models. Performance is evaluated using accuracy, precision, recall, and F1-score. Experimental results indicate that CNNs significantly outperform the KNN approach on this dataset, demonstrating their superior ability to extract and learn complex, invariant features from raw image data. This research highlights the inherent strengths of deep learning architectures in handling the intricacies of visual data while also providing insights into the characteristics where simpler adaptive systems might fall short or excel.
References
The CIFAR-10 dataset, https://www.cs.toronto.edu/~kriz/cifar.html
Krizhevsky, A., Sutskever, I. and Hinton, G. E., ImageNet Classification with Deep Convolutional Neural Networks NIPS 2012: Neural Information Processing Systems, Lake Tahoe, Nevada
Hinton, G. E., Krizhevsky, A., & Wang, S. (2011). Transforming auto-encoders. In International Conference on Artificial Neural Networks. Helsinki, Finland.
Sharma, N., Jain, V., & Mishra, A. (2018). An analysis of convolutional neural networks for image classification. In International Conference on Computational Intelligence and Data Science (ICCIDS 2018). Procedia Computer Science, 132, 377-384.
Brownlee, J. (2019). How to develop a CNN from scratch for CIFAR-10 photo classification
Yang, L., He, Z., & Fan, D. (2018). A fully on-chip binarized convolutional neural network FPGA implementation with accurate inference. In Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED '18) (pp. 50-55). July, 2018. doi: 10.1145/3218603.3218615.
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional Neural Networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS 2012), (pp. 1097-1105). Lake Tahoe, Nevada, USA.
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84-90. doi: 10.1145/3065386.
Mukta Jagdish, E.R. Aruna, Gaddam Hrithik Goud, Tejashwini Gundlapally, Katteboina Sai Charan Tej, Digital Method to Talk with Machine Using Image Processing and Machine Learning Techniques, International Journal of Advanced Research in Engineering and Technology (IJARET), 13(8), 2022, pp. 18-26. doi: https://doi.org/10.17605/OSF.IO/B2MXH
Fei-Fei, L., Fergus, R., & Perona, P. (2007). Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories. Computer Vision and Image Understanding, 106(1), 59-70.
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2013). Improving neural networks by preventing co-adaptation of feature detectors. In Proceedings of the 30th International Conference on Machine Learning (ICML 2013), (pp. 1-9). Atlanta, Georgia, USA
Fang, U., Li, J., Lu, X., Mian, A., & Gu, Z. (2023). Robust image clustering via context-aware contrastive graph learning. Pattern Recognition, 138, 109340. doi: 10.1016/j.patcog.2023.109340.
S. Balasubramanian, SQuAD 2.0: A Comprehensive Overview of the Dataset and Its Significance in Question Answering Research, International Journal of Artificial Intelligence Research and Development (IJAIRD), 1(1), 2023, pp. 1-14 doi: https://doi.org/10.17605/OSF.IO/ENKPH
Mukta Jagdish, E.R. Aruna, Gaddam Hrithik Goud, Tejashwini Gundlapally, Katteboina Sai Charan Tej, Digital Method to Talk with Machine Using Image Processing and Machine Learning Techniques, International Journal of Advanced Research in Engineering and Technology (IJARET), 13(8), 2022, pp. 18-26. doi: https://doi.org/10.17605/OSF.IO/B2MXH
P Manjula and R Kalaivani, Processing of Medical Images from Large Datasets using Convolutional Neural Network, International Journal of Advanced Research in Engineering and Technology (IJARET), 12(3), 2021, pp. 922-927 doi: https://doi.org/10.17605/OSF.IO/9SCV7
K K Ramachandran, Predicting Supermarket Sales with Big Data Analytics: A Comparative Study of Machine Learning Techniques, International Journal of Data Analytics (IJDA), 1(1), 2023, pp. 1-11 doi: https://doi.org/10.17605/OSF.IO/UTNMW
Mayank R. Kapadia and Chirag N. Paunwala, Multi-Channel Convolution Neural Network for Accurate CBMIR System with Reduced Semantic Gap, International Journal of Advanced Research in Engineering and Technology, 12(1), 2021, pp. 159-172. doi: 10.34218/IJARET.12.1.2021.013
Buda, M., Maki, A., & Mazurowski, M. A. (2018). A systematic study of the class imbalance problem in convolutional neural networks. Neural Networks, 106, 249-259.
Adiwangsa, M. (2018). Classification of Images from the CIFAR10 Dataset: A Deep Learning Approach Using Convolutional Neural Networks. http://users.cecs.anu.edu.au/~Tom.Gedeon/conf/ABCs2018/paper/ABCs2018_paper_124.pdf
Abouelnaga, Y., Girgis, M., & Elsharnoby, M. (2016). CIFAR-10: KNN-Based Ensemble of Classifiers. 2016 International Conference on Computational Science and Computational Intelligence (CSCI), 1192-1195. doi: 10.1109/CSCI.2016.0107
Majumdar, S., & Jain, I. (2016). Deep Columnar Convolutional Neural Network. International Journal of Computer Applications, 145(12), 25-32.
Lecun, Y., Huang, F. J., & Bottou, L. (2004). Learning methods for generic object recognition with invariance to pose and lighting. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004 (Vol. 2, pp. II-97). IEEE.
Mukta Jagdish, E.R. Aruna, Gaddam Hrithik Goud, Tejashwini Gundlapally, Katteboina Sai Charan Tej, Digital Method to Talk with Machine Using Image Processing and Machine Learning Techniques, International Journal of Advanced Research in Engineering and Technology (IJARET), 13(8), 2022, pp. 18-26. doi: https://doi.org/10.17605/OSF.IO/B2MXH
PapersWithCode. (2023). Image Classification on CIFAR-10 - SOTA. Retrieved May 5, 2022, from https://paperswithcode.com/sota/image-classification-on-cifar-10
Melnik, E.V., Klimenko, A.B. (2020). A Peer-to-Peer Crowdsourcing Platform for the Labeled Datasets Forming. In: Silhavy, R. (eds) Applied Informatics and Cybernetics in Intelligent Systems. CSOC 2020. Advances in Intelligent Systems and Computing, vol 1226. Springer, Cham. https://doi.org/10.1007/978-3-030-51974-2_9
Rohit Khankhoje, "Beyond Coding: A Comprehensive Study of Low-Code, No-Code and Traditional Automation," Journal of Artificial Intelligence & Cloud Computing, vol. 1, no. 4, pp. 1-5, 2022. DOI: 10.47363/JAICC/2022(1)148.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Dr. Hannah Brown, Ahmed Al-Farsi (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain the copyright of their manuscripts, and all Open Access articles are disseminated under the terms of the Creative Commons Attribution License 4.0 (CC-BY), which licenses unrestricted use, distribution, and reproduction in any medium, provided that the original work is appropriately cited. The use of general descriptive names, trade names, trademarks, and so forth in this publication, even if not specifically identified, does not imply that these names are not protected by the relevant laws and regulations.