Open Access

A Survey on Deep Learning Approaches for Malware Detection and Classification

4 Assistant Professor, Department of Computer Science and Applications, Mandsaur, India

Abstract

Malware is a serious threat in the cybersecurity area because of its dynamic nature, the variety of malware families, stealth, propagation and the capability of evading traditional security products. Therefore, proper malware detection and classification are crucial for detecting malicious software and for securing computer systems from unauthorized access and data stealing, and for disrupting systems. This study covers all the bases when it comes to deep learning approaches for malware detection and classification. It covers the principles, different forms of malware, how to detect deep learning malware, how to represent data, obtaining features, and applications. The traditional detection methods are described with their drawbacks, namely based on signature, behavioral and heuristic methods. The report also delves into the methodologies used by deep learning to classify malware, namely CNNs and Bidirectional Long Short-Term Memory (BiLSTM) networks. BiLSTM models excel at learning sequential features from code-or behavior-related data, whereas CNN-based representation learning approaches excel at learning spatial features from malware representations. Moreover, the various detection techniques (static, dynamic and hybrid) are discussed so that their role in malware analysis can be understood. The survey identifies the current challenges and gaps in research and emphasizes the need for strong, scalable and adaptive deep-learning models to combat new malware threats and enhance cybersecurity protection.

Keywords

References

A. Souri, M. Norouzi, and P. Asghari, “An analytical automated refinement approach for structural modeling large-scale codes using reverse engineering,” Int. J. Inf. Technol., vol. 9, no. 4, pp. 329–333, 2017, doi: 10.1007/s41870-017-0050-7.
S. R. Somula, “Intelligent Fraud Prevention: Implementing AML Solutions For Mcca Reimbursement Claims Protection,” Int. J. Comput. Eng. Technol., vol. 16, no. 1, pp. 3609–3622, Feb. 2025, doi: 10.34218/IJCET_16_01_249.
P. Kumar, “A Zero Trust-Based Approach to Modern Cybersecurity Challenges in Software Development,” Int. J. Emerg. Res. Eng. Technol., vol. 6, no. 9, pp. 113–122, September, 2025.
L. Caviglione et al., “Tight Arms Race: Overview of Current Malware Threats and Trends in Their Detection,” IEEE Access, vol. 9, pp. 5371–5396, 2021, doi: 10.1109/ACCESS.2020.3048319.
S. P. Sivashanmugam, S. Kumara, A. Mohile, and D. R. Suram, “Improving Detection Accuracy of Phishing Attacks with Feature Selection and Machine Learning Techniques in Cybersecurity,” in 2026 1st International Conference on Emerging Trends in Advancements and Applications of Computational Intelligence Techniques (ETAACT), Bhubaneswar, India: IEEE, 2026, pp. 1–6, April. doi: 10.1109/ETAACT69135.2026.11542138.
U. Urooj, B. A. S. Al-Rimy, A. Zainal, F. A. Ghaleb, and M. A. Rassam, “Ransomware Detection Using the Dynamic Analysis and Machine Learning: A Survey and Research Directions,” Appl. Sci., vol. 12, no. 1, 2022, doi: 10.3390/app12010172.
Y. LeCun and G. Hinton, “Deep Learning,” Nature, vol. 521, pp. 436–444, 2015, doi: 10.1038/nature14539.
X. Zhang, K. Wu, Z. Chen, and C. Zhang, “Malcaps: A capsule network based model for the malware classification,” Processes, vol. 9, no. 6, 2021, doi: 10.3390/pr9060929.
V. Koppireddy, D. G. Parasad, D. Patel, S. R. Somula, V. Kamaraj, and A. Meher, “AI Security Governance for Trustworthy Intelligent Systems: A Critical Analysis of Cyber Risks, Privacy Threats, and Responsible Deployment Frameworks,” Int. J. Res. Trends Innov., vol. 11, no. 07, pp. a407–a435, July, 2026, doi: 10.56975/ijrti.v11i7.214029.
T. Lu, Y. Du, L. Ouyang, Q. Chen, and X. Wang, “Android Malware Detection Based on a Hybrid Deep Learning Model,” Secur. Commun. Networks, vol. 2020, pp. 1–11, 2020, doi: 10.1155/2020/8863617.
S. Chatterjee, “Advanced Malware Detection in Operational Technology: Signature-Based Vs. Behaviour-Based Approaches,” ESP J. Eng. Technol. Adv., vol. 1, no. 1, pp. 272–279, 2021, doi: 10.56472/25832646/JETA-V1I2P128.
M. Stamp, M. Alazab, and A. Shalaginov, Malware Analysis Using Artificial Intelligence and Deep Learning. 2021. doi: 10.1007/978-3-030-62582-5.
X. S. Nguyen and H. Nguyen, “A Malware Family Classification Approach Based on Deep Sequence Modeling,” J. Tech. Educ. Sci., vol. 20, no. 03, pp. 8–15, 2025, doi: 10.54644/jte.2025.1527.
V. K. R. K. Koppireddy, “Passwordless Authentication: Enhancing Security And User Experience In Modern Digital Ecosystems,” Int. J. Inf. Technol. Manag. Inf. Syst., vol. 16, no. 1, pp. 82–96, Feb. 2025, doi: 10.34218/IJITMIS_16_01_008.
S. Kakkar, B. Makkena, A. Chaudhary, and A. Kakkar, “Explainable Machine Learning Models for Credit Scoring for Risk Forecasting in Big Financial Datasets,” in 2026 2nd International Conference on Cognitive Computing in Engineering, Communications, Sciences and Biomedical Health Informatics (IC3ECSBHI), Greater Noida, (Delhi NCR), India: IEEE, 2026, pp. 1384–1391, February. doi: 10.1109/IC3ECSBHI67834.2026.11469004.
N. K, I. K, S. S, N. V, and A. M, “Deep Learning Based Static Analysis of Malwares in Android Applications,” in Advances in Parallel Computing, vol. 39, 2021. doi: 10.3233/APC210133.
F. A. Aboaoja, A. Zainal, F. A. Ghaleb, B. A. S. Al-rimy, T. A. E. Eisa, and A. A. H. Elnour, “Malware Detection Issues, Challenges, and Future Directions: A Survey,” Appl. Sci., vol. 12, no. 17, p. 8482, Aug. 2022, doi: 10.3390/app12178482.
D. Wael, A. Shosha, and S. G. Sayed, “Malicious VBScript detection algorithm based on data-mining techniques,” in 2017 Intl Conf on Advanced Control Circuits Systems (ACCS) Systems & 2017 Intl Conf on New Paradigms in Electronics & Information Technology (PEIT), 2017, pp. 112–116. doi: 10.1109/ACCS-PEIT.2017.8303028.
A. Khalilian, A. Nourazar, M. Vahidi-Asl, and H. Haghighi, “G3MD: Mining frequent opcode sub-graphs for metamorphic malware detection of existing families,” Expert Syst. Appl., vol. 112, pp. 15–33, Dec. 2018, doi: 10.1016/j.eswa.2018.06.012.
R. Mosli, R. Li, B. Yuan, and Y. Pan, “Automated malware detection using artifacts in forensic memory images,” in 2016 IEEE Symposium on Technologies for Homeland Security (HST), 2016, pp. 1–6. doi: 10.1109/THS.2016.7568881.
S. Kiranyaz, O. Avci, O. Abdeljaber, T. Ince, M. Gabbouj, and D. J. Inman, “1D convolutional neural networks and applications: A survey,” Mech. Syst. Signal Process., vol. 151, p. 107398, 2021, doi: doi.org/10.1016/j.ymssp.2020.107398.
S. Hochreiter and J. Schmidhuber, “Long Short-Term Memory,” Neural Comput., vol. 9, pp. 1735–1780, 1997, doi: 10.1162/neco.1997.9.8.1735.
Y. Song, D. Zhang, J. Wang, Y. Wang, Y. Wang, and P. Ding, “Application of deep learning in malware detection: a review,” J. Big Data, vol. 12, no. 1, p. 99, 2025, doi: 10.1186/s40537-025-01157-y.
A. Mohaisen, O. Alrawi, J. Park, J. Kim, D. Nyang, and M. Mohaisen, “Network-based Analysis and Classification of Malware using Behavioral Artifacts Ordering,” ICST Trans. Secur. Saf., vol. 5, no. 16, p. 156002, 2018, doi: 10.4108/eai.13-7-2018.156002.
G. Abdiyeva-Aliyeva, M. Balayev, and N. Ahmadli, “Deep Learning for Malware Classification in Critical Infrastructure Systems Using Behavioral and Network Indicators,” in 2026 5th International Conference on Sentiment Analysis and Deep Learning (ICSADL), 2026, pp. 1078–1085. doi: 10.1109/ICSADL67539.2026.11451841.
V. S. P. Kumar, K. I. Koushik, K. Pradeep, B. G. V. S. Reddy, J. Avinash, and S. G. Pasha, “Optimized Machine and Deep Learning Approaches for Multi-Class Malware Classification from Text-based Features,” in 2026 International Conference on Machine Learning and Autonomous Systems (ICMLAS), 2026, pp. 1027–1033. doi: 10.1109/ICMLAS67792.2026.11483801.
S. Akter and M. S. Islam, “Hybrid Deep Learning Architectures for Malware Detection: A Comparative Study,” in 2025 IEEE International Conference on Telecommunications and Photonics (ICTP), 2025, pp. 285–289. doi: 10.1109/ICTP68765.2025.11415054.
J. Snead and K. Ghosh, “Deep Learning Models for Malware Family Detection,” in 2025 13th International Symposium on Digital Forensics and Security (ISDFS), 2025, pp. 1–6. doi: 10.1109/ISDFS65363.2025.11011988.
P. M. Krishna, D. B. Kumar, and K. Ashwini, “Malware Detection in Image Data: A Deep Learning Approach,” in 2024 5th International Conference on Communication, Computing & Industry 6.0 (C2I6), 2024, pp. 1–5. doi: 10.1109/C2I663243.2024.10894877.
S. H. Yaddala, M. P, C. Jothikumar, and A. Ashokkumar, “Malware Image Classification Using Deep Learning Approach,” in 2024 First International Conference on Innovations in Communications, Electrical and Computer Engineering (ICICEC), 2024, pp. 1–5. doi: 10.1109/ICICEC62498.2024.10808890.
A. Prayoga, R. B. Hadiprakoso, R. N. Yasa, and Girinoto, “Deep Learning for Android Malware Detection and Classification Using Hybrid-Based Analysis: A Comparative Study,” in 2023 IEEE International Conference on Cryptography, Informatics, and Cybersecurity (ICoCICs), 2023, pp. 309–313. doi: 10.1109/ICoCICs58778.2023.10277613.