Univrsity Of Tehran Press Journal of Information Technology Management 2980-7972 18 3 2026 07 01 RES2NET-MAXOUT: Image-Based Multi-Class Malware Classification with Deep Learning Models 1 24 108002 10.22059/jitm.2026.388431.3967 EN G.Joel Sunny Deol Associate prof., Kallam HaranadhaReddy Institute of Technology (KHIT) (AUTONOMOUS), Chowdavaram, Andhra Pradesh, India. 0009-0002-1018-3325 K. Siva Rama Prasad Assistant Prof., Department of Computer and Engineering- Artificial intelligence & Machine learning, Kallam HaranadhaReddy Institute of Technology (KHIT) (AUTONOMOUS), Chowdavaram, Andhra Pradesh, India. A. Hanumat Prasad Associate Prof., Department of Computer and Engineering- Artificial intelligence & Machine learning, Kallam Haranadhareddy Institute of Technology (KHIT) (AUTONOMOUS), Chowdavaram, Andhra Pradesh, India. M. Chennakesava Rao Associate prof., Computer and Engineering- Artificial intelligence & Machine learning, Kallam HaranadhaReddy Institute of Technology (KHIT) (AUTONOMOUS), Chowdavaram, Andhra Pradesh, India. Medida Alekhya Assistant prof., Computer and Engineering- Artificial intelligence & Machine learning, Kallam HaranadhaReddy Institute of Technology (KHIT) (AUTONOMOUS), Chowdavaram, Andhra Pradesh, India. T. Alekhya Assistant prof., Computer and Engineering- Artificial intelligence & Machine learning, Kallam HaranadhaReddy Institute of Technology (KHIT) (AUTONOMOUS), Chowdavaram, Andhra Pradesh, India. Journal Article 2025 01 08 The dynamic nature of the Internet has resulted in an increase in network security threats, primarily caused by the growing incidence of malware and the continuous emergence of its many forms. Conventional methods for detecting malware involve complex feature engineering, which considerably reduces detection effectiveness. Furthermore, machine learning algorithms, which were once a mainstay in the fight against cyber threats, are no longer able to accurately detect every new and complex malware variation. In contrast, deep learning approaches have the potential to be transformative. Their inherent flexibility and capacity for pattern recognition present a viable solution to the ever changing challenge of detecting a wide range of malware variations more reliably and effectively. For this reason, a unique deep learning based architecture is developed in this study to categorize malware types and protect networks. Three components comprise the most significant parts of this work: feature extraction, classification, and malware visualization. The suggested method first converts malware binary data into two dimensional images. Secondly, we introduce an automatic feature extractor that utilizes the Res2Net model to extract shared patterns among family members from the visualized images. Lastly, we propose a Deep Maxout Network designed to categorize malware using the extracted attributes. Moreover, data augmentation based on Conditional Generative Adversarial Networks (CGAN) addresses the issue of imbalanced data. The proposed technique is evaluated using the MaleVis, Microsoft Malware Classification Challenge (MMCC), and Drebin datasets. The experimental findings demonstrate that the proposed method can successfully and accurately classify malware compared to current state of the art techniques. https://jitm.ut.ac.ir/article_108002_3f8c855e1ccc3466ab76aac3acdd6556.pdf