Computational Intelligence and Neuroscience

Compression of Deep Learning Models for Resource-Constrained Devices


Publishing date
01 Mar 2022
Status
Published
Submission deadline
05 Nov 2021

1Bennett University, Greater Noida, India

2Brunel University London, London, UK


Compression of Deep Learning Models for Resource-Constrained Devices

Description

In recent years, deep learning has become popular in research due to its applicability in many industries. For instance, deep learning can be applied in healthcare, security surveillance, self-drive car, human activity recognition, recommended systems, image quality enhancement, transportation, prediction, forecasting, etc. Before the introduction of deep learning, prediction and decision-making can be achieved using statistical methods and machine learning. Deep learning algorithms have been solving successfully complex real-time problems. This was previously not possible with machine learning and computer vision methods.

Deep learning has also gained popularity because it automatically extracts the important features from training data and these features help to make an appropriate decision. However, there are challenges in deep learning such as problems of high computation power and resources. Moreover, deep learning models are computationally extensive and require high storage space. Therefore, a deep learning model is not well suited for edge devices. Users are not able to get high computation resources in a real-time domain from a remote location or in the case of mobility. Hence, these deep learning models require significant improvement. For instance, there is a need to make deep learning models that include lightweight and better inference time so that the models can be compatible with resource-constrained devices. Recent research has shown significant improvement in compression techniques by applying pruning, lossy weight encoding, parameter sharing, multilayer pruning, low-rank factorization, etc. To compress deep learning models, two approaches exist: compression during training and compression of the trained model. Moreover, various techniques are available for model optimization and compression for resource-constrained devices. For instance, genetic algorithms, swarm optimization, swarm intelligence, nature-inspired optimization, game-theoretic approach, chemical reaction optimization, and differential evolution.

The aim of the Special Issue is to bring together original research and review articles discussing the compression of deep learning models for resource-constrained devices. We welcome submissions from researchers who have been working on the development and deployment of deep learning models in edge devices (e.g., Raspberry Pi, Google edge tensor processing unit (Google TPU), NVIDIA Jetson Nano Developer Kit, Android devices, etc). This Special Issue invites original research discussing innovative architectures and training methods for effective and efficient compression.

Potential topics include but are not limited to the following:

  • Model optimization and compression for medical applications
  • Model optimization and compression for Internet of Things (IoT) and edge applications
  • Model optimization and compression for deep learning algorithms in security analysis applications
  • New architectures for model compression include pruning, quantization, knowledge distillation, neural architecture search (NAS), etc.
  • Generalize lightweight architectures for deep learning problems
  • Compression approaches for deep reinforcement learning
  • Efficient use of computation resources for executing deep learning models
  • Architectures and models that work with less training data on remote applications
  • Compressed deep learning model for explainable artificial intelligence
  • Compressed and accelerated versions of famous pr-trained architectures (e.g., AlexNet, OxfordNet (VGG16), residual neural network (ResNet), etc.)
  • Compression and acceleration of object detection model such as "You Only Look Once" (YOLO) model, and single-shot detector (SSD)
  • Accelerate the UNet and VNet architectures
  • Methodology and framework for developing storage constraints in deep learning models

Articles

  • Special Issue
  • - Volume 2022
  • - Article ID 6711331
  • - Research Article

[Retracted] Application of Unsupervised Migration Method Based on Deep Learning Model in Basketball Training

Hui Sun | Yu Wang | Yujue Wang
  • Special Issue
  • - Volume 2022
  • - Article ID 2213273
  • - Research Article

[Retracted] DeepCompNet: A Novel Neural Net Model Compression Architecture

M. Mary Shanthi Rani | P. Chitra | ... | S. Nithya
  • Special Issue
  • - Volume 2022
  • - Article ID 9580896
  • - Research Article

Significance of Visible Non-Invasive Risk Attributes for the Initial Prediction of Heart Disease Using Different Machine Learning Techniques

Syed Immamul Ansarullah | Syed Mohsin Saif | ... | Mudasir Manzoor Kirmani
  • Special Issue
  • - Volume 2022
  • - Article ID 4806763
  • - Research Article

[Retracted] Application of the PBL Model Based on Deep Learning in Physical Education Classroom Integrating Production and Education

Honghai Li | Hongtao Deng | Yi Zhang
  • Special Issue
  • - Volume 2022
  • - Article ID 8615374
  • - Research Article

[Retracted] Identifying Animals in Camera Trap Images via Neural Architecture Search

Liang Jia | Ye Tian | Junguo Zhang
  • Special Issue
  • - Volume 2022
  • - Article ID 2103975
  • - Research Article

Mask Detection and Social Distance Identification Using Internet of Things and Faster R-CNN Algorithm

S. Meivel | Nidhi Sindhwani | ... | Mesfin Esayas Lelisho
  • Special Issue
  • - Volume 2022
  • - Article ID 4357088
  • - Research Article

[Retracted] BID-Net: An Automated System for Bone Invasion Detection Occurring at Stage T4 in Oral Squamous Carcinoma Using Deep Learning

Pinky Agarwal | Anju Yadav | ... | Amitabha Chakrabarty
  • Special Issue
  • - Volume 2022
  • - Article ID 2832400
  • - Research Article

[Retracted] FVC-NET: An Automated Diagnosis of Pulmonary Fibrosis Progression Prediction Using Honeycombing and Deep Learning

Anju Yadav | Rahul Saxena | ... | S. M. Mostafa Kamal
  • Special Issue
  • - Volume 2022
  • - Article ID 1822585
  • - Research Article

[Retracted] A Pavement Crack Detection Method Based on Multiscale Attention and HFS

Chun Li | Yu Wen | ... | Xuedong Tian
  • Special Issue
  • - Volume 2022
  • - Article ID 8109147
  • - Research Article

Medicolite-Machine Learning-Based Patient Care Model

Rijwan Khan | Akhilesh Kumar Srivastava | ... | Santosh Kumar

We have begun to integrate the 200+ Hindawi journals into Wiley’s journal portfolio. You can find out more about how this benefits our journal communities on our FAQ.