• Home
  • Search
  • Optimizing deep learning models from multi-objective perspective via Bayesian optimization
  • Cite Icon1
  • https://doi.org/10.11591/ijai.v14.i2.pp1420-1429Copy DOI Icon

Optimizing deep learning models from multi-objective perspective via Bayesian optimization

Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Optimizing hyperparameters is crucial for enhancing the performance of deep learning (DL) models. The process of configuring optimal hyperparameters, known as hyperparameter tuning, can be performed using various methods. Traditional approaches like grid search and random search have significant limitations. In contrast, Bayesian optimization (BO) utilizes a surrogate model and an acquisition function to intelligently navigate the hyperparameter space, aiming to provide deeper insights into performance disparities between naïve and advanced methods. This study evaluates BO's efficacy compared to baseline methods such as random search, manual search, and grid search across multiple DL architectures, including multi-layer perceptron (MLP), convolutional neural network (CNN), and LeNet, applied to the Modified National Institute of Standards and Technology (MNIST) and CIFAR-10 datasets. The findings indicate that BO, employing the tree-structured parzen estimator (TPE) search method and expected improvement (EI) acquisition function, surpasses alternative methods in intricate DL architectures such as LeNet and CNN. However, grid search shows superior performance in smaller DL architectures like MLP. This study also adopts a multi-objective (MO) perspective, balancing conflicting performance objectives such as accuracy, F1 score, and model size (parameter count). This MO assessment offers a comprehensive understanding of how these performance metrics interact and influence each other, leading to more informed hyperparameter tuning decisions.

Similar Papers
  • Research Article
  • Citations183

Advanced hyperparameter optimization of deep learning models for wind power prediction

  • Dec 02, 2023
  • Renewable Energy
  • Shahram Hanifi +2
  • PDF
  • Research Article
  • Citations117

A Novel MRI Diagnosis Method for Brain Tumor Classification Based on CNN and Bayesian Optimization.

  • Mar 08, 2022
  • Healthcare
  • Mohamed Ait Amou +3
  • Research Article

Hyperparameter tuning of deep learning models using MaxPro space filling methodology

  • Jan 01, 2025
  • International Journal of Experimental Design and Process Optimisation
  • Shilpa Gupta +2
  • PDF
  • Research Article
  • Citations31

Comparative Study of Popular Deep Learning Models for Machining Roughness Classification Using Sound and Force Signals.

  • Nov 29, 2021
  • Micromachines
  • Binayak Bhandari
  • PDF
  • Research Article
  • Citations61

Prediction of compressive strength of recycled aggregate concrete using machine learning and Bayesian optimization methods

  • Feb 03, 2023
  • Frontiers in Earth Science
  • Xinyi Zhang +3
  • Research Article
  • Citations26

Ensemble genetic and CNN model-based image classification by enhancing hyperparameter tuning

  • Jan 06, 2025
  • Scientific Reports
  • Wajahat Hussain +7
  • Research Article
  • Citations61

Improving the model robustness of flood hazard mapping based on hyperparameter optimization of random forest

  • Nov 24, 2023
  • Expert Systems with Applications
  • Mingyong Liao +5
  • Research Article
  • Citations2

Bayesian Optimization for Hyperparameter Tuning in Healthcare for Diabetes Prediction

  • Jan 01, 2025
  • Informing Science: The International Journal of an Emerging Transdiscipline
  • Annapantula Sudhakar +5
  • Book Chapter
  • Citations2

Deep Learning Techniques for Side-Channel Analysis on AES Datasets Collected from Hardware and Software Platforms

  • Jan 01, 2022
  • Tanu Shree Rastogi +1
  • Research Article
  • Citations3

Early diagnosis of mild cognitive impairment and Alzheimer's disease using multimodal feature-based deep learning models in a Chinese elderly population.

  • Sep 01, 2025
  • Asian journal of psychiatry
  • Chu Wang +6
  • Research Article

Prediksi Churn Pelanggan Telekomunikasi dengan Optimalisasi Seleksi Fitur dan Tuning Hyperparameter pada Algoritma Klasifikasi C4.5

  • Feb 28, 2025
  • Jurnal Sistem Informasi Bisnis
  • Soterio Antoh +4
  • Research Article
  • Citations58

Graph convolutional network – Long short term memory neural network- multi layer perceptron- Gaussian progress regression model: A new deep learning model for predicting ozone concertation

  • Apr 18, 2023
  • Atmospheric Pollution Research
  • Mohammad Ehteram +3
  • Research Article
  • Citations2

Towards high-performance deep learning architecture and hardware accelerator design for robust analysis in diffuse correlation spectroscopy

  • Oct 28, 2024
  • Computer Methods and Programs in Biomedicine
  • Zhenya Zang +6
  • PDF
  • Research Article
  • Citations2

Enhanced Sequence-to-Sequence Deep Transfer Learning for Day-Ahead Electricity Load Forecasting

  • May 20, 2024
  • Electronics
  • Vasileios Laitsos +4
  • Book Chapter
  • Citations12

Translation of 1D Inverse Fourier Transform of K-space to an Image Based on Deep Learning for Accelerating Magnetic Resonance Imaging

  • Jan 01, 2018
  • Taejoon Eo +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.