• Home
  • Search
  • Memory-Efficient Adjoints via Graph Partitioning
  • https://doi.org/10.1109/jcsse54890.2022.9836288Copy DOI Icon

Memory-Efficient Adjoints via Graph Partitioning

  • Jun 22, 2022
  • Ekkapot Charoenwanit
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Derivative information plays a crucial role in the correctness and performance of scientific computing in a wide variety of scientific domains such as computational fluid dynamics (CFD), finance engineering and so on. The reverse mode of Algorithmic Differentiation is particularly efficient for the computation of derivatives of multivariate vector functions <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$F: R^{n}\mapsto R^{m}$</tex> , where the number of inputs <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$n$</tex> far exceeds the number of outputs <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$m$</tex> , frequently appearing as cost functions in numerical optimization kernels. In particular, reverse-mode AD is at the heart of the back propagation algorithm widely used in machine learning. The reverse mode of AD requires that the control flow of the derivative program be reversed, meaning that the results of intermediate computations (in our case, the computational graph of <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$F$</tex> ) must be stored either in memory or secondary storage. As a result, this requirement leads to the memory wall problem, especially for large-scale numerical problems, where the results of intermediate computations cannot fit entirely in memory. In this paper, we present an algorithm called Memory-Efficient Adjoints (ME-Adjoints) for solving the memory wall problem by dynamically applying a simple partitioning scheme to the computational graph of the function <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$F$</tex> at runtime. Our approach employs operator overloading in C++ to achieve a fully automatic adjoining process, whereby derivative programs require only trivial changes to the code as opposed to the use of checkpointing techniques, which require substantial changes to the code.

Similar Papers
  • Research Article
  • Citations13

Recent advances and effectiveness of machine learning models for fluid dynamics in the built environment

  • Jun 29, 2024
  • International Journal of Modelling and Simulation
  • Tran Van Quang +2
  • Research Article
  • Citations21

Rapid CFD Prediction Based on Machine Learning Surrogate Model in Built Environment: A Review

  • Jul 28, 2025
  • Fluids
  • Rui Mao +6
  • Research Article

RoseNNa: A performant, portable library for neural network inference with application to computational fluid dynamics

  • Dec 14, 2023
  • Computer Physics Communications
  • Ajay Bati +1
  • Research Article
  • Citations17

An investigation of the thermal behavior of constructal theory-based pore-scale porous media by using a combination of computational fluid dynamics and machine learning

  • Jun 11, 2022
  • International Journal of Heat and Mass Transfer
  • Mehrdad Mesgarpour +5
  • Research Article

Harnessing AI for Hydraulic Efficiency: A Comparative Study of Numerical Modeling and Machine Learning in Energy Dissipation Over a Vertical Drop Structure

  • Nov 10, 2025
  • Fusion Journal of Engineering and Sciences
  • Muhammad Haseeb +4
  • Research Article
  • Citations2

Comparing flow-based and anatomy-based features in the data-driven study of nasal pathologies

  • Jan 01, 2024
  • Flow
  • Andrea Schillaci +4
  • PDF
  • Research Article
  • Citations37

Optimization of Turbine Blade Aerodynamic Designs Using CFD and Neural Network Models

  • Jun 30, 2022
  • International Journal of Turbomachinery, Propulsion and Power
  • Chao Zhang +1
  • Research Article
  • Citations20

Numerical investigation of water forced convection inside a copper metal foam tube: Genetic algorithm (GA) based fuzzy inference system (GAFIS) contribution with CFD modeling

  • Oct 09, 2021
  • International Journal of Heat and Mass Transfer
  • Mahyuddin K.M Nasution +4
  • Dissertation

Accelerating Computational Fluid Dynamics with Unsupervised Learning-Based Mesh Adaptation

  • Jul 16, 2025
  • Kenza Tlales
  • Conference Article
  • Citations5

Machine Learning for Quantum Hardware Performance Assessment

  • Oct 01, 2022
  • Vedika Saravanan +1
  • Research Article

Machine learning and deep learning techniques for enhancing computational fluid dynamics: a comprehensive review

  • Jan 01, 2026
  • Progress in Computational Fluid Dynamics An International Journal
  • Alireza Omrani +6
  • Dissertation

Computational Heat Transfer Optimisation in Nuclear Fusion Reactors Using Data-Driven Machine Learning

  • Aug 11, 2025
  • Daniela Segura Galeana
  • Research Article
  • Citations7

Computational Fluid Dynamics—Machine Learning Prediction of Machinery Coupling Windage Heating and Power Loss

  • Jun 28, 2021
  • Journal of Heat Transfer
  • Ahmad Dawahdeh +3
  • Research Article
  • Citations3

MLFV: a novel machine learning feature vector method to predict characteristics of turbulent heat and fluid flow

  • Aug 22, 2024
  • International Journal of Numerical Methods for Heat & Fluid Flow
  • Iman Bashtani +1
  • PDF
  • Research Article
  • Citations26

Thermal prediction of turbulent forced convection of nanofluid using computational fluid dynamics coupled genetic algorithm with fuzzy interface system

  • Jan 14, 2021
  • Scientific Reports
  • Meisam Babanezhad +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.