• Home
  • Search
  • LLM-Powered Automated Detection and Optimization of Inference Bottlenecks in Distributed Systems: A Static Analysis Approach
  • https://doi.org/10.1109/iccvdm66874.2025.11290260Copy DOI Icon

LLM-Powered Automated Detection and Optimization of Inference Bottlenecks in Distributed Systems: A Static Analysis Approach

  • Sep 12, 2025
  • Xiaoying Li
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

This paper presents a novel approach to automating the detection and optimization of inference bottlenecks in distributed deep learning systems through the application of Large Language Models (LLMs). While traditional performance optimization in distributed environments requires extensive manual analysis across multiple components, this paper propose a static analysis framework that leverages LLMs' code comprehension capabilities to identify performance-critical patterns without execution.This system processes distributed model architectures and implementation code to generate an abstract syntax tree representation, which is then analyzed by a fine-tuned LLM trained on a curated dataset of 5,000+ annotated performance bottlenecks from production distributed environments. Experimental evaluation across 78 diverse distributed neural network deployments demonstrates that the approach identifies 93.7% of inference bottlenecks that would otherwise require dynamic profiling, while suggesting optimizations that yield an average 2.8x inference speedup on resource-constrained devices. A comparative analysis reveals this static analysis method reduces optimization time by 76% compared to conventional profiling-based approaches in distributed settings. Additionally, the system generates natural language explanations of detected issues and recommends contextually appropriate optimization strategies for distributed inference pipelines, facilitating knowledge transfer to practitioners. This research addresses critical challenges in deep learning deployment across distributed environments and enables more efficient utilization of computational resources in production systems.

Similar Papers
  • Conference Article
  • Citations10

ASAF: Android Static Analysis Framework

  • Nov 01, 2020
  • Aala Al Khayer +2
  • Research Article
  • Citations13

Static Analysis of Runtime Errors in Interrupt-Driven Programs via Sequentialization

  • Sep 01, 2016
  • ACM Transactions on Embedded Computing Systems
  • Xueguang Wu +4
  • Conference Article
  • Citations43

ARDiff: scaling program equivalence checking via iterative abstraction and refinement of common code

  • Nov 08, 2020
  • Sahar Badihi +3
  • Research Article
  • Citations12

DroidRista: a highly precise static data flow analysis framework for android applications

  • Oct 01, 2019
  • International Journal of Information Security
  • Areej Alzaidi +2
  • Conference Article
  • Citations5

Static Spreadsheet Analysis

  • Oct 01, 2016
  • Patrick W Koch +2
  • Research Article
  • Citations120

Detecting Cryptomining Malware: a Deep Learning Approach for Static and Dynamic Analysis

  • Jan 21, 2020
  • Journal of Grid Computing
  • Hamid Darabian +6
  • Research Article
  • Citations5

A new static–dynamic equivalence beam bending approach for the stability of a vibrating beam

  • Jun 04, 2019
  • Mechanics of Advanced Materials and Structures
  • Zhenyu Chen +2
  • Conference Article
  • Citations1

Impact of DM-LRU on WCET: A Static Analysis Approach

  • Jul 22, 2019
  • DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
  • Renato Mancuso +2
  • Conference Article
  • Citations15

Detecting Permission Over-claim of Android Applications with Static and Semantic Analysis Approach

  • Aug 01, 2017
  • Junwei Tang +4
  • Conference Article
  • Citations8

Malicious data classification using structural information and behavioral specifications in executables

  • Mar 01, 2014
  • Sandeep Kumar +4
  • Conference Article
  • Citations8

A Change Impact Analysis Approach for Workflow Repository Management

  • Jun 01, 2013
  • Gustavo A Oliva +3
  • Conference Article
  • Citations15

Simulation-directed invariant mining for software verification

  • Mar 10, 2008
  • Xueqi Cheng +1
  • PDF
  • Research Article
  • Citations9

A Value Set Analysis Refinement Approach Based on Conditional Merging and Lazy Constraint Solving

  • Jan 01, 2019
  • IEEE Access
  • Jian Lin +3
  • PDF
  • Research Article
  • Citations18

A Combined Static and Dynamic Analysis Approach to Detect Malicious Browser Extensions

  • Jan 01, 2018
  • Security and Communication Networks
  • Yao Wang +3
  • Research Article
  • Citations9

Seismic Performance of Confined Versus Unreinforced Masonry Buildings on Hilly Slopes Using Linear Static and Dynamic Analysis Approaches

  • Jun 20, 2023
  • Arabian Journal for Science and Engineering
  • Rohit Maheshwari +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.