• Home
  • Search
  • AgencyTree: Automated Multimedia Workflow Generation with Robust Planning via an Abstract Capability Tree
  • https://doi.org/10.1145/3812545Copy DOI Icon

AgencyTree: Automated Multimedia Workflow Generation with Robust Planning via an Abstract Capability Tree

  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Despite the rapid progress in Generative AI, building applications that fulfill complex demands still requires the manual orchestration of multiple AI models into workflows, which is time-consuming and error prone. Existing large language model (LLM)-based automation methods suffer from planning brittleness: they often produce infeasible plans due to an unstructured understanding of model capabilities, and their tightly-coupled architectures are vulnerable to rapid changes in the underlying model ecosystem. To address this, we present AgencyTree , a novel multi-agent framework that introduces a formal Abstract Capability Tree (ACT) as a shared ontological knowledge base. This tree hierarchically abstracts concrete AI models into canonical functional nodes, decoupling high-level task planning from low-level model execution. Built upon this abstraction, five specialized agents - Knowledge Engineer, System Analyst, System Architect, Project Engineer, and Intent Consistency Verifier-collaborate to automate the workflow lifecycle. Evaluated on a comprehensive benchmark, AgencyTree achieves significantly higher task success and output quality than state-of-the-art baselines. Crucially, the framework exhibits exceptional robustness to model registry changes, with over 90% of abstract workflows being fully reusable without modification, thereby reducing adaptation overhead by orders of magnitude compared to replanning from scratch. This work establishes a new paradigm for building reliable and dynamically-adaptive AI assembly systems.

Similar Papers
  • Research Article
  • Citations56

Generative AI in cybersecurity: A comprehensive review of LLM applications and vulnerabilities

  • Jan 01, 2025
  • Internet of Things and Cyber-Physical Systems
  • Mohamed Amine Ferrag +7
  • Front Matter

Navigating Cognitive Bias and Information Integrity in AI-Driven Digital Media Ecologies

  • Aug 08, 2025
  • Toija Cinque +1
  • Book Chapter

Distribution and Logistics Network Design in Industry 5.0: Models, Methods, and the Impact of Generative AI and Large Language Models

  • Oct 15, 2025
  • Yu Hao +3
  • Research Article

AI-Driven Burnout Management System: A Novel Approach Using Generative AI, MongoDB Atlas, Python, And Training Large Language Models (LLMs) - Version 3

  • Apr 30, 2025
  • Engineering and Technology Journal
  • Sasibhushan Rao Chanthati
  • PDF
  • Front Matter
  • Citations82

Generative AI and large language models in health care: pathways to implementation

  • Mar 07, 2024
  • NPJ Digital Medicine
  • Marium M Raza +2
  • Supplementary Content

Innovating global regulatory frameworks for generative AI in medical devices is an urgent priority

  • Mar 19, 2026
  • NPJ Digital Medicine
  • Jasmine Chiat Ling Ong +15
  • Research Article
  • Citations1

Don't Forget That There Are People in the Data: LLMs in the Context of Human Rights

  • Oct 01, 2024
  • Critical AI
  • Wendy H Wong
  • Research Article

Smart Parking Space Detection with Generative Artificial Intelligence and Large Language Models

  • Apr 18, 2024
  • Proceedings of the West Virginia Academy of Science
  • Cameron Vu +4
  • Research Article
  • Citations6

Green MLOps to Green GenOps: An Empirical Study of Energy Consumption in Discriminative and Generative AI Operations

  • Mar 30, 2025
  • Information
  • Adrián Sánchez-Mompó +4
  • Conference Article

AutoFlowgen: A Multi-Agent Framework for Automated Generation of Workflows from Natural Language

  • Jun 20, 2025
  • Zhongjun Yang +5
  • Research Article

Review Analyzer

  • Dec 15, 2024
  • INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
  • Dr V Siva Nagaraju +2
  • Conference Article

LLM + Vector Data: Coupling of Large Language Models with Vector Data Management for Enhancing Data Science

  • May 19, 2025
  • Arijit Khan +4
  • Abstract

NIA Genetics of Alzheimer’s Disease Data Storage Site (NIAGADS) AI‐Enhanced Search

  • Dec 01, 2024
  • Alzheimer's & Dementia
  • Emily Greenfest‐Allen +8
  • Research Article
  • Citations40

When geoscience meets generative AI and large language models: Foundations, trends, and future challenges

  • Jun 11, 2024
  • Expert Systems
  • Abdenour Hadid +2
  • Research Article
  • Citations32

ChatGPT or Bard: Who is a better Certified Ethical Hacker?

  • Mar 09, 2024
  • Computers & Security
  • Raghu Raman +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.