• Home
  • Search
  • FrescoDiffusion: 4K Image-to-Video with Prior-Regularized Tiled Diffusion
  • https://doi.org/10.48550/arxiv.2603.17555Copy DOI Icon

FrescoDiffusion: 4K Image-to-Video with Prior-Regularized Tiled Diffusion

Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

Diffusion-based image-to-video (I2V) models are increasingly effective, yet they struggle to scale to ultra-high-resolution inputs (e.g., 4K). Generating videos at the model's native resolution often loses fine-grained structure, whereas high-resolution tiled denoising preserves local detail but breaks global layout consistency. This failure mode is particularly severe in the fresco animation setting: monumental artworks containing many distinct characters, objects, and semantically different sub-scenes that must remain spatially coherent over time. We introduce FrescoDiffusion, a training-free method for coherent large-format I2V generation from a single complex image. The key idea is to augment tiled denoising with a precomputed latent prior: we first generate a low-resolution video at the underlying model resolution and upsample its latent trajectory to obtain a global reference that captures long-range temporal and spatial structure. For 4K generation, we compute per-tile noise predictions and fuse them with this reference at every diffusion timestep by minimizing a single weighted least-squares objective in model-output space. The objective combines a standard tile-merging criterion with our regularization term, yielding a closed-form fusion update that strengthens global coherence while retaining fine detail. We additionally provide a spatial regularization variable that enables region-level control over where motion is allowed. Experiments on the VBench-I2V dataset and our proposed fresco I2V dataset show improved global consistency and fidelity over tiled baselines, while being computationally efficient. Our regularization enables explicit controllability of the trade-off between creativity and consistency.

Similar Papers
  • Research Article
  • Citations39

The relative importance of spatial versus temporal structure in the perception of biological motion: An event-related potential study

  • Jul 26, 2005
  • Cognition
  • Masahiro Hirai +1
  • Research Article
  • Citations9

Regionalized aquatic ecotoxicity characterization factor for zinc emitted to soil accounting for speciation and the transfer through groundwater

  • May 17, 2019
  • The International Journal of Life Cycle Assessment
  • Rifat-Ara Karim +2
  • Research Article
  • Citations70

Low-rank representation with local constraint for graph construction

  • Jul 05, 2013
  • Neurocomputing
  • Yaoguo Zheng +3
  • Preprint Article

Statistics of 20 years of heavy precipitation events in Germany from radar data

  • Mar 03, 2021
  • Katharina Lengfeld +4
  • Research Article

A Markov Model-Based Fusion Algorithm for Distorted Electronic Technology Archives.

  • Apr 22, 2022
  • Computational Intelligence and Neuroscience
  • Lei Wang
  • PDF
  • Research Article
  • Citations9

Structural organization of sacred landscapes

  • Oct 05, 2019
  • Journal of Geology, Geography and Geoecology
  • O Mishchenko
  • Research Article
  • Citations65

Deep spatial–temporal structure learning for rumor detection on Twitter

  • Aug 08, 2020
  • Neural Computing and Applications
  • Qi Huang +4
  • Research Article
  • Citations67

Spatial structuring of soil microbial communities in commercial apple orchards

  • May 24, 2018
  • Applied Soil Ecology
  • Greg Deakin +6
  • PDF
  • Research Article
  • Citations3

Probabilistic Risk Assessment of Slope Failure in 3‐D Spatially Variable Soils by Finite Element Method

  • Jan 01, 2022
  • Advances in Civil Engineering
  • Ya-Nan Ding +4
  • Research Article
  • Citations28

Single image super-resolution using regularization of non-local steering kernel regression

  • Dec 28, 2015
  • Signal Processing
  • Kaibing Zhang +3
  • Research Article
  • Citations16

Microsatellite DNA analysis of spatial and temporal population structuring of Phragmites australis along the Hudson River Estuary

  • May 10, 2016
  • Biological Invasions
  • Joseph Stabile +5
  • Research Article

Flexible Bayesian modeling of non-equidispersed counts with penalized complexity priors in disease incidence studies.

  • Mar 15, 2026
  • Statistical methods in medical research
  • Mahsa Nadifar +3
  • Book Chapter
  • Citations20

Obtaining soil and land quality indicators using research chains and geostatistical methods

  • Jan 01, 1998
  • M. R. Hoosbeek +1
  • PDF
  • Research Article
  • Citations106

Partitioning the impact of environment and spatial structure on alpha and beta components of taxonomic, functional, and phylogenetic diversity in European ants.

  • Sep 29, 2015
  • PeerJ
  • Xavier Arnan +2
  • Research Article
  • Citations28

Spatiotemporal Analysis of Rice Yield Variability in Two California Fields

  • Jan 01, 2004
  • Agronomy Journal
  • Alvaro Roel +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.