TaoMate-HD: Progressive-Resolution Autoregressive Audio-Video Generation
Abstract
TaoMate-HD is an autoregressive streaming model that generates high-resolution audiovisual content in chunks with progressive denoising, history-based continuation, and optimized parallel deployment for faster, coherent long-form output.
Streaming digital humans produce detailed video while continuing speech as new text arrives. High-resolution denoising is costly, and text updates can cause repeated or interrupted speech. We present TaoMate-HD, an autoregressive model for high-resolution audio-video streaming. For each short segment, or chunk, two denoising steps establish coarse video structure at low resolution. A final step refines the video to high resolution, with audio generated throughout the same trajectory. Each stage passes its audiovisual predictions to the same stage of the next chunk as history. Across text updates, the model retains this history to infer what has already been spoken. Continuation training utilizes asymmetric text conditioning, with separate text windows for generation and distillation. Experiments show a 1.6x speedup over direct high-resolution generation with the same model and hardware. Optimized stage-parallel deployment provides a further 1.9x overall speedup over serial progressive generation. Our continuation training reduces character error rate by 11.18 percentage points relative to the baseline. The model also supports hour-long audiovisual generation. Our project page is https://taoliveaigc.github.io/TaoMate-HD.
Community
TaoMate-HD generates speech and high-resolution video together, one small chunk at a time. It builds each chunk on a coarse video grid before refining it at the output resolution.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Direct Forcing: Single-Stage Training with Representation-Space Supervision for Few-Step Autoregressive Video Generation (2026)
- In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion (2026)
- Rollout-Marginal Distillation for Long-Horizon Autoregressive Video Generation (2026)
- Real-Time Joint Audio-Video Generation by Parallel Adapter Composition (2026)
- Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation (2026)
- SoL-Refiner: Speed-of-Light One-Step Refinement for High-Resolution Video (2026)
- LongTake: Learning to Sustain Dynamics in Long-Horizon Video Generation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2611.03394 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 1
TaoLiveAIGC/TaoMate-HD-demos
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper