New AI system paves the way to AI videos with no time constraints, by eliminating drift in generative video, which is what causes sequences to become incoherent after a handful of seconds.
New AI system paves the way to AI videos with no time constraints, by eliminating drift in generative video, which is what causes sequences to become incoherent after a handful of seconds.
New AI system pushes the time limits of generative video
Stable Video Infinity: Infinite-Length Video Generation with Error Recycling.
Today, anyone can create realistic images in just a few clicks with the help of AI. Generating videos, however, is a much more complicated task. Existing AI models are only capable of producing videos that work for less than 30 seconds before degrading into randomness with incoherent shapes, colors and logic. The problem is called drift, and computer scientists have been working on it for years.
At EPFL, researchers at the Visual Intelligence for Transportation (VITA) Laboratory have taken a novel approach – working with the errors instead of circumventing or ignoring them – and developed a video-generation method that essentially eliminates drift. Their method is based on recycling errors back into the AI model so that it learns from its own mistakes.