IA 360
Art and Entertainment

Adobe Is Bringing Generative Video AI to Premiere Pro

Adobe has unveiled generative AI tools coming to Premiere Pro to extend shots and add or remove objects. The company is also exploring third-party video models, including Sora and Runway.

5 min read Leer en español

Adobe wants editors to be able to fix a short shot, remove an unwanted object or insert a new element without leaving Premiere Pro. In April, the company announced new generative video AI tools based on Firefly, its family of models, which will soon arrive in its professional editor.

The news matters because of where these tools are landing: Premiere Pro is one of the central applications in professional audiovisual production. Until now, video generation has largely been presented as a standalone tool, useful for creating clips from scratch but still separate from the editing process. Adobe wants to bring it to the timeline, where the final decisions about a piece are made.

Extending a shot when a few seconds are missing

The most concrete feature is Generative Extend. It will allow users to lengthen a video clip by adding a few frames to the beginning or end of a shot. It is designed to address a common editing problem: a take ends before the music comes in, there is not enough room to transition between two shots, or the edit needs to breathe for just a moment longer.

Instead of repeating the last frame—a workaround that often produces an unnatural freeze-frame—the system will generate a visual continuation based on what appears in the shot. It is no substitute for filming a better take, but it can eliminate manual touch-ups, forced cuts or the need to turn to stock footage for minor adjustments.

Adobe has also shown tools for adding and removing objects in video. The promise is similar to that of the generative fills that Photoshop has already popularized: select an area, describe or indicate the desired change, and let the model reconstruct the background and surrounding action.

In a photograph, removing an object means reconstructing a still image. In video, the result must remain coherent from frame to frame: lighting, shadows, camera movement and the position of objects cannot change arbitrarily. That continuity is the technical challenge separating an eye-catching demo from a reliable tool for real-world production.

Firefly enters more complex territory

The new features will be powered by Firefly’s future video model. Adobe has built its generative strategy around models trained on licensed content, including Adobe Stock, as well as public-domain material. The company presents this approach as a way for commercial customers to work with less uncertainty over the rights to generated material.

The question of data provenance is especially important in video. A clip can include people, brands, recognizable locations and styles, and using it in advertising, film or television involves greater copyright and likeness-rights risks than many casual uses of an image generator.

Adobe also plans to open Premiere Pro to third-party models. The company has cited OpenAI, the creator of Sora, and Runway among the developers with which it is exploring integrations. Sora, introduced by OpenAI in February, has drawn attention for its ability to generate video sequences from text, although access remains limited at this point. Runway, meanwhile, already offers AI-based video-generation and editing tools.

For now, this does not mean that all of those models will be built into the application. Adobe is envisioning an architecture in which editors can choose the most suitable model for each task from within Premiere Pro’s workflow.

More control, but also more responsibility

The integration could save time on finishing work, digital advertising, social media content and productions with limited budgets. It also changes the role of editing: an editor will not only arrange recorded footage, but will be able to reconstruct specific parts of a shot when the material does not quite fit.

The limits will be reliability and traceability. A generated shot should be distinguishable from a filmed one when that difference matters to the audience or a client. Adobe already uses Content Credentials, a technology that can attach information about a file’s origin and edits, as part of its response to this problem.

The announced features still need to prove that they can deliver consistent results in long and complex scenes. But bringing them to Premiere Pro moves video generation toward a less spectacular and more everyday use: fixing, within the project, the small editing problems that until now required reshooting or opening another tool.

Share this article

This website uses cookies to improve the browsing experience. Cookie policy.