Adobe Launches Firefly Video AI Model [Video]

Adobe has announced the launch of a new Firefly generative AI model for video, alongside enhancements to its Image, Vector, and Design models. The Firefly Video Model, now in limited public beta, is the first publicly available video model designed to be commercially safe.

"The usage of Firefly within our creative applications has seen massive adoption, and it's been inspiring to see how the creative community has used it to push the boundaries of what's possible," said Ely Greenfield, chief technology officer, digital media at Adobe. "We're thrilled to bring creative professionals even more tools for ideation and creation, all designed to be commercially safe."




New Firefly offerings in Creative Cloud available today include:
● Generative Extend (beta) for perfectly timed video edits: Powered by the Firefly Video Model and now available in the Premiere Pro beta, Generative Extend allows you to extend clips to cover gaps in footage, smooth out transitions, or hold on shots longer for perfectly timed edits.
● Text to Video & Image to Video (beta) for improved user controls and stunning video clips: Powered by the Firefly Video Model and now rolling out in limited public beta in the Firefly web app, creators can access new Text to Video and Image to Video capabilities. With Text to Video, video editors can generate video from text prompts, access a variety of camera controls such as angle, motion and zoom to finetune videos, and reference images for B-Roll generation that seamlessly fill gaps in a video timeline. Image to Video capabilities allow creators to bring still shots or illustrations to life by transforming them into stunning live action clips.
● Firefly Image 3 enhancements for faster generations: With the latest evolution of Firefly Image 3 Model, creators of all levels can ideate by generating images in seconds with results that are up to 4x faster than previous models – available today on the Firefly web app.
● Generative Workspace (beta) in Photoshop: Powered by Adobe Firefly, Generative Workspace in Photoshop allows designers to ideate, brainstorm and iterate concepts simultaneously to achieve their vision while producing stunning visuals faster and more intuitively than ever before.
● Firefly Vector Model (beta) Advancements in Illustrator: Adobe Illustrator brought Generative Shape Fill (beta), Generative Recolor and Text to Pattern, all powered by the latest Firefly Vector Model (beta) earlier this year, empowering designers to quickly ideate or add detailed vectors in their own unique style to existing artwork and designs. With the latest version of Firefly Vector Model, creators can now further control the density of elements in a single pattern to change how tightly the elements are packed together.

Adobe also previewed Project Concept, a new capability for multiplayer, collaborative, creative concept development bringing the ability to remix images in real time so creative professionals can concept live in a single canvas.



New Enterprise Offerings
Additionally, in Firefly Services, Adobe unveiled new offerings to scale production workflows. This includes Dubbing and Lip Sync now in beta, which uses generative AI for video content to translate spoken dialog into different languages, while maintaining the sound of the original voice with matching lip sync. Additionally, 'Bulk Create, Powered by Firefly Services' is now in beta and will enable creative professionals to edit large volumes of images more efficiently, streamlining tasks such as resizing or background removal.


Pricing and Availability
The Firefly Video Model is in limited public beta on firefly.adobe.com. Join the waitlist here. During this limited public beta, generations are free. Adobe will share more information about Firefly video generation offers and pricing when the Firefly Video Model moves out of limited public beta.

Read More