Lo, Firefly hath now the power to conjure videos from mere image and text prompts, yea, and to lengthen existing clips as well; so spake Adobe on Monday in a proclamation grand. This newfound feature doth find its place among the hallowed halls of Premiere Pro subscribers, as it doth roll out with haste.
‘Tis a sight to behold, this video generation feature, making its grand entrance in a plethora of new tools for Premiere Pro and the Firefly web app. Behold PP’s Generative Extend, which in its glory can append up to two seconds of AI footage to the beginnings or endings of clips, yea, and even make mid-shot adjustments to camera positions, tracking, and the very subjects themselves.
Verily, the generated video doth come in resolutions of 720p or 1080p, at a brisk pace of 24 frames per second. The tool hath the ability to lengthen sound effects and ambient noises by up to ten seconds, though alas, it lacketh the power to enrich spoken dialog or melodic scores.
Now, the Firefly web app doth receive unto itself two new AI tools: Text-to-Video and Image-to-Video, soon to be within reach in a limited public beta. Seek thee the waitlist and apply here anon. Text-to-Video doth craft short clips in diverse artistic styles, enabling creators to mold the output video through iterations with the web app’s camera controls.
Image-to-Video, similarly, doth utilize both text prompts and reference images to draw the model nearer to the creator’s vision in fewer attempts. These web features doth require but a minute and a half to sculpt videos up to five seconds long at the noble resolution of 720p and 24 frames per second.
Though these video generation features may not set the world ablaze with novelty — for Runway’s Gen-3, Meta’s Movie Gen, and OpenAI’s Sora boast similar functionalities — Firefly doth offer its devotees an edge over its rivals in that its outputs are deemed “commercially safe.” Adobe hath trained its Firefly model on images from Adobe Stock, openly licensed content, and public domain materials, thus averting the specter of copyright infringement claims. Would that the same were true for Runway, Meta, and Nvidia.
