When you purchase through links on our site, we may earn an affiliate commission.Heres how it works.
The tech giant has certainly come a long way from the days ofImagen Video.
Subjects inLumiere videosare no longer these nightmarish creatures with melting faces.
Now things look much more realistic.
Whats more, there’s very little of the weird jerky movement seen in other text-to-video generative AIs.
Motion is largely smooth as butter.
Inbar Mosseri, Research Team Lead atGoogleResearch,published a video on her YouTube channeldemonstrating Lumieres capabilities.
Google put a lot of work into making Lumieres content appear as lifelike as possible.
The dev team accomplished this by implementing something called Space-Time U-Net architecture (STUNet).
The technology behind STUNet is pretty complex.
Doing so results in the jerky movement the tech is known for.
Lumiere also has an ability called Cinemagraph which can animate highlighted portions of pictures.
Google demonstrates this by selecting a butterfly sitting on a flower.
Things become particularly impressive when it comes to video.
Video Inpainting, another feature, functions similarly to Cinemagraph in that the AI can edit portions of clips.
A womans patterned green dress can be turned into shiny gold or black.
Lumiere goes one step further by offering Video Stylization for altering video subjects.
For now, it looks like the team is going to keep it behind closed doors.
As impressive as this AI may be, it still has its issues.
Jerky animations are present.
In other cases, subjects have limbs warping into mush.
If you want to know more, Googles research paper on Lumiere can be found onCornell Universitys arXiv website.
Be warned: it’s a dense read.
And be sure to check out TechRadar’s roundup of thebest AI art generators for 2024.
