- In addition to scores, it also creates sound effects and dialogue “that match the characters and tone of a video.”
-
Google has announced an update to its video-to-audio technology.
The software is now capable of “synchronised audiovisual generation,” meaning it can produce soundscapes, effects and dialogue for videos, archival material, silent films and other types of footage.
The generated audio “matches the characters and tone of a video,” Google said in a new blog post. An unlimited number of soundtracks are possible for any video input. Unlike existing video-to-audio solutions, Google’s technology can understand raw pixels and doesn’t necessarily require text prompts, according to the post.
“Video generation models are advancing at an incredible pace, but many current systems can only generate silent output,” the post stated. “Initial results are showing this technology will become a promising approach for bringing generated movies to life.”
This tool, which is still undergoing safety checks before it gets released to the public, is part of DeepMind, Google’s AI lab.
Watch a few test clips below.
For more details, read Google’s blog post.
Source link
Google’s latest AI tech can generate soundtracks for videos · News ⟋ RA #Googles #latest #tech #generate #soundtracks #videos #News
Source link Google News
Source Link: https://ra.co/news/80832
Leave a Reply