This video features (1) Creatures—the latest song in my music series—and (2) my experiments using the Kaiber AI video generator (kaiber.ai/create),
I’ve always struggled to find video footage to go along with the songs on my main YouTube music channel. I have tried taking videos of dancers, using screen captures of music visualizers, using video footage I took while travelling, making montages of street art photos and collaborating with an underwater dancer. For this video, I experimented with Kaiber, an AI video generator that is useful for producing dream-like videos with evolving imagery.
Download the song
Creatures is the 45th song in my Free Background Music Series. It is a laidback piece that is largely created from loops, with the core piano coming from a promotional collaboration between Landr and Pantone (PANTONE Color of the Year 2020: The Classic Blue 19-4052), with additional parts played on a Korg M50 synthesizer. As with the other songs in the series, this work can be used for free in non-commercial projects and in YouTube monetized videos (that are otherwise non-commercial in nature) as long as credit is provided (‘music by longzijun’). For more information, you can refer to the detailed Terms of Use. The song can be downloaded from:
- MP3 file 320 kbps, 48 khz (Box)
- MP3 file 320 kbps, 48 khz (Google Drive)
- MP3 file 320 kbps, 48 khz (OneDrive)
- WAV file (Google Drive)
- WAV file (OneDrive)
The music was recorded, mixed and edited using Cakewalk by Bandlab (which is free), and I did the mastering in Magix Audio Cleaning Lab.
About the Kaiber AI video generator
With Kaiber (kaiber.ai/create), you can choose from three main animation methods:
- Flipbook: This is Kaiber’s signature style; it creates a somewhat jittery video in which the imagery evolves in a dream-like manner. You can control the amount of change via the ‘Evolve’ setting, but even if you use the very lowest setting, the main character’s facial features, hairstyle and clothes will still gradually change. Most of the shots in the above video were generated using this mode.
- Motion: This is a relatively new feature. The animated clips are between 3 and 4 seconds long, but they have smoother motion. If you select a high ‘evolve setting’ you can get interesting transitions.
- Transform a video: With this method, you upload an existing video and tell Kaiber’s AI what you want to do with it. In this mode, if you set ‘Transformation’ to a low value (1 is the minimum and 10 is the maximum), the effect is more like a filter, with only slight changes to things like the color and amount of detail. If the setting is near the maximum, you can completely change the look of the main subject(s) and the whole environment. In principle, it works similarly to rotoscoping or motion capture. At the moment, if you are using Kaiber, this mode is the only way to get realistic movements like running, walking or dancing.
Longzijun 