Intelligent Virtual Assistant Node (IVAN)

-

 



This film was to experiment more with different methods of achieving lip sync. I've been using the lip sync service from Vozo and I also have been experimenting with Kling. Not entirely the best results achieved here. By focusing on a conversanionalist's face, the movement of lips is very noticable when not aligned with sound. There needs to be improvement in the technology. I'll be exploring other systems as I move forward. 


Video can be viewed on YouTube:



Comments

Post a Comment

Popular posts from this blog

Metamorphose

-
Image
  Metamorphose 4:40 This took 2 full days to make and cost almost 10 dollars using Replicates cloud servers. The story was generated with a paid subscription to Eskritor using the following prompt: Write a short story about luminescent creatures running in panic and fear on a field of lava. Blue foam bubbles from fissures. Green lush vegetation grows in isolated pockets. Inspiration for this story was my recent stay on a lava field in Kalapana, Big Hawai'i USA. Edited with two open source programs: Openshot video editor Audacity sound editor An equal amout of editing was needed for both image and sound. Music was generated and cut and pasted like the images. This is my first AI driven creation. Three days ago I had no user knowledge of AI image or sound creation. I also learned how to use both open source editors during the same time. I had a crash course in learning how to use these programs. I still have a lot more to learn. I plan to make and post a new video every week. I'l...
Read more

Drained

-
Image
  Drained 3:59 This film was written with Eskritor and my newest writing tool... Meta AI with Llama 4. Meta AI is absolutely free on WhatsApp. The interactive conversations I have working out story details has been extremely more efficent than the Eskitor app.  This story was inspired from my personal experiences with heat and mosquitos while living and sometimes trying to sleep in Thailand. I wanted to try building a story with no music, just sound effects. I also wanted to try to have more control of my setting and how my character behaved. I wanted to create an actor that had more personality and realism. To help with this, I created a special character using OpenArt AI's character creation tool. Most of the sound was created with the sound effect generator stackadoc/stable-audio-open 1.0, but a few analog sound effects from Freesound were incorporated. This particular film has given me more of an opportunity to use the sound editing program Audacity. It was instrumental in...
Read more

Where Dreams Reside

-
Image
  This short film had similar challenges as my "Rice and Whiskey" short. There were very specific nuances of the setting that had to be correct or it was not authentic in my view. The major problem was with the Thai fishing boats. To quote Wiki:  Thai fishing boats, known as longtail boats (reua hang yao), utilize a distinctive long propeller shaft extending from the rear of the boat. This long shaft, typically several meters long, is connected directly to the engine, often a converted car or truck engine, and allows the propeller to be positioned at the surface of the water, higher than the surrounding water level. This design enables shallow water operation and provides thrust vectoring for steering.  The only text to image model that could get this correct was Google/Imagen 4 and sometimes close with Perchance/stable diffussion. The music generated was created with Aimusic. I developed lyrics with the AI lyrics generator and then created a song that I liked. What's int...
Read more