🎥｜animation

[ashen notch]

maybe it's because i put the frames at 50

[ashen notch]

I tried making the gif myself which helped smooth it out after removing some questionable frames, methinks

[frank haven]

Hi there! Here is a videoclip I made for a metal band using mainly (but not exclusively) deforum. Hope you like it! https://youtu.be/X_AbZZIWJ6Y

[flat schooner]

Hello everyone. I hope someone can help me. I am trying to achieve a 3d turntable (camera is pointing at the object and orbiting around) in deforum 3d animation but without good results. Anyone has the solution to this??

[keen kindle]

https://youtu.be/3i7M6Mo-mzM

I hope you enjoy it. I'd really appreciate a like or subscribe. I really enjoy doing this and I'd like to continue to do so. Gotta figure out how to justify it. lol

[mossy ridge]

spent a lot of time making this
https://youtu.be/WSaYoRDsbkc

my best animation so far

watch it or dont

[native sinew]

Some help please

In deforum, setting the translation_z to a negative number to get it to zoom out I just get these lines and ugly artefacts. How do i make it generate something nice while zooming out?

[sick gale]

With automatic1111's deforum extension I can't seem to make my init image have any effect on generations, would anyone know why?

[fallen girder]

maybe can make zoom in and replay in reverse, or make it very slow and replay in 60fps or more

[slate briar]

Song is "Santiago - Lay Still". hope you enjoy

[ashen notch]

https://media.discordapp.net/attachments/417718730508730369/1037865345739935755/grid-0312-115538194-scary_girl_masterpiece_1.2_best_quality_1.2_highres_1.2_1girl_red_eyes_1.1_face_focus_0.8_detailed_eyes_highly_0.gif

still having trouble with swapping inbetween the prompts

even at 30frames T_T

[waxen lion]

try chaining 2 clips at 15 frames. You get more actions out of it

[mossy ridge]

First time trying an animation https://i.imgflip.com/6zfyje.gif

[tulip steppe]

https://tenor.com/view/cat-it-is-pointless-gif-24835141

https://media.discordapp.net/attachments/1031565201675407500/1037878207900307577/itispointlessC.gif

[austere holly]

Mushrooms power #blender #aiart #stablediffusion #cgi #imagetoimage #clothsimulation #geometrynodes #blender3d #simulation
https://www.instagram.com/reel/CkhOg2BPOq8/?igshid=MDJmNzVkMjY=

[ashen notch]

https://media.discordapp.net/attachments/1010577750077210726/1037917489281110067/6zgdfs.gif

[ashen notch]

https://imgur.com/a/mETxMpb

[waxen lion]

I see the animations creep out at night 😂

I'm going through some more scripts later. Some might help with transitions. I'll keep you guys posted

[keen kindle]

https://youtu.be/3i7M6Mo-mzM

https://youtu.be/MZ8POwW7uI0

https://youtu.be/K_z4jnYuWss

[keen kindle]

Any feedback would be really great. I don't see much feedback. I perhaps I'm not looking in the right place? Suggestions? Collaborations? I apologize if my prompts aren't full of lists of popular artists names who's art I could never recreate myself to excite everyone but I think there is merit in creating something without them. I know it's not the cool thing to do these days and perhaps the images or animations aren't as cool as using some artists name in describing my vision but I think I'm getting better at it since my dalli-mini days. I've written before about this in a few different places. Anyhow, a like would be fantastic if you can muster it. There's no getting rich on youtube for any of us. I am actually passionate about this, I want to share and I want to do it well. I know asking for a subscribe is way too much. My channel doesn't read you the instructions live as a scripts for how to sd then fumble around acting like I've done it before giving you something of value instead of confusing you. Getting any feedback is incredibly rare. I guess I expected different from an artistic community. Anyhow, I'm learning. Apparently 5000+ views gets you just a few more subcribers than your Mom. Always love your Mom. Now go subscribe, try to figure out some of the ML puzzles everyone seems to be blind to. Perhaps you'll win something.

https://youtu.be/mdeHrj6rf80

https://youtu.be/GtQAETEZ2Sc

https://youtu.be/YHjyJkZZa2M

https://youtu.be/MWwB6-IaTQw

https://youtu.be/7vu4CfJNZ90

https://youtu.be/iUWcPmkpRcA

Fail here https://youtu.be/zjiyYDXh5NA

https://youtu.be/7NPNP7K2NdA

I hope you all find some enjoyment in them. A lot more on the way including "Finding Amalgamaton". Look out for the puzzles. Most are in plain view and they unlock more puzzles. It's an amalgamation of automatons all the way down from audio, visual, words and stories, poetry and histories, sad and happy character plots, the Steampunk Circus is coming to town. Get on board. Thanks for watching.

20 years ago I made an animated short film. It was beautiful in it's simplicity on the big screen at the Film Festival. Animated wooden dolls in 3DS max. After long enough, I figured I would never have the chance to do it again. Then this brick called diffusion dropped on my head and not I want to make another short film and I want it in a theater again like back then. Very much so. Are there others here with honest aspirations to do such things? I'd love to talk.

I think even in my somewhat scaling age this is very possible to do and do well with the right minds.

The festival was in Blacksburg, VA. That's where my alma mater is. VT. Not sure if any of you would be familiar with the town but it's a drinking town with a football problem and cow with a deliberate hole in it's side. 😉

https://youtu.be/K_z4jnYuWss

Already posted that one. My bad. Good day.

[winter bridge]

Hey there, as a first post in this forum I’d like to share my first experimentations with animation in SD ☺️ hope you’ll enjoy, enjoyed making it for sure!
https://www.instagram.com/reel/CkJNZ5NoNaj/

and a variation : https://www.instagram.com/p/Cj-1Fv1oxq8/

_spacedove

A littleexperiment featuringcreative dancing 🌺 go check her out and let me know in the comments what you think ☺️
.
.
.
.

Likes

219

Instagram

[rustic cosmos]

A dark Devon dox cat stands on a white nespresso coffee machine, ready to jump to the ground. Realistic style

[waxen lion]

Nice! Glad to see people using the technique! Would love to know how to create pose data to increase accuracy. Keep it up!

oh! and I've been doing a write-up on the technique and will be exploring other methods! you can find it here: https://rentry.org/AnimAnon

[ashen notch]

what the hell was wrong with that person lol

[ashen notch]

O_O how do you calculate the fps, i can't seem to figure the ms thing out

[ashen notch]

Wow that's awesome, what did you use to make that 🙌

[waxen lion]

1000ms = 1 second. so if you want 12 frames a second you would do 1000/12. I rounded the number to 83. I also left a reference chart in the guide to save you some trouble

[ashen notch]

83ms?

[waxen lion]

for 12fps yes but I'd recommend doing 8 and use frame interpolation to bump it to 16

[winter bridge]

The deforum notebook and a video init from a dancer ☺️ (she’s tagged in my post) thanks for the kind words!

[winter bridge]

Thanks for the kind words ☺️ I’m not sure what technique you’re referring to but I’ll check out your link. For these I used the deforum notebook with a video init. Cheers!

[waxen lion]

taking a look again and yeah it's definitely img2img. Must have tricked myself haha! Great work though, very clean frames.

[forest sun]

https://www.youtube.com/watch?v=FqwgUC8JBj8

[mossy ridge]

I was just thinking you could use the loopback feature for doing wind or maybe water animations https://i.imgflip.com/6zknqv.gif

[alpine oar]

Exciting news, all! I dropped my first AI video compilation, over half an hour of Stable Diffusion worlds explored via deforum

https://youtu.be/dNIUxYn3s88

This is the phone scale video, somewhat of a teaser for my full HD widescreen video with original music that's coming soon... But yeah, enjoy! Never be bored again as long as you have your phone 🙏🚀👽

[waxen lion]

nice style switch

[ashen notch]

What if she wore adidas tho

[ashen notch]

@waxen lion

search "to love ru adidas" in the discord gifs bar smh

[waxen lion]

https://tenor.com/view/momo-to-love-ru-momo-belia-deviluke-adidas-drip-gif-27040611

[drifting cave]

Today I Finaly finish promotion animation for my comic:
https://youtu.be/HbCKtU40kCg

It was made from these long pictures I was posting here some time ago.

[exotic ledge]

very cool man 🙌🔥✨

[dry pier]

Here's a part of an AI Animation I made for a song of mine dropping next week
https://youtube.com/shorts/oOUyjOTS7j4?feature=share

[ashen notch]

i seem to get better animations by adding extreme tags

[waxen lion]

Great job btw! This one is really good

found a few neat tricks today that will make planning longer sequences a lot easier. I'll be putting it in the guide tomorrow

[gilded vigil]

preview of the newest MERKURIAL song and video, in 4K later today on youtube

[gilded vigil]

now in 4k on youtube:
https://www.youtube.com/watch?v=x9dpjeK5VLk

[stable oak]

/settings

[keen kindle]

https://youtu.be/3i7M6Mo-mzM

https://youtu.be/iUWcPmkpRcA

[ashen notch]

https://media.discordapp.net/attachments/1010577750077210726/1038968113611423865/meow.gif

meow

[frosty monolith]

was playing around with a very old gan network (not diffusion) and now i wonder if anyone is working on a similar tool/script to make music-video visualization work with stable diffusion?

just... because the old gan networks were very bad at making coherent images... and temporal coherence as well

[olive gull]

I scavenged the internet for the most interesting AI film news, projects, and research papers that were published last week and summarized them down to a >5 min blog post so you don't have to🚀

https://medium.com/@sebastian_6251/the-ai-film-newsletter-54ae05bcd9d5

[honest musk]

https://www.youtube.com/watch?v=qbOSJ9hff2M

experimenting with live action - > anime

also experimenting with using in-painting to create frames for character dialogues in unreal engine (auto animating based on the text)

[ashen notch]

That's awesome!

[honest musk]

thanks!

[ashen notch]

can i send you something?

it's an animation that i made but can't post on the server for several reasons

[honest musk]

yeah as long as it's not nsfw

[ashen notch]

nvm

[honest musk]

by that i mean s*xually eplicit. anything else i don't care

[ashen notch]

Ohhh

🙌

[radiant hedge]

@mossy ridge forgot to turn off zoom

I only wanted to go to the right so I interrupted it

[mossy ridge]

xD

[radiant hedge]

I am testing for 50 frames at 20 FPS

[mossy ridge]

it's going to be magnificient

[radiant hedge]

ik, my first real deforum project

[void gyro]

Hey all here's my attempt at creating a super smooth transitioning video:
https://youtu.be/A9JGOKIgX7Y

[waxen lion]

How long did it take to generate all that with the A100????

[waxen lion]

hopefully my guide can add some insight: https://rentry.org/AnimAnon. Not much on the inpainting frame-by-frame stuff but I'll get to inpainting Prompt interpolations soon! Great work btw. Very cute!

[honest musk]

thanks! are you the owner of rentry dot org? if so thanks very much, everything posted there is super helpful. it's hard to keep up with it actually things are added so fast

[waxen lion]

Thanks so much. It's great to hear it's helping people out! Yeah, stuff is improving like crazy. Every day there is progress!

I don't think I posted my take on MMD yet 1 sec

[honest musk]

before i came across your site i knew very little about this tech, and also had no idea so much development and experimentation was being done by enthusiasts.

[waxen lion]

https://files.catbox.moe/jtp14x.mp4 Volume warning!

[honest musk]

wthell this is so high quality. is this made using a live action video as reference ?

[waxen lion]

in the beginning yes its a video of a person but its fed through MMD and the animations are generated by AI on a 3D model. Then I pass it through a video script in the SD Webui at half the frames I want, Then I use frame interpolation AI to fill the gaps 😉

[honest musk]

amazing. how do you get such a consistent style between all frames?

[waxen lion]

Very low denoise (0.1-0.12). It works better if your subject in the video looks like what you want to make.

I was going to post it on twitter but I just need to fix the volume

[honest musk]

cool. i will be digging into your animation guide later senpai. inspiring stuff

[waxen lion]

Hey it's my dream to see everyone's dream anime. So I'll push it to the limit for my fellow weebs 😉

[honest musk]

followed you on twitter. one of my goals is to integrate waifus into my terminal emulator

[waxen lion]

https://files.catbox.moe/d27xdl.gif also had this as a test for chroma key. Was planning on tacking deforum complete with a dancing Miku but the transparent sleeves messed everything up 😢

[waxen lion]

thanks for the follow btw!

[honest musk]

i guess vtuber avis would also work well for this

[waxen lion]

bingo

I'll send you some links 1 sec

[ashen notch]

how'd frame interpolation work on the video? 🙀

If you don't have the seed and all that

[waxen lion]

frame not prompt 😅 I did 12 fps then doubled it to 24. I do need to try some different models for that, RIFE is good but it has problems with animations.

[ashen notch]

ohh, is the video script in the animation guide?

im gonna attempt some flowframe stuff

[waxen lion]

you always could with the animations 🙂 stick the frames in a folder then use flowframes to set and interpolate the fps. I just did a simple vid2vid but I saw one that looked really interesting

1 sec

https://github.com/OndrejTexler/Few-Shot-Patch-Based-Training

this is the one I used: https://github.com/Filarius/stable-diffusion-webui/blob/master/scripts/vid2vid.py

[ashen notch]

ohh i'll try them out in a sec

[vestal cedar]

Started experimenting with these. Takes 10-15 min each, really fun !

[waxen lion]

Super clean alphas! Really cool! Nice work

[vestal cedar]

Literally 1 click with Canva ! haha

[ashen notch]

i cant figure out how vid2vid works 😭

[ashen notch]

and isnt batch img2img just better?

[waxen lion]

if you're more comfortable with it you should be good. Seen some good examples of it on twitter.

[ashen notch]

nvm T_T

this creature disagrees

the rotoscoping thing from deforum did seem very suitable for this tho

cause its impossible to get the face to not #$%^ with low denoising strength, at the same time high denoising strength gives good faces and everything but sadly gets the motions wrong

[ashen notch]

😭

[radiant hedge]

https://media.discordapp.net/attachments/1036248215441387563/1039620132516925470/download_7.mp4

[vital yacht]

Human Disassemble Animation
(made with Deforum)
https://www.instagram.com/tv/CktpgGpL0iQ

tragix.ai

"HUMAN DISASSEMBLED" (2022)
The Animation spin-off

---

This is the spin-off animation of the "Human Disassembled" series proposed in these days. Enjoy it!

I hope you like my creations.

---

Created by AI+Tragix
Created with Deforum Stable Diffusion
no video init image

Audio: "March of...

Instagram

[rocky matrix]

https://youtu.be/37uLDMncK80

[keen kindle]

https://youtu.be/ntq6MqUtc9E

https://youtu.be/K_z4jnYuWss

https://youtu.be/iUWcPmkpRcA

https://youtu.be/mdeHrj6rf80

https://youtu.be/3i7M6Mo-mzM

[paper granite]

Is it done with deforum ?

[broken dune]

https://youtu.be/hTHmk9F9Bxo

[radiant hedge]

Ye

[fossil cedar]

Hey

I'm using A1111 to generate animations

if I upload a frame an press generate it creates widely different results every time

but if I upload a batch it keeps things very consistent frame to frame

How do I change it so that every frame is different from the next? I tried increasing the noise alot

Is this a recent change? I used it before a bunch of times and it used to not take into account the previous frame and just generate something new based on the noise setting

now the last frame seems to dictate the next frame with less regard of noise

oh wait I think it was I was using Euler instead of Euler A

[mossy ridge]

use loopback

[fossil cedar]

where is that setting

[keen kindle]

Check out some of my vids. I've made the music with AI including the lyrics and prompting setup. Used diffusion to make the wav and that was also the prompting setup for the animations and they were synced. Yup. Fun stuff. This one includes the AI music and vocals in the beginning. Diffusing music took forever when I made it. The video took 37 hours to render! My other videos have better overall sync with the sound now as I've learned more. https://youtu.be/7NPNP7K2NdA If you have any questions I'd be happy to help.

The "Feed a Funambulist" video was a collaboration with another musician and syncing that with the visuals and Google FILM was interesting. Learned a lot. Especially regarding the collaboration and communicating how to do it. Check that one out too. https://youtu.be/iUWcPmkpRcA

The lyrics for the first video start with "She laughs the sound of steam.." It's from a poem written by a GPT AI tuned up to my poetry and writing. It's pretty wild stuff.

Also, there is not a single prompt including an artists name. That just wasn't a thing when I started with mini.

It just happened that way. It doesn't hurt that steampunk and circus are awesome though. lol

gtg... see ya'

later

Hope that helps with your music quest. I'm eager to see what you come up with. And hear it! Cheers.

[haughty isle]

Hey! Yes I've been watching your Steampunk Circus stuff, it's very cool (and hard to miss, you're everywhere 😉 ). What I'm interested in achieving is much more fine-grained audio response, in the style of the good old music visualisations like Milkdrop, but "brought to life" through Stable Diffusion – hence my experiments feeding butterchurn into the SD input. I'm also playing with extracting audio "events" with https://aubio.org/ and using those to generate parseq keyframes. Honestly, I can't remember last time I had this much fun coding. 🙂

[haughty knoll]

a small deforum test https://www.instagram.com/reel/CkMUh0CIc7i/?igshid=YmMyMTA2M2Y%3D

[radiant hedge]

Lmaoooo

[wraith prism]

Video

[wicked urchin]

Alien macarena

[safe raft]

https://youtube.com/shorts/nk7MOTdH2Wc

[waxen lion]

Super cool

[bold cipher]

SD animation (deforum notebook) + other generative AI == https://twitter.com/coqui_ai/status/1587880375505735680

coqui (@coqui_ai)

Generative AI 🤖🎨 has fundamentally disrupted content creation 🔥

Now AI can:

✅ Generate expressive voices
✅ Create video from text
✅ Compose beautiful music
✅ Write long, coherent texts

Put it all together and you get the future of media 🐸🚀

1/🧵

Likes

204

▶ Play video

Twitter · Nov 2, 2022, 6:52 PM

[gilded vigil]

you got some hate replied sad sad

[bold cipher]

haters gonna hate

[gilded vigil]

can I make you feel good by this?

[bold cipher]

that's so good!

[gilded vigil]

well the AI loves cats

[keen kindle]

Awesome! Thank you! You kind of have to be everywhere, right? lol. That sounds great! I am so down with that. The sound experience has to be top notch. I totally feel you on the coding side. I've been a demon for months now! Working with AI has drastically improved my coding abilities. I assume it's because of being challenged in areas I've never worked before but hot damn. It's super fun! I have not heard of butter churn. I'll definitely check it out. And I've never seen aubio.org! Oh, damn. There goes my night. You win the award today for destroying my tomorrow. I'll report back with my findings. Thank you so much! I have been working on some multi-model modeling with audio which is what was in that first video. It's a slog but I know LAION is working on something similar to SD for audio. That's exciting.

[haughty isle]

Sometimes the hardest part is just picking one. 🙂 https://streamable.com/smxgq8

[fallen girder]

"Machine Heads" | Cyberpunk Animation (Robo Diffusion v1 / Deforum v0.5)
https://youtu.be/KqbcUtbI3SU

[paper granite]

Bottom right

[crystal perch]

With Deforum extension on Stable Diffusion (trained with DreamBooth on my face).

(each frame is generated from prompt, no video or image input, it does have a skip of 2 though to help with transitions).

I had no laughing prompt, just varying degrees of smiling prompts (the first prompt is sad, so as to give the illusion of attempting to keep from laughing)

[glacial kayak]

Hey Everyone! I'm sharing my first animated music video: https://www.youtube.com/watch?v=gII_ITTGHx8

[crystal perch]

Thought this one had some interesting effects:

[ashen notch]

https://media.discordapp.net/attachments/1037852458128507031/1039057178260144148/grid-0417-3433547722-1guy_Spike_Spiegel_gray_eyes_from_from_front_portrait_black_adidas_tracksuit_looking_at_viewer.__AND_1guy_Spike_Spieg_0.gif

https://media.discordapp.net/attachments/1037852458128507031/1039056305308057620/SPOILER_grid-0506-3433547722-1girl_megumin_from_from_side_red_adidas_tracksuit_AND_1girl_megumin_blushing_drooling_mindbreak_moaning_aroused_from_0.gif

[austere holly]

https://www.youtube.com/shorts/Vm0gtMooIJc

[keen kindle]

https://youtu.be/3i7M6Mo-mzM

https://youtu.be/7vu4CfJNZ90

https://youtu.be/iUWcPmkpRcA

[jaunty sequoia]

https://youtu.be/enI0rSLBR7Q

[keen kindle]

https://youtu.be/8a1rKzhPmko My first tutorial attempt. Let me know what you think.

[ashen notch]

https://giphy.com/gifs/nhRliZX4bVvY2oRuRW

[silent yarrow]

https://www.youtube.com/watch?v=p3eygmzWJYI

[severe merlin]

hey y'all not sure if this qualifies but I made a music video using SD, let me know what you think!

https://youtu.be/1J0fscuPo5U

[wicked urchin]

I can never load your clips 😆

[waxen lion]

damn! must be the encoder...

I'll switch it up

[keen kindle]

https://youtu.be/8a1rKzhPmko

[keen kindle]

What did you use for greenscreen? I left RunwayML so I'm looking for an alternative. Looks awesome!

Wasn't RIFE the default in Disco?

[waxen lion]

came with the software. It's pretty decent for puppeting stuff and not worry about an alpha channel. I just put the green screen in obs because I had to pass through SD.

I was using flow frames but there isn't a way to stop the frame interpolations so I've been using ffmpeg on its own

[keen kindle]

Cool. Thanks. It makes sense. I'm always searching for movement.

I haven't looked at flow frames since disco actually.

[waxen lion]

no prob. Here is something everyone can enjoy!

[keen kindle]

Nice!

[waxen lion]

no img2img btw!

turns out txt2vid was already a thing

[keen kindle]

Put one of those characters through this thing https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model It's super fast. I'm curious how that would come out.

[waxen lion]

That was my next test!

[keen kindle]

YES!

[waxen lion]

I went through EbSynth first but it doesn't hold well 😬 much better for real film not CG characters

[keen kindle]

So, after getting some decent results with Jackie Chan I started testing it with my own animations from those successes to get characters to look around even more. It's surprising working out regarding refining things. Ther

There is a lot there to explore I think.

[waxen lion]

then I think you need to see this if you haven't yet https://youtu.be/4j-K-HWLjiI

it's my proof of concept for prompt interpolation.

[keen kindle]

What!?!? That's so great!

[waxen lion]

no img2img and it's seamless

I kinda lost it in the beginning and I got a seed glitch near the end 😅 but I learned a lot doing it

[keen kindle]

Subscribed

[waxen lion]

don't forget to check out the guide!

[keen kindle]

You too. lol

[waxen lion]

I'll give your tut a spin. Needed someone to follow along with to try it out.

[keen kindle]

haha.

Enjoy.

[soft bone]

3 minute long morph, set to music

https://www.youtube.com/watch?v=wbwMMBSxLAk

[keen kindle]

https://youtu.be/8a1rKzhPmko

[frank nymph]

https://youtu.be/QnXOLZUix8I

[ashen notch]

woww that's amazing, how'd you get the staff to open like that?

[waxen lion]

https://tenor.com/view/bob-ross-painter-painting-talk-we-dont-make-mistakes-gif-17574947

[plucky plover]

after a while you'll get something cool : ) eventually! very cool accident 🙂

[frank nymph]

I recorded myself and made an animation

[thin dust]

how do I make animations in SD?

[thin dust]

how did you do this?

[waxen lion]

you can batch your img2img so if you break a video down into pngs you can feed it into the batch with whatever prompt, set your denoise to whatever you feel like (lower sticks closer to the video images, higher increases randomness) There are scripts that can also do this and so much more! The batch img2img is a good place to start though

[thin dust]

oh I forgot about that

[waxen lion]

as for the glitch effect that was probably added in post

[thin dust]

does just adding the pictures make it look smooth like that?

[waxen lion]

you would need frame interpolation software to blend things together at a higher fps

people normally use flowframes

[thin dust]

oh I can just do that in Premiere

[thin dust]

or that

[waxen lion]

after effects also has some handy things you can use too!

[thin dust]

I want to get into premiere but I'm too busy

@waxen lion can animations be made with text2img?

[waxen lion]

https://rentry.org/AnimAnon-PromptInterp 😉

[spiral knot]

https://www.youtube.com/watch?v=nTGs_dZzZ1M Created with Premiere pro, After Effects, and Photoshop. Will get into a breakdown later of the process.

[sleek quartz]

nice!

[crystal lake]

this is A.I?

[spiral knot]

All images were made from stable diffusion, and then cleaned up in photoshop and placed in Premiere Pro to be edited to what you see. The base footage of the character is from Mixamo animation and then the character is made from two different SD images that was cleaned up and then put through Ebsynth. so, yeah AI.

[frank nymph]

Oh ye exactly what fizzledorf said

[crude hazel]

tried some animation today😄

[thin dust]

Woah how did you do this

[thin dust]

What do I type in the prompts? How do I phrase it?

[crude hazel]

stable diffusion, pixaloop for elements and capcut for editing

[near pagoda]

Batch img2img seems to work. I want to try converting a full short animation into 1000's and 1000's of frames use custom prompts and convert it back

[waxen lion]

depends on what your doing. If your using img2img, try to describe the subject and add your own styles and artists after. Helps with keeping things coherent. If you are using txt2img with prompts interpolation use the same prompt you used for the primary prompt but change out the actions, pose and expressions.

[waxen lion]

nice 🙂 I wouldn't do it in one go though. Clip one scene at a time so you can change up the prompt to include new things in the next scene then string them all together.

[icy dagger]

Graffiti Alley (4K) - a stable diffusion deforum animation
https://youtu.be/vliOwtGlo_k

Insectica (4K) - a stable diffusion deforum animation
https://youtu.be/uOFyLQiBXlk

[keen kindle]

https://youtu.be/MWwB6-IaTQw

https://youtu.be/8a1rKzhPmko

[warm flower]

Bass cover of Hysteria(Muse) but I'm anime lol
https://www.instagram.com/reel/Ck6TaibARYn/?igshid=MDJmNzVkMjY=

[faint rivet]

https://www.youtube.com/watch?v=pl0cc8eOe4o

[rocky matrix]

https://youtu.be/wnMvDjWvC9o

[astral bane]

https://www.youtube.com/watch?v=R52hxnpNews&t=333s

[ember fossil]

know it is not directly but corridor used StableDiffussion to the max in this: https://youtu.be/QBWVHCYZ_Zs

[mossy swift]

What is a good tutorial to make video renderings? How zoomed in do you have to be to get a good sync if the person in the video is singing?

[radiant hedge]

you mean the way I did it?

[keen kindle]

https://youtu.be/vs7OR7LiDF4

[edgy musk]

Hey guys! 100% stablle diffusion music video we made for electronic band RYSY -> https://www.youtube.com/watch?v=oR7MkOOoGvc

[versed prism]

Can't stand this guy. Doesn't explain what's happening on the screen or why, constantly chuckles to himself at how amusing the tech is, and is a lot of the time unintelligible due to recording from what appears to sound like a 2002 early day Logitech microphone.

[keen kindle]

I apologize.

I'll try to do better. I'm still learning so your feedback is incredibly helpful. Thanks for watching.

I'm using the microphone in my laptop at the moment. My surroundings are, unfortunately, a bit mechanical. I'm trying to work it out. Any suggestions on a microphone or reducing the background noise?

I'd appreciate it. Regarding the chuckling, I'm not going to stop that. It's a circus. I do find the tech amusing.

Suggestions on how to point out where to pay attention on the screen would be great. Some tool to zoom in perhaps? Thanks for your feedback. I'll try much harder next take.

I am trying my best.

I'm very aware my approach needs adjustments.

[versed prism]

Ohhhh. Well then go all in and get yourself a clown horn and a kazoo. 🙄 People who will want to watch your videos are going there to learn and siphon some motivation from what you have to share. The chuckling comes off as self-serving and navel-gazing. Save the character development for when you've got diehard return viewers who will want more than info and guidance.

A good mic used by several beginning anitubers is the UM-925. You have a rough and husky voice. The clarity and warmness of that mic will turn you into a soothing majestic bear hosting late night deathmetal radio

[keen kindle]

The horns and kazoos aren't really my thing. I'll look into it though. I really do appreciate your honest feedback.

I very definitely want to be a majestic bear.

I think that's the coolest I've read all day. lol.

[keen kindle]

That's one hell of a prompt "a soothing majestic bear hosting late night deathmetal radio" Wow. You're awesome. Cheers.

[versed prism]

You certainly are a 🤡

[keen kindle]

Seriously, though. Thanks. I really do appreciate you taking the time to help me out.

[dry pier]

do you use specific settings for "still" animations? i was trying with 2d animation but my still images just get sharpened

[waxen lion]

I might have mistaken it img2img with txt2img. are you trying to interpolate to the same prompt?

[dry pier]

oh so that is img2img? thank you very much, I thought it was deforum and I wasn't able to reproduce that

[waxen lion]

yeah there are different types of interpolations depending on what script you are using. I've noticed this trying it out on a bunch of different ones. I'm going to do some edits in the section for clarity too so thanks for the heads up

[stable cedar]

https://youtu.be/6bN5kXuLmeE?t=7

[waxen lion]

I'll be adding this soon but you can interpolate attention from the same prompt. for example (prompt A: (waves:1.5) -----> prompt B:(waves:1.3)) and it should give a subtle change for an animation. It still works with the chaining method and you can loop back like normal too.

[icy dagger]

A Pirate's Life (4K) - a stable diffusion deforum animation
https://youtu.be/01FpawKzUSM

[sleek quartz]

working on getting less camera movement

https://youtube.com/shorts/Cymkgx-hdUI?feature=share

[livid wasp]

• The Forest Fire -
  🔥🔥🔥
  Experimenting again with horizontal transition, I think it has a great storytelling power.

https://youtu.be/PI6XFtuVf1U

[candid bramble]

/settings

[rugged prism]

the post processing interpolation is way too much 😅

should have started with a higher fps

it's very hard to watch when you interpolate that much

[obsidian bobcat]

https://www.youtube.com/watch?v=1W3lf_Z7Zas realtime fx on AI video 🙂

[mossy ridge]

equirectangular image to animation = flying spaceship 🙂
https://youtu.be/LTWg4kf_x-Q

[mighty osprey]

https://youtu.be/5Ryimj8NZWo

another music visualizer

this seems like a good place to ask, is anybody aware of any method of batch inpainting? would save so much computing time on animations like this

[waxen lion]

funny, I was just experimenting with batch inpaint. I used the External Image Masking script in the batch img2img and made sure to check off the draw new mask every run.

I'm sure you're looking for a way to feed masks in during the batch process. Not sure if there is a script off hand but I'm sure someone around here knows

My method required manual masking every frame but you at least get a vector to move around if you misplace something.

[mighty osprey]

yep batch masking is what would help me for what i make.

[mighty osprey]

@obsidian bobcat yo this is sweet, are you using something in a python script to read MIDI data, or a VJ program like touchdesigner? the fact that it's realtime is insane

[flat schooner]

Audio on!

[astral bane]

https://www.youtube.com/playlist?list=PL8G7-J1OZZnS205o_9XbNhmp6JPSi58-n

[keen kindle]

https://youtu.be/PEMHkBTxJp0

[keen kindle]

https://youtu.be/vs7OR7LiDF4

[signal cairn]

https://www.youtube.com/watch?v=eBpmX1HTgt4

made a full music video for a tune i like (not deforum, my own music-video optimized tool)

[flat schooner]

Audiio on 🎵 🎵 🎵 🎵 🎵 🎵 🎵

[fallen girder]

Biohazard☣ | Animated Short Film (Stable Diffusion v1.5 / Deforum v0.5) [4K]
https://youtu.be/spiBEbwTnoc

[flat schooner]

audio Sync

[faint rivet]

See details of video for details on render.
https://youtu.be/gqF_KUdl9fw

Let that sink in?

[hasty plover]

For the love of weird Lynchian Vibes: https://youtu.be/J9kKFtAuMtc

[mental pecan]

Short video of masking out the background and applying SD to the individuals.. https://twitter.com/DreamingComputr/status/1593643107014258688

Dreaming Computers (@DreamingComputr)

Poppin moves AI transformation..🕺🏽

This was a clip @lsdream posted of him and @popntod throwing it down. I used to test some new AI art generation techniques on.

#aiart #art #digitalart #generativeart #abstractart #aiartcommunity #artificialintelligence #poppin

▶ Play video

Twitter · Nov 18, 2022, 4:31 PM

[amber rivet]

McDonald's family and friends https://www.youtube.com/shorts/hEgws8LbGFo

[pearl patio]

Built a digital necklace to display AI Art using the drip junkies app https://www.tiktok.com/@dripjunkies.com/video/7167440141500386602?is_copy_url=1&is_from_webapp=v1

[hardy shale]

https://www.reddit.com/r/StableDiffusion/comments/yz3wim/infinite_zoom_script_demo/

[spiral knot]

characters generated with img2img SD then ran through EbSynth for animation. https://youtube.com/shorts/VgnogNjFYXQ

[wary copper]

Quick question, when installing https://github.com/google-research/frame-interpolation for windows I reach the part where i need to install the CUDA Toolkit. Near the end of the installation process it tells me I do not have Visual Basic installed and gives me the option to skip installing it and continue onwards. My question is; Do I need to install Visual Basic and if so, what elements do I need to install with it?

[rugged prism]

don't bother with FILM for windows

it's slow AF

and the results aren't so different than RIFE anyway

[rugged prism]

I can't remember the answer, but I ran it myself, this is why I know it sucks in windows 😛

(on a 3080 desktop)

[wary copper]

what should i use instead then? I tried installing RIFE but the only tutorial i found to install it was not garbage but also didn't work lol

[rugged prism]

https://nmkd.itch.io/flowframes

😟

[wary copper]

cool i'll give that a try thanks

[rugged prism]

I have the paid version, not sure it's really needed.

try the free one, rife 2.x might actually be better looking anyway

just slower

rife 4.4 is extremely fast compared

[wary copper]

where would i find rife 4.4? or even 2.x? this is the one i was trying to install but failed. https://github.com/megvii-research/ECCV2022-RIFE

oh, is that jsut the speed? sorry i'm a total noob atm

[wary copper]

i've found a few things on rife filter for vapoursynth https://www.svp-team.com/forum/viewtopic.php?id=6281 is that what you were talking about?

[vital turtle]

https://vimeo.com/772664517

made with deforum sd 1.5

[proud ether]

https://media.discordapp.net/attachments/1024073620852584538/1043487265726406687/ezgif-5-d977cb992e.gif

[frank nymph]

https://youtu.be/di2AzcQXwWY

[stiff wren]

https://www.youtube.com/shorts/Su8yQAQgwt8

[radiant hedge]

That with thine motion capture?

[astral bane]

https://www.youtube.com/watch?v=-cT495xKvvs

[astral bane]

Everyone a moviemaker now?

[drifting cave]

Yet another animation i made using blender and AI generators (stable diffusion, and Midjourney V4). This time about greatest rulers in human history https://www.youtube.com/watch?v=-xkRbfJtb0A

[rugged prism]

ebsynth

[icy dagger]

Artificial, in Sam Nation (4K)
https://youtu.be/ZI6xGZk7JCA

[keen kindle]

https://youtu.be/6v_j5qvEKx0

https://youtu.be/PEMHkBTxJp0

https://youtu.be/vs7OR7LiDF4

[inner crest]

ebsynth

[celest flax]

https://internot.club/zfxzmkrfsy

[ashen notch]

so gooddd

[pure folio]

https://www.instagram.com/reel/ClN7xiXg69T/?utm_source=ig_web_copy_link

[vital turtle]

https://vimeo.com/773430930

fresh out of the oven

[barren dome]

first one with deforum 0.6

[sleek plinth]

so I’m trying to do a long video with deforum but don’t understand what to put for the seed_schedule so I can change seeds at certain points

(Similar to what was done here: https://old.reddit.com/r/StableDiffusion/comments/ypq227/tried_to_pull_off_an_ultra_smooth_video_where_you). Starting to feel like deforum isnt the right tool for the job.

[barren dome]

Looks like slow interpolation on a fixed seed maybe?

[keen kindle]

https://youtu.be/PEMHkBTxJp0

https://youtu.be/vs7OR7LiDF4

[shy olive]

https://vimeo.com/773695796

[faint harness]

https://youtu.be/TJu3ZEhvXzg

[astral bane]

https://www.youtube.com/watch?v=gg5saXodH70 LOTS OF LINKS

[fallen girder]

Desolation | Post-Apocalyptic Animation (Anything v3.0 / Deforum v0.6) [4K] - Workflow in the video description
https://youtu.be/44BdExhIzwA

[lost berry]

So I was trying to make use of this incredible tool to tell a story in a meaningful way... "The peephole - A lesson in Russian bittersweet melancholy for those who may feel they need it." is a tragedy documentary project shot entirely in front of my door
and animated with the help of artificial intelligence. Here is the first teaser to what I hope will become a full length movie... https://youtu.be/gm9Rx8Luixw

[rancid lichen]

Testing a retrowave deforum animation. Will probably extend this to 1 min if I can figure out how to upscale the frames prior to the mp4 being created.

[modern rock]

https://cdn.discordapp.com/attachments/1024723587317366874/1044831383719264266/animation.mp4

animation made with a.i ( two people dancing while following the moves in the video )

[rancid lichen]

Longer version (sorry for posting twice)

[spiral knot]

is that deep motion interpreting the video to 3d animation?

[modern rock]

https://www.kinetix.tech/

actually its this

[vital turtle]

https://vimeo.com/774313592

aaand another one

[bright moss]

Feels like the intro to a very strange tv show about bananas

[icy dagger]

Creepy Critters: City Edition - a stable deforum animation
https://youtu.be/GyxMJ34DPbY

[spiral knot]

Reminds me of that Russian game called Vangers

[tawny steeple]

does anyone have a tutorial for animation?

[bright moss]

Made another anime tv show opening esque animation by accident

[bright moss]

wth did I just make

[mental coral]

Hello everyone!
I'm new to ai animations, its my first time on deforum stable diffusion. Where do you think i made mistake?
These are my prompts:

    100: "A samurai holding katana towards to sky on a skyscraper at night, drones flying on sky, cyberpunk"```

[astral bane]

https://www.youtube.com/watch?v=GyxMJ34DPbY&list=PL8G7-J1OZZnS205o_9XbNhmp6JPSi58-n

animation playlist

[rugged prism]

Fixed seed for a start

[acoustic ice]

made this music video with deforum local install. Original music. Can't get math expressions to work with this deforum install... anyone know how to do that? https://youtu.be/xT0B8KHq8-o

[onyx gyro]

using depth2img

[mental coral]

which seed should i use?

[rugged prism]

not a fixed one 😄

it seems like you used a fixed seed

am i wrong?

[rugged prism]

on which repo?

[mental coral]

i used -1 as default :D

[rugged prism]

what seed bahaviour you have set?

[onyx gyro]

https://colab.research.google.com/drive/11rcwJxA8hsp6NJvixWvQn_y5kaddqKsb?usp=sharing

[ionic zenith]

I made the local press for my DD video released last month and the SD one coming out this Saturday 😊

For those of you who hadn't seen it yet: https://youtu.be/a8MmPDqwNJc

Little excerpt from the forthcoming one 😊

And another

[cedar estuary]

My first try at making an animation. A little rough, but I like the concept!

[agile eagle]

A.I. Aging

[ionic zenith]

lol the music, wakawaka

boom chakalaka

🔞

[sleek quartz]

some slow peaks https://www.youtube.com/watch?v=hDnNIMuWiLM

[vital turtle]

https://vimeo.com/774897332

[waxen lion]

https://youtu.be/EP_bkc730TQ
Animation reel of a lot of clips I made over the past month and a bit. Enjoy!

[faint harness]

https://youtu.be/z4e0Kv0yYe4

[maiden lynx]

https://www.youtube.com/watch?v=dxFyGKMlL4Q

[rocky matrix]

https://youtu.be/wnMvDjWvC9o

[wary rain]

Just uploaded my "Longboarding through Alpine Dreams" video.
https://www.youtube.com/watch?v=-9ehFZYUzX0&ab_channel=RATDREAMS%3AAI🐀

^ Using RunwayML for Greenscreen & In-painting + @slow walrus's Stable WarpFusion (available on his patreon)

[past heart]

cool animations!

[cloud heart]

In my very first animation I tried to keep realistic aspects of few scenes, ocean flow particularly. Are there any enthusiasts from Slovakia? 🙂 https://www.youtube.com/watch?v=3xMufUoCxuE

[rugged prism]

testing infinite zooms

[ember kindle]

https://twitter.com/ScottieFoxTTV/status/1596365882426626048

ScottieFox (@ScottieFoxTTV)

Stable Diffusion VR - test
Progress update: Improving Depth2Mesh functionality.
Adding more freedom of motion and creative art style.
I might start building in UnrealEngine next.
#vr #stablediffusion #AIart #touchdesigner

▶ Play video

Twitter · Nov 26, 2022, 4:51 AM

[ionic zenith]

My new song and its new animation are having their YouTube premiere in 1h35min. Join us 😊https://m.youtube.com/watch?v=eOg4X92OMaA&feature=youtu.be

[weak pecan]

Playing around with the Inkpunk model in my Unreal plugin. Threw it onto a Favela map at night and I'm really liking the surface treatment it's applied to the environment.

[mossy ridge]

https://youtu.be/Xa8VnlU5kIg

[runic osprey]

@runic osprey on Instagram. Have a groovy day

[zealous linden]

your graffiti alley put me in a very disturbed trippy state, man

wew this makes me physically ill somehow

[muted plaza]

While the videos I see here are about a million times better than mine, I am still going to share it lol... I was more proud of it a few minutes ago lol
https://www.youtube.com/watch?v=khMuxLTjqw8

[zealous linden]

how long did that take to make?

[muted plaza]

couple of hours not including failure and restarts lol

[zealous linden]

maybe i just had too much coffee but these make me ill

wonder if something like temporally coherent networks like tecogan could be used to make more intermediate frames

there's non-neural frame interpolation too

[muted plaza]

yeah i have it slowed down to 12 fps, otherwise the changes are just too fast but they are still a bit too quick.... its a cool effect that i like about ai videos (reminds me a bit of 80's music videos) but would b nice if the transitions were smoother

this was another one i did that i tried my best to make less charring
https://www.youtube.com/watch?v=m5g9ni-Uhi4

came out way longer than i planed to.

[zealous linden]

well it's impressive but it is a bad dream to me

actually this planet is turning into one...

ima stick to the classical art chat

cheers m8

[ionic zenith]

𝐉𝐞𝐚𝐧'𝐬 𝐌𝐞𝐦𝐨𝐫𝐲 is out!

Jean grapples with the sense that her mind and memory are getting out of focus in her winter years.

This is Slow Burn's 4th episode. Find it also on Spotify, YouTube Music, Deezer, Amazon Music etc etc.

Made with Stable Diffusion 😊

https://youtu.be/eOg4X92OMaA

[faint harness]

https://youtu.be/Af0QvvQyyhg

[mossy ridge]

how do you make it so that the face barely moves over time? my animations are wayyyy more chaotic

[muted plaza]

i change the default zoom to 0 (1) i believe to stop it zooming out like it does by default. tweaking the seed etc and keeping the prompts between the time frames as close to each other as possible...just change what you want to change

the further apart your prompts are the better too

(I am far from an expert though)

that makes me want to play around with the 3d options

[inner crest]

Yeah 3d is really fun. You can create a lot interesting video with it

[mossy ridge]

https://www.youtube.com/watch?v=mJvxqQqnwr8

[mossy ridge]

what is far_schedule and near_schedule?? i dont get it

[mossy ridge]

https://www.youtube.com/watch?v=ugIjidTt_UI&ab_channel=Kitchen

(stablewarp)

[radiant hedge]

when do you think it's ready for public?

[icy dagger]

https://youtu.be/Yk4fAc_eP84

[acoustic ice]

anyone know of a place where people making video are discussing settings and ways to get different effects? so we don't all have to reinvent the same things over and over ourselves. lots of cool videos here but not much discussion...

[wet ledge]

first storyline

[silent sapphire]

anyone have a solution for maintaining coherence/same-subject through frames?

[waxen lion]

https://youtu.be/oRNCK_0w2uc I just saw this come up. hope this helps.

[mossy ridge]

lower strength/steps

[waxen lion]

https://www.artstation.com/blogs/javoraj/71X1/ai-animation-stabilization Did anyone see this yet? Looks fantastic!

[regal aurora]

https://youtu.be/i-LMFv_8XGI

[ashen notch]

So crisp!

[rugged prism]

more info- only in the blog..

prolly not gonna share the details

but we'll see

it looks alright

[mossy ridge]

didnt even know i was looking for this too

[ionic zenith]

Made this video for my song with Stable Diffusion. The second of my songs for which I make an AI video (first one was with Disco Diffusion). This time I tried a bunch of new things, it's a lot of video init, but also some 3d animation, sometimes with green screen so you end up with two layers of AI images 😁 I was a lot more deliberate also this time with what to interpolate and how much. And obviously this time there's a lot of editing involved. Hope you enjoy it.
https://youtu.be/eOg4X92OMaA

But damn, making a 7min ai video takes a long time! 😅

[fallen girder]

"Neon City" | Cyberpunk Animation (SD v1.5 / Openjourney / Deforum v0.6) [4K] - Workflow in the video description
https://youtu.be/v6l--NbmZfU

[icy dagger]

https://youtu.be/GQz3JC82DfU

[ashen notch]

https://www.youtube.com/watch?v=OdRxIKv9z9w

[mild rune]

i made this today

[true pasture]

Alice in Wonderland

https://www.instagram.com/reel/ClgFh6AINle/?igshid=MDJmNzVkMjY=

[radiant hedge]

what music did you used?

[mossy ridge]

anyone help me trouble shoot with deforum?
i'm not seeing the frame generation preview

[solid flicker]

takais - 20 minute drive
//
prompted 20 min of animation (5 animations for 5 different songs that i made) using stable diffusion, and just put it on youtube if anyone cares - nothing fancy compared to some of your projects, but this one took loooong to render https://youtu.be/MRDW5zWXEyo

1024x576 resolution, using the animator script from github 🧿

[shrewd plank]

Stable Diffusion in suuuuuper slow-mo! 47,144 frames of each step of training on a single prompt
https://www.youtube.com/watch?v=1XFYDvSnsNg

[rugged prism]

Maybe upload h264 mp4 so we can see it in here? 🙃

[waxen lion]

I only have a .gif as the other file format but that should work fine 🙂 "This is a collab between an online friend and I" -from original post

[muted plaza]

My first attempt at making the animation change based on the music....I think i need a better guide, theres some cool parts where it works well though.
https://www.youtube.com/watch?v=TuJTGOSrQqY

oh and thought i had already shared this one:
https://www.youtube.com/watch?v=khMuxLTjqw8

[muted plaza]

wish i could get my results as stable as that, I embrace the choas in mine but sometimes consitency is way better

[waxen lion]

https://www.framesync.xyz/
https://www.chigozie.co.uk/keyframe-string-generator/
I don't know if you used these or not but they might help. I haven't tackled music syncing yet, Parseq implementation in on it's way to Deforum so I was waiting for that.

[waxen lion]

This is fantastic btw

[muted plaza]

book marking both of them,
The video I used for the abney park one was :
https://www.youtube.com/watch?v=exrDbTx6uJU

it was not the greatest tutorial video

[muted plaza]

Thank you 🙂

[waxen lion]

it's all txt2img btw! Probably why the posing seems so different haha

[muted plaza]

this is the site (and it does link from one of the links you gave) https://www.chigozie.co.uk/audio-keyframe-generator/

[waxen lion]

knew you'd see it 😉

[muted plaza]

How did you get it to stay so consistant was it generated via deforum with very specific prompts or all frames generated seperatly ?

[waxen lion]

Interpolation mode was recently turned on! I've been experimenting with my techniques inside it. there are some things that are wayy different about the animation prompt though that I need to get used to

That was my first test with it

[muted plaza]

the prompts i used for the steampunk one was identical at each stage except for the crowd amount....didnt really pan out as planed though

[muted plaza]

thats some earth moving lightning lol

[waxen lion]

have to get used to the new negatives haha

[muted plaza]

sd 2.0?

[bronze shard]

https://www.youtube.com/watch?v=aIbon41uek8

[waxen lion]

play around with the weights between interpolations

[waxen lion]

it's uhhh a bit of a mix lol. Was waiting for the new WD 1.4 to see if all my old prompts would hold up.

[muted plaza]

I am sticking with 1.5 at mo (i can train 1.5) I think 2.0 needs more time in the oven lol

[waxen lion]

It does look like a good framework for adding specialized model training though so I'm pretty excited to see how this new model release will pan out using SD 2 as a base

[spiral knot]

All images img2img

[rain grove]

Some img 2 img R&D, Layering sequences

[rugged prism]

This is GREAT!

What's the input video?

If I may ask

If there is one at all 🙃

[tall leaf]

https://www.youtube.com/watch?v=gRdKurerqUM First use of "AI-Integration" I've seen out in the wild. Probably SD, very well done. (the song slaps too)

[rugged prism]

First, I've seen more like it so it's not the first 😅

Second, it seems like stable warp

[tall leaf]

First use of "AI-Integration" I've seen out in the wild

[rugged prism]

Can't argue with that

💯

[tall leaf]

Thought it was cool. Just one of my sub's videos popping up in my feed

[rugged prism]

https://www.patreon.com/posts/stable-v0-5-21-74899593

For those who want to experiment with the specific software/ notebook

It's not free, FYI.

And it is really cool and well made!, the video you shared

[rain grove]

Thanks, there are three different layers of video inputs. It’s basically a style transfer in multiple layers. I find the image to be less jumpy to watch when you separate parts and runs several passes.

[rugged prism]

DMed you and shared a link to this on the Deforum server ❤️

[icy dagger]

https://www.youtube.com/watch?v=KEQFmMRnB9c&ab_channel=MrPlasm0

[upper geyser]

@rain grove how did you create that? looks great... you do contract work by chance?

[upper geyser]

any good animators for SD here interested in a contract project?

[crystal frost]

WIP - Music Video for my album.

[slate wind]

dopeee

[crystal frost]

Thanks, G.

[keen kindle]

https://youtu.be/vs7OR7LiDF4

[radiant hedge]

Wolf stays pretty stable

[frank nymph]

https://youtu.be/q9jIoSPDD78

I used stable diffusion as a creative deepfake maker in the second half of the video

[ionic zenith]

My latest music video is a week old today 😊 7 minutes of a bunch of different types of ai animation (3d, video input, with green screen, etc). Made with deforum.
https://youtu.be/eOg4X92OMaA

[ionic zenith]

And I happen to use film in it 😊

[mossy ridge]

https://youtu.be/MUAJNnjMRJI

[slim light]

Has anyone had success with installing AUTOMATIC's ui on a mac? --- or, does anyone know of another method for creating animations using SD, on a Mac, besides using AUTOMATIC's deforum or Google Colab? (Google Colab is too expensive)

[sleek plinth]

seed_travel + RIFE + ffmpeg = https://www.youtube.com/watch?v=5gBf8gNQHWo

[lofty quarry]

https://youtu.be/cZ-mqwhiVTE invokeai, finalcut, ableton

[dense crater]

https://www.youtube.com/watch?v=KKp5lzZLzdM

[hallow bramble]

https://youtu.be/yvh8_USJKBc

[faint harness]

https://youtu.be/fU_fHcZWEY0

[sleek quartz]

I have installed on a Mac Studio. was a little different process wise.. what is the issue?

[wise grail]

Aniamted MJ creation with help from depth2img from SD and blender. Small test(:

[sleek quartz]

[quiet brook]

123

[faint harness]

https://youtu.be/e-5YGZxroVk

[dense crater]

https://www.youtube.com/watch?v=7KyYSEOvK5o

[grave crag]

whats the easiest way to access animations?

I didnt see it in dream studio

[grave crag]

dude this is so good!

[lapis leaf]

Masked out, SD img2img, FlowFrames, CC and composite in AE.

[faint harness]

Thank you friend! Happy you like it!

[faint rivet]

https://www.youtube.com/watch?v=iE_vk0PkNnY

[keen thorn]

Very cool idea - is that an embedded LEGO model or just base SD2?

[agile eagle]

Christmas party 🥳 🎉 🎅

[icy dagger]

https://youtu.be/6etZfTwCFr4

[rugged prism]

I see no animation in this

Maybe one frame out of every 600

[marble copper]

Hentai,4k,porn

[hardy shale]

https://www.youtube.com/watch?v=yDCUTyZD--E
https://www.youtube.com/watch?v=KMFVr8A9gIE

[hot pumice]

3D inpainting test

[fallen girder]

"Witchcraft" | Deforum Animation (SD v1.5 / Openjourney / Deforum v0.6) [4K] - Workflow in the video description
https://youtu.be/-FChaVfsJbo

[mossy ridge]

https://youtu.be/Iq-kgQ3YAjY

[chilly zephyr]

🔖

[faint rivet]

It's 1.5 normal

[chilly zephyr]

🔖

[faint rivet]

https://www.youtube.com/watch?v=ytbHgmHH3Uc

[faint rivet]

https://www.youtube.com/watch?v=Mq8vgAByxh8

[hazy kelp]

Can I put tiktok videdos here?

[coarse flax]

https://www.youtube.com/watch?v=--ZAw0Bmxyk

[keen thorn]

I reckon that with a dream booth tuned towards LEGO would be phenomenal

[faint rivet]

Yeah, but it does pretty good already!
https://www.youtube.com/watch?v=NH9pXN4dJnI

[faint rivet]

https://www.youtube.com/watch?v=L0lTZAY6INE

[dawn oak]

Mad vid and a killer track, kudos.

[hardy shale]

https://www.youtube.com/watch?v=pmj7gQ5FdAM

[gilded vigil]

https://www.youtube.com/watch?v=Qtk1ytCuI1o
Space Cats go for a Cup of Coffee, music video, music by me (MERKURIAL), animations with Stable Diffusion and Deforum

[carmine bloom]

wow ! how do you make it so constant, for once I don't ee any glitches !

[hardy shale]

created with outpainted keyframes (probably a lot less of them than you'd expect) and some light compositing

its stable because no img2img is used

[faint rivet]

https://www.youtube.com/watch?v=vr1AZY29BKo

[fading turtle]

oops sent wrong link... had fun with this one yesterday
https://www.tiktok.com/t/ZTRVJGBUU/
https://streamable.com/qq3e3t

[mossy ridge]

Thats awesome

[haughty isle]

https://www.reddit.com/r/StableDiffusion/comments/zh8lk8/advanced_audio_sync_with_deforum_and_sdparseq/

[bright moss]

https://www.reddit.com/r/StableDiffusion/comments/zh9w0d/making_a_3d_render_in_blender_from_a_stable/ I made this animation earlier today with a cool blender tool I found.

also it has

[radiant hedge]

what is sdparseq?

[dense crater]

https://www.youtube.com/watch?v=lMp9z9RB_VM

[haughty isle]

It's a tool for defining how parameters should evolve when generating many frames, with a bunch of features including beat sync: https://github.com/rewbs/sd-parseq

[icy dagger]

https://youtu.be/oNEFD-1_PeI

[faint harness]

https://youtu.be/VI9b1J0i1GQ

[mossy ridge]

Anime,bike riding,sunny

[mossy ridge]

Let me know which you like best https://youtu.be/tkh1C0mdFdY

[full trail]

Godd Morning , my new video animation is out on my TikTok Page, please drop a like : https://www.tiktok.com/@vblank_digital/video/7175820024966417670?is_copy_url=1&is_from_webapp=v1

[fallen girder]

"Toxic Waste" | Thrash Metal Animation (Stable Diffusion v1.5 / Deforum v0.6) [4K] - Workflow in the video description
https://youtu.be/AMxK7-JGuRM

[gentle nova]

Any Starwars fan? Tried doing Boba vs Mace. Img2img test. Let me know what yall think. Sd 1.5 inpainting model https://www.tiktok.com/t/ZTRV6Qpbd/

[ionic zenith]

My favorite scene (heavily compressed for discord 😅) from my latest video, I love how the changing background made the screaming shots so intense. Made with deforum.
Full video: https://youtu.be/eOg4X92OMaA
Song: https://fanlink.to/jeansmemory

[fallen girder]

https://www.reddit.com/r/StableDiffusion/comments/zjxz5m/chatgtp_testing_deforum_camera_rotation_examples/

[vestal sage]

How do you create such amazing animations ?

[hollow prawn]

can someone direct me to info on animating with deforum? I've got some lovely stuff happening but it's all out of my control lol.

It constantly zooms in. I tried changing the zoom setting but it destroys it completely.

All the sin and cos stuff is real confusing. Any links or info would be greatly appreciated!

[waxen lion]

https://rentry.org/AnimAnon-Deforum
I do have this in the works with some examples. Just working on editing it tonight. Should be enough to get a better understanding of what's going on.

I'm hoping I'll have Parseq implementation all figured out before it get's merged. I'll have a section on it when I get there. This is one of my tests with it so far.

[fallen girder]

if you are using 3d mode the translation_z contol the zoom

[fallen girder]

translation_x = 0:(1.5) - camera TRUCK +right, -left
translation_y = 0:(1.5) - camera PEDESTAL +up, -down
translation_z = 0:(1.5) - camera DOLLY +forward, -backward
rotation_3d_x = 0:(1.5) - camera TILT +up, -down
rotation_3d_y = 0:(1.5) - camera PAN +right, -left
rotation_3d_z = 0:(1.5) - camera ROLL +anti clockwise, -clockwise

[sharp depot]

VCV + SD
https://vimeo.com/780082941

[livid wasp]

Normal people take selfie with AI app, meanwhile me... 😈

https://youtube.com/shorts/o98gImaT-1k

[hollow prawn]

thanks dude!!

[hollow prawn]

thanks dude!!

[icy dagger]

https://youtu.be/uF4jw5cP-qM

[eternal geyser]

Face beautiful

[stiff wren]

https://twitter.com/ranetas/status/1602975538104225792

Una Raneta (@ranetas)

Les dejo esta pequeña pieza inspirada en #MalDeOjo de @anaju_

#stablediffusion #AIart #ai #abstract #fashion #aiartcommunity #aiartweekly
#str4ngething #Anaju #new_media_art #Artedigital #digitalart #art #iA #animation
#alcañiz #Tezoslab #aragóncultura #aragonmusical #alcañiz

▶ Play video

Twitter · Dec 14, 2022, 10:35 AM

[hallow bramble]

https://twitter.com/iastitraia/status/1603059622960631810

iastitraia (@iastitraia)

"Dystopian Cycle of Life"

#aiart #musicvideo #stablediffusion

▶ Play video

Twitter · Dec 14, 2022, 4:09 PM

[thin ermine]

my first attempt on deforum, why the images keep getting worse? Should I low Strenght schedule?

[fading turtle]

your seed is fixed. set it to iter or random to not get that smear effect

[thin ermine]

Oh I get it, thanks

[faint harness]

https://youtu.be/wNU90k5kNgc

[molten crown]

https://www.instagram.com/reel/CmJ4OXaqZmc/?utm_source=ig_web_copy_link

[fallen girder]

The Forgoten - Somebody Save Me [Official Video] [4K] Deforum Animation (UnstablePhotoRealv.5)
https://youtu.be/ZtcNwgR2Vto

[past stone]

https://youtu.be/CkumOeC-XQU

[thin ermine]

I tried a little animation of a pikachu transforming into a squirtle, charizard and bulbasaur. I like the result, but not the colors. I would like the colors to change drastically but Pikachu's yellow remains, any advice?

[small dragon]

I put this in support but better here?..........Deforum batch?! how? Automatic1111, deforum n_batch isn't animation batch. Use override settings/custom settings from text file? I copy pasted 2 text files together but no joy. Need to leave it running with 10+ deforum animations one after the other. Any ideas? thanks.

[carmine cypress]

Did you use negative prompts to get rid of the yellow color at certain points?

[faint rivet]

https://www.youtube.com/watch?v=siOu4LwX9Bo

[mossy swift]

Running deforum locally on SD automatic1111 how would you upload your own videos to make the animated? I would like to eventually sync them with music.

[thin ermine]

no, should I use negative prompts?

[hollow prawn]

can anyone help me understand why this is happening? The first frame is amazing, but then from the second frame onwards, it just becomes solid shapes. Its meant to be 30+ frames of a giant alien machine floating through space.

[sleek quartz]

can you post your settings?

[hollow prawn]

yeah sure @sleek quartz . thanks!

{
"W": 1088,
"H": 832,
"restore_faces": true,
"tiling": false,
"enable_hr": false,
"firstphase_width": 0,
"firstphase_height": 0,
"seed": 3668543734,
"sampler": "Euler a",
"seed_enable_extras": false,
"subseed": -1,
"subseed_strength": 0,
"seed_resize_from_w": 0,
"seed_resize_from_h": 0,
"steps": 21,
"ddim_eta": 0.0,
"n_batch": 1,
"make_grid": false,
"grid_rows": 1,
"save_settings": true,
"save_samples": true,
"display_samples": false,
"save_sample_per_step": false,
"show_sample_per_step": false,
"override_these_with_webui": false,
"batch_name": "Deforum",
"filename_format": "{timestring}{index}{prompt}.png",
"seed_behavior": "iter",
"use_init": false,
"from_img2img_instead_of_link": false,
"strength_0_no_init": true,
"strength": 0.0,
"init_image": null,
"use_mask": false,
"use_alpha_as_mask": false,
"invert_mask": false,
"overlay_mask": true,
"mask_file": "https://www.filterforge.com/wiki/images/archive/b/b7/20080927223728!Polygonal_gradient_thumb.jpg",
"mask_contrast_adjust": 1.0,
"mask_brightness_adjust": 1.0,
"mask_overlay_blur": 5.0,
"fill": 1,
"full_res_mask": true,
"full_res_mask_padding": 4,
"precision": "autocast",
"scale": 7,
"C": 4,
"f": 8,
"prompt": "",
"timestring": "20221216083222",
"init_latent": null,
"init_sample": null,
"init_c": null,
"outdir": "C:\stable-diffusion-webui-master\stable-diffusion-webui-master\outputs/img2img-images\Deforum",
"prompts": {
"0": "highly detailed art of a massive hyperdimensional futuristic robot with tentacles flying through space",

"animation_mode": "2D",
"max_frames": 600,
"border": "replicate",
"angle": "0:(0)",
"zoom": "0:(1)",
"translation_x": "0:(0)",
"translation_y": "0:(0)",
"translation_z": "0:(10)",
"rotation_3d_x": "0:(0)",
"rotation_3d_y": "0:(0)",
"rotation_3d_z": "0:(0)",
"flip_2d_perspective": false,
"perspective_flip_theta": "0:(0)",
"perspective_flip_phi": "0:(t%15)",
"perspective_flip_gamma": "0:(0)",
"perspective_flip_fv": "0:(53)",
"noise_schedule": "0: (0.08)",
"strength_schedule": "0: (0.6)",
"contrast_schedule": "0: (1.0)",
"cfg_scale_schedule": "0: (7)",
"fov_schedule": "0: (40)",
"near_schedule": "0: (200)",
"far_schedule": "0: (10000)",
"seed_schedule": "0: (t%4294967293)",
"histogram_matching": true,
"color_coherence": "Match Frame 0 LAB",
"diffusion_cadence": 1,
"use_depth_warping": true,
"midas_weight": 0.3,
"near_plane": 200.0,
"far_plane": 10000.0,
"fov": 40.0,
"padding_mode": "border",
"sampling_mode": "bicubic",
"save_depth_maps": false,
"video_init_path": "/content/video_in.mp4",
"extract_nth_frame": 1,
"overwrite_extracted_frames": false,
"use_mask_video": false,
"video_mask_path": "/content/video_in.mp4",
"interpolate_key_frames": false,
"interpolate_x_frames": 4,
"resume_from_timestring": false,
"resume_timestring": "20220829210106"

}

[carmine cypress]

I think the main problem with this sequence is that the model focueses on the latest generated image itself rather than the prompt you wrote, so I would try to play with the cfg_scale_schedule (make it higher so it will give you more weight to your prompt) and strength_schedule (make it lower to give more freedom to the model, so the weight of the previously generated image will be lower). Hope it makes sense!

I also got bad results when I used V1.5-inpainting model and the inpainting mask weight was set lower than 1.

@thin ermine yea I would try to play with negative prompts too, it may help you to get better results! So for example I would add a negative prompt to your second prompt and let see if it solves your problem.

[frank nymph]

https://youtu.be/cqPHx1QgSWM

I made this using stable diffusion

[barren dome]

Deforum using 1.5 https://www.youtube.com/watch?v=0r6PSGpnH20

[faint rivet]

https://streamable.com/sv2fzp

[mellow kettle]

cyberpunk 3d 30fps

[astral bane]

https://www.youtube.com/watch?v=VU-tUFvxKgQ

[cobalt hinge]

https://youtu.be/MPIx44ukZD8

[mellow kettle]

Stop War! Social video, made only dreamlike diffusion+v1-5-pruned-emaonly.vae, without upscaling, 896 x 512, 3d, 24fps

[full jungle]

How did you import multiple frames to dreamlike? Or are those dreamlike stills that you modified after? Thanks!

[mellow kettle]

I just entered promt)

[full jungle]

what's the prompt for batch import?

[mellow kettle]

depends on what you need
without batch import and dreabooth

[sand compass]

hi guys! i want to ask you wich one is the best colab notebook to make animation with stable diffusion?

[mossy swift]

Hello, how do you upload your own videos when using Deforum locally through automatic1111? There is not an upload video like in the colab method.

[wispy kestrel]

I need help with animations

My deforum always gives me gifs and it zooms into my pictures. Is there anyone who can share their settings with an output product to understand?

[hollow prawn]

My animations still become really low-res after a period of time. Ive tried mucking with the strengthscedule and the cfgscaleschedule.

It seems to only happen when I change the width and height to 1920 x 1080

Does anyone know how to maintain the high quality images all through the animation?

[hollow prawn]

in the zoom entry box, 0:(higher than 1) zooms in, and 0:(lower than 1) zooms out.

[hollow prawn]

love that dude,

[wispy kestrel]

Got the same problem

[hollow prawn]

Yeah, does anyone know how to maintain high res detailed images from start to finish of the animation? would really help a lot.

even if i write "photorealistic" in every 20-frame-long prompt, it comes really cartoony and shapey

[hollow prawn]

where is the v1.5 inpainting mask weight option dude?

[mellow kettle]

When you open deforum, you have a sample promt, change the words in it, collect the ones you need. It has both a positive promt and a negative promt. And what about the effect of the hint on the entire promt, then add the one you need to each section of the promt

[hollow prawn]

Yeah, I've been doing that... it still becomes really low quality after a while

[hardy shale]

https://www.youtube.com/watch?v=U71tKlp5uJ8

[acoustic ice]

https://youtu.be/BxE9UbVCPZY original music video, stable diffusion

[icy dagger]

https://youtu.be/N-bTGYVmt7M

[mossy swift]

Hello, how do you upload your own videos when using Deforum locally through automatic1111? There is not an upload video like in the colab method.

[faint rivet]

I don't know about The Line project... Looks plastic.
https://streamable.com/400vdl

[hollow prawn]

how do I make a new intro for my video, and have it connect to the rest smoothly?

Is it possible to put animation between two frames, connecting them?
Or have the final frame of an animation connect to the beginning of an older one?

[stiff wren]

https://www.youtube.com/shorts/Chrt5Xlxi7Y

[sharp depot]

https://www.youtube.com/watch?v=ql0hJfZcUkA

[hollow prawn]

uh, so yeah, anyone know if its possible to make an animation with the final frames connecting to a seed image?

[uneven copper]

Unreal Engine Metahumans + Depth2Img experiment

[thin ermine]

is there a way to use depth aware imgtoimg mask on deforum?

[tribal glade]

Looking someone who helps https://github.com/albertotrunk/depth2video

[vital yacht]

"Grim Forest" - Deforum SD Animation
https://www.instagram.com/reel/CmQDGnHp_Ee/?utm_source=ig_web_copy_link

[mild rune]

hey bro! this is so cool, very relevant to my interests - I'm doing stuff with vcvrack but im taking the output into touchdesigner and then importing video into deforum, using it to output CSV is such a cool idea, are you logging every sample? are you converting it to deforum script manually from there or do you have a script doing that?

here's a very simple (all my other stuff is over upload limit) example of the vcvrack - touchdesigner - deforum stuff

I flicked through a bunch of your stuff @sharp depot you're doing great work keep it up

[fallen girder]

"The Uprising" | Deforum Animation (Complex Lineart v1 / Deforum v0.6) [4K] - Workflow in the video description
https://youtu.be/_6BGXWJDZ_U

[rugged prism]

You didn't change a thing

Is that on purpose?

Would have been better if you changed their faces in the input vs output

[astral bane]

https://www.youtube.com/watch?v=VU-tUFvxKgQ

[mild rune]

https://youtu.be/N6NbSq-JIXQ

[smoky robin]

That was so cool to watch. Would love to learn more about your process behind this

[mild rune]

thankyou! it's a few different music-synced geometric animations and then processed with img2img and then edited together and upscaled

[mossy ridge]

https://www.youtube.com/watch?v=2A9QRm6rUuI&ab_channel=Kitchen

[waxen hare]

Hello everyone, I am looking for long term partner to work on upwork.
payment : 300~400$ monthly.
If Anyone interested in my offer, please dm me.
Thanks

[hollow prawn]

I see that interpolation is "turned off at the moment", will that be coming back soon?

or is it something I need to do on my end to get it working?

[mossy ridge]

https://www.youtube.com/watch?v=YQv419bhySU&ab_channel=Kitchen

[mossy ridge]

do one but with furries and dm it to me

lol

[faint rivet]

coming right up! lol

[faint rivet]

Or, are you asking me because you know my work with The Furry Underground?
https://www.youtube.com/watch?v=4UuwvNdQJ18

I actually did a sequel too. LOL
https://www.youtube.com/watch?v=uHNdzJRHBEU

[mossy ridge]

No I do not but this is cool

[faint rivet]

One of the first few frames...

[mossy ridge]

I am a deer make sure the guy on the left is one lmao also nice work

[faint rivet]

I don't think it's a guy anymore.

[mossy ridge]

lmao

[faint rivet]

It's about 100 frames in, and I think I'll let it go a bit.

[mossy ridge]

well I sent u a DM so when its done message me... have fun

[faint rivet]

a little GIF for now... resuming...

click on it and it looks a lot better

[mossy ridge]

Nice!

[mossy ridge]

Well Whenever its done DM Me Thank You!

[novel meteor]

https://youtu.be/RSc2U074pkA

Anyone know a good way to upscale a video like this?

[wooden river]

Which model do you use ?

[next depot]

Using a crude mixamo animation as basis with same seed but wild results per frame.... well, lots to learn.

[mossy ridge]

dreamlike diffusion i think?

i think is the name

maybe dreamdiffusion

its the popular one on huggingface with dream in the name

lol

[wooden river]

Thank you

I know it.. very cool i never try pixel Art

[mossy ridge]

it takes a bit of fine tuning, this model does really well though

some of it is like "new" pixel art

going to go for a retro style next, had mixed results attempting that

also midjourney does excellent pixel art

Might also train a model on that, might be a waste of time though

couldnt find any pixel art models

[trail lily]

I'd call this production ready hahaha

More info on this here: #🏞｜general-with-images message

[sharp depot]

https://civitai.com/?query=pixel

[sharp depot]

logging every sample?
"24ps" using Nysthi LOGAN20. 60bpm on clock x 24 to LOGAN trig-to-log. Then 24fps on Deforum video out, and the audio will be in sync. Obviously you can use any ratio and bpm if you do the math.

[sharp depot]

Thanks!!

[gentle nova]

https://www.tiktok.com/t/ZTRqFm9Dy/

[mossy ridge]

thank you

[hollow prawn]

Hi everyone, can anyone please tell me if it's possible to connect the ending of an animation up to the beginning of another animation? like, by using the first frame of the second animation as a final seed or something?

Surely its possible to make a new intro to a video, and have it seamlessly connect up to the rest?

[quick wren]

Maybe you guys will appreciate this.. I used Deforum to generate a music video for my latest song.. The song & video took about 2 months of effort, I learned a lot about SD 1.4, how to use it for animations and a bit of video editing along the way.. Almost 6.5 mins long..

Interestingly I ran fed the video i generated through and rendered it again, using the same prompts and it produced a better result the 2nd time.. smoothed out a lot of the strobing.

https://www.youtube.com/watch?v=Z3gkjGpwUvw

[hollow prawn]

one other question.. I am unable to use the 3D animation mode, as I believe there is something I need to download for it to work, can you please point me in the right direction?

[thin ermine]

you need a specific file to download, I don't remember the name mmh

AdaBins_nyu.pt

[novel meteor]

what did you use to upscale to 4K?

[next depot]

Nice... pretty wild stuff there. Will check out deforum. Thanks for the infos!

[quick wren]

I put all the info in the video description.. I actually accidentally upscaled it to 8k, I that's what I uploaded to Youtube..

[novel meteor]

Using deforum diffusion but the max res i can use atm is 640x320. are you using topaz video AI?

[mossy ridge]

topaz gigapixel

it costs money, there are free options for upscaling

[novel meteor]

what was the max number of images you were able to process at once? i have it but keeps crashing around 220

[mossy ridge]

what kind of GPU do you have

[novel meteor]

that'll do it. m1 max mac

[mossy ridge]

I can process 7500 images in one go

thats just last test

idk what max is

24gb vram though, idk if its related

probably is

let me look into it

[novel meteor]

i have 64gb of ram. so pissed they got rid of external GPU's for the new macbooks

[mossy ridge]

I dont see anything about maximum amount of photos

it might not be documented that well

or just hidden from google idk

these are system requirements for mac

any of this look relevant?

we should probably move to #🤝｜tech-support

here we go

meat and potatoes

[novel meteor]

Thank you so much!

[mossy ridge]

no prob 👍

[icy dagger]

https://youtu.be/2yJOGlVFJKg

[mossy ridge]

60 fps?

[faint rivet]

https://youtu.be/Lmmzg5E1CGM

[candid furnace]

https://www.youtube.com/watch?v=ONpPNE9wDL0&t=2s

[hallow bramble]

https://twitter.com/iastitraia/status/1605325379195273216?t=5W0psjYBI1_Nh-77rwT0tw&s=19

iastitraia (@iastitraia)

AI - generated🖤🎅🎵📽️

"Silent Night"

#aiart #iastitraia #silentnight #stablediffusionart

▶ Play video

Twitter · Dec 20, 2022, 10:12 PM

[inner crest]

24

[ember relic]

How in the living hell did you achieve this? It's like straight out of the dmt world mate

[iron flower]

What if you take a story written by gpt3, put it through a high quality text to speech service, create a deforum stable diffusion animation for it, and do it in an efficient way? You may get something like this:

https://youtu.be/Qc8MiRnBNL8

[mossy ridge]

Lol thank you! I used touchdesigner for most of the audio analysis, and an xbox controller for added zoom/rotation/xyz transforms/rotations (on parts without much sound)

or to emphasize certain points

https://www.patreon.com/user?u=80175670
guy here makes really high quality tools for making deforum animations

works on stablewarp too

[faint rivet]

https://www.youtube.com/watch?v=ko44GiCo2PY

[fading turtle]

https://imgur.com/a/I3u748n

[bitter plover]

Has anyone managed to train a character then post an image of someone doing something, having the character replace the person doing the action?

[ember relic]

Hm, I'm playing around with deforum in automatic1111, but just by removing the starting prompts last line ""100": "a beautiful durian, trending on Artstation"" makes so I can't hit generate

{
"0": "(scenic countryside:1.0), (cherry:where(cos(6.28*t/10)>0, 1.8*cos(6.28*t/10), 0.001)), (strawberry:where(cos(6.28*t/10)<0, -1.8*cos(6.28*t/10), 0.001)), snow, detailed painting by greg rutkowski --neg (cherry:where(cos(6.28*t/10)<0, -1.8*cos(6.28*t/10), 0.001)), (strawberry:where(cos(6.28*t/10)>0, 1.8*cos(6.28*t/10), 0.001))",
"60": "a beautiful (((banana))), trending on Artstation",
"80": "a beautiful coconut --neg photo, realistic",
"100": "a beautiful durian, trending on Artstation"
}

{
"0": "(scenic countryside:1.0), (cherry:where(cos(6.28*t/10)>0, 1.8*cos(6.28*t/10), 0.001)), (strawberry:where(cos(6.28*t/10)<0, -1.8*cos(6.28*t/10), 0.001)), snow, detailed painting by greg rutkowski --neg (cherry:where(cos(6.28*t/10)<0, -1.8*cos(6.28*t/10), 0.001)), (strawberry:where(cos(6.28*t/10)>0, 1.8*cos(6.28*t/10), 0.001))",
"60": "a beautiful (((banana))), trending on Artstation",
"80": "a beautiful coconut --neg photo, realistic", }

Starting prompt above. "my" prompt below

[serene veldt]

https://youtu.be/aXg_Rd22d4w

[serene veldt]

amazing

[fallen girder]

I've made a quick and easy tutorial for Deforum animation in the colab notebook, some asked me for it, so here it is
https://youtu.be/kHgRQt3eTPw

[mossy swift]

I think the issue is the comma after the last line--->realistic",

[ember relic]

@mossy swift Yea I figured that out after like 10 minutes, lol

[prisma fox]

https://youtu.be/TU3OLogr1ew
My latest AI animated video features a series of text prompts utilizing excerpts from Poe's classic poem. Had a ton of fun with this one. If anyone's curious on the process, feel free to inquire! Happy to share my methods for those interested.

[wispy kestrel]

Anyone willing to share their info?

Trying to make something like this

[icy dagger]

https://www.youtube.com/watch?v=zzLxSBTrFvU&ab_channel=MrPlasm0

[oblique ivy]

Sure. Here how I made this animation:
I used stable diffusion discord bot to generate a single image, and I made at least 20 variations of it. Then I put all the frames on ''Runway.ml'' interpolation and generated the animation.

[somber island]

https://i.imgur.com/0yVd7l4.mp4

[bleak ocean]

Stunning. Would you mind sharing your settings here?🙏🏻

[wispy kestrel]

Oh I see...

I am looking for someone who uses
Automatic 1111 Deforum based on stable diffusion. It creates gifs and animations by itself.

[inner crest]

Not exactly the same video. But the camera movements are the same

[fading turtle]

[soft bone]

Music video, using openAI Jukebox and Stable Warpfusion. Merry XMAS!
https://www.youtube.com/watch?v=0pS8LNwUK2Y

[analog gazelle]

Here is a little video I made yesterday with the help of the NounsDAO and their StableDiffusion/Deforum playground https://twitter.com/never_render/status/1606333456287309824?s=20&t=9p2-ImEME3ljiezA93twgw

Jose Andres 🔮 CDMX 🦇🔊 (@never_render)

Here is my @nounsdao AI-Pod submission. A touring dj spreads nounish vibes around the world...and beyond ⌐◨-◨ #aivideo #stablediffusion

▶ Play video

Twitter · Dec 23, 2022, 4:58 PM

I'm downloading the generated images so I can finetune the animation a bit when I have the time 🙂

[mossy ridge]

is this using batch depth2img

looks good btw, havent seen results like that

[fading turtle]

Thanks!! and no, this was made using 1.5 img2img.

with the help of some custom tools that allow me to control the motion, made that in seven minutes from start to finish.

[mossy ridge]

very cool!

[mossy ridge]

Hiii !

[next depot]

Doodling with img2img and Ebsynth...

[hollow prawn]

Can someone please briefly explain to me what I need to change in the 0:(1.02+0.02sin(23.14*t/20)) zoom entry, to align it to a specific tempo?

At the moment, this function is a bit slow, I need to speed it up a fraction to match the tempo of a song. But not sure what to change, to just nudge the frequency up a bit

[hollow prawn]

holy shit that's awesome dude. i'd love to hear a brief rundown of your process

[solemn crown]

Hey I'm new here how y'all be generating animations

[woven ivy]

Thank you!
Running the dreamlike model with the latest nightly build of stable warpfusion notebook. Getting some nice results. idk if I am allowed to post links to Patron here but its easy to find. 🙂

I ran it on a init video shot of a tire floating in a lake being hit by waves.

I do not have the exact prompt but it was something like "magic donuts floating space nebula cosmos mixed media rendered in octane"

and some pretty standard neg prompting "lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ugly"

[hollow prawn]

Wow, thanks dude! crazy stuff. well done

[woven ivy]

Hello 🙂 what are your hardware restrictions? (VRAM) Are you looking to run local or on a colab?

[charred cape]

Hey great work! I noticed in your setup you use nvidia, does this mean the AI uses your machine in the background to render the frames? If so does this mean it only works on windows and not mac?

[vital haven]

Hey guys! This last month I've been working on a music video for a band from Madrid. If you are so nice to give it a like, would be awesome.
The video is 100% Stable Diffusion + Adobe premiere. Thank you!

https://youtu.be/wjQnZ8O_U6w

[sharp depot]

https://www.youtube.com/watch?v=8VUX79-15ws

[prime schooner]

https://youtube.com/shorts/1h4g7TnhBTA?feature=share

[weak loom]

Made this little animation for my website with Stable Diffusion, kind of proud of it.
https://imgur.com/a/eT38GGt

Based on the spiderverse style

Also made this other one https://imgur.com/leZMklu

Total worktime was about 6 hours, I was still figuring out the workflow. Confident I can get down to 2 hours tops for each scene.

You can see more at https://sites.google.com/view/cesar-ai/home ^^

[fallen girder]

the colab notebook uses the nvidia gpu remotely from google, you dont need any harware to run it

[fallen girder]

awesome, i love it

[vital haven]

Thank you 🥹

[faint rivet]

https://streamable.com/uncige

[quick citrus]

2d cartoon waching outside window in space

[fading turtle]

https://streamable.com/td7ffc

I love the texture of the cookies at the end

[faint rivet]

It's funny how the brain can accept it better as Legos at a lower frame rate.
Original was 30fps upped to 60fps with RIFE and upscaled to 1080p.
Here's original size (896x512), but dropped to 6fps!
https://streamable.com/pgfy1s

[serene veldt]

https://youtu.be/W1LWvs02siE

[narrow crescent]

How did you get such cohesive results, any pointers?

[weak loom]

Lots of effort through an app called Ebsynth

[oblique pecan]

After 2 months and 100Gb of generated frames, I made a 5m music video, using Deforum Stable Diffusion.
Expect loud Techno and flashing visuals…Editing and VFX were done using DaVinci Resolve and keyframed using FrameSync https://www.youtube.com/watch?v=ldFnVamk6eM

[forest plaza]

this is a brilliant way to explain an SD concept https://www.youtube.com/watch?v=NhPiYpCNBDY

[faint harness]

https://youtu.be/QLDVFJH6urk

[faint rivet]

https://youtu.be/rjWgafx5GWg

[mossy ridge]

this one looks good

your own notebook?

looks like it came out of stablewarp almost

[faint rivet]

yep. I'm about to do a pull request, and hopefully it will become a part of deforum

[mossy ridge]

thats sick

good luck!

[faint rivet]

It adds these options

#@markdown ####**Video Hybrid for 2D/3D Animation Mode:**
hybrid_video_generate_inputframes = False #@param {type:"boolean"}
hybrid_video_use_first_frame_as_init_image = True #@param {type:"boolean"}
hybrid_video_motion = "Optical Flow" #@param ['None','Optical Flow','Perspective','Affine'}
hybrid_video_flow_method = "Farneback" #@param ['Farneback','DenseRLOF','SF']
hybrid_video_composite = True #@param {type:"boolean"}
hybrid_video_comp_mask_type = "Blend" #@param ['None', 'Depth', 'Video Depth', 'Blend', 'Difference']
hybrid_video_comp_mask_inverse = True #@param {type:"boolean"}
hybrid_video_comp_mask_equalize = "Both" #@param  ['None','Before','After','Both']
hybrid_video_comp_mask_auto_contrast = True #@param {type:"boolean"}
hybrid_video_comp_save_extra_frames = False #@param {type:"boolean"}

hybrid_video_comp_alpha_schedule = "0:(0.15)" #@param {type:"string"}
hybrid_video_comp_mask_blend_alpha_schedule = "0:(0.15)" #@param {type:"string"}
hybrid_video_comp_mask_contrast_schedule = "0:(1)" #@param {type:"string"}
hybrid_video_comp_mask_auto_contrast_cutoff_high_schedule =  "0:(0)" #@param {type:"string"}
hybrid_video_comp_mask_auto_contrast_cutoff_low_schedule =  "0:(50)" #@param {type:"string"}

so, it's not Video Input mode, it's video hybridized with 2D/3D mode

optical flow visualization straight from deforum

[weak loom]

A helicopter has fallen into the city at lego city! Build the truck, arm the firefighters aaaaaaand to the rescue!

https://tenor.com/view/hey-lego-city-lego-hi-gif-16196642

[fading turtle]

https://imgur.com/6AhlTFE

[fallen girder]

"Fractals" | Deforum Animation (knollingcase + deepSpaceDiffusion_v1 + Microscopic_v1) [4K] Workflow in the video description
https://youtu.be/r5Fnue0hygw

[tranquil robin]

you got a link to their Discord? It is expired to me

For Warpfusion

[analog gazelle]

so my silly little animation is a finalist in a contest If you would like to support, please like, retweet, or even just view the video here: https://twitter.com/noun355/status/1607744379178946561?s=20&t=fH5896FvNqThFN5oIr9Fig

Roko (@noun355)

@nounsdao @never_render

▶ Play video

Twitter · Dec 27, 2022, 2:25 PM

[tough pawn]

#1057377549593890820 message

[astral bane]

SD animation playlist https://www.youtube.com/watch?v=LN5psPO5Bbg&list=PL8G7-J1OZZnS205o_9XbNhmp6JPSi58-n

[thick agate]

https://www.youtube.com/watch?v=7MKrtmZHzE0&ab_channel=ChrisJohnston

[celest flax]

depth2img/img2img

[harsh musk]

https://www.youtube.com/watch?v=9GWQrHjpMXY

[astral bane]

https://www.youtube.com/watch?v=JNRejp53JBU

[hallow bramble]

https://twitter.com/iastitraia/status/1608067750890455040

iastitraia (@iastitraia)

🌌🤖🎵📽️

#aiia #iastitraia #stablediffusionart

▶ Play video

Twitter · Dec 28, 2022, 11:50 AM

[gentle nova]

I've got some animations I've been working on over the past month or two. I'll post them here for anyone that's interested. Please let me know if i'm posting too much.

https://www.youtube.com/watch?v=0THGcFLlGsE

https://www.youtube.com/watch?v=f5SOQFNiVio

https://www.youtube.com/shorts/VKti5RdFhG8

https://www.youtube.com/shorts/HlCq8rlwkoY

on this one I added the TikTok loading graphic to simulate the TikTok Ai filter..but it's just SD 2.1 lol https://www.youtube.com/shorts/IyTE2Iwpdsg

same with this one. https://www.youtube.com/shorts/S4FK8B2ol94

[faint rivet]

https://youtu.be/1s-9N5h462k

[faint rivet]

https://www.youtube.com/watch?v=Tv6wfQmY7Es

[gentle nova]

https://www.tiktok.com/t/ZTRbJwxpR/

[cerulean stratus]

Here's an animated story made using ChatGPT, Stable Diffusion and UE5 https://www.youtube.com/watch?v=xYunzVjnywM

[gentle nova]

https://www.tiktok.com/@ixitimmyixi/video/7182385088125046059?is_from_webapp=1&sender_device=pc&web_id=7161488807110624810

[faint harness]

https://youtu.be/E2LNuWlzsAU

[iron flower]

If you did not find out yet, it‘s probably the extra comma at the end that’s messing things up.

[supple nimbus]

https://giphy.com/gifs/space-stars-universe-3og0IV7MOCfnm85iRa

https://giphy.com/gifs/BillAndTed3-bill-and-ted-face-the-music-3-2020-KEBct1Uvksr24Pxucd

https://giphy.com/gifs/007-jNijxegn1eYNziIhUJ

[faint rivet]

Here's pure depth from AUTO1111 img2img using the depth model, where "Denoising strength" is set to 1.
https://youtu.be/2I1_L7Ixjcs

[fading turtle]

https://imgur.com/a/jtUigF6

inspired by my drive back to the city after the holiday.

[fallen frigate]

"DIGITUS MATERNIS -variant 1"
The controversial machine birth protocol of the year 4516
(created with Deforum in Automatic 1111)

"DIGITUS MATERNIS -variant 1"
The controversial machine birth protocol of the year 4516
(created with Deforum in Automatic 1111)

[fossil scarab]

been playing with combining my own animations with SD batch img to img trying to work out the right balance between chaos and consistency any suggestions?

[mossy ridge]

what player can i use to play the deforum video files?
?

[waxen basin]

Img2img animations I worked on this year.

[agile eagle]

How's Germany? You're kung-fu is 🙏🏽💪🏾💪🏾💪🏾

[waxen basin]

It’s cool so far. Still getting adjusted to be honest.

[agile eagle]

Keep making those informative videos 💪🏾

[acoustic ice]

I'm looking for an app or colab notebook that takes a music file and produces a keyframe list based on the music waveform. This would be for creating music videos that change e.g. motion or prompt based on the music. I'm pretty sure I've seen something like this but can't remember where... any pointers would be greatly appreciated

[neon elbow]

https://www.youtube.com/watch?v=4MbK321Z4mc
just released this AI Christmas music video 😄

[mossy swift]

https://www.instagram.com/p/CmzVk-MM9Ck/

[hazy kelp]

wow, music is really good haha

[hazy kelp]

nice work, I love your videos

[ember relic]

Sir, may I have some knowledge to create such masterpiece as yours?

[tribal glade]

Rotating! depth2img2video
Now it's a matter of to smooth the video, any suggestion?

[mild rune]

just saw this, ty bro, following you on youtube 👍🏼

[frank nymph]

https://youtu.be/qdA7t3iJvfI

Does this count as animation

[dry pier]

my last video
https://www.instagram.com/reel/CmrXDPlOHDJ/?utm_source=ig_web_copy_link

if you want to check my portfolio of Stable Diffusion animations
bonjirum.carbonmade.com

[fallen girder]

"Winter" | Deforum Animation (Analog Diffusion) Workflow in the video description
https://youtu.be/C3pJtrrahWM

[fallen frigate]

The Reaper Hails

[gentle nova]

https://www.tiktok.com/@maydaysosyoung/video/7183088507479543083?is_from_webapp=1&sender_device=pc&web_id=7167976009038415406

[clever falcon]

guys

i can't use deforum on 9:16 aspect ratio

(768x432)