🎥｜animation

[fallen girder]

"Raven" | Deforum Hybrid Animation (SDXL 1.0) [4K]
https://youtu.be/soOQ_SIlg6M

[near badger]

https://github.com/s9roll7/animatediff-cli-prompt-travel

[solemn flame]

I cannot use Deforum, it crashes with my poor GF 2060 RTX (6 Gb VRAM). This is what I managed to create:

https://youtu.be/bzrp5ZMYohs

IMHO poor quality, but it is my first time

[void girder]

https://www.youtube.com/watch?v=qX6s6jq1Xn4

[queen monolith]

#🎥｜animation create top 10 AI tools

[jagged vapor]

https://youtu.be/gcxPRuvicPY

[quaint wasp]

https://www.youtube.com/shorts/Oi7nl2lpM9s this is the closest thing I've seen to stable animation

[rough vessel]

that looks like runway

[serene jay]

I think this looks like pika labs, runway is a bit more chaotic and you can't guide/prompt the img2video

[orchid palm]

i just started using runway but i can't get any generations where the faces don't look seriously deformed. should i be looking into pika labs instead?

like how is this usable?

[orchid palm]

re-running every frame through img2img

[somber lintel]

Hey everyone, I've just introduced some new features to my Deforum Helper tool – an editor and visualization tool designed for Stable Defusion Deforum animations. It's a solution for effortlessly controlling animations within Deforum. These additions include handy frame markers, audio channels, supplementary settings channels, enhanced user interface options, and much more. Give it a try and kindly share your feedback on how I can further enhance your experience. Let's enjoy the process and come together to create some amazing AI art!

https://deforum-helper.vercel.app/

[vast mural]

https://youtu.be/6-7HjadHxYo?si=86uMxRlMDYdD8URD

[sharp depot]

Some fun with wav2lip
https://youtu.be/YcxbOrEs3gI?si=mNRPyeT-aqh-4pfk

lyrics:
Blaaaap Blap Blap Blap Blap BlaBlap,
Blapblapblapblapblapblap blap Blablap
Blap Blapblap Blap Blablap.

[fallen girder]

Deforum Hybrid Animation (SDXL 1.0)
https://youtu.be/EdogMQCk9fc

[simple jasper]

Hey guys, anyone had this issue with Deforum ? :

Error: OpenCV(4.8.0) D:\a\opencv-python\opencv-python\opencv\modules\core\src\arithm.cpp:650: error: (-209:Sizes of input arguments do not match) The operation is neither 'array op array' (where arrays have the same size and the same number of channels), nor 'array op scalar', nor 'scalar op array' in function 'cv::arithm_op'
. Please, check your schedules/ init values.

[void girder]

https://www.youtube.com/watch?v=iIBKXopJpzc

[toxic rune]

been messing with this idea for a while, tuning the logic that keeps it from hallucinating too much. Made in ComfyUI with my own setup, logic and mostly standard nodes without any animation specific or schedule type nodes for prompting. - threw one of my images in there to see how quick it would get eaten at one point 🙂

[dense crater]

https://www.youtube.com/watch?v=XQxmSDYNWr0

[simple jasper]

Hey guys, i tried to install TemporalKit with HuggingFace, but it corrupted my whole Stable Diffusion.. Do you know where i can find a clean version that work of the tqdm.py file ? From \venv\Lib\site-packages\huggingface_hub\utils ?

[fallen girder]

"Rewind" | Deforum Hybrid Animation (SDXL 1.0)
https://youtu.be/zKqn-_DUmoU

[grand wraith]

is this purely done with stable diffusion? Is there a guide that I can follow to try something like this? This looks so much fun to make!

[dense crater]

The background is made in the Automatic1111 Stable Diffusion Deforum extension and then the rest is made in Adobe Premiere Pro/After Effects.

Here's my process:

1. Finding fitting stable diffusion prompts for the music video.
   I ask ChatGPT to give me fitting prompts based on the lyrics I feed it. I test the outputs and make changes based on the results from img2img generations with Stable Diffusion. I also try out different models and Loras to find outputs I like.

2. Getting music reactive keyframes for the animation.
   I give the song to this audio keyframe tool: https://www.chigozie.co.uk/audio-keyframe-generator/ and give it suitable functions for the values I want. I personally use 25 frames per second, something like “0.60 - x^6” for strength schedule and “1 + x*10” for Translation Z in 3D mode. I often play around with these settings and also give the 3D rotations different functions to react to.

3. Setting up a render in Deforum.
   Now I enter the keyframes and prompts into Deforum to start generating an animation. I usually do this 4 times with slightly tweaked settings and prompts to get different results to work with later.

4. Editing in Premiere Pro.
   To get a more dynamic video, I cut between the different animations in a multicam sequence, picking the best parts and cutting to the music.

5. Finishing up in After Effects.
   In After Effects I manually add the lyrics, timing and dividing them as I see fit. I also add a bunch of effects like additional 3D camera movements, shakes, overlays, particles, blur and chromatic aberration. Most of these are made to react to the music through generated audio keyframes.

[grand wraith]

Geez. Just reading this make my body pump up. I am now dying to try it out this weekend. Thank you so much for those detail!

[void girder]

https://www.youtube.com/watch?v=Ojl7dFhfwlg

[terse mortar]

Been tinkering with how to use Stable Diffusion as an AI Pass on Metahuman & UE5 animations to force a custom Lora onto character.s This was a test scene that got some decent lipsync and eye movement to happen with the AI. Still got some flicker to sort out - so if anyone's got any tips would love to hear it! Want to try the TemporalNet workflow next. https://www.youtube.com/watch?v=GhQD1ZptQ2Q

[serene jay]

great work! yes, the temporal consistency/flickering is like the BIG BOSS to fight in 3D/video workflows, interpolation might help a bit there

[terse mortar]

Thanks for the tip, will start searchin for interpolation shtuff next.

[knotty dust]

https://youtu.be/_Tz2lH1EzFY

[void girder]

https://www.youtube.com/watch?v=-OkjBB1WJTY

[distant wagon]

too long, and boring

do it like this
https://www.youtube.com/watch?v=CQLb9yjjHFg

[bold jewel]

@distant wagon cool, this is a txt2video ?

[distant wagon]

probably, not mine

[vast mural]

https://youtu.be/ATNCoM989pk?si=9LuQJCdv6oxR-eAO

[reef igloo]

Hi. Is it possible to see the original video?

[serene jay]

I believe this is entirely made on UE5 with metahumans and then it's an AI pass on the frames, all inside UE, please correct me if I'm wrong @terse mortar

[reef igloo]

I read the description of the video. It's done in Metahuman. The only thing I can't figure out is which neural network they want to use "temporalnet" in. In the SD img2img or Metahuman? If they can use "temporalnet", you can try ip2p (0.7) to eliminate flickering, in addition to "temporalnet".

[terse mortar]

Heya! Thats correct. We animated everything in metahuman and then ran the frames through img2img w/ stable diffusion using various controlnets. We're hoping to test the temporalnet controlnet model in the next video project. I was not aware of ip2p - but it looks really promising. Thanks for the tip.

[terse mortar]

I don't have the original frames exported as a video but here's a comparison shot. Top is metahumans - bottom is with the AI-Pass.

[terse mortar]

We exported the frames from UE5 and then did our AI PASS with a batch img2img in SD in Automatic 111 using controlnets Linart, Normal, and Softedge. I wasn't aware there was an SD addon for UE5 until just now. So thanks for the tip.

[mental pecan]

So im stuck in the Desert with 80k people after it rained all night, nobody can go anywhere and we are all hunkered down. I thought I would post my video that was projected on a 70 foot pyramid in the desert during Burning Man. I'm also one of the 30 drone pilots offically allowed to fly at the event. https://www.instagram.com/reel/CwsKcZluXVu/

dreamingcomputers

🔥✨ Burning Man 2023: A Dance of Real and Imagined ✨🔥

As the Black Rock Desert comes alive with the myths and legends of our collective consciousness, I’m humbled to share a once-in-a-lifetime experience. My AI-driven animation, a mesmerizing blend of real and fantasy-style animals, dances across the 70-foot PlayAlchemist grand pyramid, thanks t...

Likes

110

Instagram

[serene jay]

wow! great video and projection mapping! can you share a bit on your workflow and setup for that? BTW, sorry to hear that you guys are stuck on the desert, hope everything goes well and everyone has a safe return back home! best wishes for all the burners! 🔥

[flat moat]

Tried making a fully AI generated video using SD + Runway Gen-2: https://vimeo.com/860514129/3005d721bb?share=copy

[serene jay]

nice! is it sdxl?

[flat moat]

Thanks! No, I ended up using 1.5 with the model Arteyou because I liked how the style was coming out.

[serene jay]

If anyone is using controlnet with deforum, please don't update your automatic1111 to the latest version (1.6), it will break controlnet.

[terse mortar]

This is one of the best trailer edits I've seen of runway clips. Great work!

[terse mortar]

So cool! Hope yall are able to leave the desert soon

[flat moat]

Thanks, that means a lot! Super fun to make, the tools are getting amazing.

[reef igloo]

I suppose it might help.I did it in Deforum/Hybrid Video/CN.I did a little work with color correction, because the color was changing.But I have problems with it:) You could also try removing the flickering in Davinci Resolve.

[terse mortar]

Nice! I'll def check out a Deforum/HybridVideo/Cn workflow next. Thanks for taking a stab at it.

[gleaming terrace]

are you willing to share workflow or give tips on how you did it? the dancefloor is super smooth

[terse mortar]

Woah this looks awesome!

[serene jay]

It's a very plain animDiff workflow, nothing fancy or complicated... I tend to go high on the sample count, never less than 30, usually around 50ish. This is my exact workflow, let's you choose model, vae and upscaler. Personally I find that for this type of visuals the v14 model works best, because it has more motion. choosing the right checkpoint is a must, I tend to go for the manga/niji types because of color and texture.

[solar hearth]

Sound Killer - Brother Culture, Ed Solo. Made with Deforum, ControlNet & Hybrid Video. (4K)
https://www.youtube.com/shorts/l9k8Oj_XWWI

[void girder]

https://www.youtube.com/watch?v=1BjVcQxlK0g

[serene jay]

are these yours? hahaha very nice, I also liked the glowdog one, really funny stuff

[void girder]

yeah i made them, thank you, means a lot! 🙂

[fallen girder]

"The Spider Web" | Deforum Hybrid Animation (SDXL 1.0)
https://youtu.be/M4juIvLDr5A

[serene jay]

nice!!!

I was also playing around with Tachikoma/spiders a while back but with gen2

[fallen girder]

Gracias Wyz!!

[serene jay]

de nada, todos tus últimos posts son 🔥 🔥 🔥

[fallen girder]

that looks amazing

[serene jay]

thanks!

[terse mortar]

This is beautiful. I like the movement you got from it. Great work.

[serene jay]

thank you

[noble bison]

https://youtu.be/aiezZzj9Cn0?si=C9IAueTeV2xPZJGH

[stray tree]

The green eyes woman - SDXL - This time interpolation x2
https://www.youtube.com/watch?v=PkLSguDNGiw

[void girder]

https://www.youtube.com/watch?v=6eEdefc02Rk

[jovial sparrow]

How does one get started with animations and does it take a lot of editing? (I mean, of course it does. I'm just an amateur that is picking this as hobby).

[dense crater]

https://www.youtube.com/watch?v=IWFLzaNakts

[serene jay]

depends on what you use, what you want to do

you can run non-stop animations with deforum with no edits top to bottom

or you can do animateDiff which are 4-5 second clips and need lots of edits or interpolation

there are lots of tools available, you just have to figure out what works best for you

Pika Labs, Fulljourney, Zeroscope, Deforum, animateDiff, runway etc

[jagged vapor]

https://youtu.be/XeRJP0TNwnY

New song and accompanying video made using SDXL Deforum

[short canopy]

hey anyone here?

I need help

[noble bison]

https://youtu.be/7eoHDFJvGrU?si=TRdIVwajXuQqC-IL

[serene jay]

what do you need my friend?

[void girder]

https://www.youtube.com/watch?v=0N6Sz2JXtls

[sharp depot]

https://youtu.be/kkm2qX1wwmo?si=VOsuCgC3CvmXDtpK

https://youtu.be/jXR56dIJUnQ?si=oxC_k9l_aeLyZAtm

[bold jewel]

https://www.youtube.com/shorts/PjiHYRRSJ0k

[stray tree]

Enter the surrealism - Hybrid video:
Complete in 4k: https://www.youtube.com/watch?v=4Zvm0PAOM6U

[void girder]

https://www.youtube.com/watch?v=RGM506e8Sqg

[void girder]

https://www.youtube.com/watch?v=pW3F35-aaP4

[noble bison]

https://youtu.be/uWrkwZfbLpU?si=lbqe6pIOjiSPnvmk

[vague dagger]

https://www.youtube.com/watch?v=VsbPT4cfsaI

[mossy ridge]

Mixing Deforum made backgrounds with live looping https://m.youtube.com/watch?v=E68dmvXFqJQ&t=887s

[fallen girder]

"The Alchemist" | Deforum Hybrid Animation (SDXL 1.0) [4K]
https://youtu.be/7EzR42izrVI

[molten slate]

is there any way i can generate more frames into the clip and make things more smoother and less fast [made with animatediff on automatic1111]?
need tips or suggestions...

[serene jay]

reduce your framerate

then you can interpolate later if needed

[molten slate]

https://tsaishien-chen.github.io/MCDiff/
anyone knows about something like this?

[agile dirge]

#super #sailormoon: https://youtube.com/shorts/tLkBW-Vr1YM?feature=share

#sailormoon #mars gone viral on YouTube: https://youtube.com/shorts/wEQnaKZcd8w?feature=share

[vast nebula]

https://youtu.be/I3SKFCMdVmA?si=lZK5NQr-8m3InvjH

https://youtu.be/Jpyq68aJ724?si=4eiKT0r_TRYnaMfO

https://youtu.be/SOJwPrPGqCA?si=1I0OUWyfgDWnTbQw

[tight zenith]

Nothing as terrific as what you guys are doing, but...
https://youtu.be/fMtLo5VW2Dg

Cheating gets you far. Stable gens fed through Runway.

[noble bison]

https://youtu.be/1m_P_muPu20?si=b3vTXryXqFMHzt2_

[faint rivet]

A new feature I came up with today... it uses cv2.morphologyEx and optical flow.

[simple jasper]

Anyone having issues using Deforum with ControlNet ? NoneType object isn't iterable ?

[void girder]

https://www.youtube.com/watch?v=46NAQnHvBt0

[mossy ridge]

https://youtu.be/0rs_BL4BZG4?si=pa7Pm3cHApOPQVwO

Feedback required mates 😗

[noble quail]

Wondering if someone could help me with ebsynth

[void girder]

https://www.youtube.com/watch?v=Rizxr8A5vMs

[simple jasper]

Man don't forget to show your result with the grid method of TokyoJab technic 👀

[noble quail]

will do

[noble quail]

getting ip set up rn

[simple jasper]

Thanks mate !

[simple jasper]

Stoked to know your feedback and impressions about it too

[noble quail]

lol did you make it

thanks for letting me know about it

very excited

i have no idea how it works haha

i understand now what it can do but i dnt understand how

[simple jasper]

Yeah i don't either fully understand how it worked, but it seems to have great results, especially for face consistency between generations, don't really spent a lot of time testing it, but the few results i had where great

[noble quail]

I think you might have to make the ip image into a grid too...

for the tokoyojab

or else it applys it to the whole grid?

[simple jasper]

I really don't know honestly, gonna test i guess to see how it react

but that's fine if it applies to the whole grid right ? So the faces are consistent all over the different images on the grid no ?

[noble quail]

it looked like it applied the overall image

to the whole grid

rather than each image

[simple jasper]

did you do with SDXL IP ?

[noble quail]

yeah

[simple jasper]

Oh yeah it might be not the best usecase then for that purpose

But still interesting to have it on the side of others purposes tho aha

Might work better with Deforum, i'll try that out today

[noble quail]

I am using the cany and depth channels as the driver grid

and then using ip channel as the image style influencer

[simple jasper]

Not even tile, openpose or temporalnet ?

[noble quail]

the tokyojab method doesn't

as far as i know

i could be wrong

would those help?

[simple jasper]

yeah, i didnt saw it so i can't tell, just based on what i did on the past

Idk might try different options and see which output video work the best according to your desire

But definitly start with tokyojab technic

Maybe then try doing the same method with other controlnet, who knows if your output video would look more consistent and better

[noble quail]

its working i think

[simple jasper]

with the style image from ip adapter ?

[noble quail]

will have to see

when i do ebsynth

yeah that part works

[simple jasper]

I'm just worried, it might be not consistent with the different grids, but lets try annd see 🙂

[noble quail]

very well

it works really well

[simple jasper]

stoked to see the result

[noble quail]

wont know if it works though until ebsytnh

it might not work

well see

[simple jasper]

yeah basically you just generate the keyframes for EBsynth on SD now right ?

[noble quail]

so tokoyojab method is like: extract 4-10+ frames from a video of a person, turn those frames into a grid, use that grid as controlnet inputs

right?

then output the new frame image and use ebysthn with the base frames of the og video

[simple jasper]

yea seems the same technic i saw from the tutorial i mentionned

Like the frames you generate on SD will indicate the style of the character as keyframes on ebsynth and you give aswell all the frames of your input video so it can interpolate between those keyframes of the video exported from midjourney based on the data from all the frames of your video

[noble quail]

and so with IP you can easiliy invoke a style for example?

[simple jasper]

according to what i understood

The grid is basicly to get the consistency between frames

[simple jasper]

I guess so, but honestly i didnt tried it yet so i don't know what's going to be the results

[noble quail]

But the grid also gives the entire video ultimately right?

and then you use the og frames in ebsynth to act as the driver video

[simple jasper]

You're using the temporalkit extension to create the grid with tokyojab technic ?

Or create the grid using another way ?

[noble quail]

I am using tiled VAE

[simple jasper]

that's the name of the extension ?

[noble quail]

it helps with the performance

https://www.reddit.com/r/StableDiffusion/comments/11zeb17/tips_for_temporal_stability_while_changing_the/

at the bottom

[noble quail]

what does temporalkit do ?

[simple jasper]

That's tokyo jab tuto ? Or can you send me the one your following aswell ? i'm interesting to test that approach and compare!

[simple jasper]

Basicly it does the same as what you're doing, honestly, that's why when you told me about your technic i thought you were using that tool ahaha

[noble quail]

https://www.youtube.com/watch?v=cEnKLyodsWA&t=425s&ab_channel=DigitalMagic

[simple jasper]

Ahaha digitalMagic 😄

Yeah this guy is really dope

followed a lot of his tutorials

[noble quail]

yesss

[noble bison]

https://youtu.be/TZ5RkwxmveY?si=iWZvhoZFsZ1Hy1A_

[lilac gull]

Where is the best place to ask deforum questions?

[whole pelican]

there's a deforum discord

[surreal basin]

Error occurred when executing AnimateDiffLoaderV1:

index 10 is out of range

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
uis = []
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
nodes.before_node_execution()
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\nodes.py", line 390, in inject_motion_modules
injectors[self.version](unet, motion_module, injection_params)
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\nodes.py", line 193, in inject_motion_module_to_unet
unet.input_blocks[unet_idx].append(
File "D:\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\container.py", line 295, in getitem
return self._modules[self._get_abs_string_index(idx)]
File "D:\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\container.py", line 285, in _get_abs_string_index
raise IndexError('index {} is out of range'.format(idx))

Can someone explain how to fix this error?

[simple jasper]

Do you have any link ?

[simple jasper]

Any results to show from your tokyoJab experimentation ? 👀

[noble quail]

yeah its not bad

[simple jasper]

Doope!

[soft bone]

Hey where the diffuse-together channel is gone?
Anyways, since Peter Gabriel didn't like my entry, I'm trying my luck elswhere now
https://www.youtube.com/watch?v=YsYA67hQlF8

[noble bison]

https://youtu.be/25cMNISiw2c?si=qFw-C4u2dYjofYri

[serene jay]

animateDiff + comfyUI

[serene jay]

still there> https://discord.com/channels/1002292111942635562/1097876660101066854 just a bit quiet for now

[toxic glen]

Awesome stuff man

[toxic glen]

When I was a sound engineer back in college, my boss used exclusively Peter Gabriel songs to feel out a new space and help the levels

Anybody see this?
https://youtu.be/SfxXEOgTs5U?si=Kb_GCfA3Tang2cd9

Dropped it on r/deathcore around the exact same time I dropped my first animation there

Led to one of the cooler interactions I've had in a long while

(Their bass player)

[fallen girder]

"Pendulum" | Deforum Hybrid Animation (SDXL 1.0)
https://youtu.be/G6UDJF5ceQI

[toxic glen]

So sick, as usual. Can't wait till I can use XL.

[fallen girder]

Thanks mate 🤘

[round jay]

Example is upscaled twice and made to 60FPS with Flowframes.
Colab: https://colab.research.google.com/drive/1QVxBjAamxOIAAlSohQklZltRPx8WsxEN

If you install and use it, you can do the same thing locally.
AnimateDiff prompt travel: https://github.com/s9roll7/animatediff-cli-prompt-travel
Flowframes: https://nmkd.itch.io/flowframes

Prompt

0:closed eyes, portrait, maid headdress, edwardian maid outfit
10:portrait, maid headdress, edwardian maid outfit, look at viewer
20:upper body, maid headdress, edwardian maid outfit
30:cowboy shot, dancing, maid headdress, edwardian maid outfit
40:from below, cowboy shot, dancing, maid headdress, maid outfit
50:from below, dancing, full body, maid headdress, miniskirt maid outfit
60:dancing, fireworks, full body, maid headdress, miniskirt maid outfit, frilled, magic effects, magic circle, light particle
70:from above, dancing, fireworks, full body, idol, shine, frilled, cute, hairband, ribbon, tiara, hair ornament, magic effects, magic circle, light particle
80:from above, dancing, fireworks, full body, idol, magical girl, shine, angel, angel wings, frilled, cute, hairband, ribbon, tiara, dress, gloves, hair ornament, magic effects, magic circle, light particle
90:stylish pose, explosion, fireworks, full body, idol,magical girl,shine,angel,angel wings,frilled,cute,hairband,ribbon,tiara, dress,gloves,hair ornament, magic effects, magic circle, light particle
100:stylish pose, explosion, fireworks, cowboy shot, idol,magical girl,shine,angel,angel wings,frilled,cute,hairband,ribbon,tiara, dress,gloves,hair ornament
110:upper body, maid headdress, edwardian maid outfit, look at viewer
N:(worst quality, low quality:1.4)```

[flat moat]

The Shadow Witches

[noble bison]

https://youtu.be/ISG5aVALwzA?si=lTfMI8ORHV5JGAXQ

[simple jasper]

Really fun video, congrats on that !!

[simple jasper]

Did you used controlNets to get the consistency in the face ?

[split merlin]

https://youtu.be/j0a5aknVylU

[sacred bloom]

Stable Diffusion at Latin Grammy Awards! 🥳 🎉

I'm overjoyed that the music video that I did the animation with SD and Dreambooth was nominated for this year's Latin Grammy!

It's crazy to see how things have changed from just a few months ago. There are a lot of things that I think would be much easier today 😅
I hope you like it! And please let me know what you think! Thanks!

https://www.youtube.com/watch?v=9m17gZzM7hk

[simple jasper]

What is Stable Diffusion there ?

[sacred bloom]

The scenes where the girl is an anime were made with SD. Most parts are around 3'20''.

[simple jasper]

Oh yeeeaa, that's sick dude!

[tough hollow]

AI spaghetti anyone?

https://youtu.be/26hnnme42Vs

That is the latest in the new series of clips I am releasing from the upcoming short 'A Day In The Life' - more here:

https://www.youtube.com/playlist?list=PLyoVOQ0bp-yhPsQkeIHNEL3kA6RE4hVsE

[serene jay]

love the series mang!

[tough hollow]

Nice one @serene jay - I'm just finalising sound on part 5 and 6 so watch this space.

[void girder]

https://www.youtube.com/watch?v=nlsYvLtu7-Y

[opal dawn]

https://youtu.be/TTDWpwCsRGE?si=ICnoy76GmkAca2l-

[toxic glen]

Probably pretty close to "The Perfect sentence:
Gothic Girl | 30 minutes of AI Animation

[toxic glen]

This is a question that will never need to be asked, of me personally anyways

[tough hollow]

I assume its always 3 thumbs up.

[toxic glen]

Minimum.

[faint rivet]

Features I'm working on... A little morphological transformation and a little temporal flow
https://www.youtube.com/watch?v=bEMb-1OcODQ

[noble bison]

https://youtu.be/zoKRLAq06pw?si=dshqqgW0fQj2bysk

[white gate]

uwu hi i posted this in anime but i figured it might fit better here

https://i.imgur.com/aRowtmR.mp4

am only just figureing out animation

[white gate]

thats awesome looking

[tough hollow]

https://youtu.be/9HSDAHRZllk

[simple jasper]

Genius ahahahaha

[simple jasper]

A lot of cleaning on Ae to get that consistency right ?

[opal dawn]

https://youtu.be/tWUry9kD5Gw

[void girder]

https://www.youtube.com/watch?v=_t1GCQNUePU

[knotty dust]

https://youtu.be/x-q5X8Sjeo0?si=nFArc8RT7-fsmjyo

[white gate]

do yall use deforum in auto111. im looking for tips

didnt mean to at just u just wondering in general

i liek taht though i like the morphy stuff

[round jay]

#🎥｜animation message

[white gate]

io thank u interesting

deforum extension has a similar prompt keyframe method

i havent tried animatediff yet

[faint rivet]

https://www.youtube.com/watch?v=4N4-EwsOf7o

[bold jewel]

3 deflicker

[toxic glen]

https://civitai.com/articles/554/dwh-1-creating-your-first-animation-with-deforum-in-1-click

I know it's an absolute hail mary, but are any of y'all privy to any deflicker too that is f2p?

[noble bison]

https://youtu.be/X_t4Lt3i_BI?si=uQ98ZFwaHU_uZNM1

[serene jay]

Siren Servers and Latent Ink Medusas. #animateDiff over #comfyUI

[static niche]

Are u making this in a comfy workflow? That's crazy

There a good place to find workflows for animdiff?

[static niche]

figured it out, not a terrible first attempt

[reef igloo]

https://www.youtube.com/shorts/H7ebMmz7tZU

[void girder]

https://www.youtube.com/watch?v=ndNkoNIvNJg

[serene jay]

the workflow is very straightforward, it has not much complications, I see you already have it working! try the kosikandik nodes, there are a couple that expose more advanced options

[serene jay]

Mechas doing the latent breakdance. #animateDiff over #comfyUI

[white gate]

https://github.com/Scholar01/sd-webui-mov2mov.git

theres a new vid2vid plugin

idk if irt only takes .mov files or what

[serene jay]

I think it means movie 2 movie, nothing to do with the .mov container

[white gate]

ah that makes sense

[covert swan]

Can you guide me about TOKYO PINK BUNNY: Cyberpunk Anime AI Animation (Deforum / SDXL + Lora Model)
animation?

[bold jewel]

https://twitter.com/desenhista2023/status/1706010516311699685

Desenhista (@desenhista2023)

Tifa Lockhart (Final Fantasy) #animation #dance #game #ff

▶ Play video

Twitter · Sep 24, 2023, 6:19 PM

[faint rivet]

no idea what that is

[opal dawn]

https://youtu.be/0T5NY7OzKeQ

[serene jay]

The AnimateDiff crew just realeased motion LoRAs for camera control, if anyone is interested. https://huggingface.co/guoyww/animatediff/tree/main

[faint rivet]

Okay, this isn't "really" a deforum animation. At the same time, this is definitely a deforum animation.

[serene jay]

this one cracks me up 😂 😂 😂

I'm testing this one with video and it's very promising... https://www.youtube.com/watch?v=8XJH6uZjNzA

thanks! @proud kiln

#animateDiff over #comfyUI

[zenith tendon]

How do people upscale videos? Is there a comfy workflow?
Do you use Topaz labs and remove the watermark?

[open wadi]

I use WarpFusion to create the video frames, then batch process the frames in SD to upscale, then merge the frames back into a video using FlowFrames. Then I use Topaz to make the video more crisp at the same resoulution I upscaled to using SD.

[fallen girder]

Akira AMV | Deforum Hybrid Animation (SDXL + ControlNet)
https://youtu.be/rFhog9wji9c

[grand stump]

AnimateDiff+A1111

[zenith tendon]

Problem is Topaz isn't available on Linux... 😦

[serene jay]

try with an specialized upscaler and flowframes, you can get similar results as topaz. Even flow frames could be done all inside Auto with optical flow and cadence.

[zenith tendon]

Will try, thanks man!

[opal dawn]

https://youtu.be/GU5E70ixfQ8

[simple jasper]

That's crazy Sick !

[simple jasper]

Sheeeeesh Shaolin Soccer ❤️

[void girder]

https://www.youtube.com/watch?v=uB5FAlS1V4k

[bright rock]

https://www.upwork.com/services/product/video-audio-ai-animations-for-yourself-or-your-company-1705347738736787456?ref=project_share

[lost lagoon]

https://youtu.be/aj2RSvH5D9c

[tulip shadow]

https://www.youtube.com/shorts/XDMPgEetinY

[static niche]

anyone have a comfy workflow with animdiff that is decent at making short seamless loops?

[opal dawn]

https://youtu.be/7N0lOZIWjbc

[vital briar]

描述一位女孩来到一个城市从单纯变成了恶魔心态，被繁华的城市所逼

#1025467151206854736

#🎥｜animation

[surreal berry]

That’s awesome

[stable hawk]

Text to Image ComfyUI and AnimateDiff test

ComfyUI and AnimateDiff Image to Image test. Single Image used as base.

[opal dawn]

https://youtu.be/WmvSW4Jig_E

[marble heath]

animatediff (196 frames (16 fr/s) + upscaler x1.5) + motion interpolation to 60 fr/s

[noble bison]

https://youtu.be/0zpNmS75Mm4?si=khajy_UcamNduXq6

[stable hawk]

Use an image as an int in ComfyUI with AnimatedDiff, made a few gifs with it, wrote a python script to batch convert gifs to mp4 files, took the mp4s, concatenated them into a single video, ran through Film. AI generated.

[serene jay]

#animateDiff over #comfyUI

[opal dawn]

https://youtu.be/TxPBAJaXrNY

[void girder]

https://www.youtube.com/watch?v=MDDJHNeEb1w

[rich mirage]

irongirl doing a little dance because animatediff with lineart controlnet told her so

[faint rivet]

https://www.youtube.com/watch?v=eYY49dMp5yw

[toxic glen]

❤️

[toxic glen]

have you posted our stuff here?

[surreal berry]

I haven’t!

[toxic glen]

I wish it could loop, but also have sound. Somebody invent a new file format.

[dense laurel]

When I upload a video in AnimateDiff as a source, SD ignores it as if I haven't uploaded anything there, it renders random stuff. How to use video as a source to AD?

[vast nebula]

Pubg Mobile #bgmi #bgmishorts #bgmihighlights #bgmilive #bgmivideos
https://youtube.com/shorts/W-3A_pB41M4?feature=share

Pubg Mobile #bgmi #bgmishorts #bgmihighlights #bgmilive #bgmivideos
https://youtube.com/shorts/W-3A_pB41M4?feature=share

Bgmi Gameplay|Pubg Global Gameplay| Santorini TDM
https://youtube.com/shorts/2vxYGL976ps?feature=share

Call of Duty Modern Warfare | Remastered| 60 FPS| PC Full Gameplay No Commentary
https://youtu.be/QBifHEZtnoM

All Cutscenes of Dragon Ball Z Kakarot Gameplay 2020 Series
https://youtu.be/SOJwPrPGqCA

Dragon Ball Z Kakarot PS5 4K 60FPS HDR Gameplay PS5 Version
https://youtu.be/I3SKFCMdVmA

Goku Vs Majin Buu Dragon Ball Z Kakarot 4K 60Fps HDR Gameplay
https://youtu.be/Jpyq68aJ724

[spare goblet]

Is there a way to do any sort of previewing for an animatediff generation prior to generating the full set of frames?

[void girder]

https://www.youtube.com/watch?v=DcnuZFt2Hfg

[faint rivet]

“𝙶𝚛𝚊𝚢𝚜𝚌𝚊𝚕𝚎 𝙲𝚢𝚋𝚘𝚛𝚐 𝙳𝚊𝚗𝚌𝚎” 𝔬𝔯, 𝔣𝔲𝔫 𝔴𝔦𝔱𝔥 𝔱𝔥𝔢 𝔞𝔩𝔠𝔥𝔢𝔪𝔶 𝔬𝔣 𝔬𝔭𝔱𝔦𝔠𝔞𝔩 𝔣𝔩𝔬𝔴 𝔞𝔫𝔡 𝔪𝔬𝔯𝔭𝔥𝔬𝔩𝔬𝔤𝔦𝔠𝔞𝔩 𝔱𝔯𝔞𝔫𝔰𝔣𝔬𝔯𝔪𝔞𝔱𝔦𝔬𝔫𝔰.

[white gate]

i tried that in sdui but couldnt really figure out what it did lol

im gonna try animatediff . ive figured out deforum but not animatediff

i spent the last few days firuging out text-gen-ui and got it working reasonably well but now im certain stablediffusion is going to seem lighting fast in comparison

sd-ui is so much easier to use than text-gen-ui , even trying to autoupdate the textgen thing would break my server completely

[white gate]

getting some errors while tryong to use animatediff

do any of these look super wrong?

its like a massive error message , and then even after i disable the extension it still doesnt let me render, until i close and reopen the server

sometimes it ends with
RuntimeError: CUDA error: invalid configuration argument CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile withTORCH_USE_CUDA_DSAto enable device-side assertions.
does this need to be done or anything

[void girder]

https://www.youtube.com/watch?v=jU792GLMyEY

[stray tree]

Ink Master - Deforum Hybrid Video
Complete 4k: https://www.youtube.com/watch?v=1MHy_fCAqVM

[noble bison]

https://youtu.be/9LlSy4uVAJ0?si=GLMfnp2qaVdX56ZB

[opal dawn]

https://youtu.be/UIyGJ03QVlw

[vital yacht]

AI Animation Halloween theme (SDXL+Deforum)
https://youtu.be/T6dLYbBq6Us?si=gSIpXUYqTJFdMy7U

[stable hawk]

ComfyUI AnimateDiff interpolation test

[nimble dagger]

Where do I install and how do I Use the MotionLORAs with AnimateDiff in A1111?

[serene jay]

here they are, motion loras only work with the mm_sd_v15_v2.ckpt model https://huggingface.co/guoyww/animatediff/tree/main

[faint rivet]

https://www.youtube.com/watch?v=espmLDPg_hk

[nimble dagger]

Thanks! But where exactly should i install those? I know it says /models/MotionLORAs folder but is it inside /extensions/AnimateDiff/ folder? And how do i ”activate” those loras? The same way as normal loras?

[serene jay]

I use them on comfyUI, for Auto1111 I have no idea but I guess, it's like a normal lora.

[nimble dagger]

Thanks for reply. I found that those are not working yet in A1111

[faint rivet]

https://www.youtube.com/watch?v=cl9LI6zExv0

[topaz smelt]

hey does anyone knows what this means on deforum when using hybrid video?
Error: ''str' object has no attribute 'type''. Before reporting, please check your schedules/ init values.

[agile eagle]

Same issue, once I get a Cuda error using anything I can no longer use AnimateDiff. I have to close down webui and start of completely.

I've been able to get really good results

[opal dawn]

https://youtu.be/5aReSPEWKRs

[thin ginkgo]

A sunny day in rural area,

[halcyon jetty]

wow

[agile eagle]

🫠🫠😇🙏🏽🙏🏽🙏🏽

[agile eagle]

Classic 😅🤣

[white gate]

how did u solve?

[round jay]

0: Delicious Yummy

[agile eagle]

Keep closing and opening the program and avoid going over my memory usage. Size of output around 512x768

[dusk plover]

hello my friends i did that today (its in french but important is animation)https://www.youtube.com/shorts/iueEFcL1FOo

[noble bison]

https://youtu.be/h2IiICWdvkY?si=2DNO-e_rtt9Wy4L_

[white gate]

ill give it another try, what kind of hardware do u have? do u know if i need to disabled tiled vae/diffusion

i have at least one result on my folders that i got to work months ago so i know ive had it working at some point

[west fog]

Hi everyone!

We trained + open sourced a text-to-video model for SDXL! https://github.com/hotshotco/hotshot-xl It generates videos at 8fps

It was trained for the past couple months on tens of millions of videos with the intent of enabling the open source community to make high quality videos/animations.

It works alongside SDXL to take advantage of the great prompt understanding from all the images SDXL has been trained on.

We think this architecture is quite extensible for making full long-form videos in the future. Would love help from the community towards this goal!

Would be very keen to hear what you all think!

[split ferry]

😍

[opal dawn]

https://youtu.be/0UgR-G2zoz4?si=9h7yujg3HcBqmRiP

[opal dawn]

https://youtu.be/G25eszNVHpI?si=eTzhlvZ5UKeDpBD_

[noble bison]

https://youtu.be/uPmWNTmAAiQ?si=5I1MbCBrkQmQcbsd

[pure loom]

hello sharing my first ai music video using stable diffusion using anything-v3-fp32-pruned and my own trained lora https://www.instagram.com/reel/CxFhN_TxgAM/

becmo__

in there - music video [out now] link in bio 🫶🏽

so so happy to collaborate with @izitheartist on this. ⸜(｡˃ ᵕ ˂ )⸝♡ he spent months researching how to train personalized AI models, then made one of me to make this music video 🤯

so cool to see this come to life cus 'in there' was inspired by a convo we had about an anime show ᵔᵕᵔ

#aiart #aiart...

Likes

159

Instagram

[pure loom]

did u do it with animatediff 1.5?

[timber shuttle]

https://tenor.com/bzQu0.gif

[tardy plank]

I’ve fully automated shorts videos, it’s not perfect but it’s using animate diff with some custom changes https://vm.tiktok.com/ZGJcoQ4Px/

[void girder]

https://www.youtube.com/watch?v=psh1Kg9c-DQ

[round jay]

yes animatediff 1.5

[pure loom]

i love it

[noble bison]

https://youtu.be/BSnuXU1KAZU?si=1WZCceDVfGSqP7a3

[mossy ridge]

https://youtube.com/shorts/dwwBvDE37L8?si=OLc5Q5ebo1qEXbqy

A friendly hello to my other ai enthusiasts here. I am
currently making a short film with stable diffusion, I
nave already made a small teaser, in which you get
glimpse of what it's about and already get to see
some of the protagonists
Let me know what you think about it.

Voiced by the ai voice of Morgan Freeman

[trail galleon]

Heyaaa someone here dominating infinit zoom?

I'm having quite bad results and the discord group is quite dead

[fickle ember]

Dose anyone knows any extensions that will rotate on its axis?

[serene jay]

What's all this?

[trail galleon]

very nice! which extension you used?

or which was the proces?

[mossy ridge]

https://civitai.com/images/2826978?period=AllTime&periodMode=published&sort=Random&view=feed&collectionId=60906

would love some positive reactions, I got this into the cyberpunk contest

[ebon sparrow]

thank you!
controlnet + img 2 img
Below is the original video
https://vimeo.com/90479247

[noble bison]

https://youtube.com/shorts/RqgjML6ajTE?si=3RJSC2z9N1dduCim

[stable hawk]

Audio made with Various AI tools, Animation with ComfyUI and AnimateDiff. Test run.

[mossy ridge]

How people get such good results. Just lots trial and error?

[stable hawk]

ComfyUI and AnimateDiff Cat test 😅

[haughty turtle]

Is promt-travel in animatediff possible with a lora inside ADetailer? I use a lora that I trainied to get the same face every time

[magic rose]

robot

[noble bison]

https://youtu.be/CIx-QPwvQqA?si=BFyGrW2sS9ppicBE

[stable hawk]

ComfyUI and AnimateDiff test

[misty harness]

New music vid that I used 13 different AI techniques on just dropped, take a 👀:
https://www.youtube.com/watch?v=portA6QqVtI

[fallen girder]

"Tech Slave" | Deforum Hybrid Animation (SDXL 1.0)
https://youtu.be/5pdKZ3JSdlM

[static niche]

anyone have a good workflow for ComfyUI that supports animdiff for SDXL or are they still working on support models?

[stable hawk]

Last comfyUI animateDiff test before working on Halloween stuff. Figured out how to get really good cohesion at any length now I think.

[azure sky]

Nice work mate.

[stable hawk]

Thanks 😁!

[lucid tulip]

👏

[stable hawk]

@lucid tulip need a motion model for SDXL, currently all the motion models are for 1.5. Training motion models a little harder than regular models.

[stable hawk]

And now Skeleton test lol

[ornate sage]

this is so hypnotising, that I can't even focus on the faces

[mossy ridge]

https://youtube.com/shorts/QetNtrIji30?si=XY6_hpirM7bvkUF3

[final rivet]

https://youtube.com/shorts/3lB3CiG1Ge8?feature=share

[spring nova]

https://youtube.com/shorts/HCqBIV7jLf0?si=-MkeqRn-qjsCADJj

[gusty seal]

https://vm.tiktok.com/ZGJ3QcX12/

[mossy ridge]

https://youtube.com/shorts/QetNtrIji30?si=4dwr4gek9ATzW3Sg

[shrewd crown]

https://www.youtube.com/shorts/jzfH1iNfmCY

[agile eagle]

I just Rendered an even crazier version, thanks 😊 🙏🏽

[spring nova]

https://youtube.com/shorts/uZnRX55D5-k?feature=share

[agile eagle]

Ooh hey 👋🏾 😏 👀

[mossy ridge]

Done with stable diffusion deforum

https://youtube.com/shorts/QetNtrIji30?si=-vKliRLSjNbuz6Fl

[stable hawk]

This one came out pretty choice.

[raven stirrup]

you're turning gifs into mp4s right? @white jackal ?

i was talking to you on fb i think, i was the one having trouble with ffmpeg

[stable hawk]

I was, now I'm just making the mp4s directly.

[raven stirrup]

ah you can make them in comfy?

[stable hawk]

Ahh, Heya. Yeah, I'm Simon on Facebook and Geeky here lol.

[raven stirrup]

yeah matthew here lol

i mean fb

[stable hawk]

Yeah, there be an option to select mp4 instead of just gif I'm the combine node.

[raven stirrup]

oh sweet goodness

[stable hawk]

There's a guide you should check out. One second.

[raven stirrup]

can you hook a brother up with some json?

[stable hawk]

https://civitai.com/articles/2379/guide-comfyui-animatediff-guideworkflows-including-prompt-scheduling-an-inner-reflections-guide

[raven stirrup]

92% 4hrs 41min

lol

yes i read this

[stable hawk]

This will walk you through everything, even the ffmpeg

Ahh lol

[raven stirrup]

still doesn't work i think because i'm running on D drive and has to be on the C drive since the ffmpeg %PATH% is there

[stable hawk]

I'll see if I can post the json for the workflow I use lol. I do everything the wrong way, which sometimes is a good thing.

[raven stirrup]

yes wrong way is good way

1076s per iteration ouch

[stable hawk]

That's how I did most of the vids. I threw a whatever prompt in there, but the nodes are all what I use. Upscale is to downscale to 512x512 is the images are to large lol.

[stable hawk]

I use my freehand work to give the drawing/sketch look.

[stable hawk]

And GeekyGhostUltimate isn't actually available anywhere, but any 1.5 model should work.

[raven stirrup]

thanks a lot I will try it after my generation finishes, for some reason my animatediff combine says [DEPRECATED]

and doesn't give option for mp4

[stable hawk]

That may be the issue 😅. I was using that one originally and had to convert gifs. AnimatedDiff Evolved should fix that. If you load the json file, go to manager, install missing custom nodes, that part will be fixed at least.

[raven stirrup]

thanks heaps, will update you on the results

only took me 5 hours to make yay

[stable hawk]

It did come out good though, I dig the snow.

[raven stirrup]

now i will save this 5 hr workflow and see if yours is much faster lol

😄

[stable hawk]

Weather, water, wind and other ambient effects are harder than general motion of a character, sp props!

[raven stirrup]

1st time this has happened with comfyui

[stable hawk]

Reload your UI. Drop the json file back in

Stuff is stuck in your vram from last gens you did. I've had it happen when bouncing between workflows trying things out 😅

[raven stirrup]

i killed it and restarted

sweet it works!

[stable hawk]

The blend node has a few options, overlay, softlight, mmultiply, normal, and etc. The softlight or normal tend to work the best for this type of int for animateDiff.

[round jay]

AnimateDiff

4: look far away
5: close eyes, (look at viewer:1.3)
6: (close eyes:1.2), smile
7: smile
8: (smile:1.3)```

[raven stirrup]

where are you adding these steps?

@round jay the frame number it changes?

[stable hawk]

They are doing it the correct way lol.

[raven stirrup]

would be great to get that workflow too because then i could add scene changes

it should only take me 100 minutes with your workflow @stable hawk because it's 2% done after 2 mins much better than my other workflow which took 5 hrs

trying something different with actions and scene in prompt not just weather

[stable hawk]

Odd question, but do you launch the cpu or gpu bat?

[raven stirrup]

gpu bat

[stable hawk]

Figured I'd check lol

[raven stirrup]

it's a 1070ti so plenty of memory, just not the newest chipset

[stable hawk]

Ahh! That would do it. Yeah, I'm on a 3070. Those and the 4xxx series are geared towards AI

My 1650 works, but is slow lol.

[raven stirrup]

yeah i will buy once our ai company starts making revenue, i'm making animations for the bots with a emotion grid and sequencer in unreal but making the individual shots in SD so it will hopefully look something like Doom had

just experimenting with animatediff a bit

10% done already alright!

[noble bison]

https://youtu.be/7SoWKNOTnmE?si=kBtipnqjCLIqPv1E

[raven stirrup]

we're using a pixelated lora to turn individual shots into pixelated but workflow is slow atm

[raven stirrup]

won't finish until 4am my time unfortunately lol

and i can't game while i run SD

[stable hawk]

I haven't done any gaming since I got into AI and I've been a hard-core gamer for like 40 years 😅. Was part a lot of the major wars in PvP mmos and etc. Now, every time I go to game, I get a new idea for something to make lol.

[raven stirrup]

that's how it is, i am now building an fps as a hobby project

using procedural gen 😄

[stable hawk]

This me 13 years ago. Single take, tons of macros, no editing lol. https://youtu.be/dsoMy_vnC6U?si=3LXsHBSSwK6o1Rft

Now I just make the characters and sing/write the songs lol. No longer bounded by character creator tools lol.

Me in 3D lol

As in 3D model

[raven stirrup]

haha the halloween stuff is cool

we want to do a shoggoth ai party in estonia

[stable hawk]

Very cool, definitely a Lovecraft creature fan.

[raven stirrup]

thinking to add googley eyes to octopus costumes

[stable hawk]

Mushroom Octopus Hybrid Creatures lol

[raven stirrup]

nice

[raven stirrup]

you can tell you used a female as the background model lol

[raven stirrup]

ok didn't get an output with your workflow

AnimateDiff] - INFO - Restore GroupNorm.forward function.
[AnimateDiff] - INFO - Ejecting motion module with method default.
!!! Exception during processing !!!
Traceback (most recent call last):
File "D:\SDSetup\ComfyUI_windows_portable_nvidia_cu118_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\SDSetup\ComfyUI_windows_portable_nvidia_cu118_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "D:\SDSetup\ComfyUI_windows_portable_nvidia_cu118_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "D:\SDSetup\ComfyUI_windows_portable_nvidia_cu118_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-animatediff\animatediff\nodes.py", line 221, in generate_gif
raise ProcessLookupError("Could not find ffmpeg")
ProcessLookupError: Could not find ffmpeg

Prompt executed in 6395.51 seconds

stillffmpeg i need to buy a terabyte drive

i have 250 gig of SD models lol

i had to put all my unreal stuff on external lol

[raven stirrup]

down to 17 min

[stable hawk]

Lol, yeah, I actually bought a micro SD card for my models and workflows. Laptop has a micro SD port that I never used, so I was like... huh, why not lol.

[raven stirrup]

i can't get the coffee pouring to turn out right

i think @round jay has the solution to that

[stable hawk]

Still looking not bad at all. It's pretty smooth and fluid even with the cup issue.

[raven stirrup]

yea like the background and her movements

the next one i'm waiting on will be a prompt i made by editing his prompt and then describing her and the setting then doing her actions with those numbers

ok it turned into coffee kettle bukkake

i want it to do one action then the next then the next

maybe i use different prompts and cut them together to make a full gif with that ezgif?

like take the right pictures that work and lose the rest then add them all into the save image/ combine?

[fringe carbon]

can you ake music vid to me too?

[opal dawn]

https://youtu.be/ad58AKivbPs?si=pBu_M0g3YE7KsDgk

[sinful spire]

Guys, what is the best and easy way to do animations in A1111? I saw a lot of tutorials but what is the best?

[void girder]

https://www.youtube.com/watch?v=DcnuZFt2Hfg

[final rivet]

39 - AI Animation: Deforum
https://youtube.com/shorts/I8UuW4MhIPc?feature=share

[mossy ridge]

Hi! Making up music while watching / melding with my long play deforum backgrounds. Cheers!
https://m.youtube.com/watch?v=q1NPfR8GJag&t=1563s

[round dagger]

Enjoy a Deforum music video with custom frame synced motion parameters

https://www.youtube.com/watch?v=PgH8AZz9l9s

[final rivet]

👏 👏 👏 I love it. Any tips about how to make somethign like this?

[round dagger]

framesync.xyz

Utilize framesync. Or learn Parseq.

Spend months practicing, making test clips, failing, learning, release your work to others, get critique and feedback, grow, repeat. Pretty simple lol.

[final rivet]

Thanks!

[noble bison]

https://youtu.be/Ic6LPRt--vk?si=8YtOeEaUY5MmAYgD

[agile eagle]

My latest automatic1111 AnimateDiff render using prompttravel. No video int, or LoRAs.

[spare goblet]

how'd you get the extra length?

[round jay]

they are 2sec renders combined together into longer video XD

basic idea is generate 100 2s clips and pick the best ones to make a video

[spare goblet]

ah

[pure loom]

is this in sdxl?

[round jay]

1.5

[raven stirrup]

i started to notice that i'm getting text artifacts from somewhere now

its like ruining the images

[fallow surge]

So put things like "text, watermark, words, signatures, autographs" into your negative.

[raven stirrup]

thanks derp i should have thought of that 🙂

[mossy ridge]

Can anyone here recognize at least a few faces?

https://youtube.com/shorts/KGrlYgjN4NE?si=UqkhdmxOD0Q6u8yJ

[raven stirrup]

been trying to get her to aim down a rifle but it thinks scopes are rifles

oh look at my nice scope that is not the prompt

btw who is the guy in the background lol

[rapid hull]

The music video came out alright, took a lot of effort but I think next one is going to be way better.

https://youtu.be/MmB4ugj4m6Q?si=UmulYhSyOjTz9bEs

[vapid skiff]

FAQ: What is Stability AI?

Our vibrant communities consist of experts, leaders and partners across the globe. They are developing cutting-edge open AI models for Image, Language, Audio, Video, 3D and Biology.. AI by the people, for the people. Learn more here

[mossy ridge]

I made this with stable diffusion only.
With 5 different faces

https://youtube.com/shorts/DleTl9BS8U4?si=8F5cW3AjLuD4mJCy

[serene jay]

animateDiff + comfyUI https://www.youtube.com/watch?v=KzyBGAagYD0

[static niche]

Don't suppose you could share your workflow? Looking for a solid one to use for Halloween. I don't get much movement in my build

[stable hawk]

ComfyUI and AnimateDiff test

[mossy ridge]

I made a Face-switch and Swap Video with Animatediff

https://youtube.com/shorts/IYbakQUjou4?feature=share

[static niche]

care to share your workflow? 🙂

[stable hawk]

Second test, little better than the last. Same workflow, just updated the prompts. Hands not as weird this time lol.

[static niche]

here's mine if anyone wants it

[stable hawk]

Very cool

[stable hawk]

Pixar style test comfyUI and AnimateDiff using blended int

[static niche]

is there a way to add noise schedule to a lora? checkpoint load has one

when i put a lora in it becomes just random series of images vs a smooth animation

[stable hawk]

Probably 😅, if you check CivitAI they have a workflow section, there's bound to be a workflow for it.

[static niche]

been scouring everwhere for a few hours now, loras just make things so much better lol

[stable hawk]

Testing adding the zoom in and zoom out motion loras to my workflow. If it works ill share it

[stable hawk]

With the zoom out motion Lora

Still working on the workflow.

[stable hawk]

Looks like I have successfully chained multiple loras and motion loras to go with animateDiff. Let me clean up the work flow and I'll publish it.

[stable hawk]

Char turner lora, zoom out motion lora, animateDiff.

[static niche]

Those are fire

Curious to see how you got loras to work while retaining smooth frames like you have

[stable hawk]

Added a second checkpoint and chained loras and etc using a blended int lol

There is a slight problem though. The watermark really tries to come through when stacking loras.

[static niche]

ah, you're using the other version animdiff, i'm on the kosin version, will add it shortly and test it out

[stable hawk]

Breath of the wild lora, with zoomout motion lora, and animateDiff

[stable hawk]

Final Lora workflow lol https://civitai.com/models/162163

[stable hawk]

Had to in order to get loras to work lol, well non motion loras. Now I could probably make a 30 minute cartoon in like half and hour 😅🤣😂.

[stable hawk]

Walk cycle 😅

[stable hawk]

Last one for a bit, I'll he refining the prompt travel workflow tonight, here's a preview though.

[dense crater]

https://www.youtube.com/watch?v=IaWGAAmA0PY

[oak urchin]

/Deforum

Result:

[oak urchin]

Duuuuude !

Everytime i see you, you're working on something amazing

[spring nova]

https://www.tiktok.com/@shaid.fusion/video/7290418336913984800?is_from_webapp=1&sender_device=pc&web_id=7185933494428861958

[safe oriole]

omg how do you get zoom out motion lora working in automatic1111 😄

[safe oriole]

this is animations for a basic game sorted 😄

[stable hawk]

switch to comfyUI, it seems daunting at first, but its way faster than automatic1111, uses less vram, and can do most of what Automatic1111 can. I just use Automatic1111 for inpainting and music at this stage but I'm working on porting Riffusion to ComfyUI. So Inpainting will be mostly what I use Automatic1111 for and Training models lol.

[safe oriole]

can it make 8 min long animatediffs?

i made one of them earlier today in automatic

im sure it can, but just wondering before i hop over 😄

[stable hawk]

can make any length you want honestly, as long as your rig can handle it. Install is easy to, download the portable, run update, run the gpu bat, done.

[safe oriole]

cool, really wanting some of the camera movement loras with animiated diff, so less resource cost is ideal

[stable hawk]

I have my models, loras, and etc on an SD card and redirect to that instead of multiple copies of them everywhere lol

If you stack to many camera movement loras the shutterstock watermark becomes problematic, but you can do one at a time easy.

rotation stacked with zoom stacked with breath of the wild lora

[safe oriole]

oh why any shutterstock?

v2 of animateddiff has none?

is it the lora itself?

[stable hawk]

most of the movement loras were trained on shutterstock stuff, the v2 motion model is fine, but stacking the camera movemet loras which haven't been fine tuned as much makes it a slight issue.

[safe oriole]

true, thanks, hopefully they retrain without 😄

[stable hawk]

Just doing one camera with the motion model and a style lora is fine though.

[remote comet]

Has anyone managed to create an animation of themselves (using AnimateDiff) or simlar? I'm struggling with the concept of using an initial image of myself to feed in. Any help would be appreciated

[safe oriole]

do you mean image with background, or face swap? faceswap works perfect with roop and animatediff

[remote comet]

I would like to input an image of myself, and then run through animatediff to say make me jump using another video as the input, so it's not really a face swap, as want to keep most of the original features

Or could be a random animation - zoom out, sweep etc

[safe oriole]

yea i havent had any luck with input video for animate diff

i mean never run a video, in theory you could make a prep video of you face swapped onto some free 3d model thats jumpng around, then use that as a feeder video for animatediff

[noble bison]

https://youtu.be/zNQoNkWikks?si=PcxPZEg02LKHY1Ut

[inner crest]

My first SDXL animation...

[void girder]

https://www.youtube.com/watch?v=WVXbtloIUFY

[inner crest]

In using animatediff and comfyui I got this error:

Any idea why ?

[stable hawk]

some times things get stuck in vram and you have to relaunch comfyUI. Other than that, there may be an issue with the nodes. Try looking at the issues tab on github for the enxtension used.

[inner crest]

I made it works. Thanks

[stable hawk]

Butterfly test

[oak urchin]

Deforum in a discord bot

Barely perfect Deforum settings, Euler a, cadence 6 and a details lora ~0.75-0.80 :

Only around 4Mb per animation.
Ping me for the code.

[simple jasper]

Tu fais comment pour utiliser le bot sur discord ? 👀

[simple jasper]

I got a generic question, that i'm really interested to know, did you tried all different animation technics and what do you think is the best one to use ? I'm talking mostly about Deforum / AnimateDiff / GridTechnic with Ebsynth, if anyone got other workflows, i'm stocked to know aswell

[serene jay]

this question has no answer, each has it's own characteristics, depends on what do you want to do and your style

if you like video2video stuff maybe warpfusion or ebsynth is best suited for that, if you like text2img, deforum is pretty solid, also with the ability to control everything and sync to sound etc

there's also runway's tools: gen1 and gen2

zeroscope and more

[simple jasper]

Ok yeah i see, that's right, every tools got a different approach according to the purpose of the final results and the process to do

Did you used controlNet for the walk animation ?

[inner crest]

nope it is what is amazing

everything is done via prompt + motion model

no idea how it works

[simple jasper]

Wow man, it's crazy

[inner crest]

https://tenor.com/view/tinker-bell-fairy-dust-gif-11071242

[simple jasper]

What do you mean by motion model ? You're using animatediff ?

[inner crest]

yes I do

[simple jasper]

Ok, awesome result tho! Congrats !!

[inner crest]

and the name of motion model is mm_sd_v15_v2

from my undestanding, you just need to add: "walking toward the camera" in prompt box, and the movement starts

there are different motion models, so depending on what you want, you load them

[simple jasper]

Do you run different gifs and combine then to change the scene, or you do everything at once in a single prompt ?

[inner crest]

everything at once

It looks like seed traveling. Something I could do with Parseq. And fairy powder for the movement.

what is crazy it is how the background changes and dimensions adjust automatically

[simple jasper]

You're using ComfyUi to config your animate diff ?

[inner crest]

yes I do

[simple jasper]

Yea that is so clean!

[inner crest]

but it works with A1111

[simple jasper]

And then you use different prompt nodes to interpolate between each scenes or all the prompt is in the same node, and tell animate diff to change scene according to time or something like that ? i'm sorry with my dumb question tho 😅

[inner crest]

here's my json

I used a pre-existing workflow

[simple jasper]

Ok i might try that and adjust according to my goal

[inner crest]

The most important part is the prompt

[simple jasper]

Thanks a lot for the workflow!!

[inner crest]

and the guy who created it, he didnt make it free/

[simple jasper]

Ahaha you shared me valuable content for free 🤯

Should have asked for patreon coffee ahaha

[inner crest]

https://youtu.be/EC9bE7Fot78?si=EQm5CliVU5GVNLsL

[serene jay]

the motion models are trained on motion, you have walks, runs, birds flying, cars moving etc... it's the same as the img models but with video

[simple jasper]

yea this video is so trendy, crazy that the guy did a tut on how to do that 😄

[inner crest]

It is not so complicated, I think a lot of people can do the same. It took me 15mn to install and set my parameters

problem is if you don't know it is possible, you will never try 😄

what I try to do now is to improve the quality. He uses topaz ai video. But it is not free...

I try to find an alternative and a better upscalling solution. But I get too much flickering

[serene jay]

a decent upscaler + flowframes can give you the same results as topaz

and free

[inner crest]

realesrgan x4 + flowframe ?

[serene jay]

depends on what you want to do... esrgan is a good universal one, for anime maybe siax o yanderei

4x-ultrasharp is also good

and flowframes CUDA RIFE is very good at 2x or 4x

[inner crest]

4x-ultrasharp in batch img2img at 0.30 denoising strength gave me a lot of flickering

you upscale first ?

[serene jay]

that will give you smooth frames without flickering

[inner crest]

and then interpolate ?

[serene jay]

usually but sometimes less flickering with first interpolation and then upscaling, also depends on what, for anime or linework I would upscale first

[inner crest]

and what parameters do you use for 4x-ultrasharp ? I use SD-ultimate with 4x-ultrasharp and batch img2img in A1111 but I have a lot of flickering

is it possible to create a node with 4x-ultrasharp in comfyui ?

[serene jay]

I did this on 4x-ultrasharp and 2x RIFE https://www.youtube.com/watch?v=KzyBGAagYD0

almost no flickering

[inner crest]

https://tenor.com/view/oh-really-you-dont-say-gif-25751398

[serene jay]

also depends on what's your orignal resolution in animateDiff/comfy, if you have the GPU to render bigger frames, probably wont need a 4x upscaler

[inner crest]

I dont understand what I do wrong :d

[stable hawk]

Made a Lora on Civitai with the buzz coins I got awarded with of some images of Geeky Ghost I made with Midjourney, used my blended int comfyUI and AnimateDiff workflow to animate it using a blended int. Actually worked out fairly well.

https://civitai.com/models/165623?modelVersionId=186412

the images used for the belnded int for the workflow are also part of the training. Used 45 images total.

So.... if you want some easy animations, take a ton of photos, generate them, render them, or whatever. Create a Lora for the character, use the blended int workflow, use two images from the training, prompt well, and viola! Easy consistent animation.

[inner crest]

I just put dancing in the prompt and she dances....

https://tenor.com/view/fascinating-mr-spock-henoch-star-trek-the-original-series-gif-23404763

[inner crest]

https://tenor.com/view/james-quillus-smooth-morgan-peter-brown-uggo-ron-ogden-gif-16059628

I didn't know I could do that with free softwares... Result is even better than with Topaz....

I will see if I can do it with SD ultimate and Ultra sharp in Comfyui...

[serene jay]

Nice looking better

[stray tree]

First test with animatediff:
https://www.youtube.com/watch?v=VpMetWhh0KQ

[static niche]

you can't post that without a workflow, dont you know the rules?

[stray tree]

hahahahahahaha....is it April Fool's Day today or what?

[static niche]

have we heard anything about animdiff for comfyui getting an sdxl update?

that + @stable hawk's image blend would be dope

[stable hawk]

Some folks be working on it. The motion model is really the hold up. I don't have the rig to do the training.

[serene jay]

AnimateDiff at sdxl resolutions is heavy on training and will also be on infering

There are a couple teams working on that

[stable hawk]

I honestly didn't think it'd be that popular lol. But got me some free buzz cash somehow on Civitai so I bought a Lora training lol.

[stable hawk]

I'm going to try batch image to image with an sdxl model with low denoise strength like 30 to 40 ish today using the seed and promots from the original gens of the video to see how that works out. Then add it to the workflow before the combine if it goes well. Crazy how many chains you can have going.

[mossy ridge]

I made this with animatediff. I think everyone in the video is recognizable

https://youtube.com/shorts/admeryR_4Dc?si=oUazUKnLMaZNHkbI

[simple jasper]

Hillarious ahah

[static niche]

anyone know what i would get completely different results with the exact same setup and seed on 2 diff pcs both with 4090 24G cards?

[static niche]

nothing is different, including seed, just 2 diff pc's

same checkpoints, same lora, same motion model

same input image

exported workflow from one pc, loaded on the other

[stable hawk]

Different PCs can mean different versions of the software used to generate (different versions can make a difference), different drivers (can make a difference as this all runs through the gpu), different GPU can make a difference. There's an option in Automatic1111 to use the CPU for the seed so it acts the same across Different systems but it has to he set before generating.

[static niche]

is there a place in comfy for cpu/gpu seed?

[stable hawk]

That I do not know, I'm actually really new to ComfyUI. I'm sharing what I learn as I learn it 😅

[static niche]

535 drivers on one and 525 drivers on the other, would they be that wildly different in results?

[stable hawk]

Small differences can cause wildly different output.

[stable hawk]

You'll notice on some updates to extensions and etc they'll note that seeds will change.

[stable hawk]

Basically every system, even mostly identical systems, you should expect seeds to change. Some arguments being present or absent from the launch configuration can make the seeds change.

[static niche]

both running 535 now, exactly same results, arg

[static niche]

hmm, one has cudNN the other doesn't

[stable hawk]

Yeah, it's rough swapping between systems. I had to create to maps one for my 1650 and one for my 3070 rig

[static niche]

installed cudNN 12.2 8.9 to match, reboot, same results

only thing i see diff in the render consoles is one mentions sliding context window, the other doesn't

[AnimateDiffEvo] - INFO - Loading motion module animatediffMotion_v15V2.ckpt [AnimateDiffEvo] - INFO - Using fp16, converting motion module to fp16 [AnimateDiffEvo] - INFO - Sliding context window activated - latents passed in (32) greater than context_length 16. [AnimateDiffEvo] - INFO - Injecting motion module animatediffMotion_v15V2.ckpt version v2.

gotta be something to that, will keep researching

[toxic glen]

Xformers

[static niche]

possibly, gotta figure out how to check if it's on there

[static niche]

that was indeed the problem

[static niche]

ty kindly friend and you as well @stable hawk, appreciate the tips

[toxic glen]

no problem

[static niche]

https://tenor.com/view/drinks-are-on-me-beckett-rush-finding-you-i-treat-everyone-drinks-ill-pay-for-the-drinks-gif-22148848

so pumped

@stable hawk have you tried upscaling the video yet in the workflow?

[remote comet]

Has anyone worked out to use an initial image with animatediff? So far, have only managed to get it working with an imagine generated with txt2img, or img2img with denoising set to at least 0.8. Would be interested to see if anyone has had any success?

[stable hawk]

GeekyGhost Blended Int - v1.1 | Stable Diffusion Workflows | Civitai

Ignore my girls Playlist lol

[stable hawk]

https://civitai.com/models/162163/geekyghost-blended-int

Sorry, just woke up

[static niche]

i'll send you one in a sec

getting my coffee 🙂

[raven stirrup]

you using comfy?

[inner crest]

Yep

[serene jay]

Halloween season, they said... "Latent Nightmares" - AnimateDiff/ComfyUI https://www.youtube.com/watch?v=sUgrJDK5UaY

[static niche]

sorry, got nailed the minute i got into the office today and totally forgot

anyone able to get T2I working with animdiff?

as a kind of control net maybe

[vital yacht]

100% Deforum (SDXL) - 3D Mode
https://youtu.be/Ma2yrAkHqhc?si=d1XX5WReFBiXpr87

[simple jasper]

Are you using a specific metho to do the music sync with AnimateDiff or are you doing it manually ?

[serene jay]

it's just editing, nothing fancy

[simple jasper]

Alright so you make all the clips with AnimateDiff and then edit everything so it follow the beat of the song right ? 🙂

[serene jay]

pretty much, animating with controlnets to get interesting movements that fit with the song

[simple jasper]

Oh dope, and you're using horror reference video to put as control nets to predict the style of the output that you want, or the horror is mostly with the prompt ?

[serene jay]

all in the prompt, no reference video, some I am animating with openpose, others with qr monster, some ipadapters of sdxl gens, but it's almost 100% prompted

[simple jasper]

I see, that's really interesting to know!

[trail galleon]

Idea of how is this done? I thought infinite Zoom because it looks slightly like a zoom in but mmmmm I tested and I didn't got any good result because is also kind like a video

I didn't test yet SD CN animation in A1111

[toxic glen]

Anybody know why this would happen rendering with SDXL on Deforum?

[stoic fox]

i don t know but the effect is pretty amazing

some cars!

[stable hawk]

Removed xformers and made some changes to my comfyUI install so I can use the vid2vid node. Still sorting that at. But it did improve aninatedDiff gens lol.

[surreal basin]

Live bro!

[mossy ridge]

absolutely

🔥

[surreal basin]

Dope animation

[compact turtle]

lmao what

[toxic glen]

@foggy imp

[compact turtle]

Are there ways to shorten animatediff render times?

Are they meant to take forever on a 3060?

I have xformers on

[raven stirrup]

spooky

[raven stirrup]

I have mine down to 17min on a 1070ti so yours has to be at least faster than that, but by no means will approach a 3090 or 4090

[compact turtle]

....... How. It takes me an HOUR AND A HALF.

[raven stirrup]

you using comfy?

[compact turtle]

Nope, a1111.

[raven stirrup]

lol there you go

[compact turtle]

Damn

[raven stirrup]

comfy ui is the way to go

[compact turtle]

comfy is faster, I'm currently using it, but when i posted that i wasnt using comfy...

[raven stirrup]

you installed ffmpeg?

[compact turtle]

that sucks xD CUI looks so much more complicated, yet it produces amazing results.

I dunno what that is.

[raven stirrup]

well to get videos running you have to have it installed

then you can generate mp4s

but it doesn't work if you're running the comfy instance on your secondary drive

[compact turtle]

Well I can make gifs, and that's just fine for me

And I'm running it on my main drive

[raven stirrup]

then you can get mp4s working easy

[compact turtle]

since flashdrive decided to fuck up

[raven stirrup]

hold on

[compact turtle]

Okay so I have a question, can I use premade videos and render in my own stuff?

Like img2img, except less "This has to be exactly this, you can't change it"

[raven stirrup]

https://civitai.com/articles/2379/guide-comfyui-animatediff-guideworkflows-including-prompt-scheduling-an-inner-reflections-guide

(Optional) - https://ffmpeg.org/download.html - this is what combine nodes use to take the images and turn them in a gif. Installing is a guide in and of itself. I would YouTube how to install it to PATH. If you do not have this the node will give an error BUT the workflows still run and you will get the frames

you can there was a guy doing it just above

[raven stirrup]

@quinzel check this post

it's a bit tricky with viv2vid

[compact turtle]

I tried doing img2img frames with SD, and it gave me janky-ass results that I had to compile myself...

was not a fun time.

[raven stirrup]

the guys here suggested i start following nerdy rodent

nerdy rodent actually answered every one of my questions on his youtube channel

like in the comments

[compact turtle]

Okay, I'll give him a look later!

RIght now, I just need to figure out the basics. WHich is essentially learning how to do animations, since I'll be using a1111 for images, and cui for animations

[raven stirrup]

you can just copy paste a worflow

[compact turtle]

Exactly

[raven stirrup]

you drag the .json file into the gui

[compact turtle]

That's what I did

SO I have made my animations, now I'm just trying to vid2vid

[raven stirrup]

but you need to have comfy manager

[compact turtle]

I also have that

[raven stirrup]

cool

well then there are some janky things you need to do idk might ask GeekyGhost on that one since he is starting to work on those workflows

[compact turtle]

Alright, I'll probably look up how to do it.

[raven stirrup]

nerdyrodent prolly has the vids

he was super helpful for me

[stable hawk]

vid2vid

Theres conflicts with xformers and the faceswap nodes

[compact turtle]

Okay so I found a workflow for vid2vid, but it keeps giving me epilepsy inducing results.

ANd I don't have xformers for this either, as it didn't even come with it.

Like, very epileptic results, results I can't even show here.

It's that bad

[compact turtle]

How exactly do you do this? I'm trying to do this with a dance, and it's giving me a different result each frame.

like a VERY different result.

I'm gonna go to bed, and if you could reply with a ping, thank you. My brain is fried and I dunno what I'm doing wrong.

[stable hawk]

Yeah, I was having that issue with the portable install. I had to install comfyUI the normal way, Uninstall torch and reinstall the newer version, Uninstall daceseap custom nodes, and used the basic vid2vid with controlnet workflow

Faceswap nodes*

[stable hawk]

I did have to remove fizzy batch prompt node and replace it with a regular one to get more consistency across the board and make my prompt a bit more focused on the asthetic I wanted to change, but it's essentially the basic vid2vid workflow.

[stable hawk]

and vid2vid cut it off at 121 frames for testing

[stable hawk]

Original has audio and is the second video, its a text to image walk cycle I made a year or so ago with SD. The spiderman vid is the vid2vid output.

[stable hawk]

prompt change only.

[noble bison]

https://youtu.be/8QkasgsnVRk?si=QUw5ISXof7-KG2Yb

[void girder]

https://www.youtube.com/watch?v=WVXbtloIUFY

[stable hawk]

here is the civitai link for those not wanting to download from discord lol. https://civitai.com/models/170458?modelVersionId=191530 simplified vid2vid

[compact turtle]

What's the normal way of installing it? I installed the portable one onto my main drive...

[stable hawk]

cloning the repo, creating a venv, installing the requirements. I create a .bat file to make my life easy to handle most of it after the git clone.

[stable hawk]

the portable is for those struggling doing the cloning and etc. and for the lazy like me lol.

[compact turtle]

Yeah see you lost me at venv. I have no idea how to do that.

I googled it and got no answers, and it said i needed to install another thing for python 3.10.

[stable hawk]

I can share my .bat file but you shouldnb't trust internet code unless you know what you're doing and can review the code for issues or potentially harmful code. Especially .bat files. They can be used to rewrite all your file names lol. I actually have one that does just that that I have to be super careful using lol.

[compact turtle]

Yeah, I'll try to do it myself, as I have no idea how to check code myself, and only recently started learning Java

[stable hawk]

yeah, it

it's not to difficult though. there should be a walk through on the comfy github page if not most of automatic1111s walkjthrough should work.

[compact turtle]

Do I NEED to create a venv or can I just do what it tells me to do?

CUz it doesn't say to make a venv.

[stable hawk]

It's basically, git clone into a folder, create the venv (I don't use conda, straight python), Activate the venv, install requirements.

[stable hawk]

I always recommend created a venv, it's a virtual enviroment and limits the changes to that virtual environment. If you don't use a venv, the installs and changes are system wide.

[compact turtle]

Shiieeettttt.

How do I make a venv? Google isn't any help and it's a bunch of mumbo jumbo I don't understand.

I just need an ELI5 (explain like I'm 5), and there's none of that

[stable hawk]

Open Command Prompt: Type cmd in the Windows search bar and hit Enter.

Navigate to Project Folder: Use the cd command to go to your project directory.

bash
Copy code
cd path\to\your\project\folder
Create a Virtual Environment: Run the following command to create a virtual environment named myenv:

Copy code
python -m venv myenv
If that doesn't work, try using python3 instead of python.

Activate the Virtual Environment: To activate the environment, run:

mathematica
Copy code
.\myenv\Scripts\Activate
Your prompt should change, showing you are in the virtual environment.

Install Packages: You can now install Python packages that will only be available in this environment. For example, to install requests:

Copy code
pip install requests
Deactivate: When you're done working in the virtual environment, you can deactivate it by simply typing:

Copy code
deactivate

the myvenv is the name of your venv

[compact turtle]

I tried the python -m venv myenv and python3 and it doesn't owrk, but I'll try it again and send you the error.

[stable hawk]

are you using conda? as Conda is different.

[compact turtle]

Uhhhhh.

I...don't know.

[stable hawk]

lol, fair. I'd recommend sticking to the portable install. Issues section on the github page will help you work around most issues.

doing the regular install can mess up your other python applications if you aren't careful.

[compact turtle]

Yeaaahhhh....

[stable hawk]

any changes it makes to python and etc can bork it for others.

[compact turtle]

I don't feel like messing up this computer, as it's not mine.

[stable hawk]

fair then yeah, portable installs is the best way to go.

[compact turtle]

Alr. ALso you vid2vid flow works great, I just have to figure out what the right controlnet model is for my case.

[stable hawk]

I'm glad, I'm working on adding controlnet stacking and loras to it now lol.

its mostly the vid2vid workflow, but with some small changes that fixed it for me.

[compact turtle]

I'm sure I can figure out how to add loras to this, i built a map from scratch with a video guide, so i've kinda learned how to do it

It however gave me epileptic results. SO uh.
https://www.youtube.com/watch?v=nMyiuiWjiEc

I don't think this method is good if it's giving me entirely different frames each turn.

[stable hawk]

yeah, consistency is important and definitely don't want seizures lol

I do like that frame interpolation node though. Need to find that one lol

[compact turtle]

It's from the comfyui-n-suite I believe.

This wasn't what I was trying to make, but it still came out good nonetheless

[stable hawk]

Almost there lol, 2 controlnet models and preproccesors, lora for style Breath of the wild as it's the most noticeable when it works, motion lora (Zoom out), with the vid2vid workflow lol

same base vid as the others, my text to image walk cycle.

mind you the video used as an int isn't very good. Will test it later when I finish it with a good video.

[mossy ridge]

I made a deepfake Video with stable diffusion. I think the faces are pretty good. What do you think?

https://youtube.com/shorts/9hWN7wnBdnA?feature=share

[lone inlet]

quite the title there bud

[fallen girder]

Animations exhibited at Dreamforum UK event (Deforum hybrid motion)
https://youtube.com/shorts/BpjOl8-Av6k
https://youtu.be/oC3BJNi5Aak
https://youtu.be/Ss3hnFMT3y0

[compact turtle]

Can a 2080 run animatediff on a1111? Or is that a dream never to be achieved?

If it can run on comfyui, my next question would be is there a way to remote-access like you can with a1111

[stable hawk]

The dev working on animatediff isn't updating the automatic1111 version at the moment, it should work as is for now, but the comfyui version is more robust and less resource intensive.

2080 should run it fine for a1111

With the caveats above.

[compact turtle]

It's very slow, been sitting here for 5 minutes and there's no eta showing up.

And I'm like 90% sure it's not offloading onto the cpu. I am using someone else's computer via the remote access feature, but I don't think that would be an issue.

Okay so they checked their task manager, and there's no cpu usage that's unusual for them, so it hasn't offloaded onto the cpu.

Okay so a 2080 can't do animation with a1111, which is unfortunate, but we'll be trying comfyui. He plans to let me borrow his computer for animation generations, since my laptop's 1660ti can't handle it on ComfyUI.

It gets stuck before it even starts rendering.

It'll get to Ksampler, and then stop.

...okay so it does work on a 2080, it just. needs you to press enter a couple times.

It just needs a little encoruagement throughout the process but that's fine

[stable hawk]

lol

[compact turtle]

is there a way to get a 1660ti working with animations for comfy ui?

[void girder]

https://www.youtube.com/watch?v=sDFHrjHwsfI

[compact turtle]

Great googly moogly, I got it working! But it's 778s per step, and I'm wondering if it can't go any faster?

[rough vessel]

not with that gpu

[compact turtle]

...damn.

I wish I didn't have such a bad gpu...dammit.

I thought about maybe offloading it to my cpu, but my cpu isnt high end, it's like in the high part of mid.

[toxic glen]

Yeah I used a 2060 6GB since I started using AI tools until a couple weeks ago

Made animations for months on it

[compact turtle]

It requires a lot of poking, for some reason. Or else it doesn't generate. You have to keep pressing enter or clicking on the cmd window, or it doesn't do anything and time steadily climbs.

It might've been the uh... --share thing messing with it, but I don't know.

I was using the --share thing with a 2080, cuz the guy offered his computer for my AI animations, since my laptop is a 1660ti. The PC i'm on isn't mine, and I'll be going home on the 8th of next month.

[compact turtle]

Ohhh that's sick

[toxic glen]

This is one of the first I've made with my new gpu

as I can finally render with SDXL

and tyvm!

[toxic glen]

what are you animating with?

I'd use deforum in a11, with the --medvram flag on

[compact turtle]

For the 3060, comfyui

For the 2080, a1111

[toxic glen]

for the 2080 on a11 if you use the medvram flag you should be fine

just remember, render slow and small

upscale and interpolate after

[toxic glen]

(3090 24GB 😉)

[lament kite]

Can i ask where do u learn this infinite zoom trick

[mossy ridge]

I made a celebrity deepfake Video with switching faces with stable diffusion.
What do you think?

https://www.instagram.com/reel/Cyq1tI0sz-u/?igshid=MzRlODBiNWFlZA==

at.a.i.center

Hollywood Stars get ready to Fight ai for their Jobs #amberheard #meganfox #amandaseyfried #ai #edit #celebrity #girl #animated #weightlifting

Instagram

[toxic glen]

It's a Deforum animation

I have a tutorial series on Civitai that teaches you how to get started animating with it

https://civitai.com/articles/554/dwh-1-creating-your-first-animation-with-deforum-in-1-click

[gleaming terrace]

hey, im trying to make flowing hair in a still image, any ideas on how i would go about that?

[lament kite]

Thanks uwu >~>

[toxic glen]

No problem! Reach out if you have any questions

[lament kite]

Sure

[lament kite]

How about you download flowing hair in a green screen from google

Then edit it with ur still image

Then turn it into a mov2mov

[toxic glen]

After effects is an option

https://youtu.be/oiEjz_-8wfk?si=nEkWFANU8u4C14zN

[lament kite]

BRO SENT A 40 MIN TUTORIAL

[gleaming terrace]

not a bad idea, but i dont see how i would replicate the style of hair?

[gleaming terrace]

great video, but danm its old. good trick too, was hoping on doing something at bit more automatet

[toxic glen]

Hmmm... I'd try runway gen2

[mossy ridge]

Hi, the video is very beautiful.

[sudden obsidian]

A friend made a track to go with my Diffuse Together challenge entry. I don't see the dedicated channel anymore, so i guess this is the place for it 🙂

https://www.youtube.com/watch?v=4N58IQSmsgE

[neat coral]

https://www.youtube.com/watch?v=OhaVWg3ts7A

watch party livestream using comfyui

[toxic glen]

https://www.tiktok.com/t/ZT8kjuDDs/

[mossy ridge]

Good afternoon, has anyone taught SD how to make Sprites of bodies or objects? How to cut an image into layers on the front layer, back layer, body parts, clothes?

[stable hawk]

ive added a film node

[frigid tinsel]

awesome animate #SDXL #AnimateDiff Hotshot makes it nice with animate diff adding spice -comfyUI workflow .. results are slowly going towards a better control and better cohesion. #ComfyUI Hope you all explore same.✨📷🍬

[vital yacht]

100% Deforum (3D mode)

For this animation I used the RealVisXL (v.2) checkpoint and experimented with the prompt using 4 Loras (xl_more_art-full, XL Black-and-Color, DarkArt_Style, William_eggleston-Style)

https://youtu.be/59nCorCYMgM?si=vKtbk_z1aVLpf5QR

[noble bison]

https://youtu.be/Hiy9GdLvvGY?si=kqILLG6nWjU4sv6n

[fallen girder]

"She Past Away - Ritüel" (AnimateDiff)
https://youtu.be/9N-_faXhRl4

[serene jay]

grande

[fallen girder]

Gracias! 🤘

[static niche]

you got a workflow working with sdxl and animatediff?

[serene jay]

there are none, no motion model trained yet, best bet now is hotshotXL, which is a 512x512 model based on SDXL. video is memory hungry, for 1024 x 1024 a lot of ram would be needed, even 12Gb cards are out of the question