#HyperDetailer with Metadata

29 messages ยท Page 1 of 1 (latest)

worthy swan
#

The workflow from hipsterusername with Linked Metadata Nodes.

worthy swan
placid haven
#

you can avoid using the xygrid nodes if you use the new denoise latents + metadata node that is now part of main in place of the last first two denoise nodes it will capture most of the metadata fields automatically. The only things it does not capture are the prompts so capture them in the same way as you do now and feed them into the final denoise node.

#

this also makes the metadata collection much simpler.

placid haven
#

I was wondering why I was getting poor results in the upscale phase of the workflow so I added a tile controlnet to that part and it really improved things and now keeps consistency with the first image generation. I also played around with the linear UI part to tidy it up a bit. It could do with some text to explain things a bit. Any thoughts?

median belfry
#

Hmmm how come generating with this workflow the same prompts and same image size immensely slower ?

#

am irunning out of vram

#

I dont think the loras are working properly here tho

worthy swan
median belfry
elfin viper
#

Interestingly enough, some of the models work, some of them produce a black square around a face.

worthy swan
#

maybe you need to change the Scheduler for some models

soft orchid
#

Made some tweaks to the most recent version posted by Pfannkuchensack. This update fixes the positive and negative prompts being swapped going into the denoise node, which was producing some wonky output. I also added a fp32 toggle (having it off was causing black boxes for me), made it so you can change what part of the image is being detailed directly on the form, and pulled the original metadata through to the final output image so that it can be used as an input for further detailing.

#

Also pulled most of the denoise config values back out of the metadata so that you don't have to modify the workflow when you change image generation parameters.

hasty leaf
#

Im trying to figure out this workflow but keep getting this error "NodeInputError: Node 364b0742-112d-4987-8dae-d4db486ab370 has invalid incoming input for cfg_scale"

#

Ok actually i found where to edit that, Still trying to see how to utilise this workflow properly so any tips are very welcome

soft orchid
#

The main use of the workflow is to add extra detail to faces in images (but you can detail other things, too). Since stable diffusion essentially has its "attention" spread across the entire image, things with fine detail tend to get a bit . . . wonky. Distorted faces are especially common when it's a character at a distance.

This workflow uses a "Grounding DINO" node to find a specific element in an image (defaults to "Face", but you can pick other objects too). It then re-generates just that portion of the image, focusing only on that element (as if you had generated a super-zoomed-in version of it). And it doesn't regen it from scratch, but uses the initial image as a starting point and adds about 35% of the noise back in, regenerates it, and saves the new image to the gallery.

The end result is that faces (or other objects with fine detail) can have extra detail added back in sort of "automatically" without the user having to use inpainting. In fact, this is essentially "automatic inpainting" for objects that DINO can find in the image.

blissful marlin
#

thanks a lot! included this workflow into my regular one! works like magic!

blissful marlin
#

However! ๐Ÿ˜„ Now I found that on some models detailer creates slightly mismatched in color images.

I tried to play with a workflow, changing the mask blur, but nothing. Color correct node also bugs out on me, I don't know why. Thinking about applying curve fix node. Maybe someone have other ideas. Please share!

fair elk
#

umm how exactly do you make this work? where do i put the files, how to install and use?

worthy swan
#

you download the json file and open it in the workflow tab.

fair elk
#

@worthy swan sry to ping you know anything about this?

#

i opened the actual workflow editor and tried to determine where this was but i must be blind or something