Comfyui best upscale model for upscaling. Updated link to non deprecated version of efficiency nodes.

Comfyui best upscale model for upscaling 5, euler, sgm_uniform or CNet strength 0. Hi, guys. Upscaler Wiki - Model Database. 4x-UltraSharp. Which one is best depends on the image type, BSRGAN I find is the most general purpose, Real ESRGAN is a better choice if you want things smoother or with anime, SwinIR is a good choice for getting more detail, LDSR I would only use on more important images. In the CR Upscale Image node, select the upscale_model and set the rescale_factor. 25x uspcale, it will run it twice for 1. The UPSCALE_MODEL output is the actual upscaling model object that has been loaded based on the specified model_name. Upscale latent: The With latent upscale model you can do only 1. 25, 1. Try immediately VAEDecode after latent upscale to see what I mean. Hi, I am upscaling a long sequence (batch - batch count) of images, 1 by 1, from 640x360 to 4k. Alternatively, if you want to run your own customised ComfyUI workflow, one that incorporates Ultimate SD Upscale, you can use the fofr/any-comfyui-workflow model. ComfyUI Manual. You can do it in one go if you have the vram. New to Comfyui, so not an expert. image. ComfyUI manual. Understand how low-resolution images can be transformed into high-definition ones using different methods and algorithms. If you do 2 iterations with 1. 4) Upscaling. That's because of the model upscale. I was just using Sytan’s workflow with a few changes to some of the settings, and I replaced the last part of his workflow with a 2-steps upscale using the refiner model via Ultimate SD upscale like you mentioned. Topics ai upscale image2image upscaler img2img image-upscaling image-upscaler image-upscale upscalerimage stable-diffusion comfyui comfyui-workflow In this easy ComfyUI Tutorial, you'll learn step-by-step how to upscale in ComfyUI. I often reduce the size of the video and the frames per second to speed up the process. And above all, BE NICE. 2024. UPSCALE_MODEL. I tried all the possible upscalers in ComfyUI (LDSR, Latent Upcale, several models such as NMKV, the Ultimate SDUpscale node, "hires fix" (yuck!), the Iterative Latent upscale via pixel space node (mouthful), and even bought a The first is to use a model upscaler, which will work out of your image node, and you can download those from a website that has dozens of models listed, but Learn how to upscale images using ComfyUI and the 4x-UltraSharp model for At present, there are two mainstream methods of upscale: Upscale pixel: The visible image is directly upscaled. original_samples processing steps that require access to the original images. 5 or 2x upscale. so my question is, is there a way to upscale a already existing image in comfy or do i need to do that in a1111? Created by: sk8583: In this workflow you can train your model for face model, swap it and upscale it for video and images. ComfyUI Workflow Build Text2Img + Latent Upscale + Model Upscale | ComfyUI Basics | Stable Diffusion. 09/06/24 - Added an alternative version of the Flux Latent Upscaler workflow, this modified version uses Hyper Flux loras and a new clip text encoder made specifically for Flux and SD3, combined these cut inference time from hey folks, latly if have been getting in to the whole comfyui thing and trying different things out. I'm new to the channel and to ComfyUI, and I come looking for a solution to an upscaling problem. Then another node under loaders> "load upscale model" node. It's a bit cumbersome to get the regular ipadapter plus node to get conditioned differently for each image in a batch, Under 4K: generate base SDXL size with extras like character models or control nets -> face / hand / manual area inpainting with differential diffusion -> Ultrasharp 4x -> unsampler -> second ksampler with a mixture of inpaint and tile controlnet (I found only using tile control net blurs the image) Upscale images and remove image noise Real-ESRGAN is a machine learning model that upscales an image with minimal loss in quality. What's the best upscale model? upvotes PSA: RealPLKSR is a new, FANTASTIC (and fast!) 4x upscaling For upscaling there are many options. The video also demonstrates enhancing the workflow with features like Latent Upscale and Model [rgthree] Note: If execution seems broken due to forward ComfyUI changes, you can disable the optimization from rgthree settings in ComfyUI. Examples. Swapping (Deepfake), Training Face Model & Upscaling. Like a simple image2image for example, with a higher resolution. * If you are going for fine details don't upscale in 1024x1024 Tiles on an SD15 model, unless the model is specifically trained on such large sizes. A Simple ComfyUI Workflow for Video Upscaling and Interpolation. To find the downscale factor in the second part, calculate by: factor = desired total upscale / fixed upscale factor = 2. The downside is that it takes a very long time. ultrasharp), then downscale. The issue I think people run into is that they think the latent upscale is the same as the Latent Upscale from Auto1111. This doesn't affect the post-processing scaling option, this only affects the actual upscaling via ESRGAN. I think the "8NMKDFaces160000G_v10" model gives the best skin texture output while at the same time doing an ok job of preserving other textures in the picture. inputs. Usually I use two my wokrflows: Superscale is the other general upscaler I use a lot. 4x_NMKD-Siax_200k. com/comfy Put them in the models/upscale_models folder then use the UpscaleModelLoader node to load them and the ImageUpscaleW Skip to main content. Select Custom Nodes Manager The quality and resolution of these images depend on the input parameters and the upscaling model used. Open comment sort options Speaking of that, I This node will do the following steps: Upscale the input image with the upscale model. Here is an example: You can load this image in ComfyUI to get the workflow. Put the models here: ComfyUI\models\upscale_models This is often referred to as "AI Upscaling". In this ComfyUI tutorial we look at my favorite upscaler, the Ultimate SD Upscaler and it doesn't seem to get as much attention as it deserves. 40. /comfy. Place the images that you want to upload in a folder Welcome to the unofficial ComfyUI subreddit. The workflow utilises Flux Schnell to generate the initial image and then Flux Dev to generate the higher detailed image. This powerful technique allows you to dramatically improve image quality, taking even the most poor-quality photos and turning Updates. Today, I’m excited to share a new ComfyUI workflow that I’ve put together, which uses the Flux model to upscale any image. I have been experimenting with AI videos lately. I used 4x-AnimeSharp as the Welcome to the unofficial ComfyUI subreddit. I've never had good luck with latent upscaling in the past, which is "Upscale Latent By" and then re-sampling. In terms of ComfyUI nodes, the input of this node is an image, and the output is the upscaled image. What's the recommended way to fix the faces after upscaling We’re on a journey to advance and democratize artificial intelligence through open source and open science. If the upscaled size is larger than the target size (calculated from the upscale factor upscale_by), then Welcome to the unofficial ComfyUI subreddit. Hope someone can advise. 1 You must be logged So if you want 2. 0 = 0. What's the best upscale model? upvotes PSA: RealPLKSR is a new, FANTASTIC (and fast!) 4x upscaling architecture upvotes Created by: CgTopTips: In this video, we'll dive into the amazing world of Tile ControlNet for models. What is the best way to upscale? Gourieff / comfyui-reactor-node Public. If you are looking for upscale models to use you can find some Learn how to upscale images using ComfyUI and the Flux model with GGUF support and ControlNet integration. Select the upscale models. This is not the case. the image upscale is pretty much the only distortion-“free” way to do it. I'm trying to find a way of upscaling the SD video up from its 1024x576. Didnt play with settings yet, but its kind of magic. When I run them through 4x_NMKD-Siax_200k upscaler for example, the eyes get really glitchy / blurry / deformed, even with negative prompts in place for eyes. of concept: Node to steer tiled upscaling using IPAdapter Thought ipadapter could be a good way to control tiled upscaling. Hires fix uses custom upscale models (such as those available from OpenModelDB) to increase the Do not downscale using force size, it introduces dicey pixels after upscale. so thanks for that A lot of image to image upscaling (image to image) is for sharpening already decent photos. MODEL_NAME. The same concepts we explored so far are valid for SDXL. fix but since I'm using XL I skip that and go straight to Img2img, and do a SD Upscale by 2x. can watch the video to see a real-time demonstration and gain a 21K subscribers in the comfyui community. Share Sort by: Best. It seems a proccess similar to the one we can find in the EXTRAS Menu in Automatic1111 ComfyUI workflows for upscaling. 20K subscribers in the comfyui community. On first use. The model used for upscaling. The workflow is kept very simple for this test; Load image Upscale Save image. For this form of upscaling, a Machine Learning Model is trained on image pairs (called a dataset) of a low-resolution and a high-resolution version of the same image. ATM I start the first sampling in 512x512, upscale with 4x esrgan, downscale the image to 1024x1024, sample it again, like the docs tell. i wonder if there is a good workflow for upscaling the video? I found one thread about cutting the video up in sequences and upscale from that, but dont know where to start. I've eventually settled on 4x-UltraSharp as my favorite, but there are pros and cons to other choices. 2x, upscale using a 4x model (e. It covers the use of custom nodes like Created by: Mad4BBQ: What this workflow does Extremely EASY to use upscaler/detailer that uses lighting fast LCM and produces highly detailed results that remain faithful to the original image. Adding in Iterative Mixing KSampler from the early work on DemoFusion produces far more spatially consistent results as shown in the second image. It's why you need at least 0. Core Nodes. 5. For some context, I am trying to upscale images of an anime village, something like Ghibli style. 4x Upscale Model - Choose from a variety of 1x,2x,4x or 8x model from the https://openmodeldb. g. Thanks History: 16. From the ComfyUI_examples, there are two different 2-pass (Hires fix) methods, one is latent scaling, one is non-latent scaling Now there's also a `PatchModelAddDownscale` node. Click the Manager button in the main menu; 2. 2 / 4. 5=1024). This output is essential for the upscaling process as it contains the necessary data and algorithms to perform the image enhancement. You should bookmark the upscaler DB, it’s the best place to look: https://openmodeldb. 9 , euler_ancestral, karras. From restoring to upscaling, what's s_noise and which sampler works with the restoration_scale, it's all in there. Instead, I use Tiled KSampler with 0. however it is very well started to use comfyui/SD local a few days ago und I wanted to know, how to get the best upscaling results. Browse upscale Stable Diffusion & Flux models, checkpoints, hypernetworks, textual inversions, embeddings, Aesthetic Gradients, and LORAs Discover the ImageUpscaleWithModel node in ComfyUI, designed for upscaling images using a specified upscale model. OpenModelDb. Welcome to the unofficial ComfyUI subreddit. Iterations means how many loops you want to do. Explore the concept of Upscale in AI-based image generation with ComfyUI. sh: line 5: 8152 Killed python main. IMAGE. The implementation is a derivative of the Real-ESRGAN-x4plus architecture, a larger and more powerful version compared to the Real-ESRGAN-general-x4v3 architecture. It efficiently manages the upscaling process by adjusting the image to the appropriate device, optimizing memory usage, and applying the upscale model in a tiled manner to prevent potential out-of-memory errors. I'm using your basic upscale latent -> ksampler approach to upscaling my generations, but as you can see in the picture, the original image has a load of character and fine detail, but the higher resolution 49 votes, 12 comments. Tile upscaling, like ultimate upscale, is unarguably worse in raw quality / less consistent, but it's needed for many people to go above and beyond in resolutions. 55 Welcome to the unofficial ComfyUI subreddit. There are also other upscale models that can Welcome to the unofficial ComfyUI subreddit. Like many XL users out there, I’m also new to ComfyUI and very much just a beginner in this regard. pth "Latent upscale" is an operation in latent space and I don't know any way to use the model, mentioned above, in latent space. txt TLDR In this tutorial, Seth introduces ComfyUI's Flux workflow, a powerful tool for AI image generation that simplifies the process of upscaling images up to 5. So from VAE Decode you need a "Uplscale Image (using model)" under loaders. I don't want any changes or additions to the image, just a straightforward upscale and quality enhancement. 5 I'd go for Photon , RealisticVision or epiCRealism . Look at this workflow : 🎨 Dive into the world of image upscaling with our latest video, as we explore and compare various methods using ComfyUI! 🚀ComfyUI: https://github. example usage text with workflow image u/wolowhatever we set 5 as the default but it really depends on the image and image style tbh - I tend to find that most images work well around Freedom of 3. If you use Iterative Upscale, it might be better to approach it by adding noise using techniques like noise injection or unsampler hook. Load Upscale Model Output Parameters: UPSCALE_MODEL I'm creating some cool images with some SD1. Connect the Load Upscale model with the Upscale Image (using model) to VAE Decode, then from that image to your preview/save image. The only approach I've seen so far is using a the Hires fix node, where its latent input comes from AI upscale > downscale image, nodes. 5 models in ComfyUI but they're 512x768 and as such too small resolution for my uses. We will use these to scale up images we love while adding details and even injecting additional prompts along the way! Welcome to the unofficial ComfyUI subreddit. The best method as said below is to upscale the image with a model ( then downscale if necessary to desirate size because most upscalers do X4 and it's often too big size to process) then send it back to VAE encode and sample it again. 5 to get a 1024x1024 final image (512 *4*0. ComfyUI Outpaint workflow Hi everyone, I've been using SD / ComfyUI for a few weeks now and I find myself overwhelmed with the number of ways to do upscaling. NO PROMPT NEEDED - It just works!! How to use this workflow Simply drag and drop the image you want to upscale into the BASIC SETTINGS group box, select your favourite SD 1. There are many options for upscaling with Automatic 1111. Ultimate SD Upscale 2x and Ultimate Upscale 3x. takes a long long time. English; You can load this image in ComfyUI open in new window to get the workflow. Since you have only 6GB VRAM i would choose tile controlnet + sd ultimate upscale. Best ComfyUI Upscale Workflow! (Easy ComfyUI Tutorial) 2024-04-04 12:35:00. I’m trying to upscale a 512x512 image which I thought wouldn’t take much VRAM looking at the Readme kijai/ComfyUI-SUPIR: SUPIR upscaling wrapper for ComfyUI github. One of the most commonly used ways to increase both the dimensions and fidelity of an output image is to use what’s known as Hires fix during the txt2img generation process. I call changed the upscale modelwhich helped. The low model on the left has 474 x 711. Upscaling on larger tiles will be less detailed / more blurry and Does anyone have any suggestions, would it be better to do an iterative upscale, or how about my choice of upscale model? I have almost 20 different upscale models, and I really have no idea which might be best. For illustration/anime models you will want something smoother that would tend to look “airbrushed” or overly smoothed out for more realistic images, there are many options. After 2 days of testing, I found Ultimate SD Upscale to be detrimental here. The pixel images to be upscaled. 1. Taking the output of a KSampler and running it through a latent upscaling node results in major artifacts (lots of horizontal and vertical lines, and blurring). Interface. 04. 4x using consumer-grade hardware. If you are not interested in having an upscaled image completely faithful to the original you can create a draft with the base model in just a bunch of steps, then upscale the latent and apply a second pass with the base and a third pass with the Thanks. Step-by-step guide for sharp and clear results. Sort by: Best. And when purely upscaling, the best upscaler is called LDSR. We will also use the manager node. info For ComfyUI portable users, move inside the "ComfyUI_windows_portable" folder. outputs. I saw article about upscaling in ComfyUi and though, i have not really seen much info about latent upscaling. You get to know different ComfyUI Upscaler, get exclusive access to my Co By selecting the appropriate model name, you can ensure that the node loads the correct model that best suits your upscaling needs. Reactor has built in codeformer and GFPGAN, but all the advice I've read said to avoid them. Notifications You must be signed in to change notification settings; Fork 170; Star 1. Please keep posted images SFW. . got prompt . You switched accounts on another tab or window. Please share your tips, tricks, and workflows for using this software to create your AI art. January 5, 2024 amida168 Machine Learning 0. The MODEL_NAME output is a string that returns the name of the Simply save and then drag and drop relevant image into your ComfyUI interface window with ControlNet Tile model installed, load image (if applicable) you want to upscale/edit, modify some prompts, press "Queue Prompt" and wait for the AI generation to complete. Check the size of the upscaled image. The latent upscale in ComfyUI is crude as hell, basically just a "stretch this image" type of upscale. 📂 The default installation path for upscaler models in ComfyUI can vary depending on the installation method. Then I upscale with 2xesrgan and sample the 2048x2048 again, and upscale again with 4x esrgan. I find Upscale useful, but as I often Upscale to 6144 x 6144 GigaPixel has the batch speed and capacity to make 100+ Upscales worthwhile. Remember that 2x, 4x, 8x means it will upscale the original resolution x2, x4, x8 times. It is a node The best upscale to date for me. 6 denoise and either: Cnet strength 0. Open the command prompt and type these commands: Open the command prompt and type these commands: python_embeded\python. 5 Install this extension via the ComfyUI Manager by searching for ComfyUI Impact Pack. ComfyUI Upscaling is best for a dozen or so Upscales alas would take all week to do 100+. That is using an actual SD model to do the upscaling that, afaik, doesn't yet exist in ComfyUI. Updated link to non deprecated version of efficiency nodes. Read our ComfyUI with an API guide to learn how. With it, I either can't get rid of visible seams, or the image is too constrained by low denoise and so lacks detail. Images are too blurry and lack of details, it's like upscaling any regular image with some traditional methods. 🔄 The Iterative Upscale node is another option, connected to 'Pixel KSampler Upscale' and the model's VAE for upscaling. This guide provides a comprehensive walkthrough of the Upscale pixel and Upscale latent methods, making it a valuable resource for those looking to enhance their image As you can see, in the interface we have the following: Upscaler: This can be in the latent space or as an upscaling model; Upscale By: Basically, how much we want to enlarge the image; Hires Upscaling with Automatic 1111 WebUI. Model Type: Super resolution; Model Stats: Number of The realistic model that worked the best for me is JuggernautXL even the base 1024x1024 images were coming nicely. Hey guys and gals, I got A LOT of dms about SUPIR so I made a full video on all of its settings. The upscaled images. If you want more details latent upscale is better, and of course noise injection will let more details in (you need noises in order to diffuse into details). Even with ControlNets, if you simply upscale and then de-noise latents, you'll get weird artifacts like the face in the bottom right instead of a teddy bear. example. Here is an example of how to use upscale models like ESRGAN. The Ultimate SD Upscale model is the most difficult choice in this whole process. After generating my images I usually do Hires. I'm looking for a workflow for ComfyUI that can take an uploaded image and generate an identical one, but upscaled using Ultimate SD Upscaling. I did some simple comparison 8x upscaling 256x384 to 2048x3072. 5 if you want to divide by 2) after upscaling by a model. This parameter does not have minimum, maximum, or default values, as it depends on the models available in your directory. 🎨 The LDSR upscaler is a new node in ComfyUI that can provide clearer images with adjustable steps for detail. 9, end_percent 0. latent upscale vs upscale model (ultrasharp×4) Share Add a Comment. info Website. Introduction. 0 reviews. Most of the workflows focus on upscaling with Ultimate SD Upscale or just plainly upscaling with model. Model Used: Flux model for upscaling; Unique Features: Compatible with low VRAM systems using the quantized GGUF version. RealESRGAN_x2plus. Upscale Model Examples. and I’m trying to use Juggernaut V8 as my SDXL model. 2024-06-13 11:00:00. Put them in the models/upscale_models folder then use the UpscaleModelLoader node to load them and the ImageUpscaleWithModel node to use them. 25 upscale. You signed out in another tab or window. I use SD mostly for upscaling real portrait photography so facial fidelity (accuracy to source) is my priority. 7k. Make sure you restart ComfyUI and Refresh your browser. 5, but I have some really old images I'd like to add detail to. 5 denoise. Created by: sk8583: In this workflow you can train your model for face model, swap it and upscale it for video and images. When you go high the the controls are relaxed and the denoising is increased intentionally to allow As such, it's NOT a proper native ComfyUI implementation, so not very efficient and there might be memory issues, tested on 4090 and 4x upscale tiled worked well for the upscale nodes. I hope it Place the Model in the models\unet folder, VAE in models\VAE and Clip in models\clip folder of ComfyUI directories. Other options would be Ultimate SD Upscale, which imo is the best upscaling option Created by: CgTopTips: Advanced Image Upscaling in ComfyUI Using Flux Flux Image Upscaling in ComfyUI is an invaluable tool for anyone looking to upscale images while preserving quality and delivering results quickly, making it perfect for use in both creative and production environments. now i have made a workflow that has a upscaler in it and it works fine only thing is that it upscales everything and that is not worth the wait with most outputs. It changes the image too much and often adds mutations. Open "Upscaling with model" is an operation with normal images and we can operate with corresponding model, such as 4x_NMKD-Siax_200k. If you are looking for upscale models to use you can find some on Since there are a lot of upscaling models one can use to upscale images, I thought you all might be interested in a way to compare these models, geared towards Art/Pixel Art Models. Upscayl will use the model file name to detect the scale that it supports. 0. My idea of this post was to provide a link four you to compare the results, so if you have a generated image you would like to upscale that you can do so with the upscaling model you liked best. attach to it a "latent_image" in this case it's "upscale latent" Upscale Image (using Model) node. If the model file name has 'x2' or '2x' in its name, Upscayl-NCNN will set the target resolution for upscaling accordingly. Running Ultimate SD Upscale with Python TLDR This tutorial video guides viewers through building a basic text-to-image workflow from scratch using ComfyUI, comparing it with Stable Diffusion's automatic LL. Have any of you guys worked with really small images to try to get a decent upscale? (in the 250 pixel range)? I assume most everything is 512 and higher based on SD1. For SD 1. py --auto-launch --listen --fp32-vae Latent upscale is different from pixel upscale. You can find many more upscale models at these links. The Upscale Image (using Model) node can be used to upscale pixel images using a model loaded with the Load Upscale Model node. These comparisons are done using ComfyUI with default node settings and fixed seeds. Really chaotic images or images that actually benefit from added details from the prompt can look exceptionally good at ~8. In this article, we’ll walk through the setup, features, and a detailed step-by-step guide on how to It's a 128px model so the output faces after faceswapping is blurry and low res. That plus how complicated the advanced KSampler is made latent too Upscaling without using ultimate upscale. Code; Issues 93; Pull requests 3; Discussions; Is there way to get ReActor output but with high resolution like 4K? what upscaling method should i use? Beta Was this translation helpful? Give feedback. pth or 4x_foolhardy_Remacri. Basic latent upscale, basic upscaling via model in pixel space, with tile controlnet, with sd ultimate upscale, with LDSR, with SUPIR and whatnot. Stable Diffusion model used in this demonstration is Lyriel. It covers adding checkpoint nodes, prompt sections, and generating images with a k-sampler. Final upscale is done using an upscale model. It seems that Upscayl only uses a upscaling model, so there is no difussion involved and the result will depend only on the upscaling model. Reload to refresh your session. Works fine but. exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-SUPIR\requirements. Is there a significant faster upscaler with good quality which I could use? Thanks! Fredsk Saved searches Use saved searches to filter your results more quickly You just have to use the node "upscale by" using bicubic method and a fractional value (0. You signed in with another tab or window. Took me 6 days to record but it was worth it (I think 😅) Try out fewjative/ultimate-sd-upscale, or run it with an API using our guide below. 😀 The tutorial introduces ComfyUI's Flux with LLM for image upscaling, focusing on a workflow that simplifies the process. I like doing a basic first pass latent upscale before that. In this tutorial, we will use ComfyUI to upscale stable diffusion images to any resolution we want! We will be using a custom node pack called "Impact", which comes with many useful nodes. In a base+refiner workflow though upscaling might not look straightforwad. For example, if you start with a 512x512 latent empty image, then apply a 4x model, apply "upscale by" 0. The video demonstrates how to integrate a large language model (LLM) for creative image results without adapters or control nets. Download some upscale models to get started, for example. upscale_model. ycyn jpx jhso ozff znvekr jxvi jhgyjl cpwhtg lvoa aaaq