#errors in serverless comfyUI flux handler.py

21 messages · Page 1 of 1 (latest)

quiet karma Dec 26, 2024, 9:56 AM

errors in serverless comfyUI flux handler.py

{
"delayTime": 7417,
"error": "HTTPConnectionPool(host='127.0.0.1', port=8188): Max retries exceeded with url: /prompt (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x722232303750>: Failed to establish a new connection: [Errno 111] Connection refused'))",
"executionTime": 63,
"id": "sync-6427227d-6994-4cab-89b2-53849b6eb767-e1",
"status": "FAILED",
"workerId": "t15g74kzgldm06"
}

@chrome shore

chrome shore Dec 26, 2024, 10:54 AM

quiet karma { "delayTime": 7417, "error": "HTTPConnectionPool(host='127.0.0.1', port=818...

What application is that maybe it's still loading?

quiet karma Dec 26, 2024, 11:05 AM

2024-12-26T11:04:37.644530056Z Total VRAM 45515 MB, total RAM 515599 MB
2024-12-26T11:04:37.644601359Z pytorch version: 2.5.1+cu124
2024-12-26T11:04:37.644608782Z Set vram state to: NORMAL_VRAM
2024-12-26T11:04:37.644819877Z Device: cuda:0 NVIDIA RTX A6000 : cudaMallocAsync
2024-12-26T11:04:38.237253231Z Starting RunPod handler...
2024-12-26T11:04:38.237305018Z --- Starting Serverless Worker | Version 1.7.7 ---
2024-12-26T11:04:38.237311091Z {"requestId": null, "message": "Jobs in queue: 1", "level": "INFO"}
2024-12-26T11:04:38.237319831Z {"requestId": null, "message": "Jobs in progress: 1", "level": "INFO"}
2024-12-26T11:04:38.237324554Z {"requestId": "sync-5b4eff3f-a7db-4156-80aa-52f4958a70ed-e1", "message": "Started.", "level": "INFO"}
2024-12-26T11:04:38.379521786Z {"requestId": "sync-5b4eff3f-a7db-4156-80aa-52f4958a70ed-e1", "message": "Finished.", "level": "INFO"}
2024-12-26T11:04:38.958188186Z Using pytorch attention

@chrome shore

it just failed like this

after running execution

there is error that it failed

0 matches
2024-12-26T11:14:54.333269485Z Total VRAM 45403 MB, total RAM 515598 MB
2024-12-26T11:14:54.333374856Z pytorch version: 2.5.1+cu124
2024-12-26T11:14:54.333981378Z Set vram state to: NORMAL_VRAM
2024-12-26T11:14:54.334718459Z Device: cuda:0 NVIDIA A40 : cudaMallocAsync
2024-12-26T11:14:54.395345117Z Starting RunPod handler...
2024-12-26T11:14:54.395400633Z --- Starting Serverless Worker | Version 1.7.7 ---
2024-12-26T11:14:54.395406166Z {"requestId": null, "message": "Jobs in queue: 1", "level": "INFO"}
2024-12-26T11:14:54.395411128Z {"requestId": null, "message": "Jobs in progress: 1", "level": "INFO"}
2024-12-26T11:14:54.395415661Z {"requestId": "477c2e15-afd8-4c81-a83e-a946a7f002f9-e1", "message": "Started.", "level": "INFO"}

2024-12-26T11:14:54.642921853Z Sending workflow: {
2024-12-26T11:14:54.642964713Z "prompt": {
2024-12-26T11:14:54.642970289Z "8": {
2024-12-26T11:14:54.642974653Z "class_type": "VAEDecode",
2024-12-26T11:14:54.642979522Z "inputs": [
2024-12-26T11:14:54.642983973Z {
2024-12-26T11:14:54.642988166Z "name": "samples",
2024-12-26T11:14:54.642993152Z "type": "LATENT",
2024-12-26T11:14:54.642997296Z "link": 24
2024-12-26T11:14:54.643001539Z },
2024-12-26T11:14:54.643005646Z {
2024-12-26T11:14:54.643009743Z "name": "vae",
2024-12-26T11:14:54.643013956Z "type": "VAE",
2024-12-26T11:14:54.643018139Z "link": 12
2024-12-26T11:14:54.643022436Z }
2024-12-26T11:14:54.643026646Z ],
2024-12-26T11:14:54.643031126Z "outputs": {}
2024-12-26T11:14:54.643035566Z },
2024-12-26T11:14:54.643040133Z "22": {
2024-12-26T11:14:54.643044576Z "class_type": "BasicGuider",
2024-12-26T11:14:54.643050456Z "inputs": [
2024-12-26T11:14:54.643054986Z {
2024-12-26T11:14:54.643059296Z "name": "model",
2024-12-26T11:14:54.643063818Z "type": "MODEL",
2024-12-26T11:14:54.643068013Z "link": 39,
2024-12-26T11:14:54.643072065Z "slot_index": 0
2024-12-26T11:14:54.643076635Z },
2024-12-26T11:14:54.643083911Z {
2024-12-26T11:14:54.643088133Z "name": "conditioning",
2024-12-26T11:14:54.643092583Z "type": "CONDITIONING",
2024-12-26T11:14:54.643096563Z "link": 40,
2024-12-26T11:14:54.643100821Z "slot_index": 1

2024-12-26T11:14:54.643468097Z {
2024-12-26T11:14:54.643472141Z "name": "images",
2024-12-26T11:14:54.643476140Z "type": "IMAGE",
2024-12-26T11:14:54.643480157Z "link": 9
2024-12-26T11:14:54.643484239Z }
2024-12-26T11:14:54.643488277Z ],
2024-12-26T11:14:54.643492389Z "outputs": {}
2024-12-26T11:14:54.643496597Z },
2024-12-26T11:14:54.643500594Z "6": {
2024-12-26T11:14:54.643504677Z "class_type": "CLIPTextEncode",
2024-12-26T11:14:54.643509579Z "inputs": [
2024-12-26T11:14:54.643513621Z {
2024-12-26T11:14:54.643517739Z "name": "clip",
2024-12-26T11:14:54.643521789Z "type": "CLIP",
2024-12-26T11:14:54.643525814Z "link": 10
2024-12-26T11:14:54.643530611Z }
2024-12-26T11:14:54.643534651Z ],
2024-12-26T11:14:54.643538694Z "outputs": {},
2024-12-26T11:14:54.643542734Z "widgets_values": [
2024-12-26T11:14:54.643546834Z "A beautiful mountain landscape at sunset"
2024-12-26T11:14:54.643551219Z ]
2024-12-26T11:14:54.643555196Z },
2024-12-26T11:14:54.643559333Z "11": {
2024-12-26T11:14:54.643563691Z "class_type": "DualCLIPLoader",
2024-12-26T11:14:54.643567691Z "inputs": {},
2024-12-26T11:14:54.643571771Z "outputs": {}
2024-12-26T11:14:54.643577943Z }
2024-12-26T11:14:54.643582113Z }
2024-12-26T11:14:54.643586726Z }

2024-12-26T11:14:54.643592436Z Error in handler: Failed to queue prompt: HTTPConnectionPool(host='127.0.0.1', port=8188): Max retries exceeded with url: /prompt (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7c02f631c690>: Failed to establish a new connection: [Errno 111] Connection refused'))
2024-12-26T11:14:54.643600446Z {"requestId": "477c2e15-afd8-4c81-a83e-a946a7f002f9-e1", "message": "Finished.", "level": "INFO"}
2024-12-26T11:14:55.783385559Z Using pytorch attention
2024-12-26T11:14:57.021718217Z ****** User settings have been changed to be stored on the server instead of browser storage. ******
2024-12-26T11:14:57.021752939Z ****** For multi-user setups add the --multi-user CLI argument to enable multiple user profiles. ******
2024-12-26T11:14:57.021803143Z [Prompt Server] web root: /app/ComfyUI/web
2024-12-26T11:14:57.302830977Z Import times for custom nodes:
2024-12-26T11:14:57.302836884Z 0.0 seconds: /app/ComfyUI/custom_nodes/websocket_image_save.py
2024-12-26T11:14:57.307489052Z Starting server
2024-12-26T11:14:57.307696191Z To see the GUI go to: http://0.0.0.0:8188

quiet karma Dec 26, 2024, 11:54 AM

Do I need to create a detailed handler.py file ?

In my github repo that I have linked with serverless pod

dockerfile, requirements.txt, handler.py, workflow,json

workflow.json is of flux.dev

quiet karma Dec 26, 2024, 11:55 AM

quiet karma 2024-12-26T11:14:54.643592436Z Error in handler: Failed to queue prompt: HTTPCon...

After this error

I added sleep timing and a check if comfy server is ready or not

then it outputs a new error

2024-12-26T11:37:53.482892830Z Error in handler: Failed to queue prompt: Failed to queue prompt: {"error": {"type": "prompt_outputs_failed_validation", "message": "Prompt outputs failed validation", "details": "Required input is missing: filename_prefix\nRequired input is missing: images", "extra_info": {}}, "node_errors": {"9": {"errors": [{"type": "required_input_missing", "message": "Required input is missing", "details": "filename_prefix", "extra_info": {"input_name": "filename_prefix"}}, {"type": "required_input_missing", "message": "Required input is missing", "details": "images", "extra_info": {"input_name": "images"}}], "dependent_outputs": ["9"], "class_type": "SaveImage"}}}

chrome shore Dec 26, 2024, 12:32 PM

your workflow