Thank you for showing us how to set up this method of cloud computing. You have an excellent way of explaining the method. Good luck to you and your channel!
Just what I needed! Once that I need to delete my instance and pick up my work the next day, is there a way of saving my data and pick up where I left later in another instance?
You need to synchronise with Dropbox or Blackblaze. Last time I checked with Google Drive did not work. You can always stop the instance, but you have to pay full price, unfortunately. Alternatively, you can transfer files from a local computer via SSH or use another cheaper instance for storage, but then you depend on the owner of the instance.
@@koalanation short catch-up -> used it multiple times now + adapted your script and it works like a charm. Thank you very much for the video, as without it I would either have spended way more time setting it up or even have given it up before getting it to work.
Thanks for this! I want to set up a ComfyUI API instead, so I can send a request from another server and retrieve the generated images, how would you recommend me doing this?
This is a little beyond my expertise. I have seen a tutorial for stable diffusion A1111 with endpoints for runpod. Maybe you want to look at it to get some ideas how to do it for comfyui.
Hi! I am not a technical person, not sure of what your question is. In vast.ai there is some documentation about API. I understand access to the VM can be done via SSH/SCP but I just simply download the requirements via git clone and wget, and use jupyterlab to upload/download from my local machine . Access to Google/drive and Dropbox is possible, but I have not used it. Sorry I cannot help more.
Hi! It works for me...🤔 Anyways, I think I may need to update it. To begin, you can use more general templates, new versions of pytorch, etc...I think it is also valuable to connect to have the models/files in backblaze and sync it, instead of downloading everything every time. Takes the same time, but at least you keep the work....
Thanks! I think it should be possible to make a jupyter notebook from the script. I tried at some moment but I had some issues and decided it was faster to directly just copy and paste the script in the terminal. I have the code in a Google Docs document, which I use every time I want to use vast.ai
In the script the manager should be installed. Anyway, follow the instructions in the GitHub: From the ComfyUI folder 1- cd custom_nodes 2- git clone github.com/ltdrdata/ComfyUI-Manager.git 3- Restart ComfyUI
Unfortunately, using vast.ai, you need to run the script everytime. With other services, like runpod, you can have permanent storage and then you do not need to download all nodes and models everytime.
If you destroy your instance at the end of the work to keep the costs low, yes. Alternatives are to using your cloud storage or to create your own docker container with the basic models and nodes you normally use. Instead of the fast template, you can use the pytorch template.
@@AIWarper if you are using a 'base' of models and nodes and not changing many things, I think it should not be very difficult to create an image, if you know how to use docker. I have not done it myself, though. If you like to try things and you have good reference workflows, I think the fastest is to only install ComfyUI and ComfyUI manager, then use the install missing nodes feature from the manager, and install the models with the manager too. But yes, the cheapest solution may not be optimal if you want not to run these scripts anytime.
Thank you for showing us how to set up this method of cloud computing. You have an excellent way of explaining the method. Good luck to you and your channel!
Thanks to you for watching!
Just what I needed! Once that I need to delete my instance and pick up my work the next day, is there a way of saving my data and pick up where I left later in another instance?
You need to synchronise with Dropbox or Blackblaze. Last time I checked with Google Drive did not work. You can always stop the instance, but you have to pay full price, unfortunately.
Alternatively, you can transfer files from a local computer via SSH or use another cheaper instance for storage, but then you depend on the owner of the instance.
Thank you :) I got it working with the pytorch version!
Excellent! Have fun
@@koalanation short catch-up -> used it multiple times now + adapted your script and it works like a charm. Thank you very much for the video, as without it I would either have spended way more time setting it up or even have given it up before getting it to work.
@@TheFusssi good to hear!
Stable diffusion fast is missing from the template
Try with the pytorch template.
Thanks for this! I want to set up a ComfyUI API instead, so I can send a request from another server and retrieve the generated images, how would you recommend me doing this?
This is a little beyond my expertise. I have seen a tutorial for stable diffusion A1111 with endpoints for runpod. Maybe you want to look at it to get some ideas how to do it for comfyui.
how can i have an api to this set up to access it externally
Hi! I am not a technical person, not sure of what your question is. In vast.ai there is some documentation about API. I understand access to the VM can be done via SSH/SCP but I just simply download the requirements via git clone and wget, and use jupyterlab to upload/download from my local machine . Access to Google/drive and Dropbox is possible, but I have not used it. Sorry I cannot help more.
Greate Video, Thanks
i could not find the template you are referring to
Use the pytorch template
can you share scripts again? pastebin is not working.
Hi! It works for me...🤔 Anyways, I think I may need to update it. To begin, you can use more general templates, new versions of pytorch, etc...I think it is also valuable to connect to have the models/files in backblaze and sync it, instead of downloading everything every time. Takes the same time, but at least you keep the work....
owesome :)
Thanks! I am glad you liked it
Great tutorial, do you think it's possible to edit the template for it to automatically install comfyui with the user going into Jupiter?
Thanks!
I think it should be possible to make a jupyter notebook from the script. I tried at some moment but I had some issues and decided it was faster to directly just copy and paste the script in the terminal. I have the code in a Google Docs document, which I use every time I want to use vast.ai
why i don't have manager in your interface?
In the script the manager should be installed. Anyway, follow the instructions in the GitHub:
From the ComfyUI folder
1- cd custom_nodes
2- git clone github.com/ltdrdata/ComfyUI-Manager.git
3- Restart ComfyUI
Do i need to install the plugin and all each time i run it
Unfortunately, using vast.ai, you need to run the script everytime. With other services, like runpod, you can have permanent storage and then you do not need to download all nodes and models everytime.
@koalanation what about google colab ? Whos better
@@saberkz with Collab I think the best thing is you can easily connect and mount Google drive. For the price others are typically cheaper.
Is the choise of the preprocessor / cpu important?
To be frank, I am not sure. I try to use what is available and so far my needs are covered
Do you have to do this literally every time you launch? Also, there is no "fast" template anymore
If you destroy your instance at the end of the work to keep the costs low, yes. Alternatives are to using your cloud storage or to create your own docker container with the basic models and nodes you normally use.
Instead of the fast template, you can use the pytorch template.
@@koalanation how would I go about the latter (creating the docker)?
@@AIWarper if you are using a 'base' of models and nodes and not changing many things, I think it should not be very difficult to create an image, if you know how to use docker. I have not done it myself, though.
If you like to try things and you have good reference workflows, I think the fastest is to only install ComfyUI and ComfyUI manager, then use the install missing nodes feature from the manager, and install the models with the manager too. But yes, the cheapest solution may not be optimal if you want not to run these scripts anytime.
i wonder if its possible to get this to run on krita
There is a guide with a Krita template for runpod or vast.ai: github.com/Acly/krita-ai-diffusion/wiki/Cloud-GPU
Never tried, though