Cool video but Ollama sucks lemons....ON both my intel Macbook Pro and win10 Intel Arc A770 16GB, 64GB DDR4 RAM, 5000TB 7400MB/sec ssd system. But that's cuz I choose Arc, but hey, if you have Nvidia and M1 to M3 it shoudlwork fine. Regarding LLama3.2, they are great, downloading thme from Hugginface with a cusotm python script.
thanks for the tutorial, everything else works except the chatflow which says "fetch failed" when I try to prompt it. The document side works and retrieves the 4 most relevant documents. What could be the problem?
Thank you so much Loe, You videos are crisp and clear. I have created a chatbot, as shown in the video, using LLaMA and configured it on my VM. The chatbot has memory and is responding to questions as expected. However, the problem I am facing is that the bot takes a lot of time to load and respond to each query. I have already built a chatbot with OpenAI, and while it was a different approach, I didn’t encounter this kind of slowness. Anybody faced this issue? Do you have any solution for this?
I have created a chatbot, as shown in the video, using LLaMA and configured it on my VM. The chatbot has memory and is responding to questions as expected. However, the problem I am facing is that the bot takes a lot of time to load and respond to each query. I have already built a chatbot with OpenAI, and while it was a different approach, I didn’t encounter this kind of slowness. Anybody faced this issue? Do you have any solution for this?
@@msclt1982 it might be because Ollama3.2 is local and OpenAI is likely hosted, accessible via API key; so, your machine's hardware specs may be its Achilles heel.I'll know for sure when I try it out.
Thank you Leon another amazing FW tutorial -unfortunatelly the hallucination issues using RAG still an issue not something you can use in PROD unfortunatelly - looking fwd to next FW video 'dankie Leon'
@@leonvanzyl If you allow me to answer that question :) A video covering Flowise + a knowledge graph would be great! This would reduce LLM hallucinations as well
Flowise invite? It's free, and we used the free version in this video. If you're referring to their paid cloud service then you can skip the waiting list by using my affiliate link.
@@leonvanzyl In die Chatflow Chat Screen as ek Clear Chat druk kry ek 'Error: chatMessagesService.removeAllChatMessages - SQL_READONLY: attempt to write a readonly database'
@@leonvanzyl Dankie ek like jou channel ook 🦊. As ek 'Clear Chat' druk kry ek : Error: 'chatMessagesService.removeAllChatMessages - SQLITE_READONLY: attempt to write a readonly database'
Outstanding! I have set up a knowledge base of data and information collected by forestry company and want to extract relevant information for annual reports. Is there a way to create a flowiseAI with a template of queries that I could run to populate the annual report? Thanks again!
Thanks Leo, great tutorial. It does a wonderful job. Please can you make a video where the chatbot has the option to save the conversation history and export it as a PDF or TXT or DOCX file.
2 หลายเดือนก่อน +2
Thank you. Any chance doing the video how to deploy this and use it in the cloud or on a website?
I got it working locally, nice video thank you so much for showing this. I wonder though how could I embed this into a product? Seems that I have to at least run a node server to run the chatbot?
I am trying to download and set up the Ollama environment, which includes running the llama3.2 model-a file size of approximately 42GB. Given that Ollama operates its models locally, it does not require an active internet connection once the setup is complete. My questions are: Website Integration: After successfully setting up Ollama on my system, how can I configure and connect the chatbot to a website for real-time interaction? Offline Configuration: For environments with no internet access, how can I customize and deploy a chatbot effectively using Ollama? The aim is to ensure smooth functionality both for online website integration and in fully offline scenarios.
Websites will not be able to access Ollama on your local machine. You'll have to host it in the cloud (which can be quite expensive), or use services like Groq, HuggingFace, Replicate, etc.
@@leonvanzyl are you saying I can’t run the chatbot on a local server within a LAN environment? 🤔 Additionally, if hosting on the cloud is too expensive for me, how can I integrate the chatbot with my website to make it accessible to clients?
Hi Leon,love this video as a coding noob looking to create an ai enterprise app for a business. Is it possible using this method. And if so how can this be embedded into that product
Very useful. Thanks. Is it possible to automate document loading (as new docs become available), for example by running a script or copying files into a folder etc, or it has to be manually done everytime through the UI as you demonstrated? Thanks.
I think you can run this on a potato. Seriously, we tested the model on a 10 year old Acer Spin with an i3 processor, and onboard graphics, and it works.
I have a video on my channel that shows how to add Flowise chatbots to websites. Obviously you won't be able to use a local instance of Flowise for that, so you could either self host Flowise or use their cloud service. Instead of using Ollama, use the Groq Chat node instead.
Thank you so much Loe, You videos are crisp and clear. I have created a chatbot, as shown in the video, using LLaMA and configured it on my VM. The chatbot has memory and is responding to questions as expected. However, the problem I am facing is that the bot takes a lot of time to load and respond to each query. I have already built a chatbot with OpenAI, and while it was a different approach, I didn’t encounter this kind of slowness. Anybody faced this issue? Do you have any solution for this?
@@leonvanzyl wow I didnt expect a quick response from you. Thats great. :). Anyway iam using an Azure VM, and already checked this approach, and the bot functionality improved after increase the vm cpu and ram. Thank you so much.
Great video! But I have a problem, the chatbot doesn't always respond, or I see the response when I close and reopen the window, what could be happening?
Hi Leon, Thank you so much for all the work you’re doing-it’s greatly appreciated! I’ve just become one of your subscribers and I’m really looking forward to your tutorials. I have a question that’s been driving me a bit crazy: Is it possible to implement a chatflow developed in FlowiseAI to work with the frontend of OpenWebUI? I tried to create a pipeline and uploaded it to OpenWebUI but couldn’t get it to work. Is this achievable? Thanks again!
As a follow-up, I was also wondering about integrating a chatflow developed in N8N. I feel that combining the power of N8N or Flowise with OpenWebUI would be incredibly powerful to leverage their awesome UI capabilities.
Thanks for the sub 💪. I don't think there is a way to add Flowise to Open Web UI. May I ask why you would want to use Web UI instead of the Flowise/ Chatflow UI?
@@leonvanzyl Thanks for getting back to me! I thought the Web UI might offer more flexibility for managing user permissions (but I could be wrong!). My idea is to leverage Flowise’s power to build the chatflow logic and then use WebUI to manage access and provide a more polished frontend experience for users. Does that sound like a good approach, or do you think I’m missing something?
Thanks for the video and setup. With OpenAI, I get it to run great. However... when I try to use the Conversational Retrieval QA Chain or Conversation Chain node in combination with ChatOllama, I get a "fetch failed" error (whatever model I use). When I run Ollama (+ model) with a regular LLM Chain node, it functions as well - but obviously no RAG here. Too bad... Has anyone any idea?!? I would appreciate that very much!!!
Is it possible to use LLaVA with ollama to have the client upload a photo and the model can view it? I know it does'nt have the option, like how openAI has.. but maybe you know a work around?
Amazing. Thanks for the content. Is it possible to take this bot elsewhere? Say if I ever wanted to have a bot like this on an app like Slack or Discord?
when i type something in the chat box i get the error Fetch Failed. Do you know how to fix this issue? I searched the web got a suggestion to reinstall ollama but still the issue persists.
very good explanations here. thank youuu.. can i ask whats the minimum hardware requirements to run these locally? do we need a tensor chip and cuda gpu, how much vram gpu, and pc ram for this ?
Well, for files with 1 KB it's awesome. When you load files with let's say 20 MB, the embedding doesn't work. Maybe it's the Ollama computer. Trying to find out.
Interested. I'll actually follow up on this. I've personally loaded some massive docs IRL and haven't experienced issues. Did you remember to split that doc?
@@leonvanzyl Yes I did. I alwasy do with REcursive Character Splitter (Showing 1-50 of 124 chunks 76.210 characters). And I had to use For the Upsert, Voayage embeddings and Faiss. I cuoldn't make it with Ollama Embedding because my PC CPU and memory couldn't handle it. Although it has a NPU. This is something Ollama has to work on. How to run Ollama with NPU instead of CPU and Memory.
@@leonvanzyl I have the same issue as the original commenter. I have uploaded a 600 something kb pdf and it can't return any answers. I followed your instructions to the letter. The only difference is that i have used the smaller llama3.2:1B model. All i get is "Hmm... I'm Not sure" answer from the bot. Any advice would be greatly appreciated! My intention is to create a document chat bot for documents to summarize and extract data from larger files.
looks really nice but coulndnt instal flowise, i get " Cannot find module 'colorspace" error when try to start npx. hope i will find some help on the web. thanks anyway !
Great video, I'm doing a training but the text I'm using is in txt format and is very large, sometimes the questions have answers that make sense and other times they don't. Do you have any tips?
You'll need an internet connection to download the models from Ollama. There's probably a way to drop a model into the Ollama folder, but I haven't tried that yet
@@leonvanzyl I copied the files to the offline pc and restarted, it worked. Thank you. One more question - is there a way to install flowise offline? File copy isn't working in case of flowise
I followed the instructions to create a chatbot, but its response time is very slow and delayed. Compared to the BotPress chatbot, it is noticeably less responsive. Could this be due to a missing configuration or an overlooked step?
Hey nice video leon....but in my Rag chatbot I am using a tool agent and I need to pass the context which I have embedded in vector db in chat prompt template so that the agent can analyse whether the question is related to the docs provided or context provided ....how can I pass it?....i just want my chatbot not to give answers for unrelated questions. can you please help me with this
@@RajuK-mn6lk actually it requires high computational power. So i just dropped the idea of using Flowise. Instead of it you can do the same thing through coding. New library has been launched of generative AI. Use it and ta da.
Somethings missing from the process "AppData\Roaming pm ode_modules\flowise\dist\commands\start.js: Cannot find module 'langchainhub'", how to get? Pip doenst work on windows.
I had to separately install langchain and langchainhub using: npm install -S langchain npm install -S langchainhub If there are further issues, I had to: npm audit fix npm audit fix --force
Knew if there is one place to come to get help its here !! Leon need help connecting a multimodal model from ollama in flowise for text and images do you have a video about that I looked but can't find one 😢
I doubt you can build multi-agent apps, or agentic rag solutions, with those platforms 😊 . HEHE, seriously though - Flowise allows for some way more advanced AI solutions than those interfaces.
Subscribed and Liked. :-) This is really helpful and simple, something I really wanted to learn and set up. thanks a lot, I have set up the chatbot for my pdf repository, but is there a way to pull just the chatbot something like ollama openwebui chat, what I mean is- once we set it up in flowise, as I see I open locathost on port 3000 it takes me to the flowise page and then I click on the chatbot , the whole chat flow is shown there then I have to click chat icon to initiate a chat , is there a way to setup an url:port I can put on browser and it lands me directly on the web UI showing me this flowise chatbot that I configured.
Hey there! I have plenty of videos on my channel related to deploying Flowise and embedding it into websites. Ollama is meant for running the models locally, but in the cloud you could use Groq to run open source models for free. Again, I have videos on using Groq as well 😊
Thanks for the video Leon! When making chatbots for clients, do you encounter any cybersecurity concerns? for example, i could imagine clients worrying about using a third-party script on their website, because it could be vulnerable to XSS attacks, user privacy issues etc. Would like to hear your (or someone else's thoughts on this)
Good question. I've had to create some custom integrations for clients where all sorts of security and Auth systems are in place. I feel that Flowise provides enough flexibility in the platform, especially when using their APIs and the new SDKs, to build whatever you want within the requirements from the client.
@@leonvanzyl other people on Github had the same issue but I was able to fix it I switched to Node.js version 18.20.4 and Instead of installing it in my Documents or Downloads folder, I created a new folder directly in my root directory at ~/User/AI/, which helped avoid permission issues. After navigating to the folder in terminal, I ran npm install -g flowise and that did the trick!
Hi Leon, I was try your way to create AI chatbot, the only problem I'm not able to load a document bro, I used win machine. is there a way that you can help here?
If I'm not mistaken you can use the folder or file loader for that. That is a massive file though, so you might want to clean up that data first, to text only, before uploading it.
Hello sir I got the following error while loading the database Oh snap! The following error occured when loading this page. Status: 500 Error: documentStoreServices.insertIntoVectorStore - Error: documentStoreServices._insertIntoVectorStoreWorkerThread - Error: Could not import faiss-node. Please install faiss-node as a dependency with, e.g. npm install -S faiss-node. Error: Could not locate the bindings file.
I got a similar error: Error: documentStoreServices.insertIntoVectorStore - Error: documentStoreServices._insertIntoVectorStoreWorkerThread - Error: ENOENT: no such file or directory, mkdir 'C:\Users\danie\sentience\"C:\Users\danie\OneDrive\Desktop\faiss"' It looks like the path is appended to the current folder where I built Flowise, in the sentience folder. Yes, I just replaced the path, including the double quotes, with 'faiss' and it worked!
its not free. you get a 14 day trial then you pay $35/mo for 10k predictions/mo to use your agent. am i wrong or does it clearly state that in the PRICING page
Nope, it's free and open source. Follow the instructions in the Flowise section of the video to set it up on your machine. What you're referring to is their managed cloud service which is definitely not needed.
Nope. I did not get paid by Flowise, Meta or Ollama for this video. It wasn't created with their knowledge or permission either. I'm always blown away by comments like this. These videos are a lot of effort to create. Dude, I would happily accept a sponsorship deal if it means funding the channel, allowing me to create more videos. So even if the videos WERE sponsored, decide whether the content is for you and move on.
dear leaon , im getting this error , appreciate if you can help me fix it , my environment C:\gnLAMA>node -v v20.18.1 and flowise same as yours : C:\gnLAMA>npx flowise start 2024-11-24 20:30:46 [INFO]: Starting Flowise... 2024-11-24 20:30:46 [INFO]: 📦 [server]: Data Source is initializing... 2024-11-24 20:30:51 [ERROR]: ❌ [server]: Error during Data Source initialization: SQLITE_ERROR: no such column: ChatFlow.isPublic QueryFailedError: SQLITE_ERROR: no such column: ChatFlow.isPublic at handler (C:\gnLAMA ode_modules\typeorm\driver\sqlite\SqliteQueryRunner.js:88:37) at replacement (C:\gnLAMA ode_modules\sqlite3\lib\trace.js:25:27) at Statement.errBack (C:\gnLAMA ode_modules\sqlite3\lib\sqlite3.js:15:21) 2024-11-24 20:30:51 [INFO]: ⚡ [server]: Flowise Server is listening at :3000
Hi Leon , Thank you for sharing this clip. It is very useful for me. Now I was encountering the issues after upsert at Flowise even I was using Ubuntu 24.04 and having /home/myname/vector path" 0Error: documentStoreServices.insertIntoVectorStore - Error: documentStoreServices._insertIntoVectorStoreWorkerThread - Error: Request to Ollama server failed: 404 Not Found". Please give me some advice. Banatus
i stuck at Faiss ..but got this error tus: 500 Error: documentStoreServices.insertIntoVectorStore - Error: documentStoreServices._insertIntoVectorStoreWorkerThread - Error: Request to Ollama server failed: 404 Not Found
@@leonvanzyl having the same issue. (posted above in the comments). Ollama is up to date and running fine otherwise. I also successfully upserted vectors to faiss with Ollama embeddings with small documents but if you using larger documents it fails constantly. As workaround is it possible to use different embeddings with Ollama models?
What do you think about the new Llama 3.2 models?
Remember to hit the like button and subscribe to boost the video in the YT algorithm.
Awesome video! Thanks, Leon. I was wondering if we could use Llama 3.2 models in the sequential multiagent chatflow?
Cool video but Ollama sucks lemons....ON both my intel Macbook Pro and win10 Intel Arc A770 16GB, 64GB DDR4 RAM, 5000TB 7400MB/sec ssd system. But that's cuz I choose Arc, but hey, if you have Nvidia and M1 to M3 it shoudlwork fine. Regarding LLama3.2, they are great, downloading thme from Hugginface with a cusotm python script.
thanks for the tutorial, everything else works except the chatflow which says "fetch failed" when I try to prompt it. The document side works and retrieves the 4 most relevant documents. What could be the problem?
@leonvanzyl
fetch failed is the error message in chat window
Thank you so much Loe, You videos are crisp and clear. I have created a chatbot, as shown in the video, using LLaMA and configured it on my VM. The chatbot has memory and is responding to questions as expected. However, the problem I am facing is that the bot takes a lot of time to load and respond to each query. I have already built a chatbot with OpenAI, and while it was a different approach, I didn’t encounter this kind of slowness. Anybody faced this issue? Do you have any solution for this?
I really love your videos! I would really love to see an in-depth video of you comparing Langflow, Flowise, n8n, VectorShift, etc!
Great Leon !!! Thanks for the tutorial, very simple and work fine ! 🏅🏆🎖
You're welcome 🤗
Very nice, I followed the guide and worked just fine. Thanks a lot for the detailed tutorial. I generated some document data samples with Claude :D
Great to hear!
I have created a chatbot, as shown in the video, using LLaMA and configured it on my VM. The chatbot has memory and is responding to questions as expected. However, the problem I am facing is that the bot takes a lot of time to load and respond to each query. I have already built a chatbot with OpenAI, and while it was a different approach, I didn’t encounter this kind of slowness. Anybody faced this issue? Do you have any solution for this?
@@msclt1982 it might be because Ollama3.2 is local and OpenAI is likely hosted, accessible via API key; so, your machine's hardware specs may be its Achilles heel.I'll know for sure when I try it out.
exactly what I thought to do too, likely via Bolt
Great tutorial Leon!! I reached out to your email about a sponsor opportunity. Cheers!
Saw the mail. Thank you. Will respond soon.
Amazing tutorial, exactly what I was looking for!
You're welcome 🤗
Wow, I think this is an advantage for the developers and the geeks.
It's awesome.
Thanks for the walkthrough video
You're welcome 🤗
Fantastic tutorial! Exactly what I needed. Chrome's AI generated results referenced you on this topic, lol
For real!? Haha, that's awesome 😎
It is amazing. Great effort and very usefull. Thanks alot
Thank you Leon another amazing FW tutorial -unfortunatelly the hallucination issues using RAG still an issue not something you can use in PROD unfortunatelly - looking fwd to next FW video 'dankie Leon'
Glad you liked it!
Let me know what you'd like me to cover next 👍
@@leonvanzyl If you allow me to answer that question :) A video covering Flowise + a knowledge graph would be great! This would reduce LLM hallucinations as well
Thank you so much for this video it is just what I needed
you made my life complete :P with love
Hehe, glad I could help 😀
Brilliant video as always 👏🏼
Thanks for the content!
Great video. Standing by for my Flowise invite - would love to see "How to Fine Tune llama 3.2"
Flowise invite?
It's free, and we used the free version in this video.
If you're referring to their paid cloud service then you can skip the waiting list by using my affiliate link.
Do you have a graph rag workflow?
Not yet. Will create one soon 😄
@@leonvanzyl Lekker, looking forward to it :).
Thank you Leon for the detailed explanations, Just need to know is there a bug Clearing Chat History or am I missing something
Hey Jakkalsvibes (I like your channel by the way 🔥).
I'm not aware of any issues. What's issue are you experiencing?
@@leonvanzyl In die Chatflow Chat Screen as ek Clear Chat druk kry ek 'Error: chatMessagesService.removeAllChatMessages - SQL_READONLY: attempt to write a readonly database'
@@leonvanzyl Dankie ek like jou channel ook 🦊. As ek 'Clear Chat' druk kry ek : Error: 'chatMessagesService.removeAllChatMessages - SQLITE_READONLY: attempt to write a readonly database'
@@leonvanzylsorted
Outstanding! I have set up a knowledge base of data and information collected by forestry company and want to extract relevant information for annual reports. Is there a way to create a flowiseAI with a template of queries that I could run to populate the annual report? Thanks again!
Thanks Leo, great tutorial. It does a wonderful job. Please can you make a video where the chatbot has the option to save the conversation history and export it as a PDF or TXT or DOCX file.
Thank you. Any chance doing the video how to deploy this and use it in the cloud or on a website?
Ty! Can you do a tutorial on how you can host and deploy a lead generation chatbot on a website?
Thanks!
Sorry, found it on your channel already!
Great idea! Where on this channel can you find the website deployment solutions?
I got it working locally, nice video thank you so much for showing this. I wonder though how could I embed this into a product? Seems that I have to at least run a node server to run the chatbot?
Dear sir, did you manage to deploy this wonderful solution onto a server to serve the public?
I am trying to download and set up the Ollama environment, which includes running the llama3.2 model-a file size of approximately 42GB. Given that Ollama operates its models locally, it does not require an active internet connection once the setup is complete.
My questions are:
Website Integration: After successfully setting up Ollama on my system, how can I configure and connect the chatbot to a website for real-time interaction?
Offline Configuration: For environments with no internet access, how can I customize and deploy a chatbot effectively using Ollama?
The aim is to ensure smooth functionality both for online website integration and in fully offline scenarios.
Websites will not be able to access Ollama on your local machine.
You'll have to host it in the cloud (which can be quite expensive), or use services like Groq, HuggingFace, Replicate, etc.
Also, there are smaller versions of Llama 3.2 (like the 3b model).
@@leonvanzyl are you saying I can’t run the chatbot on a local server within a LAN environment? 🤔
Additionally, if hosting on the cloud is too expensive for me, how can I integrate the chatbot with my website to make it accessible to clients?
Take a sip of every time he says go ahead
🤣 SirSalter, go ahead and have a sip
Hi Leon,love this video as a coding noob looking to create an ai enterprise app for a business. Is it possible using this method. And if so how can this be embedded into that product
Very useful. Thanks. Is it possible to automate document loading (as new docs become available), for example by running a script or copying files into a folder etc, or it has to be manually done everytime through the UI as you demonstrated? Thanks.
This would be really useful
Just watch his n8n tutorials, there he made with google docs.
Sure...look at the source code and integrate it. Oh wait, it's done via Flowise.....
@@AaronBlox-h2t limitations of no-code/low-code
Thank you for the video. What are the minimal system requirements to run all of this on PC?
I think you can run this on a potato.
Seriously, we tested the model on a 10 year old Acer Spin with an i3 processor, and onboard graphics, and it works.
thank you for this video, please hox can i add it to a website ?
I have a video on my channel that shows how to add Flowise chatbots to websites.
Obviously you won't be able to use a local instance of Flowise for that, so you could either self host Flowise or use their cloud service.
Instead of using Ollama, use the Groq Chat node instead.
How can you setup a vision model to read from a pdf.
I get fetch error for any prompts in the chat? what could be the issue?
I had this issue too, but after upgrading the node to version 20.18 , it works properly
@@damirrekic4271 you are right
Is flowise collecting any info (resources based on metadata and namespaces) that could potentially extract private information?
No, you can literally disconnect your internet connection and run this solution fully local.
Thank you so much Loe, You videos are crisp and clear. I have created a chatbot, as shown in the video, using LLaMA and configured it on my VM. The chatbot has memory and is responding to questions as expected. However, the problem I am facing is that the bot takes a lot of time to load and respond to each query. I have already built a chatbot with OpenAI, and while it was a different approach, I didn’t encounter this kind of slowness. Anybody faced this issue? Do you have any solution for this?
Your VM might need some more horsepower
@@leonvanzyl wow I didnt expect a quick response from you. Thats great. :). Anyway iam using an Azure VM, and already checked this approach, and the bot functionality improved after increase the vm cpu and ram. Thank you so much.
how can we ollama 11b model move avilable models?
Great video! But I have a problem, the chatbot doesn't always respond, or I see the response when I close and reopen the window, what could be happening?
Hi Leon,
Thank you so much for all the work you’re doing-it’s greatly appreciated! I’ve just become one of your subscribers and I’m really looking forward to your tutorials. I have a question that’s been driving me a bit crazy: Is it possible to implement a chatflow developed in FlowiseAI to work with the frontend of OpenWebUI? I tried to create a pipeline and uploaded it to OpenWebUI but couldn’t get it to work. Is this achievable?
Thanks again!
As a follow-up, I was also wondering about integrating a chatflow developed in N8N. I feel that combining the power of N8N or Flowise with OpenWebUI would be incredibly powerful to leverage their awesome UI capabilities.
Thanks for the sub 💪.
I don't think there is a way to add Flowise to Open Web UI.
May I ask why you would want to use Web UI instead of the Flowise/ Chatflow UI?
@@leonvanzyl Thanks for getting back to me! I thought the Web UI might offer more flexibility for managing user permissions (but I could be wrong!). My idea is to leverage Flowise’s power to build the chatflow logic and then use WebUI to manage access and provide a more polished frontend experience for users. Does that sound like a good approach, or do you think I’m missing something?
Thanks for the video and setup. With OpenAI, I get it to run great. However... when I try to use the Conversational Retrieval QA Chain or Conversation Chain node in combination with ChatOllama, I get a "fetch failed" error (whatever model I use). When I run Ollama (+ model) with a regular LLM Chain node, it functions as well - but obviously no RAG here. Too bad...
Has anyone any idea?!? I would appreciate that very much!!!
Is it possible to use LLaVA with ollama to have the client upload a photo and the model can view it? I know it does'nt have the option, like how openAI has.. but maybe you know a work around?
thanks for the hard work. however how do we able to "export" the chat bot into a single site instead have to start with the chat bubble?
Amazing. Thanks for the content. Is it possible to take this bot elsewhere? Say if I ever wanted to have a bot like this on an app like Slack or Discord?
Thanks Leon, another great tutorial. What is the minimum hardware requirements to run this setup?
I think you can run this on a potato 🤣.
Seriously, I managed to get this running on an 5 year old i3 laptop with an onboard GPU.
@@leonvanzyl maybe the lack of nvidia gpu? mine is an AMD, because here I didn´t get it to answer so far.
I´ve found the issue. It was the way I wrote the ollama server address, it worked 127.0.0.1:11434/ this way instead of localhost
when i type something in the chat box i get the error Fetch Failed. Do you know how to fix this issue? I searched the web got a suggestion to reinstall ollama but still the issue persists.
Getting same issue. do you find anyway to resolve it?
Hi, in Base URL enter 127.0.0.1:11434
very good explanations here. thank youuu.. can i ask whats the minimum hardware requirements to run these locally? do we need a tensor chip and cuda gpu, how much vram gpu, and pc ram for this ?
This model is tiny (like 2GB). It should run on a potato 😄
@@leonvanzyl 🤣🤣🤣🤣🤣🤣🤣 i adored this answer.. thank youuu 🤘🤘
How can I use more than two document stores at the same time? If I can only use one document store card (vector)?
Absolutely!
I would use a tool agent and attach two retriever tools.
@@leonvanzyl please! Could you show in a video how to do it?
Well, for files with 1 KB it's awesome. When you load files with let's say 20 MB, the embedding doesn't work. Maybe it's the Ollama computer. Trying to find out.
Interested. I'll actually follow up on this.
I've personally loaded some massive docs IRL and haven't experienced issues.
Did you remember to split that doc?
@@leonvanzyl Yes I did. I alwasy do with REcursive Character Splitter (Showing 1-50 of 124 chunks 76.210 characters). And I had to use For the Upsert, Voayage embeddings and Faiss. I cuoldn't make it with Ollama Embedding because my PC CPU and memory couldn't handle it. Although it has a NPU. This is something Ollama has to work on. How to run Ollama with NPU instead of CPU and Memory.
@@leonvanzyl I have the same issue as the original commenter. I have uploaded a 600 something kb pdf and it can't return any answers. I followed your instructions to the letter. The only difference is that i have used the smaller llama3.2:1B model. All i get is "Hmm... I'm Not sure" answer from the bot. Any advice would be greatly appreciated! My intention is to create a document chat bot for documents to summarize and extract data from larger files.
i have a issue with MSSQL Server i have trying to get data from another mssql server machine kindly make a small video of this
looks really nice but coulndnt instal flowise, i get " Cannot find module 'colorspace" error when try to start npx. hope i will find some help on the web. thanks anyway !
Great video, I'm doing a training but the text I'm using is in txt format and is very large, sometimes the questions have answers that make sense and other times they don't. Do you have any tips?
How can I set it up on a workstation which doesn't have internet? How to download the models for offline installation?
You'll need an internet connection to download the models from Ollama.
There's probably a way to drop a model into the Ollama folder, but I haven't tried that yet
@@leonvanzyl I copied the files to the offline pc and restarted, it worked. Thank you. One more question - is there a way to install flowise offline? File copy isn't working in case of flowise
I installed flowise using their own documentation and during the NPM install it has a TON of warnings about unsupported packages lol!
I followed the instructions to create a chatbot, but its response time is very slow and delayed. Compared to the BotPress chatbot, it is noticeably less responsive. Could this be due to a missing configuration or an overlooked step?
I don't think you're comparing apples with apples here.
You can't run botpress locally.
The response times of Ollama depend on your own hardware.
Hey nice video leon....but in my Rag chatbot I am using a tool agent and I need to pass the context which I have embedded in vector db in chat prompt template so that the agent can analyse whether the question is related to the docs provided or context provided ....how can I pass it?....i just want my chatbot not to give answers for unrelated questions. can you please help me with this
getting fetch failed error. please help
Did you resolve the error as i am also getting the same error.
Hi, in Base URL enter 127.0.0.1:11434
@@TabindaQudrat Im also getting the same error. Any idea how to resolve it
@@RajuK-mn6lk actually it requires high computational power. So i just dropped the idea of using Flowise. Instead of it you can do the same thing through coding. New library has been launched of generative AI. Use it and ta da.
Epic thx
You're welcome 🤗
Somethings missing from the process "AppData\Roaming
pm
ode_modules\flowise\dist\commands\start.js: Cannot find module 'langchainhub'", how to get? Pip doenst work on windows.
I got the same error too.
I had to separately install langchain and langchainhub using:
npm install -S langchain
npm install -S langchainhub
If there are further issues, I had to:
npm audit fix
npm audit fix --force
why do we need this vector thing? i didnt understand what's it for
The vector store is where the knowledge base is stored.
Knew if there is one place to come to get help its here !! Leon need help connecting a multimodal model from ollama in flowise for text and images do you have a video about that I looked but can't find one 😢
Hehe, my PC won't be able to run a model with image capabilities 😊.
Will see what I can do once the larger Llama 3.2 models become available
OpenWebUI or Koteamon can do the similar thing?
I doubt you can build multi-agent apps, or agentic rag solutions, with those platforms 😊 .
HEHE, seriously though - Flowise allows for some way more advanced AI solutions than those interfaces.
Subscribed and Liked. :-) This is really helpful and simple, something I really wanted to learn and set up. thanks a lot, I have set up the chatbot for my pdf repository, but is there a way to pull just the chatbot something like ollama openwebui chat, what I mean is- once we set it up in flowise, as I see I open locathost on port 3000 it takes me to the flowise page and then I click on the chatbot , the whole chat flow is shown there then I have to click chat icon to initiate a chat , is there a way to setup an url:port I can put on browser and it lands me directly on the web UI showing me this flowise chatbot that I configured.
NVM I got the url , in the settings option in chatbot also other APIs, great thanks again. Really appreciate you for making this video.
Awesome! How can we publish this on our website? Hosting it?
Hey there!
I have plenty of videos on my channel related to deploying Flowise and embedding it into websites.
Ollama is meant for running the models locally, but in the cloud you could use Groq to run open source models for free.
Again, I have videos on using Groq as well 😊
Is it possible to host ollama on coolify?
Is it possible to load multiple models in parallel using Ollama and Flowise?
Sounds interesting. What would be the use-case?
Thanks for the video Leon! When making chatbots for clients, do you encounter any cybersecurity concerns? for example, i could imagine clients worrying about using a third-party script on their website, because it could be vulnerable to XSS attacks, user privacy issues etc.
Would like to hear your (or someone else's thoughts on this)
Good question.
I've had to create some custom integrations for clients where all sorts of security and Auth systems are in place.
I feel that Flowise provides enough flexibility in the platform, especially when using their APIs and the new SDKs, to build whatever you want within the requirements from the client.
I can't create a document store. It says created but it's not created
Haven't had that issue myself. Maybe someone in the comments knows.
Try to update FW perhaps?
@@leonvanzyl other people on Github had the same issue but I was able to fix it
I switched to Node.js version 18.20.4 and Instead of installing it in my Documents or Downloads folder, I created a new folder directly in my root directory at ~/User/AI/, which helped avoid permission issues. After navigating to the folder in terminal, I ran npm install -g flowise and that did the trick!
Hi Leon, I was try your way to create AI chatbot, the only problem I'm not able to load a document bro, I used win machine. is there a way that you can help here?
I also use a Windows machine.
What issues are you experiencing?
You should check out my Document Store video if you're new to using Document Stores 🤞
Do i have to add doc to loader? Why can’t i point to folder to load ? Cuz i got 16 tb file that will not fit
If I'm not mistaken you can use the folder or file loader for that.
That is a massive file though, so you might want to clean up that data first, to text only, before uploading it.
Just wondering when will the next update for llama vision that can read images 😆
I'm keeping an eye out 👀.
Look forward to putting it to the test.
Thanks, flowaise looks good but is it free?
Yes, it's open source and free to use
I am on the waiting list to get acces.
If you use my affiliate link you will skip the waiting list
Can we integrate these chat bots in our own websites?
Absolutely!
Check out the web embed video on my channel
@@leonvanzylone more question it is taking longer time to generate the response is it dependent on my PC.
@@leonvanzyl I have 8gb ram but still the response is taking a lot of time. is 8 gb sufficient or not.
I don't when I get the registration link from Flowise. It almost 15 days now since I requested for account registration. Any suggestion, please?
You can avoid the waiting list if you use my link apparently.
Hello sir I got the following error while loading the database
Oh snap!
The following error occured when loading this page.
Status: 500
Error: documentStoreServices.insertIntoVectorStore - Error: documentStoreServices._insertIntoVectorStoreWorkerThread - Error: Could not import faiss-node. Please install faiss-node as a dependency with, e.g. npm install -S faiss-node.
Error: Could not locate the bindings file.
I got a similar error: Error: documentStoreServices.insertIntoVectorStore - Error: documentStoreServices._insertIntoVectorStoreWorkerThread - Error: ENOENT: no such file or directory, mkdir 'C:\Users\danie\sentience\"C:\Users\danie\OneDrive\Desktop\faiss"'
It looks like the path is appended to the current folder where I built Flowise, in the sentience folder. Yes, I just replaced the path, including the double quotes, with 'faiss' and it worked!
@@DanielLaLiberte Yeah you can fix it by installing flowise in docker. Later if you use ollama in workflow, change baseurl, host.docker.internal:11434
And about to calling a function?
Yes, these models support function calling 💪
its not free. you get a 14 day trial then you pay $35/mo for 10k predictions/mo to use your agent. am i wrong or does it clearly state that in the PRICING page
Nope, it's free and open source. Follow the instructions in the Flowise section of the video to set it up on your machine.
What you're referring to is their managed cloud service which is definitely not needed.
Awesome, and thanks for uploading. I would like to know how we can implement voice input and receive voice output from my internal RAG system.
interessing me also
I don't think this is possible within Flowise itself. Would be awesome thought.
sponsored AD
Nope. I did not get paid by Flowise, Meta or Ollama for this video. It wasn't created with their knowledge or permission either.
I'm always blown away by comments like this. These videos are a lot of effort to create.
Dude, I would happily accept a sponsorship deal if it means funding the channel, allowing me to create more videos.
So even if the videos WERE sponsored, decide whether the content is for you and move on.
dear leaon , im getting this error , appreciate if you can help me fix it , my environment C:\gnLAMA>node -v
v20.18.1 and flowise same as yours : C:\gnLAMA>npx flowise start
2024-11-24 20:30:46 [INFO]: Starting Flowise...
2024-11-24 20:30:46 [INFO]: 📦 [server]: Data Source is initializing...
2024-11-24 20:30:51 [ERROR]: ❌ [server]: Error during Data Source initialization: SQLITE_ERROR: no such column: ChatFlow.isPublic
QueryFailedError: SQLITE_ERROR: no such column: ChatFlow.isPublic
at handler (C:\gnLAMA
ode_modules\typeorm\driver\sqlite\SqliteQueryRunner.js:88:37)
at replacement (C:\gnLAMA
ode_modules\sqlite3\lib\trace.js:25:27)
at Statement.errBack (C:\gnLAMA
ode_modules\sqlite3\lib\sqlite3.js:15:21)
2024-11-24 20:30:51 [INFO]: ⚡ [server]: Flowise Server is listening at :3000
Hi Leon , Thank you for sharing this clip. It is very useful for me. Now I was encountering the issues after upsert at Flowise even I was using Ubuntu 24.04 and having /home/myname/vector path" 0Error: documentStoreServices.insertIntoVectorStore - Error: documentStoreServices._insertIntoVectorStoreWorkerThread - Error: Request to Ollama server failed: 404 Not Found". Please give me some advice. Banatus
i stuck at Faiss ..but got this error
tus: 500
Error: documentStoreServices.insertIntoVectorStore - Error: documentStoreServices._insertIntoVectorStoreWorkerThread - Error: Request to Ollama server failed: 404 Not Found
Did you set up Ollama? That message is saying that Ollama is not running.
@@leonvanzyl having the same issue. (posted above in the comments). Ollama is up to date and running fine otherwise. I also successfully upserted vectors to faiss with Ollama embeddings with small documents but if you using larger documents it fails constantly. As workaround is it possible to use different embeddings with Ollama models?
getting the same error even with a small document (I am using faiss with ollama embeddings)