Building Customized Text-To-SQL Pipelines in Open WebUI

Accessing an LLM served by vLLM or ollama through open-webui
Using a text-to-SQL prompt within an open-webui pipeline
Connecting to a postgres database with an open-webui pipeline
Modifying SQL queries using the information in-context
All disconnected, running on a single server with 1x GPU
/ @jordannanos
x.com/JordanNanos
/ jordannanos

[@johnkintree763]

Lovely demo of the synergy between language models and databases.

[@user-my4ni3eq3f]

Thx for sharing and it's really interesting to learn more about the pipeline projects related to open webui.

[@rafaelg8238]

great video. hoping to see more as soon.
congrats.

[@jordannanos]

hi,
code is here: github.com/JordanNanos/example-pipelines
video reviewing the code: th-cam.com/video/iLVyEgxGbg4/w-d-xo.html

[@JJaitley]

First of all great job Jordan. It would be really helpful if you could share the code on git.

[@jordannanos]

hi,
code is here: github.com/JordanNanos/example-pipelines
video reviewing the code: th-cam.com/video/iLVyEgxGbg4/w-d-xo.html

[@hasaniqbal3180]

Thank you for this. Can you share more info on the RAG pipeline along with code examples.

[@jordannanos]

working on getting it to run on both vLLM + ollama endpoints with llama3.1 + mistral. prompt uses llamaindex for text-to-sql.

[@jordannanos]

similar to this guide: docs.llamaindex.ai/en/stable/examples/index_structs/struct_indices/SQLIndexDemo/

[@jvannoyx4]

Great job can't wait to see more

[@jordannanos]

@@jvannoyx4 hi,
code is here: github.com/JordanNanos/example-pipelines
video reviewing the code: th-cam.com/video/iLVyEgxGbg4/w-d-xo.html

[@harsh90dem0]

Iam running both the openwebui and pipelines on different docker containers, but there seems to be an error whenever i try to connect both, your example which repeats the text back to the user seems to work fine, but whenever i use libraries like langchain or lammaindex it doesnt seem to work, throws an http connection error.. could you provide any help on this ?

[@jordannanos]

@@harsh90dem0 are the dependant packages installed in your pipelines container?
you’ll need to docker exec or kubectl exec into the container called “pipelines”
Then run:
pip install llama-cloud==0.0.13 llama-index==0.10.65 llama-index-agent-openai==0.2.9 \
llama-index-cli==0.1.13 llama-index-core==0.10.66 llama-index-embeddings-openai==0.1.11 \
llama-index-indices-managed-llama-cloud==0.2.7 llama-index-legacy==0.9.48.post2 \
llama-index-llms-ollama==0.2.2 llama-index-llms-openai==0.1.29 \
llama-index-llms-openai-like==0.1.3 llama-index-multi-modal-llms-openai==0.1.9 \
llama-index-program-openai==0.1.7 llama-index-question-gen-openai==0.1.3 \
llama-index-readers-file==0.1.33 llama-index-readers-llama-parse==0.1.6 \
llama-parse==0.4.9 nltk==3.8.1

[@dj_hexa_official]

Jordan , Super good job. I'm trying to integrate openwebui into my CRM system. That I would like to query the database for any of our product price or everything through the chat for my employees. This rag pipeline can make it in this way for example ? Thanks you for your answer

[@jordannanos]

hi, I think if you've got a db you should be able to query it. especially if you already know how using python.
I posted another video. code is here: github.com/JordanNanos/example-pipelines
video reviewing the code: th-cam.com/video/iLVyEgxGbg4/w-d-xo.html

[@dj_hexa_official]

@@jordannanos Thanks a lot Jordan . Super cool

[@RickySupriyadi]

minds to share your code please?

[@jordannanos]

@@RickySupriyadi hi,
code is here: github.com/JordanNanos/example-pipelines
video reviewing the code: th-cam.com/video/iLVyEgxGbg4/w-d-xo.html

[@RickySupriyadi]

@@jordannanos wow cool, thank you.