How to Set up and Use PrivateGPT and LocalGPT

แชร์
ฝัง
  • เผยแพร่เมื่อ 15 ม.ค. 2025

ความคิดเห็น • 45

  • @konstantinlozev2272
    @konstantinlozev2272 ปีที่แล้ว +8

    These RAG solutions are basically chunking the contents into 2-3 paragraph long chunks, doing a semantic search and then putting out the results as a context for the chat function.
    It's normal that they do not perform well on summarisation.

  • @sivasangaranv6787
    @sivasangaranv6787 ปีที่แล้ว +3

    It's very much useful to me for my studies. Thank you ma'am

  • @John_Krone
    @John_Krone ปีที่แล้ว +3

    Perfect explainer. I have a mac also so this was golden. Thanks

  • @rrzz1513
    @rrzz1513 ปีที่แล้ว +3

    What are differences between PrivateGPT and Local GPT?

    • @jaujauhestogsauuasgotsehua9784
      @jaujauhestogsauuasgotsehua9784 ปีที่แล้ว

      privateGPT only uses cpu, but localGPT can use gpu. I BELIEVE, unless its updated. Cus then idk

  • @kshitijdesai2402
    @kshitijdesai2402 ปีที่แล้ว +2

    I have tried it before, what you are using are raw models, however large you use, it needs to be finetuned for the task that you wish to perform which is in this case, the answer that you are expecting, otherwise they don't seem to be practical enough as of now.

  • @manu_ovg
    @manu_ovg 7 หลายเดือนก่อน

    Which Mac you have ? M1 or M2 ?
    Because this looks fast

  • @narendrakd
    @narendrakd ปีที่แล้ว +2

    Hi MAM, I want to know can i ingest multiple files and i have 1000 docuemts pdf,txt and docs & i want to create graphical user interface based chat bot,can i ? can you please guide me mam.

    • @sru_0119
      @sru_0119 4 หลายเดือนก่อน

      have you done it? if so can u please help me

  • @Pure_Science_and_Technology
    @Pure_Science_and_Technology 11 หลายเดือนก่อน

    What embedding model is being used?

  • @PetarBanicevic-j8t
    @PetarBanicevic-j8t 7 หลายเดือนก่อน

    "just install poetry" - do I have to integrate them or its done by install script of privateGPT?

  • @vetonrushiti19
    @vetonrushiti19 7 หลายเดือนก่อน

    does localgpt work in a ubuntu machine without nvidia gpu?

  • @coder-bm2jb
    @coder-bm2jb 2 หลายเดือนก่อน

    for localGPT i am getting this error while installing requirements.txt:
    note: This error originates from a subprocess, and is likely not a problem with pip.
    ERROR: Failed building wheel for chroma-hnswlib
    Failed to build chroma-hnswlib
    ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (chroma-hnswlib)
    please help to solve this.

  • @MuhammadDanyalKhan
    @MuhammadDanyalKhan ปีที่แล้ว

    Does private GPT or localGPT allow stacking of model? i.e. giving query to model that is best suited to answer?

  • @otomakannioc8213
    @otomakannioc8213 ปีที่แล้ว +3

    I like LLMs as long as they come along in such sympathic manner as presented in this video ;-)

  • @therohitdas_com
    @therohitdas_com ปีที่แล้ว +1

    Why did you skip the part where we need to build the llama.cpp with METAL support? It should have been included in this tutorial.

    • @browny334
      @browny334 ปีที่แล้ว

      how to do this?

    • @therohitdas_com
      @therohitdas_com ปีที่แล้ว

      ​@@browny334 go to the Installation section of the privateGPT and then search(cmd+f) OSX GPU support

  • @VaibhavPatil-rx7pc
    @VaibhavPatil-rx7pc 11 หลายเดือนก่อน +1

    Excellent !🤗

    • @kajalsharma09
      @kajalsharma09 8 หลายเดือนก่อน

      Hello have you successfully run this

  • @justthestuff3324
    @justthestuff3324 ปีที่แล้ว

    GPT4All does this now, right?

  • @golyandro
    @golyandro ปีที่แล้ว

    Teşekkürler, tam aradığım şey.

  • @Andreas-z5o
    @Andreas-z5o ปีที่แล้ว

    ERROR: Could not find a version that satisfies the requirement autoawq (from versions: none)
    ERROR: No matching distribution found for autoawq
    why do I get this error for localGPT

    • @verslemonde6208
      @verslemonde6208 ปีที่แล้ว

      you may not need it and can comment it out if you don't want to build your own quantised models.

  • @mochammadrevaldi1790
    @mochammadrevaldi1790 9 หลายเดือนก่อน

    halo thankyou for the tutorial. can you explain how to use posgreSQL mode for vectorstore database privateGPT?

    • @kajalsharma09
      @kajalsharma09 8 หลายเดือนก่อน

      Hii can you please help me in this

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w ปีที่แล้ว

    like to see privategpt with Ollama?

  • @kajalsharma09
    @kajalsharma09 8 หลายเดือนก่อน

    Hello, anyone please help me i am getting error again and again

  • @browny334
    @browny334 ปีที่แล้ว

    localGPT does not work on Mac unfortunately

  • @dascoder7473
    @dascoder7473 ปีที่แล้ว

    great joB, thank you

  • @Derouz
    @Derouz 4 หลายเดือนก่อน

    If AI is so advanced, couldn't they create installers similar to those in Windows to make it easier to install these programs without having to manipulate code?

  • @DanielArnolf
    @DanielArnolf 10 หลายเดือนก่อน

    We call yaml extension "Yamel"

  • @kaistriban
    @kaistriban ปีที่แล้ว +1

    Great video. Thanks. On Mac giving the command git clone I got a xcrun error and apparently is not an uncommon error. I solved it by reinstalling xcode giving the command in the terminal: xcode-select --install

  • @ldandco
    @ldandco ปีที่แล้ว

    The face of AssemblyAI is just gorgeous

  • @ozanpress
    @ozanpress ปีที่แล้ว +1

    Bu ablamiz Turk sanirim :)

  • @pabloronald7362
    @pabloronald7362 ปีที่แล้ว

    Thanks for the video. Interesting! Although bionicgpt looks much more robust for running files locally.

  • @PetarBanicevic-j8t
    @PetarBanicevic-j8t 7 หลายเดือนก่อน

    Its bit superficial guide, flat emotions... I can read readme myself. Yaml is read YAM-uhl.

  • @user_375a82
    @user_375a82 ปีที่แล้ว +2

    I'm not subscribing at $20 a month when $5 is the right price. All these Corps are price fixing. £20 is absurdly high. Even Amazon Prime is only $5 a month.

    • @jaybestnz
      @jaybestnz 8 หลายเดือนก่อน

      God it's incredible how ungrateful people are. At this time, businesses are throwing billions of dollars into these platforms in the hope of maybe winning and maybe making money in the future.
      This tech just 5 years ago was via Watson, and would be $150k to have access to the licences for a fraction of this tech and power.
      If you are doing these tasks in a business setting you should be easily able to save hundreds of dollars by using this (eg a lawyer able to review files faster and more accurately).
      I strongly suggest if you don't like the price, learn coding and form a company that can do this, and then charge less. It's a free market.

  • @ddhruvarora
    @ddhruvarora 10 หลายเดือนก่อน

    if you have mac M1 chip, then GPU is not necessary, the power of Mac M1

  • @StripedLime
    @StripedLime 10 หลายเดือนก่อน

    *Unstructured [pdf]* gives an error on macbook

  • @TheGooch111
    @TheGooch111 ปีที่แล้ว +1

    You asked if there was a quicker way to say Y-A-M-L (.yaml), it's like Camel, but with a Y.

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว +2

      I was going to say that but doubted myself for a second thinking it would sound funny. :D Thank you though! - Mısra