Better Searches With Local AI

แชร์
ฝัง
  • เผยแพร่เมื่อ 20 พ.ย. 2024

ความคิดเห็น • 61

  • @kushagrasri
    @kushagrasri 6 หลายเดือนก่อน +75

    Hi Matt! thanks for checking it out. I'm working on major features like chat history, discovery, and new search types, and will roll them out eventually. It is still very early for Perplexica, but we're slowly reaching there. The searches are slower because Perplexity directly returns the result to the model instead of performing a similarity search. We do the opposite; after the search is complete, the results are refined and then returned to the model, this ensures that the context is very precise and the answers are some time better than Perplexity. We're working on adding some search types that allow you to disable this option.

    • @dotcomphoto7347
      @dotcomphoto7347 6 หลายเดือนก่อน

      That sounds great! Is it possible to use its services as API as well? Or just through the UI?

    • @new_artiko
      @new_artiko 5 หลายเดือนก่อน

      yeah, sound amazing! it is a open source project?

    • @mbarsot
      @mbarsot 5 หลายเดือนก่อน

      hi, great start for perplexica. My use case is creating news bullettin with queries like "top news from bbc news website, translated in italian with a title and a summary". Now: sometimes it works, sometimes it does not at all, others the reply is related to spurious parts of the bbc website (how to subscribe etc).
      Can you have us have a look at what is actually scraped from the websites (and which websites are selected), in order to make better queries to Perplexica ?

    • @riok4523
      @riok4523 5 หลายเดือนก่อน +1

      being able to add docs would be a huuuge plus!

  • @ambarrlite
    @ambarrlite 6 หลายเดือนก่อน +14

    Page Assist, an extension for chrome or firefox Ive been using awhile, does searches and can summarize the page. I forgot to add it uses local ollama models :)

    • @technovangelist
      @technovangelist  6 หลายเดือนก่อน +11

      I covered that in an earlier video. Perplexica does it in a very different way and is far more successful.

    • @ambarrlite
      @ambarrlite 6 หลายเดือนก่อน +1

      @@technovangelist I may have missed that vid, and I thought I had seen them all. I am a big fan of ollama. :)

  • @tvwithtiffani
    @tvwithtiffani 6 หลายเดือนก่อน +7

    I simply love your reviews. Clearly highlighting pros & cons. This is how it should be done.

  • @joshharrison6020
    @joshharrison6020 6 หลายเดือนก่อน +8

    To be honest, if the application only offered a light mode, I would be less inclined to use it. I tend to use everything in dark mode. It’s not because I’m trying to reflect a certain persona or mood, but rather, I find that dark mode is easier on the eyes. This preference becomes particularly noticeable when I’m using the computer for extended periods, up to 18 hours at a time. The reduced strain on my eyes makes the experience much more comfortable.

    • @technovangelist
      @technovangelist  6 หลายเดือนก่อน +2

      I feel like this is a video I need to make, since this is flat out not true. It can feel like its easier at a point when you should be looking away, but it can cause issues later on, and its especially bad for 30% of the population. It's kind of like when folks say they are visual learners when most of the science based evidence says there is no such thing.

    • @svenvanwier7196
      @svenvanwier7196 6 หลายเดือนก่อน +1

      @@technovangelist while it might not be true, I experience the same, I think its all subjective. but never researched it.
      You made a genius point about probably touching some grass if strain comes into play xD

    • @ts757arse
      @ts757arse 5 หลายเดือนก่อน

      Make that video. I use dark mode most of the time and I find it depends on the monitor, surroundings and even the time of day. My laptop is awful to use in dark mode and I find it tiring and harder work. My main PC has four monitors, the two best ones being great in dark mode and the two cheapo ones being awful. I keep that whole system in dark mode and use the secondary monitors for things like open directories, Spotify, etc.

  • @solporcima
    @solporcima 4 หลายเดือนก่อน +3

    Hello there I am wondering to see a video using ollama+ webui with web search + local llm

  • @Ammarsays
    @Ammarsays 5 หลายเดือนก่อน +2

    Hi. Nice content. I like the pace of your videos. Everything is peaceful and interesting without loud music or dramatic sound effects. Please review fabric ai coupled with agents which are included with it.

    • @technovangelist
      @technovangelist  5 หลายเดือนก่อน

      Yeah, yeah, yeah. Fabric AI. Gotta do that one. Every now and then, I do add a little bit of music or a few sound effects, but I try not to make them too over the top.

  • @blossom_rx
    @blossom_rx 6 หลายเดือนก่อน +1

    Hi Matt. I just stumbled upon your channel. I am really impressed! Thanks for providing actual knowledge instead of using clickbaity video titels without any real value. Keep it going. I hope your channel will be most successful. Quality over quantity.

  • @MeinDeutschkurs
    @MeinDeutschkurs 5 หลายเดือนก่อน

    What a great thing. Temporary embeddings for web research. ChromaDB + python + selenium. Should do it. Thx for inspiring me!

  • @Slimpickens45
    @Slimpickens45 6 หลายเดือนก่อน +2

    Holy smokes this is cool. Great stuff as always Matt!

  • @alvinnorin8820
    @alvinnorin8820 5 หลายเดือนก่อน

    The end was really appreciated.

  • @daan3298
    @daan3298 6 หลายเดือนก่อน

    What do I think? There are so many cool projects. But so little projects that make significant effort to combine all the cool projects. Some kind of standard that makes it easy to combine tools, use them as agents or whatever, that would be great. That's what I think.

  • @IdPreferNot1
    @IdPreferNot1 6 หลายเดือนก่อน +1

    Appreciate your shares and balanced reviews.

  • @dotcomphoto7347
    @dotcomphoto7347 6 หลายเดือนก่อน

    Really nice! Is there a way to use it as api as well? Or just using the UI?

  • @nadpro16
    @nadpro16 5 หลายเดือนก่อน

    I love it when I find something like this that im like, ooh I like that. Lets give it a try. And its broken....seigh.

  • @vulcan4d
    @vulcan4d 6 หลายเดือนก่อน +1

    Amazing work!

  • @ihaveacutenose
    @ihaveacutenose 6 หลายเดือนก่อน +1

    You da man! That's exactly what I wanted to know!

  • @maximeaube1619
    @maximeaube1619 6 หลายเดือนก่อน

    self hosted AI search engine ? didn't know about it. Very interesting, will definitely try

  • @c0t1
    @c0t1 6 หลายเดือนก่อน

    Another awesome video! Can't wait to try this out.

  • @قيمنقعبود-ب2ل
    @قيمنقعبود-ب2ل 5 หลายเดือนก่อน

    Thanks. So what should we use for searching our documents.

    • @technovangelist
      @technovangelist  5 หลายเดือนก่อน

      This space is changing quickly, so I'm sure there's going to be another tool to try out for doing everything you could ever want. I think right now my favorite for doing a rag search is still OpenWebUI.

  • @mbarsot
    @mbarsot 5 หลายเดือนก่อน

    I think it is great, or in fact great potential. Would love to have a more stable retrieval from the web (see comment to the author down below), but in general most programs that work with ollama seems to be very good, so it is hard to settle to one solution (a good thing, in this case)

  • @FlockofSmeagles
    @FlockofSmeagles หลายเดือนก่อน

    Searxng = Searching. Clever, I know.

  • @r-news-ny
    @r-news-ny 6 หลายเดือนก่อน

    Hi Matt, I wanted to ask if you could create a python script that will allow ollama +open webui to be able to search the Internet. I want to know if this idea will work? I'm new and learning this😊😊😊😊

  • @ThoughtFission
    @ThoughtFission 4 หลายเดือนก่อน

    What is currently the best RAG solution for docs?

    • @technovangelist
      @technovangelist  4 หลายเดือนก่อน

      That’s like asking whats the best model or whats the best car. There is no best and there can never be. It depends on your requirements.

  • @jofus521
    @jofus521 6 หลายเดือนก่อน

    I think there is a space for a robust knowledge curation app, so we can save the valuable results and tag them. Got a whole bunch of ideas around that. You always have fresh stuff, man. Wish I could pick your brain sometime. Planning to do something in all golang.

    • @technovangelist
      @technovangelist  6 หลายเดือนก่อน

      Ping me on the discord or if you are near Seattle we can meetup.

    • @jofus521
      @jofus521 6 หลายเดือนก่อน

      Cool thanks @technovangelist. On what server? A little new to discord. Can’t find a way to search. I’ve only joined from invites so far

    • @technovangelist
      @technovangelist  6 หลายเดือนก่อน

      Discord.gg/ollama. I’m mattw tvl.st/y

  • @UsmanAli-po5cm
    @UsmanAli-po5cm 2 หลายเดือนก่อน

    You can add Groq API in Msty and that will enable the real-time search mode. How is this better than Msty?

    • @technovangelist
      @technovangelist  2 หลายเดือนก่อน +1

      Same reason as wanting to use Ollama... comes down to security and privacy and sometimes cost.

    • @UsmanAli-po5cm
      @UsmanAli-po5cm 2 หลายเดือนก่อน

      @@technovangelist I installed and tested it. Msty with real time data enabled provided better search results. Perpelxica took nearly 20 gigabytes of my hard disk storage and results were no where as good as Msty with real time data enabled. Uninstalled it!

  • @dr.mikeybee
    @dr.mikeybee 6 หลายเดือนก่อน

    Which branch are you using?

  • @jacobbobo4670
    @jacobbobo4670 5 หลายเดือนก่อน

    All of the dockers are running, but when I go to port 3000 I just have a loading screen that's been going for like 20 minutes. Does anyone know what I'm doing wrong? also Im running it through wsl.

  • @sridhartn83
    @sridhartn83 หลายเดือนก่อน

    For me flowise is already running on port 3000 and ollama webui on 8080, I changed all ports in .yaml files to use other ports than these but the webui for perplexica doesn't load, any idea how to fix this

    • @technovangelist
      @technovangelist  29 วันที่ผ่านมา

      in the docker file the ports statement for the frontend is 3000:3000. So maybe change that line to 3333:3000. That will forward the container port of 3000 to 3333 on your machine. port 3000 on the container will coincide fine with 3000 on any other container or your machine.

    • @sridhartn83
      @sridhartn83 29 วันที่ผ่านมา

      @@technovangelist I made it working, got the flowise to start on port 5000 and have perplexica run on its default 3000. will try your option as well but as its working now will not touch anything until something breaks ;-) Thanks for your reply :-)

  • @Maisonier
    @Maisonier 6 หลายเดือนก่อน

    All this AI technology is still pretty green ...

  • @DanielKirsch
    @DanielKirsch 6 หลายเดือนก่อน +3

    The profile shots are a bit weird. Not sure you should add them.

    • @DanielKirsch
      @DanielKirsch 6 หลายเดือนก่อน +2

      The awkward silence at the end is hilarious though.

  • @gu9838
    @gu9838 6 หลายเดือนก่อน

    plus having an offline option is great cuz i got to the perplexity website just now and it says there are too many users asking questions and yeahhhhhhhh great lol

  • @MH-xx6df
    @MH-xx6df 5 หลายเดือนก่อน +1

    Lightmode? Pleasing? C’mon, ever heard of circadian rhythms? Going out of whack due to monitor light. Let’s widen our knowledge base into more than just the digital world.

    • @technovangelist
      @technovangelist  5 หลายเดือนก่อน +1

      Your comment goes in two directions. First talk about rhythm, accepting that light mode is important, then you make up stuff about going out of whack due to monitors suggesting that dark mode is any better. Choose the argument and stick with it. Perhaps widen your knowledge to facts and not just made up stuff.

  • @inout3394
    @inout3394 6 หลายเดือนก่อน

    Msty, make simple app to search, use api, and rag

  • @dvn8ter
    @dvn8ter 6 หลายเดือนก่อน

    ⭐️⭐️⭐️⭐️⭐️