Rajib Deb
Rajib Deb
  • 146
  • 119 431
SKOS | Semi automating using a LLM
In this recording, I show how we can semi-automate extraction of SKOS taxonomy using a large language model
reference:www.w3.org/2009/08/skos-reference/skos.html
มุมมอง: 73

วีดีโอ

AWS BEDROCK GUARDRAILS
มุมมอง 6821 วันที่ผ่านมา
In this recording, I explored AWS Bedrock Guardrails
DOCETL | Extract PII
มุมมอง 77หลายเดือนก่อน
In this recording, i show how to extract PII from unstructured data using DOCETL ucbepic.github.io/docetl/
DOCETL | ETL for unstructured data
มุมมอง 259หลายเดือนก่อน
In this recording, I explored DOCETL, an open source package for declarative data processing using the power of LLM. This reminds me of the Hadoop days when I used to write complex Java programs to create input and output formats to find the schema in unstructured data. The approached looked similar but more powerful with Gen AI. I have modified the code a little to add the youtube parser also ...
OpenAI | Swarm
มุมมอง 259หลายเดือนก่อน
Open AI released SWARM last friday which is a multi agent framework. In this recording, I explore this framework. Example code: import os from dotenv import load_dotenv from swarm import Agent, Swarm load_dotenv() OPENAI_API_KEY = os.environ.get('OPENAI_API_KEY') client = Swarm() def ask_math_agent(): return math_agent def ask_physics_agent(): return physics_agent math_agent = Agent( name="Math...
RAGAS | TOPIC ADHERENCE
มุมมอง 48หลายเดือนก่อน
In this recording, we show how RAGAS implemented topic adherence to measure if agent and human are adhering to the topics of the conversation code: github.com/rajib76/ragas_examples/blob/main/08_topic_adherence.py
Graph Algorithm | Centrality | Article Rank
มุมมอง 30หลายเดือนก่อน
Graph algorithm will be important as we adopt GraphRAG. In this recording i show how to use article rank from GDS library of Neo4j. To try this, please create a sandbox and and project following the link below neo4j.com/sandbox/ Reference:neo4j.com/docs/graph-data-science/current/algorithms/article-rank/
Directional Stimulus | Meeting summarization workflow
มุมมอง 44หลายเดือนก่อน
In this recording, i show how we can implement DSP for meeting summarization Ref: arxiv.org/pdf/2302.11520 Code:github.com/rajib76/langgraph_examples/blob/main/10_summarization_with_dsp.py
EU AI ACT | Article 50
มุมมอง 332 หลายเดือนก่อน
In this recording I summarized the provisions of article 50. Part of the summarization has been created through GPT-4O which has been further reviewed and edited by me. source:artificialintelligenceact.eu/article/50/ Note: I encourage you to read the article yourself. My interpretation of the article is based on my reading and understanding of the content.
EU AI ACT | Automated summary through Selenium and GPT4O
มุมมอง 602 หลายเดือนก่อน
In this recording, I show an integration of selenium and gpt4o to summarize Chapter 1 of EU AI ACT.
Integrating Selenium and gpt-4 vision
มุมมอง 1692 หลายเดือนก่อน
In this recording I show a use case where I integrated GPT4 vision model with selenium. code:github.com/rajib76/browser_agent
Programatically Access Google Nest Event...
มุมมอง 232 หลายเดือนก่อน
In this recording, I show how to capture the events from Google Nest Camera or a thermostat. My idea is to later integrate it with a LLM to see if I can extract any meaningful insights from the events
How to integrate crew ai with Phoenix
มุมมอง 362 หลายเดือนก่อน
In this recording I show how to integrate crew ai with phoenix observability solution code:github.com/rajib76/crewai_examples/blob/main/examples/03_simple_crewai_phoenix_integration.py
MultiOn | Exploration day#1
มุมมอง 602 หลายเดือนก่อน
In this recording I did an initial exploration of multion. I tried to do Q&A over langchain docs. I see a lot of hallucinations happening. I will explore more to see if there is a way to control the hallucination code:github.com/rajib76/multi_on_examples/blob/main/01_browsing_langchain_docs.py
Graph Memory in mem0 | How does search work
มุมมอง 952 หลายเดือนก่อน
In this recording, I show how does mem0 do a search in the Graph memory code:github.com/rajib76/memory_examples/blob/main/examples/03_search_graph_memory.py
MemoryGraph | mem0
มุมมอง 1292 หลายเดือนก่อน
MemoryGraph | mem0
LlamaIndex Workflow | Global context
มุมมอง 2013 หลายเดือนก่อน
LlamaIndex Workflow | Global context
Integrating mem0 with LlamaIndex workflow
มุมมอง 1993 หลายเดือนก่อน
Integrating mem0 with LlamaIndex workflow
LLAMAINDEX | Workflow
มุมมอง 4013 หลายเดือนก่อน
LLAMAINDEX | Workflow
MEM0 Memory Exploration
มุมมอง 1553 หลายเดือนก่อน
MEM0 Memory Exploration
LangGraph Cloud and Studio | Part 2
มุมมอง 503 หลายเดือนก่อน
LangGraph Cloud and Studio | Part 2
LangGraph Cloud and Studio | Part 1
มุมมอง 1073 หลายเดือนก่อน
LangGraph Cloud and Studio | Part 1
How a reflective Agency can lead to better answer.
มุมมอง 713 หลายเดือนก่อน
How a reflective Agency can lead to better answer.
Model Graded Evaluation | Why it is not enough
มุมมอง 633 หลายเดือนก่อน
Model Graded Evaluation | Why it is not enough
The rise of memory | How mem0 implemented it
มุมมอง 1.1K3 หลายเดือนก่อน
The rise of memory | How mem0 implemented it
LlamaIndex KG | Deduplication of nodes.
มุมมอง 1174 หลายเดือนก่อน
LlamaIndex KG | Deduplication of nodes.
Agent Interactions | Hierarchical pattern#2
มุมมอง 724 หลายเดือนก่อน
Agent Interactions | Hierarchical pattern#2
Agent interactions | Hierarchical Structure
มุมมอง 904 หลายเดือนก่อน
Agent interactions | Hierarchical Structure
Milvius | how to use cosine similarity
มุมมอง 614 หลายเดือนก่อน
Milvius | how to use cosine similarity
GraphRag from Microsoft
มุมมอง 1.3K4 หลายเดือนก่อน
GraphRag from Microsoft

ความคิดเห็น

  • @AmarAmar-q8s
    @AmarAmar-q8s 5 วันที่ผ่านมา

    I'm not getting advanced prompts what to do??

  • @TomBielecki
    @TomBielecki 6 วันที่ผ่านมา

    If I understand correctly it's just a system prompt and user prompt run over the entire text contents of the PDF file. I was a bit surprised that the entire PDF text fit in the context window! I'm trying this out now and using 01-preview to create the SKOS and it's doing a good job. This seems like a powerful method! Now to figure out what to do with the SKOS after it's been generated. Any insights into applications for this?

    • @TomBielecki
      @TomBielecki 6 วันที่ผ่านมา

      I also wonder if it is feasible/useful to iteratively enrich the SKOS with the input. The SKOS you received as output was limited to the output tokens of the model, but surely the rich data of the paper could created quite a large SKOS output if given enough inference time?

  • @kedarsaipadigala4132
    @kedarsaipadigala4132 16 วันที่ผ่านมา

    I am glad that there is someone who does all these latest experiments and post videos consistently. It's a great help to us. Keep going.

  • @seadude
    @seadude 16 วันที่ผ่านมา

    Interesting topic Rajib! Thank you for introducing. This seems like a great step 0 for creating knowledge graphs.

    • @rajibdeb4059
      @rajibdeb4059 16 วันที่ผ่านมา

      Exactly, there are two components in unstructured knowledge organization, one is the knowledge model itself(which is something like this) and the knowledge base(which is the graph store like Neo4j). This is similar to how we approach structured data processing. The data model is either vault or inmon model, the database can be snowflake, redshift, bigquery etc.

  • @08godwinm25
    @08godwinm25 25 วันที่ผ่านมา

    Only way to extract the kg via cli only?

  • @hbautomation-io
    @hbautomation-io หลายเดือนก่อน

    Hi there, another question, how can I preserve markdown formatting of the text after extraction? My contact details are on my channel, thanks

  • @farhanafridi8694
    @farhanafridi8694 หลายเดือนก่อน

    Informative!

  • @AmanYadav-p9m5p
    @AmanYadav-p9m5p หลายเดือนก่อน

    best explanation. did you get the explanation of why short term memory is not getting built?

  • @hbautomation-io
    @hbautomation-io หลายเดือนก่อน

    Hi there, great video. Unfortunately i have had a lot of issues with the pdf extract package. There are lot's of dependencies issues. Which packages / versions did you use? Thanks

  • @721908811
    @721908811 หลายเดือนก่อน

    thanks, but I didn't see tool_calls in the new code, what happend

  • @Gamezone-kq5sx
    @Gamezone-kq5sx หลายเดือนก่อน

    Very informative

  • @AlexCasimirF
    @AlexCasimirF หลายเดือนก่อน

    Thank you a lot for this video! There is quite some content about Mem0 on TH-cam already - but as it is with most hyped or promising frameworks, most creators unfortunately do not take the effort of actually looking at the codebase and explaining how it works, but rather just scrape the surface by showing off the usage examples they found in the docs in the "quickstart" section. Contributions like yours are what open source actually needs, so thanks again!

  • @seadude
    @seadude หลายเดือนก่อน

    I’m curious, how much better are the results than if you just issue a prompt to summarize directly to GOT-4/o/o1? The results would need to be objectively better in order to justify the agent complexity.

    • @rajibdeb4059
      @rajibdeb4059 หลายเดือนก่อน

      Agree, this is something you may need to experiment and see if this approach gives better result especially when you have large transcripts with domain nuance. In that case you may have to have a fine tuned model for the hints

  • @shaiknaveed78
    @shaiknaveed78 หลายเดือนก่อน

    Thank you Sir for the video, but how is this different from adding few shot examples to the prompt. Do the few shot examples we pass in a prompt are same as the hints here? Please help understand, Thanks again!

    • @rajibdeb4059
      @rajibdeb4059 หลายเดือนก่อน

      Yes, if you can add the hints manually for every use case, it should work like the hints. This approach will be more automated

  • @IdPreferNot1
    @IdPreferNot1 2 หลายเดือนก่อน

    Nice, Speed scroll capture the images and then send the images in one parralllel batch inference and restitch for faster speed. Gemini flash 1.5 is multimodal and allows 15 free rpm at <128K token window and can batch process images easily withing this limit.

  • @darkmatter9583
    @darkmatter9583 2 หลายเดือนก่อน

    Hi

  • @darkmatter9583
    @darkmatter9583 2 หลายเดือนก่อน

    Hi can you help to learn?(Not laws i mean your other content) I would like to reach your level and learn from you please, algorithms but also application side like karparthy,fe fei li to be able to opensource and be able to do something (like healthcare, entertainment,finances)etc

  • @short.positive849
    @short.positive849 2 หลายเดือนก่อน

    What's the difference between doing this and trying to call a db to save the response to it.

  • @seththunder2077
    @seththunder2077 2 หลายเดือนก่อน

    Also, will u provide github link to this project?

    • @rajibdeb4059
      @rajibdeb4059 2 หลายเดือนก่อน

      @@seththunder2077 it is there

  • @seththunder2077
    @seththunder2077 2 หลายเดือนก่อน

    This is amazing. Is there a way we can let the LLM to also display the graphs or results on the streamlit app because thats an important feature

    • @yazanrisheh5127
      @yazanrisheh5127 2 หลายเดือนก่อน

      This would be a cool update to have

  • @pythonlover20
    @pythonlover20 2 หลายเดือนก่อน

    To deploy, you need can check out the integrations section.

  • @yazanrisheh5127
    @yazanrisheh5127 2 หลายเดือนก่อน

    Would love more videos on multion. Do you think it can be used in production/

  • @igris8569
    @igris8569 2 หลายเดือนก่อน

    Hey, is the hub depreciated now ? what handles that now ? for integrating into langchain

    • @rajibdeb4059
      @rajibdeb4059 2 หลายเดือนก่อน

      It is part of langsmith

  • @yazanrisheh5127
    @yazanrisheh5127 2 หลายเดือนก่อน

    How is this different from AgentOps?

  • @OscarDiaz-fb8jd
    @OscarDiaz-fb8jd 3 หลายเดือนก่อน

    This is the best training on this topic so far

  • @seththunder2077
    @seththunder2077 3 หลายเดือนก่อน

    Could you do integrating it with langchain please

    • @rajibdeb4059
      @rajibdeb4059 3 หลายเดือนก่อน

      please take a look here github.com/rajib76/memory_examples/blob/main/examples/01_remember_user_preference.py

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 3 หลายเดือนก่อน

    does relying on events to trigger sufficient to cover all use cases?

    • @rajibdeb4059
      @rajibdeb4059 3 หลายเดือนก่อน

      @@user-wr4yl7tx3w some use case may need choreography some orchestration. So both patterns need to be considered. This is no new concept, microservices 101

  • @afrasiyab95050
    @afrasiyab95050 3 หลายเดือนก่อน

    How much effort was it to set something up like this? Is this scalable for more complex data?

  • @NikhilThorat-x7n
    @NikhilThorat-x7n 3 หลายเดือนก่อน

    Hi Sir - Cannot access ur git link, please can you keep the project open.

  • @coladeu.
    @coladeu. 3 หลายเดือนก่อน

    the number of open tabs made me understand memory at a different level

  • @kitranet
    @kitranet 3 หลายเดือนก่อน

    Does thie studio only works in Machine?

    • @rajibdeb4059
      @rajibdeb4059 3 หลายเดือนก่อน

      @@kitranet I am using it through langsmith. You need to have at least plus membership of langsmith. There is a desktop version of studio which works on certain Mac machines only

  • @BharatVarsh47
    @BharatVarsh47 3 หลายเดือนก่อน

    Is there git code for this?

  • @HumanDefenseForce
    @HumanDefenseForce 3 หลายเดือนก่อน

    Thanks for the mem0 video

  • @pariajeihooni5150
    @pariajeihooni5150 3 หลายเดือนก่อน

    @ajibdeb4059 Thanks for the video. I didn't find any content related to connecting agents to the knowledge base. Could you help with that?

  • @nikcool8614
    @nikcool8614 3 หลายเดือนก่อน

    Hello ... nice tutorial video ... What is the datatype of embedding in the code in python ?

  • @princemathew9034
    @princemathew9034 3 หลายเดือนก่อน

    Hi Rajib, I am in a dilemma, New to Langchain agent framwork. What i like is the abstractions and length of features it provides to build a true agent. What i fear is that it is too abstract and there are icebergs underneath which i dont have any clue. What if something goes wrong? Difficult to troubleshoot and may be i do not have the flexibilty enough to quickly do a work around. So i am thinking of devloping a very basic functionality which i will have full control. Any thoughts or your experience of taking Langchain to production? Your feedback is appreciated. THanks

  • @AyushKumarSingh-l1p
    @AyushKumarSingh-l1p 3 หลายเดือนก่อน

    Thanks for the video, loved how you went through every single step!

  • @MrEravila
    @MrEravila 3 หลายเดือนก่อน

    Its easy to see that the physics teacher agent was built after the math agent since the description in the physics teacher agent still references to mathematics and the instructions in the moderator related to the physics teacher agent mention maths not physics. The typical error of a copy & paste.

  • @IdPreferNot1
    @IdPreferNot1 4 หลายเดือนก่อน

    Nice video. Would like to see the next step for expanded Supervisor Agent capability. I appreciate that you are doing this without abstraction as i want to understand this before looking at a langgraph version, but would like to see that too :)

  • @LoganMarkewich-o9w
    @LoganMarkewich-o9w 4 หลายเดือนก่อน

    There is an orchestrator, but it could be exactly an event-driven orchestrator :) Great video!

  • @rockypunk91
    @rockypunk91 4 หลายเดือนก่อน

    Do we need to reindex all documents, everytime we add new document. Is there any way to run it programitically

  • @dikshyakasaju7541
    @dikshyakasaju7541 4 หลายเดือนก่อน

    Amazing explanation!! But if we don't change the existing prompts then, there's no point in creating 'Parser Lambda functions', right?

  • @OluebubeOnwuamaegbu
    @OluebubeOnwuamaegbu 4 หลายเดือนก่อน

    what about the prompt templates? Does this video only cover handling the response in the lambda function? What exactly are the prompt templates? How are those passed to the LLM?

  • @reverse_3258
    @reverse_3258 4 หลายเดือนก่อน

    Hi @rajibdeb4059, @EccleezyAvicii, do you know how to implement partial response? like if the Tool takes time to provide response, I will show temporary message to the user? Your prompt reply will be greatly appreciated.

  • @OluebubeOnwuamaegbu
    @OluebubeOnwuamaegbu 4 หลายเดือนก่อน

    I don't think I could've found a better video. As an intern I am so grateful thank you so much !

  • @dikshyakasaju7541
    @dikshyakasaju7541 4 หลายเดือนก่อน

    Great Explanation! However if we have to build a KB for prod, would it not be better to create a separate lambda function where we can have more control over how we create KB using Langchain and upload it to Vector DB? And then create a seprate RAG Agent with Lambda Function and Open API?

  • @dikshyakasaju7541
    @dikshyakasaju7541 4 หลายเดือนก่อน

    Can't we create a KB using LangChain because that way we have more control over how the chunking for the documents are done?

  • @krunaltanna8469
    @krunaltanna8469 4 หลายเดือนก่อน

    Good explanation Rajib, May I know how is it different from when we create a KG using Neo4j?

  • @GirishPatil-k9r
    @GirishPatil-k9r 4 หลายเดือนก่อน

    Which Authentication type you set for your tool ?

  • @munkuo5
    @munkuo5 4 หลายเดือนก่อน

    You can decompose the compound questions into simple questions. The Langchain page has a good example for this. Thanks for this video!