Trying to make LLMs less stubborn in RAG (DSPy optimizer tested with knowledge graphs)

แชร์
ฝัง
  • เผยแพร่เมื่อ 23 ธ.ค. 2024

ความคิดเห็น • 10

  • @wadejohnson4542
    @wadejohnson4542 7 หลายเดือนก่อน +4

    Until I saw this, I was starting to think that there was something wrong with me not being able to achieve magical improvements in results by using DSPy over meticulously hand-crafted prompts targeted at the observed quirkiness of specific LLMs. Thank you for restoring my self confidence. And now I'm also going to incorporate graph databases into my RAG pipelines after watching a couple of your videos.

  • @rahulvb5044
    @rahulvb5044 6 หลายเดือนก่อน

    one basic doubt.
    def forward(self, question):
    # Step 1: Retrieve context based on the question
    context = self.retrieve(question).passages
    # Step 2: Generate an answer based on the context and question
    prediction = self.generate_answer(context=context, question=question)
    answer = prediction.answer
    # Step 3: Validate the answer type using the entity_linker function
    correct_question_type, original_answer_type, type_status = entity_linker(answer, question)
    # Optional: You can use the AnswerTypeValidityCheck signature for validation if needed
    validation = self.check_answer_type(entity_type=correct_question_type, question=question, answer=answer).type_status
    return dspy.Prediction(context=context, answer=answer, type_status=type_status)
    in this method, the answer returned is the one you got from self.generate_answer. That method doesnt use any entitylinker . so how is entitylinker influencing the answer ?

  • @somjrgebn
    @somjrgebn 6 หลายเดือนก่อน

    Do you know of any efforts on converting these entities and relationships further into formal logic representations?
    Being able to pair these graph databases with formal logic representations would definitely help improve the quality of written text, organic exploration/discovery, and understanding over time.

  • @shubhanshuyadav2437
    @shubhanshuyadav2437 6 หลายเดือนก่อน

    Can't sign in diffbot even with non-gmail ID. Is it supposed to be so?

  • @Digitalcataloghub
    @Digitalcataloghub 6 หลายเดือนก่อน

    I really like this tool can it be used for seo

  • @GiveThanks-54
    @GiveThanks-54 6 หลายเดือนก่อน

    Do you feel that nomic embeddings are adequate open-source embeddings model for RAG projects or do you recommend another?

  • @victoriamartindelcampo7827
    @victoriamartindelcampo7827 7 หลายเดือนก่อน

    girl, u rock thank you so much for this!! Where can I follow you?

  • @pedromoya9127
    @pedromoya9127 7 หลายเดือนก่อน

    thanks great video!