Optimization of LLM Systems with DSPy and LangChain/LangSmith

แชร์
ฝัง
  • เผยแพร่เมื่อ 3 ก.พ. 2025

ความคิดเห็น • 19

  • @cm_dev
    @cm_dev 10 หลายเดือนก่อน +17

    I appreciate your commitment to posting relevant and informative content on a regular basis!

  • @istvandarvas3372
    @istvandarvas3372 10 หลายเดือนก่อน +9

    This was so awesome I cannot find the words to describe it. THANKS! Finally, I'm starting to feel like we're heading in the right direction with this DSPY ;) We're beginning to reach a point where AI, serving as an engine, can now be utilized alongside proven, well-developed software engineering principles. These principles are genuinely advanced, underpinned by 50 years of industry experience.

  • @nqnam12345
    @nqnam12345 6 หลายเดือนก่อน

    Thanks ! Great , I always had trouble with prompting

  • @diallo9149
    @diallo9149 10 หลายเดือนก่อน

    very informative , I'll definitely look into it ✌️✌️

  • @codekiln
    @codekiln 6 หลายเดือนก่อน

    World love the slides link!

  • @attilavass6935
    @attilavass6935 10 หลายเดือนก่อน +5

    This is great, but my pain is how to use DSPy without going bankrupt :)

    • @sammathew535
      @sammathew535 7 หลายเดือนก่อน +1

      It does beautiful caching across the system, so it only calls the backend LLM, if you haven't done so, until then!

  • @ppbroAI
    @ppbroAI 9 หลายเดือนก่อน +2

    Can we use gemini as a bigger model to optimize lesser models?. I mean gemini API is free and its pretty capable

  • @robboerman9378
    @robboerman9378 9 หลายเดือนก่อน

    Very informative, thanks for sharing. Is there anywhere I can watch the talk that the slides were originally used for?

  • @fraternitas5117
    @fraternitas5117 10 หลายเดือนก่อน +4

    why would I use langchain if I had this?

    • @miguelovallevillamil4953
      @miguelovallevillamil4953 10 หลายเดือนก่อน +3

      IMO and from an application-building perspective, LangChain is necessary since you cant give the final user of your application a DSPy code as frontend. In the video they mention the idea of using DSPy with LangGraph, which I think resonates with what I said preivously ~ rather than seing them as a replacement for each other, they can be used together to build your apps.

    • @istvandarvas3372
      @istvandarvas3372 10 หลายเดือนก่อน +2

      I think you need both! The small discussion at the end about Keras which is on top of TensorFlow illustrates that the same idea can be integrated. We need 'glue' and we also need higher-level abstraction building blocks for 95% of applications out there. The mariage of LangChain and DSPy fall into this category, in my opinion. Therefore, I am looking forward to learning more about this and am excited to use these higher-level building blocks in a LangChain application. It will speed up development and testing, and at the end of the day, that is what matters most!

    • @Karl-Asger
      @Karl-Asger 10 หลายเดือนก่อน +2

      I'm wondering the same thing. I only briefly used LangChain, but have bounced around all the different frameworks since then and have been using DSPy for a while now.
      While I see what Miguel and Vandarvas are saying here, I don't understand what Langchain can do that DSPy can't. The DSPy abstractions are much more peaceful to work with and allow great flexibility.
      "LangChain is necessary since you cant give the final user of your application a DSPy code as frontend" - not sure if I'm misunderstanding, but when would you give LLM app code as a frontend?
      Interested to hear more on this. It sounded like Harrison was really pushing the idea of going between LangChain and DSPy, and of course pushing LangSmith as the product which looks very nice I have to say.

    • @rodklv8564
      @rodklv8564 หลายเดือนก่อน

      Typically a langchain piece of code like any other library code gets encapsulated as a TOOL module in DSPy.
      Langchain also integrates within a tool platform, but can't compete with the optimization solution brought by DSPy.
      Will they go optimize, or not, in the future.
      Looks like a massive appeal and décisive advantage from Stanford.

  • @waynehawley814
    @waynehawley814 10 หลายเดือนก่อน +1

    Normalize the Audio Next time please... i have to increase the volume by 500%...

  • @marcusandatlas844
    @marcusandatlas844 9 หลายเดือนก่อน

    DSPy is pretty cool but Omar *really* needs to work on his communication and presentation skills.

  • @AIvanTrue
    @AIvanTrue 9 หลายเดือนก่อน

    it is cool but naming is absolutely terrible!

  • @haralc6196
    @haralc6196 5 หลายเดือนก่อน

    Am I the only one who things that DSPy only sounds nice in concept and probably only work on 3% on all possible GPT use cases, and for the other 97% it's a complete BS?

  • @maksimhajiyev7857
    @maksimhajiyev7857 9 หลายเดือนก่อน +1

    LangChain and the overall GEN AI is a huge hype , people will get back on track soon. These technology is not stable with huge overhead. It should have been done in low level lang. The problem with AI "revolution" it is dominated with PHDs and data analysts who never did real enterprise soft