Why Agent Frameworks Will Fail (and what to use instead)

แชร์
ฝัง
  • เผยแพร่เมื่อ 29 ก.ย. 2024
  • Want to get started with freelancing? Let me help: www.datalumina...
    Need help with a project? Work with me: www.datalumina...
    You probably don't need an agent framework to solve your automation problem. In this video, I'll cover my approach.
    👋🏻 About Me
    Hi there! I'm Dave, an AI Engineer and the founder of Datalumina. On this channel, I share practical coding tutorials to help you become better at building intelligent systems. If you're interested in that, consider subscribing!
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 171

  • @LeonardoAmigoni
    @LeonardoAmigoni หลายเดือนก่อน +12

    I have been building business processes for 20 years. This is the way!

    • @daveebbelaar
      @daveebbelaar  หลายเดือนก่อน +1

      I've been getting a lot of mixed comments on this video (I know the title is a little triggering, but hey, that's how TH-cam works). I'm glad I'm not the only one that thinks this is the right approach.

    • @alexjenkins8026
      @alexjenkins8026 20 วันที่ผ่านมา +1

      No1 said you had to setup an Agent Team as a dynamic randomized flow... you can have agents pass variables down the line... the best part is, it doesn't have to fit neatly into a pydantic model with error handling everywhere... if the previous agent just blobs back a full text instead of a dict - the next agent can still get the info it needs and make it work.
      Handling nulls, errors, variations, if/else logic, retries and structured input/output is what agents do away with.

  • @istvandarvas3372
    @istvandarvas3372 3 หลายเดือนก่อน +51

    I mostly agree with everything. But there are two kinds of pipelines. The first one is when you have a finite amount of transformations, and the second one is when you don't know all the transformations in advance and need to delegate decision-making (in this case, you need an agentic approach). However, every pipeline can be represented as a finite transformation when you know it. for example classification. and t
    that is the key. So, if your pipeline is research-like, then you can't know it in advance; in other cases, you can.

    • @matterhart
      @matterhart 3 หลายเดือนก่อน +2

      I like this distinction. I build UI heavy pipelines with a lot of human input where there's a ton of variability/decision-making in both the E and the T, and only the L is known in advance.

    • @daveebbelaar
      @daveebbelaar  3 หลายเดือนก่อน +3

      Good point. In those cases, agentic workflows make perfect sense.

    • @ShpanMan
      @ShpanMan 3 หลายเดือนก่อน +3

      @@daveebbelaar So you admit your title is extremely silly.

    • @Jadavarma
      @Jadavarma 2 หลายเดือนก่อน

      I completely agree with your viewpoint. The whole point of these frameworks are to get LLMs to perform such abstract tasks which we have no predefined idea about. There should be data pipelines that satisfy the needs other than that and that is obvious - If you don't need the computation power of LLMs why use them?

    • @m4rtin419
      @m4rtin419 หลายเดือนก่อน +1

      This is a great distinction. I am wondering though if we really have use cases for the second type at the Moment? In other words, I have the impression that agentic approaches are mostly used for problems that don’t need agentic approach and can be solved much simpler.

  • @maheshagodekere
    @maheshagodekere หลายเดือนก่อน +33

    Use an AI agentic framework when dealing with complex, non-linear tasks with unpredictable workflows that require dynamic decision-making and flexibility. Use traditional pipelines when dealing with linear, predictable processes that demand consistency, precise control, and efficiency.

  • @Crates-Media
    @Crates-Media 3 หลายเดือนก่อน +7

    Here's something you can help me understand, as an intermediate-level coder learning all of the nuances of AI/ML and their applcations.
    You're extolling the value of the directed acyclic graph approach towards data processing pipelines, to avoid sending data to earlier stages.
    As a fan of idempotency and functional programming, I _think_ that I somewhat understand where you're coming from in your premise.
    But in my studies of models, I'm also seeing a lot of buzz around the differentiation between methodologies of KANs vs MLPs.
    My question is this: wouldn't there be some value in using information uncovered later in the pipeline to refine what you're doing earlier on?
    For instance, let's say you're entertaining guests, and planning to serve appetizers. A very early step might be purchasing ingredients.
    Later on, you realize that not all of the guests show up. If we're just going to keep moving forward, we make more appetizers than are needed.
    The alternative: when less guests show up or RSVP, instead of making as many apps as your ingredients/plans dictate, you make less.
    Now you have less appetizers and you store or freeze the ingredients you didn't use. You _could_ make them, and freeze the unused portions.
    But by sending the information collected later back to an earlier step, you instead have the raw ingredients to use in other recipes instead.
    This is a really lousy and forced metaphor, but it's all I could come up with off the top of my head. It just seems like there's value in the concept.
    On a different level, isn't this just sort of a form of backpropagation? The ability to reinform earlier calculations with the results of later ones?

  • @kdhrubo
    @kdhrubo หลายเดือนก่อน +1

    You are right - use BPM workflow engine instead and call AI wherever needed.

  • @laurensbulthuis3366
    @laurensbulthuis3366 11 วันที่ผ่านมา

    I've been using crewai to see if it was something I could use in a production setting. The future is definitely going to be more of agentic workflow with agents having the freedom to respond to requests (eg it can handle a variaty of inputs.. not just 1) but I totally agree that the current state is far from the future state. Currently it is very creative and it can do a lot but its a real struggle to get database connections and then do some pandas dataframe actions, and dont even get me started about the excess prompting and inconsistencies. Yeah i know shocking.. but then again i am looking at this from a business intelligence perspective. So for now the pipeline route is the preferred solution.. this however can quickly change when better frameworks come out.

  • @nirvanaseeker1
    @nirvanaseeker1 หลายเดือนก่อน +1

    How would this work if we used a BPM engine instead ?

  • @tonykipkemboi
    @tonykipkemboi 2 หลายเดือนก่อน +2

    So what you're trying to say is it's simple to build agentic workflows, hence do it yourself and don't use the existing frameworks?
    If yes, your video/take would have been much better and persuasive if you dug into the implemetation of the said frameworks while pointing out the cons. Your example is very basic and doesn't even need an agentic process tbh. You can write a script to handle this like you did.
    All am asking is a more in-depth comparison and not a one-sided take.

  • @alvandal
    @alvandal 3 หลายเดือนก่อน +2

    Great video, I am not big on TH-cam, but this is the first time I see someone really understanding the current state of the tech.

  • @gregkendall3559
    @gregkendall3559 หลายเดือนก่อน

    Have you seen Agent-Zero? Very much a clearer way to do some tasks.

  • @CookTheBruce
    @CookTheBruce 2 หลายเดือนก่อน

    Have you looked at VRSEN’s Agent-Swarm? Sounds like he avoids many of the pitfalls you describe here…

  • @andydataguy
    @andydataguy 2 หลายเดือนก่อน

    Step 1) understand how the tech works
    Step 2) use it to it's best ability
    Hasn't this always been the case with new technology for decades?

  • @Rusputin-eo6tv
    @Rusputin-eo6tv 3 หลายเดือนก่อน +1

    framework in the end is just how you organize your code.

  • @opensky1710
    @opensky1710 3 หลายเดือนก่อน +47

    My problem is having hard time to find girl friends.

    • @Mangini037
      @Mangini037 2 หลายเดือนก่อน +29

      You need a bigger pipeline son.

    • @Dreamingofyou317
      @Dreamingofyou317 2 หลายเดือนก่อน +6

      Build an agent to do your tinder for you

    • @f1l4nn1m
      @f1l4nn1m 2 หลายเดือนก่อน +2

      @@Mangini037and longer, maybe.

    • @christianboning2732
      @christianboning2732 หลายเดือนก่อน +1

      Don't waste your time with them.

    • @sahilchavan5173
      @sahilchavan5173 หลายเดือนก่อน

      Trust me we are done something this - Tinder 😂

  • @SamuelTerra22
    @SamuelTerra22 หลายเดือนก่อน

    Can you share the project shown in the video?

  • @bambanx
    @bambanx หลายเดือนก่อน

    most agent frameworks have sequential and hierarchical structure

  • @andrewanokhin5090
    @andrewanokhin5090 10 วันที่ผ่านมา

    LangGraph is DAG

  • @stanTrX
    @stanTrX 5 วันที่ผ่านมา

    Agents have a very bad performance right now. Consistency and reliability problems

  • @gracegoce5295
    @gracegoce5295 2 หลายเดือนก่อน

    Totally agree !!

  • @ali-om4uv
    @ali-om4uv 3 หลายเดือนก่อน +2

    Really cool idea!! You need to get rid of your erat8c teaching style tho. Especially with respect to quickly showing pictures jump g to Code etc....
    Anyhow....
    I would love to See the full fledged videos!!

    • @daveebbelaar
      @daveebbelaar  3 หลายเดือนก่อน

      Thank you for the tip! Normally, my tutorials are structured and step-by-step. However, this one was not intended to be like that.
      But it's good to know! I will most likely publish a video on this approach in the near future.

  • @MrEnriqueag
    @MrEnriqueag 2 หลายเดือนก่อน +30

    I agree with tour core message.
    But i dont think you've used langchain at the designed level or maybe dont know about langraph?
    Its not opinionated and you can (and should) orchestrate the flow however you want, you can make it linear, acyclical (every langraph example), you can decide the flow however you want, deterministally, defined by the LLM output etc.
    None of my agents are even driven by any default langchain agents, i have my own prompt, output format, tools etc.
    The framework is there to:
    1. Standarize the way you interact with the models
    2. Have a trackable verifiable analyzable way to build those graphs

    • @mayankraj2763
      @mayankraj2763 2 หลายเดือนก่อน

      On the spot, and most accurate comment!

  • @michaelirey
    @michaelirey 3 หลายเดือนก่อน +81

    While your critique of agent frameworks is spot on and compelling, it seems there's a misconception about their potential. Your custom system resembles langchain+langgraph, highlighting a need for deeper understanding before dismissing existing frameworks.

    • @imacuser101
      @imacuser101 2 หลายเดือนก่อน

      I was thinking the same thing or the ability to do “flow engineering” on autogen. I do think it’s a good idea to build your own but it will also be a lot of work so it’s all trade off but it’s more or less the same thing by the end of the video

    • @wml816
      @wml816 2 หลายเดือนก่อน +17

      There are some valid points in this video that agent frameworks are not remedy to all solutions, but I don't agree with lots of the things there:
      1. the title is just click-baiting and misleading and I really hate it - there is nothing showing agent framework will fail, just that they are too heavy for some simple tasks like what is demoed here, and is too complicated for some data scientists to fully adopt to
      2. the whole video is talking about why a DAG is more straight-forward approach, but did not talk about why agent framework and abstractions are bad. Abstraction always comes at the cost of design complexity, but also with the benefit of things like decoupling, extensibility, etc.
      3. it is trying to advocate for building your own DAG framework, while there are already many DAG orchestration frameworks available and I don't see the point building such thing by yourself.
      4. I doubt if the author understands those agent frameworks well enough to call them fail. The agent frameworks aim at resolving enterprise level problem at large scale, and it provides a lot of features to make a solution stable, maintainable, and scalable. Making it work on as a PoC is only the first step towards a production ready system. Discarding frameworks and trying to re-invent the wheels on all these pieces are not the right way to go.

    • @deter3
      @deter3 หลายเดือนก่อน

      agent concept is a misleading concept and we shall come up with more advanced concept than agent . if you hold up with agent concept , the workflow will be really complicated .

    • @mohammadhatoum
      @mohammadhatoum หลายเดือนก่อน

      I completely agree with your point. I was just about to mention that there is a common misconception or a lack of information regarding the capabilities of agents. LangChain, combined with LangGraph, can indeed perform the same tasks effectively.

    • @m4rtin419
      @m4rtin419 หลายเดือนก่อน

      Could you specify what you think is the misconception about their potential?
      Agent frameworks add inflexibility in a space that is very early in its development and still evolving. As a result, in my view, the potential must be really big to counter the disadvantages.
      Or, in other words, what outcomes can the frameworks provide that I cannot create by building my own pipelines or sequences, or however you approach it?

  • @SeuMuniz
    @SeuMuniz หลายเดือนก่อน +2

    Many points you mentioned make a lot of sense. However, as stated in a previous comment, this approach can lead to numerous transformations in a scenario that might require multiple steps. In other words, you would always have to go through a three-step transformation. And not all tasks need three steps. The issue with fixing it this way is that, first, it can cause delays in response time, and second, you won't fully leverage the best aspect of artificial intelligence, which is its ability to, for example, assess the difficulty level of a question.
    My proposal for improving the workflow is to use the first question asked, that is, the input for the first step when you mentioned 'transformation' or 'manager.' I would pass a prompt in this step. And in this prompt, as a response, it would have to classify the difficulty level of the question, with levels ranging from 1 to 5. I would create a logic where, if the difficulty level is between 1 and 3, or between 1 and 2, for example, there would be no need to go through all these steps.
    Because there are many trivial questions that wouldn't require so many steps, which is how the human mind works when we ask someone a question. If the question demands more time for reasoning, the person takes time to think. But when, for instance, you ask someone how much 1 plus 1 is, they quickly respond that it's 2, without needing to go through three steps for trivial questions.
    So, in the first prompt, I would include a difficulty rating mechanism. You would then establish a programming logic for each of these difficulty levels, allowing an agent with more resources than other agents to handle the reasoning, even based on previous contexts. And in this same step, using the response, you would receive both the difficulty rating of the question, which would be passed to the next step, that being the generation of the response. In this return, there could also be an analysis, based on what is being said, about the quality of the previous response given within the context, assigning it a level of assistiveness.
    For example, if you ask someone to activate the email and they don't understand correctly, then, as previously mentioned, the response would receive a rating indicating that it wasn't a good response. This would be added to the agent's context, so when it generates a new response, it would take into account that the previous answer wasn't adequate. This way, with a single step, we would have feedback on the previous situation and the current situation to process.

  • @hailrider8188
    @hailrider8188 3 หลายเดือนก่อน +12

    Cyclical/recursive algorithms are needed for many problems which in part, is what agentic frameworks attempt solve. Your sequential processing only paradigm is applicable only to certain problems.

    • @martinlorentsen4704
      @martinlorentsen4704 22 วันที่ผ่านมา +1

      Breaking down the problem is however a good point.

  • @deter3
    @deter3 หลายเดือนก่อน +3

    The concept of an agent is very naive due to the current limited capabilities of LLMs. I've seen too many solutions to current problems that are just stacks of LLMs with higher costs, higher latency, and suboptimal solutions.
    When thinking about humans as agents, each agent should have specific capabilities (not just role-playing) and specific workflow inside to deal with complex problems at light speed. However, looking at current LLMs, they are slow, lack of specific capabilities and workflows with less reliability .

  • @alexanderandreev2280
    @alexanderandreev2280 2 หลายเดือนก่อน +6

    langgraph + function calling + langsmith = production
    "LangGraph is a way to create these state machines by specifying them as graphs."(c) LangChain

  • @EmilioGagliardi
    @EmilioGagliardi 3 หลายเดือนก่อน +14

    Interesting. Working on a CrewAI project atm and I found I was using a DAG approach to tasks because of my experience with Kedro. One task, one transformation, one output and keep working sequentially. In a nutshell, you're describing Kedro's approach and philosophy. Its just not fine-tuned for generative AI use cases yet. What I've found with multi agent apps is that I end up building tools that do all the heavy lifting and the agent Is used to generate a piece of data (like a query string) used in subsequent processing. The challenge is building guardrails to prevent an agent from going off the reservation when something doesn't work. If you give an agent access to a tool as simple as a search tool, if it gets stuck, it could end up calling the tool in a loop and there goes your credits. So we're still having to treat agents like toddlers... would be interesting to see your take on kedro.

    • @ricasco
      @ricasco 2 หลายเดือนก่อน

      Hi! I believe you are Italian like me, and I also already built agents with crewai related to content creation for ig and x. Atm I’m building a lead gen agent linked to another agent that then sends email to those leads
      We can share knowledge, it’s not so common find people of our country which are working on CrewAi. If interested reply to this comment 🙏

    • @bxkayy
      @bxkayy 2 หลายเดือนก่อน

      ​@@ricasco Hi, could you maybe tell me more about how exactly your lead gen agent works? Which sources does it use to find the leads? Sounds quite interesting :)

    • @daburritoda2255
      @daburritoda2255 หลายเดือนก่อน

      This guy definitely worked at McKinsey

    • @LeonardoAmigoni
      @LeonardoAmigoni หลายเดือนก่อน

      Ciao Belli!!

  • @Fezz016
    @Fezz016 2 หลายเดือนก่อน +34

    Basically what this video is saying is this, "I do not understand the Agentic Framework Flow yet, so I will just critique it in the meantime because I do not understand it"

    • @Chris_Faraday
      @Chris_Faraday 2 หลายเดือนก่อน +1

      Kind of LOL - its early and maturing as a more intelligent layered (much needed) framework - agentic with RAG / Lang is still highly compelling

    • @m4rtin419
      @m4rtin419 หลายเดือนก่อน +1

      I am curious, what actual results (eg in terms of performance) does the Agentic workflow provide for you that you couldn’t generate with a more flexible approach (eg pipeline, as outlined in the video)

    • @meh8099
      @meh8099 10 วันที่ผ่านมา

      Agents can work back and forth, basically discussing the output and improving if needed. A pipeline is one way.

  • @toi500
    @toi500 3 หลายเดือนก่อน +14

    One of the worst videos I've seen this year.
    You ignored a very capable framework like LangGraph. Also, the fact you did not talk about hierarchical or sequential agent workflows and you ONLY focused in the multi-agent ones to present us "your case" is not serious.
    In any event, even a simple multi-agent graph can achieve a 100% success rate in resolving tickets. You don't need to hardcode all those steps at all.

    • @jasonsuarez6439
      @jasonsuarez6439 3 หลายเดือนก่อน +2

      I thought the same starting the video but I ended up appreciating the effort to take a step back to first principles. It's refreshing and at least make us think about choosing a framework.
      If he was really dishonest, I could have talked about the biggest problem of those agentic frameworks... latency at scale

    • @daveebbelaar
      @daveebbelaar  3 หลายเดือนก่อน +16

      I might be too ignorant here, but I haven't seen any of those frameworks implemented in production yet. I'm aware that I just scratched the surface here and that there are indeed many different agent workflows. My point is not to discard all of them but rather to mention that, based on my experience, for most business automation problems, building your own pipeline from scratch is typically better. What's your experience with agent frameworks, and do you have a good production-ready use case? I'd love to learn more about this because I really want to like them!

    • @ShpanMan
      @ShpanMan 3 หลายเดือนก่อน +1

      @@daveebbelaar Not a single person thinks Agents are ready for production. It's an early implementation prototype that gets better and better with each new AI model that comes out. In a few years it will crush any human and send you to retirement (in a good way).

    • @bphilsochill
      @bphilsochill 2 หลายเดือนก่อน

      Do you have a use case to share?

    • @Shri
      @Shri 28 วันที่ผ่านมา

      > In any event, even a simple multi-agent graph can achieve a 100% success rate in resolving tickets. You don't need to hardcode all those steps at all.
      Why would you waste GPU cycles and $$$ on this when you just need GPU for classification and rest is plain old switch case? Using multi-agents for this is nutty.

  • @therealsergio
    @therealsergio 2 วันที่ผ่านมา

    I'm sorry but your point is that if your problem can be decomposed into pipelines and nothing but pipelines, then why bother with an agentic framework... Of course?! That's obvious. Just allow the rest of us to imagine "society of mind" agent organizations that collaborate in not strictly linear pipeline logics, and encourage us not to all invent our frameworks and consider building on the ones that are the most flexible. Autogen for me, but - yes - even a tool like n8n is great for quick linear pipelines and you can do that with no code BTW.

  • @teprox7690
    @teprox7690 2 หลายเดือนก่อน +3

    I think we will see special models trained for the agent workflows. Right now, they are trained with way too much knowledge for this workflow. Then the latency will also go down. I'm currently wondering why we haven't heard anything about this approach yet.

  • @LeonardoLeao-of5di
    @LeonardoLeao-of5di 4 วันที่ผ่านมา

    I have reached the same conclusion, but for other reasons. In fact I dare to say that these frameworks have been slowing down actual innovation. They are very helpful when you are starting end experimenting, but when it comes to go to production they will give you a hard time. Managing token count, tool calling, structured output, entry/exit rules, logging and all the "boring" stuff production needs will be very messy and will force you to rewrite the native modules. My take on data pipeline: it will depend on the task, but I have 2 approaches: (auto managed agent) setting agents as tools and work with tool calling or state machines, to control steps and transitions (what you built from scratch).

  • @NakedSageAstrology
    @NakedSageAstrology หลายเดือนก่อน +3

    I am working on a project that uses a combination of agents and pipelines. It has agents that each roleplay a specific function of mind, each agent working together to simulate a human mind.
    They are divided up according to the ancient Yogic philosophy of mind, Ahamkara for Ego, Manas for processing, Bhuddi for decisions, and Chita as the store house of memories.

    • @chadsly2
      @chadsly2 28 วันที่ผ่านมา

      Where can we see this work? Sounds fascinating

  • @333SFx
    @333SFx 3 หลายเดือนก่อน +5

    Langgraph

  • @abdulrehmanbaber2104
    @abdulrehmanbaber2104 3 วันที่ผ่านมา

    Langgraph solves this all.
    Plus DAG workflows shouldn't be considered Agentic.

  • @brianhauk8136
    @brianhauk8136 2 หลายเดือนก่อน +3

    You said this is a work in progress, and I'm wondering if you've compared the results of traditional Mixture of Agents responses with your pipeline approach for various common use cases.

  • @theanush123
    @theanush123 15 วันที่ผ่านมา

    I have been in dilemma when and where to use the existing agent-based frameworks vs ETL kind of workflow. I have been given similar work as my thesis as to developing a Multi-Agent RAG System for cross-domain information extraction and retrieval. Could you provide guidance on the following:
    Agent Specialization: How can I design specialized agents for different Confluence spaces and internal services (e.g., sick leave, vacation request, IT ticket)?
    Coordination: What strategies can I employ for a coordinator agent to manage cross-domain information retrieval effectively?
    Domain Adaptation: How can I implement transfer learning techniques to adapt agents to new domains?
    Framework Flexibility: What considerations should I keep in mind to create a flexible framework that can accommodate new spaces and internal functions?
    Additional Questions:
    Are there any existing frameworks or tools that could be adapted for this purpose?
    What are some potential challenges and best practices to consider during development and implementation?
    I'm eager to explore different approaches and learn more about this topic.
    Please suggest!

  • @UNCCNICK
    @UNCCNICK หลายเดือนก่อน +1

    The discussion about the data pipeline is accurate, but it cannot be used to prove that a multi-agent system is ineffective or failing. You are still thinking like a software/data engineer instead of an AI engineer. Consider this: when developing any new data pipeline or system, do you ever need an LLM to help? If yes, then there must be a way to integrate the LLM directly as part of the pipeline or system too.

  • @shobhitsadwal6081
    @shobhitsadwal6081 4 วันที่ผ่านมา

    The only thing I understood from this video is not build your project solely depending on agents, build a solid pipeline upto the level where you have proven systems running it.

  • @goat-of-neptune
    @goat-of-neptune 2 วันที่ผ่านมา

    is there a way that the user gets to know in an agent framework, which llm is solving his task, so that he gets consistant and repeatable results?

  • @blackpete5877
    @blackpete5877 23 วันที่ผ่านมา

    From what I see, your key argument about data pipeline flows vs agentic structures does not work in dynamical systems. In linear, simple and pre-determined flows maybe. In chaotic systems? I don't see how.

  • @d.g.567
    @d.g.567 24 วันที่ผ่านมา

    Isn’t this what LangChain is supporting? LangGraph was exactly created for this to have a somewhat stateful and to a certain extend deterministic process flow with LLMs.

  • @Nathan-pu9um
    @Nathan-pu9um 18 วันที่ผ่านมา

    Just checking, are you giving the agents their own vector database with the business information/logic needed? Im looking into this using something like pinecone, then it can specifically interact with its own information

  • @KirillEgorov-p7y
    @KirillEgorov-p7y 2 หลายเดือนก่อน +2

    Hey, looks very reasonable. Have you looked at prefect and its new controlFlow libraty?. It helps to manage this data pipeline pattern for LLM

  • @iham1313
    @iham1313 หลายเดือนก่อน +1

    pipelines are good for linear - step a then step b then step c - tasks. using a team of agents is imho meant for nonlinear tasks, where you might need step a then step c and then step b, or even adding or removing steps from the - here it comes - DYNAMICALLY formed pipeline based on the decisions of an (managing role) agent.
    using the wrong tool for the wrong task is always an easy way to critique something or someone.

    • @Shri
      @Shri 28 วันที่ผ่านมา

      Where would you ever use such a system except for chatbots? Business is deterministic and everything in this World is a business process. 99.9% of the time you wouldn't need dynamically formed pipelines at all.

  • @ibrahimmusah2015
    @ibrahimmusah2015 2 หลายเดือนก่อน +2

    I strongly agree with you using the ETL approach. Considering building a pipeline each step or agent flow can be accessed in any order, given the developer more flexible and ease in assigning tasks to agents. Thanks for sharing Dave

  • @QuinnEschenbach
    @QuinnEschenbach 25 วันที่ผ่านมา +1

    Super interesting, I have come to the same conclusion about most "agentic" frameworks, the react approach is to inconsistent for production applications.
    Have you tried langgraph? It goes into a very similar direction like you datapipline approach.
    And together with function calling and structured output it allows you to build super powerful apps.

  • @jackprophesy
    @jackprophesy 19 วันที่ผ่านมา

    wish i had seen this before beating my head against dify, flowise, n8n... 100% spot on

  • @koen.mortier_fitchen
    @koen.mortier_fitchen 2 หลายเดือนก่อน +2

    Agreed. Take a simple airtable, input cell connected to an llm, and an output cell for its response. There you have your first step of an agent. The hours I lost on learning Langchain, Flowise, you name it

  • @AI4Ever4Life
    @AI4Ever4Life 2 หลายเดือนก่อน +1

    Can you help me understand on what's the difference between the idea of building agentic applications using LangGraph vs the one you proposed in this video?
    You did mention about LangChain style of making agents but LC completely revamped their agentic application building framework using LangGraphs where one can get full control of the behaviour or the agentic workflow with principles from DAGs.

  • @GauravDhiman
    @GauravDhiman หลายเดือนก่อน +1

    Very nice and detailed video, but whatever you explained as exactly the same as LangGraph. Rather than writing from the ground up its better to use LangGraph to determine the flow between intermediate steps.

  • @sophontec2822
    @sophontec2822 28 วันที่ผ่านมา

    What's the VSCode extension for running python script as a jupyter (interactive) mode?

    • @daveebbelaar
      @daveebbelaar  27 วันที่ผ่านมา

      Check out this video: th-cam.com/video/mpk4Q5feWaw/w-d-xo.html

  • @abhinavmane60
    @abhinavmane60 19 วันที่ผ่านมา

    Hi @daveebbelaar can you share the codebase for study purposes please?

  • @newfrontiers5673
    @newfrontiers5673 หลายเดือนก่อน

    Has anyone noticed how damned expensive the OpenAI Assistants API is?

  • @NockyLucky
    @NockyLucky 2 หลายเดือนก่อน +3

    This was so wrong

  • @mikekidder
    @mikekidder 3 หลายเดือนก่อน +2

    state machines, state machines, state machines...

  • @teprox7690
    @teprox7690 2 หลายเดือนก่อน +1

    Everything is great. I have built a few tools myself with Instructor. To really automate business processes, however, I see the problem with data protection. In the EU, I can't just put a complete e-mail into an LLM. How do you solve this? It would be great if you could shed more light on the subject of data protection! Thank you very much for your excellent content!

    • @RealEstate3D
      @RealEstate3D 2 หลายเดือนก่อน

      Exactly what I build for my company. Small AI that discovers PII in a text that I want to give our offices for use in their intranet before sending it out to public LLMs. Beforehand I tried Presidio and octopii. Both use regexp. Got bad results.

  • @noduslabs
    @noduslabs 2 หลายเดือนก่อน

    Good take. All those frameworks are good for getting familiar with the principles but if you want to make a unique specialized product you need to code everything on your own. Probably you won’t need agents for some tasks even.

  • @_jen_z_
    @_jen_z_ หลายเดือนก่อน

    In DAG one can go back to already passed step

  • @JohnDoe-m6s
    @JohnDoe-m6s 3 หลายเดือนก่อน +1

    @13:33 Please create an in-depth video on these concepts using the example that you are showing in this video !

  • @mmasa1
    @mmasa1 16 วันที่ผ่านมา

    I get where you are coming from, but...
    1) CrewAI has sequential processing. Works pretty similar to traditional pipelines.
    2) There are a number of use cases where criss-crossing agents is necessary (i am thinking validation tasks).
    Finally, traditional pipelines are nice but I always find myself solving problem that others have already solved..
    so it's either copy paste into my custom Pipeline or embrace the OS. I find a lightweight framework like crewai is very useful for many of today''s tasks (in production).
    With the ability to include and write custom tools easily - it';s like having a traditional pipeline on steroids.

  • @attacksoil
    @attacksoil หลายเดือนก่อน

    my answer to this is async pipeline

  • @f1l4nn1m
    @f1l4nn1m 2 หลายเดือนก่อน

    Thanks for sharing. There’s a tradeoff that a developer needs to balance between reasoning agility and hallucinations minimization that results in how much one wants to constrain the dialog flow. Your case is naturally well suited to be solved by two steps, always the same, ETL-like pipeline. If you test your paradigm with a real chat interaction where a user wants to order at Starbucks you will easily get tired framing it with the ETL-like paradigm. Indeed there’s art in being able to see apparently complex dialogues as more linear pipelines but the overall feeling it that you’re losing much of the flexibility that LLMs can provide you.

  • @aimattant
    @aimattant 2 หลายเดือนก่อน

    I followed through. Your system looks, great, with content creation processing with your AI generative pipeline. However, I think the point of Agentic, which is not there for sure, is to be able to work in a non-rigid system, the bottom-up approach, but where all systems are communicating together. So it is a build-up on pipelines that you have. Which is amazing by the way 😊 And putting them all together in a system that works autonomously. The idea is to get AI to the point where it will work as a team without instruction. The whole point is why Sam and all the others are building these huge systems now. One thing I want to get my head around is nongenerative AI; is content base. One thing I am seriously delving into now is API endpoints of all kinds with AI LLM model support. With some tasks, they are not required. But with many where data is involved, they are. Hope this makes sense. Not here to put a dent in your wonderful work. You are great at coding and putting the AI infrastructure together. Look forward to following along with you. AI agent workflows are the way forward now.

  • @not_a_human_being
    @not_a_human_being 2 หลายเดือนก่อน

    existing frameworks are bloated, you have a point there, it's like they only make sense to people who created them. but I'm not sure what exactly is Celery adding here? extra complexity with no extra gain. Defining DAGs is fun, but usually doesn't add much value

  • @SebKrogh
    @SebKrogh หลายเดือนก่อน

    I think it’s the result of people wanting to AI'ify everything and try to build automations for processes that would be solved better with something more simple

  • @qredence
    @qredence 2 หลายเดือนก่อน

    Not 100% agree but largely clearly on our side!
    In fact the currents frameworks are not enterprise ready, unpopular opinion you seem to share too !
    Imo Orchestration is the real key ;)
    but agentic systems with stateflow nested pattern connected to external tools/fabric/composio/else can be a part of solution
    The other key is RAGsystem, uncertainty first focus based framework that adds more complexity but as we think is that is almost mandatory for companies.
    Greate video !
    You should follow closer Microsoft Fabric and Semantic Kernel

  • @threevia.travel
    @threevia.travel หลายเดือนก่อน

    Agree on the idea not to use frameworks and build custom, however, the data pipeline / sequential DAG based approach will not achieve the fluidity that gen ai promises.

  • @ds920
    @ds920 หลายเดือนก่อน

    Yeah, that’s true…!
    (that’s why I’m working on a open source execution environment for agents)

  • @ethansabljak
    @ethansabljak 27 วันที่ผ่านมา

    Max smart, 007 & 99

  • @jonm691
    @jonm691 2 หลายเดือนก่อน

    I really liked your video, and the message, but I just kept thinking that you'd just done LangGraph 'properly'. It has much more capability, more transparency, more enterprise considerations. etc. I'm not sure I agree that you must never under any circumstances loop back. All that means is that you leave open a need to fail a process and with additional context, get it resubmitted. Did I miss something?

  • @ylazerson
    @ylazerson หลายเดือนก่อน

    very well said!

  • @denisblack9897
    @denisblack9897 3 หลายเดือนก่อน +3

    Another day - another wave of similar videos…
    I did not get this agents bullshit from the start(felt like data gathering scams to me), cuz i was chaining prompts when chatgpt came out. You gonna chain prompts manually if you are building something more than a useless demo.

    • @mrprogamer896
      @mrprogamer896 3 หลายเดือนก่อน

      could you explain more about "chaining prompts manually"?
      Everything about agents seems confusing to me tbh.

  • @ContextFound
    @ContextFound 2 หลายเดือนก่อน

    You have a solid point about agentic frameworks usually not being the right tool for tangible business applications. It's about automating the repetitive.

  • @jonasgabrielmbn
    @jonasgabrielmbn หลายเดือนก่อน

    AutoGen allows groups of agents to have a specific order of execution, so you can have them interacting like in a DAG workflow

  • @yasminelmahdi2003
    @yasminelmahdi2003 2 หลายเดือนก่อน

    Hey Dave, I'm working on my undergrad project research, and it's about AI agents, I have a couple of questions if there's a way could you share a way to contact

  • @muzzletov
    @muzzletov หลายเดือนก่อน

    a week alter: my video on why agent frameworks will succeed (and what to use). opinionated bs

  • @juliovac2113
    @juliovac2113 2 หลายเดือนก่อน

    I'm a noob with coding so I find crewai a lot easier to create from scratch than your toolkit, but I'd like to change that, what do you recommend to get started on grasping it properly from the start?

  • @dalaun
    @dalaun หลายเดือนก่อน

    does openAis structured output release change your opinion ?

  • @Steph-jazz
    @Steph-jazz หลายเดือนก่อน

    Excellent !

  • @AIgencify
    @AIgencify 2 หลายเดือนก่อน

    very interesting i was applying this kind of tasks in my company too like email reading attached files processing etc. is code avaible? thanks alot

  • @AtAllAnAlias
    @AtAllAnAlias 2 หลายเดือนก่อน

    Good old Programming: Imperative Programming
    "AI" programming: Declarative programming

  • @Artem-jm9xd
    @Artem-jm9xd 21 วันที่ผ่านมา

    Bro, you are a genius! Data Pipeline??! wow, eureka!

  • @liron92
    @liron92 2 หลายเดือนก่อน

    Thank you, very informative. Which pipeline registry tool do you use?

  • @chadsly2
    @chadsly2 28 วันที่ผ่านมา

    Dave, thank you for making this video. I can't tell you many times I thought I was the problem when trying to get AutoGen and CrewAI to do anything beyond the most basic tutorial. The more I look at these frameworks, the more I realize how green this field is.

    • @daveebbelaar
      @daveebbelaar  28 วันที่ผ่านมา +1

      Everyone is trying to figure this out

  • @dustindustir521
    @dustindustir521 หลายเดือนก่อน

    We did exactly that approach in a current Projekt and it works great.

  • @agnivamahata3870
    @agnivamahata3870 2 หลายเดือนก่อน

    This works, but giving AI to take decisions are supercool, new libraries will emerge check agency-swarm.
    These works for data driven processes but first creative processes agentic systems make sense

    • @dievas_
      @dievas_ 2 หลายเดือนก่อน

      Yeah, but you dont need frameworks for that, agents are just basic methods that call each other or tools. You also create some class for state management. Function calling is also easy. All those frameworks are opinionated and only adds bloat.
      Unless youre making something with 20 agents, but that would be nonsense...

  • @stewartfarquhar1280
    @stewartfarquhar1280 3 หลายเดือนก่อน

    great work. please publish the next tutorial. is there a github for the code?

  • @7codo
    @7codo หลายเดือนก่อน

    You removed the ability to decide from the LLM

  • @agi_lab
    @agi_lab หลายเดือนก่อน

    One very good usecase for agents is the ability to take a decision on using the tools which they have at their disposal. A very lightweight less bloated framework which can do this (Basically function calling but with consciousness) will win the race. I am thinking of a design pattern instead of a framework will work.
    This is coming from my experience of putting crewai in prod and see it fail miserably at times

    • @Shri
      @Shri 28 วันที่ผ่านมา +1

      But why would you even need that ability except for when building chatbots? Your business processes are not dynamic. They are pretty static. What is dynamic is the data being fed into the process. If your business process is itself dynamic then your problem is not AI but your business process itself.

    • @agi_lab
      @agi_lab 25 วันที่ผ่านมา

      @@Shri you dont really need agents for such tasks. Normal bots would do the same thing (static requirements and needs). Think of an agent which can generate ppts for you project, searching internet, compiling from various sources and writing the ppt content. This is what we should aim for when working with agents.

  • @Geschmacksberater
    @Geschmacksberater หลายเดือนก่อน

    Seems a pretty neurotypical appoach to me

  • @edendjanashvili2963
    @edendjanashvili2963 หลายเดือนก่อน

    Is the code you presented here available anywhere?

  • @bgriffin5447
    @bgriffin5447 2 หลายเดือนก่อน

    It’s simpler for you because of your ability but for 95% of people having a framework is a better option

    • @dievas_
      @dievas_ 2 หลายเดือนก่อน

      No its not, basic python is enough for any kind of agentic flow, these frameworks only complicate things.

  • @zanderrossouw1929
    @zanderrossouw1929 2 หลายเดือนก่อน

    I would LOVE to see your design pattern in depth

  • @thepetewinn
    @thepetewinn 2 หลายเดือนก่อน

    I can’t agree with this more strongly

  • @fallinginthed33p
    @fallinginthed33p หลายเดือนก่อน

    So much abstraction going on.

  • @afazeli8361
    @afazeli8361 2 หลายเดือนก่อน

    Awesome content, Keep up the good work

  • @theguygrossi
    @theguygrossi หลายเดือนก่อน

    Super helpful, ty!

  • @hannesg.3586
    @hannesg.3586 2 หลายเดือนก่อน

    Thanks for the video. What kind of whiteboard tool do you use?

  • @joesmoo9254
    @joesmoo9254 หลายเดือนก่อน

    Great contribution