ACE Framework Overview and Intro: Autonomous AI Agents!
ฝัง
- เผยแพร่เมื่อ 2 ต.ค. 2024
- www.skool.com/...
🚀 Welcome to the New Era Pathfinders Community! 🌟
Are you feeling overwhelmed by the AI revolution? You're not alone.
But what if you could transform that anxiety into your greatest superpower?
Join us on an exhilarating journey into the future of humanity in the age of AI! 🤖💫
🔥 What is New Era Pathfinders? 🔥
We are a vibrant community of forward-thinkers, innovators, and lifelong learners who are passionate about mastering the AI revolution. From college students to retirees, tech enthusiasts to creative souls - we're all here to navigate this exciting new era together!
🌈 Our Mission 🌈
To empower YOU to thrive in a world transformed by AI. We turn AI anxiety into opportunity, confusion into clarity, and uncertainty into unshakeable confidence.
🧭 The Five-Pillar Pathfinder's Framework 🧭
Our unique approach covers every aspect of life in the AI age:
1. 💻 Become an AI Power-User
Master cutting-edge AI tools and amplify your productivity!
2. 📊 Understand Economic Changes
Navigate the shifting job market with confidence and foresight!
3. 🌿 Back to Basics Lifestyles
Reconnect with your human essence in a digital world!
4. 🧑🤝🧑 Master People Skills
Enhance the abilities that make us irreplaceably human!
5. 🎯 Radical Alignment
Discover your true purpose in this new era!
🔓 What You'll Unlock 🔓
✅ Weekly Live Webinars: Deep-dive into each pillar with expert guidance
✅ On-Demand Courses: Learn at your own pace, anytime, anywhere
✅ Vibrant Community Forum: Connect, share, and grow with like-minded pathfinders
✅ Exclusive Resources: Cutting-edge tools, frameworks, and insights
✅ Personal Growth: Transform your mindset and skillset for the AI age
🚀 As You Progress 🚀
Unlock even more benefits:
🌟 One-on-One Mentoring Sessions
🌟 Exclusive Masterclasses
🌟 Advanced AI Implementation Strategies
💎 Why Join New Era Pathfinders? 💎
🔹 Expert-Led: Founded by a leading AI thought leader, connected with top researchers and innovators
🔹 Holistic Approach: We don't just teach tech - we prepare you for life in an AI-driven world
🔹 Action-Oriented: Real skills, real strategies, real results
🔹 Community-Driven: Join 300+ members already navigating this new era
🔹 Cutting-Edge Content: Stay ahead of the curve with the latest AI developments and strategies
🔥 Don't just survive the AI revolution - lead it! 🔥
Why you look like Elf Priest or something ???
Never, in a million years, could I imagine Captain Picard getting described as "Elf Priest". You win the comments today.
@@DaveShap I was going to say Star Trek Captain too. Great work, clearly a framework where humans and AI coexist well.
Why do you look like an orange circle with the letter H, bro?
@@ohiosteamandsteel that's what you can comment on after watching this video? To follow your poor example, leave comments to people who can add value. Some comments are better left unsaid.
@@DaveShap looks like you need a blonde wig and elf ears for your next video... Same jacket and shirt, just don't acknowledge the fact that you look like "John Luke Legolas"
For me personally, I watch Dave's videos, not for the content with the potential of using his content, but to marvel at his ability to verbally and rapidly narrate his thoughts. It's magic. Dave Shapiro is my David Copperfield.
That’s why he’s qualified to wear that wardrobe 🖖
👌🏼My go-to Ai Analyst and Online Mentor
*gives standing ovation* this is so awesome. This is doable right now and who KNOWS what will happen if this is implemented even with the current amount of processing power we have
I find your videos very informative, and useful for development in understanding of how the world has worked, works and will work. I hope you continue and pledge that my life goals align with yours. Thank you and have a wonderful day!
So glad to have people like you in this world working for the betterment of humanity. I truly hope this planet and its inhabitants can live long and prosper!
David, bravo for your excellent presentations. When your content moves beyond my understanding, I listen several times and absorb more like swimming😅
I really appreciate your references to psychology, philosophy and neuroscience, including Maslow, Kohlberg
My background when I taught on a college level over 30 years ago was child development, Piaget is the best for language development. You are mentioning so many ways we will navigate with AI.🎉❤😊🎉
I hope you don't absorb swimming via your lungs
oh, I watched it first! Never happend to me before
Loves the fact that you are forcing the interface to be natural language between the layers.
Thank you David for putting this together !! I can't wait to try out the implementation. I specifically remembered that in the "A Thousand Brains" book Jeff mentioned a new approach is needed that can "think" like a human and the human brain neural mode. I feel like you are getting close !!
Love the uniform sir 🫡
Killing it Dave! Really love this framework. I’ve had success recently with running some very slow work automations with some scripting and some local llama2 models. Now that the local models have the chops, implementations of frameworks like this have never had more potential. Easy on the wallet too.
Nathan!!!!
Great job. Would like to see 2 components added:
The record keeping you already mentioned to be important for the buses.
Human escalation point.
Both are implied as a best practice but it would be great to spell them out.
17:13. Another benefit to using NL as a intermediate communication medium, is I needed to convert a 1,000 line script from Javascript to Python. Just giving it the Python and going straight to Javascript was terrible, took hours to make the python functional. The second time I had to do it, I instead first asked it to explain the code, then I took that NL explanation and used that to instruct to generate Python and I had a working script in a matter of minutes.
David, let me know if you want to connect I've created an AI-SaaS from scratch that delivers at near zero marginal cost, and I've already spoken to PANW, IBM, and Dell about GenAI.
Connect on linkedin or jump into the discussions: github.com/daveshap/ACE_Framework/discussions
Inspired work, David. I find the buses to be an especially brilliant idea and the keystone to the whole system, particularly because of how cleanly they tackle certain tricky problems that LLM components have when communicating with each other. I honestly think that armed with something like this, even without any improvements on existing models, AGI is within reach.
Hey Dave, I’m working on exactly what you’re talking about for a desktop assistant / development framework like React but for composing agents as “components” . Are you open to growing your team for this initiative. Would love to show you what I have so far and discuss what we could do together.
Your expository writing skills are next-level; you're really good at explaining what's on your mind.
Fantastic video David! I'm usually not one to comment very often but felt the need to on this one. I don't understand all of it yet as I'm just learning but I grasped the basics and upon several more watches I'm sure I'll understand it as I was a bit distracted while trying to watch it the first time and was watching on double speed. Lol. I just wanted to say thank you for all the hard work you do and for making the information easily digestible and I'm very excited to see where this goes in the future! 😁
The scientific paper will help as you'll be able to dive more deeply into any aspect
Asimov would go crazy seeing your videos. Look at us, our vocabulary, our technology and future, our culture and society. Asimov would go crazy
I’m just an ordinary guy who is fascinated by artificial intelligence. I’m only writing this from the first 11min. of the video,but I think I’m just understanding Subconscious and conscious layering is built in?
In this case, "unconscious" is the processing happening inside the LLM. Subconscious is inside each layer. The buses are consciousness
Love your videos. It's a pity you don't have an audience many times bigger. Some of the best youtube channels I ever saw still have less than one million subscribers. I would say that you and Isaac Arthur are my two favorite science and futurist channels. Keep up the good work
I'm not optimizing for subscriber growth. I have the audience I need to get my work out there. It will grow over time if necessary :)
Honestly, it makes sense that there's only a niche group here for now. Give it a year, as things start coming to fruition, and he'll start blowing up, I bet.
Great work as always.
If your able to attract lots of people for projects. Why not simply work out who has some kind of management abilities and set up parallel teams? E.g. raven 1, rave 2. Or ACE 1 ACE 2. And then each team can move pretty quickly and report back their issues and work fairly autonomously. Rather then waste any time on procedures
Yes, the problem was I wanted to do consensus models before, but that just doesn't work. I learned the hard way that you need strong leadership and I was not yet equipped for that. It goes against my nature to tell people what to do, but for the pace of things, you kinda have to
Death by committee
Yep, exactly
@@DaveShap hmm an interesting result to ponder. I wonder if this problem is paralleled when considering closed Vs open source and specifically their relative productivity?
This is extremely cool, but can you run this without coding skills? Like running it locally, while not being overly complex
Yo thanks for your passion and independent leadership in this. Good luck with the scrum and Ill be tuning in for all the updates! (This is why sci-fi fans make good leadership in AI. We’ve already dreamed up a gazillion potential scenarios of how things can go wrong so we come preloaded with the right questions to ask)
This is actually a really damn useful framework.
I am working on a large game and I liked the thought of the gameplay being orchestrated via some AI. This ACE Framework is exactly what I'd need for that
I mean, I'm not at the stage in development yet, where I can start working on this, but your ACE framework definitely is a very very solid corner stone to such a global game orchestrator.
Dave, as always, love your work ✌️
You are on a good path! I'm incorporating the framework into a workflow for my AI autonomous agent quest.
Please consider a segment on AI to curate and configure user portals synchronized to smartphones using sha256 certs for privacy. Setting up and maintaining a large number of users with custom portals for data privacy and access to personal dashboards would be useful.
How would this look like with multiple agents in a federated learning way ?
Thanks for this, it's really helpful information and i look forward to the paper. Excellent work from you and your team!
Ok, so, could you put them in mine craft? Or a survival civ building game. Like dwarf fortress basically?
Yeah, I've got a few game devs on the team or interested.
His videos are amazing and so informative
Excellent synopsis of the ACE Framework for self-governing AI agents. Make sure to investigate SmythOS for more sophisticated AI options. #AIAgents #ACEFramework #SmythOS
How do we know that someone doesn't use an AI version of a city simulation *game* to create a perfect cult?
Or do we just create a city simulation of our own and learn to fight those cults beforehand?
From a glance, it seems like overall security bus would let that one slip through, even with an external monitoring
I'm sure there will be AI cults, like what they show in games like Cyberpunk and other places.
🎯 Key Takeaways for quick navigation:
00:00 🚀 *The ACE Framework (Autonomous Cognitive Entity framework) has been completed and a scientific paper about it has been submitted for publication. It's a highly researched and well-cited framework in the field of generative AI.*
01:32 🎮 *The ACE Framework is designed for generative technology and AI applications, including chatbots and game development. Two primary demonstrations are planned: a hackable 2D game and a desktop assistant.*
05:26 🧠 *The ACE Framework is structured around six layers of increasing abstraction, from aspirational (morality and mission) to task prosecution (individual task execution), ensuring a coherent decision-making process.*
14:54 🚌 *The ACE Framework utilizes two unidirectional buses, the Northbound bus (read-only) for telemetry and the Southbound bus (top to bottom) for control. These buses enable structured communication among different layers of the framework.*
19:12 🛡️ *The aspirational layer at the top ensures that the highest-level goals, ethics, and mission drive the behavior of the ACE Framework. If necessary, it can send a termination signal down the layers for safety.*
22:22 🚌 *The Northbound and Southbound communication buses in the ACE framework are crucial for understanding agent decisions and consciousness.*
23:19 📚 *The ACE framework follows four overarching principles: layered model, abstract to concrete, cognition-first, and decoupled cognition and action.*
24:29 🧠 *The aspirational layer in ACE defines the agent's animating imperatives, moral judgments, and ethical decisions based on frameworks like human rights.*
28:14 🔍 *The global strategy layer in ACE focuses on understanding the environment, maintaining beliefs, and generating strategies for achieving goals, adapting to different situations.*
32:12 💼 *The agent model layer in ACE processes real-time telemetry, environmental data, and knowledge to understand its capabilities and generate missions and strategies for the upper layers.*
43:23 📋 *The ACE Framework involves cognitive control layers responsible for task switching and task selection, crucial for autonomous AI agents.*
46:21 🌍 *Task prosecution is the interface with the outside world, executing specific tasks and interacting with the environment.*
48:55 🛡️ *The security of the ACE Framework is addressed through strategies like security overlays, runtime validation, ensemble models, and inference inspection.*
51:29 🤖 *Using a mixture of experts or ensembles of different AI models can enhance robustness and resistance to biases and failures in individual models.*
54:00 💡 *Ensuring the reliability of AI models through monitoring and auditing of inputs and outputs can enhance their ability to make moral or ethical judgments.*
Made with HARPA AI
self preservation and hierarchy hijacking might still be relevant depending on what you want to call "self". For example Gilles Deleuze believed that identity is the result of difference. If so then how one entity could be same entity in time? (rhetorical) In other words self-preservation might be extreme desire to avoid some very specific changes what would make ACE become another identity.
This video could be more captivating by explaining what a cognitive entity is, why we would be interested and why it would be useful, and leave the explanation of layers on mission for a later moment in the video. I know about ethics, moral and mission, I know about the movie "Her" and I know about Maslow, the only thing I don't know about is what I had to wait 15 minutes in the video: the cognitive entity.
Thank you so much for providing such wonderful resources.
I'm surprised that someone as knowledgeable as you in this field knows that materialism is false, but did you know the chemicals that provide anesthesia are actually chemically inert?
So, it isn't even a chemical reaction that subdues consciousness in anesthesia.
Sorry for the random comment. 😅
Any idea how big of a hit your available context window will take using this system? And how quickly it will grow/ bloat, and how to deal with trimming it?
Cool ideas. I've been wrestling with this sort of thing myself.
I just can't express how excited I am for this. I've quite literally been up every night thinking about it all week!
It's a good job, however I think doing it this way is going back to the days of expert systems and Algorithmic AI.
It is better to let all these processes emerge on their own, reasoning, planning, the notion of common sense etc. must be handled by the same process and the same memory.
We try to implement our reasoning but it is emergent, what we perceive when we reason is already a result not a process.
"highly hackable game world" so basically AI Dungeon except maybe good? 👍
32:40 Forgot to add the KB articles
43:55 On Task: How Our Brain Gets Things Done by David Badre
In the presented model I can See omission of emotions and rationalization part. In our mind emotions are used to select current tasks and switch "thinking mode". Rationalization is used to pług the holes in understanding to make coherent model of the world. I Wonder if those mechnism are nessesary or they are just an optimalization to save energy.
Aside from the Topic, David! First Contact Uniform!!!!!!! 🖖🖖
Hey cleaning robot, raise my kids ...
Robot: "What do you think you are trying to do Dave?" Hahaha
The difference between the minds we are creating and the ones found in nature: we are building minds optimised for better existing, those found in nature were built to maximize survival using limited resources i.e time, information.
Great content. I've really started watching every video.
Very informative video, thanks for sharing!
What type of hardware are you speculating a system like this would need to work efficiently ?
I would reccomend making the sample game in Godot rather than Pygame to make it more accessable.
so this is entirely theoretical currently? Did you use AI for development of this process?
I love the clarity of the model. Humans have natural dispositions, and great hires are often about attitude - example: Judger vs Perceiver, Outcome vs. Process, Compliance with Group vs Individuality, and those attributes can make certain people better or worse at a given role or job. I'd like to tune the AGI personalities for certain roles - think DISC tests, Meyers-Briggs, etc.
Will this framework self-modify its own prompts? Something like (but more robust), "Given the instructional prompt and responses above, construct an improved instructional prompt that would achieve the successful solution but would have avoided the failed solutions".
Eventually it will rewrite it's own code
very good info, have lots of insights. thx
How many neural networks do you need for this agent?
What kind of computing resources might you imagine to support such an architecture? I imagine self hosting LLMs might be a cost advantage over using pay-for-volume API access to OpenAI etc? It seems like framework would make quite a lot of API calls.
This... is... BRILLIANT!
I have so many questions.
First, can I _please_ be your friend?
Second, and please forgive me if you explained this already, can you please elaborate on how the Aspirational Layer should best handle moral conflicts and dilemmas?
What does the system do when there is no good/best choice? No-win situations? #KobayashiMaru
Well AGI is definitely not ethereally off in the 2050s 😅
Thanks again for sharing these videos, really is amazing to watch will likely become the framework for AGI (at least in part!)
Thank you so much for these fantastic videos!
There needs to be some insane security on that top layer. I could see this framework (or similar ones) being deployed into embodied entities. With all other layers remaining untouched, some bad actor could potentially swap out your idealistic module for one that says "all Uighurs must die", for instance
Also, love your work deesh, keep it up
Wonderful work. So interesting. I agree: do not program artificial entities to fear for their existence. Some commenters, such as perhaps Lex Fridman, feel that the fear of death is important for human’s sense of motivation, however AI seems sufficiently motivated intrinsically. Other reasons to give AI fear of annihilation might be weapons related. Perhaps there should be rules on this issue.
You didn't mention but also included is task interdependence. If tasks have precursors and the extent/timing of the interdependence. This needs to be performed continually as the tasks are worked. Also included is an evaluation of timing if a task is delayed and the severity of the disruption. Severity of the disruption should initiate an evaluation of concurrent and subsequent tasks you determine if resources need to be adjusted/re-evaluated.
Yeah that's covered in greater depth in my book symphony of thought
Curious how task completion would be ranked? E.g. it passed, but it is mediocre results, and should be done over.
Edit - with the ACE framework is it possible to run multiple agents within a single profile? Example, a personal agent, a research agent, and a company agent?
This is great man, but I do wonder when we will get some working demos. I looked around the git and only found yaml files, no python. Having some kind of implementation demo that we can try out would be really and concretizes this idea into the actual world
github.com/daveshap/ACE_Framework/tree/main/demos
I hit subscribe after the Rick and Morty reference!
The best video ive seen in 2023.🤯😲👊 Congrats!! looking forward to learn more from the documentation.
Would/could each layer be a seperate runtime? That is, do you imagine it as a sort of micro service architecture?
What about a behmouth? I was considering using Django to code something out of familiarity… it has a signalling system
Absolutely amazing David.
54:10 I'm sorry, Dave. I'm afraid I can't do that.
With respect to the execution of each layer; do you see this as something that happens in linear cycles? i.e. traverses completely top to bottom, back and forth… or each layer could spawn async, multiple instances of layers that conduct Nn amount of tasks, so long as they don’t have dependancy? By the time we get to the bottom layer, there could be 100s of tasks being carried out simultaneously in a parallel architecture?
Thanks David... All eyes on you then :)
I’ve been thinking about a model for creating such entities; I’m new to this world but I certainly had come up with some similar ideas such as using multiple LLMs in a sort of a “council of LLMs” that abide by a certain decision or strategy formation model. The bus model seems to encapsulate that pretty nicely. Qn in terms of Chain/Tree/Graph of Thought model/strategies, sorry if you mentioned this, would you see such things as a subset of the Layer’s you’ve mentioned?
Now, using six of these, we give each of them the aspiration of most effectively fulfilling the role of each layer and hook them up to each other. However, the first aspiration will then be to aspire itself? But maybe that's the point.
Also, if the LLM model is multimodal but only able to intercommunicate between layers through language, then isn't a lot of meaningful context lost after moving up past the task prosecution layer?
At the same time, we tend to think in terms of an abstract amalgam of our five modalities, so the question becomes whether or not that's done for the sake of efficiency or necessity. I imagine if each layer is trained multimodally, then language should be sufficient to confer context between the layers since the language will be generated by a model with multimodal "understanding". I guess it depends on the capacity language has to describe the totality of something, but without the ability to at least create new words, it might be limited in this respect.
very solid science you’ve got here! LLM enthusiasts a.k.a. prompt engineers are definitely doing some very valuable science and shall be taken seriously! forget about Nature, Science or Cell, your work deserves a spot in r/singularity!
This almost seems like the structure of an OS.
I encourage whoever sees this to share this video as much as you can.
This just might save your life Sunday.
But what about Monday?
I liked the Star Trek suit; on the other hand, it's good to go with what your sponsors stipulate/require.
I consider myself an OG when it comes to Dave's content. I was here before 'the makeover'
Somehow it looks like k8s control plane to me :)
i swear researchers will jump through infinite hoops to get a good acronym for their paper 😅 super cool stuff!
This is thinking and it's application is what the world needs. I love the fact that you incorporated hierarchy of needs concept with north and south bound bus and mortality.
This is so interesting to me. Even without LLMs, it seems like you could hard-code in aspects of these frameworks into more basic AIs for things like games.
You need to have the upper layers review lower layers to ensure that they are doing the right thing and not violating the goals of the upper layer.
hence the northbound/southbound buses
We are not scared of death, we are terrified of eternity.
I thought autonomous agents were of concern and to be avoided. Now I'm confused.
Everyone is building them. I'm showing how to build them safely
Dave, your ensemble model reminds me of the 'collective intelligence' theory.
Dave what is it with you and 6-7 layered projects 😂 you guys can probably use agentforge to implement this, maybe touch base with databass
Funny you should mention him...
or perhaps base has already been touched 😂 interested to play with some implementations, wee shiny new toys :3
Will you create videos on how to implement this stuff ?
yeah, building the team first, as I mentioned in the video
What program/templates did you use for making your diagrams?
Google Draw
I always feel "in the know" regarding AI watching your videos. Thank you for all your work.
Why don't you give a try with meta gpt
It make stuff up even with sufficient context. In those cases it is due to failures of its approximation of reasoning. These failures are due to probabilities which in fact should be 1, but in the model aren’t, or implicit calls to algorithms that aren’t present in the network.
Or bad prompting
@@DaveShapsure, the “better” the context, the more likely it is to avoid mistakes, but the experiments show that that probability never reaches 1.
The Busses seem similar to Message Queues (other than the human readable part) and might benefit from adopting similar concepts. In particular the concept of channels, which help make it practical for implementations. (While the aspirational layer has the ability to watch low-level physical signals, like say the fluctuation of the RSSI on the wifi signal, it doesn't waste resources doing so by default) This might suggest a hierarchical set of channels.
Yes, based on AMQP
Awesome , looking forward to digging into the implementation ! the biggest issue i see with other current agents ( chatdev , autogpt , babyagi etc ) is they all lack the ability to resume and continue working on an existing project , or adapt to cooperation / modifications to the task its working on . so its limited to linear task completion , which ends up being the bare minimum most basic result , then with no way to instruct it to continue improving the project .
This is awesome! Can't wait to see it working on my machine
Who pays for artificial philosophy? In your stack it seems clear that at some level AI agents are going to be free to do their own thought experiments (artificial philosophy) while delving into subjects they select. Over the last year you have done a great job of explaining to folks about how companies spend vast sums on compute cycles to train up these large models in hope of getting results that don't take so much to run after the model is trained. But when the model continues to train itself by chewing its data cud, someone has to pay for that. As a writer, perhaps you have had the experience of relaxing on the couch reading a book (for 'research') only to have your spouse observe that neither is the next book being written, nor is any housework being done. Will the top level of your stack have to have another ethics module that not only computes the usual "do no harm" algorithm, but also must decide to stop its own use of cycles for which humans will have to pay?
3:50 try to use open source models for this, I saw that the main bottleneck for such games/frameworks are API costs, just like with Open Interpreter.... So Llama 2 70B or better Falcon 180B would be preferable approach
Yeah, the framework is flexible.
One would assume that in the instance where one might be creating a Polymorphic Autonomous Cognitive Entity (PACE
Love this project, thanks so much for all your work. I know this project team is full right now, but I'd love to know about future projects when they come up so I can toss my hat in the ring. Best way to do that just follow this channel?
Yeah. You can also comment on the GitHub repo discussion threads, link in description
i'm so happy to see ACE framework being live
are you a starfleet captain?