​Gaia: Distributed planetary-scale AI safety - Rafael Kaufmann

By ​Rafael Kaufmann, Co-founder and CTO, Gaia
At Guaranteed Safe AI Seminars, June 2024
​In the near future, there will be billions of powerful AI agents deployed in industry, defense and other high-stake sectors. As these agents interact with a hugely complex, interconnected world system - and with each other - cascading effects and unintended consequences will amplify catastrophic hidden risk. Further, stakeholders of this world system will have different yet overlapping constraints and values, legal, financial, physical and ethical. In this talk we propose Gaia, a decentralized, crowdsourced model-based safety oracle. We argue that this framework, drawing on principles of collective intelligence and active inference, gains from diversity to converge on truthful and useful safety guarantees. We discuss Gaia's key design challenges: scalable processes for crowdsourced world model and preference elicitation; contribution tracking and credit assignment; and the computation of safety assessments across a planetary-scale network.
---
About the series:
​​​​The monthly seminar series on Guaranteed Safe AI brings together researchers to advance the field of building AI with high-assurance quantitative safety guarantees.
www.horizoneve...

[@DaviRoutner]

Tool shirt noticed…