Presented by
- Sruti Srinidh, Carnegie-Mellon University
- Christine Perey, AREA Research Committee (moderator)
About this talk
With improvements in Large Language Models (LLMs) and Machine Learning (ML), the process of AR/XR experience creation with little or no human guidance is evolving. There are new opportunities to be explored, potentially changing the roles of AR platform providers, project managers, and developers.
In this AREA Research webinar, Sruti describes an approach to produce AR experiences without manual intervention, specifically in scenarios where the AR objects provide guidance to the user about something in the physical world. She proposes a cognitive assistant system that can understand, reason about and respond to the physical world in AR, allowing for in-context assistance, especially for step-by-step tasks.
She explores the various challenges in building a platform that integrates LLMs with AR devices and examines the challenges we still have left to solve.
The webinar is tailored to AR project managers, architects, developers, and platform providers.