KDD 2023 - LLMs & the evolution of Bing Chat(and other Microsoft Copilots)

Saurabh Tiwary, Corporate Vice President & Technical Fellow at Microsoft
Applied Data Science Invited Speaker
As Corporate Vice President & Technical Fellow at Microsoft, Saurabh Tiwary leads the Microsoft Turing effort. The team focuses on three areas:
1. Leading the development of Bing Chat experience and other Microsoft CoPilots like Windows Copilot, Office Copilot etc. which are the first global scale conversational search experiences across consumer and enterprise.
2. Training Turing family of large-scale deep learning models. Apart from chat and Copilot experiences, these models also power text-prediction in Word and Edge browser, Image super-resolution in Edge browser, SmartReply in Outlook/Teams and question-answering system on Bing.com amongst other things.
3. Building scalable AI infrastructure called Semantic Fabric to light up experiences like search, QnA, and Viva topics over exabytes of enterprise data from SharePoint, Exchange mailboxes, and 3rd party connector content.
Tiwary started the Microsoft Turing effort from scratch setting up the first non-trivial training cluster at Microsoft and later scaling that effort to help drive development of large-scale training, building state of the art models for NLP and vision, and efficient inferencing across different hardware options including CPU, GPU, FPGAs, and NPUs.
He also advises Microsoft Ventures Fund (M12) in its AI investments. Tiwary earned his PhD in Electrical & Computer Engineering from Carnegie Mellon University. In addition, he holds an M.B.A. from University of California, Berkeley, Haas in Master of Business Administration and an undergraduate degree from IIT Kanpur.