Generative AI: An Overview of Methods and Applications in Healthcare • Talk @ UofCincinnati

"Generative AI: An Overview of Methods and Applications in Healthcare" • Invited Talk at the University of Cincinnati/Cincinnati Children's Hospital ‪@CincinnatiChildrens‬ ‪@UniversityofCincinnati‬ • BMI Seminar Series • September 5, 2024
• Overview:
The talk provided a comprehensive overview of the evolution and current state of Generative AI, starting with a comparison between its past and present stages. It delved into the fundamentals of the Transformer model, covering Encoder, Decoder, and Encoder-Decoder architectures. The presentation then shifted focus to modern Large Language Models (LLMs), offering insight into their core functionalities and applications across various domains. A key section highlighted the significance of (bio-)medical LLMs and Vision-Language Models (VLMs), showcasing cutting-edge models like Med-PaLM M, Med-PaLM 2, MediTron, and M3Help, along with other advancements in healthcare and medicine. The talk further explored the concept of Agentic AI and its implications within (bio-)medicine, concluding with a forward-looking perspective on the future trajectory of Generative AI.
• Relevant Primers:
transformer.ama...
llm.aman.ai
• Agenda:
Generative AI: Past vs. Present
The Transformer Model (Encoder, Decoder, Encoder-Decoder)
The LLM of Today
Overview of GenAI Applications
(Bio-)Medical LLMs and VLMs (Med-PaLM M, Med-PaLM 2, MediTron, M3Help)
More (Bio-)Medical Models
Agentic AI
Agentic AI in (Bio-)Medicine
The Road Ahead for GenAI
• Relevant Links/Papers:
Vaswani, Ashish, et al. "Attention Is All You Need." Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS), 2017, pp. 5998-6008. arxiv.org/abs/...
Ho, Jonathan, Ajay Jain, and Pieter Abbeel. "Denoising diffusion probabilistic models." Advances in neural information processing systems 33 (2020): 6840-6851. arxiv.org/abs/...
Goodfellow, Ian, et al. "Generative adversarial networks." Communications of the ACM 63.11 (2020): 139-144. dl.acm.org/doi...
Kingma, Diederik P. "Auto-encoding variational bayes." arXiv preprint arXiv:1312.6114 (2013). arxiv.org/abs/...
Bengio, Emmanuel, et al. "Flow network based generative models for non-iterative diverse candidate generation." Advances in Neural Information Processing Systems 34 (2021): 27381-27394. arxiv.org/abs/...
Zhou, Hongjian, et al. "A Survey of Large Language Models in Medicine: Progress, Application, and Challenge." arXiv preprint, arXiv:2311.05112, 2023. arxiv.org/abs/...
Tu, Tao et al. "Towards Generalist Biomedical AI." arXiv preprint arXiv:2307.14334 (2023). arxiv.org/abs/...
Singhal, Karan, et al. "Towards expert-level medical question answering with large language models." arXiv preprint arXiv:2305.09617 (2023). arxiv.org/abs/...
Chen, Zeming, et al. "MEDITRON-70B: Scaling Medical Pretraining for Large Language Models." arXiv preprint, arXiv:2311.16079, 2023. arxiv.org/abs/...
Labrak, Yann, et al. "BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains." arxiv.org/abs/...
Pal, Sankarasubbu, and Sandeep Pal. "OpenBioLLMs: Advancing Open-Source Large Language Models for Healthcare and Life Sciences." huggingface.co...
Moor, Michael, et al. "Med-Flamingo: A Multimodal Medical Few-shot Learner." arxiv.org/abs/...
Li, Haotian, et al. "LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day." arxiv.org/abs/...
Saab, Amir, et al. "Capabilities of Gemini Models in Medicine." arxiv.org/abs/...
Stevens, Samuel, et al. "BioCLIP: A Vision Foundation Model for the Tree of Life." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, pp. 19412-19424. arxiv.org/abs/...
Lu, Yiwen, et al. "CONCH: A visual-language foundation model for computational pathology." arxiv.org/abs/...
Lee, Jinhyuk, et al. "BioBERT: a pre-trained biomedical language representation model for biomedical text mining." arxiv.org/abs/...
Xi, Zhiheng, et al. "The Rise and Potential of Large Language Model Based Agents: A Survey." Fudan NLP Group, 2023. arxiv.org/abs/...
Fan, Zhihao, et al. "AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator." arXiv preprint, arXiv:2402.09742v3, 27 June 2024. arxiv.org/abs/...
Wei, Hao, et al. "MEDCO: Medical Education Copilots Based on A Multi-Agent Framework." arXiv preprint arXiv:2408.12496 (2024). arxiv.org/abs/...