The Science Behind ChatGPT at Silicon Valley Code Campfire
Title: The Science Behind ChatGPT
https://www.siliconvalley-codecamp.co...
Description: In this talk, I will cover the science behind ChatGPT. I will discuss the core architecture of chatGPT, the training methodology, and the training data. I will cover the basics of language representation, transformers and large-scale pretraining of language models. I will trace the evolution of GPT from its first version to GPT-3, and then GPT 3.5, their similarity and difference. Finally, I will discuss instructGPT and how it utilizes reinforcement learning to deliver the impressive performance that ChatGPT has today.
Speaker: Junling Hu is the founder and CEO of Coach.ai, which provides a platform for AI coaches. Prior to founding the company, Junling was the Director of Applied AI at Live Person, where she led a team building conversational AI solutions. Prior to that, she had been an AI leader at Samsung and PayPal. Junling is the author of the book The Evolution of Artificial Intelligence: What You Must Know about AI. Junling received her Ph.D. in Computer Science from University of Michigan at Ann Arbor.
