10 423 10 623 Generative AI Machine Learning Department School of Computer Science Carnegie Mellon University Course Overview AutoDiff RNN LMs Matt Gormley Lecture 1 Jan 17 2024 1 WHAT IS GENERATIVE AI 2 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning 3 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning 4 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning 5 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning 6 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning 7 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning 8 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning Deep Style from https deepdreamgenerator com gallery 9 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning 10 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning qQ What does Generative AI have to do with any of these goals qA It s making in roads into all of them 11 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning q Communication comprises the comprehension and generation of human language q Large language models LLMs excel at both q Even though they are most often trained autoregressively i e to generate a next word given the previous ones 12 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning q The traditional way of learning in ML is via parameter estimation q But in context learning i e providing training examples as context at test time shows that learning can also be done via inference 13 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning q LLMs are also unexpectedly good at certain reasoning tasks q cf Chain of Though Prompting an ex of in context learning 14 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning q LLMs are already being used for grounded planning for embodied agents c f LLM Planner 15 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning q Text to image models Midjourney s Discord server has 18 million members 1 7 million were online this morning q Text to music models MusicGen capable of conditioning on text and audio sample Deep Style from https deepdreamgenerator com gallery 16 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning q Multimodal foundation models learn to answer questions about images and text in images q Diffusion models can be used as zero shot classifiers 17 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning q DayDreamer learns a generative model of experiences for RL i e a World Model without simulation q Quadruped robot learns to walk in under 1 hour 18 Artificial Intelligence Artificial Intelligence The basic goal of AI is to develop intelligent machines Machine Learning Deep Learning GenAI This consists of many sub goals Perception Reasoning Control Motion Manipulation Planning Communication Creativity Learning qQ What does Generative AI have to do with any of these goals qA It s making in roads into all of them 19 EXAMPLE OF GENERATIVE AI 20 Text Generation Prompt Write a proof of the fact that there are infinitely many primes do it in the style of a Shakespeare play through a dialogue between two parties arguing over the proof GPT 4 Enter FIRST PARTY and SECOND PARTY FIRST PARTY Thou dost not understand my friend