1Machine LearningMachine Learning1010--701/15701/15--781, Spring 2008781, Spring 2008Introduction Introduction and and Density EstimationDensity EstimationEric XingEric XingLecture 1, January 14, 2008Reading: Chap. 1,2, CBz Class webpage:z http://www.cs.cmu.edu/~epxing/Class/10701/Machine Learning 10-701/15-7812Logisticsz Text bookz Chris Bishop, Pattern Recognition and Machine Learning (required)z Tom Mitchell, Machine Learningz David Mackay, Information Theory, Inference, and Learning Algorithms z Mailing Lists: z To contact the instructors: [email protected] z Class announcements list: [email protected]. z TA:z Leon Gu, Wean Hall 8402, x8-6569, Office hours: 14:00-15:00z Kyung-Ah Sohn, Doherty Hall 4302e, x8-2039, Office hours: Thursday 13:30-14:30 z Class Assistant:z Diane Stidle, Wean Hall 4612, x8-1299 Logisticsz 5 homework assignments: 30% of gradez Theory exercisesz Implementation exercises z Final project: 20% of gradez Applying PGM to your research areaz NLP, IR, Computational biology, vision, robotics …z Theoretical and/or algorithmic work z a more efficient approximate inference algorithmz a new sampling scheme for a non-trivial model …z Two exams: 25% of grade eachz Theory exercises and/or analysisz Policies …3Apoptosis + MedicineWhat is LearningMachine Learning4Machine LearningMachine Learning seeks to develop theories and computer systems forz representing;z classifying, clustering and recognizing;z reasoning under uncertainty;z predicting;z and reacting toz …complex, real world data, based on the system's own experience with data, and (hopefully) under a unified model or mathematical framework, thatz can be formally characterized and analyzed z can take into account human prior knowledgez can generalize and adapt across data and domainsz can operate automatically and autonomouslyz and can be interpreted and perceived by human.Where Machine Learning is being used or can be useful?Speech recognitionSpeech recognitionInformation retrievalInformation retrievalComputer visionComputer visionRobotic controlRobotic controlPlanningPlanningGamesGamesEvolutionEvolutionPedigreePedigree5Natural language processing and speech recognitionz Now most pocket Speech Recognizers or Translators are running on some sort of learning device --- the more you play/use them, the smarter they become!Object Recognitionz Behind a security camera, most likely there is a computer that is learning and/or checking!6Robotic Control Iz The best helicopter pilot is now a computer! z it runs a program that learns how to fly and make acrobatic maneuvers by itself! z no taped instructions, joysticks, or things alike …A. Ng 2005Robotic Control IIz Now cars can find their own ways!7Text Miningz Reading, digesting, and categorizing a vast text database is too much for human!z We want:Understanding Brain Activities8Bioinformaticscacatcgctgcgtttcggcagctaattgccttttagaaattattttcccatttcgagaaactcgtgtgggatgcc ggatgcggctttcaatcacttctggcccgggatcggattgggtcacattgtctgcgggctctattgtctcgatccgcggcgcagttcgcgtgcttagcggtcagaaaggcagagattcggttcggattgatgcgctggcagcagggcacaaa gatctaatgactggcaaatcgctacaaataaattaaagtccggcggctaattaatgagcggactgaagccactttggattaaccaaaaaacagcagataaacaaaaacggcaaagaaaattgccacagagttgtcacgctttgttgcacaaa catttgtgcagaaaagtgaaaagcttttagccattattaagtttttcctcagctcgctggcagcacttgcgaatgtactgatgttcctcataaatgaaaattaatgtttgctctacgctccaccgaactcgcttgtttgggggattggctgg ctaatcgcggctagatcccaggcggtataaccttttcgcttcatcagttgtgaaaccagatggctggtgttttggcacagcggactcccctcgaacgctctcgaaatcaagtggctttccagccggcccgctgggccgctcgcccactggac cggtattcccaggccaggccacactgtaccgcaccgcataatcctcgccagactcggcgctgataaggcccaatgtcactccgcaggcgtctatttatgccaaggaccgttcttcttcagctttcggctcgagtatttgttgtgccatgttg gttacgatgccaatcgcggtacagttatgcaaatgagcagcgaataccgctcactgacaatgaacggcgtcttgtcatattcatgctgacattcatattcattcctttggttttttgtcttcgacggactgaaaagtgcggagagaaaccca aaaacagaagcgcgcaaagcgccgttaatatgcgaactcagcgaactcattgaagttatcacaacaccatatccatacatatccatatcaatatcaatatcgctattattaacgatcatgctctgctgatcaagtattcagcgctgcgctag attcgacagattgaatcgagctcaatagactcaacagactccactcgacagatgcgcaatgccaaggacaattgccgtggagtaaacgaggcgtatgcgcaacctgcacctggcggacgcggcgtatgcgcaatgtgcaattcgcttacctt ctcgttgcgggtcaggaactcccagatgggaatggccgatgacgagctgatctgaatgtggaaggcgcccagcaggcaagattactttcgccgcagtcgtcatggtgtcgttgctgcttttatgttgcgtactccgcactacacggagagtt caggggattcgtgctccgtgatctgtgatccgtgttccgtgggtcaattgcacggttcggttgtgtaaccttcgtgttctttttttttagggcccaataaaagcgcttttgtggcggcttgatagattatcacttggtttcggtggctagcc aagtggctttcttctgtccgacgcacttaattgaattaaccaaacaacgagcgtggccaattcgtattatcgctgtttacgtgtgtctcagcttgaaacgcaaaagcttgtttcacacatcggtttctcggcaagatgggggagtcagtcgg tctagggagaggggcgcccaccagtcgatcacgaaaacggcgaattccaagcgaaacggaaacggagcgagcactatagtactatgtcgaacaaccgatcgcggcgatgtcagtgagtcgtcttcggacagcgctggcgctccacacgtatt taagctctgagatcggctttgggagagcgcagagagcgccatcgcacggcagagcgaaagcggcagtgagcgaaagcgagcggcagcgggtgggggatcgggagccccccgaaaaaaacagaggcgcacgtcgatgccatcggggaattgga acctcaatgtgtgggaatgtttaaatattctgtgttaggtagtgtagtttcatagactatagattctcatacagattgagtccttcgagccgattatacacgacagcaaaatatttcagtcgcgcttgggcaaaaggcttaagcacgactcc cagtccccccttacatttgtcttcctaagcccctggagccactatcaaacttgttctacgcttgcactgaaaatagaaccaaagtaaacaatcaaaaagaccaaaaacaataacaaccagcaccgagtcgaacatcagtgaggcattgcaaa aatttcaaagtcaagtttgcgtcgtcatcgcgtctgagtccgatcaagccgggcttgtaattgaagttgttgatgagttactggattgtggcgaattctggtcagcatacttaacagcagcccgctaattaagcaaaataaacatatcaaat tccagaatgcgacggcgccatcatcctgtttgggaattcaattcgcgggcagatcgtttaattcaattaaaaggtagaaaagggagcagaagaatgcgatcgctggaatttcctaacatcacggaccccataaatttgataagcccgagctc gctgcgttgagtcagccaccccacatccccaaatccccgccaaaagaagacagctgggttgttgactcgccagattgattgcagtggagtggacctggtcaaagaagcaccgttaatgtgctgattccattcgattccatccgggaatgcga taaagaaaggctctgatccaagcaactgcaatccggatttcgattttctctttccatttggttttgtatttacgtacaagcattctaatgaagacttggagaagacttacgttatattcagaccatcgtgcgatagaggatgagtcatttcc atatggccgaaatttattatgtttactatcgtttttagaggtgttttttggacttaccaaaagaggcatttgttttcttcaactgaaaagatatttaaattttttcttggaccattttcaaggttccggatatatttgaaacacactagcta gcagtgttggtaagttacatgtatttctataatgtcatattcctttgtccgtattcaaatcgaatactccacatctcttgtacttgaggaattggcgatcgtagcgatttcccccgccgtaaagttcctgatcctcgttgtttttgtacatc ataaagtccggattctgctcgtcgccgaagatgggaacgaagctgccaaagctgagagtctgcttgaggtgctggtcgtcccagctggataaccttgctgtacagatcggcatctgcctggagggcacgatcgaaatccttccagtggacga acttcacctgctcgctgggaatagcgttgttgtcaagcagctcaaggagcgtattcgagttgacgggctgcaccacgctgctccttcgctggggattcccctgcgggtaagcgccgcttgcttggactcgtttccaaatcccatagccacgc
View Full Document
Unlocking...