Slide 1What will we study in this course?Newspaper TitlesKnowledge NeededMorphologySyntaxSyntaxSyntaxSyntaxSyntaxSemanticsPragmatics – The influence of contextSlide 13Slide 14Slide 15Slide 16AlgorithmsCurrent Real World ApplicationsInstructorLogisticsSlide 21Academic IntegrityFor Next ClassCS4705Natural Language ProcessingFall 2009How can machines recognize and generate text and speech? ◦Human language phenomena◦Theories, often drawn from linguistics, psychology◦Algorithms◦Applications What will we study in this course?◦"Something Went Wrong In Jet Crash, Expert Says"◦"Police Begin Campaign To Run Down Jaywalkers"◦"Drunk Gets Nine Months In Violin Case"◦"Farmer Bill Dies In House"◦"Iraqi Head Seeks Arms"◦"Enraged Cow Injures Farmer With Ax"◦"Stud Tires Out"◦"Eye Drops Off Shelf"◦"Teacher Strikes Idle Kids"◦"Squad Helps Dog Bite Victim"Newspaper TitlesMorphology: word formationSyntax: word orderSemantics: word meaning and word compositionPragmatics: influence of context/situationGoal: Discover what the speaker meantKnowledge Needed“Stud tires out”◦“Tires”: a noun or a verb?Internet search: union activities in New York◦Union/unions; activities/activity◦Active? Action? Actor?◦New vs. New YorkMorphologyWord Order◦John hit Bill ◦Bill was hit by John◦Bill hit John◦Bill, John hit◦Who John hit was BillConstituent Structure◦"Teacher Strikes Idle Kids“◦“Enraged Cow Injures Farmer With Ax”SyntaxWord Order◦John hit Bill ◦Bill was hit by John◦Bill, John hit◦Who John hit was BillConstituent Structure◦“[Teacher Strikes] [Idle] [Kids]“◦“Enraged Cow Injures Farmer With Ax”SyntaxWord Order◦John hit Bill ◦Bill was hit by John◦Bill, John hit◦Who John hit was BillConstituent Structure◦“[Teacher] [Strikes] [Idle Kids]“◦“Enraged Cow Injures Farmer With Ax”SyntaxWord Order◦John hit Bill ◦Bill was hit by John◦Bill, John hit◦Who John hit was BillConstituent Structure◦"Teacher Strikes Idle Kids“◦“[Enraged Cow] [Injures] [Farmer With Ax]”SyntaxWord Order◦John hit Bill ◦Bill was hit by John◦Bill, John hit◦Who John hit was BillConstituent Structure◦"Teacher Strikes Idle Kids“◦“[Enraged Cow] [Injures] [Farmer] [With Ax]”SyntaxWord meaning◦John picked up a bad cold.◦John picked up a large rock.◦John picked up Radio Netherlands on his radio.Composition of meaning◦Squad helps dog bite victim◦Enraged cow injures farmer with axSemantics“Going Home'' - A play in one actScene 1: Pennsylvania Station, NYBonnie: Long Beach?Passerby: Downstairs, LIRR Station.Pragmatics – The influence of contextScene 2: Ticket Counter, LIRR StationBonnie: Long Beach?Clerk: $4.50.Scene 3: Information Booth, LIRR StationBonnie: Long Beach?Clerk: 4:19, Track 17.Scene 4: On the train, vicinity of Forest HillsBonnie: Long Beach?Conductor: Change at Jamaica.Scene 5: On the next train, vicinity of LynbrookBonnie: Long Beach?Conductor: Right after Island Park.Rule-based/Symbolic◦Parsers◦Finite state automataProbabilistic◦Learned from observation◦Predicting best guess◦StatisticalAlgorithmsSearching very large text and speech corpora: e.g. the WebQuestion answering over the webTranslating between one language and another: e.g. Arabic and EnglishSummarizing very large amounts of text: e.g. your email, the news, reviews (mobile version)Sentiment analysis: NYT articleGenerating textsDialogue systems: e.g. Amtrak’s ‘Julie’Current Real World ApplicationsKathy McKeownOffice: 722 CEPSRHead NLP Group25 years at Columbia, Department Chair for 6Research◦Summarization◦Question Answering◦Language Generation◦Multimedia ExplanationInstructorInstructor: Kathy McKeown◦([email protected])◦Office and hours: CEPSR 722, Tues 4-5, Wed 4-5Teaching Assistants: ◦Sara Rosenthal [email protected]http://www.cs.columbia.edu/~ss3067Office and hours: 726 CEPSR, M 4:30-5:30, Thurs 1:30-2:30◦Kaushal Lahankar[email protected]Office and hours: NLP Lab, 7LW, Thurs 4-6Syllabus available at http://www.cs.columbia.edu/~kathy/NLPLogisticsText: Daniel Jurafsky and James H. Martin, Speech and Language Processing, 2nd edition, Prentice-Hall, 2000 (available at CU Bookstore) Assignments: ◦4 homework assignments◦Midterm and final exams◦Four ‘free’ late days for homework assignments◦After that, 10% off per day late ◦You must get a CS accountEvaluation: 50% homework + 40% exams+ 10% class participationCopying or paraphrasing someone's work (code included), or permitting your own work to be copied or paraphrased, even if only in part, is forbidden, and will result in an automatic grade of 0 for the entire assignment or exam in which the copying or paraphrasing was done. Your grade should reflect your own work. If you are going to have trouble completing an assignment, talk to the instructor or TA in advance of the due date please. Everyone: Read/write protect your homework files at all times.Academic IntegrityLook at syllabus Read Chapters 1-2 of J&M Questions?For Next
View Full Document