CSCI 5832 Natural Language Processing Lecture 25 Jim Martin 4 24 07 CSCI 5832 Spring 2007 1 Machine Translation Slides stolen from Kevin Knight USC ISI 4 24 07 CSCI 5832 Spring 2007 2 1 Today 4 24 Machine translation framework State of the art Evaluation methods Word based models 4 24 07 CSCI 5832 Spring 2007 3 Recent Progress 2002 2003 insistent Wednesday may recurred her trips to Libya tomorrow for flying Egyptair Has Tomorrow to Resume Its Flights to Libya Cairo 6 4 AFP An official announced today in the Egyptian lines company for flying Tuesday is a company insistent for flying may resumed a consideration of a day Wednesday tomorrow her trips to Libya of Security Council decision trace international the imposed ban comment Cairo 4 6 AFP Said an official at the Egyptian Aviation Company today that the company egyptair may resume as of tomorrow Wednesday its flights to Libya after the International Security Council resolution to the suspension of the embargo imposed on Libya 4 24 07 CSCI 5832 Spring 2007 4 2 Commercial Applications news broadcast foreign language speech recognition English translation searchable archive 4 24 07 CSCI 5832 Spring 2007 5 Statistical Machine Translation Hmm every time he sees banco he either types bank or bench but if he sees banco de he always types bank never bench Man this is so boring Translated documents 4 24 07 CSCI 5832 Spring 2007 6 3 Things are Consistently Improving Annual evaluation of Arabic to English MT systems Translation quality 70 60 50 40 30 20 10 Exceeded commercial grade translation here 2002 4 24 07 2003 2004 2005 2006 CSCI 5832 Spring 2007 7 Progress Driven by Experiments with Empirical Measures of Success Translation quality 35 30 25 20 USC ISI Syntax Based MT System Chinese English NIST 2002 Test Set 15 Mar 4 24 07 1 Apr May 1 CSCI 5832 Spring 2007 1 2005 8 4 Current Approaches Same old noisy channel model If we re translating French to English the French we re seeing is just a weird garbled version of English There must have been some process that generated the French from the original English The key is to decode the garbles back into the original English by Argmax P E F by Bayes A very old idea 4 24 07 CSCI 5832 Spring 2007 9 Warren Weaver 1947 When I look at an article in Russian I say to myself This is really written in English but it has been coded in some strange symbols I will now proceed to decode 4 24 07 CSCI 5832 Spring 2007 10 5 MT History Earliest applications of NLP AI Didn t work for a lot of reasons Led to an NLP AI winter where funding was hard to come by for a long time MT was a topic no one would touch in respected circles 4 24 07 CSCI 5832 Spring 2007 11 Centauri Arcturan Knight 1997 Your assignment translate this to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok rarok nok izok hihok mok 6b wat dat krat quat cat 4 24 07 12b wat nnat forat arrat vat gat CSCI 5832 Spring 2007 12 6 Centauri Arcturan Knight 1997 Your assignment translate this to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok rarok nok izok hihok mok 6b 4 24 07 wat dat krat quat cat 12b wat nnat forat arrat vat gat CSCI 5832 Spring 2007 13 Centauri Arcturan Knight 1997 Your assignment translate this to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok rarok nok izok hihok mok 6b 4 24 07 wat dat krat quat cat 12b wat nnat forat arrat vat gat CSCI 5832 Spring 2007 14 7 Centauri Arcturan Knight 1997 Your assignment translate this to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok …
View Full Document
Unlocking...