Natural Language Processing Lecture 23 12 3 2013 Jim Martin Today Machine translation framework Statistical Evaluation methods Basic probabilistic framework 12 12 13 Speech and Language Processing Jurafsky and Martin 2 What s Left Information Extraction Homework on this Additional lecture to be on line only Machine translation Last three lectures Review Last lecture Final 12 17 12 12 13 Speech and Language Processing Jurafsky and Martin 3 Current Approaches If we re translating French to English the French we re seeing is just a weird garbled version of English The key is to decode the garbles back into the original English by using Bayes rule Argmax P E F by Bayes Argmax P F E P E As we ll see the key to doing this is having access to aligned bilingual texts 12 12 13 Speech and Language Processing Jurafsky and Martin 4 Warren Weaver 1947 When I look at an article in Russian I say to myself This is really written in English but it has been coded in some strange symbols I will now proceed to decode 12 12 13 Speech and Language Processing Jurafsky and Martin 5 What s This 12 12 13 Speech and Language Processing Jurafsky and Martin 6 Rosetta Stone Egyptian hieroglyphs Demotic Greek 12 12 13 Speech and Language Processing Jurafsky and Martin 7 Training Data Egyptian hieroglyphs Demotic Greek 12 12 13 Speech and Language Processing Jurafsky and Martin 8 Centauri Arcturan Knight 1997 Your assignment translate this Centauri text to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok rarok nok izok hihok mok 6b wat dat krat quat cat 12b wat nnat forat arrat vat gat 12 12 13 Speech and Language Processing Jurafsky and Martin 9 Centauri Arcturan Knight 1997 Your assignment translate this Centauri text to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok rarok nok izok hihok mok 6b wat dat krat quat cat 12b wat nnat forat arrat vat gat 12 12 13 Speech and Language Processing Jurafsky and Martin 10 Centauri Arcturan Knight 1997 Your assignment translate this to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok rarok nok izok hihok mok 6b wat dat krat quat cat 12b wat nnat forat arrat vat gat 12 12 13 Speech and Language Processing Jurafsky and Martin 11 Centauri Arcturan Knight 1997 Your assignment translate this to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok rarok nok izok hihok mok 6b wat dat krat quat cat 12b wat nnat forat arrat vat gat 12 12 13 Speech and Language Processing Jurafsky and Martin 12 Centauri Arcturan Knight 1997 Your assignment translate this to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok ororok lalok sprok izok enemok 1b at voon bichat dat 7b wat jjat bichat wat dat vat eneat 2a ok drubel ok voon anok plok sprok 8a lalok brok anok plok nok 2b at drubel at voon pippat rrat dat 8b iat lat pippat rrat nnat 3a erok sprok izok hihok ghirok 9a wiwok nok izok kantok ok yurp 3b totat dat arrat vat hilat 4a ok voon anok drok brok jok 9b totat nnat quat oloat at yurp 10a lalok mok nok yorok ghirok clok 4b at voon krat pippat sat lat 5a wiwok farok izok stok 10b wat nnat gat mat bat hilat 11a lalok nok crrrok hihok yorok zanzanok 5b totat jjat quat cat 6a lalok sprok izok jok stok 11b wat nnat arrat mat zanzanat 12a lalok rarok nok izok hihok mok 6b wat dat krat quat cat 12b wat nnat forat arrat vat gat 12 12 13 Speech and Language Processing Jurafsky and Martin 13 Centauri Arcturan Knight 1997 Your assignment translate this to Arcturan farok crrrok hihok yorok clok kantok ok yurp 1a ok voon ororok sprok 7a lalok farok …
View Full Document
Unlocking...