Semisupervised Learning for Computational LinguisticsNatural Language Processing Guest LectureFall 2008Jason Baldridgehttp://comp.ling.utexas.edu/jbaldrid© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 2Whatʼs this story about? [Slide from Jim Martin]17 the 13 and 10 of 10 a 8 to 7 s 6 in 6 Romney 6 Mr 5 that 5 state 5 for 4 industry 4 automotive 4 Michigan 3 on 3 his 3 have 3 are 2 would 2 with 2 up 2 think 2 technology 2 speech 2 primary 2 neck 2 is 2 further 2 fuel 2 from 2 former 2 energy 2 campaigning 2 billion 2 bill 2 at 2 They 2 Senator 2 Republican 2 Monday 2 McCain 2 He 2 Gov 1 wrong 1 who 1 upon 1 unions 1 unfunded 1 ultimately 1 trade 1 top 1 took 1 together 1 throughout 1 they 1 there 1 task 1 t 1 support 1 successive 1 standards 1 some 1 signed 1 shake 1 set 1 science 1 said 1 rise 1 research 1 requires 1 representatives 1 remarkably 1 recent 1 rebuild 1 raising 1 pushed 1 presidential 1 polls 1 policy 1 plight 1 pledged 1 plan 1 people 1 or 1 off 1 measure 1 materials 1 mandates 1 losses 1 litany 1 leading 1 leadership 1 lawmakers 1 killer 1 jobs 1 job 1 its 1 issues 1 indicated 1 independent 1 increase 1 including 1 imposing 1 him 1 heavily 1 has 1 greenhouse 1 gone 1 gas 1 future 1 forever 1 focused 1 flurry 1 fluid 1 first 1 final 1 field 1 federal 1 essentially 1 emphasizing 1 emissions 1 efficiency 1 economic 1 don 1 domestic 1 do 1 disinterested 1 die 1 development 1 delivered 1 days 1 criticized 1 could 1 costs 1 contest 1 come 1 childhood 1 cause 1 cap 1 candidates 1 by 1 bring 1 between 1 being 1 been 1 be 1 back 1 automobile 1 automakers 1 asserted 1 aiding 1 ahead 1 agenda 1 again 1 after1 advisers 1 acknowledged 1 With 1 Washington 1 There 1 Recent 1 President 1 New 1 Mitt 1 Mike 1 Massachusetts 1 Lieberman 1 Joseph 1 John 1 Iowa 1 In 1 I 1 Huckabee 1 Hampshire 1 Economic 1 Detroit 1 Connecticut 1 Congress 1 Club 1 Bush 1 Arkansas 1 Arizona 1 America© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 3The story [Slide from Jim Martin]Romney Battles McCain for Michigan LeadBy MICHAEL LUODETROIT — With economic issues at the top of the agenda, the leading Republican presidential candidates set off Monday on a final flurry of campaigning in Michigan ahead of the state’s primary that could again shake up a remarkably fluid Republican field.Recent polls have indicated the contest is neck-and-neck between former Gov. Mitt Romney of Massachusetts and Senator John McCain of Arizona, with former Gov. Mike Huckabee of Arkansas further back.Mr. Romney’s advisers have acknowledged that the state’s primary is essentially do-or-die for him after successive losses in Iowa and New Hampshire. He has been campaigning heavily throughout the state, emphasizing his childhood in Michigan and delivered a policy speech on Monday focused on aiding the automotive industry.In his speech at the Detroit Economic Club, Mr. Romney took Washington lawmakers to task for being a “disinterested” in Michigan’s plight and imposing upon the state’s automakers a litany of “unfunded mandates,” including a recent measure signed by President Bush that requires the raising of fuel efficiency standards.He criticized Mr. McCain and Senator Joseph I. Lieberman, independent of Connecticut, for a bill that they have pushed to cap and trade greenhouse gas emissions. Mr. Romney asserted that the bill would cause energy costs to rise and would ultimately be a “job killer.”Mr. Romney further pledged to bring together in his first 100 days representatives from the automotive industry, unions, Congress and the state of Michigan to come up with a plan to “rebuild America’s automotive leadership” and to increase to $20 billion, from $4 billion, the federal support for research and development in energy, fuel technology, materials science and automotive technology.© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 Is language just bags of words?The first slide captured the “meaning” of the text as a bag of words.Discourse segments, sentence boundaries, syntax, word order are all ignored. Roughly, all that matters is the set of words that occur and how often they occur.4© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 Thatʼs not the full story...Texts are not just bags-of-words.Order and syntax affect interpretation of utterances.5legonmanthedogbit© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 Thatʼs not the full story...Texts are not just bags-of-words.Order and syntax affect interpretation of utterances.5legonmanthe dogbit thethe© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 Thatʼs not the full story...Texts are not just bags-of-words.Order and syntax affect interpretation of utterances.5legonmanthe dogbit thethe mandog© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 Thatʼs not the full story...Texts are not just bags-of-words.Order and syntax affect interpretation of utterances.5legonmanthe dogbit thethe mandog© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 Thatʼs not the full story...Texts are not just bags-of-words.Order and syntax affect interpretation of utterances.5legonmanthe dogbit thethe mandogSubjectObjectModifier© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 Thatʼs not the full story...Texts are not just bags-of-words.Order and syntax affect interpretation of utterances.5legonmanthe dogbit thethe mandogSubjectObjectLocation© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 6Whatʼs hard about this story? [Slide from Jason Eisner]John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there.© 2008 Jason M Baldridge NLP (LIN350/CS378), UT Austin, Fall 2008 6Whatʼs hard about this story? [Slide from Jason Eisner]To get a spare tire (donut) for his car?John stopped at the donut store on his way home from work. He thought a coffee