Information ExtractionLecture #19Computational LinguisticsCMPSCI 591N, Spring 2006University of Massachusetts AmherstAndrew McCallumToday’s Main Points• Why IE?• Components of the IE problem and solution• Approaches to IE segmentation and classification– Sliding window– Finite state machines• IE for the Web• Semi-supervised IE• Later: relation extraction and coreference• …and possibly CRFs for IE & coreferenceQuery to General-Purpose Search Engine:+camp +basketball “north carolina” “two weeks”Domain-Specific SearchEngineExample: The ProblemMartin Baker, a personGenomics jobEmployers job posting formExample: A SolutionExtracting Job Openings from the Webfoodscience.com-Job2 JobTitle: Ice Cream Guru Employer: foodscience.com JobCategory: Travel/Hospitality JobFunction: Food Services JobLocation: Upper MidwestContact Phone: 800-488-2611 DateExtracted: January 8, 2001 Source: www.foodscience.com/jobs_midwest.html OtherCompanyJobs: foodscience.com-Job1Job Openings:Category = Food ServicesKeyword = Baker Location = Continental U.S.Data Mining the Extracted Job InformationIE fromChinese Documents regarding WeatherDepartment of Terrestrial System, Chinese Academy of Sciences200k+ documentsseveral millennia old- Qing Dynasty Archives- memos- newspaper articles- diariesIE from Research Papers[McCallum et al ‘99]IE from Research PapersMining Research Papers[Giles et al][Rosen-Zvi, Griffiths, Steyvers, Smyth, 2004]Named Entity RecognitionCRICKET -MILLNS SIGNS FOR BOLANDCAPE TOWN 1996-08-22South African provincial sideBoland said on Thursday theyhad signed Leicestershire fastbowler David Millns on a oneyear contract.Millns, who toured Australia withEngland A in 1992, replacesformer England all-rounderPhillip DeFreitas as Boland'soverseas professional.Labels: Examples:PER Yayuk BasukiInnocent ButareORG 3MKDPClevelandLOC ClevelandNirmal HridayThe OvalMISC JavaBasque1,000 Lakes RallyDispersed Topic:PoliticsDensely Linked Topic: Israel/PalestineUSS Cole attackEntities that co-occur withMadeleine Albright, by topicAmericansSandy BergerAriel SharonAbdel RahmanAlbertoFujimoriEdmond PopeChineseAl GoreAmericansColin PowellKim Jong IlChineseJake SiewertGeorge WBushSlobodanMilosevicTerry MadonnaVojislavKostunicaSerbsRadovanKaradicJacques ChiracSandy BergerAriel SharonSandy BergerEhud BarakAbdel RahmanDennis B RossAl GoreAmr MoussaDeal makingKoreaSerbiaMiddle EastWhat is “Information Extraction”Filling slots in a database from sub-segments of text.As a task:October 14, 2002, 4:00 a.m. PTFor years, Microsoft Corporation CEO BillGates railed against the economic philosophyof open-source software with Orwellian fervor,denouncing its communal licensing as a"cancer" that stifled technological innovation.Today, Microsoft claims to "love" the open-source concept, by which software code ismade public to encourage improvement anddevelopment by outside programmers. Gateshimself says Microsoft will gladly disclose itscrown jewels--the coveted code behind theWindows operating system--to selectcustomers."We can be open source. We love the conceptof shared source," said Bill Veghte, aMicrosoft VP. "That's a super-important shiftfor us in terms of code access.“Richard Stallman, founder of the FreeSoftware Foundation, countered saying…NAME TITLE ORGANIZATIONWhat is “Information Extraction”Filling slots in a database from sub-segments of text.As a task:October 14, 2002, 4:00 a.m. PTFor years, Microsoft Corporation CEO BillGates railed against the economic philosophyof open-source software with Orwellian fervor,denouncing its communal licensing as a"cancer" that stifled technological innovation.Today, Microsoft claims to "love" the open-source concept, by which software code ismade public to encourage improvement anddevelopment by outside programmers. Gateshimself says Microsoft will gladly disclose itscrown jewels--the coveted code behind theWindows operating system--to selectcustomers."We can be open source. We love the conceptof shared source," said Bill Veghte, aMicrosoft VP. "That's a super-important shiftfor us in terms of code access.“Richard Stallman, founder of the FreeSoftware Foundation, countered saying…NAME TITLE ORGANIZATIONBill Gates CEO MicrosoftBill Veghte VP MicrosoftRichard Stallman founder Free Soft..IEWhat is “Information Extraction”Information Extraction = segmentation + classification + clustering + associationAs a familyof techniques:October 14, 2002, 4:00 a.m. PTFor years, Microsoft Corporation CEO BillGates railed against the economic philosophyof open-source software with Orwellian fervor,denouncing its communal licensing as a"cancer" that stifled technological innovation.Today, Microsoft claims to "love" the open-source concept, by which software code ismade public to encourage improvement anddevelopment by outside programmers. Gateshimself says Microsoft will gladly disclose itscrown jewels--the coveted code behind theWindows operating system--to selectcustomers."We can be open source. We love the conceptof shared source," said Bill Veghte, aMicrosoft VP. "That's a super-important shiftfor us in terms of code access.“Richard Stallman, founder of the FreeSoftware Foundation, countered saying…Microsoft CorporationCEOBill GatesMicrosoftGatesMicrosoftBill VeghteMicrosoftVPRichard StallmanfounderFree Software FoundationWhat is “Information Extraction”Information Extraction = segmentation + classification + association + clusteringAs a familyof techniques:October 14, 2002, 4:00 a.m. PTFor years, Microsoft Corporation CEO BillGates railed against the economic philosophyof open-source software with Orwellian fervor,denouncing its communal licensing as a"cancer" that stifled technological innovation.Today, Microsoft claims to "love" the open-source concept, by which software code ismade public to encourage improvement anddevelopment by outside programmers. Gateshimself says Microsoft will gladly disclose itscrown jewels--the coveted code behind theWindows operating system--to selectcustomers."We can be open source. We love the conceptof shared source," said Bill Veghte, aMicrosoft VP. "That's a super-important shiftfor us in terms of code access.“Richard Stallman, founder of the FreeSoftware Foundation, countered saying…Microsoft CorporationCEOBill GatesMicrosoftGatesMicrosoftBill VeghteMicrosoftVPRichard StallmanfounderFree Software FoundationWhat is “Information Extraction”Information Extraction =