Discourse, coherence and anaphora resolutionWhat is discourse?Discourse phenomenaSlide 4Discourse connectivesImplicit and explicit discourse relationsAmbiguity of discourse connectivesPenn Discourse Tree BankIn a general text, what is the proportion of explicit versus implicit relations?How ambiguous are discourse connectives?Are certain sequences of relations more likely?Slide 12Reference resolutionDefinitionsSlide 15Features for pronominal anaphora resolutionPreferences in pronoun interpretation SalienceRelation to summarizationTypes of problems in manually edited summaries (15 multi-doc summaries)Slide 20Slide 21Slide 22Slide 231Discourse, coherence and anaphora resolutionLecture 162What is discourse?Any piece of text consisting of more than one sentenceUntil now our lectures revolved mainly around topics concerning word-level or sentence-level analysis.3Discourse phenomenaAnaphora resolution–The Tin Woodman went to Emerald City to see the Wizard of Oz and ask for a heart. After he asked for it, the Woodman waited for the Wizard’s response.Types of noun phrases–Indefinite: Julia has a cat. Some cat entered the house.–Definite: The cat is brown.–Pronoun: It doesn’t eat much.4Coherence–John hid Bill’s car keys. [the reason he did this was that] He was drunk.–?? John hid Bill’s car keys. [How are these sentences related?] He likes spinach.Coherence relations–explanation or cause–contrast or concession5Discourse connectivesCue phrases, discourse markers–Because, although, but, for example, yet, and–John hid Bill’s car keys because he was drunk.–[We can’t win] [but we must keep trying] contrast6Implicit and explicit discourse relations I took my umbrella this morning. [because] The forecast was rain in the afternoon.She is never late for meetings. [but] He always arrives 10 minutes late.She woke up early. [afterward] She had breakfast and went for a walk in the park.7Ambiguity of discourse connectivesThey have not spoken to each other since they argued last fall. (Temporal)I assumed you were not coming since you never replied to the invitation. (Causal)8Penn Discourse Tree BankAnnotated explicit and implicit discourse relationsEach relation is annotated with its sense9In a general text, what is the proportion of explicit versus implicit relations?10How ambiguous are discourse connectives?11Are certain sequences of relations more likely?12In order to interpret (understand) discourse automatically, the problem of identification and disambiguation of discourse relations needs to be addressed.What else?13Reference resolutionVictoria Chen, Chief Financial Officer of Megabucks Banking Corp since 2004, saw her pay jump 20%, to $1.3 million, as the 37-year-old also became the Denver-based financial-services company’s president. It has been ten years since she came to Megabucks from rival Lotsabucks.14DefinitionsReference: use of linguistic expressions (her, Chen) to denote an entity or individualReference resolution: the task of determining what entities are referred to by which linguistic expressionsA natural language expression used to perform reference is called a referring expression, and the entity that is referred to is called the referent.15Two referring expressions that are used to refer to the same entity are said to coreferReference to an entity that has been previously introduced into the discourse is called anaphora.Coreference resolution is the task of finding referring expressions in a text that refer to the same entity (coreference chains)16Features for pronominal anaphora resolutionNumber agreement–John has a Ford Falcon. It is red–?? John has a Ford Falcon. They are red.–John has three cars. They are red.–?? John has three cars. It is red.Person agreementGender agreement17Preferences in pronoun interpretationSalienceRecency– pronoun antecedents have been mentioned nearby in the text.Grammatical role: –typically entities mentioned in subject position are more salient than those mentioned in object positionRepeated mentionSelectional restrictions–John parked his car in the garage after driving it around for hours.18Relation to summarization Revisions that improve cohesion in multidocument summaries: a preliminary study (2002) Jahna C. Otterbacher, Dragomir R. Radev, Airong Luo . In Proceedings of the Workshop on Automatic Summarization19Types of problems in manually edited summaries (15 multi-doc summaries)Discourse – Concerns the relationships between the sentences in a summary, as well asthose between individual sentences and the overall summary.Identification of entities – Involves the resolution of referential expressions such that each entity mentioned in a summary can easily be identified by the reader.Temporal – Concerns the establishment of the correct temporal relationships between events.Grammar – Concerns the correction of grammatical problems, which may be the result of juxtaposing sentences from different sources, or due to the previous revisions that were made.Location/setting – Involves establishing where each event in a summary takes