Speech and Language Processing Chapter 24 of SLP (part 2) Dialogue and Conversational AgentsOutline The Linguistics of Conversation Basic Conversational Agents ASR NLU Generation Dialogue Manager Dialogue Manager Design Finite State Frame-based Initiative: User, System, Mixed VoiceXML Information-State Dialogue-Act Detection Dialogue-Act Generation Evaluation Utility-based conversational agents MDP, POMDP 7/18/08 2 Speech and Language Processing -- Jurafsky and MartinInformation-State and Dialogue Acts If we want a dialogue system to be more than just form-filling Needs to: Decide when the user has asked a question, made a proposal, rejected a suggestion Ground a user’s utterance, ask clarification questions, suggestion plans Suggests: Conversational agent needs sophisticated models of interpretation and generation In terms of speech acts and grounding Needs more sophisticated representation of dialogue context than just a list of slots 7/18/08 3 Speech and Language Processing -- Jurafsky and MartinInformation-state architecture Information state Dialogue act interpreter Dialogue act generator Set of update rules Update dialogue state as acts are interpreted Generate dialogue acts Control structure to select which update rules to apply 7/18/08 4 Speech and Language Processing -- Jurafsky and MartinInformation-state 7/18/08 5 Speech and Language Processing -- Jurafsky and MartinDialogue acts • Also called “conversational moves” • An act with (internal) structure related specifically to its dialogue function • Incorporates ideas of grounding • Incorporates other dialogue and conversational functions that Austin and Searle didn’t seem interested in 7/18/08 6 Speech and Language Processing -- Jurafsky and MartinVerbmobil task Two-party scheduling dialogues Speakers were asked to plan a meeting at some future date Data used to design conversational agents which would help with this task (cross-language, translating, scheduling assistant) 7/18/08 7 Speech and Language Processing -- Jurafsky and MartinVerbmobil Dialogue Acts THANK thanks GREET Hello Dan INTRODUCE It’s me again BYE Allright, bye REQUEST-COMMENT How does that look? SUGGEST June 13th through 17th REJECT No, Friday I’m booked all day ACCEPT Saturday sounds fine REQUEST-SUGGEST What is a good day of the week for you? INIT I wanted to make an appointment with you GIVE_REASON Because I have meetings all afternoon FEEDBACK Okay DELIBERATE Let me check my calendar here CONFIRM Okay, that would be wonderful CLARIFY Okay, do you mean Tuesday the 23rd? 7/18/08 8 Speech and Language Processing -- Jurafsky and MartinAutomatic Interpretation of Dialogue Acts How do we automatically identify dialogue acts? Given an utterance: Decide whether it is a QUESTION, STATEMENT, SUGGEST, or ACK Recognizing illocutionary force will be crucial to building a dialogue agent Perhaps we can just look at the form of the utterance to decide? 7/18/08 9 Speech and Language Processing -- Jurafsky and MartinCan we just use the surface syntactic form? YES-NO-Q’s have auxiliary-before-subject syntax: Will breakfast be served on USAir 1557? STATEMENTs have declarative syntax: I don’t care about lunch COMMAND’s have imperative syntax: Show me flights from Milwaukee to Orlando on Thursday night 7/18/08 10 Speech and Language Processing -- Jurafsky and MartinSurface form != speech act type Locutionary Force Illocutionary Force Can I have the rest of your sandwich? Question Request I want the rest of your sandwich Declarative Request Give me your sandwich! Imperative Request 7/18/08 11 Speech and Language Processing -- Jurafsky and MartinDialogue act disambiguation is hard! Who’s on First? Abbott: Well, Costello, I'm going to New York with you. Bucky Harris the Yankee's manager gave me a job as coach for as long as you're on the team. Costello: Look Abbott, if you're the coach, you must know all the players. Abbott: I certainly do. Costello: Well you know I've never met the guys. So you'll have to tell me their names, and then I'll know who's playing on the team. Abbott: Oh, I'll tell you their names, but you know it seems to me they give these ball players now-a-days very peculiar names. Costello: You mean funny names? Abbott: Strange names, pet names...like Dizzy Dean... Costello: His brother Daffy Abbott: Daffy Dean... Costello: And their French cousin. Abbott: French? Costello: Goofe' Abbott: Goofe' Dean. Well, let's see, we have on the bags, Who's on first, What's on second, I Don't Know is on third... Costello: That's what I want to find out. Abbott: I say Who's on first, What's on second, I Don't Know's on third. 7/18/08 12 Speech and Language Processing -- Jurafsky and MartinDialogue act ambiguity Who’s on first? INFO-REQUEST or STATEMENT 7/18/08 13 Speech and Language Processing -- Jurafsky and MartinDialogue Act ambiguity Can you give me a list of the flights from Atlanta to Boston? This looks like an INFO-REQUEST. If so, the answer is: YES. But really it’s a DIRECTIVE or REQUEST, a polite form of: Please give me a list of the flights… What looks like a QUESTION can be a REQUEST 7/18/08 14 Speech and Language Processing -- Jurafsky and MartinDialogue Act ambiguity Similarly, what looks like a STATEMENT can be a QUESTION: Us OPEN-OPTION I was wanting to make some arrangements for a trip that I’m going to be taking uh to LA uh beginnning of the week after next Ag HOLD OK uh let me pull up your profile and I’ll be right with you here. [pause] Ag CHECK And you said you wanted to travel next week? Us ACCEPT Uh yes. 7/18/08 15 Speech and Language Processing -- Jurafsky and MartinIndirect speech acts Utterances which use a surface statement to ask a question Utterances which use a surface question to issue a request 7/18/08 16 Speech and Language Processing -- Jurafsky and MartinDA interpretation as statistical classification Lots of clues in each sentence that can tell us which DA it
or
We will never post anything without your permission.
Don't have an account? Sign up