ACL RD-TEC 1.0 Summarization of W97-0601
Paper Title:
EVALUATING INTERACTIVE DIALOGUE SYSTEMS: EXTENDING COMPONENT EVALUATION TO INTEGRATED SYSTEM EVALUATION
EVALUATING INTERACTIVE DIALOGUE SYSTEMS: EXTENDING COMPONENT EVALUATION TO INTEGRATED SYSTEM EVALUATION
Authors: Marilyn A. Walker and Diane J. Litman and Candace A. Kamm and Alicia Abella
Primarily assigned technology terms:
- database
- dialog system
- dialog systems
- dialogue evaluation
- dialogue system
- dialogue systems
- discourse segment tagging
- evaluation framework
- information-seeking
- instantiation
- interactive dialogue
- interactive spoken dialogue
- language generation
- language understanding
- linear regression
- measuring
- natural language generation
- natural language understanding
- normalization
- predictor
- recognition
- regression
- repair
- score normalization
- segment tagging
- speech recognition
- spoken dialogue
- spoken dialogue agent
- spoken dialogue system
- spoken dialogue systems
- tagging
- text-tospeech
- transcript evaluation
- validation
Other assigned terms:
- abbreviations
- approach
- attribute-value matrix
- attribute-value pairs
- background noise
- case
- chance agreement
- coefficient
- coherence
- community
- concept
- confusion matrix
- contextual appropriateness
- correlation
- correlations
- database query
- decision theory
- dialog
- dialog context
- dialog evaluation
- dialogue agent
- dialogue behavior
- dialogue corpus
- dialogue strategies
- dialogue strategy
- dialogue system evaluation
- dialogues
- discourse
- discourse segment
- distribution
- estimation
- evaluation function
- evaluation metrics
- explicit confirmation
- finite set
- general evaluation framework
- generation
- human judgement
- implicit confirmation
- information flow
- kappa
- kappa coefficient
- knowledge
- measure
- measures
- method
- methodology
- natural language
- noise
- performance evaluation
- prior distribution
- query
- redundant information
- reference answer
- representations
- semantic
- semantic representation
- standard deviation
- statistical significance
- subdialogue
- system evaluation
- system performance
- technologies
- terms
- theory
- tone
- transcript
- transformation
- understanding
- usability
- user
- user satisfaction
- user utterance
- utterance
