Skip to content
/ Effects-of-Dialogue-Context Public

The repository contains a subset of the ReDial dataset with additional annotations on relevance and usefulness created in the paper: Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems, accepted at NAACL'24

1 star 0 forks Branches Tags Activity
Star
Notifications

Clemenciah/Effects-of-Dialogue-Context

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits

Annotation interfaces

Annotation interfaces

 
 

Data

Data

 
 

README.md

README.md

 
 

Repository files navigation

Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems, NAACL'24 Findings

The repository consists of data used for analysis to understand how different context sizes and types influence the consistency of human evaluation labels.

About

The repository contains a subset of the ReDial dataset with additional annotations on relevance and usefulness created in the paper: Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems, accepted at NAACL'24

Topics

evaluation crowdsourcing relevance-feedback usefulness task-oriented-dialog-systems

Resources

Readme
Activity

Stars

1 star

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published