No description, website, or topics provided.
Branch: master
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
sim-GEN Reorganize and release sim-GEN. Jun 1, 2018
sim-M
sim-R Reorganize and release sim-GEN. Jun 1, 2018
README.md Reorganize and release sim-GEN. Jun 1, 2018

README.md

Simulated Dialogue

Machines Talking To Machines (M2M)

We present datasets of conversations between an agent and a simulated user. These conversations are collected using our M2M framework that combines dialogue self-play and crowd sourcing to exhaustively generate dialogues. The dialogue self-play step generates dialogue outlines consisting of the semantic frames for each turn of the dialogue. The crowd sourcing step provides natural language realizations for each dialogue turn. More details are available in this paper. Please cite the paper if you use or discuss these datasets in your work:

@article{shah2018building,
  title={Building a Conversational Agent Overnight with Dialogue Self-Play},
  author={Shah, Pararth and Hakkani-T{\"u}r, Dilek and T{\"u}r, Gokhan and Rastogi, Abhinav and Bapna, Ankur and Nayak, Neha and Heck, Larry},
  journal={arXiv preprint arXiv:1801.04871},
  year={2018}
}

Datasets

We are releasing two datasets containing dialogues for booking a restaurant table and buying a movie ticket. The number of dialogues in each dataset are listed below. The README file within each directory contains further details about the dataset.

Dataset Slots Train Dev Test
Sim-R (Restaurant) price_range, location, restaurant_name,
category, num_people, date, time
1116 349 775
Sim-M (Movie) theatre_name, movie, date, time,
num_people
384 120 264
Sim-GEN (Movie) theatre_name, movie, date, time,
num_people
100K 10K 10K

The datasets are provided "AS IS" without any warranty, express or implied. Google disclaims all liability for any damages, direct or indirect, resulting from the use of these datasets.

Please email {abhirast, dilekh}@google.com with questions.

Dialogue State Tracking

Our publication Scalable Multi-Domain Dialogue State Tracking (IEEE ASRU 2017) reports joint goal accuracy on Sim-R and Sim-M datasets. The released version of the datasets includes fixes for some errors in dialogue state and action annotations. This updated version of the paper reports the results on corrected datasets.

End-to-End Trainable Task Oriented Dialogue

Our publication Dialogue Learning with Human Teaching and Feedback in End-to-End Trainable Task-Oriented Dialogue Systems uses Sim-GEN.