Skip to content


Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time
Jun 2, 2017

Dialog State Tracking Challenge 6 (DSTC6)

End-to-End Goal Oriented Dialog Learning

This track of the DSTC-6 challenge series is aiming to build End-to-End dialog systems for goal-oriented applications. Goal-oriented dialog technology is an important research issue and End-to-End dialog learning has emerged as a primary research subject in the domain of conversation agent learning. It consists in learning a dialog policy from transactional dialogs of a given domain. In this task, the automatic system responses generated using a given task-oriented dialog data will be evaluated.

A full description of the task and the dataset is available here

Test dataset format and submission procedure

The test-set is composed with 4 subdirectories: "tst1", "tst2", "tst3", "tst4".

A valid submission consists in a tarball (.tgz file) with the 4 subdirectories added in it. In each subdirectory of the test-set, 5 .json files have to be processed. The json files of the test-set follow the same format than the one produced by the baseline models provided in the scripts folder and can also be verified using the script. A valid response file should have the same name than the corresponding test file with the suffixe .answers.json and should follow the format of the response file described in the description of the task.

For example, the valid name of the test file tst1/dialog-task1API-kb1_atmosphere-distr0.5-tst1000.json must be tst1/dialog-task1API-kb1_atmosphere-distr0.5-tst1000.answers.json.

Submission link

The submissions have to be performed using this Google Form

The date of submission will be used as reference to deadline.

Contact Information

You can get the latest updates and participate in discussions on DSTC mailing list

To join the mailing list, send an email to: ( putting "subscribe DSTC" in the body of the message (without the quotes). To post a message, send your message to: (


No releases published


No packages published