No description, website, or topics provided.
Python
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.gitattributes
.gitignore
ActiveConstructionofExamplBase.py
CompiledSystemUtterance.pkl
CompiledUserUtterance.pkl
DialogWithCompileInfo.pkl
PerplexityCalculator.py
README.md
Vectorizor4System.pkl
Vectorizor4User.pkl
kylm.jar
model.arpa
nextdialchat.jar
ngrams.py
ngrams.pyc
temp4C
temp4WS

README.md

Name

AL4EBDS

Overview

This code is for replicating experiments in my IWSDS 2016 paper (to appear)

Description

AL4EBDS provides active learning framework for rapid development of example-based dialog system. This framework includes query selection methods (such uncertain sampling, and information density method) for constructing example database. For evaluating query selection methods, simulated environments based on several dialogue corpus are also provided.

Requirement

NLTK 3.0.2+

Sklearn 0.16.1+

Corpus for simulated environment (downloadable from here)

Quick start

  1. Install all requirements.
  2. Unzip corpus for simulated environment (Data_OracleCorpus.zip), and copy corpus accoring to experiment domain. For example, if you want to peform an experiment in bus information domain, you need to copy "OracleCorpus.bu.BusInfo(DSTC1)" directory into "/Active-Learning-for-Example-based-Dialog/OracleCorpus".
  3. Indicate experiment domain by setting value to "corpusType" in "/Active-Learning-for-Example-based-Dialog/ActiveConstructionofExamplBase.py". For example, if you want to perform an enperiment in bus information domain (i.e., copy "OracleCorpus.bu.BusInfo(DSTC1)" insto "OracleCorpus"), you need to set value "BusInfo": corpusType="BusInfo"
  4. Indicate query selection methods by setting value to "creationMethod" in "/Active-Learning-for-Example-based-Dialog/ActiveConstructionofExamplBase.py". For example, if you want to use uncertain sampling, you need to set value "MinInExample": creationMethod="MinInExample"

Tips

TBA

Licence

TBA

Author

TakuyaHiroka