Wip/synthetic data sampler

[jmhw0123]

Background

This is a simple synthetic data sampler that is intended to help the developer debug the canonical annotations to make sure that they fit well in the templates. The main function is to synthesize a small set of utterance-ThingTalk pairs and showcase the synthetic sentences from the canonical annotations.
The output file is in tsv format, where each row contains the id, utterance, and ThingTalk representation for one example.

Output file example:

yelp-000	What is the name of the restaurant?	[ id ] of @com.yelp . restaurant ( ) ;
yelp-001	What is the restaurant 's name?	[ id ] of @com.yelp . restaurant ( ) ;
yelp-002	What name does the restaurant have?	[ id ] of @com.yelp . restaurant ( ) ;

TODO

• Add support for generating synthetic data for specific input params

Known issues

• Some utterance generations were not handled properly. e.g.

{
  query: 'restaurant',
  queryCanonical: 'restaurant',
  argument: 'price',
  utterance: 'Show me a restaurant with cheap.',
  value: 'cheap',
  paraphrases: []
},
{
  query: 'restaurant',
  queryCanonical: 'restaurant',
  argument: 'price',
  utterance: 'which restaurant has cheap?',
  value: 'cheap',
  paraphrases: []
},
{
  query: 'restaurant',
  queryCanonical: 'restaurant',
  argument: 'price',
  utterance: 'which restaurant is ${value:select: moderate{moderately priced} _{${value}}} luxury?',
  value: 'luxury',
  paraphrases: []
}

[sileix]

I left some comments, let's get those addressed first before moving on.

[sileix]

Overall it looks good. There are some minor issues. Also I just realize we should add support for input param for queries as well... but let's not worry about that in this pr. Let's get this merged first.

[sileix]

rename query to action in this function?

[sileix]

Overall, it looks good.
One minor issue: you still have a lot of query, queryCanonical inside action functions, which will be confusing in the future. Please fix those.
Make sure you have eyeballed the output and they look good (or even better, add some unit test).
After that, you can merge this branch.