Add WMT16 into dataset.

[lcy-seso]

• Use moses to tokenize the raw input data.
• Need to add comments.

You can use this dataset like this:

train_data = paddle.batch(
    paddle.reader.shuffle(
        paddle.dataset.wmt16.train(
            src_dict_size=10000, trg_dict_size=10000, src_lang="en"),
        buf_size=1000),
    batch_size=batch_size)

[pkuyym]

Be careful about the naming style, since built-in functions in python are always named to __XXX__

[lcy-seso]

Yes, I agree. Do you think it is necessary to change the function named __xx__ into __xx also in other datasets (like wmt14) ?

[pkuyym]

It seems that naming a function to _xx is enough to declare the function to be private. I have no idea whether __xx is a better naming style. It would be better to unify the naming style, however it is a tedious work.

[lcy-seso]

Thank you. According to Google style, https://google.github.io/styleguide/pyguide.html#Naming I think __xx is ok. I will have a try.

[lcy-seso]

Done.

[guoshengCS]

LGTM