Natural Language Processing and Word Representation.
tensorlayer.nlp
generate_skip_gram_batch
sample sample_top
SimpleVocabulary Vocabulary process_sentence create_vocab
simple_read_words read_words read_analogies_file build_vocab build_reverse_dictionary build_words_dataset save_vocab
words_to_word_ids word_ids_to_words
basic_tokenizer create_vocabulary initialize_vocabulary sentence_to_token_ids data_to_token_ids
moses_multi_bleu
generate_skip_gram_batch
sample
sample_top
SimpleVocabulary
Vocabulary
process_sentence
create_vocab
simple_read_words
read_words
read_analogies_file
build_vocab
build_reverse_dictionary
build_words_dataset
save_vocab
These functions can be done by Vocabulary
class.
words_to_word_ids
word_ids_to_words
basic_tokenizer
create_vocabulary
initialize_vocabulary
sentence_to_token_ids
data_to_token_ids
moses_multi_bleu