Files

abstractive-summarization
attention
chatbot
classification-comparison
dependency-parser
embedded
entity-tagging
extractive-summarization
generator
language-detection
misc
neural-machine-translation
- 1.basic-seq2seq-manual.ipynb
- 10.basic-birnn-seq2seq-greedy.ipynb
- 11.lstm-birnn-seq2seq-greedy.ipynb
- 12.gru-birnn-seq2seq-greedy.ipynb
- 13.basic-seq2seq-luong.ipynb
- 14.lstm-seq2seq-luong.ipynb
- 15.gru-seq2seq-luong.ipynb
- 16.basic-seq2seq-bahdanau.ipynb
- 17.lstm-seq2seq-bahdanau.ipynb
- 18.gru-seq2seq-bahdanau.ipynb
- 19.lstm-birnn-seq2seq-luong.ipynb
- 2.lstm-seq2seq-manual.ipynb
- 20.gru-birnn-seq2seq-luong.ipynb
- 21.lstm-birnn-seq2seq-bahdanau.ipynb
- 22.gru-birnn-seq2seq-bahdanau.ipynb
- 23.lstm-birnn-seq2seq-bahdanau-luong.ipynb
- 24.gru-birnn-seq2seq-bahdanau-luong.ipynb
- 25.lstm-seq2seq-greedy-luong.ipynb
- 26.gru-seq2seq-greedy-luong.ipynb
- 27.lstm-seq2seq-greedy-bahdanau.ipynb
- 28.gru-seq2seq-greedy-bahdanau.ipynb
- 29.lstm-seq2seq-beam.ipynb
- 3.gru-seq2seq-manual.ipynb
- 30.gru-seq2seq-beam.ipynb
- 31.lstm-birnn-seq2seq-beam-luong.ipynb
- 32.gru-birnn-seq2seq-beam-luong.ipynb
- 33.lstm-birnn-seq2seq-luong-bahdanau-stack-beam.ipynb
- 34.gru-birnn-seq2seq-luong-bahdanau-stack-beam.ipynb
- 35.byte-net.ipynb
- 36.estimator.ipynb
- 37.capsule-lstm-seq2seq-greedy.ipynb
- 38.capsule-lstm-seq2seq-luong-beam.ipynb
- 39.lstm-birnn-seq2seq-luong-bahdanau-stack-beam-dropout-l2.ipynb
- 4.basic-seq2seq-api-greedy.ipynb
- 40.dnc-seq2seq-bahdanau-greedy.ipynb
- 41.lstm-birnn-seq2seq-beam-luongmonotic.ipynb
- 42.lstm-birnn-seq2seq-beam-bahdanaumonotic.ipynb
- 43.memory-network-basic.ipynb
- 44.memory-network-lstm.ipynb
- 45.attention-is-all-you-need.ipynb
- 46.transformer-xl.ipynb
- 47.attention-is-all-you-need-beam-search.ipynb
- 48.conv-encoder-conv-decoder.ipynb
- 49.conv-encoder-lstm.ipynb
- 5.lstm-seq2seq-api-greedy.ipynb
- 50.byte-net-greedy.ipynb
- 51.gru-birnn-seq2seq-greedy-residual.ipynb
- 52.google-nmt.ipynb
- 53.dilated-seq2seq.ipynb
- 54.bert-lstm-luong.ipynb
- 55.bert-dilated-fairseq.ipynb
- 6.gru-seq2seq-greedy.ipynb
- 7.basic-birnn-seq2seq-manual.ipynb
- 8.lstm-birnn-seq2seq-manual.ipynb
- 9.gru-birnn-seq2seq-manual.ipynb
- README.md
- access.py
- addressing.py
- dnc.py
- english-train
- gpt_2.py
- util.py
- vietnam-train
not-deep-learning
ocr
pos-tagging
question-answer
sentence-pair
speech-to-text
squad-qa
stemming
text-augmentation
text-classification
text-similarity
text-to-speech
topic-generator
vocoder
.gitignore
LICENSE
README.md
tf-nlp.png

neural-machine-translation

huseinzol05

added BERT nmt

Jul 9, 2019

96f51d3 · Jul 9, 2019

History

This branch is 60 commits behind mesolitica/NLP-Models-Tensorflow:master.

Name	Name	Last commit message	Last commit date
parent directory ..
1.basic-seq2seq-manual.ipynb	1.basic-seq2seq-manual.ipynb	add neural machine translation	Mar 16, 2019
10.basic-birnn-seq2seq-greedy.ipynb	10.basic-birnn-seq2seq-greedy.ipynb	add neural machine translation	Mar 16, 2019
11.lstm-birnn-seq2seq-greedy.ipynb	11.lstm-birnn-seq2seq-greedy.ipynb	add neural machine translation	Mar 16, 2019
12.gru-birnn-seq2seq-greedy.ipynb	12.gru-birnn-seq2seq-greedy.ipynb	add neural machine translation	Mar 16, 2019
13.basic-seq2seq-luong.ipynb	13.basic-seq2seq-luong.ipynb	add neural machine translation	Mar 16, 2019
14.lstm-seq2seq-luong.ipynb	14.lstm-seq2seq-luong.ipynb	add neural machine translation	Mar 16, 2019
15.gru-seq2seq-luong.ipynb	15.gru-seq2seq-luong.ipynb	add neural machine translation	Mar 16, 2019
16.basic-seq2seq-bahdanau.ipynb	16.basic-seq2seq-bahdanau.ipynb	add neural machine translation	Mar 16, 2019
17.lstm-seq2seq-bahdanau.ipynb	17.lstm-seq2seq-bahdanau.ipynb	add neural machine translation	Mar 16, 2019
18.gru-seq2seq-bahdanau.ipynb	18.gru-seq2seq-bahdanau.ipynb	add neural machine translation	Mar 16, 2019
19.lstm-birnn-seq2seq-luong.ipynb	19.lstm-birnn-seq2seq-luong.ipynb	add neural machine translation	Mar 16, 2019
2.lstm-seq2seq-manual.ipynb	2.lstm-seq2seq-manual.ipynb	add neural machine translation	Mar 16, 2019
20.gru-birnn-seq2seq-luong.ipynb	20.gru-birnn-seq2seq-luong.ipynb	add neural machine translation	Mar 16, 2019
21.lstm-birnn-seq2seq-bahdanau.ipynb	21.lstm-birnn-seq2seq-bahdanau.ipynb	add neural machine translation	Mar 16, 2019
22.gru-birnn-seq2seq-bahdanau.ipynb	22.gru-birnn-seq2seq-bahdanau.ipynb	add neural machine translation	Mar 16, 2019
23.lstm-birnn-seq2seq-bahdanau-luong.ipynb	23.lstm-birnn-seq2seq-bahdanau-luong.ipynb	add neural machine translation	Mar 16, 2019
24.gru-birnn-seq2seq-bahdanau-luong.ipynb	24.gru-birnn-seq2seq-bahdanau-luong.ipynb	add neural machine translation	Mar 16, 2019
25.lstm-seq2seq-greedy-luong.ipynb	25.lstm-seq2seq-greedy-luong.ipynb	add neural machine translation	Mar 16, 2019
26.gru-seq2seq-greedy-luong.ipynb	26.gru-seq2seq-greedy-luong.ipynb	add neural machine translation	Mar 16, 2019
27.lstm-seq2seq-greedy-bahdanau.ipynb	27.lstm-seq2seq-greedy-bahdanau.ipynb	add neural machine translation	Mar 16, 2019
28.gru-seq2seq-greedy-bahdanau.ipynb	28.gru-seq2seq-greedy-bahdanau.ipynb	add neural machine translation	Mar 16, 2019
29.lstm-seq2seq-beam.ipynb	29.lstm-seq2seq-beam.ipynb	add neural machine translation	Mar 16, 2019
3.gru-seq2seq-manual.ipynb	3.gru-seq2seq-manual.ipynb	add neural machine translation	Mar 16, 2019
30.gru-seq2seq-beam.ipynb	30.gru-seq2seq-beam.ipynb	add neural machine translation	Mar 16, 2019
31.lstm-birnn-seq2seq-beam-luong.ipynb	31.lstm-birnn-seq2seq-beam-luong.ipynb	add neural machine translation	Mar 16, 2019
32.gru-birnn-seq2seq-beam-luong.ipynb	32.gru-birnn-seq2seq-beam-luong.ipynb	add neural machine translation	Mar 16, 2019
33.lstm-birnn-seq2seq-luong-bahdanau-stack-beam.ipynb	33.lstm-birnn-seq2seq-luong-bahdanau-stack-beam.ipynb	add neural machine translation	Mar 16, 2019
34.gru-birnn-seq2seq-luong-bahdanau-stack-beam.ipynb	34.gru-birnn-seq2seq-luong-bahdanau-stack-beam.ipynb	add neural machine translation	Mar 16, 2019
35.byte-net.ipynb	35.byte-net.ipynb	add neural machine translation	Mar 16, 2019
36.estimator.ipynb	36.estimator.ipynb	add neural machine translation	Mar 16, 2019
37.capsule-lstm-seq2seq-greedy.ipynb	37.capsule-lstm-seq2seq-greedy.ipynb	add neural machine translation	Mar 16, 2019
38.capsule-lstm-seq2seq-luong-beam.ipynb	38.capsule-lstm-seq2seq-luong-beam.ipynb	add neural machine translation	Mar 16, 2019
39.lstm-birnn-seq2seq-luong-bahdanau-stack-beam-dropout-l2.ipynb	39.lstm-birnn-seq2seq-luong-bahdanau-stack-beam-dropout-l2.ipynb	add neural machine translation	Mar 16, 2019
4.basic-seq2seq-api-greedy.ipynb	4.basic-seq2seq-api-greedy.ipynb	add neural machine translation	Mar 16, 2019
40.dnc-seq2seq-bahdanau-greedy.ipynb	40.dnc-seq2seq-bahdanau-greedy.ipynb	add neural machine translation	Mar 16, 2019
41.lstm-birnn-seq2seq-beam-luongmonotic.ipynb	41.lstm-birnn-seq2seq-beam-luongmonotic.ipynb	add neural machine translation	Mar 16, 2019
42.lstm-birnn-seq2seq-beam-bahdanaumonotic.ipynb	42.lstm-birnn-seq2seq-beam-bahdanaumonotic.ipynb	add neural machine translation	Mar 16, 2019
43.memory-network-basic.ipynb	43.memory-network-basic.ipynb	add neural machine translation	Mar 16, 2019
44.memory-network-lstm.ipynb	44.memory-network-lstm.ipynb	add neural machine translation	Mar 16, 2019
45.attention-is-all-you-need.ipynb	45.attention-is-all-you-need.ipynb	add neural machine translation	Mar 16, 2019
46.transformer-xl.ipynb	46.transformer-xl.ipynb	add neural machine translation	Mar 16, 2019
47.attention-is-all-you-need-beam-search.ipynb	47.attention-is-all-you-need-beam-search.ipynb	add neural machine translation	Mar 16, 2019
48.conv-encoder-conv-decoder.ipynb	48.conv-encoder-conv-decoder.ipynb	fix fairseq chatbot and neural machine translation	Apr 2, 2019
49.conv-encoder-lstm.ipynb	49.conv-encoder-lstm.ipynb	add neural machine translation	Mar 16, 2019
5.lstm-seq2seq-api-greedy.ipynb	5.lstm-seq2seq-api-greedy.ipynb	add neural machine translation	Mar 16, 2019
50.byte-net-greedy.ipynb	50.byte-net-greedy.ipynb	added more models	Apr 15, 2019
51.gru-birnn-seq2seq-greedy-residual.ipynb	51.gru-birnn-seq2seq-greedy-residual.ipynb	added residual gru for nmt	May 3, 2019
52.google-nmt.ipynb	52.google-nmt.ipynb	added google nmt	May 15, 2019
53.dilated-seq2seq.ipynb	53.dilated-seq2seq.ipynb	added dilated seq2seq	May 19, 2019
54.bert-lstm-luong.ipynb	54.bert-lstm-luong.ipynb	added BERT nmt	Jul 9, 2019
55.bert-dilated-fairseq.ipynb	55.bert-dilated-fairseq.ipynb	added BERT nmt	Jul 9, 2019
6.gru-seq2seq-greedy.ipynb	6.gru-seq2seq-greedy.ipynb	add neural machine translation	Mar 16, 2019
7.basic-birnn-seq2seq-manual.ipynb	7.basic-birnn-seq2seq-manual.ipynb	add neural machine translation	Mar 16, 2019
8.lstm-birnn-seq2seq-manual.ipynb	8.lstm-birnn-seq2seq-manual.ipynb	add neural machine translation	Mar 16, 2019
9.gru-birnn-seq2seq-manual.ipynb	9.gru-birnn-seq2seq-manual.ipynb	add neural machine translation	Mar 16, 2019
README.md	README.md	added dilated seq2seq	May 19, 2019
access.py	access.py	add neural machine translation	Mar 16, 2019
addressing.py	addressing.py	add neural machine translation	Mar 16, 2019
dnc.py	dnc.py	add neural machine translation	Mar 16, 2019
english-train	english-train	add neural machine translation	Mar 16, 2019
gpt_2.py	gpt_2.py	add neural machine translation	Mar 16, 2019
util.py	util.py	add neural machine translation	Mar 16, 2019
vietnam-train	vietnam-train	add neural machine translation	Mar 16, 2019

README.md

How-to

Run any notebook using Jupyter Notebook.

Accuracy, not sorted

Based on 20 epochs accuracy. The results will be different on different dataset. Trained on a GTX 960, 4GB VRAM.

name	accuracy
1.basic-seq2seq-manual	0.915255
2.lstm-seq2seq-manual	0.917009
3.gru-seq2seq-manual	0.920200
4.basic-seq2seq-api-greedy	0.960998
5.lstm-seq2seq-api-greedy	0.202590
6.gru-seq2seq-greedy	0.408099
7.basic-birnn-seq2seq-manual	0.919491
8.lstm-birnn-seq2seq-manual	0.918473
9.gru-birnn-seq2seq-manual	0.922818
10.basic-birnn-seq2seq-greedy	0.957355
11.lstm-birnn-seq2seq-greedy	0.202628
12.gru-birnn-seq2seq-greedy	0.484461
13.basic-seq2seq-luong	0.916100
14.lstm-seq2seq-luong	0.917736
15.gru-seq2seq-luong	0.919482
16.basic-seq2seq-bahdanau	0.915700
17.lstm-seq2seq-bahdanau	0.721833
18.gru-seq2seq-bahdanau	0.919218
19.lstm-birnn-seq2seq-luong	0.918555
20.gru-birnn-seq2seq-luong	0.919445
21.lstm-birnn-seq2seq-bahdanau	0.917655
22.gru-birnn-seq2seq-bahdanau	0.920555
23.lstm-birnn-seq2seq-bahdanau-luong	0.918182
24.gru-birnn-seq2seq-bahdanau-luong	0.920045
25.lstm-seq2seq-greedy-luong	0.364322
26.gru-seq2seq-greedy-luong	0.627814
27.lstm-seq2seq-greedy-bahdanau	0.378199
28.gru-seq2seq-greedy-bahdanau	0.470696
29.lstm-seq2seq-beam	0.122135
30.gru-seq2seq-beam	0.163046
31.lstm-birnn-seq2seq-beam-luong	0.171741
32.gru-birnn-seq2seq-beam-luong	0.189787
33.lstm-birnn-seq2seq-luong-bahdanau-stack-beam	0.098961
34.gru-birnn-seq2seq-luong-bahdanau-stack-beam	0.091473
35.byte-net	1.022409
36.estimator
37.capsule-lstm-seq2seq-greedy
38.capsule-lstm-seq2seq-luong-beam
39.lstm-birnn-seq2seq-luong-bahdanau-stack-beam-dropout-l2	0.066305
40.dnc-seq2seq-bahdanau-greedy	0.711184
41.lstm-birnn-seq2seq-beam-luongmonotic	0.624756
42.lstm-birnn-seq2seq-beam-bahdanaumonotic	0.624756
43.memory-network-basic	0.965700
44.memory-network-lstm	0.942591
45.attention-is-all-you-need	0.170279
46.transformer-xl	0.114907
47.attention-is-all-you-need-beam-search	0.158205
48.conv-encoder-conv-decoder	0.462655
49.conv-encoder-lstm	0.438702
50.byte-net-greedy.ipynb	1.023528
51.gru-birnn-seq2seq-greedy-residual.ipynb	0.561457
52.google-nmt.ipynb	0.675990
53.dilated-seq2seq.ipynb	1.023615

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Files

neural-machine-translation

neural-machine-translation

README.md

How-to

Accuracy, not sorted

Files

neural-machine-translation

Directory actions

More options

Directory actions

More options

Latest commit

History

neural-machine-translation

Folders and files

parent directory

README.md

How-to

Accuracy, not sorted