Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hainan's RNNLM setup #37

Open
wants to merge 186 commits into
base: master
Choose a base branch
from
Open

Hainan's RNNLM setup #37

wants to merge 186 commits into from

Commits on Sep 1, 2016

  1. in progress...

    @hainan-xv
    hainan-xv committed Sep 1, 2016
    Configuration menu
    Copy the full SHA
    d0a06e3 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2016

  1. change design - have 2 wordlists

    @hainan-xv
    hainan-xv committed Sep 5, 2016
    Configuration menu
    Copy the full SHA
    03f6bd8 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2016

  1. can train RNNLMs

    @hainan-xv
    hainan-xv committed Sep 12, 2016
    Configuration menu
    Copy the full SHA
    1bae64a View commit details
    Browse the repository at this point in the history

  2. Added evaluation binary. Not tested yet

    @hainan-xv
    hainan-xv committed Sep 12, 2016
    Configuration menu
    Copy the full SHA
    912770f View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2016

  1. evaluation reveals problems...

    @hainan-xv
    hainan-xv committed Sep 21, 2016
    Configuration menu
    Copy the full SHA
    451e2a4 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2016

  1. binaries are working now

    @hainan-xv
    hainan-xv committed Sep 27, 2016
    Configuration menu
    Copy the full SHA
    1d4e7c8 View commit details
    Browse the repository at this point in the history

  2. small chagne

    @hainan-xv
    hainan-xv committed Sep 27, 2016
    Configuration menu
    Copy the full SHA
    55c41b1 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into rnnlm

    @hainan-xv
    hainan-xv committed Sep 27, 2016
    Configuration menu
    Copy the full SHA
    f7181e4 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2016

  1. fix some bugs

    @hainan-xv
    hainan-xv committed Oct 24, 2016
    Configuration menu
    Copy the full SHA
    3805d0f View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2016

  1. finally working

    @hainan-xv
    hainan-xv committed Oct 25, 2016
    Configuration menu
    Copy the full SHA
    1ba7357 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2016

  1. implemented LSTM-LM

    @hainan-xv
    hainan-xv committed Oct 27, 2016
    Configuration menu
    Copy the full SHA
    5212f54 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2016

  1. aesthetic chagnes

    @hainan-xv
    hainan-xv committed Oct 28, 2016
    Configuration menu
    Copy the full SHA
    1b7b23b View commit details
    Browse the repository at this point in the history

  2. more aesthetic chagnes

    @hainan-xv
    hainan-xv committed Oct 28, 2016
    Configuration menu
    Copy the full SHA
    2f22d48 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2016

  1. scripts are pretty and runnable

    @hainan-xv
    hainan-xv committed Oct 29, 2016
    Configuration menu
    Copy the full SHA
    52e35c6 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2016

  1. ami lstm tuned - better than rnnlm

    @hainan-xv
    hainan-xv committed Oct 31, 2016
    Configuration menu
    Copy the full SHA
    37dc6c5 View commit details
    Browse the repository at this point in the history

  2. divide egs into archives for rnnlm training

    @hainan-xv
    hainan-xv committed Oct 31, 2016
    Configuration menu
    Copy the full SHA
    9ed83d6 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2016

  1. add script for WSJ (untuned)

    @hainan-xv
    hainan-xv committed Nov 1, 2016
    Configuration menu
    Copy the full SHA
    d00217c View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2016

  1. add words per second diagnostics; add PPL with OOS penalties

    @hainan-xv
    hainan-xv committed Nov 2, 2016
    Configuration menu
    Copy the full SHA
    52652ec View commit details
    Browse the repository at this point in the history

  2. starting to write the new LmNnetCompute class

    @hainan-xv
    hainan-xv committed Nov 2, 2016
    Configuration menu
    Copy the full SHA
    0f85a2d View commit details
    Browse the repository at this point in the history

  3. starting to write the new LmNnetCompute class, include new files

    @hainan-xv
    hainan-xv committed Nov 2, 2016
    Configuration menu
    Copy the full SHA
    bd11e28 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2016

  1. add show-progress

    @hainan-xv
    hainan-xv committed Nov 3, 2016
    Configuration menu
    Copy the full SHA
    b12b1d0 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2016

  1. continue implementing RNNLM; change designs

    @hainan-xv
    hainan-xv committed Nov 4, 2016
    Configuration menu
    Copy the full SHA
    2755d54 View commit details
    Browse the repository at this point in the history

  2. buggy rnnlm-init

    @hainan-xv
    hainan-xv committed Nov 4, 2016
    Configuration menu
    Copy the full SHA
    49737e9 View commit details
    Browse the repository at this point in the history

  3. fix the memery but in LmNnet; rnnlm-init is working

    @hainan-xv
    hainan-xv committed Nov 4, 2016
    Configuration menu
    Copy the full SHA
    e582e09 View commit details
    Browse the repository at this point in the history

  4. there is a bug in rnnlm-train; included testing scripts

    @hainan-xv
    hainan-xv committed Nov 4, 2016
    Configuration menu
    Copy the full SHA
    e1b33cd View commit details
    Browse the repository at this point in the history

  5. still debugging

    @hainan-xv
    hainan-xv committed Nov 4, 2016
    Configuration menu
    Copy the full SHA
    7dd21ad View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2016

  1. still debugging...

    @hainan-xv
    hainan-xv committed Nov 7, 2016
    Configuration menu
    Copy the full SHA
    3ea9ef3 View commit details
    Browse the repository at this point in the history

  2. realized that I used a bad design w.r.t. egs input projections... com… 

    …mit before fixing it
    @hainan-xv
    hainan-xv committed Nov 7, 2016
    Configuration menu
    Copy the full SHA
    5df77b4 View commit details
    Browse the repository at this point in the history

  3. new design...

    @hainan-xv
    hainan-xv committed Nov 7, 2016
    Configuration menu
    Copy the full SHA
    75b323d View commit details
    Browse the repository at this point in the history

  4. now able to get derivatives w.r.t. input

    @hainan-xv
    hainan-xv committed Nov 7, 2016
    Configuration menu
    Copy the full SHA
    a4d40c9 View commit details
    Browse the repository at this point in the history

  5. can't find the bug...

    @hainan-xv
    hainan-xv committed Nov 7, 2016
    Configuration menu
    Copy the full SHA
    e61de3c View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2016

  1. found the bug. it seems to be working now

    @hainan-xv
    hainan-xv committed Nov 8, 2016
    Configuration menu
    Copy the full SHA
    7cfe475 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2016

  1. re-write the first layers with CPU; not finished yet

    @hainan-xv
    hainan-xv committed Nov 9, 2016
    Configuration menu
    Copy the full SHA
    7e20e28 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2016

  1. re-write the underlying Component class to use CPU matrices

    @hainan-xv
    hainan-xv committed Nov 10, 2016
    Configuration menu
    Copy the full SHA
    7acd96a View commit details
    Browse the repository at this point in the history

  2. re-write the underlying Component class to use CPU matrices - added l… 

    …ots of code
    @hainan-xv
    hainan-xv committed Nov 10, 2016
    Configuration menu
    Copy the full SHA
    cd2ea74 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2016

  1. get rid of some redundant code

    @hainan-xv
    hainan-xv committed Nov 14, 2016
    Configuration menu
    Copy the full SHA
    f75e5c9 View commit details
    Browse the repository at this point in the history

  2. re-wrote backpropagation with sparse matrix; buggy

    @hainan-xv
    hainan-xv committed Nov 14, 2016
    Configuration menu
    Copy the full SHA
    169fc0f View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2016

  1. back using GPU for output layers

    @hainan-xv
    hainan-xv committed Nov 15, 2016
    Configuration menu
    Copy the full SHA
    b23955d View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2016

  1. done with regular RNNLMs with the new design\!

    @hainan-xv
    hainan-xv committed Nov 16, 2016
    Configuration menu
    Copy the full SHA
    42a3ac9 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2016

  1. setup tested to be correct

    @hainan-xv
    hainan-xv committed Nov 17, 2016
    Configuration menu
    Copy the full SHA
    86abb85 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2016

  1. linear componnet

    @hainan-xv
    hainan-xv committed Nov 19, 2016
    Configuration menu
    Copy the full SHA
    e7c5d8a View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2016

  1. linear componnet, make the config more flexible

    @hainan-xv
    hainan-xv committed Nov 20, 2016
    Configuration menu
    Copy the full SHA
    03eabbd View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2016

  1. add rnnlm-compute-prob; add a lot of const to the classes for better … 

    …maintenance
    @hainan-xv
    hainan-xv committed Nov 21, 2016
    Configuration menu
    Copy the full SHA
    147cf87 View commit details
    Browse the repository at this point in the history

  2. fix bugs in previous commit

    @hainan-xv
    hainan-xv committed Nov 21, 2016
    Configuration menu
    Copy the full SHA
    5c4da99 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2016

  1. small changes

    @hainan-xv
    hainan-xv committed Nov 22, 2016
    Configuration menu
    Copy the full SHA
    ecb4e7f View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2016

  1. starting the sample-affine-logsoftmax-component

    @hainan-xv
    hainan-xv committed Nov 27, 2016
    Configuration menu
    Copy the full SHA
    063b140 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2016

  1. add sampling and forward code

    @hainan-xv
    hainan-xv committed Nov 28, 2016
    Configuration menu
    Copy the full SHA
    9299526 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2016

  1. add code for back-prob; so-far only implemented on CPU for easier deb… 

    …ugging
    @hainan-xv
    hainan-xv committed Nov 29, 2016
    Configuration menu
    Copy the full SHA
    2b345ef View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2016

  1. changes in architecture

    @hainan-xv
    hainan-xv committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    0d1eba4 View commit details
    Browse the repository at this point in the history

  2. new based classes finished

    @hainan-xv
    hainan-xv committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    2352a5b View commit details
    Browse the repository at this point in the history

  3. runable but getting nan's

    @hainan-xv
    hainan-xv committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    3a16b1f View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2016

  1. still getting nan's but I think I know why

    @hainan-xv
    hainan-xv committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    a4d32f8 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2016

  1. done with the normalized layer; to run on data

    @hainan-xv
    hainan-xv committed Dec 7, 2016
    Configuration menu
    Copy the full SHA
    d20661b View commit details
    Browse the repository at this point in the history

  2. runnable; getting nan's

    @hainan-xv
    hainan-xv committed Dec 7, 2016
    Configuration menu
    Copy the full SHA
    0e8e5b5 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2016

  1. re-write in cu-matrix

    @hainan-xv
    hainan-xv committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    3b44e8b View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2016

  1. preparing for reviews

    @hainan-xv
    hainan-xv committed Dec 19, 2016
    Configuration menu
    Copy the full SHA
    78eb7c1 View commit details
    Browse the repository at this point in the history

  2. to review

    @hainan-xv
    hainan-xv committed Dec 19, 2016
    Configuration menu
    Copy the full SHA
    d7c5a73 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2016

  1. fixed some small bugs; no *unexpected* nan's anymore

    @hainan-xv
    hainan-xv committed Dec 21, 2016
    Configuration menu
    Copy the full SHA
    02f0498 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/hainan-xv/kaldi

    @hainan-xv
    hainan-xv committed Dec 21, 2016
    Configuration menu
    Copy the full SHA
    e18eb37 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into my-rnnlm

    @hainan-xv
    hainan-xv committed Dec 21, 2016
    Configuration menu
    Copy the full SHA
    0438594 View commit details
    Browse the repository at this point in the history

  4. add per-comp-max-change code; still not training correctly

    @hainan-xv
    hainan-xv committed Dec 21, 2016
    Configuration menu
    Copy the full SHA
    14d0bd6 View commit details
    Browse the repository at this point in the history

Commits on Dec 22, 2016

  1. re-design some of the code

    @hainan-xv
    hainan-xv committed Dec 22, 2016
    Configuration menu
    Copy the full SHA
    2c12ba5 View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2016

  1. more changes

    @hainan-xv
    hainan-xv committed Dec 26, 2016
    Configuration menu
    Copy the full SHA
    69510ca View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2016

  1. add code for coverting prob vectors

    @hainan-xv
    hainan-xv committed Dec 27, 2016
    Configuration menu
    Copy the full SHA
    131c8d9 View commit details
    Browse the repository at this point in the history

  2. fix a bug when a correct output label appears more than once in a min… 

    …ibatch
    @hainan-xv
    hainan-xv committed Dec 27, 2016
    Configuration menu
    Copy the full SHA
    07e0a9b View commit details
    Browse the repository at this point in the history

  3. pipeline draft finished

    @hainan-xv
    hainan-xv committed Dec 27, 2016
    Configuration menu
    Copy the full SHA
    ff1ab0e View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2016

  1. running now

    @hainan-xv
    hainan-xv committed Dec 28, 2016
    Configuration menu
    Copy the full SHA
    b3f0c08 View commit details
    Browse the repository at this point in the history

  2. fix rand() issue

    @hainan-xv
    hainan-xv committed Dec 28, 2016
    Configuration menu
    Copy the full SHA
    d9677a3 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2016

  1. sorting before sampling; fix Rand() issue for Windows

    @hainan-xv
    hainan-xv committed Dec 29, 2016
    Configuration menu
    Copy the full SHA
    0670dc5 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2016

  1. adding the unigram code; made it worse...

    @hainan-xv
    hainan-xv committed Dec 30, 2016
    Configuration menu
    Copy the full SHA
    22a84c6 View commit details
    Browse the repository at this point in the history

  2. cleaned a bit

    @hainan-xv
    hainan-xv committed Dec 30, 2016
    Configuration menu
    Copy the full SHA
    1e555ee View commit details
    Browse the repository at this point in the history

  3. test ideas...

    @hainan-xv
    hainan-xv committed Dec 30, 2016
    Configuration menu
    Copy the full SHA
    167dfd9 View commit details
    Browse the repository at this point in the history

  4. test ideas; add some comment for NormalizeVec()

    @hainan-xv
    hainan-xv committed Dec 30, 2016
    Configuration menu
    Copy the full SHA
    c1c44d6 View commit details
    Browse the repository at this point in the history

  5. new linear transform added which helped PPL; add more comments for th… 

    …e sampling code
    @hainan-xv
    hainan-xv committed Dec 30, 2016
    Configuration menu
    Copy the full SHA
    47b9fa0 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2017

  1. the normalized-layer method works like magic

    @hainan-xv
    hainan-xv committed Jan 2, 2017
    Configuration menu
    Copy the full SHA
    0ff3342 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2017

  1. fixed small bugs

    @hainan-xv
    hainan-xv committed Jan 3, 2017
    Configuration menu
    Copy the full SHA
    53d2b63 View commit details
    Browse the repository at this point in the history

  2. add test code for SamplingWithoutReplacement()

    Ke Li committed Jan 3, 2017
    Configuration menu
    Copy the full SHA
    2d2dfe2 View commit details
    Browse the repository at this point in the history

  3. modify code to ensure the test won't terminates if the convergence te… 

    …st is failed
    Ke Li committed Jan 3, 2017
    Configuration menu
    Copy the full SHA
    b38eb6a View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2017

  1. add a normalize-to-one component

    @hainan-xv
    hainan-xv committed Jan 4, 2017
    Configuration menu
    Copy the full SHA
    3580ed9 View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2017

  1. restructured duplicate code; add test for k = 1, 2, and n

    Ke Li committed Jan 5, 2017
    Configuration menu
    Copy the full SHA
    ce2af52 View commit details
    Browse the repository at this point in the history

  2. use pointer instead of reference in function args; minor changes like… 

    … variable names
    Ke Li committed Jan 5, 2017
    Configuration menu
    Copy the full SHA
    cd110a0 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2017

  1. applied several tricks to the normalized-component method; getting ve… 

    …ry close PPLs with softmax'ed RNN
    @hainan-xv
    hainan-xv committed Jan 7, 2017
    Configuration menu
    Copy the full SHA
    e245a3d View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2017

  1. sigmoid + normalize trick

    @hainan-xv
    hainan-xv committed Jan 8, 2017
    Configuration menu
    Copy the full SHA
    34e78a1 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2017

  1. more tricks...

    @hainan-xv
    hainan-xv committed Jan 9, 2017
    Configuration menu
    Copy the full SHA
    ed64185 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2017

  1. Merge pull request #1 from keli78/my-rnnlm 

    test code
    @hainan-xv
    hainan-xv committed Jan 10, 2017
    Configuration menu
    Copy the full SHA
    95a6f96 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2017

  1. tuning sampling method; found small bug in sampling code

    @hainan-xv
    hainan-xv committed Jan 11, 2017
    Configuration menu
    Copy the full SHA
    8194443 View commit details
    Browse the repository at this point in the history

  2. fix sampling bug

    @hainan-xv
    hainan-xv committed Jan 11, 2017
    Configuration menu
    Copy the full SHA
    0540dd7 View commit details
    Browse the repository at this point in the history

  3. major improvement on the sampling method

    @hainan-xv
    hainan-xv committed Jan 11, 2017
    Configuration menu
    Copy the full SHA
    d0bffb9 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2017

  1. fix one hidden issue in the sampling code caused by numerical problem… 

    …s. sampling code is almost certainly bug-free now
    @hainan-xv
    hainan-xv committed Jan 12, 2017
    Configuration menu
    Copy the full SHA
    bc21318 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2017

  1. make rnnlm-compute-probs work; can report train and dev PPLs (normali… 

    …zed and unnormalized both supported)
    @hainan-xv
    hainan-xv committed Jan 13, 2017
    Configuration menu
    Copy the full SHA
    a7fb871 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2017

  1. writing rnnlm-show-progress (in progress still)

    @hainan-xv
    hainan-xv committed Jan 17, 2017
    Configuration menu
    Copy the full SHA
    a3d19ca View commit details
    Browse the repository at this point in the history

  2. rnnlm-show-progress, seg fault

    @hainan-xv
    hainan-xv committed Jan 17, 2017
    Configuration menu
    Copy the full SHA
    3e574ae View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2017

  1. rnnlm-compute-probs working

    @hainan-xv
    hainan-xv committed Jan 18, 2017
    Configuration menu
    Copy the full SHA
    33a004c View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2017

  1. supporting new objf with no sampling now

    @hainan-xv
    hainan-xv committed Jan 19, 2017
    Configuration menu
    Copy the full SHA
    ebab9f7 View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2017

  1. rnnlm merge with shortcut

    @hainan-xv
    hainan-xv committed Jan 20, 2017
    Configuration menu
    Copy the full SHA
    3a664b9 View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2017

  1. some changes to make it more efficient

    @hainan-xv
    hainan-xv committed Jan 21, 2017
    Configuration menu
    Copy the full SHA
    f9e81b8 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2017

  1. cuda kernels for sparse matrix affine forward/backward prop

    @freewym
    freewym committed Jan 24, 2017
    Configuration menu
    Copy the full SHA
    1795a5c View commit details
    Browse the repository at this point in the history

  2. Merge pull request #4 from freewym/shortcut2 

    cuda kernels for sparse matrix affine forward/backward prop
    @hainan-xv
    hainan-xv committed Jan 24, 2017
    Configuration menu
    Copy the full SHA
    ae9b986 View commit details
    Browse the repository at this point in the history

  3. use binary search instead of linear search in sampling; fix a bug in … 

    …cuda function for LmLinearComponent
    @hainan-xv
    hainan-xv committed Jan 24, 2017
    Configuration menu
    Copy the full SHA
    6a43ff7 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2017

  1. fix a bug where input matrix to nnet3 in rnnlm is uninitialized

    @hainan-xv
    hainan-xv committed Jan 27, 2017
    Configuration menu
    Copy the full SHA
    1a8536c View commit details
    Browse the repository at this point in the history

  2. rebuild comparable baseline

    @hainan-xv
    hainan-xv committed Jan 27, 2017
    Configuration menu
    Copy the full SHA
    3b70acf View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2017

  1. add NaturalGradientLinearComponent

    @hainan-xv
    hainan-xv committed Jan 28, 2017
    Configuration menu
    Copy the full SHA
    2af0e93 View commit details
    Browse the repository at this point in the history

  2. natural gradient on rnnlm

    @hainan-xv
    hainan-xv committed Jan 28, 2017
    Configuration menu
    Copy the full SHA
    1142e60 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2017

  1. aesthetic changes

    @hainan-xv
    hainan-xv committed Jan 30, 2017
    Configuration menu
    Copy the full SHA
    c79e1b1 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2017

  1. more aesthetic changes

    @hainan-xv
    hainan-xv committed Feb 3, 2017
    Configuration menu
    Copy the full SHA
    09b35fd View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2017

  1. sample a word version1 (IO is written by myself)

    Ke Li committed Feb 8, 2017
    Configuration menu
    Copy the full SHA
    62c48b2 View commit details
    Browse the repository at this point in the history

  2. sample a word version 2 (use fst Symbol table and kaldi io)

    Ke Li committed Feb 8, 2017
    Configuration menu
    Copy the full SHA
    7ae1bff View commit details
    Browse the repository at this point in the history

  3. more aesthetic changes; add test code

    @hainan-xv
    hainan-xv committed Feb 8, 2017
    Configuration menu
    Copy the full SHA
    dd8aea9 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2017

  1. add natural gradient for the output layer

    @hainan-xv
    hainan-xv committed Feb 20, 2017
    Configuration menu
    Copy the full SHA
    d6ae8e7 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2017

  1. fix a bug with max-change for the in/out layers

    @hainan-xv
    hainan-xv committed Feb 21, 2017
    Configuration menu
    Copy the full SHA
    799f355 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2017

  1. tuning

    @hainan-xv
    hainan-xv committed Feb 26, 2017
    Configuration menu
    Copy the full SHA
    0f0870b View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2017

  1. adversarial training

    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    b49997a View commit details
    Browse the repository at this point in the history

  2. added NnetComputer object to adversarial step to accout for the code … 

    …refactoring
    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    a6adf89 View commit details
    Browse the repository at this point in the history

  3. Travis re-check

    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    e8df0c5 View commit details
    Browse the repository at this point in the history

  4. fix

    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    0aa1bc5 View commit details
    Browse the repository at this point in the history

  5. fix2

    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    7c23ceb View commit details
    Browse the repository at this point in the history

  6. added natural gradient freezing code

    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    bac0a08 View commit details
    Browse the repository at this point in the history

  7. fix3

    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    8fe4b95 View commit details
    Browse the repository at this point in the history

  8. fix4

    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    c2e65e0 View commit details
    Browse the repository at this point in the history

  9. added option adversarial-training-prob; changes according to the last… 

    … review
    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    6b074f2 View commit details
    Browse the repository at this point in the history

  10. assert fix

    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    e3da23c View commit details
    Browse the repository at this point in the history

  11. changes from < to <= for adversarial_training_prob to make it more re… 

    …asonable when prob=1
    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    2c2312b View commit details
    Browse the repository at this point in the history

  12. change from adversarial-training-prob to adversarial-trainining-inter… 

    …val for potential more training stability
    @freewym
    freewym committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    511e136 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2017

  1. 2-stage sampling works

    @hainan-xv
    hainan-xv committed Mar 3, 2017
    Configuration menu
    Copy the full SHA
    6ea1135 View commit details
    Browse the repository at this point in the history

  2. try out non-natural affine for LM

    @hainan-xv
    hainan-xv committed Mar 3, 2017
    Configuration menu
    Copy the full SHA
    049c437 View commit details
    Browse the repository at this point in the history

  3. merge with latest master

    @hainan-xv
    hainan-xv committed Mar 3, 2017
    Configuration menu
    Copy the full SHA
    69e328b View commit details
    Browse the repository at this point in the history

  4. merge wangs update method with rnnlm

    @hainan-xv
    hainan-xv committed Mar 3, 2017
    Configuration menu
    Copy the full SHA
    6c5da3f View commit details
    Browse the repository at this point in the history

  5. rnnlm + wang's update

    @hainan-xv
    hainan-xv committed Mar 3, 2017
    Configuration menu
    Copy the full SHA
    5967298 View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2017

  1. unigram initialization for non-natural gradient layer

    @hainan-xv
    hainan-xv committed Mar 7, 2017
    Configuration menu
    Copy the full SHA
    bcba8fb View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2017

  1. new idea about grouping...; back the old code

    @hainan-xv
    hainan-xv committed Mar 13, 2017
    Configuration menu
    Copy the full SHA
    b5bdf3c View commit details
    Browse the repository at this point in the history

  2. grouping code finished but undebugged

    @hainan-xv
    hainan-xv committed Mar 13, 2017
    Configuration menu
    Copy the full SHA
    2268dad View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2017

  1. grouping with bigram done

    @hainan-xv
    hainan-xv committed Mar 14, 2017
    Configuration menu
    Copy the full SHA
    868cf8c View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2017

  1. to add through test code for 2-stage sampling

    @hainan-xv
    hainan-xv committed Mar 20, 2017
    Configuration menu
    Copy the full SHA
    c8baae7 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2017

  1. add test for DoGroupingCDF

    @hainan-xv
    hainan-xv committed Mar 21, 2017
    Configuration menu
    Copy the full SHA
    dd777c0 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2017

  1. generate samples in egs

    @hainan-xv
    hainan-xv committed Mar 27, 2017
    Configuration menu
    Copy the full SHA
    efcf0bb View commit details
    Browse the repository at this point in the history

  2. generate samples in egs, seems to be working

    @hainan-xv
    hainan-xv committed Mar 27, 2017
    Configuration menu
    Copy the full SHA
    1fdc779 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2017

  1. using double in sampling to prevent issues

    @hainan-xv
    hainan-xv committed Mar 28, 2017
    Configuration menu
    Copy the full SHA
    2fcb4f8 View commit details
    Browse the repository at this point in the history

  2. fix a bug in computing weights of histories

    Ke Li committed Mar 28, 2017
    Configuration menu
    Copy the full SHA
    04996e8 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2017

  1. rnnlm training draft finished

    @hainan-xv
    hainan-xv committed Apr 3, 2017
    Configuration menu
    Copy the full SHA
    1190b3d View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2017

  1. Add history-weight test

    Ke Li committed Apr 6, 2017
    Configuration menu
    Copy the full SHA
    62e5f9b View commit details
    Browse the repository at this point in the history

  2. fixed Makefile

    @freewym
    freewym committed Apr 6, 2017
    Configuration menu
    Copy the full SHA
    03ec444 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #9 from freewym/wangs-update 

    fixed Makefile
    @hainan-xv
    hainan-xv committed Apr 6, 2017
    Configuration menu
    Copy the full SHA
    60608b4 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2017

  1. debugging...

    @hainan-xv
    hainan-xv committed Apr 12, 2017
    Configuration menu
    Copy the full SHA
    12d387a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'wangs-update' of https://github.com/hainan-xv/kaldi int… 

    …o wangs-update
    @hainan-xv
    hainan-xv committed Apr 12, 2017
    Configuration menu
    Copy the full SHA
    eb37f98 View commit details
    Browse the repository at this point in the history

  3. a natural gradient bug... reasons yet to find

    @hainan-xv
    hainan-xv committed Apr 12, 2017
    Configuration menu
    Copy the full SHA
    f9db3f3 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2017

  1. get rid of alternative classes

    @hainan-xv
    hainan-xv committed Apr 17, 2017
    Configuration menu
    Copy the full SHA
    f92dd96 View commit details
    Browse the repository at this point in the history

  2. get rid of LmComponent base class

    @hainan-xv
    hainan-xv committed Apr 17, 2017
    Configuration menu
    Copy the full SHA
    e6d9d19 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2017

  1. fix bug in sampling

    @hainan-xv
    hainan-xv committed Apr 18, 2017
    Configuration menu
    Copy the full SHA
    77c7306 View commit details
    Browse the repository at this point in the history

  2. fix more bugs in sampling

    @hainan-xv
    hainan-xv committed Apr 18, 2017
    Configuration menu
    Copy the full SHA
    045398c View commit details
    Browse the repository at this point in the history

  3. new sampling code passes tests

    @hainan-xv
    hainan-xv committed Apr 18, 2017
    Configuration menu
    Copy the full SHA
    d61ff54 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2017

  1. fixed the sampling bug; pipeline working in easy conditions

    @hainan-xv
    hainan-xv committed Apr 19, 2017
    Configuration menu
    Copy the full SHA
    26a2a11 View commit details
    Browse the repository at this point in the history

  2. fixed a bug in nnet-example io functions

    @hainan-xv
    hainan-xv committed Apr 19, 2017
    Configuration menu
    Copy the full SHA
    4fdde14 View commit details
    Browse the repository at this point in the history

  3. still buggy...

    @hainan-xv
    hainan-xv committed Apr 19, 2017
    Configuration menu
    Copy the full SHA
    8403b67 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2017

  1. fixed more bugs

    @hainan-xv
    hainan-xv committed Apr 20, 2017
    Configuration menu
    Copy the full SHA
    d1202d3 View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2017

  1. still cant find the bug...

    @hainan-xv
    hainan-xv committed Apr 21, 2017
    Configuration menu
    Copy the full SHA
    b2d4bac View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2017

  1. got rid of normalizeonecomponent

    @hainan-xv
    hainan-xv committed Apr 24, 2017
    Configuration menu
    Copy the full SHA
    38ef328 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2017

  1. add interface for lattice-rescoring

    @hainan-xv
    hainan-xv committed Apr 25, 2017
    Configuration menu
    Copy the full SHA
    12f119e View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2017

  1. Add ComputeOutputWords function; remove auto; remove histories and hi… 

    …sts_weights as class members
    Ke Li committed Apr 28, 2017
    Configuration menu
    Copy the full SHA
    2103485 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'wangs-update' into rnnlm-shortcut

    @keli78
    keli78 committed Apr 28, 2017
    Configuration menu
    Copy the full SHA
    449c15b View commit details
    Browse the repository at this point in the history

  3. add test code for LmOutputComponent

    @hainan-xv
    hainan-xv committed Apr 28, 2017
    Configuration menu
    Copy the full SHA
    af2a4c2 View commit details
    Browse the repository at this point in the history

  4. adding the ComputeLogProb interface to LmOutputComponent

    @hainan-xv
    hainan-xv committed Apr 28, 2017
    Configuration menu
    Copy the full SHA
    7de1e33 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #8 from keli78/rnnlm-shortcut 

    Arpa-reading and generating average prob distribution over words on different histories
    @hainan-xv
    hainan-xv committed Apr 28, 2017
    Configuration menu
    Copy the full SHA
    9506f72 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2017

  1. found bugs in natural gradient init/IO code

    @hainan-xv
    hainan-xv committed May 2, 2017
    Configuration menu
    Copy the full SHA
    af29d26 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2017

  1. change the conditionlogprob function to be const

    @hainan-xv
    hainan-xv committed May 3, 2017
    Configuration menu
    Copy the full SHA
    9fc7168 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2017

  1. fixed a small bug; found a big bug; will fix by tmr

    @hainan-xv
    hainan-xv committed May 4, 2017
    Configuration menu
    Copy the full SHA
    f23806c View commit details
    Browse the repository at this point in the history

  2. fixed the bug. seems to be working

    @hainan-xv
    hainan-xv committed May 4, 2017
    Configuration menu
    Copy the full SHA
    4c4a6c9 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2017

  1. turning off preconditioning on the output side

    @hainan-xv
    hainan-xv committed May 6, 2017
    Configuration menu
    Copy the full SHA
    e84e403 View commit details
    Browse the repository at this point in the history

  2. fix bug in ComputeLogprobOfWordGivenHistory which didn't consider the… 

    … bias
    @hainan-xv
    hainan-xv committed May 6, 2017
    Configuration menu
    Copy the full SHA
    7fa005c View commit details
    Browse the repository at this point in the history

Commits on May 7, 2017

  1. change how backprop is done in training; now call backprop only once

    @hainan-xv
    hainan-xv committed May 7, 2017
    Configuration menu
    Copy the full SHA
    ef6a357 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2017

  1. merge with latest master

    @hainan-xv
    hainan-xv committed May 9, 2017
    Configuration menu
    Copy the full SHA
    9bddfc5 View commit details
    Browse the repository at this point in the history

  2. nnet3 rnnlm rescoring

    @freewym
    freewym committed May 9, 2017
    Configuration menu
    Copy the full SHA
    595bd10 View commit details
    Browse the repository at this point in the history

  3. fix

    @freewym
    freewym committed May 9, 2017
    Configuration menu
    Copy the full SHA
    265b9fa View commit details
    Browse the repository at this point in the history

  4. fix Makefile

    @freewym
    freewym committed May 9, 2017
    Configuration menu
    Copy the full SHA
    799111f View commit details
    Browse the repository at this point in the history

  5. bug fix

    @freewym
    freewym committed May 9, 2017
    Configuration menu
    Copy the full SHA
    7de184e View commit details
    Browse the repository at this point in the history

  6. bug fix related to zero-size of an internal matrix

    @freewym
    freewym committed May 9, 2017
    Configuration menu
    Copy the full SHA
    c1d5f0c View commit details
    Browse the repository at this point in the history

Commits on May 10, 2017

  1. more efficient implementation

    @freewym
    freewym committed May 10, 2017
    Configuration menu
    Copy the full SHA
    9f88f56 View commit details
    Browse the repository at this point in the history

  2. add assert

    @freewym
    freewym committed May 10, 2017
    Configuration menu
    Copy the full SHA
    e1925eb View commit details
    Browse the repository at this point in the history

  3. Merge pull request #11 from freewym/wangs-update 

    nnet3 rnnlm lattice rescoring
    @hainan-xv
    hainan-xv committed May 10, 2017
    Configuration menu
    Copy the full SHA
    ffc8a11 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2017

  1. change the nneteg to store samples as an IO

    @hainan-xv
    hainan-xv committed May 11, 2017
    Configuration menu
    Copy the full SHA
    fad5050 View commit details
    Browse the repository at this point in the history

  2. merge with kaldi_52

    @hainan-xv
    hainan-xv committed May 11, 2017
    Configuration menu
    Copy the full SHA
    d95a352 View commit details
    Browse the repository at this point in the history

  3. merge with kaldi_52

    @hainan-xv
    hainan-xv committed May 11, 2017
    Configuration menu
    Copy the full SHA
    d6b1e4c View commit details
    Browse the repository at this point in the history

  4. fixed the scripts; working now

    @hainan-xv
    hainan-xv committed May 11, 2017
    Configuration menu
    Copy the full SHA
    ba5b446 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2017

  1. script tested

    @hainan-xv
    hainan-xv committed May 12, 2017
    Configuration menu
    Copy the full SHA
    7e179be View commit details
    Browse the repository at this point in the history

  2. lattice-rescoring support seperate wordlists for input and output

    @hainan-xv
    hainan-xv committed May 12, 2017
    Configuration menu
    Copy the full SHA
    fb4eb99 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2017

  1. should work now

    @hainan-xv
    hainan-xv committed May 17, 2017
    Configuration menu
    Copy the full SHA
    c41bbc9 View commit details
    Browse the repository at this point in the history

  2. ready

    @hainan-xv
    hainan-xv committed May 17, 2017
    Configuration menu
    Copy the full SHA
    388fcf5 View commit details
    Browse the repository at this point in the history