-
Notifications
You must be signed in to change notification settings - Fork 223
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
deprecation of genericLSTM #17
Comments
I've run a lot of benchmarks that have shown that (1) peephole optimizations don't help (and usually hurt), and (2) any other choice of non-linearity other than the default one performs considerably worse. I'll publish that as an Arxiv tech report soon. |
Is the arxiv link of your tech report available now? |
I got publication clearance, but it's not quite out yet. I'll try to push it in the next few days. |
Thank you! Have you ever try to push a GPU version of LSTM since the community seems to have more interests in the RNN field? |
I'm planning on GPU support via Eigen; however, that will still be a few months before the necessary dependencies are out. |
@BestSonny, here it is: Benchmarking of LSTM Networks |
Thank you! |
Thanks. Looks like Eigen and mshadow have similar goals. Is there any performance data comparing the two? |
@tmbdev , mshadow has very detailed tutorials and other documentations including multi-GPU support while Eigen documents almost nothing related to GPU on its official website. More importantly, mshadow exploits the powerful NVIDIA cuDNN library. It's impossible for Eigen to catch up mshadow in performance on GPUs. |
I have seen that in the last version genericLSTM has been "softly" deprecated. Could you please explain me the reason why this choice has been made?
The text was updated successfully, but these errors were encountered: