走向AI,Good good study,day day up!
http://bit.baidu.com/course/detail/id/137.html
MATRIX CAPSULES WITH EM ROUTING(使用 EM 路由的矩阵 capsule)
https://openreview.net/pdf?id=HJWLfGWRb
https://www.toutiao.com/i6482558545681187341/
https://github.com/lcatro/Machine-Learning-Note
https://github.com/MorvanZhou/tutorials
https://github.com/zlotus/notes-LSJU-machine-learning
python
https://pylint.readthedocs.io/en/latest/
https://mooc.study.163.com/smartSpec/detail/1001319001.htm/?edusave=1&from=study
https://www.toutiao.com/i6448800156446900750/?group_id=6448796272673669390&group_flags=0
https://github.com/cysmith/neural-style-tf
百度DeepSpeech
文字分类 https://github.com/dennybritz/cnn-text-classification-tf
图片分类 https://github.com/akshaypai/tfClassifier
一文了解各种卷积结构原理及优劣
https://www.toutiao.com/i6448048500524450317/?group_id=6448043969683128589&group_flags=0
https://medium.com/towards-data-science/types-of-convolutions-in-deep-learning-717013397f4d
更多卷积动画:
https://github.com/vdumoulin/conv_arithmetic
TheOrangeDuck Daniel Holden
我搭的神经网络不work该怎么办!看看这11条新手最容易犯的错误
https://www.toutiao.com/i6464389875142492685/?group_id=6464389875142492685&group_flags=0
一文看懂如何搭建AI应用:10周学会深度学习,还赢下5千美元
https://www.toutiao.com/i6383461061009342977/?group_id=6383458254790705410&group_flags=0
浅析Hinton最近提出的Capsule计划
https://zhuanlan.zhihu.com/p/29435406
sigmoid会饱和,造成梯度消失。于是有了ReLU。 ReLU负半轴是死区,造成梯度变0。于是有了LeakyReLU,PReLU。 强调梯度和权值分布的稳定性,由此有了ELU,以及较新的SELU。 太深了,梯度传不下去,于是有了highway。 干脆连highway的参数都不要,直接变残差,于是有了ResNet。 强行稳定参数的均值和方差,于是有了BatchNorm。 在梯度流中增加噪声,于是有了 Dropout。 RNN梯度不稳定,于是加几个通路和门控,于是有了LSTM。 LSTM简化一下,有了GRU。 GAN的JS散度有问题,会导致梯度消失或无效,于是有了WGAN。 WGAN对梯度的clip有问题,于是有了WGAN-GP。
Dynamic Routing Between Capsules
https://arxiv.org/abs/1710.09829
部分翻:https://www.toutiao.com/i6481644640318521870/
-
卷积神经网络了解博客。//blog.csdn.net/zouxy09/article/details/8781543
-
卷积神经网络的推导博客。//blog.csdn.net/zouxy09/article/details/9993371/
【专栏】谷歌资深工程师深入浅析AlphaGo Zero与深度强化学习
http://m.hexun.com/hz/toutiao/2017-10-27/191404853.html?tt_group_id=6481477106782372110
人脸
https://www.toutiao.com/i6481423589345067534/
https://github.com/seetaface/SeetaFaceEngine
5行python运行神经元网络,动画给你演示,机器学习必备! 一个很简单的代码例子
https://www.toutiao.com/i6481039679838749198/
Deep neural networks for voice conversion (voice style transfer) in Tensorflow
https://github.com/andabi/deep-voice-conversion
Bottery is a syntax, editor, and simulator for prototyping generative contextual conversations modeled as finite state machines.
https://github.com/google/bottery
吴恩达
ReLU function rectified linear unit 修正线性单元 SNN standard NN neural network CNN convolutional .. Recurrent NN
正向传播步骤 反向传播步骤
logistic regression 回归 Gradient Descent 梯度下降
cifar10 http://www.voidcn.com/article/p-vdkdnmft-w.html
推荐评估模型 https://github.com/cnkuangshi/LightCTR
python:
https://github.com/norvig/pytudes https://github.com/rochacbruno/py2rs
StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation https://github.com/yunjey/StarGAN