Deep Learning Study Group

目的:

使用Pytorch, Tensorflow進行Deep Learning的實務學習

方法:

實務cases實作, 每週實體聚會討論交流, 隨時線上討論.

時程:

• Pytorch 入門: Tensor 操作, torch optim...等 2019/4/14
  • PyTorch的backward()相关理解(舊版pytorch，參考)
  • PyTorch基礎篇-張量、模型自動更新、優化器(舊版PyTorch，參考)
  • 2019-0420 Slide: PyTorch - Get Started@忠孝伯朗咖啡
• Pytorch 101: Cases實作:
  • 世界人口預測 (Linear Regression) 2019/5/5
  • Stock Price (Logistic Regression) 2019/5/5
  • MNIST (Logistic Regression) 2019/5/5
  • 2019-0505 Slide: PyTorch 101@小樹屋-民權西路
• Pytorch 102: Cases實作:
  • NLP: RNN (LSTM) 寫古詩 2019/5/25
  • 2019-0525 Slide: PyTorch 102@小樹屋-民權西路
• Pytorch 103: Cases實作:
  • Time Series: RNN GDP 預測 2019/6/22
  • Reading: Seq2seq pay Attention to Self Attention: Part 1(中文版) 2019/6/22
  • Reading: Seq2seq pay Attention to Self Attention: Part 2(中文版) 2019/6/22
• Paper Study:
  • Perceive Your Users in Depth: Learning Universal User Representations from Multiple E-commerce Tasks 2019/6/22
• Tensorflow Cases實作:
  • Common knowledge 2019/6/15
  • Case: 玩轉IRIS資料集, 零基礎範例 2019/6/15
  • Case: Titanic survivor (Logistic Regression) 2019/6/15
  • Case: Credit Card Analysis (Logistic Regression to DNN) 2019/6/15
  • Case: MNIST (RNN) 2019/6/29
  • Case: Fashion MNIST (DNN, GRU, Dataset API) 2019/6/29
  • Case: Fashion MNIST (Tensorflow 2.0 API) 2019/6/29
• Milestones目標 (關鍵成果):
  • PyTorch: Seq2Seq 實作數學加法運算 (with or without Attention) 2019/6/8
  • PyTorch: Attention is all you need (Transformer) 2019/6/22
  • Tensorflow: Attention is all you need (Transformer) 2019/7/13
  • Neural Ordinary Differential Equations 2019/?/?
    • Ref: Neural ODE & DiffEqFlux - 杜岳華 (without QA)
  • 大型資料黑客松競賽 2019/11/1
    • Search for global hackathon: https://www.hackathon.com/
      • possible event1: https://www.hackathon.com/event/take-europe-to-the-hearts-hackathon-39909500390
      • possible event2: https://www.eventbrite.com/e/zero-waste-retail-hackathon-tickets-58778354641
      • possible event3: https://techandrelationships.org/

Reference Material

• Tensorflow 中文教學
• Pytorch LSTM, GRU
• Seq2Seq with Attention 的 PyTorch 範例
• Transformer 入門中文文章
• NLP 新手必看！这是一份覆盖全面的基于 PyTorch 和 keras 的 NLP 学习教程
• Deeplearning-models 大全: 含大量 Tensorflow, PyTorch 範例