This repository contains materials on presentations and workshops on Canadian researchers' recent contributions to Deep Learning and Artificial Intelligence.
Presentation to delegates from the South Korean Ministry of Education on October 16, 2017.
- Self Introduction
- Introduction to Deep Learning and Artificial Intelligence
- Definitions
- Historical Overview
- Canada's Contributions
- Deep Learning
- Theory
- Applications
- Q&A
A PDF version of the deck is included here.
A workshop at the Canada Now: 2017 iSchool Student Conference (https://canadanow2017.wordpress.com) on March 11, 2017
Workshop Title: Canada's Contributions to Deep Learning and Artificial Intelligence
Background: In the field of artificial intelligence, the term "deep learning" has gained massive popularity in recent years. Companies such as Google have used the technique to great effect in image recognition, voice recognition, and even in audio/music generation. To the extent that these technical capabilities will change the landscape for information professionals in technological, social, and cultural ways, it will be important to consider how Canada has helped advance this field. The recent advances in deep learning field would not have been possible without the significant contributions by computer scientists in Canada, such as Professor Geoffrey Hinton of the University of Toronto and Yoshua Bengio of the Université de Montréal. This workshop will present how Canadian researchers have pushed the state of the art in deep learning and artificial intelligence research.
Outline: This workshop will provide an overview of the history and development of the deep learning field, with an emphasis on how Canadian researchers’ contributions have shaped the field. Particular emphasis will be given to highlight the work of Professor Hinton of the University of Toronto and other Canadian contributors. Next, the workshop will feature a demonstration of deep learning techniques using the TensorFlow Python library open sourced by Google. As an introduction to the technology, the demonstration will show how deep learning techniques can decipher handwritten numbers. Depending on time constraints, a further demonstration will show how current APIs perform in such tasks as image recognition, speech recognition, and translation.
An outline of the headings and sub-headings for the workshop.
- Introduction to Deep Learning and Artificial Intelligence
- Historical Overview
- Canada's Contributions
- Deep Learning
- Theory - In Brief
- Applications
- Demonstration: TensorFlow
- Installation
- MNIST Tutorial
- Embeddings and Visualization Tutorial
- Q&A
A PDF version of the workshop deck is included here.
This is a small selection of the research and resources out there. References listed in APA style.
- Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., ... & Kudlur, M. (2016, November). TensorFlow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI). Savannah, Georgia, USA.
- Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., ... & Ghemawat, S. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467.
- Bergen, M., Wagner, K. (2015, July 15). Welcome to the AI Conspiracy: The 'Canadian Mafia' Behind Tech's Latest Craze. Recode. Retrieved from http://www.recode.net/2015/7/15/11614684/ai-conspiracy-the-scientists-behind-deep-learning
- Britz, D. (2016). Deep Learning Glossary. Retrieved from http://www.wildml.com/deep-learning-glossary/
- Brownless J. (2016, July 14). 8 Inspirational Applications of Deep Learning. Machine Learning Mastery. Retrieved from http://machinelearningmastery.com/inspirational-applications-deep-learning/
- Deshpande, A. (2016, August 24). The 9 Deep Learning Papers You Need To Know About (Understanding CNNs Part 3). Retrieved from https://adeshpande3.github.io/adeshpande3.github.io/The-9-Deep-Learning-Papers-You-Need-To-Know-About.html
- Golge, E. (n.d.). Brief History of Machine Learning. Retrieved from http://www.erogol.com/brief-history-machine-learning/
- Hinton, G (Speaker). (2015, May 5). The Current [Audio podcast]. Retrieved from http://www.cbc.ca/radio/thecurrent/the-current-for-may-5-2015-1.3061292
- Jacobs, J., Poutanen, T., Zemel, R., Hinton, G. & Clark, E. (2017, January 7). Artificial intelligence is the future, and Canada can seize it. The Globe and Mail. Retrieved from http://www.theglobeandmail.com/report-on-business/rob-commentary/artificial-intelligence-is-the-future-and-canada-must-seize-it/article33532668/
- Kurenkov, A. (2015, December 24). A 'Brief' History of Neural Nets and Deep Learning, Part 1. Retrieved from http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-and-deep-learning/
- Kurenkov, A. (2015, December 24). A 'Brief' History of Neural Nets and Deep Learning, Part 2. Retrieved from http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-and-deep-learning-part-2/
- Kurenkov, A. (2015, December 24). A 'Brief' History of Neural Nets and Deep Learning, Part 3. Retrieved from http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-and-deep-learning-part-3/
- Kurenkov, A. (2015, December 24). A 'Brief' History of Neural Nets and Deep Learning, Part 4. Retrieved from http://www.andreykurenkov.com/writing/a-brief-history-of-neural-nets-and-deep-learning-part-4/
- Kurenkov, A. (2016, April 18). A 'Brief' History of Game AI Up To AlphaGo, Part 1. Retrieved from http://www.andreykurenkov.com/writing/a-brief-history-of-game-ai/
- LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436-444.
- Lee, A. (2017, January 18). Can RBC help stop Canada’s brain drain in deep learning?. Macleans. Retrieved from http://www.macleans.ca/society/technology/can-rbc-help-stop-canadas-brain-drain-in-deep-learning/
- Lewis-Kraus, G. (2016, December 14). The Great A.I. Awakening. The New York Times. Retrieved from https://www.nytimes.com/2016/12/14/magazine/the-great-ai-awakening.html
- Marr, B. (2016, December 8). What Is The Difference Between Deep Learning, Machine Learning and AI?. Forbes. Retrieved from https://www.forbes.com/sites/bernardmarr/2016/12/08/what-is-the-difference-between-deep-learning-machine-learning-and-ai
- Nielsen, M. (2017). Neural Networks and Deep Learning. Retrieved from http://neuralnetworksanddeeplearning.com/index.html
- Parloff, R. (2016). Why Deep Learning is Suddenly Changing Your Life. Fortune. Retrieved from http://fortune.com/ai-artificial-intelligence-deep-machine-learning/
- Press, G. (2016, December 30). A Very Short History Of Artificial Intelligence (AI). Forbes. Retrieved from https://www.forbes.com/sites/gilpress/2016/12/30/a-very-short-history-of-artificial-intelligence-ai
- Rohrer, B. (2016, May 22). Deep Learning Demystified. Retrieved from http://brohrer.github.io/deep_learning_demystified.html
- Schmidhuber, J. (2015). Deep learning in neural networks: An overview. Neural networks, 61, 85-117. Retrieved from https://arxiv.org/abs/1404.7828
- Turovsky, B. (2016, November 15). Found in translation: More accurate, fluent sentences in Google Translate. Google Blog. Retrieved from https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/
- Van Veen, F. (2016, September 14). The Neural Network Zoo. Retrieved from http://www.asimovinstitute.org/neural-network-zoo/
- Wang, H., Raj, B., & Xing, E. P. (2017). On the Origin of Deep Learning. arXiv preprint arXiv:1702.07800. Retrieved from https://arxiv.org/abs/1702.07800
- Yuan, A. (n.d.). Deep Learning. Retrieved from http://andrewyuan.github.io/