Skip to content


Switch branches/tags

Latest commit


Git stats


Failed to load latest commit information.
Latest commit message
Commit time

ML and NLP Paper Discussions

One of our community-driven efforts it to discuss interesting ML or NLP papers and foster an inclusive, safe, and open platform that allows it. This repository contains notes and discussions for our weekly NLP paper discussions. You will find notes, questions, and other findings and topics the community found interesting.

Interested to join these discussions in the future? Check out our future events here and join the discussion in our Slack group.

July 4, 2020

Paper: A Simple Framework for Contrastive Learning of Visual Representations

Authors: Ting Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey Hinton

Notes: Link

June 20, 2020

Paper: VirTex: Learning Visual Representations from Textual Annotations

Authors: Karan Desai, Justin Johnson

Notes: Link

June 13, 2020

Paper: When BERT Plays the Lottery, All Tickets Are Winning

Authors: Sai Prasanna, Anna Rogers, Anna Rumshisky

Notes: Link

June 06, 2020

Paper: Language Models are Few-Shot Learners

Authors: Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, Dario Amodei

Notes: Link

May 30, 2020

Paper: Experience Grounds Language

Authors: Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph Turian

Notes: Link

May 23, 2020

Paper: On the relationship between self-attention and convolutional layers

Authors: Jean-Baptiste Cordonnier, Andreas Loukas & Martin Jaggi

Notes: Link

May 16, 2020

Paper: TLDR: Extreme Summarization of Scientific Documents

Authors: Isabel Cachola, Kyle Lo, Arman Cohan, Daniel S. Weld

Notes: Link

May 2, 2020

Paper: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Authors: Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu

Notes: Link


πŸ“„ A repo containing notes and discussions for our weekly NLP/ML paper discussions.







No releases published


No packages published