Skip to content

Recent Papers including Neural Symbolic Reasoning, Logical Reasoning, Visual Reasoning, planning and any other topics connecting deep learning and reasoning

License

Notifications You must be signed in to change notification settings

floodsung/Deep-Reasoning-Papers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Deep-Reasoning-Papers

Recent Papers including Neural Symbolic Reasoning, Logical Reasoning, Visual Reasoning, natural language reasoning and any other topics connecting deep learning and reasoning.

0 Survey or Talk

[1] Yoshua Bengio,From System 1 Deep Learning to System 2 Deep Learning [pdf] [video]

[2] Yann Lecun, Self-Supervised Learning [pdf]

[3] Petar Veličković Graph Representation Learning for Algorithmic Reasoning [pdf]

1 Mathematical Problems

[1] Saxton, David, et al. Analysing mathematical reasoning abilities of neural models. arXiv preprint arXiv:1904.01557 (2019).[pdf]

[2] Ortega, Pedro A., et al. Meta-learning of sequential strategies. arXiv preprint arXiv:1905.03030 (2019).[pdf]

[3] Lample, Guillaume, and François Charton. Deep learning for symbolic mathematics. arXiv preprint arXiv:1912.01412 (2019).[pdf]

[4] Zhuo, Tao, and Mohan Kankanhalli. Solving Raven's Progressive Matrices with Neural Networks. arXiv preprint arXiv:2002.01646 (2020).[pdf]

[5] Zheng, Kecheng, Zheng-Jun Zha, and Wei Wei. Abstract Reasoning with Distracting Features. Advances in Neural Information Processing Systems. 2019. [pdf]

[6] van Steenkiste, Sjoerd, et al. Are Disentangled Representations Helpful for Abstract Visual Reasoning?. Advances in Neural Information Processing Systems. 2019. [pdf]

[7] Dong, Honghua, et al. Neural logic machines. arXiv preprint arXiv:1904.11694 (2019). [pdf]

[8] Zhang, Chi, et al. Learning perceptual inference by contrasting. Advances in Neural Information Processing Systems. 2019.[pdf]

[9] Santoro, Adam, et al. Measuring abstract reasoning in neural networks. International Conference on Machine Learning. 2018.[pdf]

[10] Wang, Po-Wei, et al. SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver. arXiv preprint arXiv:1905.12149 (2019).

[11] Manhaeve, Robin, et al. Deepproblog: Neural probabilistic logic programming. Advances in Neural Information Processing Systems. 2018.[pdf]

[13] van Steenkiste, Sjoerd, et al. Are Disentangled Representations Helpful for Abstract Visual Reasoning?. Advances in Neural Information Processing Systems. 2019. [pdf]

[14] Dai, Wang-Zhou, et al. Bridging machine learning and logical reasoning by abductive learning. Advances in Neural Information Processing Systems. 2019. [pdf] [code]

2 Raven's Progressive Matrices

[1] Santoro, Adam, et al. Measuring abstract reasoning in neural networks. International Conference on Machine Learning. 2018.[pdf]

[2] Zhang, Chi, et al. Raven: A dataset for relational and analogical visual reasoning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019.[pdf]

[3] Zheng, Kecheng, Zheng-Jun Zha, and Wei Wei. Abstract Reasoning with Distracting Features. Advances in Neural Information Processing Systems. 2019.[pdf]

[4] Hill, Felix, et al. "Learning to make analogies by contrasting abstract relational structure." arXiv preprint arXiv:1902.00120 (2019).[pdf]

[5] Hu, Sheng, et al. Hierarchical Rule Induction Network for Abstract Visual Reasoning. arXiv preprint arXiv:2002.06838 (2020). [pdf]

[6] Zhang, Chi, et al. Learning perceptual inference by contrasting." Advances in Neural Information Processing Systems. 2019. [pdf]

[7] van Steenkiste, Sjoerd, et al. Are Disentangled Representations Helpful for Abstract Visual Reasoning?. Advances in Neural Information Processing Systems. 2019.[pdf]

[8] Zhuo, Tao, and Mohan Kankanhalli. Solving Raven's Progressive Matrices with Neural Networks. arXiv preprint arXiv:2002.01646 (2020). [pdf]

[9] Wang, Duo, Mateja Jamnik, and Pietro Lio. Abstract diagrammatic reasoning with multiplex graph networks. (2020). [pdf]

[10] Steenbrugge, Xander, et al. Improving generalization for abstract reasoning tasks using disentangled feature representations. arXiv preprint arXiv:1811.04784 (2018). [pdf]

3 Visual Reasoning

[1] Han, Chi, et al. Visual Concept-Metaconcept Learning. Advances in Neural Information Processing Systems. 2019. [pdf]

[2] Mao, Jiayuan, et al. Program-Guided Image Manipulators. Proceedings of the IEEE International Conference on Computer Vision. 2019.[pdf]

[3] Mao, Jiayuan, et al. The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision. arXiv preprint arXiv:1904.12584 (2019). [pdf]

[4] Tian, Yonglong, et al. Learning to infer and execute 3d shape programs. arXiv preprint arXiv:1901.02875 (2019). [pdf]

[5] Liu, Yunchao, et al. Learning to describe scenes with programs. (2018). [pdf]

[6] Yi, Kexin, et al. Neural-symbolic vqa: Disentangling reasoning from vision and language understanding. Advances in Neural Information Processing Systems. 2018. [pdf]

4 Physical Reasoning/Planning/Model based/World Model

[1] Jaques, Miguel, Michael Burke, and Timothy Hospedales. Physics-as-inverse-graphics: Joint unsupervised learning of objects and physics from video. arXiv preprint arXiv:1905.11169 (2019). [pdf]

[2] Bakhtin, Anton, et al. Phyre: A new benchmark for physical reasoning. Advances in Neural Information Processing Systems. 2019. [pdf]

[3] Ye Y, Gandhi D, Gupta A, et al. Object-centric Forward Modeling for Model Predictive Control[J]. arXiv preprint arXiv:1910.03568, 2019. [pdf]

[4] Veerapaneni R, Co-Reyes J D, Chang M, et al. Entity Abstraction in Visual Model-Based Reinforcement Learning[J]. arXiv preprint arXiv:1910.12827, 2019.[pdf]

[5] Janner M, Levine S, Freeman W T, et al. Reasoning about physical interactions with object-oriented prediction and planning[J]. arXiv preprint arXiv:1812.10972, 2018.[pdf]

[6] Kossen J, Stelzner K, Hussing M, et al. Structured Object-Aware Physics Prediction for Video Modeling and Planning[J]. arXiv preprint arXiv:1910.02425, 2019. [pdf]

[7] Watters N, Matthey L, Bosnjak M, et al. Cobra: Data-efficient model-based rl through unsupervised object discovery and curiosity-driven exploration[J]. arXiv preprint arXiv:1905.09275, 2019.[pdf]

[8] Li Y, He H, Wu J, et al. Learning Compositional Koopman Operators for Model-Based Control[J]. arXiv preprint arXiv:1910.08264, 2019.[pdf]

[9] Kulkarni T D, Gupta A, Ionescu C, et al. Unsupervised learning of object keypoints for perception and control[C]//Advances in Neural Information Processing Systems. 2019: 10723-10733. [pdf]

[10] Kipf T, van der Pol E, Welling M. Contrastive Learning of Structured World Models[J]. arXiv preprint arXiv:1911.12247, 2019. [pdf]

[11] Chang M B, Ullman T, Torralba A, et al. A compositional object-based approach to learning physical dynamics[J]. arXiv preprint arXiv:1612.00341, 2016. [pdf]

[12] Sanchez-Gonzalez A, Godwin J, Pfaff T, et al. Learning to Simulate Complex Physics with Graph Networks[J]. arXiv preprint arXiv:2002.09405, 2020.[pdf]

[13] Battaglia P, Pascanu R, Lai M, et al. Interaction networks for learning about objects, relations and physics[C]//Advances in neural information processing systems. 2016: 4502-4510. [pdf]

[14] Watters N, Zoran D, Weber T, et al. Visual interaction networks: Learning a physics simulator from video[C]//Advances in neural information processing systems. 2017: 4539-4547. [pdf]

[15] Cranmer M, Greydanus S, Hoyer S, et al. Lagrangian Neural Networks[J]. arXiv preprint arXiv:2003.04630, 2020. [pdf]

[16] Sanchez-Gonzalez A, Heess N, Springenberg J T, et al. Graph networks as learnable physics engines for inference and control[J]. arXiv preprint arXiv:1806.01242, 2018. [pdf]

[17] Li Y, Wu J, Tedrake R, et al. Learning particle dynamics for manipulating rigid bodies, deformable objects, and fluids[J]. arXiv preprint arXiv:1810.01566, 2018.[pdf]

5 Natural Language Reasoning

[1] Schlag, Imanol, and Jürgen Schmidhuber. Learning to reason with third order tensor products. Advances in neural information processing systems. 2018.[pdf]

6 Modularity/Compositional or Systematic Generalization

[1] Jacobs R A, Jordan M I, Nowlan S J, et al. Adaptive mixtures of local experts[J]. Neural computation, 1991, 3(1): 79-87. [pdf]

[2] Ramezani M, Marble K, Trang H, et al. Joint sparse representation of brain activity patterns in multi-task fMRI data[J]. IEEE Transactions on Medical Imaging, 2014, 34(1): 2-12.

[3] Sternberg S. Modular processes in mind and brain[J]. Cognitive neuropsychology, 2011, 28(3-4): 156-208.

[4] Ronco E, Gollee H, Gawthrop P J. Modular neural network and self-decomposition[J]. Connection Science (special issue: COMBINING NEURAL NETS).(To appear), 1996. [pdf]

[5] Andreas J, Rohrbach M, Darrell T, et al. Neural module networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016: 39-48. [pdf]

[6] Parascandolo G, Kilbertus N, Rojas-Carulla M, et al. Learning independent causal mechanisms[J]. arXiv preprint arXiv:1712.00961, 2017. [pdf]

[7] Rosenbaum C, Klinger T, Riemer M. Routing networks: Adaptive selection of non-linear functions for multi-task learning[J]. arXiv preprint arXiv:1711.01239, 2017. [pdf]

[8] Fernando C, Banarse D, Blundell C, et al. Pathnet: Evolution channels gradient descent in super neural networks[J]. arXiv preprint arXiv:1701.08734, 2017. [pdf]

[9] Shazeer N, Mirhoseini A, Maziarz K, et al. Outrageously large neural networks: The sparsely-gated mixture-of-experts layer[J]. arXiv preprint arXiv:1701.06538, 2017. [pdf]

[10] Kirsch L, Kunze J, Barber D. Modular networks: Learning to decompose neural computation[C]//Advances in Neural Information Processing Systems. 2018: 2408-2418. [pdf]

[11] Rosenbaum C, Cases I, Riemer M, et al. Routing networks and the challenges of modular and compositional computation[J]. arXiv preprint arXiv:1904.12774, 2019. [pdf]

[12] Goyal A, Lamb A, Hoffmann J, et al. Recurrent independent mechanisms[J]. arXiv preprint arXiv:1909.10893, 2019. [pdf]

[13] Goyal A, Sodhani S, Binas J, et al. Reinforcement Learning with Competitive Ensembles of Information-Constrained Primitives[J]. arXiv preprint arXiv:1906.10667, 2019. [pdf]

[14] Yang R, Xu H, Wu Y, et al. Multi-Task Reinforcement Learning with Soft Modularization[J]. arXiv preprint arXiv:2003.13661, 2020. [pdf]

[15] Peng X B, Chang M, Zhang G, et al. Mcp: Learning composable hierarchical control with multiplicative compositional policies[C]//Advances in Neural Information Processing Systems. 2019: 3681-3692. [pdf]

[16] Hu, Ronghang, et al. Learning to reason: End-to-end module networks for visual question answering. Proceedings of the IEEE International Conference on Computer Vision. 2017. [pdf]

[17] Devin, Coline, et al. Learning modular neural network policies for multi-task and multi-robot transfer. 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2017. [pdf]

[18] Alet, Ferran, Tomás Lozano-Pérez, and Leslie P. Kaelbling. Modular meta-learning. arXiv preprint arXiv:1806.10166 (2018). [pdf]

[19] Chitnis, Rohan, Leslie Pack Kaelbling, and Tomás Lozano-Pérez. Learning quickly to plan quickly using modular meta-learning. 2019 International Conference on Robotics and Automation (ICRA). IEEE, 2019.[pdf]

[20] Alet, Ferran, et al. Modular meta-learning in abstract graph networks for combinatorial generalization. arXiv preprint arXiv:1812.07768 (2018).[pdf]

[21] Chen, Yutian, et al. Modular meta-learning with shrinkage arXiv preprint arXiv:1909.05557 (2019). [pdf]

[22] Alet, Ferran, et al. Neural Relational Inference with Fast Modular Meta-learning. Advances in Neural Information Processing Systems. 2019. [pdf]

[23] Andreas, Jacob, Dan Klein, and Sergey Levine. Modular multitask reinforcement learning with policy sketches. Proceedings of the 34th International Conference on Machine Learning-Volume 70. JMLR. org, 2017. [pdf]

[24] Bahdanau D, Murty S, Noukhovitch M, et al. Systematic generalization: what is required and can it be learned?[J]. arXiv preprint arXiv:1811.12889, 2018. [pdf]

[25] Chang M B, Gupta A, Levine S, et al. Automatically composing representation transformations as a means for generalization[J]. arXiv preprint arXiv:1807.04640, 2018.[pdf]

[26] Meunier D, Lambiotte R, Bullmore E T. Modular and hierarchically modular organization of brain networks[J]. Frontiers in neuroscience, 2010, 4: 200.

[27] Sporns O, Betzel R F. Modular brain networks[J]. Annual review of psychology, 2016, 67: 613-640.

[28] Clune J, Mouret J B, Lipson H. The evolutionary origins of modularity[J]. Proceedings of the Royal Society b: Biological sciences, 2013, 280(1755): 20122863.[pdf]

Datasets

[1] Johnson, Justin, et al. Clevr: A diagnostic dataset for compositional language and elementary visual reasoning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017. [pdf]

[2] Zellers, Rowan, et al. From recognition to cognition: Visual commonsense reasoning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019.[pdf]

[3] Zhang, Wenhe, et al. Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning. Pythagoras 100.300 (1818).[pdf]

[4] Santoro, Adam, et al. Measuring abstract reasoning in neural networks. International Conference on Machine Learning. 2018.[pdf]

[5] Zhang, Chi, et al. Raven: A dataset for relational and analogical visual reasoning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019.[pdf]

[6] Bakhtin, Anton, et al. Phyre: A new benchmark for physical reasoning. Advances in Neural Information Processing Systems. 2019. [pdf]

[7] Baradel, Fabien, et al. COPHY: Counterfactual Learning of Physical Dynamics. arXiv preprint arXiv:1909.12000 (2019). [pdf]

About

Recent Papers including Neural Symbolic Reasoning, Logical Reasoning, Visual Reasoning, planning and any other topics connecting deep learning and reasoning

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published