Rigourous evaluation of LLM-synthesized code - NeurIPS 2023

A Dataset of Python Challenges for AI Research

A relation-aware semantic parsing model from English to SQL

Code for Parsel 🐍 - generate complex programs with language models

APPS: Automated Programming Progress Standard (NeurIPS 2021)

Neural Symbolic Machines is a framework to integrate neural networks and symbolic representations using reinforcement learning, with applications in program synthesis and semantic parsing.

The collection synthesizer

A Python framework for program synthesis with a focus on Automated Machine Learning.

An inductive logic programming system

Code and Data artifact for NeurIPS 2023 paper - "Monitor-Guided Decoding of Code LMs with Static Analysis of Repository Context". `multispy` is a lsp client library in Python intended to be used to build applications around language servers.

🌌️Fuzz4All: Universal Fuzzing with Large Language Models

BigCodeBench: The Next Generation of HumanEval

Repilot, a patch generation tool introduced in the ESEC/FSE'23 paper "Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair"

Deepcoder paper implementation

Re-implement DeepCoder (https://openreview.net/pdf?id=ByldLrqlx)

An official TensorFlow implementation of "Neural Program Synthesis from Diverse Demonstration Videos" (ICML 2018) by Shao-Hua Sun, Hyeonwoo Noh, Sriram Somasundaram, and Joseph J. Lim

PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. We provide scripts for downloading, processing, and loading the datasets. This is done by offering a unified API and data structures for all datasets.

Mechanistically interpretable neurosymbolic AI (Nature Comput Sci 2024): losslessly compressing NNs to computer code and discovering new algorithms which generalize out-of-distribution and outperform human-designed algorithms

EvoEval: Evolving Coding Benchmarks via LLM

Generative Art Synthesizer - a python program that generates python programs that generates generative art