LLM-RL-Papers

MARL in LLMs

• Large language model based multi-agents: A survey of progress and challenges. Paper by Guo, Taicheng, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V. Chawla, Olaf Wiest, and Xiangliang Zhang. 2024.
• Theory of mind for multi-agent collaboration via large language models Paper by Li, Huao, Yu Quan Chong, Simon Stepputtis, Joseph Campbell, Dana Hughes, Michael Lewis, and Katia Sycara. 2023.

Reward

• LLM-Reward: "Language to Rewards for Robotic Skill Synthesis", arXiv, Jun 2023. [Paper] [Website]

• ELLM: "Guiding Pretraining in Reinforcement Learning with Large Language Models", arXiv, Sep 2023. [Paper] [Website]

• LAMP: "Language Reward Modulation for Pretraining Reinforcement Learning", arXiv, Aug 2023. [Paper] [Website]

• Text2Reward: "Text2Reward: Automated Dense Reward Function Generation for Reinforcement Learning", arXiv, Sep 2023. [Paper] [Website]

• Reflexion: "Reflexion: Language Agents with Verbal Reinforcement Learning", arXiv, Sep 2023. [Paper] [Website]

Manipulation

• RoboCat: "RoboCat: A Self-Improving Foundation Agent for Robotic Manipulation", arxiv, Oct 2023. [Paper] [Website]

• WHEN2ASK: "Enabling Intelligent Interactions between an Agent and an LLM: A Reinforcement Learning Approach", arxiv, Aug 2023. [Paper] [Website]

• Plan4MC: "Plan4MC: Skill Reinforcement Learning and Planning for Open-World Minecraft Tasks", arxiv, Mar 2023. [Paper] [Website]

• LgTS: "LgTS: Dynamic Task Sampling using LLM-generated sub-goals for Reinforcement Learning Agents", arxiv, Oct 2023. [Paper]

• RLAdapter: "RLAdapter: Bridging Large Language Models to Reinforcement Learning in Open Worlds", arxiv, Sep 2023. [Paper]

• Motif: "Motif: Intrinsic Motivation from Artificial Intelligence Feedback", arxiv, Mar 2023. [Paper]

• LaGR-SEQ: "LaGR-SEQ: Language-Guided Reinforcement Learning with Sample-Efficient Querying", arxiv, Aug 2023. [Paper] [Website]

Instruction

• MILLION: "Meta-Reinforcement Learning via Language Instructions", arXiv, Sep 2022. [Paper] [Website]

• instructRL: "Language Instructed Reinforcement Learning for Human-AI Coordination", arXiv, Jun 2023. [Paper] [Website]

• Dialogue Shaping: "Dialogue Shaping: Empowering Agents through NPC Interaction", arXiv, Jun 2023. [Paper]

• "Towards A Unified Agent with Foundation Models", arXiv, Jun 2023. [Paper]

Policy

• GLAM: "Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning", arXiv, Sep 2023. [Paper] [Website]