Pinned Loading

1. xlang-ai/OSWorld xlang-ai/OSWorld Public

   [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

   Python 1.3k 150

2. TableQAKit TableQAKit Public

   A Toolkit for Table-based Question Answering

   Python 105 7

3. S3Eval S3Eval Public

   A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models

   Python 32 1

4. S3HQA S3HQA Public

   Code for ACL 2023 paper S3HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering

   Python 18 1

5. xlang-ai/Spider2-V xlang-ai/Spider2-V Public

   [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

   Jupyter Notebook 106 7

6. xlang-ai/Spider2 xlang-ai/Spider2 Public

   Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

   HTML 116 10