1- # Quickstart
1+ ## Local Mode
22
3- ## Install
43
54First be sure that you have docker tools installed.
65
@@ -10,11 +9,6 @@ apt install docker
109
1110To install the benchmark run,
1211
13- ``` bash
14- pip install commit0
15- ```
16-
17- ## Commands
1812
1913The system is a command-line tool that allows you to run unit-tests on a
2014variety of libraries in isolated environments. To get started with the full
@@ -73,67 +67,3 @@ a branch and the environment will sync and run.
7367``` bash
7468commit0 test minitorch branch=mychange tests/test_operators.py::test_relu
7569```
76-
77- ## Running an Agent
78-
79- Next we will see how this can be run with an AI agent system.
80- We will use [ Aider] ( https://aider.chat/ ) which is a nice
81- command-line oriented agent system.
82-
83- To setup Aider first set your api key.
84- We recommend using Claude Sonnet.
85-
86- ``` bash
87- # Work with Claude 3.5 Sonnet on your repo
88- export ANTHROPIC_API_KEY=your-key-goes-here
89- ```
90-
91- Once this is setup you can run Aider with the following command.
92- This will edit the files locally in your branch, but
93- run the tests inside the environment.
94-
95- ``` bash
96- aider --model sonnet --file repos/minitorch/operators.py --message " fill in" \
97- --auto-test --test \
98- --test-cmd ' commit0 test minitorch branch=mychange tests/test_operators.py::test_relu' \
99- --yes
100- ```
101-
102- This will run an LLM agent that will try to fill in the
103- functions in one file of the minitorch library.
104-
105- For a full example baseline system that tries to solve
106- all the tests in the library see the [ baseline] ( baseline ) documentation.
107-
108-
109- ## Distributed Tests
110-
111- One of the main advantages of ` commit0 ` is that it can run
112- a range of unit tests in distributed environments.
113-
114- By default, the library is configured to work with [ modal] ( https://modal.com/ ) .
115-
116- ``` bash
117- pip install modal
118- modal token new
119- ```
120-
121- To enable distributed run, first
122- create a file called ` distributed.yaml `
123-
124- ``` yaml
125- backend : modal
126- base_dir : repos.dist/
127- ` ` `
128-
129- You can pass this configuration file as an argumnet to clone.
130-
131- ` ` ` bash
132- commit0 clone lite --cfg=distributed.yaml
133- ```
134-
135- Next to run tests you can run the standard test command.
136-
137- ``` bash
138- commit0 test simpy master tests/test_event.py::test_succeed --cfg=distributed.yaml
139- ```
0 commit comments