Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Self improvement Challenge #3912

Closed
1 task done
waynehamadi opened this issue May 6, 2023 · 4 comments
Closed
1 task done

Self improvement Challenge #3912

waynehamadi opened this issue May 6, 2023 · 4 comments

Comments

@waynehamadi
Copy link
Contributor

waynehamadi commented May 6, 2023

Duplicates

  • I have searched the existing issues

Summary 馃挕

The goal of this challenge is to test Auto-GPT's abilities to beat unbeaten challenges. We're first going to start with fake challenges though.

Hopefully, increasing the level of difficulty of the challenge solver challenge will give us the self-reinforcing feedback loop that will get us closer to AGI.

The "Challenge creator" challenge will help us do that too, hopefully.

I will start by creating a fake challenge. The challenge will be for Auto-GPT to write a file, but I will introduce a typo in the main.py.

Step 1: run the "challenge solver" challenge
Step 2: introduce a mistake in the codebase. Since the challenge solver challenge has already started, the agent it uses will not be impacted by the mistake in the codebase.
Step 3:

  • run the pytest test for the fake challenge (run pytest in a separate subprocess)
  • understand why the challenge is not beaten
  • modify the codebase
  • run pytest in a separate subprocess.
  • etc, etc...

Hopefully we will be able to use the logs/DEBUG folder to help our "challenge solver" agent understand the behavior of the agent ran in the fake challenge.

@waynehamadi
Copy link
Contributor Author

the write_file method cannot write outside of the autogpt_workspace so we have to find a trick here.

@waynehamadi waynehamadi changed the title "Challenge Solver" Challenge Self improvement Challenge May 7, 2023
@waynehamadi
Copy link
Contributor Author

@gravelBridge you wanna try this one after the debugging challenge ?

@github-actions
Copy link
Contributor

github-actions bot commented Sep 6, 2023

This issue has automatically been marked as stale because it has not had any activity in the last 50 days. You can unstale it by commenting or removing the label. Otherwise, this issue will be closed in 10 days.

@github-actions github-actions bot added the Stale label Sep 6, 2023
@github-actions
Copy link
Contributor

This issue was closed automatically because it has been stale for 10 days with no activity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Sep 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants