Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor challenges to use cycle count instead of time #4222

Merged

Conversation

waynehamadi
Copy link
Contributor

@waynehamadi waynehamadi commented May 15, 2023

Background

Continuous agents need to be stopped after a certain time, but we don't know that time in advance.
Plus there could be some rate limit errors that make the agent take more time.
So instead of using time let's use the number of cycle.
Other code cleanup added.

Changes

use cycle count instead of time
enforce type hinting on challenges
create a test for challenges to be formatted properly (it's a test testing the tests)

Documentation

Test Plan

PR Quality Checklist

  • My pull request is atomic and focuses on a single change.
  • I have thoroughly tested my changes with multiple different prompts.
  • I have considered potential risks and mitigations for my changes.
  • I have documented my changes clearly and comprehensively.
  • I have not snuck in any "extra" small tweaks changes

@vercel
Copy link

vercel bot commented May 15, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
docs ⬜️ Ignored (Inspect) May 16, 2023 0:23am

@github-actions github-actions bot added the conflicts Automatically applied to PRs with merge conflicts label May 15, 2023
@github-actions
Copy link

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@waynehamadi waynehamadi marked this pull request as draft May 15, 2023 14:52
@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@github-actions github-actions bot removed the conflicts Automatically applied to PRs with merge conflicts label May 15, 2023
@github-actions
Copy link

Conflicts have been resolved! 🎉 A maintainer will review the pull request shortly.

@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@codecov
Copy link

codecov bot commented May 15, 2023

Codecov Report

Patch coverage has no change and project coverage change: +0.23 🎉

Comparison is base (3c80e05) 62.09% compared to head (8746255) 62.33%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4222      +/-   ##
==========================================
+ Coverage   62.09%   62.33%   +0.23%     
==========================================
  Files          73       73              
  Lines        3327     3329       +2     
  Branches      479      480       +1     
==========================================
+ Hits         2066     2075       +9     
+ Misses       1122     1107      -15     
- Partials      139      147       +8     
Impacted Files Coverage Δ
autogpt/prompts/prompt.py 51.92% <0.00%> (-2.08%) ⬇️

... and 5 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@waynehamadi waynehamadi marked this pull request as ready for review May 15, 2023 18:04
@waynehamadi waynehamadi requested a review from a team May 15, 2023 18:04
@waynehamadi waynehamadi changed the title Feature/refactor tests Refactor challenges May 15, 2023
@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@waynehamadi waynehamadi changed the title Refactor challenges Refactor challenges to use cycle count instead of time May 15, 2023
@dschonholtz
Copy link
Contributor

Could you describe exactly what the cycle count is doing?
I like the idea of enforcing mypy.

@dschonholtz
Copy link
Contributor

Generally this seems like a good thing

@github-actions
Copy link

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

@ntindle ntindle merged commit 6c4426d into Significant-Gravitas:master May 16, 2023
10 of 11 checks passed
ppetermann pushed a commit to ppetermann/Auto-GPT that referenced this pull request May 22, 2023
@ntindle ntindle added this to the v0.4.0 Release milestone May 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

None yet

4 participants