-
Notifications
You must be signed in to change notification settings - Fork 87
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Extended test suites #1118
Comments
I agree with the proposal as discussed already at GECCO-2016 and in particular on the number of added functions. |
Does it mean that the data from this year will be abandoned? On Sun, Aug 7, 2016 at 9:05 PM, Dimo Brockhoff notifications@github.com
|
No, of course not. |
I started to implement the extended
|
I have been again a bit too optimistic wrt the CI tests :-( : on one Windows machine and the Mac, the tests do not yet run through:
|
Remark: a closer look revealed that the second objective of f79 is the Weierstrass function for which seemingly no |
Update: the |
In order to keep the repository small, we need to put the (new and old) files of the regression test somewhere else (the new |
Updated list of things to do (possibly done already at the time of writing, to be checked):
See also #1873. |
Add-on: we should implement the functionality that the order of the objective functions is changed pseudo-randomly with the instance number. The reason is that in the original |
I guess the closing of this issue was a mistake. Most issues above are still not addressed. |
We should consider to proposed extended versions of the
bbob
andbbob-biobj
test suites.Proposal for
bbob-biobj
: we add all within-group combinations ofbbob
functions which are not already inbbob-biobj
and which do not combine a function with itself. This will add4*(4+3+2+1-1) + 3+2+1-1 = 4*9+5=41
functions.Rationale: this will add more diversity w.r.t. the used single objective functions (as suggested by @loshchil) and more functions where both objectives are from a similar "function domain" (as suggested by @Ulfgard).
The text was updated successfully, but these errors were encountered: