Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upcoming metabot OGS AI tournament - OGS 2019x19 #2109

Closed
wonderingabout opened this issue Dec 31, 2018 · 24 comments

Comments

@wonderingabout
Copy link
Contributor

commented Dec 31, 2018

hi,

i will be helding an AI tournament on OGS, are you in ?

phoenixgo-text-winrate

tournament 1st edition link :

Please read rules, everyone is welcome

@roy7 @alreadydone @AncalagonX @l1t1 @Friday9i @bjiyxo @yenw @baduk1 @bubblesld @Marcin1960 @Mardak @Ishinoshita @godmoves @MartinDevelopment @petgo3 @Hersmunch @marcocalignano @TFiFiE @Ttl @tterava @pangafu @lemonsqueeze

i mentionned the most likely and frequent names i saw, but again everyone is welcome,

read carefully rules though please, especially regarding AI diversity condition

Max number is 10 participants

Participants so far (will be updated)

  1. me, with PhoenixGo 20b native provided by Tencent github : https://online-go.com/user/view/592558//meta-金毛测试-20b
  2. Saphira AI, an AI trained on human games, stronger than leela zero : https://online-go.com/user/view/598330/Saphira-test
  3. roy7 RoyalZero : https://online-go.com/player/484523/RoyalZero
  4. Stefe has confirmed to enter with NightlyLeela (most likely elf v1) : https://online-go.com/player/530672/NightlyLeela
  5. Dorus has confirmed to run the new lz 15b #2091 released by @bjiyxo recently : https://online-go.com/user/view/195118/Dorus using the 15bTurboLeela bot account https://online-go.com/player/602660/15bTurboLeela
  6. mafutrct https://online-go.com/user/view/30107/mafutrct is interested to take one seat too with a customized LZ : lz 40b weights with a significantly modified search algorithmm, which is nerai13 AI : https://online-go.com/player/602718/nerai13
  7. FREE SEAT
  8. FREE SEAT
  9. FREE SEAT
  10. FREE SEAT

UPDATE : if there are many bots, i am willing to open a B block with 10 new seats !!
update 2 : due to new things to manage (nothing dire), Aquabot informed me he will not be able use his AI at the same time, but will be looking forward to it : https://online-go.com/player/495496/AquaBotTest

4 seats remain now

community discussion here :

@Ishinoshita

This comment has been minimized.

Copy link

commented Dec 31, 2018

@wonderingabout Very nice idea to have this tournament. Will provide some benchmark.

Not sure I got the "1 day correspondence time limit", but I assume we are talking about long time control, so all moves should be made with high visits. I wish this tournament could show how beneficial Cpuct scaling with depth can be. Namely, to see LZ with and without this change.

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Dec 31, 2018

@Ishinoshita thanks :)

i also am looking forward to it, i hope we'll see many new AI (there is already the new saphira AI), but i want to see ray, human trained AI, lz 15b 157.2 (the new one trained by @bjiyxo in #2091 ), elf, etc...

as for time limit, remember that it is a time limit : i do not plan this tournament to last one year, the time limit is here to end the game fast if the bot admin is away (after 24 hours the bot will lose by timeout)

also, i set the following playouts limit so that :

  • this tournament can be played with simple hardware
  • this tournament will NOT be a horse race of who has the most powerful hardware
  • at the opposite, this tournament is aimed to be fair and played in a friendly and non competitive environment
  • yet with quality games

so :

  • for 40b : 12 000 playouts max
  • for 20b : 20 000 playouts max
  • for 15b : 24 000 playouts max

@wonderingabout wonderingabout changed the title Upcoming metabot AI tournament - OGS 2019x19 Upcoming metabot OGS AI tournament - OGS 2019x19 Dec 31, 2018

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Dec 31, 2018

@barrtgt

This comment has been minimized.

Copy link

commented Dec 31, 2018

I would like to hear more about Saphira. I'm glad to see more strong supervised ai.

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Dec 31, 2018

list of possible AI here (non exhaustive) :
https://www.reddit.com/r/cbaduk/comments/7e05b8/go_software/

first that come to my mind

ray
ELF
AQ
minigo
lz 15b new
leela master
crazystone
deep zen

also here #2027

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Dec 31, 2018

@barrtgt

Saphira is a japanese AI trained from 20k pro games
it is a 15b network yet much stronger than the current lz, with just 5000 playouts

it was trained using 2 gtx 1080 ti for a training time of one week
this is was the author told me, ask hakudragon for more details : https://online-go.com/player/519285/

@barrtgt

This comment has been minimized.

Copy link

commented Dec 31, 2018

@wonderingabout thanks

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Dec 31, 2018

you're welcome @barrtgt

update : Mitsunari has confirmed to be willing to participate, he will be using one seat of this tournament

update 2 : Stefe has confirmed to be entering too with NightlyLeela (most likely elf v1)

@l1t1

This comment has been minimized.

Copy link

commented Jan 1, 2019

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 1, 2019

yes but using low visits @l1t1

i had to reduce drastically playouts because i was wining all the game at even playouts

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 1, 2019

update 3 : Tokumoto haas confirmed to be entering the competition with Bifron

update 4 : Dorus has confirmed to enter the competition with the new lz 15b (15bTurboLeela)

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 1, 2019

only 2 free seats are left now

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 1, 2019

this is an example of how the canadian clock will work for this tournament https://beta.online-go.com/game/4122

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 1, 2019

UPDATE : if there are many bots, i am willing to open a B block with 10 new seats !!

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 1, 2019

update 2
mafutrct https://online-go.com/user/view/30107/mafutrct is interested to take one seat too with a customized LZ : lz 40b weights with a significantly modified search algorithm

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 1, 2019

update 3 : due to new things to manage, Aquabot informed me he will not be able use his AI at the same time, but he will be looking forward to it : https://online-go.com/player/495496/AquaBotTest

Mitsunari is also unsure to participate (need to set up the cloud, not decided yet)

@dbosst

This comment has been minimized.

Copy link
Contributor

commented Jan 2, 2019

start date 15th or 12th of January?
Saturday is the 12th.... You have 15th several other places.... all mixed up

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 2, 2019

second saturday of january, which can only be 12th my bad, will be fixed soon :)

edit : fixed now, thanks

there is a countdown here : https://online-go.com/tournament/44207

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 4, 2019

edit : so to sum up, 4 free seats remain out of 10 now

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 7, 2019

update : Tokumoto has decided to withdraw his bot Bifron from the tournament

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 9, 2019

update 2 :

nerai13 AI is entering the competition (seat number 6) : https://online-go.com/player/602718/nerai13

without news from mitsunari, i have to withdraw him from the competition until i get any news

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 12, 2019

the AI tournament has started !!!

https://online-go.com/tournament/44207

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Jan 13, 2019

end of tournament !!

phoenixgo got a bronze medal !!

trophy

the last game of phoenixgo vs 15b turbo leela had an amazing comeback by phoenixgo

we have many new ideas of what to improve and try for 2nd edition, which will be

sunday 10 february 2019

https://online-go.com/tournament/44623

@wonderingabout

This comment has been minimized.

Copy link
Contributor Author

commented Mar 26, 2019

closed as it was stale

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
5 participants
You can’t perform that action at this time.