Windows support #11

salarian · 2016-04-28T08:07:27Z

It would be nice if you could add support for Windows.

andrewssobral · 2016-04-28T17:22:36Z

True

steenblikrs · 2016-05-15T02:39:03Z

Please!! Support windows. I know I should have a dual boot linux distro, but I only have a little solid state. Adding a linux distro would cripple me... Long story short, it would be very convenient to have this available on windows!!

Thank you for all of your hard work thus far.

gdb · 2016-05-16T01:11:34Z

I know a non-trivial number of people are currently using Gym on Windows. I think at this point, it mostly works (with the possible exception of Atari, though I think that too may be not too hard).

We don't have any Windows users at OpenAI currently. Is anyone on this thread interested in doing the work to get Gym fully supported on Windows (which mostly involves getting a CI service set up, and making sure our current functionality actually works there)? Happy to provide guidance.

See also #99.

vrxacs · 2016-06-21T05:43:40Z

Is this still an issue worth resolving? It looks like there was an attempt in #99 but it never really went anywhere. I'd be interested in getting this set up.

gdb · 2016-06-21T05:45:34Z

Yep, definitely!

vrxacs · 2016-06-22T04:45:12Z

Alright, then! I'll start looking into it. I'm going to start by setting up a CI service somewhere. Let me know if there's anything else I should be looking into for this issue.

quibsorg · 2016-08-15T21:56:16Z

Any update on this?

maxosmith · 2016-08-28T01:18:50Z

I've got OpenAI gym working on Windows 10 (at least CartPole). Preface: you need to run all the python commands as root because it does path look-ups differently by user.

Very rough instructions:

Update to the latest version of Windows (>version 1607, "Anniversary Update")
Enable Windows Subsystem for Linux (WSL)
Open cmd, run bash
Install python & gym (using sudo, and NOT PIP to install gym). So by now you should probably be able to run things and get really nasty graphics related errors. This is because WSL doesn't support any displays, so we need to fake it.
Install vcXsrv, and run it (you should just have a little tray icon)
In bash run "export DISPLAY=:0" Now when you run it you should get a display to pop-up, there may be issues related to graphics drivers. Sadly, this is where the instructions diverge if you don't have an NVIDIA graphics card.
Get the drivers: "sudo apt-get install nvidia-319 nvidia-settings-319 nvidia-prime"
Run!

Let me know if you have any questions or if I should do a detailed guide.

lunzueta · 2016-08-28T09:36:19Z

@maxosmith Good news! I have one question about this: why nvidia-319 and not a newer version?

lbandy · 2016-08-28T10:18:46Z

Just a heads-up for anyone not having Windows 10, I'm able to run the gym on Windows 7 using cygwin and ImageMagick, although I haven't tried the atari games yet. One issue though, the recording doesn't seem to work because of ffmpeg issues, but I assume this could be sorted after some investigation.

maxosmith · 2016-08-29T03:08:09Z

@lunzueta I knew it was a safe version for working with vcXsrv, I would imagine newer versions work.

icoxfog417 · 2016-09-13T06:14:33Z

@maxosmith Thank you for nice tutorial to enable gym work on Windows! I succeeded to run gym on my Windows PC (bash on Windows/Python 3.5.2). pip install also works fine, below is my setup procedure.

install vcXsrv on Windows
run bash on Windows
install all dependencies
pip install gym
pip install 'gym[atari]'
invoke vcXsrv Window (I recommend to reboot PC before it)
run export DISPLAY=:0
run below script, Invaders works fine.

import gym


if __name__ == "__main__":
    env = gym.make("SpaceInvaders-v0")
    env.reset()
    for _ in range(1000):
        env.render()
        env.step(env.action_space.sample())

fedorzh · 2016-09-21T01:30:43Z

After multiple hours of trial-and-error, this procedure worked for me from scratch, includes Jupyter:

Install Ubuntu (run in cmd) on Windows:
lxrun /uninstall /all
lxrun /install

Python and Jupyter (reference to microsoft/WSL#185 (comment)):
apt-get update
add-apt-repository ppa:aseering/wsl
apt-get update
apt-get install python-pip ipython ipython-notebook
pip install jupyter
jupyter notebook --no-browser

Gym:
apt-get install -y python-numpy python-dev cmake zlib1g-dev libjpeg-dev xvfb libav-tools xorg-dev python-opengl libboost-all-dev libsdl2-dev swig
pip install gym
pip install 'gym[atari]'

Graphics, I have Intel HD Graphics 4400, launch Xming first (vcXsrv didn't work!):
apt-get install mesa-utils
export DISPLAY=:0

Viliami · 2016-10-01T07:57:35Z

windows only has 90% market share, it's no big deal...

Viliami · 2016-10-02T00:21:53Z

I got OpenAI gym to work in windows without BASH but installing the extra dependencies like 'atari' can't be done because they install it using the make command

Warr1611 · 2016-10-07T22:42:37Z

@Viliami Could you give detail on how you got OpenAI gym working without BASH?

tihomir-kit · 2016-12-21T00:40:43Z

It's fascinating that I haven't been able to run even the cartpole on either a fresh install of the latest ubuntu on the hardware or in a vm, but the whole "ubuntu on windows" thing work flawlessly after the first try... :D thanks for the setup instructions @maxosmith @icoxfog417 !

rybskej · 2016-12-22T06:52:50Z

I've gotten atari_py to build and install on Windows 7 x86_64, using msys2/mingw64 for the compiler tools, Python 3.5 Anaconda, Xming for graphics, and TensorFlow 0.12.0 + CUDA GPU enabled.

For simplicity, I've forked this project with relatively minor changes applied and full install instructions included: https://github.com/rybskej/atari-py

It should be possible to merge these changes back into this project, with minor edits. I'll try to work on a portable patch.

davidtellez · 2017-01-04T02:13:36Z

@rybskej you are my hero! I followed your instructions in https://github.com/rybskej/atari-py and I can finally render Atari games in Windows 10 (no WSL bash): python 3.5 Anaconda, Xming, TensorFlow 0.12.0 + CUDA GPU and PyCharm :) It would be very interesting to merge the changes back, since many more people could benefit from it.

I also tested Ubuntu bash under Windows 10 WSL following @icoxfog417 instructions and it works using Xming, as suggested by @fedorzh.

rybskej · 2017-01-11T23:34:39Z

Hi David, Awesome to hear it worked out for you! I suspect the MSYS2 environment approach can help other Linux-only TF projects be more rapidly ported to Windows. Especially now that TF officially supports Windows. Time permitting, I'll definitely put together a patch proposal to ported changes back to the main branch. Regards, Eric

…

On Tue, Jan 3, 2017 at 9:13 PM, David Tellez ***@***.***> wrote: @rybskej <https://github.com/rybskej> you are my hero! I followed your instructions in https://github.com/rybskej/atari-py and I can finally render Atari games in Windows 10 (no WSL bash): python 3.5 Anaconda, Xming, TensorFlow 0.12.0 + CUDA GPU and PyCharm :) It would be very interesting to merge the changes back, since many more people could benefit from it. I also tested Ubuntu bash under Windows 10 WSL following @icoxfog417 <https://github.com/icoxfog417> instructions and it works using Xming, as suggested by @fedorzh <https://github.com/fedorzh>. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#11 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AV-Uf5wIdzjFEP7YLYM1rePX7Io-I5GWks5rOwBYgaJpZM4IRrZS> .

edupard · 2017-01-19T11:27:35Z

@rybskej Crystal clear instructions and it just works! Thanks a lot! Win7 x64, python 3.5

VXLearning · 2017-01-30T00:13:01Z

Was able to get VcXsrv to work with Bash on Windows 10 (Dell Latitude 6220), python 2.7.6 by install the
opengl library:

sudo apt-get install python-opengl
export DISPLAY=:0
run the cart pole example from gym or other games

Best of luck.

Kojoley · 2017-02-20T17:20:19Z

I have opend a PR openai/atari-py#7 but I am asking here for help in testing it out.
All you need is to enter pip install -U git+https://github.com/Kojoley/atari-py.git
(requires zlib so have one installed in your system, the path to it can be provided with ZLIB_ROOT environment variable)

edupard · 2017-02-21T10:06:30Z

@Kojoley
Win7_x64: I installed zlib from here Set ZLIB_ROOT to installation directory. But compiler could not find zlib.h. If i change ZLIB_ROOT to INSTALL_DIR/include it could not link...

Kojoley · 2017-02-21T10:33:49Z

@edupard I have pushed a fix, but I am afraid that package you have provided link to is suitable only for mingw/cygwin (it requires unistd.h which is the part of posix that msvc does not support)

edupard · 2017-02-21T10:46:38Z

@Kojoley Can you please tell exact package i have to use?

Kojoley · 2017-02-21T11:01:24Z

@edupard If you use mingw as compiler for python - you can use one you have provided. Otherwise you have to compile it by yourself from official site. (I have not done conda support yet)

jamartinh · 2017-02-27T15:23:10Z

@rybskej and others, I found the method of @rybskej simpler than any other.
I works nicely. Also, it seems to render on windows 10 without the need of xming.

ghost · 2017-02-27T17:02:27Z

@rybskej I was initially having problems building with make (something about not being able to find the compiler) but I tried again after reinstalling python and msys2 numerous times. It works beautifully! Thank you.
Running Windows 10 Insider Preview, Surface Book with dGPU, and Anaconda 4.2.0 with Python 3.5.2

Kojoley · 2017-02-27T17:08:03Z

I got rid of zlib depency completely, so except the need of compiler it is now simply as typing pip install -U git+https://github.com/Kojoley/atari-py.git

JaeDukSeo · 2018-03-04T20:12:40Z

This was such as useful thread.

jamartinh · 2018-03-06T16:13:52Z

It seems that pyglet==1.2.4 is required instead of the current 1.3?

Kojoley · 2018-03-06T16:41:07Z

It seems that pyglet==1.2.4 is required instead of the current 1.3?

If you are talking about this
https://bitbucket.org/pyglet/pyglet/issues/170/nameerror-name-puint-is-not-defined issue --
it is a problem with pyglet==1.3.1 on Python 2.7. You can roll back to pyglet==1.3.0 or install it from trunk.

jamartinh · 2018-03-08T18:51:51Z

I am on python36, I had to downgrade to pyglet==1.2.4

averdones · 2018-03-20T23:02:28Z

I'm on python 3.6.4 and I got an error when running pip install gym[all]
: Failed building wheel for Box2D-kengz.

Anyone got the same?

jamartinh · 2018-03-21T06:46:38Z

Me. El 21 mar. 2018 0:02, "Antonio Verdone" <notifications@github.com> escribió: I'm on python 3.6.4 and I got an error: *Failed building wheel for Box2D-kengz*. Anyone got the same? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#11 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ADbWs5gJkGhSYwZvzAvwEPAD_tUZFbG2ks5tgYqWgaJpZM4IRrZS> .

averdones · 2018-03-22T16:38:32Z

Do you know how to fix it @jamartinh?

I followed @aywi instructions and I could do pip install gym, but not pip install gym[all].

jamartinh · 2018-03-23T19:36:59Z

Nop, I just dont use that environments. All the rest works well installing them 1 by 1. El jue., 22 mar. 2018 17:39, Antonio Verdone <notifications@github.com> escribió:

…

Do you know how to fix it @jamartinh <https://github.com/jamartinh>? I followed @aywi <https://github.com/aywi> instructions and I could do pip install gym, but not pip install gym[all]. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#11 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ADbWs1E7_Cci0X-gC6jPXXoMVBY-ML3Cks5tg9OlgaJpZM4IRrZS> .

ghost · 2018-04-19T18:15:48Z

Greetings, What is the long range strategy for windows support?
Please consider adding support for windows installation via pip.

Thanks, coast

viper7882 · 2018-05-29T09:59:32Z

@jamartinh , I faced the same issue and apparently get resolved when following instructions at https://github.com/j8lp/atari-py.

ivenzor · 2018-07-09T04:01:39Z

@jamartinh , I found the same error with Box2D-kengz while installing Box2d on Windows 10. I just went to http://www.swig.org/download.html, downloaded the zip file, unzipped it, changed windows PATH environmental to include swig.exe, then installed Box2D again and it seems to be working:

import gym
env = gym.make('LunarLander-v2')
env.reset()
for _ in range(1000):
env.render()
env.step(env.action_space.sample())

jamartinh · 2018-07-09T10:10:48Z

Oh, thanks! El lun., 9 jul. 2018 6:02, ivenzor <notifications@github.com> escribió:

…

@jamartinh <https://github.com/jamartinh> , I found the same error with Box2D-kengz while installing Box2d on Windows 10. I just went to http://www.swig.org/download.html, downloaded the zip file, unzipped it, changed windows PATH environmental to include swig.exe, then installed Box2D again and it seems to be working: import gym env = gym.make('LunarLander-v2') env.reset() for _ in range(1000): env.render() env.step(env.action_space.sample()) [image: box2d] <https://user-images.githubusercontent.com/11284409/42430107-c6635804-8302-11e8-8716-b1cef749622b.png> — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#11 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ADbWs-L0lj0LXanl_MetaSImtd_-ZnOmks5uEtW7gaJpZM4IRrZS> .

thingersoft · 2018-08-09T23:44:18Z

Let me say that given the OpenAI mission (and the reasons behind the gym toolkit) the lack of official support for the most widespread OS on the planet is pretty puzzling.

ph-dev-2016 · 2018-09-22T19:21:05Z

when trying to use gym I get error from file
gym\wrappers\monitoring\video_recorder.py", line 254, in init
raise error.DependencyNotInstalled("""Found neithethe ffmpeg nor avconv executables.

Is this because
elif distutils.spawn.find_executable('ffmpeg')
should look for ffmpeg.exe in Windows version?

ghost · 2018-12-11T14:11:32Z

I would like to share how I got it working on Windows 10:

First I enabled & installed Windows Subsystem for Linux. I went ahead and installed entire ubuntu-desktop which was not required I guess. You can also install Xming if you want to enable using GUI's like gedit, firefox (You would need to set Display:0).

Later I installed anaconda followed by pip install gym['atari'] & used jupyter notebook with --no-browser flag to open it in native Windows chrome browser. It works without any problem for me.

NOTE: I've skipped some things like pip refusing to install gym because of some permission error etc. I resolved it but I think that wasn't a generic error. If anyone is trying and facing any error, do report. I will share the solutions.

itegmark · 2019-04-08T18:08:00Z

This instruction worked like charm: https://towardsdatascience.com/how-to-install-openai-gym-in-a-windows-environment-338969e24d30

NicoEssi · 2019-06-19T15:56:14Z

Any update on how the Windows support is coming along? Been years now.

daniel-fudge · 2019-09-02T14:38:41Z

Just ran successfully in Windows 10. Just follow the readme with the addition of installing the "Build Tools for Visual Studio 2019" from the following site.

https://visualstudio.microsoft.com/downloads/

I also found this by reading the following article.
https://towardsdatascience.com/how-to-install-openai-gym-in-a-windows-environment-338969e24d30

I think if the readme was updated with this reference, this issue could be closed.

leemorris · 2020-01-12T13:37:33Z

@jamartinh - I needed to edit a file after installing Swig from here.

https://github.com/pybox2d/pybox2d/issues/106#issuecomment-535283336

jkterry1 · 2021-07-30T19:42:46Z

I will accept PRs from the community for this, but almost everything should work for Windows and me and those helping maintain Gym don't have the ability to deal extend Gym to Windows ourselves. I'm going to close this issue for now.

ageron mentioned this issue Mar 15, 2018

chapter16. NotImplementedError: abstract ageron/handson-ml#193

Closed

alexisbcook mentioned this issue Jul 8, 2018

SWIG required on windows for box2d udacity/deep-reinforcement-learning#2

Closed

Shmuma mentioned this issue Sep 25, 2018

monitor not working in Chapter04/01_cartpole.py PacktPublishing/Deep-Reinforcement-Learning-Hands-On#3

Closed

Migdalin mentioned this issue Dec 9, 2018

can openai be installed on windows 10? #982

Closed

TheCrazyT mentioned this issue Mar 9, 2019

TypeError: render() missing 1 required positional argument: 'mode' TheCrazyT/roboschool#13

Closed

schrum2 mentioned this issue May 30, 2019

Apply an algorithm to an Atari game nazaruka/gym-http-api#7

Closed

daniel-fudge mentioned this issue Sep 2, 2019

README doesn't reference required Visual Studio Build Tools for Windows udacity/deep-reinforcement-learning#34

Closed

christopherhesse added the pinned label Nov 15, 2019

stonebig mentioned this issue May 10, 2020

pls help with pip install gym[all] winpython/winpython#843

Open

jkterry1 closed this as completed Jul 30, 2021

Windows support #11

Windows support #11

Comments

salarian commented Apr 28, 2016

andrewssobral commented Apr 28, 2016

steenblikrs commented May 15, 2016

gdb commented May 16, 2016 • edited Loading

vrxacs commented Jun 21, 2016

gdb commented Jun 21, 2016

vrxacs commented Jun 22, 2016

quibsorg commented Aug 15, 2016

maxosmith commented Aug 28, 2016 • edited Loading

lunzueta commented Aug 28, 2016

lbandy commented Aug 28, 2016

maxosmith commented Aug 29, 2016

icoxfog417 commented Sep 13, 2016 • edited Loading

fedorzh commented Sep 21, 2016 • edited Loading

Viliami commented Oct 1, 2016

Viliami commented Oct 2, 2016

Warr1611 commented Oct 7, 2016

tihomir-kit commented Dec 21, 2016 • edited Loading

rybskej commented Dec 22, 2016 • edited Loading

davidtellez commented Jan 4, 2017

rybskej commented Jan 11, 2017 via email

edupard commented Jan 19, 2017 • edited Loading

VXLearning commented Jan 30, 2017 • edited Loading

Kojoley commented Feb 20, 2017

edupard commented Feb 21, 2017

Kojoley commented Feb 21, 2017

edupard commented Feb 21, 2017

Kojoley commented Feb 21, 2017

jamartinh commented Feb 27, 2017

ghost commented Feb 27, 2017 • edited by ghost Loading

Kojoley commented Feb 27, 2017

JaeDukSeo commented Mar 4, 2018

jamartinh commented Mar 6, 2018

Kojoley commented Mar 6, 2018

jamartinh commented Mar 8, 2018 • edited Loading

averdones commented Mar 20, 2018 • edited Loading

jamartinh commented Mar 21, 2018 via email

averdones commented Mar 22, 2018

jamartinh commented Mar 23, 2018 via email

ghost commented Apr 19, 2018

viper7882 commented May 29, 2018

ivenzor commented Jul 9, 2018

jamartinh commented Jul 9, 2018 via email

thingersoft commented Aug 9, 2018

ph-dev-2016 commented Sep 22, 2018

ghost commented Dec 11, 2018 • edited by ghost Loading

itegmark commented Apr 8, 2019

NicoEssi commented Jun 19, 2019

daniel-fudge commented Sep 2, 2019

leemorris commented Jan 12, 2020 • edited Loading

jkterry1 commented Jul 30, 2021

gdb commented May 16, 2016 •

edited

Loading

maxosmith commented Aug 28, 2016 •

edited

Loading

icoxfog417 commented Sep 13, 2016 •

edited

Loading

fedorzh commented Sep 21, 2016 •

edited

Loading

tihomir-kit commented Dec 21, 2016 •

edited

Loading

rybskej commented Dec 22, 2016 •

edited

Loading

edupard commented Jan 19, 2017 •

edited

Loading

VXLearning commented Jan 30, 2017 •

edited

Loading

ghost commented Feb 27, 2017 •

edited by ghost

Loading

jamartinh commented Mar 8, 2018 •

edited

Loading

averdones commented Mar 20, 2018 •

edited

Loading

ghost commented Dec 11, 2018 •

edited by ghost

Loading

leemorris commented Jan 12, 2020 •

edited

Loading