Cannot compile on Windows

[beartastic]

I installed the recommended C++ Compiler for Python 2.7, however I can't seem to run the installer.

The fatal error I got is:
C1083: Cannot open include file: 'stdint.h': No such file or directory

Is it possible to release a compiled version of this?

[beartastic]

Please ignore. I was able to compile and run the code, but had to manually copy all the modules within Arctic to the site-packages directory.

Many thanks!

[jamesblackburn]

Oh super! What did you have to do? We don't run this code on Windows here, so anything we can do to make this seamless would be good...

[beartastic]

Here are my steps:

1. Install MinGW. Make sure to install the following packages:
   Under Basic Setup:
   mingw32-base, mingw32-gcc-g++
   Under All Packages:
   mingw32-pthreads-w32

2. Make sure the mingw bin directory is inside your PATH environment

3. Go into your Python27 directory then under Lib\distults\distutils.cfg, add the following:

[build]
compiler=mingw32

4. Do a pip install for numpy, pandas.

5. Finally do the install for arctic. Fingers crossed you won't get any error messages.

6. Create a simple python script that does an import to Arctic. If you get an error when running the code, which I did get, can try this solution: I had to directly copy the rest of the subdirectories with the .py files from the installation source directly into the site-packages/arctic folder myself. I am not sure if this is a bug with the installer or I am just doing it incorrectly.

Either way it seems to run now!

[jamesblackburn]

Would be great to get this automated so we can have some windows eggs / wheels to upload to PyPI

[ghost]

I am getting the same error message as beartastic ("fatal error C1083: Cannot open include file: 'stdint.h': No such file or directory". I followed his steps but it didn't help. Any idea? Thanks.

[jamesblackburn]

We don't technially require the native bits (they just provide parallel compression), you can run arctic without them as per:
#52 (comment)

[NickAltmann]

I had two problems getting up and running on Windows.

The first was with the lz4 dependency. This was failing because the compile uses gcc specific command line arguments, causing the MSVC compile to fail. Not sure if I'm missing something, I've posed the question here.

The second problem was the missing stdint.h mentioned above, this was affecting both the lz4 install and arctic. This header is missing from VS 2008, the version on which the Python 2.7 compiler is based, it is there later versions. I fixed this locally by just grabbing a version someone has kindly produced, see here. To make the arctic code portable you'd need to define the missing types. The stackoverflow question I just linked to gives an example. Equally, if you look at the lz4 code on PyPi your can see that the file lz4.c is implemented entirely in types that is defines based on compiler version, see the typedefs for BYTE, U16, etc.

[fintrader]

To further clarify @NickAltmann's points

You can get the unofficial windows lz4 binary from here: http://www.lfd.uci.edu/~gohlke/pythonlibs/#python-lz4
Download and install that via pip install C:/path/to/lz4_pip_wheel.whl

Then for the stdint header issue:

1. Clone the artic github repository
2. download this file: http://www.azillionmonkeys.com/qed/pstdint.h into the src/ folder in the local github directory you cloned
3. rename the file to stdint.h
4. run "pip install C:/path/to/github_repos/arctic"

Good to go! Thanks Nick

[spyamine]

Hi,
I've created a wheel for arctic for python 2.7 64bit. I'll run you through how I've proceeded.
0- install lz4 from this link http://www.lfd.uci.edu/~gohlke/pythonlibs/#python-lz4
1- clone the repo arctic into a folder
2- add the stdint header to src/ folder from the link http://www.azillionmonkeys.com/qed/pstdint.h
3- using the method to create a wheel from this link : https://cowboyprogrammer.org/building-python-wheels-for-windows/ . I've installed some compilers and created some environments depending on the target environment I want to work with I had created the following bat program :

:: Required: git, Visual Studio 10.0 Express, Visual Studio 9 Express,
::           Windows 7 SDK (.NET 4), Windows 7 SDK (.NET 3.5), Anaconda/Miniconda

:::::::::::::::::::::::::::::::::::
:: User configurable stuff start ::
:::::::::::::::::::::::::::::::::::

:: These depends on where you installed Anaconda.
:: Python2 or Python3 doesn't matter but you need both 32bit and 64bit versions.
set ANACONDA_BASE=C:\Anaconda2
::set ANACONDA_BASE64=C:\Users\YOURUSERNAME\Anaconda-64

:: Location of your package, can be a directory or a git repo.

:: A directory where the git repo is.
set PKG_REPO=C:\Users\Amine\Desktop\ArcticGit\arctic

:: A git repo
:: set PKG_REPO=git+https://github.com/CamDavidsonPilon/lifelines.git

:::::::::::::::::::::::::::::::::
:: User configurable stuff end ::
:::::::::::::::::::::::::::::::::

:: Save original path so we can restore it
set BASEPATH=%PATH%

:: Set up your conda environments like this, do it for both 32bit and 64bit.
:: navigate to the Anaconda\Scripts / Anaconda-64\Scripts directory to avoid setting any Paths
:: conda create -n py3.4 python=3.4 numpy pip mingw
:: conda create -n py3.3 python=3.3 numpy pip mingw
:: conda create -n py2.7 python=2.7 numpy pip mingw

:: These depend on what you named your environments above
set ENV27=envs\py2.7
::set ENV33=envs\py3.3
::set ENV34=envs\py3.4


:: Tell Python to select correct SDK version
set DISTUTILS_USE_SDK=1
set MSSdk=1

:: Set 32-bit environment
call "C:\Program Files\Microsoft SDKs\Windows\v7.1\Bin\SetEnv.Cmd" /Release /x86

:: Python 2.7 32bit
:: Python2 requires Visual Studio 2008 compiler present (Express version is fine)
call "C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\vcvarsall.bat"
set CPATH=%PATH%
set PATH=%ANACONDA_BASE%\%ENV27%;%ANACONDA_BASE%\%ENV27%\Scripts;%CPATH%
pip install wheel -q
pip wheel --no-deps %PKG_REPO%

:: Set 64-bit environment
call "C:\Program Files\Microsoft SDKs\Windows\v7.1\Bin\SetEnv.Cmd" /Release /x64

:: Python 2.7 64bit
:: 64-bit cl.exe is here
set CPATH=C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\bin\x86_amd64;%CPATH%
set PATH=%ANACONDA_BASE64%\%ENV27%;%ANACONDA_BASE64%\%ENV27%\Scripts;%CPATH%
pip install wheel -q
pip wheel --no-deps %PKG_REPO%

Then I have the wheel that I've tested on a new environment where i did install lz4 for compression.

I hope it will work for you.

I'm happy to help if any problem

arctic-1.26.0-cp27-cp27m-win_amd64.whl.zip

[joekane3]

Thanks @spyamine, this was convenient and worked for me - needed to uncomment the line conda create -n py2.7 python=2.7 numpy pip mingw

[spyamine]

Happy to hear that!! I've comment it because I've already created the conda environment.
How can we get this conveniently automated ? I'm new to github by the way

[bmoscon]

another thing missing is timezone support in windows, see issue #43

[bmoscon]

@spyamine I'll try your instructions and see if i can build a Windows Wheel, if I can, I'll upload it to PyPI so people will be able to just install without compiling

[brdsio]

@Yoshi9143's instructions worked for me!

[bmoscon]

@flaviodrt ok, I'll try his instructions and see if they work for me. Last time I tried, it did not work :(

[buhbuhtig]

Setup for Anaconda 3 (Windows, Python 3.5, 64-bit):

1. Install Visual C++ 2015 Build Tools (~4Gb):
   1.1 Download: http://landinghub.visualstudio.com/visual-cpp-build-tools
   1.2 Run visualcppbuildtools_full.exe

2. Open Anaconda prompt

3. mkdir C:\PackageTmp

4. cd C:\PackageTmp

5. git clone https://github.com/manahl/arctic.git

6. cd C:\PackageTmp\arctic

7. python setup.py build --compiler=msvc

8. pip install wheel

9. pip wheel --no-deps C:\PackageTmp\arctic

10. Bingo: C:\PackageTmp\arctic\arctic-1.50.0-cp35-cp35m-win_amd64.whl

11. pip install arctic-1.50.0-cp35-cp35m-win_amd64.whl

arctic-1.50.0-cp35-cp35m-win_amd64.whl.zip
Best regards,
Vladimir Malkhanov

[bmoscon]

@buhbuhtig thanks I'll try this today and upload a wheel if I can get it to work!

[buhbuhtig]

@bmoscon If you have failed to install using the above instructions, please, check {Anaconda3 path}\Lib\distutils\cygwinccompiler.py file.
Before my successful experiment I changed the following part of code from:

def get_msvcr():
    """Include the appropriate MSVC runtime library if Python was built
    with MSVC 7.0 or later.
    """
    msc_pos = sys.version.find('MSC v.')
    if msc_pos != -1:
        msc_ver = sys.version[msc_pos+6:msc_pos+10]
        if msc_ver == '1300':
            # MSVC 7.0
            return ['msvcr70']
        elif msc_ver == '1310':
            # MSVC 7.1
            return ['msvcr71']
        elif msc_ver == '1400':
            # VS2005 / MSVC 8.0
            return ['msvcr80']
        elif msc_ver == '1500':
            # VS2008 / MSVC 9.0
            return ['msvcr90']
        elif msc_ver == '1600':
            # VS2010 / MSVC 10.0
            return ['msvcr100']
        else:
            raise ValueError("Unknown MS Compiler version %s " % msc_ver)

into:

def get_msvcr():
    """Include the appropriate MSVC runtime library if Python was built
    with MSVC 7.0 or later.
    """
    msc_pos = sys.version.find('MSC v.')
    if msc_pos != -1:
        msc_ver = sys.version[msc_pos+6:msc_pos+10]
        if msc_ver == '1300':
            # MSVC 7.0
            return ['msvcr70']
        elif msc_ver == '1310':
            # MSVC 7.1
            return ['msvcr71']
        elif msc_ver == '1400':
            # VS2005 / MSVC 8.0
            return ['msvcr80']
        elif msc_ver == '1500':
            # VS2008 / MSVC 9.0
            return ['msvcr90']
        elif msc_ver == '1600':
            # VS2010 / MSVC 10.0
            return ['msvcr100']

        elif msc_ver == '1700':
            # Visual Studio 2012 / Visual C++ 11.0
            return ['msvcr110']
        elif msc_ver == '1800':
            # Visual Studio 2013 / Visual C++ 12.0
            return ['msvcr120']
        elif msc_ver == '1900':
            # Visual Studio 2015 / Visual C++ 14.0
            return ['vcruntime140']

        else:
            raise ValueError("Unknown MS Compiler version %s " % msc_ver)

Src: http://c-sharp-snippets.blogspot.de/2016/08/compiling-aspell-python.html

[spyamine]

Hi, thanks @buhbuhtig can you please build a version for python 2.7 ?

[spyamine]

Does your version support compression or not ?? Also how can we deactivate compression please ??

[bmoscon]

I don't think you can turn off compression.

[buhbuhtig]

@spyamine Sorry, I don't use 2.7 version.

[taewookim]

@buhbuhtig

$ pip install arctic-1.50.0-cp35-cp35m-win_amd64.whl
arctic-1.50.0-cp35-cp35m-win_amd64.whl is not a supported wheel on this platform.

Am I missing something..?

I'm using Python 3.6.2 :: Anaconda custom (64-bit) on Win 8 / 64 bit using Cygwin

[brdsio]

pip install wheel Em 3 de nov de 2017 4:48 PM, "taewookim" <notifications@github.com> escreveu: @buhbuhtig <https://github.com/buhbuhtig> $ pip install arctic-1.50.0-cp35-cp35m-win_amd64.whl arctic-1.50.0-cp35-cp35m-win_amd64.whl is not a supported wheel on this platform. Am I missing something..? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#6 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAE4THeNaWHCA9CRN3UpNE1LbnjBe4Wrks5sy2AAgaJpZM4E9Z3r> .

[taewookim]

Still getting the error

$ pip install wheel
Requirement already satisfied: wheel in c:\anaconda3\lib\site-packages

$ pip install arctic-1.50.0-cp35-cp35m-win_amd64.whl
arctic-1.50.0-cp35-cp35m-win_amd64.whl is not a supported wheel on this platform.

[markqiu]

latest version compiled in windows 10
arctic-1.55.0-cp36-cp36m-win_amd64.whl.zip

[bashtage]

1.55 and 1.56 compile and work fine on Windows.

[buhbuhtig]

latest version compiled with VC++ 2015.3 v140 toolset for desktop (Visual Studio 2017 component):
arctic-1.64.0-cp36-cp36m-win_amd64.whl.zip

[spyamine]

Hi can you please compile fir python 2.7 or indicate how to do it?

[bashtage]

The easiest solution for stdint on python 2 is to use one of the free versions of these. I do this here

https://github.com/bashtage/randomgen/blob/master/randomgen/src/pcg32/pcg32.h

[bashtage]

I just compiled it on Windows/Python2.7/x64 without issue from Master

https://github.com/bashtage/arctic/blob/py27-win/dist/arctic-1.64.0-cp27-cp27m-win_amd64.whl

[spyamine]

Cool @bashtage Thank you for sharing.

You did not have any problem with the lz4 library for using compression ?

[bashtage]

No problems. I use

https://www.microsoft.com/en-gb/download/details.aspx?id=44266

for compiling.

[jamesblackburn]

@bashtage than you for the PR - are you happy to close this ticket now?

[bashtage]

AFAICT it builds correctly on Python 2.7, 3.5 and 3.6 Windows/x86_64 which should be enough to close this. It may not work on Win32 but I don't think it makes sense to put effort into 32 bit Windows.

[bmoscon]

i tested this on windows. All I did was install python 3.6 and the visual studio compiler toolchain and it built without issue (on windows 10).