Running 'tests/runner.py benchmark' fails on Windows.

[juj]

Running 'python tests/runner.py benchmark' on Windows gives the following error output:

(Emscripten: Running sanity checks)
test_copy (__main__.benchmark) ... link: unknown option -- o
Try `/usr/bin/link --help' for more information.
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

ERROR
test_corrections (__main__.benchmark) ... link: unknown option -- o
Try `/usr/bin/link --help' for more information.
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

ERROR
test_dlmalloc (__main__.benchmark) ... link: unknown option -- o
Try `/usr/bin/link --help' for more information.
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

ERROR
test_fannkuch (__main__.benchmark) ... link: unknown option -- o
Try `/usr/bin/link --help' for more information.
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

ERROR
test_fasta_float (__main__.benchmark) ... link: unknown option -- o
Try `/usr/bin/link --help' for more information.
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

ERROR
test_memops (__main__.benchmark) ... link: unknown option -- o
Try `/usr/bin/link --help' for more information.
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

ERROR
test_primes (__main__.benchmark) ... link: unknown option -- o
Try `/usr/bin/link --help' for more information.
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

ERROR
test_skinning (__main__.benchmark) ... In file included from /tmp\emscripten_test_benchmark_w8o2ou\skinning.cpp:9:
In file included from C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\vector:6:
In file included from C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\memory:987:
In file included from C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\intrin.h:26:
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:222:1: error: unknown type name '__m256'
__m256 _mm256_macc_ps(__m256, __m256, __m256);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:222:23: error: use of undeclared identifier '__m256'
__m256 _mm256_macc_ps(__m256, __m256, __m256);
                      ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:223:1: error: unknown type name '__m256d'
__m256d _mm256_macc_pd(__m256d, __m256d, __m256d);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:223:24: error: use of undeclared identifier '__m256d'
__m256d _mm256_macc_pd(__m256d, __m256d, __m256d);
                       ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:224:1: error: unknown type name '__m256'
__m256 _mm256_maddsub_ps(__m256, __m256, __m256);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:224:26: error: use of undeclared identifier '__m256'
__m256 _mm256_maddsub_ps(__m256, __m256, __m256);
                         ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:225:1: error: unknown type name '__m256d'
__m256d _mm256_maddsub_pd(__m256d, __m256d, __m256d);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:225:27: error: use of undeclared identifier '__m256d'
__m256d _mm256_maddsub_pd(__m256d, __m256d, __m256d);
                          ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:226:1: error: unknown type name '__m256'
__m256 _mm256_msubadd_ps(__m256, __m256, __m256);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:226:26: error: use of undeclared identifier '__m256'
__m256 _mm256_msubadd_ps(__m256, __m256, __m256);
                         ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:227:1: error: unknown type name '__m256d'
__m256d _mm256_msubadd_pd(__m256d, __m256d, __m256d);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:227:27: error: use of undeclared identifier '__m256d'
__m256d _mm256_msubadd_pd(__m256d, __m256d, __m256d);
                          ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:228:1: error: unknown type name '__m256'
__m256 _mm256_msub_ps(__m256, __m256, __m256);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:228:23: error: use of undeclared identifier '__m256'
__m256 _mm256_msub_ps(__m256, __m256, __m256);
                      ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:229:1: error: unknown type name '__m256d'
__m256d _mm256_msub_pd(__m256d, __m256d, __m256d);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:229:24: error: use of undeclared identifier '__m256d'
__m256d _mm256_msub_pd(__m256d, __m256d, __m256d);
                       ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:230:1: error: unknown type name '__m256'
__m256 _mm256_nmacc_ps(__m256, __m256, __m256);
^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:230:24: error: use of undeclared identifier '__m256'
__m256 _mm256_nmacc_ps(__m256, __m256, __m256);
                       ^
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\ammintrin.h:231:1: error: unknown type name '__m256d'
__m256d _mm256_nmacc_pd(__m256d, __m256d, __m256d);
^
fatal error: too many errors emitted, stopping now [-ferror-limit=]
20 errors generated.

ERROR

======================================================================
ERROR: test_copy (__main__.benchmark)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/runner.py", line 10120, in test_copy
    self.do_benchmark('copy', src, [], 'sum:9928\n', emcc_args=['-s', 'QUANTUM_SIZE=4', '-s', 'USE_TYPED_ARRAYS=2'])
  File "tests/runner.py", line 9976, in do_benchmark
    self.run_native(filename, args)
  File "tests/runner.py", line 285, in run_native
    Popen([filename+'.native'] + args, stdout=PIPE).communicate()[0]
  File "G:\Inttel-slave\win-emcc-incoming-tests\build\tools\shared.py", line 31, in __init__
    self.process = subprocess.Popen(args, bufsize, executable, self.stdin_, self.stdout_, self.stderr_, preexec_fn, close_fds, shell, cwd, env, universal_newlines, startupinfo, creationflags)
  File "C:\Python27\lib\subprocess.py", line 679, in __init__
    errread, errwrite)
  File "C:\Python27\lib\subprocess.py", line 896, in _execute_child
    startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

======================================================================
ERROR: test_corrections (__main__.benchmark)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/runner.py", line 10147, in test_corrections
    self.do_benchmark('corrections', src, [], 'final: 826:14324.', emcc_args=['-s', 'CORRECT_SIGNS=1', '-s', 'CORRECT_OVERFLOWS=1', '-s', 'CORRECT_ROUNDINGS=1'])
  File "tests/runner.py", line 9976, in do_benchmark
    self.run_native(filename, args)
  File "tests/runner.py", line 285, in run_native
    Popen([filename+'.native'] + args, stdout=PIPE).communicate()[0]
  File "G:\Inttel-slave\win-emcc-incoming-tests\build\tools\shared.py", line 31, in __init__
    self.process = subprocess.Popen(args, bufsize, executable, self.stdin_, self.stdout_, self.stderr_, preexec_fn, close_fds, shell, cwd, env, universal_newlines, startupinfo, creationflags)
  File "C:\Python27\lib\subprocess.py", line 679, in __init__
    errread, errwrite)
  File "C:\Python27\lib\subprocess.py", line 896, in _execute_child
    startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

======================================================================
ERROR: test_dlmalloc (__main__.benchmark)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/runner.py", line 10166, in test_dlmalloc
    self.do_benchmark('dlmalloc', src, ['400', '400'], '*400,0*', emcc_args=['-g', '-s', 'CORRECT_SIGNS=2', '-s', 'CORRECT_SIGNS_LINES=[4820, 4195, 4250, 4203, 4209, 4239, 4231]'])
  File "tests/runner.py", line 9976, in do_benchmark
    self.run_native(filename, args)
  File "tests/runner.py", line 285, in run_native
    Popen([filename+'.native'] + args, stdout=PIPE).communicate()[0]
  File "G:\Inttel-slave\win-emcc-incoming-tests\build\tools\shared.py", line 31, in __init__
    self.process = subprocess.Popen(args, bufsize, executable, self.stdin_, self.stdout_, self.stderr_, preexec_fn, close_fds, shell, cwd, env, universal_newlines, startupinfo, creationflags)
  File "C:\Python27\lib\subprocess.py", line 679, in __init__
    errread, errwrite)
  File "C:\Python27\lib\subprocess.py", line 896, in _execute_child
    startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

======================================================================
ERROR: test_fannkuch (__main__.benchmark)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/runner.py", line 10124, in test_fannkuch
    self.do_benchmark('fannkuch', src, ['10'], 'Pfannkuchen(10) = 38.')
  File "tests/runner.py", line 9976, in do_benchmark
    self.run_native(filename, args)
  File "tests/runner.py", line 285, in run_native
    Popen([filename+'.native'] + args, stdout=PIPE).communicate()[0]
  File "G:\Inttel-slave\win-emcc-incoming-tests\build\tools\shared.py", line 31, in __init__
    self.process = subprocess.Popen(args, bufsize, executable, self.stdin_, self.stdout_, self.stderr_, preexec_fn, close_fds, shell, cwd, env, universal_newlines, startupinfo, creationflags)
  File "C:\Python27\lib\subprocess.py", line 679, in __init__
    errread, errwrite)
  File "C:\Python27\lib\subprocess.py", line 896, in _execute_child
    startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

======================================================================
ERROR: test_fasta_float (__main__.benchmark)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/runner.py", line 10154, in test_fasta_float
    self.fasta('float')
  File "tests/runner.py", line 10151, in fasta
    self.do_benchmark('fasta', src, ['2100000'], '''GGCCGGGCGCGGTGGCTCACGCCTGTAATCCCAGCACTTTGGGAGGCCGAGGCGGGCGGA\nTCACCTGAGGTCAGGAGTTCGAGACCAGCCTGGCCAACATGGTGAAACCCCGTCTCTACT\nAAAAATACAAAAATTAGCCGGGCGTGGTGGCGCGCGCCTGTAATCCCAGCTACTCGGGAG\nGCTGAGGCAGGAGAATCGCTTGAACCCGGGAGGCGGAGGTTGCAGTGAGCCGAGATCGCG\nCCACTGCACTCCAGCCTGGGCGACAGAGCGAGACTCCGTCTCAAAAAGGCCGGGCGCGGT\nGGCTCACGCCTGTAATCCCAGCACTTTGGGAGGCCGAGGCGGGCGGATCACCTGAGGTCA\nGGAGTTCGAGACCAGCCTGGCCAACATGGTGAAACCCCGTCTCTACTAAAAATACAAAAA\nTTAGCCGGGCGTGGTGGCGCGCGCCTGTAATCCCAGCTACTCGGGAGGCTGAGGCAGGAG\nAATCGCTTGAACCCGGGAGGCGGAGGTTGCAGTGAGCCGAGATCGCGCCACTGCACTCCA\nGCCTGGGCGA''')
  File "tests/runner.py", line 9976, in do_benchmark
    self.run_native(filename, args)
  File "tests/runner.py", line 285, in run_native
    Popen([filename+'.native'] + args, stdout=PIPE).communicate()[0]
  File "G:\Inttel-slave\win-emcc-incoming-tests\build\tools\shared.py", line 31, in __init__
    self.process = subprocess.Popen(args, bufsize, executable, self.stdin_, self.stdout_, self.stderr_, preexec_fn, close_fds, shell, cwd, env, universal_newlines, startupinfo, creationflags)
  File "C:\Python27\lib\subprocess.py", line 679, in __init__
    errread, errwrite)
  File "C:\Python27\lib\subprocess.py", line 896, in _execute_child
    startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

======================================================================
ERROR: test_memops (__main__.benchmark)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/runner.py", line 10034, in test_memops
    self.do_benchmark('memops', src, [], 'final: 720.')
  File "tests/runner.py", line 9976, in do_benchmark
    self.run_native(filename, args)
  File "tests/runner.py", line 285, in run_native
    Popen([filename+'.native'] + args, stdout=PIPE).communicate()[0]
  File "G:\Inttel-slave\win-emcc-incoming-tests\build\tools\shared.py", line 31, in __init__
    self.process = subprocess.Popen(args, bufsize, executable, self.stdin_, self.stdout_, self.stderr_, preexec_fn, close_fds, shell, cwd, env, universal_newlines, startupinfo, creationflags)
  File "C:\Python27\lib\subprocess.py", line 679, in __init__
    errread, errwrite)
  File "C:\Python27\lib\subprocess.py", line 896, in _execute_child
    startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

======================================================================
ERROR: test_primes (__main__.benchmark)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/runner.py", line 10011, in test_primes
    self.do_benchmark('primes', src, [], 'lastprime: 1297001.')
  File "tests/runner.py", line 9976, in do_benchmark
    self.run_native(filename, args)
  File "tests/runner.py", line 285, in run_native
    Popen([filename+'.native'] + args, stdout=PIPE).communicate()[0]
  File "G:\Inttel-slave\win-emcc-incoming-tests\build\tools\shared.py", line 31, in __init__
    self.process = subprocess.Popen(args, bufsize, executable, self.stdin_, self.stdout_, self.stderr_, preexec_fn, close_fds, shell, cwd, env, universal_newlines, startupinfo, creationflags)
  File "C:\Python27\lib\subprocess.py", line 679, in __init__
    errread, errwrite)
  File "C:\Python27\lib\subprocess.py", line 896, in _execute_child
    startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

======================================================================
ERROR: test_skinning (__main__.benchmark)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/runner.py", line 10161, in test_skinning
    self.do_benchmark('skinning', src, ['10000', '1000'], 'blah=0.000000')
  File "tests/runner.py", line 9976, in do_benchmark
    self.run_native(filename, args)
  File "tests/runner.py", line 285, in run_native
    Popen([filename+'.native'] + args, stdout=PIPE).communicate()[0]
  File "G:\Inttel-slave\win-emcc-incoming-tests\build\tools\shared.py", line 31, in __init__
    self.process = subprocess.Popen(args, bufsize, executable, self.stdin_, self.stdout_, self.stderr_, preexec_fn, close_fds, shell, cwd, env, universal_newlines, startupinfo, creationflags)
  File "C:\Python27\lib\subprocess.py", line 679, in __init__
    errread, errwrite)
  File "C:\Python27\lib\subprocess.py", line 896, in _execute_child
    startupinfo)
WindowsError: [Error 2] The system cannot find the file specified

----------------------------------------------------------------------
Ran 8 tests in 425.993s

FAILED (errors=8)

[juj]

Poking around this problem and I found the following:

a) Cygwin may not be in PATH. If it is, then running any test fails with something like

"C:/Cygwin/bin/link.exe" "-out:c:/temp\emscripten_temp\copy.cpp.native.exe" -defaultlib:libcmt -nologo C:/Users/clb/AppData/Local/Temp/copy-468025.o link: unknown option -- o
Try `/usr/bin/link --help' for more information.
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

After removing Cygwin from PATH, the failure message turns to

"link.exe" "-out:c:/temp\emscripten_temp\copy.cpp.native.exe" -defaultlib:libcmt -nologo C:/Users/clb/AppData/Local/Temp/copy-787633.o
clang++: error: unable to execute command: program not executable
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

which indicates that clang is trying to invoke the Visual C++ linker which it can't find. This can be solved by running the tests from VS2010 command prompt (and killing cygwin from PATH). After that, several of the tests succeed.

The tests benchmark.test_dlmalloc, benchmark.test_fasta_float and benchmark.test_skinning will still fail. Investigating the reason for those..

[stale]

This issue has been automatically marked as stale because there has been no activity in the past 2 years. It will be closed automatically if no further activity occurs in the next 7 days. Feel free to re-open at any time if this issue is still relevant.