Can't run scalene

[dedomenico]

Hi,

I have attempted to use scalene but without success. Here you can see the output that I get when running scalene over testme.py

Could you indicate me what I am doing wrong?

Thanks

[emeryberger]

This issue should now be fixed; please re-install from the repository (python3 -m pip install git+https://github.com/plasma-umass/scalene) and try again. Let us know what happens!

[dedomenico]

Hi,

reinstalling scalene and then running testme.py, I have the code succesfully running but at the end it prints:

Scalene: Program did not run for long enough to profile.

[emeryberger]

Can you provide your command line, and maybe upload the profile.json file? Thanks!

[dedomenico]

When attempting to run scalene on testme, I use
python -m scalene lsn-model-yellow/Model/testme.py

I got an error as it cannot import numpy (shown below) and the profile.json is not generated. I can solve if I import numpy from the prompt before to run the above line

Error in program being profiled:
No module named 'numpy.lib.type_check'
Traceback (most recent call last):
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\scalene\scalene_profiler.py", line 1785, in profile_code
exec(code, the_globals, the_locals)
File "lsn-model-yellow/Model/test.py", line 1, in
import numpy as np
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\numpy_init_.py", line 169, in
from . import lib
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\numpy\lib_init_.py", line 21, in
from . import scimath as emath
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\numpy\lib\scimath.py", line 38, in
from numpy.lib.type_check import isreal
ModuleNotFoundError: No module named 'numpy.lib.type_check'
Scalene: Program did not run for long enough to profile.

---

If a try scalene on a personal script, I see this:

Error in program being profiled:
Unable to import required dependencies:
numpy: No module named 'numpy.polynomial.chebyshev'
Traceback (most recent call last):
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\scalene\scalene_profiler.py", line 1785, in profile_code
exec(code, the_globals, the_locals)
File "lsn-model-yellow/Model/data_process_ABM.py", line 10, in
import pandas as pd
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\pandas_init_.py", line 16, in
raise ImportError(
ImportError: Unable to import required dependencies:
numpy: No module named 'numpy.polynomial.chebyshev'
Scalene: Program did not run for long enough to profile.

After import the above module, I still have further error:

Error in program being profiled:
[WinError 123] The filename, directory name, or volume label syntax is incorrect: ''
Traceback (most recent call last):
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\scalene\scalene_profiler.py", line 1785, in profile_code
exec(code, the_globals, the_locals)
File "lsn-model-yellow/Model/data_process_ABM.py", line 10, in
import pandas as pd
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\pandas_init_.py", line 11, in
import(dependency)
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\numpy_init.py", line 169, in
from . import lib
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\numpy\lib_init_.py", line 39, in
from .arraypad import *
File "", line 991, in _find_and_load
File "", line 975, in _find_and_load_unlocked
File "", line 657, in _load_unlocked
File "", line 562, in module_from_spec
File "", line 541, in _init_module_attrs
File "", line 382, in cached
File "", line 487, in _get_cached
File "", line 422, in cache_from_source
File "", line 99, in _path_join
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\scalene\scalene_profiler.py", line 856, in cpu_signal_handler
Scalene.compute_frames_to_record(),
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\scalene\scalene_profiler.py", line 1186, in compute_frames_to_record
while not Scalene.should_trace(fname):
File "C:\Users\a00555641.conda\envs\testscalene\lib\site-packages\scalene\scalene_profiler.py", line 1556, in should_trace
resolved_filename = str(pathlib.Path(filename).resolve()).lower()
File "C:\Users\a00555641.conda\envs\testscalene\lib\pathlib.py", line 1181, in resolve
s = self._flavour.resolve(self, strict=strict)
File "C:\Users\a00555641.conda\envs\testscalene\lib\pathlib.py", line 206, in resolve
s = self._ext_to_normal(_getfinalpathname(s))
OSError: [WinError 123] The filename, directory name, or volume label syntax is incorrect: ''
Scalene: Program did not run for long enough to profile.

[emeryberger]

If you can possibly provide a sample script, that would really be helpful. I can't reproduce the behavior you are seeing right now. Barring that - we did just push a fix for a path-related issue on Windows that may be related; please try to install the latest repo version again. Thanks.

[dedomenico]

Unfortunately, updating scalene still did not produce the expected results.
I am just running scalene over testme.py available in your directory, after adding 'from scalene import scalene_profiler' 'scalene_profiler.start()' and 'scalene_profiler.stop()' see below:

import numpy as np
#import math

from numpy import linalg as LA

arr = [i for i in range(1,1000)]

def doit1(x):
#x = [ii for i in range(1,1000)][0]
y = 1
#w, v = LA.eig(np.diag(arr)) # (1, 2, 3, 4, 5, 6, 7, 8, 9, 10)))
x = [ii for i in range(0,100000)][99999]
y1 = [i*i for i in range(0,200000)][199999]
z1 = [i for i in range(0,300000)][299999]
z = x * y
#z = np.multiply(x, y)
return z

def doit2(x):
i = 0
#zarr = [math.cos(13) for i in range(1,100000)]
#z = zarr[0]
z = 0.1
while i < 100000:
#z = math.cos(13)
#z = np.multiply(x,x)
#z = np.multiply(z,z)
#z = np.multiply(z,z)
z = z * z
z = x * x
z = z * z
z = z * z
i += 1
return z

def doit3(x):
z = x + 1
z = x + 1
z = x + 1
z = x + z
z = x + z
#z = np.cos(x)
return z

def stuff():
# Turn profiling on
scalene_profiler.start()
y = np.random.randint(1, 100, size=5000000)[4999999]
x = 1.01
for i in range(1,10):
print(i)
for j in range(1,10):
x = doit1(x)
x = doit2(x)
x = doit3(x)
x = 1.01
# Turn profiling off
scalene_profiler.stop()
return x

import sys

from scalene import scalene_profiler

print("TESTME")
print(sys.argv)
stuff()

[emeryberger]

Note that you do not need to modify your code to use Scalene - you should in fact not include those "turn profiler on and off" statements.