bigjob bootstrap fails on india

[marksantcroos]

See the output of stderr below.
Although python 2.7 is loaded from modules as can also be seen in the log, the error about syntax seems to point to an older version of python ...

torque/2.5.5 version 2.5.5 loaded
Python version 2.7 loaded
Traceback (most recent call last):
File "/N/u/marksant/.bigjob/bigjob-bootstrap.py", line 2323, in
main()
File "/N/u/marksant/.bigjob/bigjob-bootstrap.py", line 823, in main
symlink=options.symlink)
File "/N/u/marksant/.bigjob/bigjob-bootstrap.py", line 965, in create_environment
install_sdist('Pip', 'pip-*.tar.gz', py_executable, search_dirs)
File "/N/u/marksant/.bigjob/bigjob-bootstrap.py", line 934, in install_sdist
filter_stdout=filter_install_output)
File "/N/u/marksant/.bigjob/bigjob-bootstrap.py", line 901, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command /N/u/marksant/.bigjob/python/bin/python setup.py install --single-version-externally-managed --record record failed with error code 1
'import site' failed; use -v for traceback
File "/N/u/marksant/.bigjob/bigjob-bootstrap.py", line 1510
cp_or_ln = (os.symlink if symlink else copyfile)
^
SyntaxError: invalid syntax
Traceback (most recent call last):
File "", line 45, in
IOError: [Errno 2] No such file or directory: '/N/u/marksant/.bigjob/python/bin/activate_this.py'

[andre-merzky]

FWIW, Matteo sees the same.

[marksantcroos]

After the fix I get the following error in the agent log:

Python version 2.7 loaded
error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the
installation directory:

[Errno 13] Permission denied: '/N/soft/python/2.7/lib/python2.7/site-packages/test-easy-install-19556.write-test'

The installation directory you specified (via --install-dir, --prefix, or
the distutils default setting) was:

/N/soft/python/2.7/lib/python2.7/site-packages/

Perhaps your account does not have write access to this directory? If the
installation directory is a system-owned directory, you may need to sign in
as the administrator or "root" account. If you do not have administrative
access to this machine, you may wish to choose a different installation
directory, preferably one that is listed in your PYTHONPATH environment
variable.

For information on other options, you may wish to consult the
documentation at:

http://peak.telecommunity.com/EasyInstall.html

Please make the appropriate changes for your system and try again.

Traceback (most recent call last):
File "", line 59, in
NameError: name 'bigjob' is not defined

[marksantcroos]

I can work around this one by setting
"source $HOME/.bigjob/python/bin/activate"
in my .bashrc, but that’s probably not what we want.

On 25 Jan 2014, at 23:51 , Mark Santcroos mark.santcroos@rutgers.edu wrote:

After the fix I get the following error in the agent log:

Python version 2.7 loaded
error: can't create or remove files in install directory

The following error occurred while trying to add or remove files in the
installation directory:

[Errno 13] Permission denied: '/N/soft/python/2.7/lib/python2.7/site-packages/test-easy-install-19556.write-test'

The installation directory you specified (via --install-dir, --prefix, or
the distutils default setting) was:

/N/soft/python/2.7/lib/python2.7/site-packages/

Perhaps your account does not have write access to this directory? If the
installation directory is a system-owned directory, you may need to sign in
as the administrator or "root" account. If you do not have administrative
access to this machine, you may wish to choose a different installation
directory, preferably one that is listed in your PYTHONPATH environment
variable.

For information on other options, you may wish to consult the
documentation at:

http://peak.telecommunity.com/EasyInstall.html

Please make the appropriate changes for your system and try again.

Traceback (most recent call last):
File "", line 59, in
NameError: name 'bigjob' is not defined

[anjaniragothaman]

I'm seeing an issue:

[ethread@ip-10-9-147-80 ~]$ cat stderr-bj-7afcbd94-86c5-11e3-9c59-080027261dbf-agent.txt
Traceback (most recent call last):
File "/home/ethread/.bigjob/bigjob-bootstrap.py", line 2337, in
ret = subprocess.call(["virtualenv", "--version"])
File "/usr/lib64/python2.6/subprocess.py", line 478, in call
p = Popen(_popenargs, *_kwargs)
File "/usr/lib64/python2.6/subprocess.py", line 642, in init
errread, errwrite)
File "/usr/lib64/python2.6/subprocess.py", line 1234, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
Traceback (most recent call last):
File "/home/ethread/.bigjob/bigjob-bootstrap.py", line 2337, in
ret = subprocess.call(["virtualenv", "--version"])
File "/usr/lib64/python2.6/subprocess.py", line 478, in call
p = Popen(_popenargs, *_kwargs)
File "/usr/lib64/python2.6/subprocess.py", line 642, in init
errread, errwrite)
File "/usr/lib64/python2.6/subprocess.py", line 1234, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
Traceback (most recent call last):
File "", line 45, in
IOError: [Errno 2] No such file or directory: '/home/ethread/.bigjob/python/bin/activate_this.py'

Do I need to reinstall BJ to avoid this issue? Currently I'm running version 0.53

[anjaniragothaman]

Hi Mark,

I got it resolved with AndreL's help yesterday. I was following it up on
the "[bigjob-devel] issue 169 installation failure" mail thread started by
you!

Thanks
Anjani

On 27 January 2014 16:55, Mark Santcroos notifications@github.com wrote:

Reopened #169 #169.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/169
.

Thanks and Regards,
Anjani Bhargavi.R
If u have the willpower to do things nothing will be against u.

[marksantcroos]

Hi,

I’m reopening because of the env variable.

Gr,

Mark

On 27 Jan 2014, at 17:04 , anjaniragothaman notifications@github.com wrote:

Hi Mark,

I got it resolved with AndreL's help yesterday. I was following it up on
the "[bigjob-devel] issue 169 installation failure" mail thread started by
you!

Thanks
Anjani

On 27 January 2014 16:55, Mark Santcroos notifications@github.com wrote:

Reopened #169 #169.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/169
.

Thanks and Regards,
Anjani Bhargavi.R
If u have the willpower to do things nothing will be against u.
—
Reply to this email directly or view it on GitHub.

[anjaniragothaman]

Oh OK.

Thanks
Anjani

On 27 January 2014 17:05, Mark Santcroos notifications@github.com wrote:

Hi,

I’m reopening because of the env variable.

Gr,

Mark

On 27 Jan 2014, at 17:04 , anjaniragothaman notifications@github.com
wrote:

Hi Mark,

I got it resolved with AndreL's help yesterday. I was following it up on
the "[bigjob-devel] issue 169 installation failure" mail thread started
by
you!

Thanks
Anjani

On 27 January 2014 16:55, Mark Santcroos notifications@github.com
wrote:

Reopened #169 #169.

—
Reply to this email directly or view it on GitHub<
https://github.com/saga-project/BigJob/issues/169>
.

Thanks and Regards,
Anjani Bhargavi.R
If u have the willpower to do things nothing will be against u.
—
Reply to this email directly or view it on GitHub.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/169#issuecomment-33428668
.

Thanks and Regards,
Anjani Bhargavi.R
If u have the willpower to do things nothing will be against u.

[andre-merzky]

re Mark:

I can work around this one by setting
"source $HOME/.bigjob/python/bin/activate"
in my .bashrc, but that’s probably not what we want.

I used to do that, for other reasons, but in that case both bigjob and sinon agents can't run any tasks anymore (they then complain about an ssh key error, of all things). So that is indeed not a viable option...