Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Command parsing broken by login message output #623

Open
robertsawko opened this issue Aug 28, 2018 · 1 comment
Open

Command parsing broken by login message output #623

robertsawko opened this issue Aug 28, 2018 · 1 comment

Comments

@robertsawko
Copy link

Hi,

Meanwhile we stumbled across another issue and I think this time it's definitely a (minor) problem of the current implementation.

Our clusters apart from MOTD produce messages from lmod. What we are seeing on the login is this

[MOTD content]
##########################################################################
	group: my_group_name 
	user: my_user_name
	project: my_project
	base path: my_base_path

	Thank you for using Xalt to monitor your applications

Unfortunately, because of this HPCCloud catches the output of these non MOTD output and raises all sorts of nasty exceptions. Here's an example:

cat /opt/hpccloud/cumulus/cumulus/tasks/job.py
...

output = conn.execute('pwd')
if len(output) < 1:
    raise Exception('Unable to fetch users home directory %s.' % output)

We have shrewdly expanded the exception message to see output and this is what we found:

Exception: Unable to fetch users home directory [u'/gpfs/fairthorpe/local/HCRI016/dre03/cxp90-dre03\n', u'\tgroup: dre03 \n', u'\tuser: cxp90-dre03 \n', u'\tproject: HCRI016 \n', u'\tbase path: /gpfs/panther/local/HCRI016/dre03/cxp90-dre03 \n', u'\tpath to CDS: /gpfs/cds/local/HCRI016/dre03/cxp90-dre03 \n', u'\tThank you for using Xalt to monitor your applications\n', u'\n', u'\tThank you for using Xalt to monitor your applications\n', u'\n', u'-------------------------------------------------------------------------------\n', u'There are messages associated with the following module(s):\n', u'-------------------------------------------------------------------------------\n', u'\n', u'use.panther:\n', u'   Modules for software available on Panther compute cluster. Default stack\n', u'   on this system is IBM XL with Spectrum MPI. We are experimenting with\n', u'   software monitoring using Xalt.\n', u'\n', u'-------------------------------------------------------------------------------\n', u'\n'].

So it seems to me that HPCCloud is assuming no output on the login. This would be my preference, but I think this is a minor inconvenience as sometimes users may want to have some hello message printed or as the case of one of our clusters an lmod message.

Please advise.

@robertsawko robertsawko changed the title Unable to fetch home directory due to lmod messages? Command parsing broken by login message output Aug 28, 2018
@cjh1
Copy link

cjh1 commented Aug 28, 2018

@robertsawko Yes, HPCCloud is assuming no output on the login. For system that produced output on login, it might be possible filter out this output. When are spinning up clusters in the cloud we have control over the login environment, so that is problem why we are making this assumption.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants