Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove Develop branch #22

merged 22 commits into from Jan 21, 2019


Copy link

commented Jan 21, 2019

No description provided.

loerum and others added 17 commits Nov 17, 2017
…les on disk at startup/restart. This can be usefull to avoid a lot of old files published at startup
Introducing 'info' request
Added argument option disable-backlog
Add support for Python 3
Feature client unpack
Defaults to 30 seconds for configuring the connection persistence time

This comment has been minimized.

Copy link

commented on bf6c4f5 Nov 7, 2018

What does mkdfile do? I guess it should be some ftplib command, but I cant find it.

And, why do you want to quit the connection after the copy? I thought the idea was to keep the connection?
I guess it's some details I don't read out of the code.

This comment has been minimized.

Copy link
Member Author

replied Nov 7, 2018

Good point, that's a bug (the connection closing).
As for mkdfile, I'll have to look it up.

This comment has been minimized.

Copy link

replied Dec 5, 2018

@mraspaud what I'm testing is my implementation of the persistent connection with ssh. So of course my implementation can have issues

On Monday this week my trollmoves system broke down again. There I saw (or I think I saw) that the connection was lost outside trollmoves, but trollmoves still saw it as a valid connection. I will try to find back the logs. So this might be an issue.

[2018-12-04 11:40:41,882 DEBUG trollmoves.server] Copying to: scp://xvis-m3b/lustre/storeA/project/metproduction/products/satdata_polar/pps-v2014/ears/S_NWC_CT_m
[2018-12-04 11:40:41,882 DEBUG trollmoves.server] Getting connection to remotesensing@xvis-m3b:None
[2018-12-04 11:40:41,882 DEBUG trollmoves.server] checking ssh connection ... True
[2018-12-04 11:40:41,883 DEBUG paramiko.transport] [chan 3] Max packet in: 32768 bytes
[2018-12-04 11:40:41,884 DEBUG paramiko.transport] [chan 3] Max packet out: 32768 bytes
[2018-12-04 11:40:41,885 DEBUG paramiko.transport] Secsh channel 3 opened.
[2018-12-04 11:40:41,891 DEBUG paramiko.transport] [chan 3] EOF sent (3)
[2018-12-04 11:40:41,892 ERROR trollmoves.server] Something went wrong with scp: Channel closed.
[2018-12-04 11:40:41,892 ERROR trollmoves.server] Exception name SSHException
[2018-12-04 11:40:41,892 ERROR trollmoves.server] Exception args ('Channel closed.',)
[2018-12-04 11:40:41,892 ERROR trollmoves.server] Something went wrong during copy of /data/nwcsaf/pps-v2014-ears-out/NWC_data/ to scp://xvis-m3b/lustre/storeA/project/metproduction/products/satdata_polar/pps-v2014/ears/ Channel closed.
[2018-12-04 11:40:41,893 DEBUG trollmoves.server] File "/software/pytroll/lib/python2.7/site-packages/trollmoves-0.1.1-py2.7.egg/trollmoves/", line 579, in move_it
mover(pathname, dest_url, attrs=attrs).copy()
File "/software/pytroll/lib/python2.7/site-packages/trollmoves-0.1.1-py2.7.egg/trollmoves/", line 825, in copy
scp.put(self.origin, self.destination.path)
File "/software/pytroll/lib/python2.7/site-packages/scp-0.10.2-py2.7.egg/", line 145, in put
File "/software/pytroll/lib/python2.7/site-packages/paramiko-2.4.1-py2.7.egg/paramiko/", line 63, in _check
return func(self, *args, **kwds)
File "/software/pytroll/lib/python2.7/site-packages/paramiko-2.4.1-py2.7.egg/paramiko/", line 241, in exec_command
File "/software/pytroll/lib/python2.7/site-packages/paramiko-2.4.1-py2.7.egg/paramiko/", line 1198, in _wait_for_event
raise e

[2018-12-04 11:40:41,893 DEBUG trollmoves.server] Response: pytroll://PPS-v2014/EARS/EXPORT err polarsat@satproc4-a-G3KSDN2 2018-12-04T11:40:41.893261 v1.01 text/ascii Channel closed.

mraspaud added 5 commits Nov 7, 2018
Make ftp connections persistent for 30 seconds
persistent ssh/scp connection
Feature persistent connection
@mraspaud mraspaud merged commit 0997a18 into master Jan 21, 2019
@mraspaud mraspaud deleted the develop branch Jan 21, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
None yet
4 participants
You can’t perform that action at this time.