Upload hang at 100% #346

silvioto · 2017-05-17T11:59:06Z

I have a script that upload my files with FTPS. It work well with small files, but on 70mb the transfer end with a message "100% - Waiting for transfer to complete". The file is entirely uploaded but connection stay open and go in timeout forever, and the script don't execute the following command.

I tryed to read manual but I don't have idea which options should I use to solve.
Thanks for your help.

I'm using Debian Jessie package of lftp v. 4.6.0-1+deb8u1.

loglftp.txt
toftps.txt

nausicaea · 2018-09-17T14:41:22Z

I'm frequently running into a similar, if not the same error. The transfer of a particular file succeeds (100% transfer status and the file is verifyably complete), but the server closes the connection to lftp and lftp hangs itself up in a reconnect loop.

jifang · 2019-04-26T18:19:43Z

+1

lavv17 · 2019-04-28T11:09:27Z

Please include debug logs. пт, 26 апр. 2019, 21:19 Ji Fang <notifications@github.com>:

…

+1 — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#346 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAHLWXDBSTEXMGS3PSW532TPSNBT7ANCNFSM4DLXBJLQ> .

aweidler · 2020-04-15T20:41:53Z

+1

nausicaea · 2020-04-16T05:53:17Z

I stopped having the reconnect loop, but I still get connection terminations (but that is now client independent). For that, luckily, I managed to use the --loop flag with success.

mweichert · 2020-11-19T15:14:25Z

+1

ThirtySix361 · 2021-05-09T14:11:04Z

+1

tome9111991 · 2021-06-13T13:40:16Z

I have same with version 4.8.4 or wirth 4.9.2

Is only happens i have force use TLS on my firtzbox.

Without TLS i have no issue

tome9111991 · 2021-11-13T19:17:17Z

@lavv17
Issue still with latest source code.
Mybe issue with ftpes ?

---- using user `ftpuser' and password from ~/.netrc
---- Löse Hostadresse auf...
---- 1  Adresse gefunden: xx.xxx.xx.xxx
---- Verbinde mit my dyndns.de (xx.xxx.xx.xxx) Port 669
---> FEAT
<--- 220 FRITZ!Box7560(UI) FTP server ready.
<--- 211- Extensions supported:
<---  UTF8
<---  MDTM
<---  SIZE
<---  AUTH TLS
<---  PBSZ
<---  PROT
<--- 211 end
---> AUTH TLS
<--- 234 Authentication method accepted
---> OPTS UTF8 ON
---> USER ftpuser
Certificate depth: 0; subject: /CN=my dyndns.de; issuer: /CN=my dyndns.de
Certificate verification: subjectAltName: »my dyndns.de« matched
<--- 530 Please login with USER and PASS.
<--- 331 Password required for ftpuser.
---> PASS XXXX
---> OPTS UTF8 ON
---> PWD
---> PBSZ 0
---> PROT P
<--- 230 User ftpuser logged in.
<--- 200 UTF8 ON
<--- 257 "/" is current directory.
<--- 200 ok
<--- 200 Data channel will be secured
---> TYPE I
---> PORT 62,171,163,52,197,25
---> STOR config_files_2021-09-22.tar.gz
<--- 200 Type set to I.
---- Datenverbindung von (xx.xxx.xx.xxx) Port 38751 akzeptiert
<--- 200 PORT command sucessful.
<--- 150 Opening BINARY mode data connection for 'config_files_2021-09-22.tar.gz'.
Certificate verification: subjectAltName: »my dyndns.de« matched
---- Schließe den Daten Socket
<--- 426 Data Connection: Connection reset by peer.
---> QUIT
---- Schließe den Kontroll - Socket
---- Verbinde mit my dyndns.de (xx.xxx.xx.xxx) Port 669
---> FEAT
<--- 220 FRITZ!Box7560(UI) FTP server ready.
<--- 211- Extensions supported:
<---  UTF8
<---  MDTM
<---  SIZE
<---  AUTH TLS
<---  PBSZ
<---  PROT
<--- 211 end
---> AUTH TLS
<--- 234 Authentication method accepted
---> OPTS UTF8 ON
---> USER ftpuser
Certificate verification: subjectAltName: »my dyndns.de« matched
<--- 530 Please login with USER and PASS.
<--- 331 Password required for ftpuser.
---> PASS XXXX
---> OPTS UTF8 ON
---> PBSZ 0
---> PROT P
<--- 230 User ftpuser logged in.
<--- 200 UTF8 ON
<--- 200 ok
<--- 200 Data channel will be secured
---> TYPE I
---> SIZE config_files_2021-09-22.tar.gz
<--- 200 Type set to I.
<--- 213 81920
---> PORT 62,171,163,52,234,235
---> REST 81920
---> STOR config_files_2021-09-22.tar.gz
copy: put kehrte zu 81920 zurück, suche entsprechendes get
<--- 200 PORT command sucessful.
---- Datenverbindung von (xx.xxx.xx.xxx) Port 44871 akzeptiert
<--- 350 Restarting at 81920. Send STORE or RETRIEVE to initiate transfer.
<--- 150 Opening BINARY mode data connection for 'config_files_2021-09-22.tar.gz'.
Certificate verification: subjectAltName: »my dyndns.de« matched
---- Schließe den Daten Socket
<--- 426 Data Connection: Connection reset by peer.
---> QUIT
---- Schließe den Kontroll - Socket
---- Verbinde mit my dyndns.de (xx.xxx.xx.xxx) Port 669
---> FEAT
<--- 220 FRITZ!Box7560(UI) FTP server ready.
<--- 211- Extensions supported:
<---  UTF8
<---  MDTM
<---  SIZE
<---  AUTH TLS
<---  PBSZ
<---  PROT
<--- 211 end
---> AUTH TLS
<--- 234 Authentication method accepted
---> OPTS UTF8 ON
---> USER ftpuser
Certificate verification: subjectAltName: »my dyndns.de« matched
<--- 530 Please login with USER and PASS.
<--- 331 Password required for ftpuser.
---> PASS XXXX
---> OPTS UTF8 ON
---> PBSZ 0
---> PROT P
<--- 230 User ftpuser logged in.
<--- 200 UTF8 ON
<--- 200 ok
<--- 200 Data channel will be secured
---> TYPE I
---> SIZE config_files_2021-09-22.tar.gz
<--- 200 Type set to I.
<--- 213 131072
---> PORT 62,171,163,52,198,101
---> REST 131072
---> STOR config_files_2021-09-22.tar.gz
copy: put kehrte zu 131072 zurück, suche entsprechendes get
<--- 200 PORT command sucessful.
---- Datenverbindung von (xx.xxx.xx.xxx) Port 39489 akzeptiert
<--- 350 Restarting at 131072. Send STORE or RETRIEVE to initiate transfer.
<--- 150 Opening BINARY mode data connection for 'config_files_2021-09-22.tar.gz'.
Certificate verification: subjectAltName: »my dyndns.de« matched
---- Schließe den Daten Socket
<--- 426 Data Connection: Connection reset by peer.
---> QUIT
---- Schließe den Kontroll - Socket
---- Verbinde mit my dyndns.de (xx.xxx.xx.xxx) Port 669
---> FEAT
<--- 220 FRITZ!Box7560(UI) FTP server ready.
<--- 211- Extensions supported:
<---  UTF8
<---  MDTM
<---  SIZE
<---  AUTH TLS
<---  PBSZ
<---  PROT
<--- 211 end
---> AUTH TLS
<--- 234 Authentication method accepted
---> OPTS UTF8 ON
---> USER ftpuser
Certificate verification: subjectAltName: »my dyndns.de« matched
<--- 530 Please login with USER and PASS.
<--- 331 Password required for ftpuser.
---> PASS XXXX
---> OPTS UTF8 ON
---> PBSZ 0
---> PROT P
<--- 230 User ftpuser logged in.
<--- 200 UTF8 ON
<--- 200 ok
<--- 200 Data channel will be secured
---> TYPE I
---> SIZE config_files_2021-09-22.tar.gz
<--- 200 Type set to I.
<--- 213 196608
---> PORT 62,171,163,52,221,77
---> REST 196608
---> STOR config_files_2021-09-22.tar.gz
copy: put kehrte zu 196608 zurück, suche entsprechendes get
<--- 200 PORT command sucessful.
---- Datenverbindung von (xx.xxx.xx.xxx) Port 33745 akzeptiert
<--- 350 Restarting at 196608. Send STORE or RETRIEVE to initiate transfer.
<--- 150 Opening BINARY mode data connection for 'config_files_2021-09-22.tar.gz'.
Certificate verification: subjectAltName: »my dyndns.de« matched
---- Schließe den Daten Socket
<--- 426 Data Connection: Connection reset by peer.
---> QUIT
---- Schließe den Kontroll - Socket
---- Verbinde mit my dyndns.de (xx.xxx.xx.xxx) Port 669
---> FEAT
<--- 220 FRITZ!Box7560(UI) FTP server ready.
<--- 211- Extensions supported:
<---  UTF8
<---  MDTM
<---  SIZE
<---  AUTH TLS
<---  PBSZ
<---  PROT
<--- 211 end
---> AUTH TLS
<--- 234 Authentication method accepted
---> OPTS UTF8 ON
---> USER ftpuser
Certificate verification: subjectAltName: »my dyndns.de« matched
<--- 530 Please login with USER and PASS.
<--- 331 Password required for ftpuser.
---> PASS XXXX
---> OPTS UTF8 ON
---> PBSZ 0
---> PROT P
<--- 230 User ftpuser logged in.
<--- 200 UTF8 ON
<--- 200 ok
<--- 200 Data channel will be secured
---> TYPE I
---> SIZE config_files_2021-09-22.tar.gz
<--- 200 Type set to I.
<--- 213 245760
---> PORT 62,171,163,52,154,59
---> REST 245760
---> STOR config_files_2021-09-22.tar.gz
copy: put kehrte zu 245760 zurück, suche entsprechendes get
<--- 200 PORT command sucessful.
---- Datenverbindung von (xx.xxx.xx.xxx) Port 33743 akzeptiert
<--- 350 Restarting at 245760. Send STORE or RETRIEVE to initiate transfer.
<--- 150 Opening BINARY mode data connection for 'config_files_2021-09-22.tar.gz'.
Certificate verification: subjectAltName: »my dyndns.de« matched
---- Schließe den Daten Socket
<--- 426 Data Connection: Connection reset by peer.
---> QUIT
---- Schließe den Kontroll - Socket
---- Verbinde mit my dyndns.de (xx.xxx.xx.xxx) Port 669
---> FEAT
<--- 220 FRITZ!Box7560(UI) FTP server ready.
<--- 211- Extensions supported:
<---  UTF8
<---  MDTM
<---  SIZE
<---  AUTH TLS
<---  PBSZ
<---  PROT
<--- 211 end
---> AUTH TLS
<--- 234 Authentication method accepted
---> OPTS UTF8 ON
---> USER ftpuser
Certificate verification: subjectAltName: »my dyndns.de« matched
<--- 530 Please login with USER and PASS.
<--- 331 Password required for ftpuser.
---> PASS XXXX
---> OPTS UTF8 ON
---> PBSZ 0
---> PROT P
<--- 230 User ftpuser logged in.
<--- 200 UTF8 ON
<--- 200 ok
<--- 200 Data channel will be secured
---> TYPE I
---> SIZE config_files_2021-09-22.tar.gz
<--- 200 Type set to I.
<--- 213 262144
---> PORT 62,171,163,52,147,221
---> REST 262144
---> STOR config_files_2021-09-22.tar.gz
copy: put kehrte zu 262144 zurück, suche entsprechendes get
<--- 200 PORT command sucessful.
---- Datenverbindung von (xx.xxx.xx.xxx) Port 38237 akzeptiert
<--- 350 Restarting at 262144. Send STORE or RETRIEVE to initiate transfer.
<--- 150 Opening BINARY mode data connection for 'config_files_2021-09-22.tar.gz'.
Certificate verification: subjectAltName: »my dyndns.de« matched
---- Schließe den Daten Socket
<--- 426 Data Connection: Connection reset by peer.
---> QUIT
---- Schließe den Kontroll - Socket
---- Verbinde mit my dyndns.de (xx.xxx.xx.xxx) Port 669
---> FEAT
<--- 220 FRITZ!Box7560(UI) FTP server ready.
<--- 211- Extensions supported:
<---  UTF8
<---  MDTM
<---  SIZE
<---  AUTH TLS
<---  PBSZ
<---  PROT
<--- 211 end
---> AUTH TLS
<--- 234 Authentication method accepted
---> OPTS UTF8 ON
---> USER ftpuser
Certificate verification: subjectAltName: »my dyndns.de« matched
<--- 530 Please login with USER and PASS.
<--- 331 Password required for ftpuser.
---> PASS XXXX
---> OPTS UTF8 ON
---> PBSZ 0
---> PROT P
<--- 230 User ftpuser logged in.
<--- 200 UTF8 ON
<--- 200 ok
<--- 200 Data channel will be secured
---> TYPE I
---> SIZE config_files_2021-09-22.tar.gz
<--- 200 Type set to I.
<--- 213 294912
---> PORT 62,171,163,52,195,247
---> REST 294912
---> STOR config_files_2021-09-22.tar.gz
copy: put kehrte zu 294912 zurück, suche entsprechendes get
<--- 200 PORT command sucessful.
---- Datenverbindung von (xx.xxx.xx.xxx) Port 35583 akzeptiert
<--- 350 Restarting at 294912. Send STORE or RETRIEVE to initiate transfer.
<--- 150 Opening BINARY mode data connection for 'config_files_2021-09-22.tar.gz'.
Certificate verification: subjectAltName: »my dyndns.de« matched
---- Schließe den Daten Socket
<--- 426 Data Connection: Connection reset by peer.
---> QUIT
---- Schließe den Kontroll - Socket

With lftp 4.8.4 i got
gnutls_record_recv: Die TLS-Verbindung wurde nicht ordentlich beendet. Assuming EOF.

gnh1201 · 2022-01-20T06:50:05Z

I came here because of this problem, too. I don't use SSL/TLS.

=> Oh, sorry. It works, but it takes a long time.

MJGTwo · 2022-05-19T21:06:07Z

when i experienced this, it turned out to be a false negative because of how i was using the command. in my case, i told it a file existed (when it didn't) for a parallelized mput command.

i setup a script to transfer a, b, and c from my local computer to example. turns out b wasn't there. lftp notifies me on launch that it couldn't find b, but then continued to upload a and c. once it was done, it stated waiting for transfer to complete at 100% for awhile and then sent a non-zero error code. i checked example and sure enough, a and c were complete.

my solution was to find the circumstances when b wasn't present and modified the script. no error now.

simon-amadeus · 2023-02-17T13:46:07Z

+1 lftp version 4.9.2

Does not work:

lftp -c " \
    set ftp:ssl-allow true; \
    set ftp:ssl-force true; \
    set ftp:ssl-protect-data true; \
    open -u <username> -e \" \
        mirror -X .* -X .*/ --reverse --verbose --delete source_dir/ target_dir/; \
        bye\" \
    remote_host \
"

Does work:

lftp -c " \
    set ftp:ssl-allow false; \
    open -u <username> -e \" \
        mirror -X .* -X .*/ --reverse --verbose --delete source_dir/ target_dir/; \
        bye\" \
    remote_host \
"

Although this gives me a workaround, I do not consider it a solution in any sense -.-

sjuk · 2024-06-16T14:27:22Z

I can confirm this problem. LFTP seems to have been abandoned. I wonder if someone can fix this problem one day.

ThirtySix361 · 2024-08-22T06:00:03Z

same issue here.
set ftp:ssl-protect-data true;
causes endless reconnection loops.

but only on large files
for about 10KiB it does work fine.

only small workaround could be to set

set net:reconnect-interval-base 1; 
set net:max-retries 1;

but this is not nice at all.

silvioto changed the title ~~Transfer hang at 100%~~ Upload hang at 100% May 17, 2017

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Upload hang at 100% #346

Upload hang at 100% #346

silvioto commented May 17, 2017 •

edited

Loading

nausicaea commented Sep 17, 2018

jifang commented Apr 26, 2019

lavv17 commented Apr 28, 2019 via email

aweidler commented Apr 15, 2020

nausicaea commented Apr 16, 2020

mweichert commented Nov 19, 2020

ThirtySix361 commented May 9, 2021

tome9111991 commented Jun 13, 2021

tome9111991 commented Nov 13, 2021 •

edited

Loading

gnh1201 commented Jan 20, 2022 •

edited

Loading

MJGTwo commented May 19, 2022

simon-amadeus commented Feb 17, 2023

sjuk commented Jun 16, 2024

ThirtySix361 commented Aug 22, 2024

Upload hang at 100% #346

Upload hang at 100% #346

Comments

silvioto commented May 17, 2017 • edited Loading

nausicaea commented Sep 17, 2018

jifang commented Apr 26, 2019

lavv17 commented Apr 28, 2019 via email

aweidler commented Apr 15, 2020

nausicaea commented Apr 16, 2020

mweichert commented Nov 19, 2020

ThirtySix361 commented May 9, 2021

tome9111991 commented Jun 13, 2021

tome9111991 commented Nov 13, 2021 • edited Loading

gnh1201 commented Jan 20, 2022 • edited Loading

MJGTwo commented May 19, 2022

simon-amadeus commented Feb 17, 2023

sjuk commented Jun 16, 2024

ThirtySix361 commented Aug 22, 2024

silvioto commented May 17, 2017 •

edited

Loading

tome9111991 commented Nov 13, 2021 •

edited

Loading

gnh1201 commented Jan 20, 2022 •

edited

Loading