We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When the task fails due to issues like 'no such file' or 'file is empty', the sftp connection didn't release.
Task mode is yarn-session.
Connection is released.
{ "job": { "content": [ { "reader": { "parameter": { "path": "/root/tiezhu/test_two.csv", "protocol": "SFTP", "password": "Abc!@#135", "port": 22, "isFirstLineHeader": true, "host": "172.16.85.171", "column": [ { "name": "id", "type": "int" }, { "name": "name", "type": "string" } ], "fieldDelimiter": ",", "encoding": "utf-8", "fileType": "CSV", "username": "root" }, "name": "ftpreader" }, "writer": { "parameter": { "print": true }, "name": "streamwriter" } } ] } }
NONE
master
The text was updated successfully, but these errors were encountered:
same bug with local test mode.
{ "job": { "content": [ { "reader": { "parameter": { "password": "DT@Stack#123", "column": [ { "name": "id", "type": "INT" }, { "name": "result_val", "type": "VARCHAR" } ], "connection": [ { "schema": "flinkx_test", "jdbcUrl": [ "jdbc:mysql://172.16.100.186:3306/flinkx_test?useSSL=false" ], "table": [ "ftp_source" ] } ], "splitPk": "id", "username": "drpeco" }, "name": "mysqlreader" }, "writer": { "parameter": { "path": "/data/sftp/buffertest", "password": "dt@sz.com", "protocol": "SFTP", "port": "22", "host": "172.16.100.116", "column": [ { "name": "id", "type": "INT" }, { "name": "result_val", "type": "VARCHAR" } ], "writeMode": "append", "fieldDelimiter": ",", "ftpFileName": "xiaohe.txt", "username": "root" }, "name": "ftpwriter", "table": { "tableName": "sink" } } } ], "setting": { "speed": { "bytes": 0, "channel": 2 } } } }
Sorry, something went wrong.
[hotfix-DTStack#1210][ftp] Fix the issue that the connections of SFTP…
5fbb2bd
… are not released when task failed.
[hotfix-#1210][ftp] Fix the issue that the connections of SFTP are no…
bd9eb0d
…t released when task failed. (#1222)
Successfully merging a pull request may close this issue.
Search before asking
What happened
When the task fails due to issues like 'no such file' or 'file is empty', the sftp connection didn't release.
Task mode is yarn-session.
What you expected to happen
Connection is released.
How to reproduce
Anything else
NONE
Version
master
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: