We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
您好,一直在用您改造的datax,最近有个mongdbreader的问题困绕我,就是mongdb中文档有些字段可能不存在时,配置这个字段后进行读取数据,当读取到没有的字段行时,就提示源数据字段与目标字段数据不一致,请问可否在后续将这个问题解决!
The text was updated successfully, but these errors were encountered:
感谢反馈,可以考虑,针对没有字段的行,设置该字段的默认值为null
Sorry, something went wrong.
刚进过测试,当前master分支上的mongodbreader是指支持缺失字段读取为null的功能的。 以下我是的测试结果
2020-09-17 20:27:47.171 [0-0-0-reader] INFO connection - Opened connection [connectionId{localValue:5, serverValue:30}] to 127.0.0.1:32768 add_id auction_id new column content_type add_id auction_id new column content_type add_id auction_id new column content_type add_id auction_id new column content_type add_id auction_id new column content_type add_id auction_id new column content_type add_id auction_id new column content_type add_id auction_id new column content_type add_id auction_id new column content_type add_id auction_id new column content_type unique_id auction_id null content_type unique_id auction_id null content_type unique_id auction_id null content_type unique_id auction_id null content_type unique_id auction_id null content_type unique_id auction_id null content_type unique_id auction_id null content_type unique_id auction_id null content_type unique_id auction_id null content_type unique_id auction_id null content_type
注意到值为new column的这列,实际上我是分两次写入到 mongodb,第一次是有这个字段,值为new column,第二次写入则没有这个值。 我们可以看到最后十条该字段的输出为 null
new column
null
如果你当前的版本不支持,可以从这里下载我最新版本(提取码 jxxa),替换你当前jar包,然后测试再看看。 如果还有问题,可以贴出你的整个测试过程
jxxa
No branches or pull requests
您好,一直在用您改造的datax,最近有个mongdbreader的问题困绕我,就是mongdb中文档有些字段可能不存在时,配置这个字段后进行读取数据,当读取到没有的字段行时,就提示源数据字段与目标字段数据不一致,请问可否在后续将这个问题解决!
The text was updated successfully, but these errors were encountered: