[IOTDB-842] Better Export/Import-CSV Tool#3820
Merged
HTHou merged 44 commits intoapache:masterfrom Sep 22, 2021
xuanronaldo:xuanronaldo
Merged
[IOTDB-842] Better Export/Import-CSV Tool#3820HTHou merged 44 commits intoapache:masterfrom xuanronaldo:xuanronaldo
HTHou merged 44 commits intoapache:masterfrom
xuanronaldo:xuanronaldo
Conversation
added 11 commits
August 13, 2021 16:34
1.add the function of device aligned format importing. 2.parse the data type from the csv header. 3.query the data type from IoTDB. 4.use insertRecordsOfOneDevice API to insert data. 5.output the failed line to a new csv file.
1.add parameter "-fd" to specify a directory to save the failed file.
1.add annotations.
1.using google format plugin to reformat the code.
2.recoding the ExportCsv.java to simplify code and implement headerType definition.
1.using google format plugin to reformat the code.
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
xuanronaldo
changed the title
added 2 commits
August 24, 2021 16:08
jixuan1989
reviewed
Aug 25, 2021
jixuan1989
reviewed
Aug 25, 2021
jixuan1989
reviewed
Aug 25, 2021
cli/src/test/java/org/apache/iotdb/tool/integration/ExportCsvTestIT.java
Outdated
Show resolved
Hide resolved
jixuan1989
reviewed
Aug 25, 2021
cli/src/test/java/org/apache/iotdb/tool/unit/WriteCsvFileTestUT.java
Outdated
Show resolved
Hide resolved
jixuan1989
reviewed
Aug 25, 2021
cli/src/test/java/org/apache/iotdb/tool/integration/ImportCsvTestIT.java
Show resolved
Hide resolved
HTHou
reviewed
Sep 1, 2021
HTHou
reviewed
Sep 1, 2021
added 3 commits
September 1, 2021 10:04
HTHou
requested changes
Sep 14, 2021
HTHou
reviewed
Sep 14, 2021
HTHou
reviewed
Sep 15, 2021
HTHou
approved these changes
Sep 17, 2021
cigarl
pushed a commit
to cigarl/iotdb
that referenced
this pull request
Sep 30, 2021
* fix the bug that the program can not run at background. Co-authored-by: Haonan <hhaonan@outlook.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Update the Export/Import-CSV tool.
Import
common-csvUsing
common-csvto do CSV file reading and writing.Using
Java streamUsing
Java streamto simplify code.The New Import Tool
The new import tool support 4 data formats. Including the data aligned by time or device, with or without data type of headers. Besides, you can specify a directory to save file which save failed lines.
The New Export Tool
The new export tool can print data type of timeseries in the head line of CSV file. Besides, you can directly specify a query comman that you want to execute by setting parameter.