Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement]: row-based import, only allow one JSON file each time #32434

Closed
1 task done
UshaPravinkumar opened this issue Apr 18, 2024 · 6 comments
Closed
1 task done
Assignees
Labels
kind/enhancement Issues or changes related to enhancement stale indicates no udpates for 30 days

Comments

@UshaPravinkumar
Copy link

UshaPravinkumar commented Apr 18, 2024

Is there an existing issue for this?

  • I have searched the existing issues

What would you like to be added?

Hello,

When attempting to import multiple files using the row-based approach, I encounter an error message: "io.milvus.exception.ServerException: row-based import, only allow one JSON file each time."

How can I accomplish bulk insertion using the row-based method?

List<String> fileList = new ArrayList<>(); fileList.add("a-bucket/2022/Data_1.json"); fileList.add("a-bucket/2022/Data_2.json"); util.bulkInsert(collectionName, fileList);

Why is this needed?

No response

Anything else?

No response

@UshaPravinkumar UshaPravinkumar added the kind/enhancement Issues or changes related to enhancement label Apr 18, 2024
@xiaofan-luan
Copy link
Collaborator

we support only one json file to be imported each time.

this could be improved in 2.4 already.

@UshaPravinkumar
Copy link
Author

Hello,
I attempted bulk insertion of multiple files using version 2.4.1, yet the problem persists unchanged.

@xiaofan-luan
Copy link
Collaborator

/assign @bigsheeper
bigsheeper is working on this

@bigsheeper
Copy link
Contributor

Hello, I attempted bulk insertion of multiple files using version 2.4.1, yet the problem persists unchanged.

Hello @UshaPravinkumar , version 2.4.x introduces RESTful API to enable importing multiple files in a single request. You can find more information in the documentation: RESTful API Documentation.

@UshaPravinkumar
Copy link
Author

Hello, I attempted bulk insertion of multiple files using version 2.4.1, yet the problem persists unchanged.

Hello @UshaPravinkumar , version 2.4.x introduces RESTful API to enable importing multiple files in a single request. You can find more information in the documentation: RESTful API Documentation.

Let me try that, thanks.

Copy link

stale bot commented Jun 13, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

@stale stale bot added the stale indicates no udpates for 30 days label Jun 13, 2024
@stale stale bot closed this as completed Jun 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/enhancement Issues or changes related to enhancement stale indicates no udpates for 30 days
Projects
None yet
Development

No branches or pull requests

3 participants