Feature Summary
Currently, some users would like to import or fetch data directly from external storage services, such as Box, Dropbox, or Google Drive. This would make it easier for users to bring files into Texera datasets, especially when the data is already stored in a shared cloud folder or is too large to move manually.
Overall, this feature could improve the dataset ingestion workflow and reduce extra manual steps for users who already manage their data through external storage platforms. The data could be directly used in workflows for further processing and analysis.
Proposed Solution or Design
Add an import option in the dataset/file management interface that allows users to connect to an external source and select files to import.
We could consider using an existing library to support the integration. The initial implementation can focus on one provider first, and the connection layer can be extended later to support additional sources.
Affected Area
No response
Feature Summary
Currently, some users would like to import or fetch data directly from external storage services, such as Box, Dropbox, or Google Drive. This would make it easier for users to bring files into Texera datasets, especially when the data is already stored in a shared cloud folder or is too large to move manually.
Overall, this feature could improve the dataset ingestion workflow and reduce extra manual steps for users who already manage their data through external storage platforms. The data could be directly used in workflows for further processing and analysis.
Proposed Solution or Design
Add an import option in the dataset/file management interface that allows users to connect to an external source and select files to import.
We could consider using an existing library to support the integration. The initial implementation can focus on one provider first, and the connection layer can be extended later to support additional sources.
Affected Area
No response