Skip to content

Commit

Permalink
set expectations about S3 direct upload behavior #9601
Browse files Browse the repository at this point in the history
  • Loading branch information
pdurbin committed May 23, 2023
1 parent 6838fdf commit 046a049
Show file tree
Hide file tree
Showing 2 changed files with 15 additions and 0 deletions.
11 changes: 11 additions & 0 deletions doc/sphinx-guides/source/developers/big-data-support.rst
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,17 @@ At present, one potential drawback for direct-upload is that files are only part

``./asadmin create-jvm-options "-Ddataverse.files.<id>.ingestsizelimit=<size in bytes>"``

.. _s3-direct-upload-features-disabled:

Features that are Disabled if S3 Direct Upload is Enabled
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

The following features are disabled when S3 direct upload is enabled.

- Unzipping of zip files. (See :ref:`compressed-files`.)
- Extraction of metadata from FITS, NetCDF, and HDF5 files. (See :ref:`fits` and :ref:`netcdf-and-hdf5`.)
- Creation of NcML auxiliary files (See :ref:`netcdf-and-hdf5`.)

.. _cors-s3-bucket:

Allow CORS for S3 Buckets
Expand Down
4 changes: 4 additions & 0 deletions doc/sphinx-guides/source/user/dataset-management.rst
Original file line number Diff line number Diff line change
Expand Up @@ -329,6 +329,8 @@ You can also search for files within datasets that have been tagged as "Workflow

|cw-image6|

.. _fits:

Astronomy (FITS)
----------------

Expand Down Expand Up @@ -374,6 +376,8 @@ Please note the following rules regarding these fields:

If the bounding box was successfully populated, :ref:`geospatial-search` should be able to find it.

.. _compressed-files:

Compressed Files
----------------

Expand Down

0 comments on commit 046a049

Please sign in to comment.