aw3d30-parquet

Application to download ALOS World 3D 30 meter DEM data from OpenTopography (OTALOS.112016.4326.2) and store it as Parquet data. Used in Supercomputing for Big Data course at Delft University of Technology.

Acknowledgements

• J. Takaku, T. Tadono, K. Tsutsui Generation of High Resolution Global DSM from ALOS PRISM The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, pp.243-248, Vol. XL-4, ISPRS TC IV Symposium, Suzhou, China, 2014

• T. Tadono, H. Ishida, F. Oda, S. Naito, K. Minakawa, H. Iwamoto Precise Global DEM Generation By ALOS PRISM ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, pp.71-76, Vol.II-4, 2014

• Japan Aerospace Exploration Agency (2021) ALOS World 3D 30 meter DEM. V3.2, Jan 2021. Distributed by OpenTopography. doi: 10.5069/G94M92HB

Install

Docker

You can build a Docker image that runs the application:

docker build -t aw3d30 https://github.com/mbrobbel/aw3d30-parquet.git#main

Run a container to download and write Parquet files:

docker run -it --rm -v `pwd`:/io aw3d30 -t /io/tif -p /io/parquet <set>

The following pre-defined sets are supported:

• netherlands (requires ~300 MiB of disk space)
• france (requires ~5 GiB of disk space)
• europe (~43 GiB)
• world (~400 GiB)

Build

Requirements

• Rust (stable)
• GDAL development files

Cargo

cargo install --git https://github.com/mbrobbel/aw3d30-parquet.git

Or clone the repository and run:

cargo install --path .

License

Licensed under either of Apache License, Version 2.0 or MIT license at your option.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.