Skip to content

A collection of tools to pack the GAIA universe model in a binary format.

License

Notifications You must be signed in to change notification settings

MrSinho/gaia-archive-tools

Repository files navigation

ESA Gaia (Early) Data Release Archive Tools

linux-status windows-status


License

Use of the Gaia data comes with the following license:

"The Gaia data are open and free to use, provided credit is given to 'ESA/Gaia/DPAC'. In general, access to, and use of, ESA's Gaia Archive (hereafter called 'the website') constitutes acceptance of the following general terms and conditions. Neither ESA nor any other party involved in creating, producing, or delivering the website shall be liable for any direct, incidental, consequential, indirect, or punitive damages arising out of user access to, or use of, the website. The website does not guarantee the accuracy of information provided by external sources and accepts no responsibility or liability for any consequences arising from the use of such data."

This repository is licensed under the GPL-3.0 license.


Clone and Build

Open the terminal and run the following commands:

git clone --recursive https://github.com/MrSinho/gaia-archive-tools.git
cd gaia-archive-tools
mkdir build
cd build
cmake .. #-DGAIA_ARCHIVE_TOOLS_BUILD_EXAMPLES=ON
cmake --build .
CMake target type
gaia-archive-tools library
gaia-exp executable
gaia-convert-sample executable
gaia-read-sample executable

For any issues, see the windows and linux build logs.


Before running: manually unzip example source data

Go to gaia-bin and unzip the files before running the offline sample gaia-read.c


Example

The gaia-universe-model repository uses this library and the shengine API to render in a 3d environment hundreds of millions of celestial bodies in real time, with gradually more features being implemented.

Useful Python Scripts

If you navigate in the scripts folder you'll find some python scripts:

cd scripts
dir
Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----        26/01/2022     20:26           1116 compress_catalogues.py
-a----        22/01/2022     21:53           1127 convert_catalogues.py
-a----        13/01/2022     17:37           1485 download_catalogues.py
-a----        15/01/2022     22:49              8 requirements.txt

To download the original CSV files directly from the Gaia Servers:

python download-catalogues.py 0 #Download only file 0
python download-catalogues.py 0 4999 #Download all the files in the given range

If you want to convert the CSV files in a binary format, do:

python convert-catalogues.py 0 #Convert only file 0 
python convert-catalogues.py 0 4999 #Convert all the files in the given range 

In case you need to compress the binaries in a RAR file:

python compress-catalogues.py 0 #Compress only file 0 
python compress-catalogues.py 0 4999 #Compress all the files in the given range 

To download the binaries from gaia-resources:

python download-release.py 0 #Download only file 0
python download-release.py 0 4999 #Download all the files in the given range

About

A collection of tools to pack the GAIA universe model in a binary format.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published