New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stream segments of a FITS file over network protocols #3446

Open
keflavich opened this Issue Feb 5, 2015 · 3 comments

Comments

Projects
None yet
3 participants
@keflavich
Contributor

keflavich commented Feb 5, 2015

This is mostly directed at @embray, I think.

The CFITSIO docs indicate that FITS files can be opened read-only over a network protocol. astropy.io.fits tries to download the file if its a URL, though. Is it possible to enable network access to FITS files via pyfits? There's a major use case in getting quicklook cutouts from large data cubes that I would like to exploit (especially in spectral_cube.

@Cadair

This comment has been minimized.

Show comment
Hide comment
@Cadair

Cadair Feb 5, 2015

Member

@keflavich oh that would be cool.

Member

Cadair commented Feb 5, 2015

@keflavich oh that would be cool.

@embray

This comment has been minimized.

Show comment
Hide comment
@embray

embray Feb 6, 2015

Member

I want to do a total overhaul though of how pyfits handles I/O, and in particular I want to make it possible to read in, for example, just a single HDU without having to scan for every HDU in a file. For your example of large data cubes over the network this would be especially important, as we would want to read only ranges of the file. That level of support is definitely not possible at the moment (though possibly within the scope of the I/O rework).

Member

embray commented Feb 6, 2015

I want to do a total overhaul though of how pyfits handles I/O, and in particular I want to make it possible to read in, for example, just a single HDU without having to scan for every HDU in a file. For your example of large data cubes over the network this would be especially important, as we would want to read only ranges of the file. That level of support is definitely not possible at the moment (though possibly within the scope of the I/O rework).

@embray embray changed the title from Question: astropy.io.fits open via http? to Stream segments of a FITS file over network protocols Feb 6, 2015

@embray

This comment has been minimized.

Show comment
Hide comment
@embray

embray Feb 6, 2015

Member

I changed the title of this since, as you noted, it's already possible to open a FITS file via HTTP. The difference being that simply downloads the entire file, and does not stream it.

Member

embray commented Feb 6, 2015

I changed the title of this since, as you noted, it's already possible to open a FITS file via HTTP. The difference being that simply downloads the entire file, and does not stream it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment