Errors opening TIF files over S3 with rasterio

[vishcious]

I have read through most of the other issues related to this and can't figure out what I am doing wrong. Here are the errors i am encountering

https://gist.github.com/viswaug/627e8755aff2b087c78049d80afbdd49

I am pretty sure the error is with the user :) and was looking for suggestions to troubleshoot.

[perrygeo]

Hey @viswaug, what does gdalinfo --formats | grep HTTP show?

[vishcious]

hmm... where do you expect gdalinfo to be? I pip installed "rasterio" and "rasterio[s3]". gdalinfo is not available. I did expect to find the gdal binaries (gdal.so) in the virtualenv site packages, but did not. pip tells me i am on version 0.36.0. But the requirements file here uses version 1.0a2 (that version does bring in the gdal.so binaries) ... feels like i am missing something. I thought this feature would be in 0.36.0 because of the conversation here

[perrygeo]

@viswaug sorry, there are many variables, including gdal libs and rasterio installation method, which are not known to us! Can you try

pip install --pre "rasterio>=1.0a3"

gdalinfo will not be available (libgdal, not gdal binaries are bundled with Rasterio) but you should be able to access:

$ rio info s3://landsat-pds/L8/180/121/LC81801212015297LGN00/LC81801212015297LGN00_B4.TIF

[sgillies]

@viswaug @perrygeo remember that S3 access is an optional dependency (involving boto3), so do pip install --pre "rasterio[s3]>=1.0a3". Some SSL cert file hacking may be required because the SSL lib linked by GDAL has its cert directory hard coded. We've got a fix for this coming in 1.0a4, though.

[sgillies]

State of the art documentation on doing this is now at #942.

[vishcious]

yup. got 1.0a4 and my issue was resolved