Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Streaming/Windowed GeoTiff Reading #1905

Merged
merged 90 commits into from
Mar 10, 2017

Commits on Dec 5, 2016

  1. Added StreamingSegmentBytes

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    e1b08c1 View commit details
    Browse the repository at this point in the history
  2. Integrated StreamingSegmentBytes in SinglebandGeoTiffs

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    ccc9a67 View commit details
    Browse the repository at this point in the history
  3. Integrated StreamingSegmentBytes in MultibandGeoTiffs

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    fb625c6 View commit details
    Browse the repository at this point in the history
  4. Integrated StreamingSegmentBytes in GeoTiffReader

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    4bf33df View commit details
    Browse the repository at this point in the history
  5. Integrated StreamingSegmentBytes into Int16GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    0242cf6 View commit details
    Browse the repository at this point in the history
  6. Integrated StreamingSegmentBytes into UByteGeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    cc716f7 View commit details
    Browse the repository at this point in the history
  7. Integrated StreamingSegmentBytes into Int16GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    ac2bac5 View commit details
    Browse the repository at this point in the history
  8. Added StreamingSegmentBytesSpec

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 5, 2016
    Configuration menu
    Copy the full SHA
    66c9a4d View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2016

  1. Integrated StreamingSegmentBytes into ByteGeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    60fcd37 View commit details
    Browse the repository at this point in the history
  2. Integrated StreamingSegmentBytes into UInt16GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    95b443b View commit details
    Browse the repository at this point in the history
  3. Integrated StreamingSegmentBytes into UInt32GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    5c0dde4 View commit details
    Browse the repository at this point in the history
  4. Integrated StreamingSegmentBytes into Float32GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    03261f0 View commit details
    Browse the repository at this point in the history
  5. Integrated StreamingSegmentBytes into Float64GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    6b4799f View commit details
    Browse the repository at this point in the history
  6. Added intersectingSegments to ArraySegmentBytes

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    70d3c35 View commit details
    Browse the repository at this point in the history
  7. Removed LazySegmentBytes

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    f06d71f View commit details
    Browse the repository at this point in the history
  8. Added intersectingSegments to SegmentBytes

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    0b948bb View commit details
    Browse the repository at this point in the history
  9. Continuing debugging work

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    3c21091 View commit details
    Browse the repository at this point in the history
  10. Continued to debug StreamingSegmentBytes

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    ebc1c42 View commit details
    Browse the repository at this point in the history
  11. Removed LazySegmentBytes from SegmentBytesSpec

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    e930661 View commit details
    Browse the repository at this point in the history
  12. Removed some debugging code and extranious methods from StreamingSegm…

    …entBytes
    
    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    ae257e8 View commit details
    Browse the repository at this point in the history
  13. Updated StreamingSegmentBytesSpec to reflect the changes to Streaming…

    …SegmentBytes
    
    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    4c88e9e View commit details
    Browse the repository at this point in the history
  14. Moved MergeQueue from the Spark to Util

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    14a9562 View commit details
    Browse the repository at this point in the history
  15. Updated the import path for MergeQueue in all files that use it

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    94428db View commit details
    Browse the repository at this point in the history
  16. Began work on reading consecutive segments as one chunk

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    46b46cc View commit details
    Browse the repository at this point in the history
  17. Removed bug that created duplicate chunks

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    dbd8f42 View commit details
    Browse the repository at this point in the history
  18. Switched paramters around in ByteReaderExtensions

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    3f00aee View commit details
    Browse the repository at this point in the history
  19. Updated TiffTagsReader to reflect the changes in ByteReaderExtensions

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    3d0058c View commit details
    Browse the repository at this point in the history
  20. Continued to bug fix

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 6, 2016
    Configuration menu
    Copy the full SHA
    011f041 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2016

  1. Configuration menu
    Copy the full SHA
    aae773a View commit details
    Browse the repository at this point in the history
  2. Updated the various GeoTiffTiles crop methods to reflect the changes …

    …made in StreamingSegmentBytes
    
    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    82c97e3 View commit details
    Browse the repository at this point in the history
  3. All tests now run in the WindowedReadingSpec

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    018490d View commit details
    Browse the repository at this point in the history
  4. Added readStrippedSegmentBytes and readTileSegmentBytes methods to Ge…

    …oTiffTile
    
    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    2d29425 View commit details
    Browse the repository at this point in the history
  5. Changed how bytes are read in for the ByteGeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    131e0bd View commit details
    Browse the repository at this point in the history
  6. Changed how bytes are read in for the UByteGeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    3e390a9 View commit details
    Browse the repository at this point in the history
  7. Changed how bytes are read in for the Int16GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    98226cf View commit details
    Browse the repository at this point in the history
  8. Changed how bytes are read in for the Int32GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    06a5279 View commit details
    Browse the repository at this point in the history
  9. Changed how bytes are read in for the UInt32GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    e3ce0ef View commit details
    Browse the repository at this point in the history
  10. Changed how bytes are read in for the Float32GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    02d4747 View commit details
    Browse the repository at this point in the history
  11. Changed how bytes are read in for the Float64GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 8, 2016
    Configuration menu
    Copy the full SHA
    d918773 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2016

  1. Configuration menu
    Copy the full SHA
    ed04db0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e0cac50 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1ca071e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ef74b86 View commit details
    Browse the repository at this point in the history
  5. Put GridIndexTransform into its own file

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    85bd642 View commit details
    Browse the repository at this point in the history
  6. Created StripedSegmentTransform that extends GridIndexTransform

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    4818546 View commit details
    Browse the repository at this point in the history
  7. Created TiledSegmentTransform that extends GridIndexTransform

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    e812304 View commit details
    Browse the repository at this point in the history
  8. Removed GridIndexTransform from GeoTiffSegmentLayout

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    0c4a82b View commit details
    Browse the repository at this point in the history
  9. Reimplamented how segmentTransform is called in GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    8545e04 View commit details
    Browse the repository at this point in the history
  10. Continued reimplamentation of segmentTransform calls in GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    ed88c6f View commit details
    Browse the repository at this point in the history
  11. Reimplamented how segmentTransform is called in GeoTiffMultibandTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    a242844 View commit details
    Browse the repository at this point in the history
  12. Reimplamented how segmentTransform is called in BitGeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    18d0060 View commit details
    Browse the repository at this point in the history
  13. Reimplamented how segmentTransform is called in Int16GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    a9499a8 View commit details
    Browse the repository at this point in the history
  14. Reimplamented how segmentTransform is called in UInt16GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    3e87239 View commit details
    Browse the repository at this point in the history
  15. Reimplamented how segmentTransform is called in UInt32GeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    5446eff View commit details
    Browse the repository at this point in the history
  16. Re-added the getSegmentTransform method to GeoTiffSegmentLayout

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    bdd855a View commit details
    Browse the repository at this point in the history
  17. Changed how segmentTransform is obtained

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    35c6353 View commit details
    Browse the repository at this point in the history
  18. Removed the crop method from BitGeoTiffTile

    Signed-off-by: jbouffard <jbouffard@azavea.com>
    jbouffard committed Dec 9, 2016
    Configuration menu
    Copy the full SHA
    4f78e9b View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2016

  1. Configuration menu
    Copy the full SHA
    44bafcd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    834dd46 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    11727a0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    feddbfb View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    e79d2a7 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    aa905cd View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    227c775 View commit details
    Browse the repository at this point in the history
  8. Fix double decompression

    echeipesh committed Dec 12, 2016
    Configuration menu
    Copy the full SHA
    2a409d9 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    30efae3 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    5c9d0fb View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2016

  1. Configuration menu
    Copy the full SHA
    b76f113 View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2016

  1. Configuration menu
    Copy the full SHA
    bbb6317 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    652b1de View commit details
    Browse the repository at this point in the history

Commits on Feb 25, 2017

  1. Configuration menu
    Copy the full SHA
    4b4675f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0567d30 View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2017

  1. Configuration menu
    Copy the full SHA
    5a7a712 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    59a4d47 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2017

  1. Configuration menu
    Copy the full SHA
    543361c View commit details
    Browse the repository at this point in the history
  2. more getSegments usage

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Feb 28, 2017
    Configuration menu
    Copy the full SHA
    6fb555f View commit details
    Browse the repository at this point in the history
  3. poking around mbgeotiff crop method

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Feb 28, 2017
    Configuration menu
    Copy the full SHA
    3fd8172 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2017

  1. fix crop function

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 1, 2017
    Configuration menu
    Copy the full SHA
    6004b3d View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2017

  1. Merge branch 'master' of github.com:pomadchin/geotrellis into chunky-…

    …streaming
    
    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    2e53e9c View commit details
    Browse the repository at this point in the history
  2. fix s3 unit tests

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    947131b View commit details
    Browse the repository at this point in the history
  3. deinterleave functions fix

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    0d48955 View commit details
    Browse the repository at this point in the history
  4. improve bands and subset functions

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    71deb84 View commit details
    Browse the repository at this point in the history
  5. _combine(initValueHolder: ...) function refactor

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    ec4ccdc View commit details
    Browse the repository at this point in the history
  6. combiners arity 2 refactor

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    d78fd98 View commit details
    Browse the repository at this point in the history
  7. use getSegments in GeoTiffWriter

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    1024743 View commit details
    Browse the repository at this point in the history
  8. multiband combiners improvements, moved boilerplate to use getSegment…

    …s function
    
    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    6e75560 View commit details
    Browse the repository at this point in the history
  9. fix multiband combiners

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 2, 2017
    Configuration menu
    Copy the full SHA
    ff0ec4b View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2017

  1. restore LazySegmentBytes tests

    Signed-off-by: Grigory Pomadchin <gr.pomadchin@gmail.com>
    pomadchin committed Mar 3, 2017
    Configuration menu
    Copy the full SHA
    e1258ec View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2017

  1. Configuration menu
    Copy the full SHA
    95c6a27 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    30f8597 View commit details
    Browse the repository at this point in the history