Large single-tile image and memory: need low level streaming implementation

[GoogleCodeExporter]

The site 'http://marsoweb.nas.nasa.gov/HiRISE/hirise_images/'
allows the download of JP2 images.

I have downloaded

ESP_011277_1825_RED: Crater in Meridiani Planum with Layering

The downloaded file 'ESP_011277_1825_RED.JP2' has a size of
90'573'764 Byte.

On my LINUX 32-bit machine all viewers fail to show this image.

-----------------------------------
j2k_dump -i ESP_011277_1825_RED.JP2 > index

[ERROR] read error: passed the end of the codestream
   (start = -1307983864, current = -1217410100, end = -1217410100
[ERROR] tcd_decode: incomplete bistream
Segmentation fault
-----------------------------------
My simple JP2 reader shows:

[224]marker(0xff90)
sot  tile_nr(0) Psot(1'415'700'102) TPsot(0) TNsot(1)

-----------------------------------
free -m (i.e. megabytes)
             total    used    free  shared  buffers  cached
Mem:          2025     807    1217       0       58     685
-/+ buffers/cache:      64    1961
Swap:           23       0      23
-----------------------------------

Does this mean that my memory and swap space is too small for
such an image?

winfried

Original issue reported on code.google.com by szukw...@arcor.de on 26 Sep 2011 at 6:24

• Blocking: Improve support for region of interest #39, OpenJPEG allocates more memory than stricly needed #275

[GoogleCodeExporter]

Perhaps it was the swap space. After extending the swap space to
8 GB, I got:

j2k_dump -v -i ESP_011277_1825_RED.JP2 -o index

Setting decoding area to 0,0,0,0
[INFO] Stream reached its end !
[ERROR] Stream too short
ERROR -> j2k_dump: failed read the tile header

winfried

Original comment by szukw...@arcor.de on 28 Sep 2011 at 7:21

[GoogleCodeExporter]

I have now tested another HiRISE image: ESP_014256_1300_RED.JP2.
It has a size of 259'194'623 bytes.

Currently

 http://openjpeg.googlecode.com/svn/branches/openjpeg-1.5

returns revision 950.

In openjpeg-1.5-revision-950/application/codec/

both 'j2k_dump' and 'j2k_to_image' fail with 'Segmentation fault'.

'j2k_to_image' fails in 'libopenjpeg/t1.c'.

line 1556: y == 0, x == 0, tile_w == 14617, tile_dp == NULL

line 1557: clbk_h == 64

line 1558: cblk_w == 58

line 1559: j == 0, i == 0, tmp == -1025

winfried

Original comment by szukw...@arcor.de on 28 Sep 2011 at 8:20

[GoogleCodeExporter]

Adding direct link:
http://hirise-pds.lpl.arizona.edu/download/PDS/RDR/ESP/ORB_011200_011299/ESP_011
277_1825/ESP_011277_1825_RED.JP2

Original comment by mathieu.malaterre on 11 Jan 2012 at 9:15

[GoogleCodeExporter]

Original comment by mathieu.malaterre on 29 May 2012 at 1:18

[GoogleCodeExporter]

This image is not tiled. This will be hard to deal with even using v2.

Original comment by mathieu.malaterre on 15 Oct 2012 at 3:28

[GoogleCodeExporter]

Original comment by mathieu.malaterre on 25 Feb 2014 at 3:27

• Added labels: Priority-Low
• Removed labels: Priority-Medium

[GoogleCodeExporter]

Issue 122 has been merged into this issue.

Original comment by mathieu.malaterre on 27 Feb 2014 at 8:14

[GoogleCodeExporter]

Original comment by mathieu.malaterre on 27 Feb 2014 at 8:14

[GoogleCodeExporter]

Original comment by mathieu.malaterre on 27 Feb 2014 at 8:15

• Changed title: HiRISE image and memory: need low level streaming implementation

[GoogleCodeExporter]

Issue 151 has been merged into this issue.

Original comment by mathieu.malaterre on 27 Feb 2014 at 1:32

[GoogleCodeExporter]

Original comment by mathieu.malaterre on 6 Mar 2014 at 11:50

• Now blocking: Improve support for region of interest #39

[GoogleCodeExporter]

Original comment by mathieu.malaterre on 6 Mar 2014 at 11:51

• Changed title: Large single-tile image and memory: need low level streaming implementation

[GoogleCodeExporter]

Original comment by mathieu.malaterre on 7 Mar 2014 at 9:11

• Now blocking: OpenJPEG allocates more memory than stricly needed #275