Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add initial support for reading BinaryOnly OME-TIFF datasets #1090

Merged
merged 3 commits into from
May 16, 2014

Conversation

melissalinkert
Copy link
Member

This adjusts the type detection slightly so that .companion.ome files
are detected as OME-TIFF, not OME-XML (as this makes finding and reading
the corresponding OME-TIFF files much easier). Selecting either a
BinaryOnly OME-TIFF file or the corresponding companion OME-XML file
should result in the entire dataset being read.

Fixes https://trac.openmicroscopy.org.uk/ome/ticket/11951. Sample files were generated from gh-1015, and are in data_repo/from_skyking/ome-tiff/samples/binary-only.

This adjusts the type detection slightly so that .companion.ome files
are detected as OME-TIFF, not OME-XML (as this makes finding and reading
the corresponding OME-TIFF files much easier).  Selecting either a
BinaryOnly OME-TIFF file or the corresponding companion OME-XML file
should result in the entire dataset being read.

Fixes #11951.
@bramalingam
Copy link
Member

  1. While pointing at the folder. The import works perfectly. All datasets are getting imported as expected.
    screen shot 2014-05-14 at 12 32 27
    EX: Import log for one of the images (single-channel.ome.tif)
2014-05-14 12:26:46,659 INFO  [    ome.formats.OMEROMetadataStoreClient] (2-thread-5) Call context: {omero.logfilename:user-1_8/2014-05/14/12-26-45.992.log}
2014-05-14 12:26:46,670 INFO  [         ome.security.basic.EventHandler] (Server-560)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,721 INFO  [                loci.formats.ImageReader] (2-thread-5) OMETiffReader initializing /nightshade/OMERO/omero-c6100-dec-5-2013-valuable/OMERO-merge-develop-FS/ManagedRepository/user-1_8/2014-05/14/12-26-45.992/single-channel.ome.tif
2014-05-14 12:26:46,764 INFO  [       loci.formats.in.MinimalTiffReader] (2-thread-5) Reading IFDs
2014-05-14 12:26:46,764 INFO  [       loci.formats.in.MinimalTiffReader] (2-thread-5) Populating metadata
2014-05-14 12:26:46,768 INFO  [         ome.security.basic.EventHandler] (Server-560)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,786 INFO  [         ome.security.basic.EventHandler] (Server-565)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,791 INFO  [         ome.security.basic.EventHandler] (Server-544)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,795 INFO  [         ome.security.basic.EventHandler] (Server-553)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,798 DEBUG [                   loci.formats.Memoizer] (2-thread-5) skipping save memo. elapsed millis: 72
2014-05-14 12:26:46,798 DEBUG [                   loci.formats.Memoizer] (2-thread-5) start[1400066806693] time[105] tag[loci.formats.Memoizer.setId]
2014-05-14 12:26:46,798 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Image Count: 1
2014-05-14 12:26:46,798 INFO  [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) File format: OME-TIFF
2014-05-14 12:26:46,798 INFO  [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Base reader: loci.formats.in.OMETiffReader
2014-05-14 12:26:46,798 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Step 0
2014-05-14 12:26:46,799 WARN  [    ome.formats.model.ReferenceProcessor] (2-thread-5) Unknown target class for LSID: Image:0
2014-05-14 12:26:46,799 INFO  [    ome.formats.OMEROMetadataStoreClient] (2-thread-5) Handling # of containers: 4
2014-05-14 12:26:46,801 INFO  [         ome.security.basic.EventHandler] (Server-555)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,802 INFO  [    ome.formats.OMEROMetadataStoreClient] (2-thread-5) Handling # of references: 1
2014-05-14 12:26:46,804 INFO  [         ome.security.basic.EventHandler] (Server-559)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,818 INFO  [         ome.security.basic.EventHandler] (Server-532)  Auth:    user=8,group=9,event=757467(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,825 INFO  [       ome.security.basic.CurrentDetails] (Server-532) Adding log:INSERT,class ome.model.core.Image,41327
2014-05-14 12:26:46,827 INFO  [       ome.security.basic.CurrentDetails] (Server-532) Adding log:INSERT,class ome.model.containers.DatasetImageLink,23415
2014-05-14 12:26:46,828 INFO  [       ome.security.basic.CurrentDetails] (Server-532) Adding log:INSERT,class ome.model.core.Pixels,39127
2014-05-14 12:26:46,830 INFO  [       ome.security.basic.CurrentDetails] (Server-532) Adding log:INSERT,class ome.model.core.LogicalChannel,39167
2014-05-14 12:26:46,831 INFO  [       ome.security.basic.CurrentDetails] (Server-532) Adding log:INSERT,class ome.model.core.Channel,75617
2014-05-14 12:26:46,854 INFO  [         ome.security.basic.EventHandler] (Server-562)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,867 INFO  [         ome.security.basic.EventHandler] (Server-561)  Auth:    user=8,group=9,event=757468(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,870 INFO  [       ome.security.basic.CurrentDetails] (Server-561) Adding log:UPDATE,class ome.model.core.OriginalFile,72814
2014-05-14 12:26:46,882 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Step 1
2014-05-14 12:26:46,882 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Plane:0 X:0 Y:0 TileWidth:439 TileHeight:167 arrayBuf.length:73313
2014-05-14 12:26:46,896 INFO  [         ome.security.basic.EventHandler] (Server-535)  Auth:    user=8,group=9,event=757469(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:46,918 INFO  [         ome.security.basic.EventHandler] (Server-560)  Auth:    user=8,group=9,event=757470(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,033 INFO  [       ome.security.basic.CurrentDetails] (Server-560) Adding log:UPDATE,class ome.model.core.Pixels,39127
2014-05-14 12:26:47,051 INFO  [         ome.security.basic.EventHandler] (Server-565)  Auth:    user=8,group=9,event=757471(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,089 INFO  [       ome.security.basic.CurrentDetails] (Server-565) Adding log:INSERT,class ome.model.stats.StatsInfo,64958
2014-05-14 12:26:47,089 INFO  [       ome.security.basic.CurrentDetails] (Server-565) Adding log:UPDATE,class ome.model.core.Channel,75617
2014-05-14 12:26:47,102 INFO  [         ome.security.basic.EventHandler] (Server-544)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,116 INFO  [         ome.security.basic.EventHandler] (Server-553)  Auth:    user=8,group=9,event=757472(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,119 INFO  [       ome.security.basic.CurrentDetails] (Server-553) Adding log:UPDATE,class ome.model.core.OriginalFile,72814
2014-05-14 12:26:47,131 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Step 2
2014-05-14 12:26:47,142 INFO  [         ome.security.basic.EventHandler] (Server-555)  Auth:    user=8,group=9,event=757473(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,183 INFO  [                loci.formats.ImageReader] (Server-555) OMETiffReader initializing /nightshade/OMERO/omero-c6100-dec-5-2013-valuable/OMERO-merge-develop-FS/ManagedRepository/user-1_8/2014-05/14/12-26-45.992/single-channel.ome.tif
2014-05-14 12:26:47,228 INFO  [       loci.formats.in.MinimalTiffReader] (Server-555) Reading IFDs
2014-05-14 12:26:47,228 INFO  [       loci.formats.in.MinimalTiffReader] (Server-555) Populating metadata
2014-05-14 12:26:47,229 DEBUG [                   loci.formats.Memoizer] (Server-555) skipping save memo. elapsed millis: 72
2014-05-14 12:26:47,229 DEBUG [                   loci.formats.Memoizer] (Server-555) start[1400066807156] time[72] tag[loci.formats.Memoizer.setId]
2014-05-14 12:26:47,233 INFO  [       ome.security.basic.CurrentDetails] (Server-555) Adding log:INSERT,class ome.model.display.QuantumDef,37691
2014-05-14 12:26:47,234 INFO  [       ome.security.basic.CurrentDetails] (Server-555) Adding log:INSERT,class ome.model.display.RenderingDef,37691
2014-05-14 12:26:47,235 INFO  [       ome.security.basic.CurrentDetails] (Server-555) Adding log:INSERT,class ome.model.display.ChannelBinding,72059
2014-05-14 12:26:47,271 INFO  [         ome.security.basic.EventHandler] (Server-559)  Auth:    user=8,group=9,event=757474(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,280 INFO  [       ome.security.basic.CurrentDetails] (Server-559) Adding log:INSERT,class ome.model.display.Thumbnail,37040
2014-05-14 12:26:47,324 INFO  [                loci.formats.ImageReader] (Server-559) OMETiffReader initializing /nightshade/OMERO/omero-c6100-dec-5-2013-valuable/OMERO-merge-develop-FS/ManagedRepository/user-1_8/2014-05/14/12-26-45.992/single-channel.ome.tif
2014-05-14 12:26:47,373 INFO  [       loci.formats.in.MinimalTiffReader] (Server-559) Reading IFDs
2014-05-14 12:26:47,373 INFO  [       loci.formats.in.MinimalTiffReader] (Server-559) Populating metadata
2014-05-14 12:26:47,374 DEBUG [                   loci.formats.Memoizer] (Server-559) skipping save memo. elapsed millis: 77
2014-05-14 12:26:47,374 DEBUG [                   loci.formats.Memoizer] (Server-559) start[1400066807297] time[76] tag[loci.formats.Memoizer.setId]
2014-05-14 12:26:47,379 INFO  [       ome.logic.JavaImageScalingService] (Server-559) Scaling to: 36x96
2014-05-14 12:26:47,404 INFO  [         ome.security.basic.EventHandler] (Server-532)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,417 INFO  [         ome.security.basic.EventHandler] (Server-562)  Auth:    user=8,group=9,event=757475(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,421 INFO  [       ome.security.basic.CurrentDetails] (Server-562) Adding log:UPDATE,class ome.model.core.OriginalFile,72814
2014-05-14 12:26:47,434 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Step 3
2014-05-14 12:26:47,438 INFO  [         ome.security.basic.EventHandler] (Server-561)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,443 INFO  [         ome.security.basic.EventHandler] (Server-535)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,457 INFO  [         ome.security.basic.EventHandler] (Server-560)  Auth:    user=8,group=9,event=757476(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,460 INFO  [       ome.security.basic.CurrentDetails] (Server-560) Adding log:UPDATE,class ome.model.core.OriginalFile,72814
2014-05-14 12:26:47,467 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Step 4
2014-05-14 12:26:47,469 INFO  [         ome.security.basic.EventHandler] (Server-565)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,481 INFO  [         ome.security.basic.EventHandler] (Server-544)  Auth:    user=8,group=9,event=757477(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,484 INFO  [       ome.security.basic.CurrentDetails] (Server-544) Adding log:UPDATE,class ome.model.core.OriginalFile,72814
2014-05-14 12:26:47,511 INFO  [         ome.security.basic.EventHandler] (Server-553)  Auth:    user=8,group=9,event=757478(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,517 DEBUG [                omero.util.ServantHolder] (Server-553) Removed omero.api._RawFileStoreTie@fe51a7ac from omero.util.ServantHolder@de9921 as 6f61a3e0-fdc4-43f2-8c40-3fef01545292omero.api.RawFileStore
2014-05-14 12:26:47,517 INFO  [                      omero.cmd.SessionI] (Server-553) Unregistered servant:c977d1fc-887e-41dc-9816-6c007d2a9884/6f61a3e0-fdc4-43f2-8c40-3fef01545292omero.api.RawFileStore(omero.api._RawFileStoreTie@fe51a7ac)
2014-05-14 12:26:47,527 INFO  [         ome.security.basic.EventHandler] (Server-555)  Auth:    user=8,group=9,event=757479(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,534 DEBUG [                omero.util.ServantHolder] (Server-555) Removed omero.api._RawPixelsStoreTie@9c86a6b4 from omero.util.ServantHolder@de9921 as b7fdaab4-78ce-490c-b4ff-2fac24202415omero.api.RawPixelsStore
2014-05-14 12:26:47,534 INFO  [                      omero.cmd.SessionI] (Server-555) Unregistered servant:c977d1fc-887e-41dc-9816-6c007d2a9884/b7fdaab4-78ce-490c-b4ff-2fac24202415omero.api.RawPixelsStore(omero.api._RawPixelsStoreTie@9c86a6b4)
2014-05-14 12:26:47,536 INFO  [         ome.security.basic.EventHandler] (Server-559)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:26:47,562 INFO  [                loci.formats.ImageReader] (Server-559) OMETiffReader initializing /nightshade/OMERO/omero-c6100-dec-5-2013-valuable/OMERO-merge-develop-FS/ManagedRepository/user-1_8/2014-05/14/12-26-45.992/single-channel.ome.tif
2014-05-14 12:26:47,607 INFO  [       loci.formats.in.MinimalTiffReader] (Server-559) Reading IFDs
2014-05-14 12:26:47,607 INFO  [       loci.formats.in.MinimalTiffReader] (Server-559) Populating metadata
2014-05-14 12:26:47,608 DEBUG [                   loci.formats.Memoizer] (Server-559) skipping save memo. elapsed millis: 72
2014-05-14 12:26:47,608 DEBUG [                   loci.formats.Memoizer] (Server-559) start[1400066807536] time[71] tag[loci.formats.Memoizer.setId]
2014-05-14 12:26:47,610 DEBUG [                omero.util.ServantHolder] (Server-559) Removed omero.api._ThumbnailStoreTie@aa506223 from omero.util.ServantHolder@de9921 as 857a5755-362c-402e-8c78-978d7b96c963omero.api.ThumbnailStore
2014-05-14 12:26:47,610 INFO  [                      omero.cmd.SessionI] (Server-559) Unregistered servant:c977d1fc-887e-41dc-9816-6c007d2a9884/857a5755-362c-402e-8c78-978d7b96c963omero.api.ThumbnailStore(omero.api._ThumbnailStoreTie@aa506223)
2014-05-14 12:26:47,611 DEBUG [                omero.util.ServantHolder] (Server-532) Removed omero.api._MetadataStoreTie@e2c36fb0 from omero.util.ServantHolder@de9921 as f9edca25-ee1b-4a47-b799-7cfb882bcbe5omero.api.MetadataStore
2014-05-14 12:26:47,611 INFO  [                      omero.cmd.SessionI] (Server-532) Unregistered servant:c977d1fc-887e-41dc-9816-6c007d2a9884/f9edca25-ee1b-4a47-b799-7cfb882bcbe5omero.api.MetadataStore(omero.api._MetadataStoreTie@e2c36fb0)
2014-05-14 12:26:47,612 INFO  [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-5) Finalizing log file.
  1. While pointing the companion ome-xml files, the datasets don't get imported, but the files get processed without any error.

screen shot 2014-05-14 at 12 33 16

2014-05-14 12:32:00,203 INFO  [    ome.formats.OMEROMetadataStoreClient] (2-thread-3) Call context: {omero.logfilename:user-1_8/2014-05/14/12-31-59.410.log}
2014-05-14 12:32:00,211 INFO  [         ome.security.basic.EventHandler] (Server-565)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,265 INFO  [                loci.formats.ImageReader] (2-thread-3) OMETiffReader initializing /nightshade/OMERO/omero-c6100-dec-5-2013-valuable/OMERO-merge-develop-FS/ManagedRepository/user-1_8/2014-05/14/12-31-59.410/single-channel.ome.tif
2014-05-14 12:32:00,305 INFO  [       loci.formats.in.MinimalTiffReader] (2-thread-3) Reading IFDs
2014-05-14 12:32:00,305 INFO  [       loci.formats.in.MinimalTiffReader] (2-thread-3) Populating metadata
2014-05-14 12:32:00,312 INFO  [         ome.security.basic.EventHandler] (Server-535)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,333 INFO  [         ome.security.basic.EventHandler] (Server-560)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,338 INFO  [         ome.security.basic.EventHandler] (Server-559)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,344 INFO  [         ome.security.basic.EventHandler] (Server-553)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,348 DEBUG [                   loci.formats.Memoizer] (2-thread-3) skipping save memo. elapsed millis: 66
2014-05-14 12:32:00,348 DEBUG [                   loci.formats.Memoizer] (2-thread-3) start[1400067120239] time[108] tag[loci.formats.Memoizer.setId]
2014-05-14 12:32:00,348 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Image Count: 1
2014-05-14 12:32:00,348 INFO  [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) File format: OME-TIFF
2014-05-14 12:32:00,348 INFO  [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Base reader: loci.formats.in.OMETiffReader
2014-05-14 12:32:00,348 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Step 0
2014-05-14 12:32:00,348 INFO  [    ome.formats.OMEROMetadataStoreClient] (2-thread-3) Handling # of containers: 4
2014-05-14 12:32:00,350 INFO  [         ome.security.basic.EventHandler] (Server-562)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,352 INFO  [    ome.formats.OMEROMetadataStoreClient] (2-thread-3) Handling # of references: 0
2014-05-14 12:32:00,369 INFO  [         ome.security.basic.EventHandler] (Server-544)  Auth:    user=8,group=9,event=758026(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,380 INFO  [       ome.security.basic.CurrentDetails] (Server-544) Adding log:INSERT,class ome.model.core.Image,41339
2014-05-14 12:32:00,383 INFO  [       ome.security.basic.CurrentDetails] (Server-544) Adding log:INSERT,class ome.model.core.Pixels,39139
2014-05-14 12:32:00,385 INFO  [       ome.security.basic.CurrentDetails] (Server-544) Adding log:INSERT,class ome.model.core.LogicalChannel,39191
2014-05-14 12:32:00,387 INFO  [       ome.security.basic.CurrentDetails] (Server-544) Adding log:INSERT,class ome.model.core.Channel,75641
2014-05-14 12:32:00,420 INFO  [         ome.security.basic.EventHandler] (Server-561)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,440 INFO  [         ome.security.basic.EventHandler] (Server-565)  Auth:    user=8,group=9,event=758027(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,443 INFO  [       ome.security.basic.CurrentDetails] (Server-565) Adding log:UPDATE,class ome.model.core.OriginalFile,72970
2014-05-14 12:32:00,451 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Step 1
2014-05-14 12:32:00,452 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Plane:0 X:0 Y:0 TileWidth:439 TileHeight:167 arrayBuf.length:73313
2014-05-14 12:32:00,472 INFO  [         ome.security.basic.EventHandler] (Server-555)  Auth:    user=8,group=9,event=758028(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,518 INFO  [         ome.security.basic.EventHandler] (Server-532)  Auth:    user=8,group=9,event=758029(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,630 INFO  [       ome.security.basic.CurrentDetails] (Server-532) Adding log:UPDATE,class ome.model.core.Pixels,39139
2014-05-14 12:32:00,650 INFO  [         ome.security.basic.EventHandler] (Server-535)  Auth:    user=8,group=9,event=758030(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,695 INFO  [       ome.security.basic.CurrentDetails] (Server-535) Adding log:INSERT,class ome.model.stats.StatsInfo,64982
2014-05-14 12:32:00,696 INFO  [       ome.security.basic.CurrentDetails] (Server-535) Adding log:UPDATE,class ome.model.core.Channel,75641
2014-05-14 12:32:00,713 INFO  [         ome.security.basic.EventHandler] (Server-553)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,726 INFO  [         ome.security.basic.EventHandler] (Server-565)  Auth:    user=8,group=9,event=758031(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,730 INFO  [       ome.security.basic.CurrentDetails] (Server-565) Adding log:UPDATE,class ome.model.core.OriginalFile,72970
2014-05-14 12:32:00,740 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Step 2
2014-05-14 12:32:00,750 INFO  [         ome.security.basic.EventHandler] (Server-560)  Auth:    user=8,group=9,event=758033(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,793 INFO  [                loci.formats.ImageReader] (Server-560) OMETiffReader initializing /nightshade/OMERO/omero-c6100-dec-5-2013-valuable/OMERO-merge-develop-FS/ManagedRepository/user-1_8/2014-05/14/12-31-59.410/single-channel.ome.tif
2014-05-14 12:32:00,840 INFO  [       loci.formats.in.MinimalTiffReader] (Server-560) Reading IFDs
2014-05-14 12:32:00,840 INFO  [       loci.formats.in.MinimalTiffReader] (Server-560) Populating metadata
2014-05-14 12:32:00,841 DEBUG [                   loci.formats.Memoizer] (Server-560) skipping save memo. elapsed millis: 76
2014-05-14 12:32:00,841 DEBUG [                   loci.formats.Memoizer] (Server-560) start[1400067120765] time[76] tag[loci.formats.Memoizer.setId]
2014-05-14 12:32:00,846 INFO  [       ome.security.basic.CurrentDetails] (Server-560) Adding log:INSERT,class ome.model.display.QuantumDef,37703
2014-05-14 12:32:00,848 INFO  [       ome.security.basic.CurrentDetails] (Server-560) Adding log:INSERT,class ome.model.display.RenderingDef,37703
2014-05-14 12:32:00,849 INFO  [       ome.security.basic.CurrentDetails] (Server-560) Adding log:INSERT,class ome.model.display.ChannelBinding,72083
2014-05-14 12:32:00,870 INFO  [         ome.security.basic.EventHandler] (Server-559)  Auth:    user=8,group=9,event=758038(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:00,880 INFO  [       ome.security.basic.CurrentDetails] (Server-559) Adding log:INSERT,class ome.model.display.Thumbnail,37052
2014-05-14 12:32:00,926 INFO  [                loci.formats.ImageReader] (Server-559) OMETiffReader initializing /nightshade/OMERO/omero-c6100-dec-5-2013-valuable/OMERO-merge-develop-FS/ManagedRepository/user-1_8/2014-05/14/12-31-59.410/single-channel.ome.tif
2014-05-14 12:32:00,969 INFO  [       loci.formats.in.MinimalTiffReader] (Server-559) Reading IFDs
2014-05-14 12:32:00,969 INFO  [       loci.formats.in.MinimalTiffReader] (Server-559) Populating metadata
2014-05-14 12:32:00,970 DEBUG [                   loci.formats.Memoizer] (Server-559) skipping save memo. elapsed millis: 71
2014-05-14 12:32:00,970 DEBUG [                   loci.formats.Memoizer] (Server-559) start[1400067120899] time[70] tag[loci.formats.Memoizer.setId]
2014-05-14 12:32:00,974 INFO  [       ome.logic.JavaImageScalingService] (Server-559) Scaling to: 36x96
2014-05-14 12:32:00,996 INFO  [         ome.security.basic.EventHandler] (Server-562)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,009 INFO  [         ome.security.basic.EventHandler] (Server-544)  Auth:    user=8,group=9,event=758040(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,012 INFO  [       ome.security.basic.CurrentDetails] (Server-544) Adding log:UPDATE,class ome.model.core.OriginalFile,72970
2014-05-14 12:32:01,024 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Step 3
2014-05-14 12:32:01,026 INFO  [         ome.security.basic.EventHandler] (Server-561)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,031 INFO  [         ome.security.basic.EventHandler] (Server-553)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,043 INFO  [         ome.security.basic.EventHandler] (Server-535)  Auth:    user=8,group=9,event=758041(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,047 INFO  [       ome.security.basic.CurrentDetails] (Server-535) Adding log:UPDATE,class ome.model.core.OriginalFile,72970
2014-05-14 12:32:01,057 DEBUG [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Step 4
2014-05-14 12:32:01,060 INFO  [         ome.security.basic.EventHandler] (Server-555)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,079 INFO  [         ome.security.basic.EventHandler] (Server-565)  Auth:    user=8,group=9,event=758042(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,082 INFO  [       ome.security.basic.CurrentDetails] (Server-565) Adding log:UPDATE,class ome.model.core.OriginalFile,72970
2014-05-14 12:32:01,112 INFO  [         ome.security.basic.EventHandler] (Server-560)  Auth:    user=8,group=9,event=758043(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,119 DEBUG [                omero.util.ServantHolder] (Server-560) Removed omero.api._RawFileStoreTie@e102e164 from omero.util.ServantHolder@de9921 as 40f4207a-e502-45f7-b519-63be4f9452b8omero.api.RawFileStore
2014-05-14 12:32:01,119 INFO  [                      omero.cmd.SessionI] (Server-560) Unregistered servant:c977d1fc-887e-41dc-9816-6c007d2a9884/40f4207a-e502-45f7-b519-63be4f9452b8omero.api.RawFileStore(omero.api._RawFileStoreTie@e102e164)
2014-05-14 12:32:01,137 INFO  [         ome.security.basic.EventHandler] (Server-544)  Auth:    user=8,group=9,event=758044(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,149 DEBUG [                omero.util.ServantHolder] (Server-544) Removed omero.api._RawPixelsStoreTie@fa14a8c3 from omero.util.ServantHolder@de9921 as fd6beb51-8579-42a8-b8ea-3cac9ba9c140omero.api.RawPixelsStore
2014-05-14 12:32:01,149 INFO  [                      omero.cmd.SessionI] (Server-544) Unregistered servant:c977d1fc-887e-41dc-9816-6c007d2a9884/fd6beb51-8579-42a8-b8ea-3cac9ba9c140omero.api.RawPixelsStore(omero.api._RawPixelsStoreTie@fa14a8c3)
2014-05-14 12:32:01,150 INFO  [         ome.security.basic.EventHandler] (Server-561)  Auth:    user=8,group=9,event=null(User),sess=c977d1fc-887e-41dc-9816-6c007d2a9884
2014-05-14 12:32:01,173 INFO  [                loci.formats.ImageReader] (Server-561) OMETiffReader initializing /nightshade/OMERO/omero-c6100-dec-5-2013-valuable/OMERO-merge-develop-FS/ManagedRepository/user-1_8/2014-05/14/12-31-59.410/single-channel.ome.tif
2014-05-14 12:32:01,218 INFO  [       loci.formats.in.MinimalTiffReader] (Server-561) Reading IFDs
2014-05-14 12:32:01,218 INFO  [       loci.formats.in.MinimalTiffReader] (Server-561) Populating metadata
2014-05-14 12:32:01,219 DEBUG [                   loci.formats.Memoizer] (Server-561) skipping save memo. elapsed millis: 68
2014-05-14 12:32:01,219 DEBUG [                   loci.formats.Memoizer] (Server-561) start[1400067121151] time[68] tag[loci.formats.Memoizer.setId]
2014-05-14 12:32:01,221 DEBUG [                omero.util.ServantHolder] (Server-561) Removed omero.api._ThumbnailStoreTie@fbe50413 from omero.util.ServantHolder@de9921 as 484ee86c-b276-4838-bdcf-ef4c22a5454comero.api.ThumbnailStore
2014-05-14 12:32:01,221 INFO  [                      omero.cmd.SessionI] (Server-561) Unregistered servant:c977d1fc-887e-41dc-9816-6c007d2a9884/484ee86c-b276-4838-bdcf-ef4c22a5454comero.api.ThumbnailStore(omero.api._ThumbnailStoreTie@fbe50413)
2014-05-14 12:32:01,221 DEBUG [                omero.util.ServantHolder] (Server-532) Removed omero.api._MetadataStoreTie@b0cff92d from omero.util.ServantHolder@de9921 as c89cf5a8-a735-4416-a107-6e43199bb8fdomero.api.MetadataStore
2014-05-14 12:32:01,221 INFO  [                      omero.cmd.SessionI] (Server-532) Unregistered servant:c977d1fc-887e-41dc-9816-6c007d2a9884/c89cf5a8-a735-4416-a107-6e43199bb8fdomero.api.MetadataStore(omero.api._MetadataStoreTie@b0cff92d)
2014-05-14 12:32:01,222 INFO  [    o.s.blitz.repo.ManagedImportRequestI] (2-thread-3) Finalizing log file.

@bramalingam
Copy link
Member

If its just at the level of reading alone. The OMETiffReader is reading the files, but the import does not happen. Is this the expectation?

@melissalinkert
Copy link
Member Author

I don't follow what you mean by the import not happening when the .companion.ome files are selected. The log files are similar (and neither contains an error message), and both screenshots suggest successful import with no errors. Do the corresponding images just not appear in Insight after refreshing the dataset list?

@bramalingam
Copy link
Member

Yes The images do not appear on insight post refreshing. Apologies for not stating that clearly.

Some Prairie datasets contain "OME-TIFF" files with a BinaryOnly entry
that points to a different "OME-TIFF", which is not valid.
@melissalinkert
Copy link
Member Author

I assume you were importing into nightshade? Has that been upgraded with this morning's merge build?

@melissalinkert
Copy link
Member Author

One more commit added as well to address BIOFORMATS-5.0-merge-full-repository test failures.

@bramalingam
Copy link
Member

Was importing into Gretzky. With the latest merge build client of insight.

@melissalinkert
Copy link
Member Author

Trying to reproduce on gretzky, I do see the images from the .companion.ome files under "Orphaned Images". Why that happens isn't completely clear to me, but I don't think that should block this PR.

@joshmoore
Copy link
Member

Asked @melissalinkert to move the HCS/non-HCS detection to a ticket in 5.0.3, @jburel, since this is likely related to DOMAIN detection in Insight and/or the ImportLibrary.

@melissalinkert
Copy link
Member Author

@joshmoore
Copy link
Member

Thanks @melissalinkert (et al).

joshmoore added a commit that referenced this pull request May 16, 2014
Add initial support for reading BinaryOnly OME-TIFF datasets
@joshmoore joshmoore merged commit b3325bc into ome:dev_5_0 May 16, 2014
@melissalinkert
Copy link
Member Author

--rebased-to #1136

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants