Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

compare whole image stats to tiled image stats to estimate impact of tiling on model performance #44

Open
rbavery opened this issue Apr 4, 2022 · 5 comments
Assignees
Projects

Comments

@rbavery
Copy link
Collaborator

rbavery commented Apr 4, 2022

No Tile Mean

category area bbox_area major_axis_length axis_minor_length_bbox
ambiguous 98232 375622 681 339
coincident_vessel 8428 599280 1042 390
infra_slick 5516 49345 251 110
natural_seep 17475 179013 436 218
old_vessel 8205 203208 608 235
recent_vessel 23912 942663 1553 558

Tiled Mean

category area bbox_area major_axis_length axis_minor_length_bbox
ambiguous 29388 57650 275 159
coincident_vessel 1659 31658 283 94
infra_slick 2333 15065 153 68
natural_seep 5355 33780 214 110
old_vessel 2284 25125 232 88
recent_vessel 3609 43873 317 124

No Tile Max

category area bbox_area major_axis_length img_name axis_minor_length_bbox
ambiguous 3917234 7999881 6246 /root/data-cv2/Recent/S1A_IW_GRDH_1SDV_20210808T023921_20210808T023946_039132_049E41_F488/ambiguous_1.png 2229
coincident_vessel 109373 6998992 7399 /root/data-cv2/Recent/S1B_IW_GRDH_1SDV_20201130T054419_20201130T054444_024490_02E940_4287/vessel_coincident_1.png 2245
infra_slick 295684 5724740 7507 /root/data-cv2/Recent/S1B_IW_GRDH_1SDV_20201023T170344_20201023T170409_023943_02D81C_6412/infrastructure_2.png 1588
natural_seep 467438 4929176 3133 /root/data-cv2/Recent/S1B_IW_GRDH_1SDV_20210805T043953_20210805T044018_028106_035A5F_D096/natural_1.png 1978
old_vessel 113868 4649160 4290 /root/data-cv2/Recent/S1B_IW_GRDH_1SDV_20210715T213255_20210715T213315_027810_03518E_6FF2/vessel_old_2.png 1462
recent_vessel 172570 6403072 6199 /root/data-cv2/Recent/S1B_IW_GRDH_1SDV_20210922T044045_20210922T044110_028806_037019_3ABC/vessel_recent_1.png 1817

Tiled Max

category area bbox_area major_axis_length img_name axis_minor_length_bbox
ambiguous 261391 262144 1032 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1B_IW_GRDH_1SDV_20200909T034850_20200909T034915_023293_02C3CD_F327_vv-image_local_tile_44.tif 512
coincident_vessel 26167 237056 876 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1B_IW_GRDH_1SDV_20210707T172027_20210707T172050_027691_034E02_CA71_vv-image_local_tile_45.tif 463
infra_slick 80153 262144 938 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1B_IW_GRDH_1SDV_20210908T174423_20210908T174448_028610_036A08_28AF_vv-image_local_tile_80.tif 512
natural_seep 151919 262144 834 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1A_IW_GRDH_1SDV_20210901T223134_20210901T223159_039494_04AAAE_FD16_vv-image_local_tile_93.tif 512
old_vessel 32626 244736 1000 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1B_IW_GRDH_1SDV_20210908T174423_20210908T174448_028610_036A08_28AF_vv-image_local_tile_80.tif 478
recent_vessel 52457 242688 857 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1B_IW_GRDH_1SDV_20210908T174423_20210908T174448_028610_036A08_28AF_vv-image_local_tile_80.tif 474

No Tile Min

category area bbox_area major_axis_length img_name axis_minor_length_bbox
ambiguous 675 3780 81 /root/data-cv2/Coincident/S1A_IW_GRDH_1SDV_20201116T052225_20201116T052250_035269_041E82_12BD/ambiguous_1.png 36
coincident_vessel 151 364 39 /root/data-cv2/Coincident/S1A_IW_GRDH_1SDV_20200729T034859_20200729T034924_033664_03E6D3_93EF/vessel_coincident_1.png 7
infra_slick 91 176 19 /root/data-cv2/Coincident/S1A_IW_GRDH_1SDV_20200814T105729_20200814T105754_033902_03EE9F_3456/infrastructure_1.png 7
natural_seep 308 882 47 /root/data-cv2/Coincident/S1A_IW_GRDH_1SDV_20210409T110701_20210409T110726_037372_046780_6870/natural_1.png 21
old_vessel 348 880 42 /root/data-cv2/Coincident/S1A_IW_GRDH_1SDV_20200729T034859_20200729T034924_033664_03E6D3_93EF/vessel_old_1.png 15
recent_vessel 1555 11607 225 /root/data-cv2/Coincident/S1A_IW_GRDH_1SDV_20200814T105729_20200814T105754_033902_03EE9F_3456/vessel_recent_1.png 53

Tiled Min

category area bbox_area major_axis_length img_name axis_minor_length_bbox
ambiguous 2 2 2 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1A_IW_GRDH_1SDV_20200729T034859_20200729T034924_033664_03E6D3_93EF_vv-image_local_tile_101.tif 1
coincident_vessel 2 4 3 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1A_IW_GRDH_1SDV_20200729T034859_20200729T034924_033664_03E6D3_93EF_vv-image_local_tile_101.tif 1
infra_slick 1 1 0 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1A_IW_GRDH_1SDV_20200723T061222_20200723T061247_033578_03E42D_AD34_vv-image_local_tile_33.tif 1
natural_seep 1 1 0 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1A_IW_GRDH_1SDV_20200729T034859_20200729T034924_033664_03E6D3_93EF_vv-image_local_tile_101.tif 1
old_vessel 1 1 0 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1A_IW_GRDH_1SDV_20200723T061222_20200723T061247_033578_03E42D_AD34_vv-image_local_tile_33.tif 1
recent_vessel 1 1 0 /root/data/tiled-cerulean-v2-partial-no-context/tiled_images_no_context/S1A_IW_GRDH_1SDV_20200723T061222_20200723T061247_033578_03E42D_AD34_vv-image_local_tile_33.tif 1

Tiled Counts

category count
ambiguous 371
coincident_vessel 476
infra_slick 1171
natural_seep 319
old_vessel 937
recent_vessel 609

No Tile Counts

category count
ambiguous 116
coincident_vessel 149
infra_slick 733
natural_seep 138
old_vessel 385
recent_vessel 121
@rbavery rbavery created this issue from a note in Cerulean ML (Sprint 6) Apr 4, 2022
@rbavery rbavery moved this from Sprint 6 to In progress in Cerulean ML Apr 4, 2022
@rbavery rbavery moved this from In progress to Sprint 6 in Cerulean ML Apr 4, 2022
@rbavery
Copy link
Collaborator Author

rbavery commented Apr 13, 2022

todo: add sample ID of min and max values for inspection

@rbavery
Copy link
Collaborator Author

rbavery commented May 6, 2022

all statistics for each instance are in these csvs files. We can use the distributions here to decide on an area threshold

all_notile.csv
all_tiled.csv

@jonaraphael
Copy link
Collaborator

Hey Ryan--can you annotate what the units are for these tables? thanks!

@rbavery
Copy link
Collaborator Author

rbavery commented May 9, 2022

sure thing. They are all in pixel units. I can reflect that in the tables. conversion to meters would require associating the projection info to annotations which we haven't done yet and would take some time so I think for now we should stick to examining pixel units if you agree @jonaraphael

@rbavery rbavery self-assigned this May 11, 2022
@rbavery
Copy link
Collaborator Author

rbavery commented May 11, 2022

To-do, update measurement to show moments or something closer to rotated bounding box lengths. rerun stats after @jonaraphael uploads natural seep scenes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Cerulean ML
Sprint 6
Development

No branches or pull requests

2 participants