It's too slow to read compress level 9 VIIRS data (regrid_data_plane)

[hsoh-u]

Describe the Enhancement

This was reported via helpdesk (https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95411) as hang or stuck process with regrid_data_plane. It's 12000 by 6000 dimension with compress level 9 (highest). It was caused by reading row by row OR column by column. It needs to read whole data at once.

Time Estimate

8 hours (most time was already spent to figure out)

Sub-Issues

Consider breaking the enhancement down into sub-issues.

• Add a checkbox for each sub-issue here.

Relevant Deadlines

NONE.

Funding Source

NONE.

Define the Metadata

Assignee

• Select engineer(s) or no engineer required (Howard)
• Select scientist(s) or no scientist required (None)

Labels

• Select component(s)
• Select priority
• Select requestor(s)

Projects and Milestone

• Review projects and select relevant Repository and Organization ones
• Select milestone

Define Related Issue(s)

Consider the impact to the other METplus components.

• METplus, MET, METdb, METviewer, METexpress, METcalcpy, METplotpy

Enhancement Checklist

See the METplus Workflow for details.

• Complete the issue definition above.
• Fork this repository or create a branch of develop.
  Branch name: feature_<Issue Number>_<Description>
• Complete the development and test your changes.
• Add/update unit tests.
• Add/update documentation.
• Push local changes to GitHub.
• Submit a pull request to merge into develop.
  Pull request: feature <Issue Number> <Description>
• Iterate until the reviewer(s) accept and merge your changes.
• Delete your fork or branch.
• Close this issue.