Skip to content

[FEATURE] - Modflow6Simulation.split: warn on spatially unchunked input #1691

@Huite

Description

@Huite

Related to #1686: it may be worthwhile to detect if the model to split is unchunked. As mentioned in the PR, this will lead to massive IO waste when writing the parallel partitions. I'm not sure on how best to word this.

There is also the distinction between structured and unstsructured inputs. A structured model can be trivially chunked along x and y. To solve the partition-related overhead, it would be sufficient to set the relevant encoding in a dump method.

This isn't the case for the unstructured case, where the internal topology ordering is essential. We could define a reorder method on the model, but it feels a bit messy to me. For structured data, I guess it would be a no-op. Perhaps a pragmatic solution is to allow it to be called internally (as an xugrid method) in the dump method: if the data is unstructured and not already ordered, then it ordered automatically before being written to Zarr or netCDF chunks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    Status

    📯 New

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions