Skip to content

Layer and Site comments#63

Merged
jomey merged 8 commits intoapi_upload_updatefrom
layer_comments
Jul 7, 2025
Merged

Layer and Site comments#63
jomey merged 8 commits intoapi_upload_updatefrom
layer_comments

Conversation

@jomey
Copy link
Copy Markdown
Member

@jomey jomey commented Jun 12, 2025

Note that this only addresses the 'comments' as a column in the data or when passed in as kwarg with the parser. There is more work to be done to also parse the comments as part of the header/metadata fields.

Noting here that the identifier also changed between 2020 and 2021, where it was # Comments:, (2020) and # Comments,.

Needs SnowEx/snowexsql#191

jomey added 2 commits June 16, 2025 13:28
This is the first part of reworking how comments are handled. This
covers the 'comments' column under the stratigraphy data and when it is
present as a header for measurements.
This is the first part of reworking how comments are handled. This
covers the 'comments' column under the stratigraphy data and when it is
present as a header for measurements.
jomey added 2 commits June 16, 2025 15:28
Store comments found in the header or passed in as an uploader option on
the site record column.
@jomey jomey marked this pull request as ready for review June 17, 2025 23:10
@jomey jomey requested a review from Ibrahim-Ola June 18, 2025 14:46
Copy link
Copy Markdown
Contributor

@aaarendt aaarendt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Several of the layers tests fail due to no mapping for pit_comments but when I add:

PIT COMMENTS:
  code: pit_comments
  description: Comments about the pit
  map_from:
  - pit_comments
  match_on_code: true
  auto_remap: true

to metadata_variable_overrides.yaml they work.

@jomey
Copy link
Copy Markdown
Member Author

jomey commented Jun 18, 2025

Several of the layers tests fail due to no mapping for pit_comments but when I add:

PIT COMMENTS:
  code: pit_comments
  description: Comments about the pit
  map_from:
  - pit_comments
  match_on_code: true
  auto_remap: true

to metadata_variable_overrides.yaml they work.

Nice catch and I forgot to mention that.

I am leaning towards fixing that in insitupy as it has a 'pit comments' mapping in there and is improperly defined without the underscore. I logged an issue that an underscore should not break the mapping

Comment thread tests/layers/test_ssa_profile.py
Comment thread tests/layers/test_smp_profile.py
@jomey
Copy link
Copy Markdown
Member Author

jomey commented Jul 2, 2025

Related: M3Works/insitupy#27

jomey and others added 4 commits July 2, 2025 09:33
The test was passing when the whole class was run. Individually it would
fail.
Pass in the current active session to the helper, so we can lazily load
associations of the returned object.
Use the record association definition to verify the results.
@jomey
Copy link
Copy Markdown
Member Author

jomey commented Jul 2, 2025

The test suite for layers is now 🟢 again.

@micah-prime micah-prime requested a review from aaarendt July 3, 2025 18:29
@micah-prime micah-prime mentioned this pull request Jul 3, 2025
@jomey jomey merged commit 52ec880 into api_upload_update Jul 7, 2025
@jomey jomey deleted the layer_comments branch July 7, 2025 20:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants