Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Quick fix to support date/time conversion to "ISO instant" format #55

Closed
tdddblog opened this issue Jun 29, 2021 · 0 comments
Closed

Quick fix to support date/time conversion to "ISO instant" format #55

tdddblog opened this issue Jun 29, 2021 · 0 comments
Assignees
Labels

Comments

@tdddblog
Copy link
Contributor

tdddblog commented Jun 29, 2021

Motivation

Before automatic conversion of date/time fields based on LDD definition is implemented, we need a way to specify a list of date / time fields to be converted to "ISO instant" format supported by Elasticsearch.

Additional Details

  • Keep existing logic and convert all fields having "date" in their names.
  • Provide an option to list field names that need to be converted to ISO format in Harvest configuration file.

Acceptance Criteria

Given an attribute in a label that is an ASCII_Date type from PDS4, but does NOT contain date in the attribute name
When I perform the configuration noted below, and ingest the data
Then I expect harvest to convert these attributes to ISO dates

Engineering Details

An example of new dateFields element in Harvest configuration file:

<autogenFields>
  <dateFields>
    <field>cassini:VIMS_Specific_Attributes/cassini:earth_received_start_time</field>
    <field>cassini:VIMS_Specific_Attributes/cassini:earth_received_stop_time</field>
    <field>cassini:VIMS_Specific_Attributes/cassini:start_time_doy</field>
    <field>cassini:VIMS_Specific_Attributes/cassini:stop_time_doy</field>
  </dateFields>
</autogenFields>

#54 will be a future, better solution at a later date.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants