Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration of echometrics #10

Merged
merged 1 commit into from
Mar 15, 2022
Merged

Conversation

jr3cermak
Copy link

  • Add default dtypes to ascii2nc and bin2ascii argument processor.
  • Pass the data block when processing extras data.
  • If pseudogram is present, reassign echometric values with the
    extras dimension.
  • Interweave echometrics data into pseudogram with extras dimension.
  • Return data block from extras if modified.
  • Decoding the pseudogram now uses a python library "dbdreader" for
    reading the raw binary instead of a prior code. This could
    eliminate the need for any of the slocum binaries that are only
    usable on x86 systems.
  • dbdreader: https://github.com/smerckel/dbdreader
  • Updated decodePsudogram.py and teledyne.py files using "dbdreader".
  • Update covertDbd.sh with API/args updates to decodePseudogram.py

 * Add default dtypes to ascii2nc and bin2ascii argument processor.
 * Pass the data block when processing extras data.
 * If pseudogram is present, reassign echometric values with the
   extras dimension.
 * Interweave echometrics data into pseudogram with extras dimension.
 * Return data block from extras if modified.
 * Decoding the pseudogram now uses a python library "dbdreader" for
   reading the raw binary instead of a prior code.  This could
   eliminate the need for any of the slocum binaries that are only
   usable on x86 systems.
 * dbdreader: https://github.com/smerckel/dbdreader
 * Updated decodePsudogram.py and teledyne.py files using "dbdreader".
 * Update covertDbd.sh with API/args updates to decodePseudogram.py
@jr3cermak
Copy link
Author

The netCDF file that is created has echometrics variables with the extras dimension:

        double sci_echodroid_aggindex(extras) ;
                sci_echodroid_aggindex:_FillValue = -9999.9 ;
                sci_echodroid_aggindex:units = "m-1" ;
                sci_echodroid_aggindex:long_name = "Aggregation Index" ;
                sci_echodroid_aggindex:colorBarMinimum = 0. ;
                sci_echodroid_aggindex:colorBarMaximum = 1. ;
                sci_echodroid_aggindex:ioos_category = "Other" ;
                sci_echodroid_aggindex:platform = "platform" ;
                sci_echodroid_aggindex:observation_type = "measured" ;
                sci_echodroid_aggindex:coordinates = "time depth lon lat" ;

The data is inserted into the first matching pseudogram_time when multiple times exist.

sci_echodroid_aggindex = _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    _, _, _, _, 0.0379715003073215, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    0.0335540995001793, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    _, _, _, _, _, _, _, _, _, _, _, _, _, _, 0.0404663011431694, _, _, _, _, 
    _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, 
    _, _, _, _, _, _, _, _, _, _, _, _, _, 0.0362090989947319, _, _, _, _, _, 
....

Next steps?

@kwilcox kwilcox merged commit 7c36901 into SECOORA:pseudograms Mar 15, 2022
@kwilcox
Copy link
Member

kwilcox commented Mar 15, 2022

Thanks @jr3cermak! Is there anyway we can get a test written that produces the ecometrics and pseudogram data on the extras dimension so I see how the file looks? The three tests I have written for ecometrics don't end up producing any netCDF files with the extras dimension. You can send me the subset of *.*bd files and the *.cac files and I can whip up the test.

We may want to always create extras dimension for the ecometric variables, even if there is no pseudogram data available. If the ecometric variables witch between using the time dimension and the extras dimension in different profiles it will be difficult to aggregate them together over the entire deployment.

@jr3cermak jr3cermak mentioned this pull request Mar 15, 2022
6 tasks
@jr3cermak jr3cermak deleted the pseudograms branch May 4, 2022 21:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants