Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Table D sequence for reporting marine observations from unmanned surface vehicles #8

Closed
efucile opened this issue Apr 20, 2020 · 12 comments

Comments

@efucile
Copy link
Member

efucile commented Apr 20, 2020

Branch

https://github.com/wmo-im/BUFR4/tree/issue-8

Summary and purpose

New sequence for the reporting of met-ocean observations from unmanned surface vehicles.

Action proposed

The meeting is requested to review and approve the contents of this proposal for validation status.

Discussions

Observations from unmanned, or autonomous, surface vehicles are currently converted to BUFR and inserted on to the GTS using the sequence for drifting buoys (315009). However, this sequence is inadequate for the full range of observable parameters and sensors on the surface vehicles. Additionally, the use of the incorrect template leads the observations being mis-attributed to drifting buoys, resulting in the location and platform motion being incorrectly flagged by quality control / assurance systems. The sequence proposed in this document seeks to address these issues.

Dr David Berry, representative from Joint WMO-IOC Technical Commission for Oceanography and Marine Meteorology (JCOMM), proposed a Table D sequence to address these issues as in the Annex to this paragraph.

Dr Berry hoped the proposal would be validated by November 2019 and operational by FT2020-1. ECMWF, NOAA/NWS and DWD will assist the validation.

Detailed proposal

Add new entry to BUFR Table D

Category 15 – Oceanographic report sequences

Table Reference Table References Element Name Element Description
FXXYYY
315011   Met-ocean observations from unmanned surface vehicles  
  301150 (WIGOS identifier)  
  001036 Agency in charge of operating the observing platform  
  001085 Observing platform manufacturer’s model  
  001086 Observing platform manufacturer’s serial number  
  003001 Surface station type  
  208032 Change width of CCITT IA5 field  
  001079 Unique ID for profile UUID for report, 32 character hex string
  208000 Change width of CCITT IA5 field  
  301011 Year, month, day  
  301012 Hour, minute  
  301021 (Latitude/longitude (high accuracy))  
  001012 Direction of motion of moving observing platform  
  001013 Speed of motion of moving platform  
  103000 Delayed replication of 3 descriptor  
  031000 Short delayed descriptor replication factor  
  007031 Height of barometer above mean sea level  
  306038 Sequence for representation of standard surface marine meteorological observations from moored buoys  
  012161 Skin temperature  
  101000 Delayed replication of 1 descriptors  
  031000 Short delayed descriptor replication factor  
  306034 (Surface current)  
  101000 Delayed replication of 1 descriptor  
  031000 Short delayed descriptor replication factor  
  306039 (Sequence for representation of basic wave measurements)  
  101000 Delayed replication of 1 descriptors  
  031000 Short delayed descriptor replication factor  
  306033 (Surface salinity)  
  101000 Delayed replication of 1 descriptor  
  031000 Short delayed descriptor replication factor  
  306041 (Depth and temperature profile (high accuracy/precision))  
  101000 Delayed replication of 1 descriptors  
  031000 Short delayed descriptor replication factor  
  306004 (Depth, temperature, salinity)  
  101000 Delayed replication of 1 descriptor  
  031000 Short delayed descriptor replication factor  
  306005 Sub-surface current measurements  
  105000 Delayed replication of 5 descriptors  
  031000 Short delayed descriptor replication factor  
  041001 pCO2  
  008043 Atmospheric chemical or physical constituent type  
  015028 Mole fraction of atmospheric constituent / pollutant in dry air  
  008043 Atmospheric chemical or physical constituent type  
  013080 Water pH  
  104000 Delayed replication of 4 descriptors  
  031000 Short delayed descriptor replication factor  
  041005 Turbidity  
  041003 Dissolved nitrates  
  022188 Dissolved oxygen  
  041002 Fluorescence  
  101000 Delayed replication of 1 descriptor  
  031000 Short delayed descriptor replication factor  
  306040 (Sequence for representation of detailed spectral wave measurements)  
  104000 Delayed replication of 4 descriptors  
  031000 Short delayed descriptor replication factor  
  008021 Time significance  
  004025 Time period or displacement  
  014017 Instantaneous long-wave radiation  
  014018 Instantaneous short-wave radiation  

Expanded proposed sequence 315011
Met-ocean observations from unmanned surface vehicles

Table References Element Name
FXXYYY1 FXXYYY2
Identification
301150  
  001125
  001126
  001127
  001128
001036  
001085  
001086  
003001  
208032  
001079  
208000  
Date, time, location and motion
301011  
  004001
  004002
  004003
301012  
  004004
  004005
301021  
  005001
  006001
001012  
001013  
Basic meteorological observations
103000  
031000  
007031  
306038  
  010004
  010051
  007033
  012101
  012103
  013003
  007033
  008021
  004025
  011001
  011002
  008021
  004025
  011041
  004025
  007033
  002005
  007063
  022049
012161  
Surface currents
101000  
031000  
306034  
  002031
  003010
  002040
  022005
  022032
Surface waves
101000  
031000  
306039  
  022078
  022070
  022073
  022074
  022071
  022076
  022077
Surface salinity
101000  
031000  
306033  
  002033
  007063
  022064
Temperature profile
101000  
031000  
306041  
  002032
  102000
  031001
  007062
  022043
Temperature and salinity profile
101000  
031000  
306004  
  002032
  002033
  103000
  031001
  007062
  022043
  022062
Current profile
101000  
031000  
306005  
  002031
  103000
  031001
  007062
  022004
  022031
pCO2
105000  
031000  
041001  
008043  
015028  
008043  
013080  
Dissolved nitrates, oxygen and turbidity
104000  
031000  
041005  
041003  
022188  
041002  
Spectral wave measurements
101000  
031000  
306040  
  022078
  022082
  106000
  031001
  022080
  022069
  022086
  022087
  022088
  022089
Radiation
104000  
031000  
008021  
004025  
014017  
014018  

Reference document: https://wmoomm.sharepoint.com/:w:/s/wmocpdb/EbjXX95DCrJDn838EdH98a0BWvJkCaMNKG37ocLadRcIVw?e=v1AtKi

Reference meeting: https://community.wmo.int/activity-areas/wmo-codes/meetings/ipet-cm-iii

@david-i-berry
Copy link
Member

Hi Enrico,

I think this is in the wrong project and is a duplicate of #6.

Cheers,

Dave.

@efucile
Copy link
Member Author

efucile commented Apr 20, 2020

@DavidBerryNOC absolutely correct. I need to get used to the multiple repos

@efucile efucile transferred this issue from wmo-im/GRIB2 Apr 20, 2020
@efucile efucile added this to In validation in BUFR4 (old) Apr 20, 2020
@efucile
Copy link
Member Author

efucile commented Apr 20, 2020

@DavidBerryNOC it's in the correct place now!

@david-i-berry
Copy link
Member

As part of the validation process the sequence has been modified, the revised proposal can be found below.

As part of this name has been changed from unmanned surface vehicles to autonomous surface vehicles.

PROPOSAL
(Details of proposal)
Add new entry to BUFR Table D
Category 15 – Oceanographic report sequences

Table Reference Table References Element Name Description
F XX YYY F XX YYY
3 15 011 Met-ocean observations from autonomous surface vehicles
  3 01 150 (WIGOS identifier)
  0 01 087 WMO marine observing platform extended identifier
  0 01 036 Agency in charge of operating the observing platform
  0 01 085 Observing platform manufacturer’s model
  0 01 086 Observing platform manufacturer’s serial number
  0 03 001 Surface station type
  2 08 032 Change width of CCITT IA5 field
  0 01 079 Unique ID for profile UUID for report, 32 character hex string
  2 08 000 Change width of CCITT IA5 field
  3 01 011 Year, month, day
  3 01 012 Hour, minute
  3 01 021 (Latitude/longitude (high accuracy))
  0 01 012 Direction of motion of moving observing platform
  0 01 014 Platform drift speed (high precision)
  0 11 104 True heading of aircraft, ship or other mobile platform[DB2]
  1 03 000 Delayed replication of 3 descriptor
  0 31 000 Short delayed descriptor replication factor
  0 07 031 Height of barometer above mean sea level
  3 06 038 Sequence for representation of standard surface marine meteorological observations from moored buoys
  0 12 161 Skin temperature
  1 01 000 Delayed replication of 1 descriptors
  0 31 000 Short delayed descriptor replication factor
  3 06 034 (Surface current)
  1 01 000 Delayed replication of 1 descriptor
  0 31 000 Short delayed descriptor replication factor
  3 06 039 (Sequence for representation of basic wave measurements)
  1 01 000 Delayed replication of 1 descriptors
  0 31 000 Short delayed descriptor replication factor
  3 06 033 (Surface salinity)
  1 01 000 Delayed replication of 1 descriptor
  0 31 000 Short delayed descriptor replication factor
  3 06 041 (Depth and temperature profile (high accuracy/precision))
  1 01 000 Delayed replication of 1 descriptors
  0 31 000 Short delayed descriptor replication factor
  3 06 004 (Depth, temperature, salinity)
  1 01 000 Delayed replication of 1 descriptor
  0 31 000 Short delayed descriptor replication factor
  3 06 005 Sub-surface current measurements
  1 05 000 Delayed replication of 5 descriptors
  0 31 000 Short delayed descriptor replication factor
  0 41 001 pCO2
  0 08 043 Atmospheric chemical or physical constituent type
  0 15 028 Mole fraction of atmospheric constituent / pollutant in dry air
  0 08 043 Atmospheric chemical or physical constituent type
  0 13 080 Water pH
  1 04 000 Delayed replication of 4 descriptors
  0 31 000 Short delayed descriptor replication factor
  0 41 005 Turbidity
  0 41 003 Dissolved nitrates
  0 22 188 Dissolved oxygen
  0 41 002 Fluorescence
  1 01 000 Delayed replication of 1 descriptor
  0 31 000 Short delayed descriptor replication factor
  3 06 040 (Sequence for representation of detailed spectral wave measurements)
  1 04 000 Delayed replication of 4 descriptors
  0 31 000 Short delayed descriptor replication factor
  0 08 021 Time significance
  0 04 025 Time period or displacement
  0 14 017 Instantaneous long-wave radiation
  0 14 018 Instantaneous short-wave radiation

@efucile efucile added this to the FT-2020-2 milestone May 7, 2020
@efucile efucile added the branch label May 27, 2020
chenxiaoxia2019 added a commit that referenced this issue May 27, 2020
Table D sequence for reporting marine observations from unmanned surface vehicles #8
chenxiaoxia2019 added a commit that referenced this issue May 27, 2020
enter BURF table D 15-315011
chenxiaoxia2019 added a commit that referenced this issue May 27, 2020
Table D sequence for reporting marine observations from unmanned surface vehicles
#8
chenxiaoxia2019 added a commit that referenced this issue May 27, 2020
Table D sequence for reporting marine observations from unmanned surface vehicles
#8
chenxiaoxia2019 added a commit that referenced this issue May 27, 2020
Table D sequence for reporting marine observations from unmanned surface vehicles
#8
@chenxiaoxia2019
Copy link
Contributor

@DavidBerryNOC Hi, David, I have already created the branch for this issue, could you please check it and review the table with new entries? Thanks.

@david-i-berry
Copy link
Member

The addition to Table D (based on the merged file) is correct and I am able to use it in my decoding software and example file.

I'll upload samples shortly.

@david-i-berry
Copy link
Member

Sample files (NetCDF, BUFR and decoded text) plus encoding software can be found at

https://github.com/DavidBerryNOC/bufr_saildrone

@marijanacrepulja
Copy link
Contributor

@david-i-berry
Copy link
Member

david-i-berry commented Jun 5, 2020

Thanks @marijanacrepulja.

With exception of truncation of decimal places for location elements and blank padding of strings in decoded output the output is identical to that expected.

Comparison of expected vs ecCodes given in attached files.

saildrone_comparison.xlsx

I've added the validated label as I believe this is now complete.

@jbathegit
Copy link
Contributor

@DavidBerryNOC I was also able to read your saildrone-gen_5-tpos_pmel_2019_003-sd1066-20190717T120000-20190717T135959-1_minutes-v1.1563373962076.bufr using the NCEP BUFRLIB software, and a spot-check of the first 5 subsets agreed with the decoded values shown in your sample output listing.

@chenxiaoxia2019 chenxiaoxia2019 moved this from In validation to Ready for Submission to NFP in BUFR4 (old) Jul 1, 2020
@amilan17
Copy link
Member

SUMMARY: Add entries to Table D Category 15.

@amilan17
Copy link
Member

Approved by FT 2020-2.

@amilan17 amilan17 moved this from Ready for Submission to NFP to Operational in BUFR4 (old) Oct 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
BUFR4 (old)
  
Operational
Development

No branches or pull requests

6 participants