Update etl.py for ETL from radio station sources

[hammad93]

This can be closed when the Python file has the ability to return structured data from the unstructured data sources below,

https://www.weather.gov/nwr/station_search
https://radio-locator.com/
https://short-wave.info/index.php

[hammad93]

https://github.com/fluids-ai/weather_radio_locator/tree/scrape
This branch was created to track changes associated with the issue.

[hammad93]

Currently, all NOAA stations according to the station_search are in this JSON file,

https://www.weather.gov/source/nwr/JS/xmitter.js

Using lat and lon, we can create a function that finds the nearest station ourselves

[hammad93]

https://radio-locator.com/cgi-bin/locate?select=lonlat&geo=y&latd=40.5536768&lond=-74.30144

Replace lat and lon here

[hammad93]

POST request to get all English stations, https://www.short-wave.info/index.php

station=Any Station
language=English
now=03
now2=43
GMT=true
submit=GO
mobile=false

[hammad93]

Currently, all NOAA stations according to the station_search are in this JSON file,

https://www.weather.gov/source/nwr/JS/xmitter.js

Using lat and lon, we can create a function that finds the nearest station ourselves

This does not include the band information. It is available from further webscraping here, https://www.weather.gov/nwr/sites?site=KZZ31 by replacing the site variable with the index from xmitter.js. This link can be included in the metadata.

[hammad93]

POST request to get all English stations, https://www.short-wave.info/index.php

station=Any Station language=English now=03 now2=43 GMT=true submit=GO mobile=false

Latitude and longitude are included in the data for each station. The default API does not search by location but we can use the same method that we use for the NOAA weather bands.