RC v0.0.4

[aburrell]

Release candidate for version 0.0.4:

• Update the version number
• Verify and update Zenodo information in .zeondo.json
• doc tests pass locally
• activate this branch on readthedocs (https://pysatmadrigal.readthedocs.io/en/rc_v0.0.4/index.html)
• Upload the test distribution to the testPyPi server - https://test.pypi.org/project/pysatMadrigal/0.0.4/
• Contacted developers and users about the future release
• Performed integration tests with downstream packages (include list of these packages)
• Create a wiki page with the release text (https://github.com/pysat/pysatMadrigal/wiki/v0.0.4)
• After approval, confirm all changes from the RC pull are listed in the wiki release text.

[rstoneback]

Made a visual pass through the code. Planning at poking at the instruments as well.

[rstoneback]

I did some extra checks with DMSP. I have an admixture of hdf and 'simple' files. When loading all of the data at once, the data from the simple file ends up at the end rather than in time order. strict_time_flag=False here.

In [28]: dmsp.files.files                                                                                                                                                 
Out[28]: 
2011-08-15         dms_ut_20110815_15.002.hdf5
2011-08-16         dms_ut_20110816_15.002.hdf5
2011-08-17         dms_ut_20110817_15.002.hdf5
2011-08-18    dms_ut_20110818_15.002.simple.gz
2012-05-13         dms_ut_20120513_15.002.hdf5
2012-05-14         dms_ut_20120514_15.002.hdf5
2012-05-15         dms_ut_20120515_15.002.hdf5
2012-05-16         dms_ut_20120516_15.002.hdf5
2012-05-17         dms_ut_20120517_15.002.hdf5
dtype: object

In [29]: dmsp.load()                                                                                                                                                      
/Users/russellstoneback/opt/anaconda3/envs/standard3/bin/ipython:1: UserWarning:  Loaded data is not monotonically increasing. 
  #!/Users/russellstoneback/opt/anaconda3/envs/standard3/bin/python

In [30]: dmsp.index.is_monotonic_increasing                                                                                                                               
Out[30]: False

[rstoneback]

I've verified the output from the first suggested change for DMSP.
Note the duplicate filenames arises since I have both 'simple' and regular files for a few common days.

In [1]: import pysat                                                                                                                                                      

In [2]: dmsp = pysat.Instrument('dmsp', 'ivm', tag='utd', inst_id='f15')                                                                                                  
pysat WARNING: Duplicate datetimes in stored filename information.
Keeping one of each of the duplicates, dropping the rest. Please ensure the file datetimes are unique at the microsecond level.
pysat WARNING: DatetimeIndex(['2011-08-16', '2011-08-17'], dtype='datetime64[ns]', freq=None)

In [3]: dmsp.load()                                                                                                                                                       
First sort

In [4]: dmsp.data                                                                                                                                                         
Out[4]: 
                       year  month   day  hour   min   sec    recno   kindat   kinst  ...  phe+   ph+      ti      te  rpa_flag_ut  idm_flag_ut  rms_x  sigma_vy  sigma_vz
2011-08-15 00:22:03  2011.0    8.0  15.0   0.0  22.0   3.0    330.0  10245.0  8100.0  ...  0.02  0.08  1577.0  2000.0          1.0          1.0   0.03      21.6      31.5

Trying to check out GNSS with mixed files and I'm getting an error. Trying to load an hdf and netcdf file over a two day span.

In [21]: gnss.load(date=dt.datetime(2017, 11, 17), end_date=dt.datetime(2017, 11, 19))                                                                                    
---------------------------------------------------------------------------
AssertionError                            Traceback (most recent call last)

AssertionError: 3 columns passed, passed data had 16 columns

[rstoneback]

I got the same error independent of file type order.

[rstoneback]

I checked out the loading with mixed hdf and netcdf and it works for all tested order variants. I must've done something wrong pulling down the latest code when I last checked a few days ago. Sorry about that.

[jklenzing]

Minor documentation update