issue #21 - Smart Emission - documentation

docs/data.rst

@@ -7,7 +7,7 @@ Data Management
 This chapter describes all technical aspects related to data within the SOSPilot project. The "data"
 as mentioned here is all related to LML RIVM data, i.e. Dutch Air Quality Data.  In 2015 this setup was
 also used to handle air quality data from the `Smart Emission (Nijmegen) project <http://www.ru.nl/gpm/onderzoek/research-projects/smart-emission/>`_.
-This is described in a separate chapter.
+This is described in a separate chapter: :ref:`smartemission`.
 
 * obtaining raw source data: measurements, stations etc.
 * data transformation (ETL) for various (OWS) services, INSPIRE and E-reporting

docs/index.rst

@@ -17,6 +17,7 @@ Contents:
    services.rst
    clients.rst
    administration.rst
+   smartemission.rst
    weather.rst
    weatherstation.rst
    raspberrypi-install.rst

src/smartem/readme.txt

@@ -4,12 +4,79 @@ Uses host-specific variables for databases, passwords etc.
 To use define a file on your host called options-<your host>.sh
 Take the example file options-sunda.sh for initial values and adapt to your host.
 
-NB for now only raw files are processed, i.e. ETL Step 1 (Harvesting) is not yet performed.
+NB for now only raw files are processed, i.e. ETL Step 1 (Harvesting, harvester.* files) is not yet performed.
 
 Only ETL Steps 2 and 3.
 
 Step 2: files2measurements: put files+stations in regular DB tables (DB sensors, schema: smartem)
-Step 3: publish stationas and observations from tables in Step2 to SOS
+Step 3: publish stations and observations from tables in Step2 to SOS
+
+------------------------------
+Data stats, op 30 sept 2015:
+
+- 175122 measurements in DB. Deze naar SOS gepubliceerd.
+
+- inlezen raw data in Postgres database: 5 minuten
+
+- publiceren naar SOS 10 minuten per 10000, plm 3 uur voor 175122 observaties
+
+- per station
+SELECT count(*), station_id from Smartem.measurements group by station_id
+
+station_id	count
+3           7150
+8           24470
+9           53228
+1           63454
+5           58
+10          26762
+
+
+-----------------------------
+Get data via REST
+Zie doc http://sensorweb.demo.52north.org/sensorwebclient-webapp-stable/api-doc/
+
+- Search (vindt procedures, timeseries etc gerelateerd aan Smart Emission)
+http://sensors.geonovum.nl/sos/api/v1/search?q=SmartEmission
+
+- Stations
+http://sensors.geonovum.nl/sos/api/v1/stations
+http://sensors.geonovum.nl/sos/api/v1/stations/67
+http://sensors.geonovum.nl/sos/api/v1/stations/68
+http://sensors.geonovum.nl/sos/api/v1/stations/69
+
+- Procedures  (Sensor stations)
+http://sensors.geonovum.nl/sos/api/v1/procedures
+http://sensors.geonovum.nl/sos/api/v1/procedures/119
+http://sensors.geonovum.nl/sos/api/v1/procedures/120
+http://sensors.geonovum.nl/sos/api/v1/procedures/121
+http://sensors.geonovum.nl/sos/api/v1/procedures/122
+http://sensors.geonovum.nl/sos/api/v1/procedures/123
+http://sensors.geonovum.nl/sos/api/v1/procedures/124
+http://sensors.geonovum.nl/sos/api/v1/procedures/125
+
+- Offerings
+http://sensors.geonovum.nl/sos/api/v1/offerings
+http://sensors.geonovum.nl/sos/api/v1/offerings/120
+http://sensors.geonovum.nl/sos/api/v1/offerings/121
+http://sensors.geonovum.nl/sos/api/v1/offerings/123
+http://sensors.geonovum.nl/sos/api/v1/offerings/125
+
+- Timeseries Data
+http://sensors.geonovum.nl/sos/api/v1/timeseries/
+
+# metadata Unit-10 O3 procedure 125
+http://sensors.geonovum.nl/sos/api/v1/timeseries/259
+
+# metadata Unit-10 NO2 procedure 125
+# Heeft data van: 2015-07-21 10:47:57 t/m 2015-07-28 07:11:08
+http://sensors.geonovum.nl/sos/api/v1/timeseries/260
+
+# Get data in ISO_8601 timerange spec: https://en.wikipedia.org/wiki/ISO_8601#Time_intervals
+http://sensors.geonovum.nl/sos/api/v1/timeseries/260/getData?timespan=2015-07-21TZ/2015-07-28TZ
+
+# CO SmartEmission-Unit-10 procedure 125
+http://sensors.geonovum.nl/sos/api/v1/timeseries/261
 
 
 

www/index.html

@@ -95,7 +95,9 @@ <h1>SOSPilot</h1>
                     <a href="http://www.eionet.europa.eu/aqportal">Eionet</a>. For this purpose a technical
                     platform, "SOSPilot" has been developed. This website provides links to various
                     elements of the SOSPilot platform. In addition, a weather station has been added to the platform.
-
+                    In 2015, Air Quality data from the
+                    <a href="http://www.ru.nl/gpm/onderzoek/research-projects/smart-emission/">Smart Emission project</a>
+                    (via <a href="http://citygis.nl/">CityGIS.nl</a>) was added to the platform.
                 </p>
                 <h1 id="doc-index" class="page-header">Documentation</h1>
                 <p>
@@ -267,9 +269,7 @@ <h1 id="services" class="page-header">Web Services</h1>
                 </p>
                 <h3 id="services-sos">52North SOS server</h3>
                 <p>
-                    Version: 20140521-SNAPSHOT with later patches from 52N<br/> See
-                    <a href="http://sensorweb.demo.52north.org/sensorwebclient-webapp-stable/api-doc/index.html">REST API doc</a>
-                    for the simpler REST API requests.
+                    Version: 20140521-SNAPSHOT with later patches from 52N<br/>
                 </p>
                 <ul>
                     <li>
@@ -312,17 +312,33 @@ <h3 id="services-sos">52North SOS server</h3>
                             GetObservation (all Temperature Observations for Geonovum Weather Station, Amersfoort)
                         </a>
                     </li>
+                 </ul>
+                <p>
+                    The <strong>REST API</strong> provides easier access to the SOS.
+                    See <a href="http://sensorweb.demo.52north.org/sensorwebclient-webapp-stable/api-doc/index.html">REST API doc</a>
+                                       for the REST API Syntax.  Below some example REST API requests
+                </p>
+                <ul>
                     <li>
-                        <a href="http://sensors.geonovum.nl/sos/api/v1/stations">REST API, Stations: http://sensors.geonovum.nl/sos/api/v1/stations</a>
-                    </li>
-                    <li>
-                        <a href="http://sensors.geonovum.nl/sos/api/v1/phenomena/">REST API, Phenomena: http://sensors.geonovum.nl/sos/api/v1/phenomena/</a>
-                    </li>
-                    <li>
-                        <a href="http://sensors.geonovum.nl/sos/api/v1/timeseries/100/getData?timespan=PT48H/2014-09-06">REST API, Time Series Data: http://sensors.geonovum.nl/sos/api/v1/timeseries/100/getData?timespan=PT48H/2014-09-06</a>
-                    </li>
-                </ul>
+                         <a href="http://sensors.geonovum.nl/sos/api/v1/stations">REST API, Stations: http://sensors.geonovum.nl/sos/api/v1/stations</a>
+                     </li>
+                     <li>
+                         <a href="http://sensors.geonovum.nl/sos/api/v1/phenomena/">REST API, Phenomena: http://sensors.geonovum.nl/sos/api/v1/phenomena/</a>
+                     </li>
+                     <li>
+                          <a href="http://sensors.geonovum.nl/sos/api/v1/timeseries">REST API, All Time Series List: http://sensors.geonovum.nl/sos/api/v1/timeseries</a>
+                      </li>
+                     <li>
+                          <a href="http://sensors.geonovum.nl/sos/api/v1/timeseries/260">REST API, Single Time Series MetaData: http://sensors.geonovum.nl/sos/api/v1/timeseries/260</a>
+                      </li>
+                     <li>
+                         <a href="http://sensors.geonovum.nl/sos/api/v1/timeseries/100/getData?timespan=PT48H/2014-09-06">REST API, Time Series Data: http://sensors.geonovum.nl/sos/api/v1/timeseries/100/getData?timespan=PT48H/2014-09-06</a>
+                     </li>
+                     <li>
+                         <a href="http://sensors.geonovum.nl/sos/api/v1/timeseries/260/getData?timespan=2015-07-21TZ/2015-07-28TZ">REST API, Time Series Data: http://sensors.geonovum.nl/sos/api/v1/timeseries/260/getData?timespan=2015-07-21TZ/2015-07-28TZ</a>
+                     </li>
 
+                </ul>
                 <!--<hr class="bs-docs-separator">-->
 
                 <h3 id="services-wmswfs">GeoServer</h3>