Wip/mqtt/init - tracking mqtt experiments #190

bewest · Oct 1, 2014

The corresponding uploader changes (there are a few actually)

The protobuf model:
https://github.com/nightscout/android-uploader/blob/master/core/src/main/java/com/nightscout/core/model/Download.proto

Feel free to close/ignore if this gets in the way of things, I'll move it to my personal fork if it becomes a distraction.

bewest · Oct 1, 2014

I can see some messages being delivered from some past experiment, interesting.

bewest · Oct 1, 2014

This should work with @ktind's mqtt uploader with the download model to at least debug the thing (it won't record anything yet, but should be able to receive the messages and print them).

bewest · Oct 1, 2014

Really want to arrange the last will and testament message, the on connect message, and a message for usb connection status. The combination will allow us to put a real-time widget on the web app with the connection status.

bewest · Nov 22, 2014

See also #272

bewest · Dec 5, 2014

- update protobuf to match latest from android-uploader

coveralls · Feb 26, 2015

Coverage increased (+0.07%) to 70.89% when pulling abbd231 on wip/mqtt/init into d616b6c on dev.

doesn't look like this is used by anything

coveralls · Mar 15, 2015

Coverage increased (+0.05%) to 72.74% when pulling 98417ae on wip/mqtt/init into 06c1008 on dev.

bewest · Mar 18, 2015

The rebasing includes re-plays on top of wip/bootevent/init.

coveralls · Mar 18, 2015

Changes Unknown when pulling 82032f4 on wip/mqtt/init into * on dev*.

should lo be _?

need to get sensor entries merged with sgvs

an extra file, note the trailing ~

coveralls · Mar 18, 2015

Changes Unknown when pulling 0cdd3c0 on wip/mqtt/init into * on dev*.

coveralls · Mar 18, 2015

Changes Unknown when pulling 0cdd3c0 on wip/mqtt/init into * on dev*.

coveralls · Mar 18, 2015

Changes Unknown when pulling d185010 on wip/mqtt/init into * on dev*.

coveralls · Mar 18, 2015

Changes Unknown when pulling d185010 on wip/mqtt/init into * on dev*.

coveralls · Mar 18, 2015

Changes Unknown when pulling d185010 on wip/mqtt/init into * on dev*.

bewest · Mar 19, 2015

W00t exciting
On Wed, Mar 18, 2015 at 9:55 PM Jason Calabrese notifications@github.com
wrote:

Merged #190 #190.

—
Reply to this email directly or view it on GitHub
#190 (comment)
.

bewest make mqtt experiments suitable for hacking
Uses experimental support in sgvdata for protobuf.

All checks have passed
2 successful checks

continuous-integration/travis-ci — The Travis CI build passed

Details

default — Build succeeded

Details

b9e8a5f

bewest added the ready label Nov 22, 2014

bewest referenced this pull request Dec 5, 2014
Closed
MQTT #272

bewest added in progress and removed ready labels Dec 5, 2014

bewest was assigned by jasoncalabrese Dec 14, 2014

jasoncalabrese commented on an outdated diff Mar 9, 2015

View full outdated diff
lib/entries.js

@@ -167,6 +167,11 @@ function storage(name, storage, pushover) {

});

}

+ function writeStream (opts) {

jasoncalabrese Mar 9, 2015
Owner

doesn't look like this is used by anything

jasoncalabrese commented on an outdated diff Mar 18, 2015

View full outdated diff
lib/pebble.js~

@@ -0,0 +1,187 @@

+'use strict';

jasoncalabrese Mar 18, 2015
Owner

an extra file, note the trailing ~

jasoncalabrese added this to the enchilada milestone Mar 18, 2015

jasoncalabrese referenced this pull request Mar 18, 2015
Closed
Bewest/refactor/events #229

jasoncalabrese added a commit that referenced this pull request Mar 19, 2015

jasoncalabrese Merge pull request #190 from nightscout/wip/mqtt/init
Wip/mqtt/init - tracking mqtt experiments
d0d708c

jasoncalabrese removed the in progress label Mar 19, 2015

jasoncalabrese deleted the wip/mqtt/init branch Mar 19, 2015

This was referenced Mar 19, 2015

Closed

introduce bootevent #219

Merged

Release 0.7.0 (Enchilada) #567

bewest	`get mqtt basically working, very rough`	All checks have passed 2 successful checks continuous-integration/travis-ci — The Travis CI build passed Details default — Build succeeded Details	`c8be1de`
bewest	`forgot long`		`756e9e8`
bewest	`test coverage`	Some checks were not successful 1 failing and 1 successful checks continuous-integration/travis-ci — The Travis CI build failed Details default — Build succeeded Details	`9ad7bf1`

ktind	`Quick hack to get things working`		`33e1a36`
bewest	`blarg, attempt to debug mqtt`	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`1f1bc4d`
bewest	`store each record according to own timestamp`	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`f70a031`
bewest	`tweak times and protobuf model with @ktind`	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`bf2f623`
ktind	`Adding experimental time calculation algorithm`		`70877f7`
bewest	`Merge branch 'wip/mqtt/init' of github.com:ktind/cgm-remote-monitor i…` …nto wip/mqtt/init Conflicts: lib/mqtt.js Merging @ktind's version.	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`de51d22`
ktind	`First pass at adding MGB, Sensor, Calibration, and Device Status reco…` …rds via MQTT New method to create device status with a backdated timestamp		`650bcd1`
bewest	`allow multiple instances of mqtt to multiplex` This is intended to allow multiple listeners on mqtt to each receive data from MQTT, so long as they are writing to different databases.	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`b37069e`
ktind	`Merge remote-tracking branch 'origin/wip/mqtt/init' into wip/mqtt/ini…` …t-merge Conflicts: lib/mqtt.js		`e59adfc`
ktind	`Store the download object in the entries for debugging purposes` Converting Sensor filtered and unfiltered data to a proper number		`76b9a15`
ktind	`Updating model and removing dead code`		`11a7d9d`
ktind	`Merge remote-tracking branch 'origin/dev' into wip/mqtt/init` Conflicts: lib/devicestatus.js		`e4d6675`
bewest	`fix mbg undefined`	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`6b4041a`
bewest	`only need one stream factory` Pass around the sync function for less code.	Some checks were not successful 1 failing and 1 successful checks continuous-integration/travis-ci — The Travis CI build failed Details continuous-integration/codeship — Build succeeded Details	`ddc9bf2`
bewest	`force strict zero check`	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`de7cb78`
jasoncalabrese	`Merge branch 'release/0.6.3'`	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`1b5fc82`
jasoncalabrese	`Merge pull request #413 from nightscout/release/0.6.4` Dreamsicle (Release 0.6.4)	Some checks were not successful 1 errored and 2 successful checks continuous-integration/travis-ci/push — The Travis CI build could not complete due to an error Details continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`48bdd80`
jasoncalabrese	`merged master into mqtt/init`	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci — The Travis CI build passed Details	`d529801`
jasoncalabrese	`Merge branch 'dev' into wip/mqtt/init`	All checks have passed 3 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci/pr — The Travis CI build passed Details continuous-integration/travis-ci/push — The Travis CI build passed Details	`abbd231`

jasoncalabrese	`Merge pull request #496 from nightscout/wip/context-range-fix` context range fix	All checks have passed 2 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci/push — The Travis CI build passed Details	`a291a0e`
bewest	`rebasing, it seems to run`		`469d868`
bewest	`fix broken test`		`1a38f4e`
bewest	`bring back ensureIndexes` Make sure indexes are created for commonly sought fields.		`6705b62`
bewest	`Merge branch 'wip/mqtt/rebased' into wip/mqtt/init` Resolved Conflicts: lib/devicestatus.js package.json server.js	All checks have passed 3 successful checks continuous-integration/codeship — Build succeeded Details continuous-integration/travis-ci/pr — The Travis CI build passed Details continuous-integration/travis-ci/push — The Travis CI build passed Details	`82032f4`

+    +}
+    +
+    +
+    +function make_timestamp ( ) {
+    +}
+    +
+    +function make_field ( ) {
+    +}
+    +
+    +function sanitizer (opts) {
+    +
+    +}
+    +
+    +function index (opts) {
+    +  function calc (data) {
+    +    var o = lo.pick(data, opts.keys);

+    +                console.log("WRITE TO MONGO");
+    +                var download_timestamp = moment(packet.download_timestamp);
+    +                if (packet.download_status === 0) {
+    +                    iter_mqtt_record_stream(packet, 'sgv', toSGV)
+    +                      .pipe(core.persist(function empty(err, result) {
+    +                          console.log("DONE WRITING SGV TO MONGO", err, result.length);
+    +                      }));
+    +                    iter_mqtt_record_stream(packet, 'cal', toCal)
+    +                      .pipe(core.persist(function empty(err, result) {
+    +                          console.log("DONE WRITING Cal TO MONGO", err, result.length);
+    +                      }));
+    +                    iter_mqtt_record_stream(packet, 'meter', toMeter)
+    +                      .pipe(core.persist(function empty(err, result) {
+    +                          console.log("DONE WRITING Meter TO MONGO", err, result.length);
+    +                      }));
+    +                    iter_mqtt_record_stream(packet, 'sensor', toSensor)

nightscout/cgm-remote-monitor

Join GitHub today

Wip/mqtt/init - tracking mqtt experiments #190

Conversation

bewest commented Oct 1, 2014

bewest added some commits Aug 2, 2014

All checks have passed

All checks have passed

All checks have passed

All checks have passed

bewest commented Oct 1, 2014

All checks have passed

bewest commented Oct 1, 2014

bewest commented Oct 1, 2014

bewest added the ready label Nov 22, 2014

bewest commented Nov 22, 2014

bewest added some commits Nov 23, 2014

All checks have passed

Some checks were not successful

bewest referenced this pull request Dec 5, 2014

bewest commented Dec 5, 2014

bewest added in progress and removed ready labels Dec 5, 2014

bewest was assigned by jasoncalabrese Dec 14, 2014

ktind and others added some commits Dec 26, 2014

All checks have passed

All checks have passed

All checks have passed

All checks have passed

All checks have passed

All checks have passed

Some checks were not successful

All checks have passed

All checks have passed

Some checks were not successful

All checks have passed

All checks have passed

coveralls commented Feb 26, 2015

All checks have passed

Show 1 comment Hide comment jasoncalabrese commented on an outdated diff Mar 9, 2015

All checks have passed

coveralls commented Mar 15, 2015

jasoncalabrese and others added some commits Mar 18, 2015

All checks have passed

All checks have passed

bewest commented Mar 18, 2015

coveralls commented Mar 18, 2015

Show 1 comment Hide comment jasoncalabrese commented on an outdated diff Mar 18, 2015

jasoncalabrese commented on the diff Mar 18, 2015

Show 1 comment Hide comment jasoncalabrese commented on an outdated diff Mar 18, 2015

All checks have passed

coveralls commented Mar 18, 2015

coveralls commented Mar 18, 2015

bewest added some commits Mar 18, 2015

All checks have passed

All checks have passed

coveralls commented Mar 18, 2015

coveralls commented Mar 18, 2015

coveralls commented Mar 18, 2015

jasoncalabrese added this to the enchilada milestone Mar 18, 2015

jasoncalabrese referenced this pull request Mar 18, 2015

jasoncalabrese added a commit that referenced this pull request Mar 19, 2015

Hide details View details jasoncalabrese merged commit d0d708c into dev Mar 19, 2015 3 checks passed

3 checks passed

jasoncalabrese removed the in progress label Mar 19, 2015

jasoncalabrese deleted the wip/mqtt/init branch Mar 19, 2015

bewest commented Mar 19, 2015

This was referenced Mar 19, 2015

jasoncalabrese commented on an outdated diff Mar 9, 2015

jasoncalabrese commented on an outdated diff Mar 18, 2015

jasoncalabrese commented on an outdated diff Mar 18, 2015

jasoncalabrese merged commit `d0d708c` into dev Mar 19, 2015
3 checks passed