Infinite updates for a github issue

[djmitche]

https://github.com/taskcluster/json-e/issues/200 seems to be changing every time bugwarrior runs.

From pending.data:

[annotation_1509630624:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200" description:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200 Invalid date-time can be generated, intermittently" entry:"1509630624" githubbody:"STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with &dquot;InputValidationError&dquot;\n\nThis is the error:\n```\n{\n  &dquot;code&dquot;: &dquot;InputValidationError&dquot;,\n  &dquot;message&dquot;: &dquot;\nSchema Validation Failed!\nRejecting Schema: http:\/\/schemas.taskcluster.net\/queue\/v1\/create-task-request.json#\nErrors:\n  * data.created should match format \\&dquot;date-time\\&dquot;\n  * data.deadline should match format \\&dquot;date-time\\&dquot;\n  * data.expires should match format \\&dquot;date-time\\&dquot;\n----\nmethod:     createTask\nerrorCode:  InputValidationError\nstatusCode: 400\ntime:       2017-11-01T22:00:22.006Z&dquot;,\n  &dquot;requestInfo&dquot;: {\n    &dquot;method&dquot;: &dquot;createTask&dquot;,\n    &dquot;params&dquot;: {\n      &dquot;taskId&dquot;: &dquot;VTVCJR8yRB2OUSFzEiztmg&dquot;\n    },\n    &dquot;payload&dquot;: {\n      &dquot;provisionerId&dquot;: &dquot;aws-provisioner-v1&dquot;,\n      &dquot;schedulerId&dquot;: &dquot;taskcluster-github&dquot;,\n      &dquot;metadata&dquot;: {\n        &dquot;source&dquot;: &dquot;https:\/\/github.com\/mozilla\/DeepSpeech.git&dquot;,\n        &dquot;description&dquot;: &dquot;Building DeepSpeech for Linux\/AMD64, CUDA-enabled, optimized version&dquot;,\n        &dquot;name&dquot;: &dquot;DeepSpeech Linux AMD64 CUDA&dquot;,\n        &dquot;owner&dquot;: &dquot;reuben.morais@gmail.com&dquot;\n      },\n      &dquot;workerType&dquot;: &dquot;deepspeech-worker&dquot;,\n      &dquot;deadline&dquot;: &dquot;2017-11-02T22:00:09&dquot;,\n      &dquot;extra&dquot;: {\n        &dquot;github&dquot;: {\n          &dquot;events&dquot;: &open;\n            &dquot;pull_request.opened&dquot;,\n            &dquot;pull_request.synchronize&dquot;,\n            &dquot;pull_request.reopened&dquot;\n          &close;,\n          &dquot;env&dquot;: true\n        }\n      },\n      &dquot;payload&dquot;: {\n        &dquot;maxRunTime&dquot;: 14400,\n        &dquot;command&dquot;: &open;\n          &dquot;\/bin\/bash&dquot;,\n          &dquot;--login&dquot;,\n          &dquot;-cxe&dquot;,\n          &dquot;apt-get -qq update && apt-get -qq -y install git pixz wget pkg-config libsox-dev && true && adduser --system --home \/home\/build-user build-user && cd \/home\/build-user\/ && echo -e \\&dquot;#!\/bin\/bash\nset -xe\n env && id && (wget -O - $TENSORFLOW_BUILD_ARTIFACT | pixz -d | tar -C \/home\/build-user\/ -xf - ) && git clone --quiet https:\/\/github.com\/mozilla\/DeepSpeech.git ~\/DeepSpeech\/ds\/ && cd ~\/DeepSpeech\/ds && git checkout --quiet 4a10d400da51df8abd77c09b79c16982b58988a1 && ln -s ~\/DeepSpeech\/ds\/native_client\/ ~\/DeepSpeech\/tf\/native_client\\&dquot; > \/tmp\/clone.sh && chmod +x \/tmp\/clone.sh && sudo -H -u build-user \/bin\/bash \/tmp\/clone.sh && \/home\/build-user\/DeepSpeech\/tf\/tc-apt.sh && true && sudo -H -u build-user --preserve-env \/bin\/bash \/home\/build-user\/DeepSpeech\/ds\/taskcluster\/cuda-build.sh && sudo -H -u build-user \/bin\/bash \/home\/build-user\/DeepSpeech\/ds\/taskcluster\/cuda-package.sh\n&dquot;\n        &close;,\n        &dquot;image&dquot;: &dquot;ubuntu:14.04&dquot;,\n        &dquot;artifacts&dquot;: {\n          &dquot;public&dquot;: {\n            &dquot;path&dquot;: &dquot;\/tmp\/artifacts\/&dquot;,\n            &dquot;type&dquot;: &dquot;directory&dquot;,\n            &dquot;expires&dquot;: &dquot;2017-11-08T22:00:09&dquot;\n          }\n        },\n        &dquot;env&dquot;: {\n          &dquot;DEEPSPEECH_TEST_MODEL&dquot;: &dquot;https:\/\/queue.taskcluster.net\/v1\/task\/Px4oq0S1Q0a3K0dV6_9htg\/runs\/0\/artifacts\/public\/output_graph.pb&dquot;,\n          &dquot;DEEPSPEECH_PROD_MODEL&dquot;: &dquot;https:\/\/github.com\/lissyx\/DeepSpeech\/releases\/download\/0.0.2\/tc-fake-prod.988_e120.LSTM.ldc93s1.pb&dquot;,\n          &dquot;TENSORFLOW_BUILD_ARTIFACT&dquot;: &dquot;https:\/\/index.taskcluster.net\/v1\/task\/project.deepspeech.tensorflow.pip.master.gpu\/artifacts\/public\/home.tar.xz&dquot;,\n          &dquot;SUMMARIZE_GRAPH_BINARY&dquot;: &dquot;https:\/\/index.taskcluster.net\/v1\/task\/project.deepspeech.tensorflow.pip.master.gpu\/artifacts\/public\/summarize_graph&dquot;\n        }\n      },\n      &dquot;created&dquot;: &dquot;2017-11-01T22:00:09&dquot;,\n      &dquot;taskGroupId&dquot;: &dquot;daayUA2aTPaw9BLms_p72g&dquot;,\n      &dquot;dependencies&dquot;: &open;&close;,\n      &dquot;expires&dquot;: &dquot;2017-11-08T22:00:09&dquot;,\n      &dquot;requires&dquot;: &dquot;all-completed&dquot;,\n      &dquot;routes&dquot;: &open;&close;,\n      &dquot;priority&dquot;: &dquot;lowest&dquot;,\n      &dquot;retries&dquot;: 5,\n      &dquot;scopes&dquot;: &open;&close;,\n      &dquot;tags&dquot;: {}\n    },\n    &dquot;time&dquot;: &dquot;2017-11-01T22:00:22.006Z&dquot;\n  }\n}\n```\n\nAs you can see, `created`, `deadline` and `expires` are all invalid because they lack the timezone info. It is generated here &open;https:\/\/github.com\/mozilla\/DeepSpeech\/blob\/12dee36a43fbbebcccf1a3c2cbc8946c54924f7d\/taskcluster\/linux-opt-base.tyml#L10-L15&close;:\n```\ncreated: { $fromNow: '0 sec' }\ndeadline: { $fromNow: '1 day' }\nexpires:\n  $if: 'event.event == &dquot;push&dquot;'\n  then: { $fromNow: '6 months' }\nelse: { $fromNow: '7 days' }\n```\n\nThis template is being ingested by JSON-e Python module." githubcreatedon:"1509582508" githubnumber:"200.000000" githubrepo:"taskcluster\/json-e" githubtitle:"Invalid date-time can be generated, intermittently" githubtype:"issue" githubupdatedat:"1509627314" githuburl:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200" githubuser:"lissyx" modified:"1511027418" priority:"M" project:"moz" status:"pending" uuid:"7b765533-1ff5-42cc-a112-8de66cc04b2e"]

and the undo log looks like lots of

---
time 1511029191
old [annotation_1509630624:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200" description:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200 Invalid date-time can be generated, intermittently" entry:"1509630624" githubbody:"STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with &dquot;InputValidationError&dquot;\n\nThis is the error:\n```\n{\n  &dquot;code&dquot;: &dquot;InputValidationError&dquot;,\n  &dquot;message&dquot;: &dquot;\nSchema Validation Failed!\nRejecting Schema: http:\/\/schemas.taskcluster.net\/queue\/v1\/create-task-request.json#\nErrors:\n  * data.created should match format \\&dquot;date-time\\&dquot;\n  * data.deadline should match format \\&dquot;date-time\\&dquot;\n  * data.expires should match format \\&dquot;date-time\\&dquot;\n----\nmethod:     createTask\nerrorCode:  InputValidationError\nstatusCode: 400\ntime:       2017-11-01T22:00:22.006Z&dquot;,\n  &dquot;requestInfo&dquot;: {\n    &dquot;method&dquot;: &dquot;createTask&dquot;,\n    &dquot;params&dquot;: {\n      &dquot;taskId&dquot;: &dquot;VTVCJR8yRB2OUSFzEiztmg&dquot;\n    },\n    &dquot;payload&dquot;: {\n      &dquot;provisionerId&dquot;: &dquot;aws-provisioner-v1&dquot;,\n      &dquot;schedulerId&dquot;: &dquot;taskcluster-github&dquot;,\n      &dquot;metadata&dquot;: {\n        &dquot;source&dquot;: &dquot;https:\/\/github.com\/mozilla\/DeepSpeech.git&dquot;,\n        &dquot;description&dquot;: &dquot;Building DeepSpeech for Linux\/AMD64, CUDA-enabled, optimized version&dquot;,\n        &dquot;name&dquot;: &dquot;DeepSpeech Linux AMD64 CUDA&dquot;,\n        &dquot;owner&dquot;: &dquot;reuben.morais@gmail.com&dquot;\n      },\n      &dquot;workerType&dquot;: &dquot;deepspeech-worker&dquot;,\n      &dquot;deadline&dquot;: &dquot;2017-11-02T22:00:09&dquot;,\n      &dquot;extra&dquot;: {\n        &dquot;github&dquot;: {\n          &dquot;events&dquot;: &open;\n            &dquot;pull_request.opened&dquot;,\n            &dquot;pull_request.synchronize&dquot;,\n            &dquot;pull_request.reopened&dquot;\n          &close;,\n          &dquot;env&dquot;: true\n        }\n      },\n      &dquot;payload&dquot;: {\n        &dquot;maxRunTime&dquot;: 14400,\n        &dquot;command&dquot;: &open;\n          &dquot;\/bin\/bash&dquot;,\n          &dquot;--login&dquot;,\n          &dquot;-cxe&dquot;,\n          &dquot;apt-get -qq update && apt-get -qq -y install git pixz wget pkg-config libsox-dev && true && adduser --system --home \/home\/build-user build-user && cd \/home\/build-user\/ && echo -e \\&dquot;#!\/bin\/bash\nset -xe\n env && id && (wget -O - $TENSORFLOW_BUILD_ARTIFACT | pixz -d | tar -C \/home\/build-user\/ -xf - ) && git clone --quiet https:\/\/github.com\/mozilla\/DeepSpeech.git ~\/DeepSpeech\/ds\/ && cd ~\/DeepSpeech\/ds && git checkout --quiet 4a10d400da51df8abd77c09b79c16982b58988a1 && ln -s ~\/DeepSpeech\/ds\/native_client\/ ~\/DeepSpeech\/tf\/native_client\\&dquot; > \/tmp\/clone.sh && chmod +x \/tmp\/clone.sh && sudo -H -u build-user \/bin\/bash \/tmp\/clone.sh && \/home\/build-user\/DeepSpeech\/tf\/tc-apt.sh && true && sudo -H -u build-user --preserve-env \/bin\/bash \/home\/build-user\/DeepSpeech\/ds\/taskcluster\/cuda-build.sh && sudo -H -u build-user \/bin\/bash \/home\/build-user\/DeepSpeech\/ds\/taskcluster\/cuda-package.sh\n&dquot;\n        &close;,\n        &dquot;image&dquot;: &dquot;ubuntu:14.04&dquot;,\n        &dquot;artifacts&dquot;: {\n          &dquot;public&dquot;: {\n            &dquot;path&dquot;: &dquot;\/tmp\/artifacts\/&dquot;,\n            &dquot;type&dquot;: &dquot;directory&dquot;,\n            &dquot;expires&dquot;: &dquot;2017-11-08T22:00:09&dquot;\n          }\n        },\n        &dquot;env&dquot;: {\n          &dquot;DEEPSPEECH_TEST_MODEL&dquot;: &dquot;https:\/\/queue.taskcluster.net\/v1\/task\/Px4oq0S1Q0a3K0dV6_9htg\/runs\/0\/artifacts\/public\/output_graph.pb&dquot;,\n          &dquot;DEEPSPEECH_PROD_MODEL&dquot;: &dquot;https:\/\/github.com\/lissyx\/DeepSpeech\/releases\/download\/0.0.2\/tc-fake-prod.988_e120.LSTM.ldc93s1.pb&dquot;,\n          &dquot;TENSORFLOW_BUILD_ARTIFACT&dquot;: &dquot;https:\/\/index.taskcluster.net\/v1\/task\/project.deepspeech.tensorflow.pip.master.gpu\/artifacts\/public\/home.tar.xz&dquot;,\n          &dquot;SUMMARIZE_GRAPH_BINARY&dquot;: &dquot;https:\/\/index.taskcluster.net\/v1\/task\/project.deepspeech.tensorflow.pip.master.gpu\/artifacts\/public\/summarize_graph&dquot;\n        }\n      },\n      &dquot;created&dquot;: &dquot;2017-11-01T22:00:09&dquot;,\n      &dquot;taskGroupId&dquot;: &dquot;daayUA2aTPaw9BLms_p72g&dquot;,\n      &dquot;dependencies&dquot;: &open;&close;,\n      &dquot;expires&dquot;: &dquot;2017-11-08T22:00:09&dquot;,\n      &dquot;requires&dquot;: &dquot;all-completed&dquot;,\n      &dquot;routes&dquot;: &open;&close;,\n      &dquot;priority&dquot;: &dquot;lowest&dquot;,\n      &dquot;retries&dquot;: 5,\n      &dquot;scopes&dquot;: &open;&close;,\n      &dquot;tags&dquot;: {}\n    },\n    &dquot;time&dquot;: &dquot;2017-11-01T22:00:22.006Z&dquot;\n  }\n}\n```\n\nAs you can see, `created`, `deadline` and `expires` are all invalid because they lack the timezone info. It is generated here &open;https:\/\/github.com\/mozilla\/DeepSpeech\/blob\/12dee36a43fbbebcccf1a3c2cbc8946c54924f7d\/taskcluster\/linux-opt-base.tyml#L10-L15&close;:\n```\ncreated: { $fromNow: '0 sec' }\ndeadline: { $fromNow: '1 day' }\nexpires:\n  $if: 'event.event == &dquot;push&dquot;'\n  then: { $fromNow: '6 months' }\nelse: { $fromNow: '7 days' }\n```\n\nThis template is being ingested by JSON-e Python module." githubcreatedon:"1509582508" githubnumber:"200.000000" githubrepo:"taskcluster\/json-e" githubtitle:"Invalid date-time can be generated, intermittently" githubtype:"issue" githubupdatedat:"1509627314" githuburl:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200" githubuser:"lissyx" modified:"1511020222" priority:"M" project:"moz" status:"pending" uuid:"7b765533-1ff5-42cc-a112-8de66cc04b2e"]
new [annotation_1509630624:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200" description:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200 Invalid date-time can be generated, intermittently" entry:"1509630624" githubbody:"STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with &dquot;InputValidationError&dquot;\n\nThis is the error:\n```\n{\n  &dquot;code&dquot;: &dquot;InputValidationError&dquot;,\n  &dquot;message&dquot;: &dquot;\nSchema Validation Failed!\nRejecting Schema: http:\/\/schemas.taskcluster.net\/queue\/v1\/create-task-request.json#\nErrors:\n  * data.created should match format \\&dquot;date-time\\&dquot;\n  * data.deadline should match format \\&dquot;date-time\\&dquot;\n  * data.expires should match format \\&dquot;date-time\\&dquot;\n----\nmethod:     createTask\nerrorCode:  InputValidationError\nstatusCode: 400\ntime:       2017-11-01T22:00:22.006Z&dquot;,\n  &dquot;requestInfo&dquot;: {\n    &dquot;method&dquot;: &dquot;createTask&dquot;,\n    &dquot;params&dquot;: {\n      &dquot;taskId&dquot;: &dquot;VTVCJR8yRB2OUSFzEiztmg&dquot;\n    },\n    &dquot;payload&dquot;: {\n      &dquot;provisionerId&dquot;: &dquot;aws-provisioner-v1&dquot;,\n      &dquot;schedulerId&dquot;: &dquot;taskcluster-github&dquot;,\n      &dquot;metadata&dquot;: {\n        &dquot;source&dquot;: &dquot;https:\/\/github.com\/mozilla\/DeepSpeech.git&dquot;,\n        &dquot;description&dquot;: &dquot;Building DeepSpeech for Linux\/AMD64, CUDA-enabled, optimized version&dquot;,\n        &dquot;name&dquot;: &dquot;DeepSpeech Linux AMD64 CUDA&dquot;,\n        &dquot;owner&dquot;: &dquot;reuben.morais@gmail.com&dquot;\n      },\n      &dquot;workerType&dquot;: &dquot;deepspeech-worker&dquot;,\n      &dquot;deadline&dquot;: &dquot;2017-11-02T22:00:09&dquot;,\n      &dquot;extra&dquot;: {\n        &dquot;github&dquot;: {\n          &dquot;events&dquot;: &open;\n            &dquot;pull_request.opened&dquot;,\n            &dquot;pull_request.synchronize&dquot;,\n            &dquot;pull_request.reopened&dquot;\n          &close;,\n          &dquot;env&dquot;: true\n        }\n      },\n      &dquot;payload&dquot;: {\n        &dquot;maxRunTime&dquot;: 14400,\n        &dquot;command&dquot;: &open;\n          &dquot;\/bin\/bash&dquot;,\n          &dquot;--login&dquot;,\n          &dquot;-cxe&dquot;,\n          &dquot;apt-get -qq update && apt-get -qq -y install git pixz wget pkg-config libsox-dev && true && adduser --system --home \/home\/build-user build-user && cd \/home\/build-user\/ && echo -e \\&dquot;#!\/bin\/bash\nset -xe\n env && id && (wget -O - $TENSORFLOW_BUILD_ARTIFACT | pixz -d | tar -C \/home\/build-user\/ -xf - ) && git clone --quiet https:\/\/github.com\/mozilla\/DeepSpeech.git ~\/DeepSpeech\/ds\/ && cd ~\/DeepSpeech\/ds && git checkout --quiet 4a10d400da51df8abd77c09b79c16982b58988a1 && ln -s ~\/DeepSpeech\/ds\/native_client\/ ~\/DeepSpeech\/tf\/native_client\\&dquot; > \/tmp\/clone.sh && chmod +x \/tmp\/clone.sh && sudo -H -u build-user \/bin\/bash \/tmp\/clone.sh && \/home\/build-user\/DeepSpeech\/tf\/tc-apt.sh && true && sudo -H -u build-user --preserve-env \/bin\/bash \/home\/build-user\/DeepSpeech\/ds\/taskcluster\/cuda-build.sh && sudo -H -u build-user \/bin\/bash \/home\/build-user\/DeepSpeech\/ds\/taskcluster\/cuda-package.sh\n&dquot;\n        &close;,\n        &dquot;image&dquot;: &dquot;ubuntu:14.04&dquot;,\n        &dquot;artifacts&dquot;: {\n          &dquot;public&dquot;: {\n            &dquot;path&dquot;: &dquot;\/tmp\/artifacts\/&dquot;,\n            &dquot;type&dquot;: &dquot;directory&dquot;,\n            &dquot;expires&dquot;: &dquot;2017-11-08T22:00:09&dquot;\n          }\n        },\n        &dquot;env&dquot;: {\n          &dquot;DEEPSPEECH_TEST_MODEL&dquot;: &dquot;https:\/\/queue.taskcluster.net\/v1\/task\/Px4oq0S1Q0a3K0dV6_9htg\/runs\/0\/artifacts\/public\/output_graph.pb&dquot;,\n          &dquot;DEEPSPEECH_PROD_MODEL&dquot;: &dquot;https:\/\/github.com\/lissyx\/DeepSpeech\/releases\/download\/0.0.2\/tc-fake-prod.988_e120.LSTM.ldc93s1.pb&dquot;,\n          &dquot;TENSORFLOW_BUILD_ARTIFACT&dquot;: &dquot;https:\/\/index.taskcluster.net\/v1\/task\/project.deepspeech.tensorflow.pip.master.gpu\/artifacts\/public\/home.tar.xz&dquot;,\n          &dquot;SUMMARIZE_GRAPH_BINARY&dquot;: &dquot;https:\/\/index.taskcluster.net\/v1\/task\/project.deepspeech.tensorflow.pip.master.gpu\/artifacts\/public\/summarize_graph&dquot;\n        }\n      },\n      &dquot;created&dquot;: &dquot;2017-11-01T22:00:09&dquot;,\n      &dquot;taskGroupId&dquot;: &dquot;daayUA2aTPaw9BLms_p72g&dquot;,\n      &dquot;dependencies&dquot;: &open;&close;,\n      &dquot;expires&dquot;: &dquot;2017-11-08T22:00:09&dquot;,\n      &dquot;requires&dquot;: &dquot;all-completed&dquot;,\n      &dquot;routes&dquot;: &open;&close;,\n      &dquot;priority&dquot;: &dquot;lowest&dquot;,\n      &dquot;retries&dquot;: 5,\n      &dquot;scopes&dquot;: &open;&close;,\n      &dquot;tags&dquot;: {}\n    },\n    &dquot;time&dquot;: &dquot;2017-11-01T22:00:22.006Z&dquot;\n  }\n}\n```\n\nAs you can see, `created`, `deadline` and `expires` are all invalid because they lack the timezone info. It is generated here &open;https:\/\/github.com\/mozilla\/DeepSpeech\/blob\/12dee36a43fbbebcccf1a3c2cbc8946c54924f7d\/taskcluster\/linux-opt-base.tyml#L10-L15&close;:\n```\ncreated: { $fromNow: '0 sec' }\ndeadline: { $fromNow: '1 day' }\nexpires:\n  $if: 'event.event == &dquot;push&dquot;'\n  then: { $fromNow: '6 months' }\nelse: { $fromNow: '7 days' }\n```\n\nThis template is being ingested by JSON-e Python module." githubcreatedon:"1509582508" githubnumber:"200.000000" githubrepo:"taskcluster\/json-e" githubtitle:"Invalid date-time can be generated, intermittently" githubtype:"issue" githubupdatedat:"1509627314" githuburl:"https:\/\/github.com\/taskcluster\/json-e\/issues\/200" githubuser:"lissyx" modified:"1511023821" priority:"M" project:"moz" status:"pending" uuid:"7b765533-1ff5-42cc-a112-8de66cc04b2e"]
---

bugwarrior-pull DEBUG log

INFO:bugwarrior.db:Service-defined UDAs exist: you can optionally use the `bugwarrior-uda` command to export a list of UDAs you can add to your taskrc file.
INFO:bugwarrior.services:Starting to aggregate remote issues.
INFO:bugwarrior.services:Spawning 2 workers.
INFO:bugwarrior.services:Working on [github_assigned]
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): api.github.com
DEBUG:urllib3.connectionpool:https://api.github.com:443 "GET /search/issues?q=is:open%20is:issue%20assignee:djmitche&per_page=100 HTTP/1.1" 200 None
DEBUG:bugwarrior.services.github: Found 13 issues.
DEBUG:bugwarrior.services.github: Pruned down to 13 issues.
INFO:bugwarrior.services:Done with [github_assigned] in 0.249182s
INFO:bugwarrior.services:Working on [github_respond]
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): api.github.com
DEBUG:urllib3.connectionpool:https://api.github.com:443 "GET /search/issues?q=is:open%20is:pr%20review-requested:djmitche&per_page=100 HTTP/1.1" 200 None
DEBUG:bugwarrior.services.github: Found 1 issues.
DEBUG:bugwarrior.services.github: Pruned down to 1 issues.
INFO:bugwarrior.services:Done with [github_respond] in 0.159398s
INFO:bugwarrior.services:Done aggregating remote issues.
INFO:bugwarrior.db:Adding 0 tasks
INFO:bugwarrior.db:Updating 1 tasks
INFO:bugwarrior.db:Updating task 7b765533-1ff5-42cc-a112-8de66cc04b2e, https://github.com/taskcluster/json-e/issues/200 Invalid date-time can be generated, intermittently; githubbody: u'STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with "InputValidationError"\n\nThis is the error:\n```\n{\n  "code": "InputValidationError",\n  "message": "\nSchema Validation Failed!\nRejecting Schema: http://schemas.taskcluster.net/queue/v1/create-task-request.json#\nErrors:\n  * data.created should match format \\"date-time\\"\n  * data.deadline should match format \\"date-time\\"\n  * data.expires should match format \\"date-time\\"\n----\nmethod:     createTask\nerrorCode:  InputValidationError\nstatusCode: 400\ntime:       2017-11-01T22:00:22.006Z",\n  "requestInfo": {\n    "method": "createTask",\n    "params": {\n      "taskId": "VTVCJR8yRB2OUSFzEiztmg"\n    },\n    "payload": {\n      "provisionerId": "aws-provisioner-v1",\n      "schedulerId": "taskcluster-github",\n      "metadata": {\n        "source": "https://github.com/mozilla/DeepSpeech.git",\n        "description": "Building DeepSpeech for Linux/AMD64, CUDA-enabled, optimized version",\n        "name": "DeepSpeech Linux AMD64 CUDA",\n        "owner": "reuben.morais@gmail.com"\n      },\n      "workerType": "deepspeech-worker",\n      "deadline": "2017-11-02T22:00:09",\n      "extra": {\n        "github": {\n          "events": [\n            "pull_request.opened",\n            "pull_request.synchronize",\n            "pull_request.reopened"\n          ],\n          "env": true\n        }\n      },\n      "payload": {\n        "maxRunTime": 14400,\n        "command": [\n          "/bin/bash",\n          "--login",\n          "-cxe",\n          "apt-get -qq update && apt-get -qq -y install git pixz wget pkg-config libsox-dev && true && adduser --system --home /home/build-user build-user && cd /home/build-user/ && echo -e \\"#!/bin/bash\\nset -xe\\n env && id && (wget -O - $TENSORFLOW_BUILD_ARTIFACT | pixz -d | tar -C /home/build-user/ -xf - ) && git clone --quiet https://github.com/mozilla/DeepSpeech.git ~/DeepSpeech/ds/ && cd ~/DeepSpeech/ds && git checkout --quiet 4a10d400da51df8abd77c09b79c16982b58988a1 && ln -s ~/DeepSpeech/ds/native_client/ ~/DeepSpeech/tf/native_client\\" > /tmp/clone.sh && chmod +x /tmp/clone.sh && sudo -H -u build-user /bin/bash /tmp/clone.sh && /home/build-user/DeepSpeech/tf/tc-apt.sh && true && sudo -H -u build-user --preserve-env /bin/bash /home/build-user/DeepSpeech/ds/taskcluster/cuda-build.sh && sudo -H -u build-user /bin/bash /home/build-user/DeepSpeech/ds/taskcluster/cuda-package.sh\n"\n        ],\n        "image": "ubuntu:14.04",\n        "artifacts": {\n          "public": {\n            "path": "/tmp/artifacts/",\n            "type": "directory",\n            "expires": "2017-11-08T22:00:09"\n          }\n        },\n        "env": {\n          "DEEPSPEECH_TEST_MODEL": "https://queue.taskcluster.net/v1/task/Px4oq0S1Q0a3K0dV6_9htg/runs/0/artifacts/public/output_graph.pb",\n          "DEEPSPEECH_PROD_MODEL": "https://github.com/lissyx/DeepSpeech/releases/download/0.0.2/tc-fake-prod.988_e120.LSTM.ldc93s1.pb",\n          "TENSORFLOW_BUILD_ARTIFACT": "https://index.taskcluster.net/v1/task/project.deepspeech.tensorflow.pip.master.gpu/artifacts/public/home.tar.xz",\n          "SUMMARIZE_GRAPH_BINARY": "https://index.taskcluster.net/v1/task/project.deepspeech.tensorflow.pip.master.gpu/artifacts/public/summarize_graph"\n        }\n      },\n      "created": "2017-11-01T22:00:09",\n      "taskGroupId": "daayUA2aTPaw9BLms_p72g",\n      "dependencies": [],\n      "expires": "2017-11-08T22:00:09",\n      "requires": "all-completed",\n      "routes": [],\n      "priority": "lowest",\n      "retries": 5,\n      "scopes": [],\n      "tags": {}\n    },\n    "time": "2017-11-01T22:00:22.006Z"\n  }\n}\n```\n\nAs you can see, `created`, `deadline` and `expires` are all invalid because they lack the timezone info. It is generated here [https://github.com/mozilla/DeepSpeech/blob/12dee36a43fbbebcccf1a3c2cbc8946c54924f7d/taskcluster/linux-opt-base.tyml#L10-L15]:\n```\ncreated: { $fromNow: \'0 sec\' }\ndeadline: { $fromNow: \'1 day\' }\nexpires:\n  $if: \'event.event == "push"\'\n  then: { $fromNow: \'6 months\' }\nelse: { $fromNow: \'7 days\' }\n```\n\nThis template is being ingested by JSON-e Python module.' -> u'STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with "InputValidationError"\n\nThis is the error:\n```\n{\n  "code": "InputValidationError",\n  "message": "\\nSchema Validation Failed!\\nRejecting Schema: http://schemas.taskcluster.net/queue/v1/create-task-request.json#\\nErrors:\\n  * data.created should match format \\"date-time\\"\\n  * data.deadline should match format \\"date-time\\"\\n  * data.expires should match format \\"date-time\\"\\n----\\nmethod:     createTask\\nerrorCode:  InputValidationError\\nstatusCode: 400\\ntime:       2017-11-01T22:00:22.006Z",\n  "requestInfo": {\n    "method": "createTask",\n    "params": {\n      "taskId": "VTVCJR8yRB2OUSFzEiztmg"\n    },\n    "payload": {\n      "provisionerId": "aws-provisioner-v1",\n      "schedulerId": "taskcluster-github",\n      "metadata": {\n        "source": "https://github.com/mozilla/DeepSpeech.git",\n        "description": "Building DeepSpeech for Linux/AMD64, CUDA-enabled, optimized version",\n        "name": "DeepSpeech Linux AMD64 CUDA",\n        "owner": "reuben.morais@gmail.com"\n      },\n      "workerType": "deepspeech-worker",\n      "deadline": "2017-11-02T22:00:09",\n      "extra": {\n        "github": {\n          "events": [\n            "pull_request.opened",\n            "pull_request.synchronize",\n            "pull_request.reopened"\n          ],\n          "env": true\n        }\n      },\n      "payload": {\n        "maxRunTime": 14400,\n        "command": [\n          "/bin/bash",\n          "--login",\n          "-cxe",\n          "apt-get -qq update && apt-get -qq -y install git pixz wget pkg-config libsox-dev && true && adduser --system --home /home/build-user build-user && cd /home/build-user/ && echo -e \\"#!/bin/bash\\\\nset -xe\\\\n env && id && (wget -O - $TENSORFLOW_BUILD_ARTIFACT | pixz -d | tar -C /home/build-user/ -xf - ) && git clone --quiet https://github.com/mozilla/DeepSpeech.git ~/DeepSpeech/ds/ && cd ~/DeepSpeech/ds && git checkout --quiet 4a10d400da51df8abd77c09b79c16982b58988a1 && ln -s ~/DeepSpeech/ds/native_client/ ~/DeepSpeech/tf/native_client\\" > /tmp/clone.sh && chmod +x /tmp/clone.sh && sudo -H -u build-user /bin/bash /tmp/clone.sh && /home/build-user/DeepSpeech/tf/tc-apt.sh && true && sudo -H -u build-user --preserve-env /bin/bash /home/build-user/DeepSpeech/ds/taskcluster/cuda-build.sh && sudo -H -u build-user /bin/bash /home/build-user/DeepSpeech/ds/taskcluster/cuda-package.sh\\n"\n        ],\n        "image": "ubuntu:14.04",\n        "artifacts": {\n          "public": {\n            "path": "/tmp/artifacts/",\n            "type": "directory",\n            "expires": "2017-11-08T22:00:09"\n          }\n        },\n        "env": {\n          "DEEPSPEECH_TEST_MODEL": "https://queue.taskcluster.net/v1/task/Px4oq0S1Q0a3K0dV6_9htg/runs/0/artifacts/public/output_graph.pb",\n          "DEEPSPEECH_PROD_MODEL": "https://github.com/lissyx/DeepSpeech/releases/download/0.0.2/tc-fake-prod.988_e120.LSTM.ldc93s1.pb",\n          "TENSORFLOW_BUILD_ARTIFACT": "https://index.taskcluster.net/v1/task/project.deepspeech.tensorflow.pip.master.gpu/artifacts/public/home.tar.xz",\n          "SUMMARIZE_GRAPH_BINARY": "https://index.taskcluster.net/v1/task/project.deepspeech.tensorflow.pip.master.gpu/artifacts/public/summarize_graph"\n        }\n      },\n      "created": "2017-11-01T22:00:09",\n      "taskGroupId": "daayUA2aTPaw9BLms_p72g",\n      "dependencies": [],\n      "expires": "2017-11-08T22:00:09",\n      "requires": "all-completed",\n      "routes": [],\n      "priority": "lowest",\n      "retries": 5,\n      "scopes": [],\n      "tags": {}\n    },\n    "time": "2017-11-01T22:00:22.006Z"\n  }\n}\n```\n\nAs you can see, `created`, `deadline` and `expires` are all invalid because they lack the timezone info. It is generated here [https://github.com/mozilla/DeepSpeech/blob/12dee36a43fbbebcccf1a3c2cbc8946c54924f7d/taskcluster/linux-opt-base.tyml#L10-L15]:\n```\ncreated: { $fromNow: \'0 sec\' }\ndeadline: { $fromNow: \'1 day\' }\nexpires:\n  $if: \'event.event == "push"\'\n  then: { $fromNow: \'6 months\' }\nelse: { $fromNow: \'7 days\' }\n```\n\nThis template is being ingested by JSON-e Python module.'
INFO:bugwarrior.db:Closing 0 tasks

Does anyhing

[ryneeverett]

My first thought would be that maybe the raw json in the description is uncovering a bug in one of the several json serialization/deserialization processes. We're querying github for json and ultimately taskwarrior stores the data in json.

[djmitche]

Yup, in fact, the issue is the encoded \n in the JSON. Something is double-applying evaluation of \ escapes.

[djmitche]

>>> for l in difflib.unified_diff(a, b): print l
... 
--- 

+++ 

@@ -12,18 +12,7 @@

 {
   "code": "InputValidationError",
-  "message": "
-Schema Validation Failed!
-Rejecting Schema: http://schemas.taskcluster.net/queue/v1/create-task-request.json#
-Errors:
-  * data.created should match format \"date-time\"
-  * data.deadline should match format \"date-time\"
-  * data.expires should match format \"date-time\"
-----
-method:     createTask
-errorCode:  InputValidationError
-statusCode: 400
-time:       2017-11-01T22:00:22.006Z",
+  "message": "\nSchema Validation Failed!\nRejecting Schema: http://schemas.taskcluster.net/queue/v1/create-task-request.json#\nErrors:\n  * data.created should match format \"date-time\"\n  * data.deadline should match format \"date-time\"\n  * data.expires should match format \"date-time\"\n----\nmethod:     createTask\nerrorCode:  InputValidationError\nstatusCode: 400\ntime:       2017-11-01T22:00:22.006Z",
   "requestInfo": {
     "method": "createTask",
     "params": {
@@ -56,8 +45,7 @@

           "/bin/bash",
           "--login",
           "-cxe",
-          "apt-get -qq update && apt-get -qq -y install git pixz wget pkg-config libsox-dev && true && adduser --system --home /home/build-user build-user && cd /home/build-user/ && echo -e \"#!/bin/bash\nset -xe\n env && id && (wget -O - $TENSORFLOW_BUILD_ARTIFACT | pixz -d | tar -C /home/build-user/ -xf - ) && git clone --quiet https://github.com/mozilla/DeepSpeech.git ~/DeepSpeech/ds/ && cd ~/DeepSpeech/ds && git checkout --quiet 4a10d400da51df8abd77c09b79c16982b58988a1 && ln -s ~/DeepSpeech/ds/native_client/ ~/DeepSpeech/tf/native_client\" > /tmp/clone.sh && chmod +x /tmp/clone.sh && sudo -H -u build-user /bin/bash /tmp/clone.sh && /home/build-user/DeepSpeech/tf/tc-apt.sh && true && sudo -H -u build-user --preserve-env /bin/bash /home/build-user/DeepSpeech/ds/taskcluster/cuda-build.sh && sudo -H -u build-user /bin/bash /home/build-user/DeepSpeech/ds/taskcluster/cuda-package.sh
-"
+          "apt-get -qq update && apt-get -qq -y install git pixz wget pkg-config libsox-dev && true && adduser --system --home /home/build-user build-user && cd /home/build-user/ && echo -e \"#!/bin/bash\\nset -xe\\n env && id && (wget -O - $TENSORFLOW_BUILD_ARTIFACT | pixz -d | tar -C /home/build-user/ -xf - ) && git clone --quiet https://github.com/mozilla/DeepSpeech.git ~/DeepSpeech/ds/ && cd ~/DeepSpeech/ds && git checkout --quiet 4a10d400da51df8abd77c09b79c16982b58988a1 && ln -s ~/DeepSpeech/ds/native_client/ ~/DeepSpeech/tf/native_client\" > /tmp/clone.sh && chmod +x /tmp/clone.sh && sudo -H -u build-user /bin/bash /tmp/clone.sh && /home/build-user/DeepSpeech/tf/tc-apt.sh && true && sudo -H -u build-user --preserve-env /bin/bash /home/build-user/DeepSpeech/ds/taskcluster/cuda-build.sh && sudo -H -u build-user /bin/bash /home/build-user/DeepSpeech/ds/taskcluster/cuda-package.sh\n"
         ],
         "image": "ubuntu:14.04",
         "artifacts": {

[djmitche]

Looking at taskw's serialization / deserialization, I see:

serialized: u'STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with &dquot;InputValidationError&dquot;\n\nThis is the error:\n```\n{\n &dquot;code&dquot;: &dquot;InputValidationError&dquot;,\n &dquot;message&dquot;: &dquot;\\nSchema Validation Failed!\\nRejecting Schema: ht'...

unserialized: u'STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with "InputValidationError"\n\nThis is the error:\n```\n{\n "code": "InputValidationError",\n "message": "\\nSchema Validation Failed!\\nRejecting Schema: http://schemas.taskcluster.net/queue/v1/create-task-requ'...

in other words, both encode the \ n sequence in the input as \ \ \n. But both also contain "raw" newlines which clearly aren't allowed in .task/pending.data. Still digging..

[djmitche]

The modification calculated by encode_task_experimental is u'githubbody:"STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with &dquot;InputValidationError&dquot;\n\nThis is the error:\n```\n{\n &dquot;code&dquot;: &dquot;InputValidationError&dquot;,\n &dquot;message&dquot;: &dquot;\\nSchema Validation Failed!\\nRejecting Schema'... so still properly using \\n.

[djmitche]

Here's what the generated task command looks like: ['task', 'rc:/home/dustin/.taskrc', 'rc.uda.githubcreatedon.type=date', 'rc.uda.githubcreatedon.label="Github Created"', 'rc.uda.githubtitle.type=string', 'rc.uda.githubtitle.label="Github Title"', 'rc.uda.githubnumber.type=numeric', 'rc.uda.githubnumber.label="Github Issue/PR #"', 'rc.uda.githubbody.type=string', 'rc.uda.githubbody.label="Github Body"', 'rc.uda.githubrepo.type=string', 'rc.uda.githubrepo.label="Github Repo Slug"', 'rc.uda.githubuser.type=string', 'rc.uda.githubuser.label="Github User"', 'rc.uda.githuburl.type=string', 'rc.uda.githuburl.label="Github URL"', 'rc.uda.githubupdatedat.type=date', 'rc.uda.githubupdatedat.label="Github Updated"', 'rc.uda.githubtype.type=string', 'rc.uda.githubtype.label="Github Type"', 'rc.uda.githubmilestone.type=string', 'rc.uda.githubmilestone.label="Github Milestone"', 'rc.dependency.confirmation=no', 'rc.json.array=TRUE', 'rc.confirmation=no', 'rc.verbose=new-uuid', '7b765533-1ff5-42cc-a112-8de66cc04b2e', 'modify', 'githubbody:"STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with &dquot;InputValidationError&dquot;\n\nThis is the error:\n```\n{\n &dquot;code&dquot;: &dquot;InputValidationError&dquot;,\n &dquot;message&dquot;: &dquot;\\nSchema Validation Failed!\\nRejecting Schema

That is handed directly to task without any shell interpretatoin.

[djmitche]

Here's what that looks like in pending.data:
githubbody:"STR:\n - be on halloween day off\n - submit taskcluster tasks\n\nExpected:\n Works.\n\nActual:\n Fails with &dquot;InputValidationError&dquot;\n\nThis is the error:\n```\n{\n &dquot;code&dquot;: &dquot;InputValidationError&dquot;,\n &dquot;message&dquot;: &dquot;\nSchema Validation Failed!\nRejecting Schema: -- note, the \\n have turned to \n.

[djmitche]

Ah, I see what's happening. When you feed a literal newline to task modify, taskwarrior escapes it to \n. When you pass it the sequence \ \n, it does nothing -- it should convert the \ to \\. The strings two comments above are python strings, so \n is a literal newline.

dustin@jemison ~ $ rm -rf tmp/task-test
dustin@jemison ~ $ TASKDATA=tmp/task-test task add abc $'githubbody:"newline=\n, backslash=\\, escaped newline=\\n"'
TASKDATA override: /home/dustin/tmp/task-test
Created task 1.
dustin@jemison ~ $ TASKDATA=tmp/task-test task 1 export
TASKDATA override: /home/dustin/tmp/task-test
[
{"id":1,"description":"abc","entry":"20171124T140940Z","githubbody":"newline=\n, backslash=\\, escaped newline=\n","modified":"20171124T140940Z","priority":"M","status":"pending","uuid":"c8f97740-e97f-481b-9184-aea65af2ddf3","urgency":3.9}
]

So this is a Taskwarrior bug, but I suspect taskw should work around it. @ryneeverett what do you think?

[artur-shaik]

Have same issue, any updates on it?

[djmitche]

I stlil see this all the time. @artur-shaik can you confirm it still happens with the latest task, and if so file a bug with that project?

[artur-shaik]

Here is my taskwarrior:

~/ » task --version
2.5.1

And here was issue with that bug: artur-shaik/vim-javacomplete2#418

I've edited author's message and remove \n from text. bugwarrior's issue disapeared, with your @djmitche help.

[djmitche]

I meant the latest committed version of the 2.6.0 (development) branch

[artur-shaik]

The same with 2.6.0

[djmitche]

I filed GothenburgBitFactory/taskwarrior/issues/2140. If that doesn't get much attention, then maybe we can consider working around this in taskw?

[srl295]

is this related to #798 ? it at least seems to have similar behavior.

[djmitche]

I expect so, yes.

[ryneeverett]

triage: The link to the original github issue that was causing this issue is dead and the bug opened upstream in taskwarrior has been fixed. Can we close this?

[srl295]

triage: The link to the original github issue that was causing this issue is dead and the bug opened upstream in taskwarrior has been fixed. Can we close this?

I have a use case (linked in #798 ) causing this issue. But will check on upstream. Thanks.

Update: I guess newlines and slashes are no longer causing problems… just other characters. So fine to close this, but #798 is still a daily annoyance here.