Briefcase not retrieving all submissions

[getodk-bot]

Issue by mitchellsundt
Thursday Jul 09, 2015 at 18:56 GMT
Originally opened as getodk/getodk#615 (4 comment(s))

---

Originally reported on Google Code with ID 614

Email to list 
http://groups.google.com/group/opendatakit/browse_thread/thread/b03e753799eee225


Hello.

I'm using ODK Briefcase v1.0.2.1 (ODK_Briefcase_1.0.2.1.jar) to pull and export submissions
for a form that uses repeated groups (Briefcase's ability to preserve relationships
is important here). In ODK Aggregate, from the bulk CSV export I can see that I have,
at one time, 207 form submissions. However, when I use ODK Briefcase to Pull these
instances, I only get 100, hence the log (in "Details..." under the "Pull" tab):

Fetching form definition
Fetching form manifest
 (getting 1 of 1 media files)
preparing to retrieve instance data
retrieving next chunk of instances from server...
fetching instance 1 ...
fetching instance 2 ...
fetching instance 3 ...

[MY EDIT: continues fetching instances 4 through 96]

fetching instance 97 ...
fetching instance 98 ...
fetching instance 99 ...
fetching instance 100 ...
retrieving next chunk of instances from server...
retrieving next chunk of instances from server...
SUCCESS!

Indeed, in the "ODK Briefcase Storage" there are only 100 instances; same as in the
export from ODK Briefcase. How do I get the remaining instances?

Thanks!

Reported by wbrunette on 2012-06-23 05:52:40

[getodk-bot]

Comment by mitchellsundt
Thursday Jul 09, 2015 at 18:56 GMT

---

If you can add me ( mitchellsundt@gmail.com ) as a Site Admin to your site and also
invite me to be a developer ( http://code.google.com/p/opendatakit/wiki/AppEngineTroubleshooting
) I can try running Briefcase myself and see where this is failing.

Reported by mitchellsundt on 2012-06-25 18:28:46

[getodk-bot]

Comment by mitchellsundt
Thursday Jul 09, 2015 at 18:56 GMT

---

I've added you as a Site Admin; I sent you an e-mail with the details. Note that this
instance is not on Google AppEngine so I didn't invite you to be a developer through
that channel.

Reported by kaendsle@mtu.edu on 2012-06-25 20:09:41

[getodk-bot]

Comment by mitchellsundt
Thursday Jul 09, 2015 at 18:56 GMT

---

I've confirmed that this is a bug.  The timestamp in the continuation cursor has a timezone
error.

e.g.,

http://odkaggregate.mtri.org:8080/ODKAggregate/view/submissionList?formId=MDOT_Seatbelt_Survey_Final&numEntries=10

yields this resumption cursor:

<cursor xmlns="http://www.opendatakit.org/cursor"><attributeName>_LAST_UPDATE_DATE</attributeName><attributeValue>2012-06-04T01:28:01.626+0000</attributeValue><uriLastReturnedValue>uuid:a9da3981-895f-4640-bba0-5ab32faa9d20</uriLastReturnedValue><isForwardCursor>true</isForwardCursor></cursor>

but the correct resumption cursor should be 4 hours earlier:

<cursor xmlns="http://www.opendatakit.org/cursor"><attributeName>_LAST_UPDATE_DATE</attributeName><attributeValue>2012-06-03T21:28:01.626+0000</attributeValue><uriLastReturnedValue>uuid:a9da3981-895f-4640-bba0-5ab32faa9d20</uriLastReturnedValue><isForwardCursor>true</isForwardCursor></cursor>

Reported by mitchellsundt on 2012-06-26 22:47:52

[getodk-bot]

Comment by mitchellsundt
Thursday Jul 09, 2015 at 18:56 GMT

---

The server is running ODK Aggregate 1.0.1

Please upgrade to ODK Aggregate 1.0.9

The problem should have been fixed with this code change (Nov 10, 2011):

http://code.google.com/p/opendatakit/source/detail?r=3f7febf9fd106dc182dd3aa4dc1d02e20713fdf2&repo=aggregate&path=/src/main/java/org/opendatakit/common/utils/WebUtils.java

Reported by mitchellsundt on 2012-06-27 21:12:38

[yanokwa]

This should be fixed.