Data errors

[153957]

While processing events for the ESD we encourtered some errors as mentioned in #61.
We should try to find the cause of these errors:

• 2012_11_05 - stations 10, 303, 504, 1003, 2201, 3103, 3302, 7001, 8003, 8004 and 8006 (different errors).
• 2011_02_14 - station 3201.
• 2009_03_01 up to and including 2009_05_15 - stations 98, 502, 503, 504, 505, 507, 601, 8101 and 8102.

update on 2015/5/6: added 2012_11_05 - 10, 303, 504, 1003, 2201, 3103, 3302, 7001, 8003

[153957]

Data from 2009_03_22 (or 23..) up to and including 2009_05_15 is broken because of extra quotes around the data, if these are stripped the data unpacks properly.

[153957]

Fixed the 2009 problems in HiSPARC/sapphire@4f8db5a

[davidfokkema]

Great!

[153957]

SAPPHIRE v0.9.14 contains the fix.
It has been deployed on the publicdb.
Now processing; 2009_03_22 - 2009_05_16.
It now works for those events that it failed on before.

[153957]

Fixed for 2012-11-5, removed all (network)summaries for that date to let the publicdb (jobs) rediscover all data.

from django_publicdb.histograms.models import Summary, NetworkSummary
import datetime as dt
DATE = dt.date(2012, 11, 5)
summaries = Summary.objects.filter(date=DATE)
summaries.delete()
networksummary = NetworkSummary.objects.get(date=DATE)
networksummary.delete()

[153957]

Also fixed (by removing data) for 2011-2-14 in HiSPARC/datastore@41deafb