Repository navigation
Daylight saving time offset on daily data #114
Description
Activity
Now that DST is coming to an end in North America this weekend I'm seeing the same issue that you've outlined. It's probably showing midnight daylight time but converting it into standard time which is causing the error. I would think after the switch everything displays fine?
I'll ping @alexander0042 to take a look but it might not be fixed until the 2.0 release in the winter.
@cloneofghosts is spot on here, the fundamental issue is pretty simple. The script picks a zero hour using the time zone, then propagates forward in 24h increments. Since hourly data is continuous, it's only an issue for daily responses.
Adding this to the project board for V2.0, since I've missed the DST window for this year. My plan for a fix is pretty simple- instead of making the midnight array by adding 24 hours, I'm going to convert the entire time series into local and then find the midnight indexes
I've tagged this one as keep so it won't go stale in the future. From what I can tell this issue hasn't been fixed yet on the V2 API but still on the board to be fixed.
Finally fixed this- it was harder than it should have been, since timezone objects don't really like changing dst after they have been created. Just release a v2.0i to the dev channel, so should see it next time we have a DST switchover!
For anyone trying to figure this out in the future, the trick is to create a new timezone object for each step, like this:
day_array_grib = np.array([pytzTZ.localize(datetime.datetime(year=baseTime.year, month=baseTime.month, day=baseTime.day) + datetime.timedelta(days=i)).astimezone(utc).timestamp() for i in range(9)]).astype(np.int32)where
pytzTZispytz.timezone(tzSTRING)Will close this issue for now and we can always re-open the next time DST rolls around if it isn't fixed.
Describe the bug
When we observe daylight saving time during the week, the daily times become offset
Expected behavior
The
daily[].timeshould reflect midnight for that dayActual behavior
When there is a DST switch, the beginning of day is an hour off (23:00:00 of the previous day)
API Endpoint
Production
Location
Huércal-Overa, Almería, Spain used in the example but not limited to..
Other details
Possible to workaround and recompute using the hourly data
Troubleshooting steps