Copy assets, account sources

Summary

Version v0.33 of FlexMeasures adds the ability to copy assets and supports filtering beliefs data by source much better.

Also, we improved many small things as usual. One interesting change is that pushing data into FlexMeasures now is not blocking API handling instances from accepting other requests. Another is more fine-grained monitoring of failed tasks and absent users.

Read more on these features on the FlexMeasures blog.

This release consists of more than 30 PRs:

What's Changed

• Return 422 ValidationError for zero-duration single-value posts on non-instantaneous sensors by @Copilot in #2116
• Fix/asset context page bugs by @Flix6x in #2117
• upgrade dependencies after release of v0.32 by @nhoening in #2114
• Navigate to parent asset after deleting a child asset; show deletion toast by @Copilot in #2119
• Feat/sensor data source account filtering by @BelhsanHmida in #2083
• Always enable RQ embedded scheduler in flexmeasures jobs run-worker by @Ragnar-the-mighty in #2112
• feat: Cleanup of stale sensor references by @joshuaunity in #2106
• Feat/copy assets by @joshuaunity in #2017
• Add "Copy this asset" button to the asset properties page by @Copilot in #2121
• fix: default stats window is for the selected period by @Flix6x in #2129
• Check read permissions for regressor sensors when triggering forecasts by @Copilot in #2096
• Fix/ajax dialogue regression by @joshuaunity in #2124
• Fix account PATCH endpoint rejecting valid requests on accounts with a consultancy set, and show attributes on the account page by @Copilot in #2140
• fix attributes being overwritten in asset form by @nhoening in #2138
• Feat/clean up old rolling forecasting code by @BelhsanHmida in #2082
• Feat: check flex config permissions schedule by @BelhsanHmida in #2125
• Add GET /api/v3_0/sources endpoint for accessible data sources and types by @Copilot in #2126
• Chore/update to timely beliefs v3.5.5 by @Flix6x in #2148
• Add unified job status endpoint GET /api/v3_0/jobs/ by @Copilot in #2141
• Feat: sensor data source type filter by @BelhsanHmida in #2127
• Fix/drop unchanged beliefs per event by @Flix6x in #2150
• Fix forecast regressor filtering by belief time by @Ragnar-the-mighty in #2134
• Feat/monitoring more fine grained by @nhoening in #2158
• Chore(deps): Bump urllib3 from 2.6.3 to 2.7.0 by @dependabot[bot] in #2161
• Fix: include belief time in fixed-value records for chart data by @joshuaunity in #2147
• Standardize resolution formatting across API endpoints for consistent response payloads by @joshuaunity in #2152
• fix: reporter crashing on KeyError: 'Level source not found' by @Flix6x in #2159
• Fix/build device soc values by @Flix6x in #2160
• Fix auth check when running CLI command with flask by @Flix6x in #2169
• Fix auth issues: child asset creation, account page access by @Copilot in #2163
• feat: add account_id filter for sources in search_beliefs by @Copilot in #2065
• Fix: All use of raw json when updating flex_configs by @joshuaunity in #2162
• Feat/validate source type filter by @Flix6x in #2151
• Feat/speed up stats panel on sensor page by @Flix6x in #2173
• Fix/sensor data deletion window by @Flix6x in #2175
• Fix/migrate darts package by @BelhsanHmida in #2180
• Feat/efficiencyfield support sensor by @joshuaunity in #2142
• Fix: visually distinguish data sources beyond source name by @BelhsanHmida in #2185
• Move sensor data ingestion to job queue by @Copilot in #2101
• fix the links with sed between endpoint listing and endpoint details by @nhoening in #1753
• Fix/force new job when scheduling an asset (tree) by @Flix6x in #2182
• Fix sensor forecast button to send train-start from available history by @Copilot in #2187
• Docs/fix various api doc issues by @nhoening in #2122
• Fix: DST transition handling by supporting both datetime and pandas Timestamp objects by @Ahmad-Wahid in #2197
• Create .github/instructions folder with cross-cutting topic instruction files by @Copilot in #2198
• Harden RQ Dashboard job views against non-JSON-serializable job data by @Copilot in #2200
• Fix StorageScheduler crash on devices without sensor in flex-model by @saerts-gp in #2085
• Derive seasonal lags from sensor resolution by @BelhsanHmida in #2157
• docs: improve docstring for asset copy endpoint by @nhoening in #2204
• CLI command to inspect a job by @nhoening in #2202
• Chore/avoid autouse fixtures by @Flix6x in #2206
• uploading/posting beliefs works without Redis (again) by @nhoening in #2207
• Fail clearly on insufficient forecasting history by translating Darts fit errors by @Copilot in #2192
• Select regressor beliefs per (event_start, regressor) in forecasting covariate assembly by @Copilot in #2155
• Handle standardized sensors_to_show plots in flexmeasures show asset by @Copilot in #2189
• feat: allow setting a consumption/production sensor in the flex-model of an asset by @Flix6x in #2190
• docs: improve API units section with conversion examples and Pint reference by @Copilot in #2211
• Catch 404 errors in Sentry interation without exc_info as well by @nhoening in #2212
• Fix/storage efficiency validation using consumption/production field by @Flix6x in #2213

New Contributors

• @saerts-gp made their first contribution in #2085

Full Changelog: v0.32.0...v0.33.0