Skip to content

Historical data storage strategy#5

Draft
kvkenyon wants to merge 1 commit intomainfrom
cursor/historical-data-storage-strategy-4d06
Draft

Historical data storage strategy#5
kvkenyon wants to merge 1 commit intomainfrom
cursor/historical-data-storage-strategy-4d06

Conversation

@kvkenyon
Copy link
Copy Markdown
Owner

Implements a client-side data warehousing strategy for historical ERCOT data using S3/Parquet and DuckDB.

This strategy provides a cost-effective and unified way to offer a "pre-built historical database" for tinygrid, directly competing with commercial offerings like Grid Status without incurring the high costs of a dedicated database server. It offloads query compute to the client and leverages cheap object storage.


Open in Cursor Open in Web

Co-authored-by: kvkenyon <kvkenyon@utexas.edu>
@cursor
Copy link
Copy Markdown

cursor Bot commented Dec 29, 2025

Cursor Agent can help with this pull request. Just @cursor in comments and I'll start working on changes in this branch.
Learn more about Cursor Agents

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants