DAM hourly LMPs API only returns last 3 months

[tamird]

Hello. I'm trying to fetch DAM hourly LMPs but I can't seem to get anything before ~3.5 months ago. At the same time, much older data is available on the public archive.

Would it be possible to make the entire archive available via the API?

[mackermann-ercot]

Hello Tamir,

We're glad to see you have joined the discussions! Our primary objective for the Public API project is to provide historical archives for our public EMIL products that are no longer available through our main ercot.com site. The file archive provides EMIL products for the last seven years (and in some cases much longer), however we only provide API access to the data within those products from mid December of 2023 year (during the Beta release).

However, If there is enough interest to provide additional historical data for selected reports, we may consider loading data prior to the beta release.

Regards,
mackermann, ERCOT

[ianzhg]

Tamir,

This is a very useful tool. Love to see you guys developing it.

I was also trying to access data for RT pricing for each substation, and RT pricing for resource nodes, load zones, and hubs, but the data only goes from mid-Decemebr.

Would love to see data loaded for previous time because it would be extremely for us to understand the RT pricing risks given all the turbulent pricing we have had in the last couple of years.

Cheers,
Ian

[mackermann-ercot]

Hi Ian,

Thanks for the encouraging words! I will pass along your request for an extended data selection for the LMPs by Resource Nodes, Load Zones and Trading Hubs product to give it another up-vote for future enhancements.

Regards,
mackermann, ERCOT

[oorlandini]

Hi ya'll, I just started working with this awesome API and between @mackermann-ercot and @CaffieneLab have an extremely convenient little python script going to fill some holes and keep our database updated. Thank you so much for your work on this!

I'd also like to second how deeply I would adore making older records available via this great API. I don't know who I should send flowers and/or donuts to in Taylor to help persuade, but this tool is outstanding and we would definitely use it proportionate to any further effort put into it.

[manu1151]

Hello mackermann,

This would be extremely useful, I've had the same issue myself and would benefit enormously from having access to prior data (< Dec 2023).

Thank you!

Manuel

[dpyrek-ea]

Hello Mackermann,

I wanted to add a comment supporting extended data selection. I ran into similar issue pulling data from the 60 Day SCED Gen Resource Data API back through 2023. The API has already been an incredibly useful tool, and would be augmented greatly with additional data to avoid scraping csvs from the historical archives.

Thank you very much!
Daniel

[DMJ-CV-91913]

I would like to ask ERCOT to extend the API historical datasets or corpus back to Nov 1, 2021 to allow for a robust experience and provide useful data and efficiencies to the developer community supporting market participants either for modeling, researching, reporting, risk assessment, planning, etc. This date is chosen as prior data other than load data, doesnt have any relevant statistical significance given the dynamic changes of the grid( powerflows, intermittency, constraints, ramp rates). The date provides almost 3 years of data(>post covid), which is enough for almost any market participant needs.

[haqureshi]

How can i call Find Transaction Method of Retail API
(https://misapi.ercot.com/retailAPI/)

Please help

[will-strauch-toce]

Adding a comment to support historical data additions!