Firmware Upgrade 23.44.0 - Vitals Removed #402
Replies: 20 comments 54 replies
-
Progress Update
If anyone wants to test, edit your |
Beta Was this translation helpful? Give feedback.
-
Hi @jasonacox - apart from the live data feeds from the gateway over time (which for me is just so darn useful that this data is pulled together) - I would say the Powerwall Temps and Powerwall Capacity feeds are the most useful. As I have 4 x non-Tesla solar inverters I don't get any of the other info - and frequency and voltages don't mean that much (am sure they would be worthwhile for troubleshooting issues if they arose with Tesla themselves). Hope this helps! Am not a developer but if you need help petitioning Tesla just let us know! |
Beta Was this translation helpful? Give feedback.
-
Hi Jason - we could add another mode/option to pypowerwall to retrieve live data via the Tesla Cloud API instead of via the TEG. It is possible to get live data for the basic metrics via the "SITE_DATA" cloud API endpoint command. Also we can retrieve some other data relevant to us via "SITE_CONFIG". This would be better than using "calendar history data" like the tesla-history script does, and in fact a great improvement for the solar-only users as well anyway. The tesla-history script could still be useful to fill in data gaps if the connection to the Tesla cloud server was down for a period. Is it okay to be polling the Tesla Owners API website directly e.g. every 5 seconds? I think it is. I just did some testing with the Tesla App open on a mobile device, and set up a packet capture to watch frequency of poll requests from the app - it appears with the app open and showing the power flow, requests are sent every 4 seconds. So to have pypowerwall polling live data from the cloud every 5 seconds seems reasonable, and is essentially the same as someone leaving the app open forever on a mobile or tablet to show the live power flow. What metrics are available from the cloud? From "SITE_DATA" we can get the following live metrics:
"response": {
"solar_power": 738,
"battery_power": -250,
"load_power": 488,
"grid_power": 0,
}
"response": {
"percentage_charged": 60.87642617009513,
}
"response": {
"grid_status": "Active",
"island_status": "on_grid",
}
"response": {
"energy_left": 7938.894736842106,
"total_pack_energy": 13041,
} From "SITE_CONFIG" we can get the following live metrics:
"response": {
"backup_reserve_percent": 30,
} Maybe pypowerwall could retrieve the live metrics that are available from the cloud, and interpret those as the return values for the api url provided by the proxy. This would minimise other changes like to the telegraf config or InfluxDB CQ's hopefully? So it should be possible to return some metrics from the cloud for the below telegraf inputs: [[inputs.http]]
urls = [
"http://pypowerwall:8675/aggregates",
"http://pypowerwall:8675/soe",
"http://pypowerwall:8675/freq",
"http://pypowerwall:8675/pod"
] With "aggregates" I think the "instant_power" values for solar, load, etc. can be set to the equivalent returned cloud power metrics (i.e. solar, battery, load, grid), however need to confirm for sure these values match. For "freq" we can at least set the value for "grid_status" from the interpreted cloud response, but not much else unfortunately (I cannot find any voltages, frequencies, etc. from the cloud API). For "pod" we can set values for "backup_reserve_percent" and the "PWx_POD_nom_energy_remaining" and "PWx_POD_nom_full_pack_energy". However for "PWx_POD" values this may pose a problem for users with >1 Powerwall? The cloud response may not return individual Powerwall's "energy_remaining" and "full_pack_energy" but a combined value. I cannot test this as I only have 1 Powerwall. The inputs below would not be possible, as the data is not available from the cloud by the looks of it. [[inputs.http]]
urls = [
"http://pypowerwall:8675/strings",
"http://pypowerwall:8675/temps/pw",
"http://pypowerwall:8675/alerts/pw"
] Thoughts @jasonacox ? |
Beta Was this translation helpful? Give feedback.
-
Love that you guys already have a plan in place to cover some of the losses we may see. For me, I like PW full charge capacity and temps. |
Beta Was this translation helpful? Give feedback.
-
I also love (and am grateful) that you guys are already working on a plan! My prioritization would be: PW full charge capacity, string data, alerts, temps, voltages, frequencies. String data is second for me because I have seven strings (six arrays) and can't imagine trying to troubleshoot solar production questions/issues without comparing string data. String data made me feel OK about not having panel level data. |
Beta Was this translation helpful? Give feedback.
-
My priority: The voltage and frequency data is nice but I don't need it as I have string panels. |
Beta Was this translation helpful? Give feedback.
-
Jason, thank you for all your work on pyPowerwall. My priorities are:
Thanks. |
Beta Was this translation helpful? Give feedback.
-
Any tricks or suggestions on how to prevent Powerwall firmware updates? I'm stuck on release 23.12.11 and would be happy to keep it that way indefinitely to preserve the data-logging... |
Beta Was this translation helpful? Give feedback.
-
The latest pypowerwall release, v0.7.3, adds the ability to use the Tesla Owners API (via TeslaPy) to pull basic information and some extended information (e.g. firmware version, Powerwall full charge capacity, etc.). This could be helpful for Powerwall 3 (and Solar only) owners that do not have local API access. For those with local access, the release also adds aggregate Powerwall See release notes starting with https://github.com/jasonacox/pypowerwall/releases/tag/v0.7.1. This doesn't restore the rich data set in the vitals API but it does provide some. We continue to be hopeful that we will see an opportunity to restore more of the vitals data set for those that have lost it. |
Beta Was this translation helpful? Give feedback.
-
@jasonacox I just saw the last comment in this issue over at vloschiavo/powerwall2#55 (comment) which mentions a possibility for continuing to get the vitals out of the powerwall via capturing the Bearer token after logging in as customer. Since (I assume - making a big assumption having not grabbed the code of pypowerwall) that you're logging in as customer since you ask for the login details you may be able to grab the bearer token to use it to grab the vitals (if you're not already doing this). |
Beta Was this translation helpful? Give feedback.
-
Data from api/meters/aggregates: Attempting to get data from Powerwall at https://224.0.0.100/api/system_status/soe Attempting to get data from Powerwall at https://224.0.0.100/api/devices/vitals ERROR Unable to get api/devices/vitals: |
Beta Was this translation helpful? Give feedback.
-
Not Yet
I've fought my way out of websites that haven't wanted to play nice before :) I've also played around wireshark and transparent proxies and packet capture when I've had to to consider poking around to see what can be seen with Tesla Pros - but I think that's probably a dead end, because - at least for my testing, it required a hard login (toggle the switch on the Powerwall) to authenticate even with older firmware, so even if it exposes where the end points are - and that could be useful - if they are only exposed via Telsa Pros, and that is only available via toggling the switch... |
Beta Was this translation helpful? Give feedback.
-
🔥 CRITICAL Upgrade - Please take a moment and upgrade your installation of Powerwall-Dashboard to get the latest pypowerwall proxy. The latest release includes a critical patch that fixes 404 HTTP status code handling for API calls. Older versions of pypowerwall will cause a repeating loop of login attempts to the Powerwall Gateway, eventually resulting in rate limiting and failure to get any metrics. NOTE: If you have firmware 23.44.0 you are impacted due to the removal of the 🟢 Powerwall-Dashboard - Version v3.0.8 Also, if you are using the pypowerwall python library for your own scripts, make sure you upgrade to the latest version (v0.7.6). |
Beta Was this translation helpful? Give feedback.
-
Update on EffortsAs more of the community get the firmware 23.44.0 upgrade (which removes the vitals API), I figure it is time to do a quick update on efforts. The general speculation is that Tesla was planning to remove all local (LAN based) customer accessible APIs and shift to the Tesla App for customers (cloud based) as the only way to get this data and the Tesla Pros app for installers and advanced metrics. The vitals API is the first to go. The Powerwall 3 was released with NO local API and NO web portal access (see #387 ). I understand that Tesla needs to upgrade the system to serve all their customers, making the installation and use a better experience for everyone. That may impact those of us automation/data enthusiast, who are using unofficial APIs to get our data or control our systems. However, I'm also optimistic that we will be able to find a new way to get at least the basic data via local APIs and even hopeful that we may get more with some additional work. Some work is already going on in this area:
More coming... As I said above, I'm still hopeful that a local API will persist (hopefully with some vital like data 🙏 ) or be created soon (for Powerwall 3). Having a local portal and related API set is extremely helpful for power and internet outage events. I believe all Tesla Powerwall would benefit and appreciate that. If you agree, please 👍 In general, I have heard feedback from the community that these data points which are at risk, are priorities (with ☁️ indicating available via Cloud Mode and available with latest pypowerwall release, ❌ indicating only available via local access pre-23.44.0, ⚡ indicates available via local access post 23.44.0 and ✅ indicating no risk)
|
Beta Was this translation helpful? Give feedback.
-
Alerts, IMO would be the Vital Vitals, then Freq/V. What does teh process of altering from local data acquisition to cloud based data acquisition look like? |
Beta Was this translation helpful? Give feedback.
-
@jasonacox wonderful thank you much. Will stand by for merge :) |
Beta Was this translation helpful? Give feedback.
-
HI there, I've just been affected by 23.44.0 and loss of vitals - most importantly for me, the charge info per battery. I do notice some of the same info is available in an array from Would this be a good way forward for now, or would we expect this endpoint to also be removed? The reason I'm so interested here is that one of my PWs seems to be losing a lot of capacity (23%) after only 3 years, and the other one is new as of last week, so I'd like to keep an eye on these. |
Beta Was this translation helpful? Give feedback.
-
Will or has PD been updated to get data from second wifi adapter connected to teg? |
Beta Was this translation helpful? Give feedback.
-
@jasonacox, for folks with multiple PWs, does this provide string data from all of the PWs? |
Beta Was this translation helpful? Give feedback.
-
Is there any reason why you couldn't set up a WiFi client directly on your router if it can reach the gateway and it supports running WiFi interfaces in both AP mode and client mode at the same time? My GateWay and Router are in the same equipement cupboard. They're currently wired together directly by ethernet (of course), but I'm running OpenWrt and believe I should be able to add a client interface to a radio at the same time as an access point interface. I don't know enough not to be dangerous, but I'm hard wired from my PC to my router, so I'm tempted to just try it... |
Beta Was this translation helpful? Give feedback.
-
We have reports of a new Powerwall firmware upgrade (23.44.0) in jasonacox/pypowerwall#57 which results in the removal of the device vitals data API. This API is what we poll to get string data, voltages, frequencies, temperatures, alerts and Powerwall capacity. Unfortunately, I don't think there is a lot we are going to be able to do to recover the device vitals API or data after this Firmware upgrade rolls out.
I believe this will be the first of many changes we will see. As you can see from the TEG portal UI and on the new Powerwall 3, it appears that the direction from Tesla is toward the "Tesla Pros" app to make it easier to install and manage for the majority of their customers. For data nerds like us, we are going to need to pivot and figure out new ways to get what we want. I'm hopeful there will be some easy/good way to accomplish that over next few months.
Request/Notice to the community:
I know changes like this can be frustrating, but I also acknowledge that the Tesla teams need to optimize for the entire customer base and not just us. Still, I'm hopeful that we will be able to figure out ways to bridge most of what we enjoy with the rich data from our Powerwalls, even if we have some work to do to get there.
Beta Was this translation helpful? Give feedback.
All reactions