-
-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integration with Google assistant #31
Comments
Hi, sorry that is not possible because the Google Assistant doesn't have a local API. I'd need to have a complicated cloud infrastructure to support Google home which I can't do as a small open source project. You can do it with the free IFTTT website though, which is compatible with google Assistant. It requires you to do a router port forwarding so the ESP8266 is accessible from the internet. Then you need two IFTTT Webhooks applets that trigger |
This is not a bug, and there is no way for me to add native Assistant support in the near future sadly. |
Könnte man nicht eine von Google unterstütze api integrieren? Die api von tuya smart (smart life) ist offen und soll leicht verständlich sein. Viele sub-hersteller (smart life oder auch hama) nutzen die. |
Könnte man überlegen. Würde sicherlich funktionieren, aber im Moment möchte ich keine cloudabhängige API integrieren. Es ist aber möglich, das Ganze mithilfe von IFTTT und Blynk zu bauen: https://www.instructables.com/id/GOOGLE-ASSISTANT-CONTROLLED-SWITCH-USING-NODEMCU/ dazu könnte ich mal ein an WLED angepasstes Tutorial erstellen, weil Blynk ja schon implementiert ist. |
Hey, ja mit ifttt habe ich schon einiges umgesetzt; aber die weiblichen Mitglieder der Familie bombardieren die Google home Geräte mit Phrasen die ich vorher nicht angelegt habe und sind dann enttäuscht, wenn auf "hey Google, lightbox Farbe Lavendel" die Farbe dann nicht umgesetzt wird. Vielleicht könnte man die Farben ja sprachbasiert mit rgb Werten hinterlegen? /win&color=red/rot |
This is now possible as there is a local API exposed in the New SDK i think this should be reopened. https://developers.google.com/assistant/smarthome/concepts/local |
right on! |
Not yet looked into it in detail, but I agree that this is a promising change! |
Any update as to having google automation? I've tried using WebCoRE with Smartthings, no luck. Couldn't do Blynk as I'm new to programming. I already set up my ESP8266 with my WS2812b lights and WLED but I want at least Google home to turn them off or on. Any other ideas? I tried adafruit but i'll have to see as I followed a tutorial and I got a bit lost |
Are there any updates for this feature? I'm looking forward to being able to control my lights with my google home natively! |
I spent a little time getting the Blynk webhook working for one of my projects. It takes a bit of leg work, but here's a write up of what I went through to use Google Assistant via IFTTT and Blynk: http://www.robopenguins.com/web-based-door-control-update/ |
Relevant to this issue: Google announced that their Local Home SDK has emerged from developer preview and is now GA: https://developers.googleblog.com/2020/04/local-home-sdk-ready-for-actions.html |
This would make WLED even more user friendly and ready for the mass |
Just reading the updates, this is exciting! Can't wait to see this feature land! :-) Keep up the great work! |
Is there a tutorial how can i integrate wled with google assistant? |
Watching this open issue eagerly! |
Following this one as well. My kids will appreciate the ability to control their desk LEDs with the Google home speakers in their rooms! |
+1 here for Google Integration in the near future too. |
Found this. Any help? @Aircoookie ? |
I was able to set this up. First using this guide for having a static FQDN with a cert https://www.youtube.com/watch?v=hqRT2VKhxJ0 i had no router loopback problems. Then i mainly used the https://www.home-assistant.io/integrations/google_assistant/ guide to do the rest. I think i also watched https://www.youtube.com/watch?v=MMtCzX6US9M and https://www.youtube.com/watch?v=mDqllkmxiOI the only gotcha was google no longer accepts the apikey and will only accept a json fil. so i had upload my json file i got from google to home assist and make my config file look have this. The part i dont have working and would be happy to do a write up if i figured out how would be how to change things like fx via google. |
after briefly talking to @Aircoookie and "e_town" on discord i was able to setup saying things like "OK google turn on Bedroom popcorn effect" EDIT
|
Hi, just wanted to ask if there are any news on the integration? |
maybe it can have more future support once Connected Home over IP becomes more developed and supported https://github.com/project-chip/connectedhomeip#connected-home-over-ip |
CHIP seems awesome! Perhaps this is finally the standard we've been waiting for that will ideally work with all major voice assistants without needing a "manufacturer server". I just hope that the overhead for implementing security won't be too much for an ESP8266, they tend to be quite unusable in most things crypto. |
isnt this what zigbee was suppoed to be until it got butcherd by the very people involved in CHIP ? Ahh so its not a radio its piggybacking over other radio stacks, ooh i wonder if this could be used to run connected lights/switches/sockets on ethernet over power (powerline) well when they support ethernet that is |
I haven't had the chance to go through those links yet, but is it controlling it via http request on the local network? If so I think I can help you with controlling the fx. |
Not sure this is 100% relevant to this thread issue thread, but if you have Samsung Smartthings, WLED can be integrated with that, and Google assistant has some ability to control them. I used this to do it: |
I might be able to build a service that does this. IMO, the hard part would be building a way for IT to talk to our WLED instances without port forwarding. One method I thought of would be to have a setting in WLED where it would poll an HTTP server every few seconds until it got a response that told it to change its current settings. It's not the push like notifications we've come to love, but it's an idea. I'll let everyone know if I actually make an attempt at setting something up like this. |
@Ryanb58 after it recieves the command from the google cloud. then it forwards it to your local network to wled. it it posible that I'm simply describing what node-red does(doh!) or home assistant. surely all the google enabled things don't require port forwarding. |
@Ryanb58 that would be absolutely amazing!
How about MQTT? The publish/subscribe type messages mean no polling and thus almost instant change. I've thought about the architecture |
Little bit of progress: @Aircoookie The ways to send change requests(JSON, MQTT, etc…) are only available on the local network(inbound/outbound traffic issue). To pursue the MQTT approach, I think I would need a Samsung SmartThings device or something similar. I'd like to go at this with an approach that doesn't require me to have to buy any more hardware. Depending on how I can establish the connection. Side Note/Discovery: |
@Aircoookie I may not understand MQTT. I'm going to do more research into it. My last comments about it may not apply. |
@Ryanb58 wow, that is awesome! If you manage to implement something that works, I'd definitely be happy to cover the hosting $ if it's not outrageous. About MQTT, indeed, it works outside the local network, which I believe is a key requirement for this sort of thing to work. How it works is also quite simple, the WLED subscribes to the |
@Aircoookie Are there any plans on supporting TLS 1.2 and x.509 certs during the MQTT rewrite? |
@Ryanb58 not currently, on ESP8266 we definitely do not have enought memory for crypto. On 32, it is less of an issue, but it is still quite hard. The only way that worked when I tried it was hard-coding a certificate, which of course breaks all communication if it expires, and only allows interfacing with one specific pre-set server. |
@Aircoookie I played around with MQTT a bit more over this last weekend, and learned a lot. I went through the steps of setting up a local Mosquito MQTT server and controlling my WLED lights from it; from a python script. That gave me a way better understanding of how it operates. I didn't have to send any OAuth Tokens over the wire to MQTT broker. If I get some more time this next weekend, I will attempt to push it all onto an EC2 instance and test out my Oauth App's code alongside a dedicated MQTT broker instance. It will be over an insecure transport, but should give me a good feel for what this will look like running together. I'll keep ya updated. |
Just testing out the integration a bit tonight. Figure I'd share the progress in a video. https://www.youtube.com/watch?v=s2G-iIrtfhc The Code isn't ready for prime time… Lots of embedded secrets and passwords… But I'll keep working on it to get it up to a server for other people to try in the near future. In its current state... it is insecure. |
Very nice, this will make wLED infinitely more useful for me and I'm sure a ton of others.
Looking forward to seeing this implemented.
|
I was looking at this and try to find some Google assistant to mqtt integration and i came across this three projects that can be use to control wled over Google assistant for two of them need to have full SSL, setting up google actions port forwarding so you can run them but one of them is much easier it just need node-red no need for port opening and SSL |
After a few weeks of messing with this stuff, there isn't really anything we can add to this repo to make this work. It involves a cloud provider setup with a connection to your IoT devices. Thus, maybe this PR should be closed until one of these two items are completed.
My original setup involved an insecure MQTT broker on the web. Which was abused. Thus, wouldn't provide a good user experience and is a security risk. |
Is there any update on getting wled working natively with google home? I'm looking forward to this as i have two nest hub 2 and a sonos one with google Assistant. |
Matter as a replacement for current Google Home infrastructure looks promising as a robust solution to this as it doesn't require cloud access for smart home devices, similar to HomeKit. But no idea on licensing, security or implementation on esp32. |
Any updates here? Or atleast a guide with the best DIY solution? |
Hi all. For starters, I´m a total noob. I just made my first LED strip with a Wemos D1 mini for the back of my tv with Wled+Hyperion. This works great. Wife asked if they could be turned on/off with Google assistant? So I am looking for this feature to. I did some digging around and found something called ESP Rainmaker which can be set up using a local MQTT broker. It can be used for ESP32 and ESP8266. The ESP Rainmaker app can then be added to Google Home without issue. I am no coder and only understand half of it. My thought was if ESP Rainmaker some how could be implemented in Wled? https://www.youtube.com/watch?v=Ta9dwDD9GyA Regards |
If you have local mqtt/broker then you can do this via home assistant
without additional work. The problem is when you don't want/have a local HA
instance and would like to have them directly controlled via Google Home.
…On Fri, 27 Jan 2023, 12:22 pm BrimStoneDK, ***@***.***> wrote:
Hi all. For starters, I´m a total noob. I just made my first LED strip
with a Wemos D1 mini for the back of my tv with Wled+Hyperion. This works
great. Wife asked if they could be turned on/off with Google assistant? So
I am looking for this feature to. I did some digging around and found
something called ESP Rainmaker which can be set up using a local MQTT
broker. It can be used for ESP32 and ESP8266. The ESP Rainmaker app can
then be added to Google Home without issue. I am no coder and only
understand half of it. My thought was if ESP Rainmaker/MQTT some how could
be implemented in Wled? https://www.youtube.com/watch?v=Ta9dwDD9GyA
Regards
—
Reply to this email directly, view it on GitHub
<#31 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AACF5L7NI5E7EDH6R2MWZNTWUMBLFANCNFSM4FH2MTMQ>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Thats what I mean. This should work without a HA instance. Full control using Google assistant. Watch the video ;) |
You still have to have a local mqtt instance so this is pretty much the
same thing, wether it's Google, home assistant, openhab or rainmaker ; it's
still acting as the intimediary and you still need a local mqtt instance.
…On Fri, 27 Jan 2023, 12:27 pm BrimStoneDK, ***@***.***> wrote:
Thats what I mean. This should work without a HA instance. Full control
using Google assistant. Watch the video ;)
—
Reply to this email directly, view it on GitHub
<#31 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AACF5L6LAIH7HRGYDTC36SDWUMB53ANCNFSM4FH2MTMQ>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Yes yes agreed. The way I understand it is there has to be some sort of code on the ESP board to be able to add it to the Rainmaker app as an IOT device. The Rainmaker app is then added as a "skill" to Home Assistant there by adding voice control. I dont care if its local or cloud or both. As long as I can use voice control. |
I've setup some IFTTT webhook, is working "okayish" |
Based on my experience with AWS IoT Core and on what I found on the web about connecting an ESP32 to AWS, I'd like to share an idea how this might work without an MQTT broker in the middle. The solution consists of two parts:
The part I can't say much about is how much effort this is to integrate, since I'm rather new to programming microcontrollers. My motivation is to get feedback on this aspect and on whether I'm missing something... Cheers |
Sorry, forgot to add the link to the tutorial... |
hola, estoy usando esp32 con rainmaker y te deja configurar varios dispositivos, ya que tengo varias luces con wled esp8266 y no es compatible con casi nada el esp8266, se me ocurrio usar el esp32 como master y crear varias luces virtuales en el y que cada luz virtual le envie los comandos desde rainmaker a wled por GET o por MQTT, aun no lo termino de probar pero creo que va a ser una buena solucion para los viejos esp8266 wled que tengo ya en casa y funcionan muy bien. voy a ir comentando aca mis avances y si funciona entonces publico mi codigo para que lo trabajemos en conjunto y tengamos una solucion estable y sin tanto problemas de configurar servidores en la nube. |
Hi, unfortunately most people here (including myself) do not speak Portuguese, could you translate your comment into English? Thanks. |
Has anyone investigated Google's local fulfillment sdk? https://developers.home.google.com/local-home/overview |
How can I Control it with Google assistant
The text was updated successfully, but these errors were encountered: