Error while setting up platform alexa_media - KeyError: 'csrf' #258

eifinger · 2019-07-25T20:49:17Z

Describe the bug
TTS was not working anymore. I suspected an old cookie etc, deleted the .pickle file and restarted homeassistant which always worked. Configuration with 2FA seemed to work. Afterwards I started to see the following errors in the log:

Error while setting up platform alexa_media
Traceback (most recent call last):
  File "/usr/src/app/homeassistant/helpers/entity_platform.py", line 126, in _async_setup_platform
    SLOW_SETUP_MAX_WAIT)
  File "/usr/local/lib/python3.7/asyncio/tasks.py", line 416, in wait_for
    return fut.result()
  File "/usr/local/lib/python3.7/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/config/custom_components/alexa_media/alarm_control_panel.py", line 35, in setup_platform
    hass)  \
  File "/config/custom_components/alexa_media/alarm_control_panel.py", line 73, in __init__
    self.alexa_api = AlexaAPI(self, login)
  File "/usr/local/lib/python3.7/site-packages/alexapy/alexaapi.py", line 51, in __init__
    csrf = self._session.cookies.get_dict()['csrf']
KeyError: 'csrf'

To Reproduce
Steps to reproduce the behavior:

Delete .pickle
Restart HA
Configure (Login)
Error appear

Expected behavior
Media Players should appear along the functionality

Screenshots
If applicable, add screenshots to help explain your problem.

System details

Home-assistant (version): 0.95.4 (docker)
Hassio (Yes/No): No
alexa_media (version from const.py or HA startup): v1.3.1
alexapy (version from pip show alexapy or HA startup): 0.7.0

Additional context
Add any other context about the problem here.

The text was updated successfully, but these errors were encountered:

alandtse · 2019-07-25T23:56:33Z

Thanks for reporting. I suspect Amazon changed something with the login. Will have to look into it. Unfortunately I'm traveling for a couple weeks so can't do much till I'm back.
You have total loss of functionality right?

eifinger · 2019-07-26T06:28:22Z

Unfortunately yes, total loss.

tlpbu · 2019-07-27T07:23:43Z

Have the same issue on hassio as well with latest HA.

anrada73 · 2019-07-27T15:14:42Z

same problem.

jmutnick · 2019-07-27T16:52:45Z

same problem here

jfautley · 2019-07-27T21:09:23Z

It looks like Amazon have tweaked the API, and the AlexaPy library no longer gets the CSRF token from the login URL (and there's no error checking in the init function there).

Given the upstream maintainers lack of time, I've forked the AlexaPy repo and updated the site - I'd raise a PR but it's a one line change and I've not done anything to actually test it - but it works for me.

You can find the updated repo at https://gitlab.com/jfautley/alexapy - I've tested this against an Amazon UK account using Hass.IO.

To install (on Hass.IO), SSH into your instance and run:
pip3 install --target /config --no-dependencies git+https://gitlab.com/jfautley/alexapy

For other Home-Assistant installs, you should be able to use --target /path/to/config/deps but for some reason the PYTHONPATH on Hass.IO is messed up... 🤷‍♂

alandtse · 2019-07-27T23:53:39Z

Thanks @jfautley . I'm currently traveling abroad until August 2 but should be able to make the fix when I'm back. @keatontaylor any chance you can test/implement before then?

jmutnick · 2019-07-28T00:09:30Z

@alandtse, I downloaded the new file and it worked for me! Thanks @jfautley

genem2 · 2019-07-28T01:40:41Z

@jfautley , Thank you!
Alexa can get back to keeping my kids on task!

erichter2018 · 2019-07-28T04:37:26Z

Not fully understanding how to install this... Should I completely uninstall the original plugin and install this instead? or just install it over it?

jkpe · 2019-07-28T10:52:56Z

@jfautley thank you
I replaced the following directory with the files here and restarted but am still getting the same error mentioned in the first post, what am I doing wrong?

homeassistant@homeassistant:~$ locate alexalogin.py
/srv/homeassistant/lib/python3.6/site-packages/alexapy/alexalogin.py

Ryanmt-Deep3 · 2019-07-28T10:54:22Z

Ensure you delete the .pickle file out of your config folder.

Just tested - fix works fine for me too. Thanks @jfautley

jkpe · 2019-07-28T11:00:44Z

Ensure you delete the .pickle file out of your config folder.

Just tested - fix works fine for me too. Thanks @jfautley

Ah yes, working now, thank you

Xaos1990 · 2019-07-28T11:33:30Z

Its working again, thanks @jfautley

erichter2018 · 2019-07-28T12:11:36Z

I'm sorry for being a noob but could someone just give me quick pointers about how to install this? I installed the original media player via HACS on Hassio, but I'm not sure how to upgrade/replace alexapy.

fogarty · 2019-07-28T12:23:27Z

First a huge thx @jfautley now works again!

@erichter2018 the simplest way would be to go to the "Configurator" then clic on settings and on "Execute shell Command"
Paste here the command given by Jon:
pip3 install --target /config --no-dependencies git+https://gitlab.com/jfautley/alexapy

Then don't forget to delete your .pickle file in your /config directory and reboot ;-)

mrnix1001 · 2019-07-29T15:40:59Z

@jfautley This fixed it for me as well! Thank you!

mattnewham · 2019-08-01T09:36:34Z

OK, so ran the shell script, all fine (I had removed the configurator plugin as I use git to manage my config files).

There is no pickle file in my config dir though. Only one for my Ring doorbell. AlexaPY was working fine until the other day when this change became apparent, so I've already set up the connection to Amazon, so confused as to why I dont have a .pickle file?

3ative · 2019-08-01T09:41:19Z

@petestanley112
You mentioned: "Took me a few trays to get it working."

@mattnewham
Did you get it working again?

mattnewham · 2019-08-01T09:43:06Z

@3ative yep - not sure how though. I just restarted my instance and its working again now. I guess I was still properly authenticated because I didnt have to do any authentication steps, just started working when I put the new alexapy in the config dir. Should it not really go into deps though? I dont really like it in the root of the config dir

3ative · 2019-08-01T09:49:49Z

@mattnewham
Cool, glad to hear it.
Same here, I didn't need any re-authentication either - even after deleting the .pickle file.
I know what you mean, my OCD hates the new folders/files in the Root too. :)

leonka93 · 2019-08-02T17:27:07Z

Hi I followed your instructions, but continue to give me the same problem. in config the alexapy folder appeared, should I put it under custom_component? thanks i'm a noob.

petestanley112 · 2019-08-02T23:10:17Z

@3ative
God knows how to send messsges@ some one.

But yeah took a few trays to get it working del picke reinstalled the plugin but this

pip3 install --target /config --no-dependencies git+https://gitlab.com/jfautley/alexapy

Got it working for me.. so thanks fogarty....

Tts is all that works for me. But that's all I want so yeah... oh and I had to re authent every time I del .pickle

3ative · 2019-08-02T23:38:21Z

@leonka93
Running the script put these two folders in my Config folder

-- I haven't and didn't need to move them.
Also, have you deleted the .pickle file and re-started HA?

mattnewham · 2019-08-03T08:39:06Z

Did you restart homeassistant ? And delete the Alexa media pickle file from /config?

…

On 3 August 2019 at 00:10:21, petestanley112 ***@***.***) wrote: God knows how to send messsges@ some one. But yeah took a few trays to get it working del picke reinstalled the — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <https://github.com/keatontaylor/alexa_media_player/issues/258?email_source=notifications&email_token=AABS336WNWXB5MOVP6ES7HLQCS5F3A5CNFSM4IG6KDE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3PAZLY#issuecomment-517868719>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AABS337BFLXWSCVCSAEYKKLQCS5F3ANCNFSM4IG6KDEQ> .

leonka93 · 2019-08-03T11:43:46Z

@ 3ative@mattnewham yes I deleted the pickle file and restart HA. but after the reboot the pickle file continues to appear, and it does not find me nor the Alexa speakers associated with my account asks me to verify it

leonka93 · 2019-08-03T11:45:02Z

I installed hassio on Raspberry Pi 3+.The URL is amazon.it thanks to all

3ative · 2019-08-03T17:07:04Z

@leonka93
That .pickle file [should] return - post restart.
Not sure about your other issues, I've not had any trouble with my setup, soz I can't help futher.

leonka93 · 2019-08-03T18:50:08Z

after a few reboots, finally work, the pickle file continues to appear but does not create problems for music playback. I do some tests for notifications etc. I'll update you. thanks

keatontaylor · 2019-08-03T23:37:11Z

It looks like Amazon have tweaked the API, and the AlexaPy library no longer gets the CSRF token from the login URL (and there's no error checking in the init function there).

Given the upstream maintainers lack of time, I've forked the AlexaPy repo and updated the site - I'd raise a PR but it's a one line change and I've not done anything to actually test it - but it works for me.

You can find the updated repo at https://gitlab.com/jfautley/alexapy - I've tested this against an Amazon UK account using Hass.IO.

To install (on Hass.IO), SSH into your instance and run:
pip3 install --target /config --no-dependencies git+https://gitlab.com/jfautley/alexapy

For other Home-Assistant installs, you should be able to use --target /path/to/config/deps but for some reason the PYTHONPATH on Hass.IO is messed up... 🤷‍♂

@jfautley Please make a PR on the gitlab page.

alandtse · 2019-08-03T23:43:55Z

@keatontaylor I'm actually reviewing if we can make a more robust fix so we can feed multiple urls to iterate through.

alandtse · 2019-08-04T10:45:29Z

As an update, there's a new OTP page where you can then select voice or SMS which we need to handle particularly if you have multiple devices. Looking at a solution now.

rjbrookes · 2019-08-05T00:12:43Z

Hi I am new to all this and have very limited knowledge. Trying to get the Alexa devices shown on media players, when I open the configurator - execute shell command and copy the above mentioned pip3 line it fails to update... I get this:

Command executed: pip3 install --target /config --no-dependencies git+https://gitlab.com/jfautley/alexapy: 1
Collecting git+https://gitlab.com/jfautley/alexapy
Cloning https://gitlab.com/jfautley/alexapy to /tmp/pip-req-build-tt6qrcya
Running command git clone -q https://gitlab.com/jfautley/alexapy /tmp/pip-req-build-tt6qrcya
fatal: unable to access 'https://gitlab.com/jfautley/alexapy/': Could not resolve host: gitlab.com
ERROR: Command "git clone -q https://gitlab.com/jfautley/alexapy /tmp/pip-req-build-tt6qrcya" failed with error code 128 in None

any ideas... spent all day trying to get Alexa to work!

thanks in advanced.

DrBeaker73 · 2019-08-05T06:03:39Z

I dont normally post, but I have to say a HUGE thank you to @jfautley for finding this fix and to @fogarty for making the fix easy. I've spread the word where I can!

I have spent hours troubleshooting this today and long into the evening, but now. Rolling.

cubilon · 2019-08-06T06:35:58Z

Thanks to @fogarty for the solution! Not clear to me how to fix it on Home Assistant on wheels@Buster.

pip3 install --target /config --no-dependencies git+https://gitlab.com/jfautley/alexapy

This is the command for HASSIO, but how to solve on buster?

Sk4zz · 2019-08-07T06:38:57Z

Also thanks to @fogarty for the fix. I'm running hassbian and installed the fix by changing to homeassistant's virtualenv:

source /srv/homeassistant/bin/activate

the path might be different, if you installed homeassistant manually on a buster system. And then installed the fix to my local homeassistant/ via

pip3 install --target /home/homeassistant/.homeassistant/ --no-dependencies git+https://gitlab.com/jfautley/alexapy

You might need to run this command as root if your user hasn't write access to the homeassistant's config dir.

After applying this patch, I have media_player instances for my echos available. Unfortunately, they don't work and my journal shows approximately every 10secs the following error messages.

Aug 06 21:47:37 hassbian hass[3408]: 2019-08-06 21:47:37 ERROR (MainThread) homeassistant.helpers.entity] Update for media_player.this_device fails
Aug 06 21:47:37 hassbian hass[3408]: Traceback (most recent call last):
Aug 06 21:47:37 hassbian hass[3408]:   File "/srv/homeassistant/lib/python3.7/site-packages/homeassistant/helpers/entity.py", line 221, in async_update_ha_state
Aug 06 21:47:37 hassbian hass[3408]:     await self.async_device_update()
Aug 06 21:47:37 hassbian hass[3408]:   File "/srv/homeassistant/lib/python3.7/site-packages/homeassistant/helpers/entity.py", line 380, in async_device_update
Aug 06 21:47:37 hassbian hass[3408]:     await self.hass.async_add_executor_job(self.update)
Aug 06 21:47:37 hassbian hass[3408]:   File "/usr/lib/python3.7/concurrent/futures/thread.py", line 57, in run
Aug 06 21:47:37 hassbian hass[3408]:     result = self.fn(*self.args, **self.kwargs)
Aug 06 21:47:37 hassbian hass[3408]:   File "/home/homeassistant/.homeassistant/custom_components/alexa_media/media_player.py", line 428, in update
Aug 06 21:47:37 hassbian hass[3408]:     no_throttle=True)
Aug 06 21:47:37 hassbian hass[3408]:   File "/srv/homeassistant/lib/python3.7/site-packages/homeassistant/util/__init__.py", line 224, in wrapper
Aug 06 21:47:37 hassbian hass[3408]:     result = method(*args, **kwargs)
Aug 06 21:47:37 hassbian hass[3408]:   File "/srv/homeassistant/lib/python3.7/site-packages/homeassistant/util/__init__.py", line 224, in wrapper
Aug 06 21:47:37 hassbian hass[3408]:     result = method(*args, **kwargs)
Aug 06 21:47:37 hassbian hass[3408]:   File "/home/homeassistant/.homeassistant/custom_components/alexa_media/media_player.py", line 256, in refresh
Aug 06 21:47:37 hassbian hass[3408]:     self._last_called = self._get_last_called()
Aug 06 21:47:37 hassbian hass[3408]:   File "/home/homeassistant/.homeassistant/custom_components/alexa_media/media_player.py", line 357, in _get_last_called
Aug 06 21:47:37 hassbian hass[3408]:     ['serialNumber']))
Aug 06 21:47:37 hassbian hass[3408]: TypeError: 'NoneType' object is not subscriptable

I would appreciate it, if you could point me in the right direction.

Edit: I just realized the update in the dev branch by @alandtse and I will try it out later today.

Edit 2: Nevermind. I changed the server from amazon.com to the local amazon.de and now it seems to work fine!

alandtse added alexapy Issue relates to the API bug Something isn't working labels Jul 27, 2019

This comment has been minimized.

Sign in to view

alandtse pinned this issue Jul 28, 2019

This comment has been minimized.

Sign in to view

alandtse mentioned this issue Aug 7, 2019

fix: handle Amazon API login changes #266

Merged

alandtse mentioned this issue Aug 8, 2019

Update to 1.4.0 #267

Merged

alandtse closed this as completed in #267 Aug 8, 2019

alandtse unpinned this issue Aug 8, 2019

Error while setting up platform alexa_media - KeyError: 'csrf' #258

Error while setting up platform alexa_media - KeyError: 'csrf' #258

Comments

eifinger commented Jul 25, 2019 • edited

alandtse commented Jul 25, 2019

eifinger commented Jul 26, 2019

tlpbu commented Jul 27, 2019

anrada73 commented Jul 27, 2019

jmutnick commented Jul 27, 2019

jfautley commented Jul 27, 2019

alandtse commented Jul 27, 2019 • edited

jmutnick commented Jul 28, 2019

genem2 commented Jul 28, 2019

erichter2018 commented Jul 28, 2019

jkpe commented Jul 28, 2019

Ryanmt-Deep3 commented Jul 28, 2019

jkpe commented Jul 28, 2019

Xaos1990 commented Jul 28, 2019

erichter2018 commented Jul 28, 2019

fogarty commented Jul 28, 2019

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

mrnix1001 commented Jul 29, 2019

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

mattnewham commented Aug 1, 2019

This comment has been minimized.

3ative commented Aug 1, 2019

mattnewham commented Aug 1, 2019

3ative commented Aug 1, 2019

leonka93 commented Aug 2, 2019

petestanley112 commented Aug 2, 2019 • edited

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

3ative commented Aug 2, 2019 • edited

mattnewham commented Aug 3, 2019 via email

leonka93 commented Aug 3, 2019

leonka93 commented Aug 3, 2019

3ative commented Aug 3, 2019

This comment has been minimized.

leonka93 commented Aug 3, 2019

keatontaylor commented Aug 3, 2019 • edited

alandtse commented Aug 3, 2019

alandtse commented Aug 4, 2019

rjbrookes commented Aug 5, 2019

DrBeaker73 commented Aug 5, 2019 • edited

cubilon commented Aug 6, 2019

Sk4zz commented Aug 7, 2019 • edited

eifinger commented Jul 25, 2019 •

edited

alandtse commented Jul 27, 2019 •

edited

petestanley112 commented Aug 2, 2019 •

edited

3ative commented Aug 2, 2019 •

edited

keatontaylor commented Aug 3, 2019 •

edited

DrBeaker73 commented Aug 5, 2019 •

edited

Sk4zz commented Aug 7, 2019 •

edited