CareLink Recaptcha EU #47

m0rt4l1n · 2023-09-28T18:49:06Z

Minimed seems to have implemented recaptcha with the standard https://carelink.minimed.eu/patient/sso/login authorization, at least in Europe, thus it does not work for me anymore...

The text was updated successfully, but these errors were encountered:

m0rt4l1n · 2023-09-28T19:03:09Z

For reference, this it what the login ui looks like

stijnbrouwers · 2023-09-29T09:24:14Z

+1
Same here.
Unable to log in due to the recaptcha

m0rt4l1n · 2023-09-29T09:50:01Z

There seems to be an refresh token endpoint in the sso configs (https://carelink.minimed.eu/configs/v1/sso_cp_eu_v4.json), so maybe an manual login with recaptcha and automated refresh would be possible...

stijnbrouwers · 2023-09-29T10:03:48Z

Technically, I suppose it would be possible.
However, that's a workaround that requires some recoding.
I think a more sustainable solution would be to analyse the traffic generated by the official apps to see how these services resolve it and implement that it here...
My best bet would be that there is a different URL to login for retrieving the authentication token, or some kind of parameter we need to use with the current URL.

m0rt4l1n · 2023-09-29T11:04:52Z

In the App I also had to use recaptcha so this seems to be the only option...

stijnbrouwers · 2023-09-29T11:09:47Z

Ah seriously? I don’t remember seeing it.

If the app solves it like that I think you are right, we might be required to provide an initial token and use the refresh url afterwards…

seanch80 · 2023-09-29T13:56:01Z

Medtronic really doesn't like 3rd-party clients it seems... It could also be that some clients are abusing the servers by polling too frequently. I only poll data every 5 or 6 minutes myself, as sensor data is only updated every 5 minutes anyway. There could be a small delay (latency) by doing this obviously, but if we really want Medtronic to not be so aggressive in trying to block 3rd-party clients, polling less often might be preferred. By analyzing the timestamps of new sensor data the polling could be synchronized so it always tries to poll 10-20 seconds after it expects new sensor data to be there, but in any case never more frequently than every 5 minute.

Lintzman · 2023-09-29T22:05:53Z

I also am unable to login after the Recaptcha was added to the login screen. Anyway to get around this?

bewest · 2023-09-30T04:15:40Z

Howdy all, thanks for everyone's interest in this project! I have rewritten much of this library in the form of nightscout-connect's minimedcarelink driver.
The reason for the new plugin was to condense the number of (deprecated) http library plugins, Nightscout specific integration code, and ability to modify driver features and add vendors without modifying Nightscout into a single node package.

Common driver features usually involve scheduling updates, handling error and retry logic. I experimented using xstate to describe a series of state machines and inject vendor specific behavior into the actions and services the machine makes available. This helps standardize scheduling and retry concerns. In fact, the new driver consistently schedules updates to occur such that it rarely misses an update by more than a minute. It turns out Medtronic updates at the very end of the cycle, so additional time has been tuned in addition to randomized jitter to help avoid any kind of thundering herd problems we've had in the past.

Session Refresh

I like this idea but had a lot of trouble implementing this before recaptcha was introduced. In fact I've been trying to make this work consistently for weeks now and have not been able to do so, although I'm sure it's my fault. More work/contributions needed.

Recaptcha

Some brief looking around indicates that the way to do this is download the sound file, which can then be decoded and entered. The xstate and Nightscout integration in the new plugin opens the possibility of communicating messages from the NS UI back and forth to the plugin. It's foreseeable that we could develop features that enable the Nightscout operator to navigate through the obstacle. Many projects on github use AI image or sound recognition, but we can also assume there is a Nightscout operator for setup purposes. Unclear how long a refreshed session will last.

sbc2280 · 2023-09-30T11:31:01Z

Please see a couple of samples..

nightscout/nightscout-connect@5638380

https://github.com/anguriskit24/CareLinkJavaClient/blob/22defbd961a5092c7ed40f3f64adc0170928df39/src/main/java/info/nightscout/medtronic/carelink/client/CareLinkClient.java#L308-L310

sbc2280 · 2023-09-30T11:36:39Z

s now and have not been able to do so, although I'm sure it's my fault. More work/contributions needed.

it looks like there is a cookie that shows how long session/cookie lasts and as long as it gets refreshed before it expires seems to work.

seanch80 · 2023-10-02T03:50:31Z

Is anyone using the Guardian Monitor app? I hear people in my country are using this app still, and I don't see any new versions released for either Apple or Android recently. Maybe this app is using a different protocol?

ex33xv · 2023-10-03T13:15:35Z

Is anyone using the Guardian Monitor app? I hear people in my country are using this app still, and I don't see any new versions released for either Apple or Android recently. Maybe this app is using a different protocol?

Update: unfortunately , it's just a shell w/ some UI improvement to Carelink, still automatically logging off due to inactivity.

@seanch80 I'm testing GuardianMonitor 1.0 now, it require id/pwd & manually reCAPTCHA identification to login, so far it successfully maintains the session without automatically logging off due to inactivity.

stijnbrouwers · 2023-10-04T17:53:29Z

So I did a dirty little POC but I got it working by prefetching the token.
( See: stijnbrouwers@38d02a8 )

FYI, this is not a sustainable solution but rather proves the issue can be solved by prefetching the token and use the tokenrefresh from that point onward. This solution is based upon the work proposed by @sbc2280 ...

How to use it

What you need to do is open up a browser and navigate to carelink.minimed.eu (for EU residents).
When you see the regular login page, open your browser's "Developer Tools"

Now login with your username, password and pass the "reCaptcha".

After login in, you can search for the entry with file = "/" in the Developer Tool's "Network"-tab

Under cookies, copy the values for both:

auth_tmp_token
c_token_valid_to

Pass these values to the application as environment variables with the same name and casing as the cookies (auth_tmp_token & c_token_valid_to).

How it works

The first time entering the checkLogin function "FIRST_TIME_LOGIN"-variable will be set to true.

Whenever FIRST_TIME_LOGIN = true, the new environment variables we just created will be read as if they were cookies and used to do a token refresh.

When a succesfull login has been done, the FIRST_TIME_LOGIN-variable will be set to false and from then on, the process should be the same as before...

bewest · 2023-10-04T17:57:44Z

Excellent work! If possible, I'd like to move this conversation to nightscout-connect.
nightscout/nightscout-connect#25

Were you able to observe any kind of average session duration, or is it very dynamic? The nightscout-connect code is built with the (erroneous?) assumption that sessions will expire at a predictable rate and will attempt to renew the session before that occurs, independently of anything, including what the client says. This could be refactored to depend on what the server claims instead.

stijnbrouwers · 2023-10-04T18:03:46Z

@bewest I'm OK with moving the discussion.

No, I am not aware of the average session duration. I see that "minimed-connect-to-nightscout" actually takes the response from the server into account:

if(expire < new Date(Date.now() + 6 * 60 * 1000)) { 
...
}

This line is also the reason why we needed to add 2 cookies, more specifically the "c_token_valid_to"-cookie is involved in this.

I suppose this would be a more solid solution than to presume a certain expiration rate. Especially when manually setting the token since there might be a delay between login in and starting the application like we do in this solution.

bewest · 2023-10-04T20:47:50Z

I think that is next step in the development:
nightscout/nightscout-connect#22

ex33xv · 2023-10-05T00:46:10Z

Pass these values to the application as environment variables with the same name and casing as the cookies

@stijnbrouwers Is the term "application" in this context referring to "minimed-connect-to-nightscout"? Since reCAPTCHA is blocking access to data from CareLink, which primarily impacts "minimed-connect-to-nightscout" and not "cgm-remote-monitor," correct? Is it feasible to execute this process semi-automatically, meaning manually engaging with reCAPTCHA to acquire the auth_tmp_token and c_token_valid_to, and then adding them to the HTTP object of "minimed-connect-to-nightscout" so that "minimed-connect-to-nightscout" can subsequently transmit data to "cgm-remote-monitor"?

stijnbrouwers · 2023-10-05T07:27:29Z

@ex33xv
Yes, with application I am referring to "minimed-connect-to-nightscout", not the "cgm-remote-monitor".

I am not sure if it's possible with a semi-automatic approach.
Typically in an OIDC workflow you provide a redirecturl during the login process, but that needs to be registered on the OIDC server (in this case by Medtronic). So I doubt if it's possible, but to be sure the traffic from the official app should be monitored to see how it works.

The semi-automatic way would also not work for me since I am running the application on a server (without UI) so opening the browser to pass the captcha would not be possible in such a case.

olsky · 2023-10-05T13:33:38Z

+1 same here, also from dev branch (use of CARELINK_PATIENT), here is the log:


> minimed-connect-to-nightscout@1.5.6 start
> node run.js

[MMConnect] Wait 0 seconds before start
2023-10-05T13:31:55.745Z [Arguments] { '0': 'Logging in to CareLink' }
2023-10-05T13:31:55.748Z [Arguments] { '0': 'EU login 1' }
2023-10-05T13:31:55.752Z [Arguments] {
  '0': 'EU login 1',
  '1': 'https://carelink.minimed.com/patient/sso/login?country=de&lang=en'
}
2023-10-05T13:31:56.451Z [Arguments] {
  '0': 'EU login 2 (url: https://carelink.minimed.eu/patient/sso/login?country=de&lang=en)'
}
2023-10-05T13:31:56.686Z [Arguments] {
  '0': 'EU login 3 (url: https://mdtlogin-ocl.medtronic.com/mmcl/auth/oauth/v2/authorize?locale=null&countrycode=null)'
}
Error: Request failed with status code 400
stack: Error: Request failed with status code 400
    at createError (/home/ubuntu/mmconnect/minimed-connect-to-nightscout/node_modules/axios/lib/core/createError.js:16:15)
    at settle (/home/ubuntu/mmconnect/minimed-connect-to-nightscout/node_modules/axios/lib/core/settle.js:17:12)
    at /home/ubuntu/mmconnect/minimed-connect-to-nightscout/node_modules/axios-cookiejar-support/lib/interceptors/response.js:79:25
    at new Promise (<anonymous>)
    at responseInterceptor (/home/ubuntu/mmconnect/minimed-connect-to-nightscout/node_modules/axios-cookiejar-support/lib/interceptors/response.js:78:9)
    at /home/ubuntu/mmconnect/minimed-connect-to-nightscout/node_modules/axios-cookiejar-support/lib/index.js:130:67
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at async doLoginEu3 (/home/ubuntu/mmconnect/minimed-connect-to-nightscout/carelink.js:170:20)
    at async checkLogin (/home/ubuntu/mmconnect/minimed-connect-to-nightscout/carelink.js:284:28)
    at async Object.fetch (/home/ubuntu/mmconnect/minimed-connect-to-nightscout/carelink.js:313:21)

ex33xv · 2023-10-17T03:53:56Z

Mechanical Turk (mTurk) may be the only solution? ( or 2Captcha, Anti-Captcha, Solve Recaptcha ... might be a better way?)

fjpezuela · 2023-10-20T19:34:04Z

So I did a dirty little POC but I got it working by prefetching the token. ( See: stijnbrouwers@38d02a8 )

FYI, this is not a sustainable solution but rather proves the issue can be solved by prefetching the token and use the tokenrefresh from that point onward. This solution is based upon the work proposed by @sbc2280 ...

How to use it

What you need to do is open up a browser and navigate to carelink.minimed.eu (for EU residents). When you see the regular login page, open your browser's "Developer Tools" Now login with your username, password and pass the "reCaptcha".

After login in, you can search for the entry with file = "/" in the Developer Tool's "Network"-tab Under cookies, copy the values for both:

auth_tmp_token

c_token_valid_to

Pass these values to the application as environment variables with the same name and casing as the cookies (auth_tmp_token & c_token_valid_to).

How it works

The first time entering the checkLogin function "FIRST_TIME_LOGIN"-variable will be set to true.

Whenever FIRST_TIME_LOGIN = true, the new environment variables we just created will be read as if they were cookies and used to do a token refresh.

When a succesfull login has been done, the FIRST_TIME_LOGIN-variable will be set to false and from then on, the process should be the same as before...

Hello, I have Nightscout version 15.0.2 (dev branch) and I am trying to connect Carelink to Nightscout. I got the two variables from the cookies, as you explain and added them as nightscout variables, but I can't get it to connect. It gives an error in the captcha, do I need to do any additional steps?

2023-10-20T19:21:37.629584105Z stdout F ' \r\n' +
2023-10-20T19:21:37.629565525Z stdout F ' \r\n' +
2023-10-20T19:21:37.629561685Z stdout F '

\r\n' +
2023-10-20T19:21:37.629556965Z stdout F '

\r\n' +
2023-10-20T19:21:37.629552205Z stdout F '\r\n' +
2023-10-20T19:21:37.629547615Z stdout F '

Invalid recaptcha

\r\n' +
2023-10-20T19:21:37.629542785Z stdout F '\t\t\t\t

\r\n' +
2023-10-20T19:21:37.629538935Z stdout F ' \t\t\t\t\r\n' +
2023-10-20T19:21:37.629535275Z stdout F ' \t\t\tPassword\r\n' +
2023-10-20T19:21:37.629531315Z stdout F '\t\t\t\t

\r\n' +
2023-10-20T19:21:37.629526815Z stdout F '\t\t\t\t

\r\n' +
2023-10-20T19:21:37.629521965Z stdout F ' \t\t\t\t\r\n' +
2023-10-20T19:21:37.629517305Z stdout F '\t\t\t Username\r\n' +
2023-10-20T19:21:37.629513055Z stdout F '

\r\n' +
2023-10-20T19:21:37.629505335Z stdout F ' \r\n' +
2023-10-20T19:21:37.629500835Z stdout F ' \r\n' +
2023-10-20T19:21:37.629488865Z stdout F ' \r\n' +
2023-10-20T19:21:37.629480845Z stdout F ' \r\n' +
2023-10-20T19:21:37.629476245Z stdout F ' <form action="https://mdtlogin-ocl.medtronic.com/mmcl/auth/oauth/v2/authorize/login?locale=en&country="; method="POST" id="form-login-en" class="form-body form-login" autocomplete="off">\r\n' +
2023-10-20T19:21:37.629471395Z stdout F '

\r\n' +
2023-10-20T19:21:37.629466525Z stdout F '

\r\n' +
2023-10-20T19:21:37.629448975Z stdout F

              <h1 id="title-line2" class='title-login'><span id="logo1" class="logo1">CareLink</span> <sup id="logo-tm">&trade;</sup> <span id="logo2" class="logo2"> </span></h1>\r\n

+
2023-10-20T19:21:37.629443735Z stdout F <h1 id="title-line1" i18n="login_page.title_login" class='title-login'>Log in to </h1>\r\n +
2023-10-20T19:21:37.629439715Z stdout F '

\r\n' +
2023-10-20T19:21:37.629435225Z stdout F '\r\n' +
2023-10-20T19:21:37.629430655Z stdout F '

\r\n' +
2023-10-20T19:21:37.629426685Z stdout F

              <h1 id="banner-label" class='banner-label'><span id="banner-logo1" class="logo1">CareLink</span> <sup id="bannerlogo-tm">&trade;</sup></h1>\r\n

+
2023-10-20T19:21:37.629422065Z stdout F '

\r\n' +
2023-10-20T19:21:37.629417785Z stdout F '\r\n' +
2023-10-20T19:21:37.629414285Z stdout F '

\r\n' +
2023-10-20T19:21:37.629410865Z stdout F '

\r\n' +
2023-10-20T19:21:37.629407445Z stdout F '\r\n' +

stijnbrouwers · 2023-10-23T14:54:21Z

@fjpezuela
The environment variables need to be added and only work for the "minimed-connect-to-nightscout" application.
They need to be added there and the tool will POST the data to nightscout. This is not implement (AFAIK) yet to the "nightscout-connect" tool

ImmRanneft · 2023-10-24T20:54:50Z

@stijnbrouwers it does, actually, as far as I got. At least they use those cookie names too https://github.com/nightscout/nightscout-connect/blob/main/lib/sources/minimedcarelink/index.js#L38
btw that approach works for cgm-remote-monitor as well (I managed to run your approach separately with minimed-connect-to-nightscout, then patched carelink.js on my server and use mmconnect plugin successfuly atm, let's see how it will refresh token)
Thank you.

ImmRanneft · 2023-10-28T13:21:33Z

well, it doesn't seem to refresh token or it breaks at somepoint. bi-daily I have to hi-jack session

fjpezuela · 2023-10-28T13:52:58Z

@fjpezuela Las variables de entorno deben agregarse y solo funcionan para la aplicación "minimed-connect-to-nightscout". Deben agregarse allí y la herramienta PUBLICARÁ los datos en Nightscout. Esto aún no se ha implementado (AFAIK) en la herramienta "nightscout-connect"

Thank you very much for the clarification. I didn't know where the problem was.

stijnbrouwers · 2023-11-30T08:48:50Z

well, it doesn't seem to refresh token or it breaks at somepoint. bi-daily I have to hi-jack session

I am seeing the same issue. After 2-3 days, you need to retrieve the cookie values anew and restart the application.

colebrusco · 2023-12-27T20:04:30Z

do we have any update on this issue?

ffernandezro · 2024-01-07T21:33:49Z

Hello all!

Does anyone know if there is a reliable way to push data from medtronic cloud, Carelink, to nightscout?

Thank you so much.
Regards.

adipanait mentioned this issue Sep 30, 2023

Login error since last Carelink scheduled maintenance FredMK/minimed-connect-to-nightscout-wrapper#8

Closed

bewest mentioned this issue Oct 3, 2023

[minimed carelink] Carelink follower login error nightscout/nightscout-connect#25

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

CareLink Recaptcha EU #47

CareLink Recaptcha EU #47

m0rt4l1n commented Sep 28, 2023

m0rt4l1n commented Sep 28, 2023

stijnbrouwers commented Sep 29, 2023

m0rt4l1n commented Sep 29, 2023

stijnbrouwers commented Sep 29, 2023 •

edited

m0rt4l1n commented Sep 29, 2023

stijnbrouwers commented Sep 29, 2023

seanch80 commented Sep 29, 2023

Lintzman commented Sep 29, 2023

bewest commented Sep 30, 2023

sbc2280 commented Sep 30, 2023

sbc2280 commented Sep 30, 2023

seanch80 commented Oct 2, 2023

ex33xv commented Oct 3, 2023 •

edited

stijnbrouwers commented Oct 4, 2023 •

edited

bewest commented Oct 4, 2023

stijnbrouwers commented Oct 4, 2023

bewest commented Oct 4, 2023

ex33xv commented Oct 5, 2023

stijnbrouwers commented Oct 5, 2023

olsky commented Oct 5, 2023

ex33xv commented Oct 17, 2023 •

edited

fjpezuela commented Oct 20, 2023

How to use it

How it works

stijnbrouwers commented Oct 23, 2023

ImmRanneft commented Oct 24, 2023

ImmRanneft commented Oct 28, 2023

fjpezuela commented Oct 28, 2023

stijnbrouwers commented Nov 30, 2023

colebrusco commented Dec 27, 2023

ffernandezro commented Jan 7, 2024

CareLink Recaptcha EU #47

CareLink Recaptcha EU #47

Comments

m0rt4l1n commented Sep 28, 2023

m0rt4l1n commented Sep 28, 2023

stijnbrouwers commented Sep 29, 2023

m0rt4l1n commented Sep 29, 2023

stijnbrouwers commented Sep 29, 2023 • edited

m0rt4l1n commented Sep 29, 2023

stijnbrouwers commented Sep 29, 2023

seanch80 commented Sep 29, 2023

Lintzman commented Sep 29, 2023

bewest commented Sep 30, 2023

Session Refresh

Recaptcha

sbc2280 commented Sep 30, 2023

sbc2280 commented Sep 30, 2023

seanch80 commented Oct 2, 2023

ex33xv commented Oct 3, 2023 • edited

Update: unfortunately , it's just a shell w/ some UI improvement to Carelink, still automatically logging off due to inactivity.

stijnbrouwers commented Oct 4, 2023 • edited

How to use it

How it works

bewest commented Oct 4, 2023

stijnbrouwers commented Oct 4, 2023

bewest commented Oct 4, 2023

ex33xv commented Oct 5, 2023

stijnbrouwers commented Oct 5, 2023

olsky commented Oct 5, 2023

ex33xv commented Oct 17, 2023 • edited

fjpezuela commented Oct 20, 2023

How to use it

How it works

stijnbrouwers commented Oct 23, 2023

ImmRanneft commented Oct 24, 2023

ImmRanneft commented Oct 28, 2023

fjpezuela commented Oct 28, 2023

stijnbrouwers commented Nov 30, 2023

colebrusco commented Dec 27, 2023

ffernandezro commented Jan 7, 2024

stijnbrouwers commented Sep 29, 2023 •

edited

ex33xv commented Oct 3, 2023 •

edited

stijnbrouwers commented Oct 4, 2023 •

edited

ex33xv commented Oct 17, 2023 •

edited