Can we support UOS with puppeteer? #127

huan · 2021-03-21T13:55:23Z

According to this Pull Request to ItChat created by @luvletter2333, it seems we can improve our puppeteer version as well.

UOS

I believe the most important is the headers.

UOS_PATCH_CLIENT_VERSION = '2.0.0'
UOS_PATCH_EXTSPAM = 'Gp8ICJkIEpkICggwMDAwMDAwMRAGGoAI1GiJSIpeO1RZTq9QBKsRbPJdi84ropi16EYI10WB6g74sGmRwSNXjPQnYUKYotKkvLGpshucCaeWZMOylnc6o2AgDX9grhQQx7fm2DJRTyuNhUlwmEoWhjoG3F0ySAWUsEbH3bJMsEBwoB//0qmFJob74ffdaslqL+IrSy7LJ76/G5TkvNC+J0VQkpH1u3iJJs0uUYyLDzdBIQ6Ogd8LDQ3VKnJLm4g/uDLe+G7zzzkOPzCjXL+70naaQ9medzqmh+/SmaQ6uFWLDQLcRln++wBwoEibNpG4uOJvqXy+ql50DjlNchSuqLmeadFoo9/mDT0q3G7o/80P15ostktjb7h9bfNc+nZVSnUEJXbCjTeqS5UYuxn+HTS5nZsPVxJA2O5GdKCYK4x8lTTKShRstqPfbQpplfllx2fwXcSljuYi3YipPyS3GCAqf5A7aYYwJ7AvGqUiR2SsVQ9Nbp8MGHET1GxhifC692APj6SJxZD3i1drSYZPMMsS9rKAJTGz2FEupohtpf2tgXm6c16nDk/cw+C7K7me5j5PLHv55DFCS84b06AytZPdkFZLj7FHOkcFGJXitHkX5cgww7vuf6F3p0yM/W73SoXTx6GX4G6Hg2rYx3O/9VU2Uq8lvURB4qIbD9XQpzmyiFMaytMnqxcZJcoXCtfkTJ6pI7a92JpRUvdSitg967VUDUAQnCXCM/m0snRkR9LtoXAO1FUGpwlp1EfIdCZFPKNnXMeqev0j9W9ZrkEs9ZWcUEexSj5z+dKYQBhIICviYUQHVqBTZSNy22PlUIeDeIs11j7q4t8rD8LPvzAKWVqXE+5lS1JPZkjg4y5hfX1Dod3t96clFfwsvDP6xBSe1NBcoKbkyGxYK0UvPGtKQEE0Se2zAymYDv41klYE9s+rxp8e94/H8XhrL9oGm8KWb2RmYnAE7ry9gd6e8ZuBRIsISlJAE/e8y8xFmP031S6Lnaet6YXPsFpuFsdQs535IjcFd75hh6DNMBYhSfjv456cvhsb99+fRw/KVZLC3yzNSCbLSyo9d9BI45Plma6V8akURQA/qsaAzU0VyTIqZJkPDTzhuCl92vD2AD/QOhx6iwRSVPAxcRFZcWjgc2wCKh+uCYkTVbNQpB9B90YlNmI3fWTuUOUjwOzQRxJZj11NsimjOJ50qQwTTFj6qQvQ1a/I+MkTx5UO+yNHl718JWcR3AXGmv/aa9rD1eNP8ioTGlOZwPgmr2sor2iBpKTOrB83QgZXP+xRYkb4zVC+LoAXEoIa1+zArywlgREer7DLePukkU6wHTkuSaF+ge5Of1bXuU4i938WJHj0t3D8uQxkJvoFi/EYN/7u2P1zGRLV4dHVUsZMGCCtnO6BBigFMAA='

headers = {
  'client-version' : UOS_PATCH_CLIENT_VERSION,
  'extspam' : UOS_PATCH_EXTSPAM,
  'referer' : 'https://wx.qq.com/?&lang=zh_CN&target=t'
}

To be investigated.

huan · 2021-03-21T14:50:14Z

It seems not to work on my account (can not log in via web) with the following modifications:

https://github.com/wechaty/wechaty-puppet-wechat/blob/04fae37abc714b21b19ad66eca827971d3a63a35/src/bridge.ts#L228-L242

@luvletter2333 Please feel free to join us if you are interested. :-)

luvletter2333 · 2021-03-21T15:00:31Z

I am willing to help but I have no idea about typescript and its HTTP library...

luvletter2333 · 2021-03-21T15:01:35Z

This patch is still working, I checked it just before

luvletter2333 · 2021-03-21T15:24:51Z

This patch should be applied to the third step of login.

When you get a 200 from https://login.weixin.qq.com/cgi-bin/mmwebwx-bin/login, the response must contain window.redirect_uri="https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage.

When requesting cgi-bin/mmwebwx-bin/webwxnewloginpage, this patch is needed. Besides, wxsid and wxuin should be obtained from Cookie, not XML response.

huan · 2021-03-21T15:48:11Z

Hi @luvletter2333 !

Thank you very much for your reply, and it's great to know that the patch is still working!

When you get a 200 from https://login.weixin.qq.com/cgi-bin/mmwebwx-bin/login, the response must contain window.redirect_uri="https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage.

Cloud you explain how to get a response contain window.redirect_uri="https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage" when visit https://login.weixin.qq.com/cgi-bin/mmwebwx-bin/login?

I tried in the chrome browser and it seems that the webwxnewloginpage does not exist.

Could you please share a minimum code to reproduce it in Python code, or CURL if possible? Appreciate it!

luvletter2333 · 2021-03-26T06:57:07Z

Hi @luvletter2333 !

Thank you very much for your reply, and it's great to know that the patch is still working!

When you get a 200 from https://login.weixin.qq.com/cgi-bin/mmwebwx-bin/login, the response must contain window.redirect_uri="https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage.

Cloud you explain how to get a response contain window.redirect_uri="https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage" when visit https://login.weixin.qq.com/cgi-bin/mmwebwx-bin/login?

I tried in the chrome browser and it seems that the webwxnewloginpage does not exist.

Could you please share a minimum code to reproduce it in Python code, or CURL if possible? Appreciate it!

I'm sorry to reply so late.
You would need to switch to Firefox for inspection since Chrome Devtools may lose Response Body.

You could follow this repo to try adding custom Headers. Then you may login Wechat Web like UOS.
The pre-generated token is published in issues by me.

luvletter2333 · 2021-03-26T07:00:54Z

About the analysis of the protocol of Wechat Web, you could check this blog https://blog.csdn.net/zhangmiaoping23/article/details/78733231

huan · 2021-03-26T07:07:21Z

Thank you so much for the detailed explanation!

I'll try Firefox to reproduce it later, and I believe it will not be hard to enable it in Puppeteer because we can study from the Firefox ModHeader plugin.

artxia · 2021-04-09T10:01:13Z

不知道是不是 redirect_uri 的关系？使用 988dd56 依然不能绕开登录限制

huan · 2021-04-09T10:09:05Z

@artxia If you want to help, I'd like to suggest that you follow this repo https://github.com/BlueSky-07/wechat-token and make everything work with the browser plugin as the repo mentioned.

After you can reproduce the login successfully with the browser plugin, then I believe we will be easily to copy the setting from the browser plugin to the puppeteer configurations.

artxia · 2021-04-09T10:13:40Z

@artxia If you want to help, I'd like to suggest that you follow this repo https://github.com/BlueSky-07/wechat-token and make everything work with the browser plugin as the repo mentioned.

After you can reproduce the login successfully with the browser plugin, then I believe we will be easily to copy the setting from the browser plugin to the puppeteer configurations.

https://github.com/adamyi/wechrome
This browser plugin can be used directly.

huan · 2021-04-09T10:16:29Z

Awesome, it looks great!

Would you like to send a PR to configure our puppeteer by following the setting from this plugin?

This improvement will be an epic milestone for our Web Protocol since 2017!

artxia · 2021-04-09T10:21:55Z

I am very sorry, my code programming skills are not enough for PR.

Also, the above browser plugin may require adding an address "https://wx2.qq.com/*" to "wechatUrls".

leochen-g · 2021-04-09T11:21:04Z

This is an exciting news

huan · 2021-04-11T18:41:04Z

According to puppeteer/puppeteer#659 and Stackoverflow: No, google-chrome in headless mode doesn't support extensions yet., we can not use https://github.com/adamyi/wechrome directly with the puppeteer.

Need to move the logic to native puppeteer implementation.

leochen-g · 2021-04-13T04:42:33Z

Hi @luvletter2333 !

Thank you very much for your reply, and it's great to know that the patch is still working!

When you get a 200 from https://login.weixin.qq.com/cgi-bin/mmwebwx-bin/login, the response must contain window.redirect_uri="https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage.

Cloud you explain how to get a response contain window.redirect_uri="https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage" when visit https://login.weixin.qq.com/cgi-bin/mmwebwx-bin/login?

I tried in the chrome browser and it seems that the webwxnewloginpage does not exist.

Could you please share a minimum code to reproduce it in Python code, or CURL if possible? Appreciate it!

Thank you so much for the detailed explanation!

I'll try Firefox to reproduce it later, and I believe it will not be hard to enable it in Puppeteer because we can study from the Firefox ModHeader plugin.

我本地测试了一个最简化的代码，发现https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage是扫码点击确定后的跳转地址，所以不扫码确定看不到这个path。以下是我使用puppeteer写的最小demo，本地测试已经可以成功登陆网页端，希望能有帮助

const pptr = require('puppeteer');

async function bootstrap() {
    const browser = await pptr.launch({
        headless: false,
        slowMo: 250,
    });
    const page = await browser.newPage();
    // 开启请求拦截
    await page.setRequestInterception(true);
    page.on('request', async req => {
        let url = new URL(req.url());
        if (url.pathname == "/cgi-bin/mmwebwx-bin/webwxnewloginpage") {
            console.log(req.headers())
            const override = {
                headers: {
                    ...req.headers(),
                    extspam: "Gp8ICJkIEpkICggwMDAwMDAwMRAGGoAI1GiJSIpeO1RZTq9QBKsRbPJdi84ropi16EYI10WB6g74sGmRwSNXjPQnYUKYotKkvLGpshucCaeWZMOylnc6o2AgDX9grhQQx7fm2DJRTyuNhUlwmEoWhjoG3F0ySAWUsEbH3bJMsEBwoB//0qmFJob74ffdaslqL+IrSy7LJ76/G5TkvNC+J0VQkpH1u3iJJs0uUYyLDzdBIQ6Ogd8LDQ3VKnJLm4g/uDLe+G7zzzkOPzCjXL+70naaQ9medzqmh+/SmaQ6uFWLDQLcRln++wBwoEibNpG4uOJvqXy+ql50DjlNchSuqLmeadFoo9/mDT0q3G7o/80P15ostktjb7h9bfNc+nZVSnUEJXbCjTeqS5UYuxn+HTS5nZsPVxJA2O5GdKCYK4x8lTTKShRstqPfbQpplfllx2fwXcSljuYi3YipPyS3GCAqf5A7aYYwJ7AvGqUiR2SsVQ9Nbp8MGHET1GxhifC692APj6SJxZD3i1drSYZPMMsS9rKAJTGz2FEupohtpf2tgXm6c16nDk/cw+C7K7me5j5PLHv55DFCS84b06AytZPdkFZLj7FHOkcFGJXitHkX5cgww7vuf6F3p0yM/W73SoXTx6GX4G6Hg2rYx3O/9VU2Uq8lvURB4qIbD9XQpzmyiFMaytMnqxcZJcoXCtfkTJ6pI7a92JpRUvdSitg967VUDUAQnCXCM/m0snRkR9LtoXAO1FUGpwlp1EfIdCZFPKNnXMeqev0j9W9ZrkEs9ZWcUEexSj5z+dKYQBhIICviYUQHVqBTZSNy22PlUIeDeIs11j7q4t8rD8LPvzAKWVqXE+5lS1JPZkjg4y5hfX1Dod3t96clFfwsvDP6xBSe1NBcoKbkyGxYK0UvPGtKQEE0Se2zAymYDv41klYE9s+rxp8e94/H8XhrL9oGm8KWb2RmYnAE7ry9gd6e8ZuBRIsISlJAE/e8y8xFmP031S6Lnaet6YXPsFpuFsdQs535IjcFd75hh6DNMBYhSfjv456cvhsb99+fRw/KVZLC3yzNSCbLSyo9d9BI45Plma6V8akURQA/qsaAzU0VyTIqZJkPDTzhuCl92vD2AD/QOhx6iwRSVPAxcRFZcWjgc2wCKh+uCYkTVbNQpB9B90YlNmI3fWTuUOUjwOzQRxJZj11NsimjOJ50qQwTTFj6qQvQ1a/I+MkTx5UO+yNHl718JWcR3AXGmv/aa9rD1eNP8ioTGlOZwPgmr2sor2iBpKTOrB83QgZXP+xRYkb4zVC+LoAXEoIa1+zArywlgREer7DLePukkU6wHTkuSaF+ge5Of1bXuU4i938WJHj0t3D8uQxkJvoFi/EYN/7u2P1zGRLV4dHVUsZMGCCtnO6BBigFMAA=",
                    'client-version': "2.0.0",
                }
            }
            await req.continue(override);
            return
        }
        await req.continue();

    });

    page.on('response', async res => {
        if (res.url().indexOf('/header') >= 0) {
            console.log(res.status());
            console.log(await res.text());
        }
    });

    page.on('requestfinished', req => {
        // console.log(`请求完成: ${req.url()}`);
    });

    page.on('requestfailed', req => {
        console.log(`请求失败: ${req.url()}`);
    });
    await page.goto('https://wx.qq.com/?target=t');
}

bootstrap();

luvletter2333 · 2021-04-13T04:46:00Z

我本地测试了一个最简化的代码，发现https://wx.qq.com/cgi-bin/mmwebwx-bin/webwxnewloginpage是扫码点击确定后的跳转地址，所以不扫码确定看不到这个path。以下是我使用puppeteer写的最小demo，本地测试已经可以成功登陆网页端，希望能有帮助

是这样的（

huan · 2021-04-13T05:03:50Z

@gengchen528 Thank you very much for your feedback and minimum reproducible code, it will be a great help and I'll definitely try it today and hope we can integrate it into our puppet soon!

官方答复： > Wechaty 也是有免费方案的，比如这里的基本上都是免费的： https://wechaty.js.org/docs/puppet-providers/ 包括网页版 WeChat, Whatsapp, 飞书，Gitter 等等 > 网页版有一部分无法登陆的账号，也有希望通过 wechaty/puppet-wechat#127 很快 Fix 掉，这样的话就任何微信账号都可以用免费版本 Wechaty 了

huan · 2021-04-13T08:01:09Z

Thanks to @gengchen528 for adding UOS support for our Wechaty Puppet WeChat!

The PR has been tested by myself and it works like a charm, I have merged it as wechaty-puppet-wechat@0.27.1 and we can expect for using it soon!

This is a HUGE improvement for our Wechaty ecosystem because this fix lets most of the users can get started with Wechaty more easily. I'd like to invite @gengchen528 to write a blog post for announcing this great improvement, it would be great if we have it soon and I'm looking forward to reading it!

leochen-g · 2021-04-13T08:17:10Z

Thanks to @gengchen528 for adding UOS support for our Wechaty Puppet WeChat!

The PR has been tested by myself and it works like a charm, I have merged it as wechaty-puppet-wechat@0.27.1 and we can expect for using it soon!

This is a HUGE improvement for our Wechaty ecosystem because this fix lets most of the users can get started with Wechaty more easily. I'd like to invite @gengchen528 to write a blog post for announcing this great improvement, it would be great if we have it soon and I'm looking forward to reading it!

非常荣幸能够写这篇博客，感谢 @artxia 提供的chrom插件给了我思路。希望这种方式能够一直可用

huan · 2021-04-13T13:59:06Z

Close this issue because it has been implemented perfectly.

Thanks to @luvletter2333 for letting me know UOS by your Python PR, @artxia for linking to the chrome extension to make everything clear, @gengchen528 for creating the PR for our puppet system!

…chat#127)

Related to #127

suntong · 2021-05-08T14:35:34Z

Thanks you guys to have made such tremendous breakthrough. Truly a milestone in WX bot history. @gengchen528 your blog post is spreading like a wildfire in WX bot community, 😄😄

One question,

You could follow this repo to try adding custom Headers. Then you may login Wechat Web like UOS.
The pre-generated token is published in issues by me.

Currently, the whole world is using a fixed extspam value from @gengchen528's blog post, however, wechat-token says that the extspam value should be associated with each person's profile. So

@luvletter2333 / @gengchen528, do you think it'd be a problem, if the whole world is using the same fixed extspam value? thx

huan · 2021-05-08T14:50:09Z

@luvletter2333 / @gengchen528, do you think it'd be a problem, if the whole world is using the same fixed extspam value? thx

Thanks for pointing this out! I'd also have this question and I believe it should not use the same extspam value for every users.

leochen-g · 2021-05-08T15:00:24Z

目前看来同一个extspam不会有太大问题，但是后期没法保证。如果如果把wechat-token集成进puppet或者让用户自行生成的话，会不会增加使用门槛，而且我看使用wechat-token是需要安装docker环境的

我在想是否能够由我们提前生成一批extspam，在启动的时候随机使用其中一个呢这只是我目前个人的建议

suntong · 2021-05-08T16:36:10Z

是否能够由我们提前生成一批extspam，在启动的时候随机使用其中一个呢

I think that's the best solution so far, I was thinking that too.
Otherwise, it can easily be identified by WX, and becomes the biggest giveaway, yelling to WX, "block me, I'm such an easy target and so simple to block"

zpaimon · 2021-05-09T15:13:15Z

I think we can build a token server.When user start puppet,the puppet call token api and get an extspam token.

ghost · 2022-12-12T13:51:20Z

我可以正常登录 UOS 微信，但是无法通过 wechaty 登陆。

扫码后手机微信提示“当前账号无法使用该服务”。

austincityuwen · 2023-03-24T09:23:58Z

It's too late for me to read this issue at this moment, my question is how to generate personal extspam that associated with each person's profile? In case that it is detected by wechat and may block it someday？

huan added the enhancement New feature or request label Mar 21, 2021

huan added a commit that referenced this issue Mar 21, 2021

Try to add UOS patch (#127)

988dd56

huan added a commit to wechaty/wechaty that referenced this issue Mar 21, 2021

Upgrade puppeteer to UOS (wechaty/puppet-wechat#127)

4654e33

huan pinned this issue Mar 22, 2021

artxia mentioned this issue Apr 7, 2021

web 登录可以通过 UOS 的自定义标头绕过登录限制，还请升级一下依赖 UnsignedInt8/wallchat#20

Closed

huan added a commit that referenced this issue Apr 9, 2021

Try using chrome extension (#127)

f929c2b

huan mentioned this issue Apr 13, 2021

添加uos请求头支持 #129

Merged

This was referenced Apr 13, 2021

Gengchen528 patch 1 wechaty/docusaurus#737

Merged

Update wechaty-puppet-wechat provider docs page wechaty/docusaurus#738

Open

huan closed this as completed Apr 13, 2021

huan added a commit that referenced this issue Apr 13, 2021

v0.28 changelog (#127)

36af019

huan added a commit to wechaty/wechaty that referenced this issue Apr 13, 2021

Support Web UOS (wechaty/puppet-wechat#127)

1d7c8f2

huan added a commit to wechaty/getting-started that referenced this issue Apr 13, 2021

Enable UOS Web Protocol for WeChat (wechaty/puppet-wechat#127)

db65d89

huan added a commit to wechaty/wechaty that referenced this issue Apr 13, 2021

use wechaty-puppet-wechat with UOS for the default (wechaty/puppet-we…

58af3dc

…chat#127)

kecrily mentioned this issue Apr 14, 2021

OneBot Web WeChat 端 botuniverse/onebot#95

Closed

huan pushed a commit that referenced this issue Apr 14, 2021

修复二次登陆时，报web协议限制 (#130)

d433df2

Related to #127

huan mentioned this issue Apr 14, 2021

修复二次登陆时，报web协议限制 #130

Merged

huan added a commit to wechaty/getting-started that referenced this issue Apr 14, 2021

upgrade wechat for uos support! (wechaty/puppet-wechat#127)

99faa02

onism68 mentioned this issue Apr 16, 2021

添加uos请求头支持 eatmoreapple/openwechat#2

Merged

suntong mentioned this issue May 8, 2021

301 response missing Location header eatmoreapple/openwechat#11

Closed

leochen-g mentioned this issue May 31, 2021

web端登录不了 leochen-g/wechaty-web-panel#1

Closed

huan unpinned this issue Sep 1, 2021

vzhong mentioned this issue Nov 9, 2021

Account is unable to use wechat for web wechaty/matrix-appservice#115

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Can we support UOS with puppeteer? #127

Can we support UOS with puppeteer? #127

huan commented Mar 21, 2021 •

edited

Loading

huan commented Mar 21, 2021

luvletter2333 commented Mar 21, 2021

luvletter2333 commented Mar 21, 2021

luvletter2333 commented Mar 21, 2021

huan commented Mar 21, 2021

luvletter2333 commented Mar 26, 2021 •

edited

Loading

luvletter2333 commented Mar 26, 2021

huan commented Mar 26, 2021

artxia commented Apr 9, 2021

huan commented Apr 9, 2021 •

edited

Loading

artxia commented Apr 9, 2021

huan commented Apr 9, 2021

artxia commented Apr 9, 2021

leochen-g commented Apr 9, 2021

huan commented Apr 11, 2021

leochen-g commented Apr 13, 2021

luvletter2333 commented Apr 13, 2021

huan commented Apr 13, 2021

huan commented Apr 13, 2021

leochen-g commented Apr 13, 2021

huan commented Apr 13, 2021

suntong commented May 8, 2021

huan commented May 8, 2021 •

edited

Loading

leochen-g commented May 8, 2021

suntong commented May 8, 2021 •

edited

Loading

zpaimon commented May 9, 2021

ghost commented Dec 12, 2022

austincityuwen commented Mar 24, 2023

Can we support UOS with puppeteer? #127

Can we support UOS with puppeteer? #127

Comments

huan commented Mar 21, 2021 • edited Loading

UOS

huan commented Mar 21, 2021

luvletter2333 commented Mar 21, 2021

luvletter2333 commented Mar 21, 2021

luvletter2333 commented Mar 21, 2021

huan commented Mar 21, 2021

luvletter2333 commented Mar 26, 2021 • edited Loading

luvletter2333 commented Mar 26, 2021

huan commented Mar 26, 2021

artxia commented Apr 9, 2021

huan commented Apr 9, 2021 • edited Loading

artxia commented Apr 9, 2021

huan commented Apr 9, 2021

artxia commented Apr 9, 2021

leochen-g commented Apr 9, 2021

huan commented Apr 11, 2021

leochen-g commented Apr 13, 2021

luvletter2333 commented Apr 13, 2021

huan commented Apr 13, 2021

huan commented Apr 13, 2021

leochen-g commented Apr 13, 2021

huan commented Apr 13, 2021

suntong commented May 8, 2021

huan commented May 8, 2021 • edited Loading

leochen-g commented May 8, 2021

suntong commented May 8, 2021 • edited Loading

zpaimon commented May 9, 2021

ghost commented Dec 12, 2022

austincityuwen commented Mar 24, 2023

huan commented Mar 21, 2021 •

edited

Loading

luvletter2333 commented Mar 26, 2021 •

edited

Loading

huan commented Apr 9, 2021 •

edited

Loading

huan commented May 8, 2021 •

edited

Loading

suntong commented May 8, 2021 •

edited

Loading