Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG]特殊用户会出现抓取不到作品的情况，为抖音bug #206

Open
mj900912 opened this issue Sep 2, 2022 · 7 comments
Open

[BUG]特殊用户会出现抓取不到作品的情况，为抖音bug #206

mj900912 opened this issue Sep 2, 2022 · 7 comments
Assignees
@Johnserf-Seed
Labels
额外求助(help wanted) 非项目代码错误的求助(Extra attention is needed) 无效(invalid) 非代码故障导致错误或异常(Non-code faults causing errors or anomalies)

Comments

@mj900912
Copy link

mj900912 commented Sep 2, 2022

描述出现的错误
对bug的清晰而简洁的描述。
下载抖音视频时，不管是使用长链还是短链，均提示获取用户昵称失败。切换其他博主没有任何问题。

截图
如果适用，添加屏幕截图以帮助解释您的问题。
微信图片_20220903041859

桌面（请填写以下信息）：
-操作系统：[例如windows8.1 64bit]
-vpn代理[关闭]

附文
多次尝试不管是是用TikTokMulti.py或者TikTokTool.py下载博主视频，均提示获取用户昵称失败

长链地址：https://www.douyin.com/user/MS4wLjABAAAAiE_WvsYiMheaIhMdp6GUs2AYdWsqPyZUiReWz_MN560
短链地址：https://v.douyin.com/6J1Q5e5/
@mj900912 mj900912 added 故障(bug) 代码问题导致的错误(Bugs caused by code problems) 额外求助(help wanted) 非项目代码错误的求助(Extra attention is needed) 无效(invalid) 非代码故障导致错误或异常(Non-code faults causing errors or anomalies) labels Sep 2, 2022
@Johnserf-Seed
Copy link
Owner

https://www.iesdouyin.com/share/user/MS4wLjABAAAAiE_WvsYiMheaIhMdp6GUs2AYdWsqPyZUiReWz_MN560 用这个呢

@mj900912
Copy link
Author

mj900912 commented Sep 3, 2022

感谢作者解答，您提供的这个链接也不能正常下载。出现相同的提示。

@Johnserf-Seed
Copy link
Owner

感谢作者解答，您提供的这个链接也不能正常下载。出现相同的提示。

我现在在高铁上，晚一点我解决一下

@Johnserf-Seed
Copy link
Owner

测试了就这个用户的作品无法获取到，很奇怪

@mj900912
Copy link
Author

mj900912 commented Sep 3, 2022

是的，很奇怪，我研究一下午。也没研究出是什么问题。应该是抖音自己的一个小BUG吧。

@Johnserf-Seed Johnserf-Seed changed the title [BUG] [BUG]特殊用户会出现抓取不到作品的情况，为抖音bug Sep 5, 2022
@Johnserf-Seed
Copy link
Owner

是的，很奇怪，我研究一下午。也没研究出是什么问题。应该是抖音自己的一个小BUG吧。

确实是抖音服务器的问题
image

@MrEsquire
Copy link

https://v.douyin.com/6FfpUPd/
这个抖音号也有这样的问题 使用tiktoktool会出错，但是单条内容能下载到

Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
重构__init__.py 一堆"债"😇 #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 …
d96c2d9 
…#287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、全面升级aiohttp作为异步网络请求，asyncio为密集型IO
2、将导入的库做一个分类排序
3、新增昵称映射、登录、版本自定义模块
4、删除图集模块（现统一由Profile模块处理）
5、优化初始化控制台输出信息，由rich美化
6、偷懒欠了一屁股issues🥴
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
🥁重构Profile.py #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #…
ed619d4 
…294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、重构所有逻辑改使用异步，便于个人开发调用
2、create_user_folder函数用于创建作品保存目录并返回路径
3、re_match匹配用户的唯一标识
4、get_request_data返回接口的数据
5、get_all_sec_user_id返回用户的唯一标识
6、get_diff_type_url根据传入配置文件中的mode和用户sec_user_id,生成不同作品类型的接口链接
7、get_user_base_info获取用户im基本数据
8、get_user_profile_info获取用户完整信息
9、get_user_post_info获取用户的作品信息
10、get_Profile 相当于main
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
📱新增扫码登录，无需手动填写cookie #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 …
90969e6 
…#287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、根据配置文件的cookie来唤起登录二维码，同时获取登录后的cookie
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
🛒重构Download.py #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #…
3d9db1b 
…294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、使用异步来采集传入的数据列表（aweme_data）中的音乐、视频和图集
2、trim_filename用于分割超长文案作品导致错误
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
🍬重构Config.py #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294
ec387a3 
 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、改用ConfigObj来操作配置文件，可保存配置文件的注释
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
🍪重构Cookies.py #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #…
82eaf0b 
…294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、新增verifyFp、s_v_web_id参数生成（相同参数）
2、拆分response对象的Set-Cookie字符串并拼接
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
🍵重构版本更新 #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312
8dfc039 
 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、引入了 "update" 参数来决定是否每次进行版本更新
2、自定义URL常量，方便修改
3、使用 os.path.join() 代替手动拼接路径，以提高跨平台兼容性
4、提取了进度条显示功能，简化了 zip_Download 方法
5、优化了对用户输入的处理，改用循环重新询问，直到用户输入有效值为止
6、使用 shutil.move() 和 shutil.rmtree() 代替 os.rename() 和 os.removedirs()，以解决部分情况下无法移动或删除文件的问题
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
🌡重构Check.py #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294
314031f 
#312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、file_exists检测作品是否已经存在
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
💅重构Command.py #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #…
bb63da2 
…294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

1、修改命令行选项
2、添加全局headers
#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
🥇新版Tool启动入口 #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294
9da97a0 
#312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
Johnserf-Seed added a commit that referenced this issue Aug 4, 2023
@Johnserf-Seed
🎻1.4.0.0版本更新 #155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294
4a0b619 
 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485

#155 #191 #202 #203 #206 #220 #226 #227 #243 #267 #287 #294 #312 #320 #332 #335 #341 #343 #346 #355 #357 #360 #361 #362 #364 #365 #367 #370 #372 #374 #376 #377 #379 #380 #381 #382 #383 #393 #394 #397 #398 #399 #401 #402 #403 #404 #406 #407 #408 #410 #414 #416 #419 #420 #422 #423 #426 #431 #432 #433 #434 #435 #436 #437 #446 #448 #449 #450 #451 #452 #454 #455 #456 #567 #460 #466 #469 #470 #471 #472 #475 #476 #477 #480 #481 #483 #484 #485
@Johnserf-Seed Johnserf-Seed removed the 故障(bug) 代码问题导致的错误(Bugs caused by code problems) label Dec 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Johnserf-Seed Johnserf-Seed

Labels
额外求助(help wanted) 非项目代码错误的求助(Extra attention is needed) 无效(invalid) 非代码故障导致错误或异常(Non-code faults causing errors or anomalies)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@MrEsquire @Johnserf-Seed @mj900912