Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

录制之后,上传失败, #8

Closed
w316525096 opened this issue Oct 14, 2019 · 20 comments
Closed

录制之后,上传失败, #8

w316525096 opened this issue Oct 14, 2019 · 20 comments

Comments

@w316525096
Copy link

求帮助-_-

OS:Linux raspberrypi 4.19.66-v7+ #1253 SMP Thu Aug 15 11:49:46 BST 2019 armv7l GNU/Linux

2019-10-14 16:45:38,225 upload.py[line:171](Pid:18773 Tname:Thread-2) info 更新cookie失败
2019-10-14 16:45:38,319 upload.py[line:144](Pid:18773 Tname:Thread-2) info 浏览器驱动退出
2019-10-14 16:46:05,147 handler.py[line:65](Pid:18773 Tname:Thread-4) error IOError
Traceback (most recent call last):
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/engine/handler.py", line 58, in all_check
if one('检测' + url, url).check_stream():
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/engine/plugins/general.py", line 17, in check_stream
info = site.parser(url)
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractor.py", line 21, in parser
info = self.prepare()
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractors/douyu/live.py", line 183, in prepare
error_msg = get_live_info()
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractors/douyu/live.py", line 150, in get_live_info
html_content = get_content('https://www.douyu.com/lapi/live/getH5Play/{}'.format(self.vid), data=data)
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/util/html.py", line 67, in get_content
response = urlopen(req)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden
2019-10-14 16:46:05,153 upload.py[line:261](Pid:18773 Tname:Thread-2) info 准备上传2019.10.14雪鲍
2019-10-14 16:46:43,723 upload.py[line:148](Pid:18773 Tname:Thread-2) info 准备更新cookie
2019-10-14 16:46:59,442 upload.py[line:171](Pid:18773 Tname:Thread-2) info 更新cookie失败
2019-10-14 16:46:59,541 upload.py[line:144](Pid:18773 Tname:Thread-2) info 浏览器驱动退出
2019-10-14 16:47:01,283 handler.py[line:65](Pid:18773 Tname:Thread-4) error IOError
Traceback (most recent call last):
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/engine/handler.py", line 58, in all_check
if one('检测' + url, url).check_stream():
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/engine/plugins/general.py", line 17, in check_stream
info = site.parser(url)
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractor.py", line 21, in parser
info = self.prepare()
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractors/douyu/live.py", line 183, in prepare
error_msg = get_live_info()
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractors/douyu/live.py", line 150, in get_live_info
html_content = get_content('https://www.douyu.com/lapi/live/getH5Play/{}'.format(self.vid), data=data)
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/util/html.py", line 67, in get_content
response = urlopen(req)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden
2019-10-14 16:47:01,289 upload.py[line:261](Pid:18773 Tname:Thread-2) info 准备上传2019.10.14雪鲍
2019-10-14 16:47:39,796 upload.py[line:148](Pid:18773 Tname:Thread-2) info 准备更新cookie
2019-10-14 16:47:55,181 upload.py[line:171](Pid:18773 Tname:Thread-2) info 更新cookie失败
2019-10-14 16:47:55,329 upload.py[line:144](Pid:18773 Tname:Thread-2) info 浏览器驱动退出
2019-10-14 16:48:30,178 upload.py[line:261](Pid:18773 Tname:Thread-2) info 准备上传2019.10.14雪鲍
2019-10-14 16:48:45,942 init.py[line:35](Pid:23307 Tname:Thread-4) info 开始下载Generic:雪鲍
2019-10-14 16:48:45,955 init.py[line:242](Pid:23307 Tname:Thread-5) info 获取到23307,雪鲍1571042910.flv.part
2019-10-14 16:49:10,345 upload.py[line:148](Pid:18773 Tname:Thread-2) info 准备更新cookie
2019-10-14 16:49:26,673 upload.py[line:171](Pid:18773 Tname:Thread-2) info 更新cookie失败
2019-10-14 16:49:26,772 upload.py[line:144](Pid:18773 Tname:Thread-2) info 浏览器驱动退出
2019-10-14 16:49:56,878 handler.py[line:65](Pid:18773 Tname:Thread-3) error IOError
Traceback (most recent call last):
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/engine/handler.py", line 58, in all_check
if one('检测' + url, url).check_stream():
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/engine/plugins/general.py", line 17, in check_stream
info = site.parser(url)
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractor.py", line 21, in parser
info = self.prepare()
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractors/douyu/live.py", line 183, in prepare
error_msg = get_live_info()
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/extractors/douyu/live.py", line 150, in get_live_info
html_content = get_content('https://www.douyu.com/lapi/live/getH5Play/{}'.format(self.vid), data=data)
File "/media/pi/62cbccdf-3771-4dfb-8fd6-aa226d70ff55/bilibiliupload/ykdl/util/html.py", line 67, in get_content
response = urlopen(req)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

@w316525096
Copy link
Author

在GCE上运行,不知道为什么,log也不输出日至.

                                                            (为心爱的主播录制上传视频-_-)

@ForgQi
Copy link
Member

ForgQi commented Oct 14, 2019

首次上传更新cookie失败,一般问题不大,多等一会就好了,因为用的是模拟登录没有用登录api,所以有几率登录失败,如果等了很长时间还是更新cookie失败请再反馈一下。

@w316525096
Copy link
Author

新的log:
ds_update.log

@hackcraker
Copy link

我也有类似错误,上传失败

2019-10-16 16:34:47,948 handler.py[line:65](Pid:81944 Tname:ThreadPoolExecutor-0_1) error IOError
Traceback (most recent call last):
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 1318, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1239, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1285, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1234, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1026, in _send_output
self.send(msg)
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 964, in send
self.connect()
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1400, in connect
server_hostname=server_hostname)
File "/Users/Mac/anaconda3/lib/python3.6/ssl.py", line 407, in wrap_socket
_context=self, _session=session)
File "/Users/Mac/anaconda3/lib/python3.6/ssl.py", line 814, in init
self.do_handshake()
File "/Users/Mac/anaconda3/lib/python3.6/ssl.py", line 1068, in do_handshake
self._sslobj.do_handshake()
File "/Users/Mac/anaconda3/lib/python3.6/ssl.py", line 689, in do_handshake
self._sslobj.do_handshake()
ssl.SSLEOFError: EOF occurred in violation of protocol (_ssl.c:841)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/Users/Mac/游乐场/bilibiliupload-master/engine/handler.py", line 58, in all_check
if one('检测' + url, url).check_stream():
File "/Users/Mac/游乐场/bilibiliupload-master/engine/plugins/general.py", line 17, in check_stream
info = site.parser(url)
File "/Users/Mac/游乐场/bilibiliupload-master/ykdl/extractor.py", line 21, in parser
info = self.prepare()
File "/Users/Mac/游乐场/bilibiliupload-master/ykdl/extractors/douyu/live.py", line 183, in prepare
error_msg = get_live_info()
File "/Users/Mac/游乐场/bilibiliupload-master/ykdl/extractors/douyu/live.py", line 150, in get_live_info
html_content = get_content('https://www.douyu.com/lapi/live/getH5Play/{}'.format(self.vid), data=data)
File "/Users/Mac/游乐场/bilibiliupload-master/ykdl/util/html.py", line 67, in get_content
response = urlopen(req)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 223, in urlopen
return opener.open(url, data, timeout)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 526, in open
response = self._open(req, data)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 544, in _open
'_open', req)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 1361, in https_open
context=self._context, check_hostname=self._check_hostname)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 1320, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error EOF occurred in violation of protocol (_ssl.c:841)>

@ForgQi
Copy link
Member

ForgQi commented Oct 16, 2019

如果是上传出错的话。上传需要你去b站建一个投稿模板然后保存,记得选转载,分区什么的按照你录的直播来选就行了

@w316525096
Copy link
Author

w316525096 commented Oct 17, 2019

如果是上传出错的话。上传需要你去b站建一个投稿模板然后保存,记得选转载,分区什么的按照你录的直播来选就行了

已经在B站建立投稿模板。
新的log:
上传失败,
ds_update.log

@ForgQi
Copy link
Member

ForgQi commented Oct 17, 2019

def start(self, url, date=None):
    title = self.title
    if date:
        title = str(date) + self.title
    if self.filter_file():
        logger.info('准备上传' + title)
        try:
            self.upload(title, self.file_list, link=url)
        except selenium.common.exceptions.WebDriverException:
            logger.exception('WebDriverException')
        # except :
        #     logger.exception('?')

把这最后两行的注释打开再运行一下(在upload.py这个文件里),因为你这个现在没有报错,看不出来哪出问题了

@w316525096
Copy link
Author

我也有类似错误,上传失败

2019-10-16 16:34:47,948 handler.py[line:65](Pid:81944 Tname:ThreadPoolExecutor-0_1) error IOError
Traceback (most recent call last):
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 1318, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1239, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1285, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1234, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1026, in _send_output
self.send(msg)
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 964, in send
self.connect()
File "/Users/Mac/anaconda3/lib/python3.6/http/client.py", line 1400, in connect
server_hostname=server_hostname)
File "/Users/Mac/anaconda3/lib/python3.6/ssl.py", line 407, in wrap_socket
_context=self, _session=session)
File "/Users/Mac/anaconda3/lib/python3.6/ssl.py", line 814, in init
self.do_handshake()
File "/Users/Mac/anaconda3/lib/python3.6/ssl.py", line 1068, in do_handshake
self._sslobj.do_handshake()
File "/Users/Mac/anaconda3/lib/python3.6/ssl.py", line 689, in do_handshake
self._sslobj.do_handshake()
ssl.SSLEOFError: EOF occurred in violation of protocol (_ssl.c:841)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/Mac/游乐场/bilibiliupload-master/engine/handler.py", line 58, in all_check
if one('检测' + url, url).check_stream():
File "/Users/Mac/游乐场/bilibiliupload-master/engine/plugins/general.py", line 17, in check_stream
info = site.parser(url)
File "/Users/Mac/游乐场/bilibiliupload-master/ykdl/extractor.py", line 21, in parser
info = self.prepare()
File "/Users/Mac/游乐场/bilibiliupload-master/ykdl/extractors/douyu/live.py", line 183, in prepare
error_msg = get_live_info()
File "/Users/Mac/游乐场/bilibiliupload-master/ykdl/extractors/douyu/live.py", line 150, in get_live_info
html_content = get_content('https://www.douyu.com/lapi/live/getH5Play/{}'.format(self.vid), data=data)
File "/Users/Mac/游乐场/bilibiliupload-master/ykdl/util/html.py", line 67, in get_content
response = urlopen(req)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 223, in urlopen
return opener.open(url, data, timeout)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 526, in open
response = self._open(req, data)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 544, in _open
'_open', req)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 1361, in https_open
context=self._context, check_hostname=self._check_hostname)
File "/Users/Mac/anaconda3/lib/python3.6/urllib/request.py", line 1320, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error EOF occurred in violation of protocol (_ssl.c:841)>

兄弟,你能成功上传了吗!?

@ForgQi
Copy link
Member

ForgQi commented Oct 18, 2019

不知道你加群没有,新加群的已经成功上传了

@w316525096
Copy link
Author

def start(self, url, date=None):
    title = self.title
    if date:
        title = str(date) + self.title
    if self.filter_file():
        logger.info('准备上传' + title)
        try:
            self.upload(title, self.file_list, link=url)
        except selenium.common.exceptions.WebDriverException:
            logger.exception('WebDriverException')
        # except :
        #     logger.exception('?')

把这最后两行的注释打开再运行一下(在upload.py这个文件里),因为你这个现在没有报错,看不出来哪出问题了

注释打开了,
ds_update.log

@hackcraker
Copy link

我可以成功上传,我有个问题是下满两个文件就上传吗,还有就是上传的同时还能下载吗?
我这里显示的同一个主播还在直播时,有两个文件下载完成了在上传的时候没有新的文件在下载,这样的话是不是有直播内容的丢失?

@w316525096
Copy link
Author

我可以成功上传,我有个问题是下满两个文件就上传吗,还有就是上传的同时还能下载吗?
我这里显示的同一个主播还在直播时,有两个文件下载完成了在上传的时候没有新的文件在下载,这样的话是不是有直播内容的丢失?

可以看“.part”文件的大小,判断进程有没有在下载- -。
感觉有时候,获取不到直播下载地址的时候,会有多个进程同时下载-,-

@ForgQi
Copy link
Member

ForgQi commented Oct 18, 2019

我可以成功上传,我有个问题是下满两个文件就上传吗,还有就是上传的同时还能下载吗?
我这里显示的同一个主播还在直播时,有两个文件下载完成了在上传的时候没有新的文件在下载,这样的话是不是有直播内容的丢失?

不是两个文件就上传,如果你不主动停止或者网络波动导致断流的话,直到主播下播才会上传,因为这个是给vps设计的,上传带宽比较充足,硬盘资源不足,所以出了问题是优先上传

@ForgQi
Copy link
Member

ForgQi commented Oct 18, 2019

你的cookie文件有问题,你可以打开检查一下,或者直接删了,让他重新登录

@ForgQi
Copy link
Member

ForgQi commented Oct 18, 2019

我可以成功上传,我有个问题是下满两个文件就上传吗,还有就是上传的同时还能下载吗?
我这里显示的同一个主播还在直播时,有两个文件下载完成了在上传的时候没有新的文件在下载,这样的话是不是有直播内容的丢失?

可以看“.part”文件的大小,判断进程有没有在下载- -。
感觉有时候,获取不到直播下载地址的时候,会有多个进程同时下载-,-

如果网络有问题,他会重试3次,不会同时下载的

@w316525096
Copy link
Author

你的cookie文件有问题,你可以打开检查一下,或者直接删了,让他重新登录

删除了cookie.
可以成功上传了.
感谢!!!

@w316525096
Copy link
Author

你的cookie文件有问题,你可以打开检查一下,或者直接删了,让他重新登录

删除了cookie.
可以成功上传了.
感谢!!!

看到上行在跑流量以为没事了,
还是有报错.
ds_update.log

@ForgQi
Copy link
Member

ForgQi commented Oct 19, 2019

你更新一下再试试,如果中途有错误日志先不要管,只要有上传了几个文件的日志就行了

@w316525096
Copy link
Author

你更新一下再试试,如果中途有错误日志先不要管,只要有上传了几个文件的日志就行了

好勒

@w316525096
Copy link
Author

你更新一下再试试,如果中途有错误日志先不要管,只要有上传了几个文件的日志就行了

成功上传拉!!!
ds_update.log

@ForgQi ForgQi pinned this issue Oct 19, 2019
@ForgQi ForgQi unpinned this issue Dec 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants