filer.copy error with weed filer setup with redis&cassandra #603
Comments
chrislusf
added a commit
that referenced
this issue
Nov 25, 2017
display the error message for debugging #603
|
I added debug message in this commit. 97f757c Please use it to see what the error is. |
|
I still find no useful info, this is result from weed filer with cassandra config:
And this is from weed filer with redis config:
|
|
Please check
https://github.com/chrislusf/seaweedfs/blob/97f757c669ff52d6149138ee5c21f1b6c17bd59a/weed/operation/filer/register.go#L28
You can use curl to send a http request with the path and fileId parameter
to http://10.110.200.37:8888/admin/register and see what happened on the
filer server.
Failed to register file /root/ceph-cluster/ceph-deploy-ceph.log on
10.110.200.37:8888: Failed to register path
/1011020037/etc/ceph-cluster/ceph-deploy-ceph.log on filer
10.110.200.37:8888 to file id 3,3fc280ec1b :
http://10.110.200.37:8888/admin/register: 500 Internal Server Error
…On Sun, Nov 26, 2017 at 9:55 PM, zhashuyu ***@***.***> wrote:
I still find no useful info, this is result from weed filer with
*cassandra* config:
- filer
# /usr/bin/weed -log_dir=/weed/filer/log filer -dir=/weed/filer/dir -master=10.110.200.175:9333 -ip=10.110.200.37 -port=8888 -defaultReplicaPlacement=020 -cassandra.server=127.0.0.1
I1127 13:41:57 27540 file_util.go:20] Folder /weed/filer/dir Permission: -rwxr-xr-x
I1127 13:41:57 27540 filer.go:129] Start Seaweed Filer 0.76 at port 8888
I1127 13:41:57 27540 filer_server.go:122] Filer server bootstraps with master 10.110.200.175:9333
I1127 13:42:41 27540 filer_server_handlers_write.go:77] failing to find path in filer store /admin/register No file id found for /admin/register
- file.copy
# weed filer.copy -master 10.110.200.175:9333 /root/ceph-cluster http://10.110.200.37:8888/1011020037/etc/
Failed to register file /root/ceph-cluster/ceph-deploy-ceph.log on 10.110.200.37:8888: Failed to register path /1011020037/etc/ceph-cluster/ceph-deploy-ceph.log on filer 10.110.200.37:8888 to file id 3,3fc280ec1b : http://10.110.200.37:8888/admin/register: 500 Internal Server Error
Example: weed filer.copy file_or_dir1 [file_or_dir2 file_or_dir3] http://localhost:8888/path/to/a/folder/
Default Usage:
-collection string
optional collection name
......
- curl
# curl http://10.110.200.175:9333/3,3fc280ec1b -L | head
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 74 100 74 0 0 89156 0 --:--:-- --:--:-- --:--:-- 74000
[2017-03-04 14:34:42,315][ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[2017-03-04 14:34:42,316][ceph_deploy.cli][INFO ] Invoked (1.5.37): /usr/bin/ceph-deploy new ceph-mon1.skyinno.com ceph-mon2.skyinno.com ceph-mon3.skyinno.com
[2017-03-04 14:34:42,316][ceph_deploy.cli][INFO ] ceph-deploy options:
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] username : None
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] func : <function new at 0x1422410>
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] verbose : False
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] overwrite_conf : False
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] quiet : False
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0x1493878>
[2017-03-04 14:34:42,318][ceph_deploy.cli][INFO ] cluster : ceph
......
And this is from weed filer with *redis* config:
- filer
# /usr/bin/weed -log_dir=/weed/filer/log filer -dir=/weed/filer/dir -master=10.110.200.175:9333 -ip=10.110.200.37 -port=8888 -defaultReplicaPlacement=020 -redis.server=127.0.0.1:6379
I1127 13:50:21 27623 file_util.go:20] Folder /weed/filer/dir Permission: -rwxr-xr-x
I1127 13:50:21 27623 filer.go:129] Start Seaweed Filer 0.76 at port 8888
I1127 13:50:21 27623 filer_server.go:122] Filer server bootstraps with master 10.110.200.175:9333
- file.copy
# weed filer.copy -master 10.110.200.175:9333 /root/ceph-cluster http://10.110.200.37:8888/1011020037/etc/
Failed to register file /root/ceph-cluster/ceph-deploy-ceph.log on 10.110.200.37:8888: Failed to register path /1011020037/etc/ceph-cluster/ceph-deploy-ceph.log on filer 10.110.200.37:8888 to file id 2,41365ee401 : http://10.110.200.37:8888/admin/register: 404 Not Found
Example: weed filer.copy file_or_dir1 [file_or_dir2 file_or_dir3] http://localhost:8888/path/to/a/folder/
Default Usage:
-collection string
......
- curl
# curl http://10.110.200.175:9333/2,41365ee401 -L | head
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 74 100 74 0 0 97368 0 --:--:-- --:--:-- --:--:-- 74000
[2017-03-04 14:34:42,315][ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[2017-03-04 14:34:42,316][ceph_deploy.cli][INFO ] Invoked (1.5.37): /usr/bin/ceph-deploy new ceph-mon1.skyinno.com ceph-mon2.skyinno.com ceph-mon3.skyinno.com
[2017-03-04 14:34:42,316][ceph_deploy.cli][INFO ] ceph-deploy options:
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] username : None
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] func : <function new at 0x1422410>
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] verbose : False
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] overwrite_conf : False
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] quiet : False
[2017-03-04 14:34:42,317][ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0x1493878>
[2017-03-04 14:34:42,318][ceph_deploy.cli][INFO ] cluster : ceph
......
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#603 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/ABeL76ey3qgji2QHxelVeoLrUKLgGil9ks5s6k66gaJpZM4QqWDz>
.
|
|
I try this one by one, it still report error
|
|
Please read this section: https://github.com/chrislusf/seaweedfs/blob/97f757c669ff52d6149138ee5c21f1b6c17bd59a/weed/operation/filer/register.go#L28 And use curl to send a http request with the path and fileId parameter |
|
i have this problom too.... |
|
@suze521 need to know how to reproduce this with step by step details. |
|
@chrislusf |
|
thanks for the reproduce details. please check whether the commit fixed your problem. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Question
I setup seaweedfs filer with cassandra, I can upload file to seaweedfs by command curl ,but when I use filer.copy to upload lots of files , I got errors, see bellow. I got the same result when using redis.
test with curl
test with filer.copy
BTW when I use the id (2,3e6e533926) from command filer.copy, seaweedfs cluster got file actually.
version
OS: centos7 latest
seaweedfs: 0.76
cassandra: 3.11.1
redis: 3.2.1
Setup
seaweedfs cluster
cassandra
follow this https://www.howtoforge.com/tutorial/how-to-install-apache-cassandra-on-centos-7/
filer
# weed -log_dir=/weed/filer/log filer -dir=/weed/filer/dir -master=10.110.200.175:9333 -ip=10.110.200.37 -port=8888 -defaultReplicaPlacement=020 -cassandra.server=127.0.0.1The text was updated successfully, but these errors were encountered: