df: `/media/cloudfiles': Transport endpoint is not connected #15

Open
mandmZoom opened this Issue Apr 28, 2011 · 11 comments

Comments

Projects
None yet
5 participants
@mandmZoom

I keep getting this error periodically on my installation of cloud fuse and it occurs both on ubuntu 10.04 as well as 10.10. I am using rackspace cloud servers

when i type a df -h i see this error
df: `/media/cloudfiles': Transport endpoint is not connected

and in the /var/log/syslog i see this error
kernel: [249662.999667] cloudfuse[2459]: segfault at 1000000d7 ip 00007f8da9424095 sp 00007f8da460a000 error 4 in libxml2.so.2.7.7[7f8da93ec000+144000]

it has been really difficult for me to scale due to this issue occurring on my servers at randoom time intervals. My configuration is such that i mount all my media files to the cloud files and then all my servers can access the same files

The second issue is that if the media file is uploaded from one server it takes about 5 to 10 mins for the other server to see it

This is the command i use for mounting cloudfiles

sudo cloudfuse /media/cloudfiles -o allow_other,nonempty

Please let me know whats missing here?

@intel352

This comment has been minimized.

Show comment Hide comment
@intel352

intel352 Jul 27, 2011

the cloudfuse configuration has a cache setting, so that's likely causing the delay between servers seeing the files (or cloud files is caching it's output).

additionally, I received the Transport error multiple times when attempting to copy a >5gb file to the cloudfuse mount point. Turns out that cloud files only supports 5gb file segments, so if you want a larger filesize, you must segment the files for storage.

Howto: http://www.rackspace.com/knowledge_center/index.php/Does_Cloud_Files_support_large_file_transfer

the cloudfuse configuration has a cache setting, so that's likely causing the delay between servers seeing the files (or cloud files is caching it's output).

additionally, I received the Transport error multiple times when attempting to copy a >5gb file to the cloudfuse mount point. Turns out that cloud files only supports 5gb file segments, so if you want a larger filesize, you must segment the files for storage.

Howto: http://www.rackspace.com/knowledge_center/index.php/Does_Cloud_Files_support_large_file_transfer

@davidlevy

This comment has been minimized.

Show comment Hide comment
@davidlevy

davidlevy Jul 30, 2011

I am having the same problem ( Transport endpoint is not connected ) even with very low traffic (developement stage) and few files.
Is there a way to reconnect automatically ?

It seems it just disconnects after some inactivity. Does it ?

I am having the same problem ( Transport endpoint is not connected ) even with very low traffic (developement stage) and few files.
Is there a way to reconnect automatically ?

It seems it just disconnects after some inactivity. Does it ?

@mandmZoom

This comment has been minimized.

Show comment Hide comment
@mandmZoom

mandmZoom Jul 31, 2011

hi David,
no there does not seem to be any resolution on this, so i am using nfs mounts


From: davidlevy reply@reply.github.com
To: mandm_zoom@yahoo.com
Sent: Saturday, July 30, 2011 5:02 PM
Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

I am having the same problem ( Transport endpoint is not connected ) even with very low traffic (developement stage) and few files.
Is there a way to reconnect automatically ?

It seems it just disconnects after some inactivity. Does it ?

Reply to this email directly or view it on GitHub:
#15 (comment)

hi David,
no there does not seem to be any resolution on this, so i am using nfs mounts


From: davidlevy reply@reply.github.com
To: mandm_zoom@yahoo.com
Sent: Saturday, July 30, 2011 5:02 PM
Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

I am having the same problem ( Transport endpoint is not connected ) even with very low traffic (developement stage) and few files.
Is there a way to reconnect automatically ?

It seems it just disconnects after some inactivity. Does it ?

Reply to this email directly or view it on GitHub:
#15 (comment)

@davidlevy

This comment has been minimized.

Show comment Hide comment
@davidlevy

davidlevy Aug 3, 2011

@mandnzoom : you mean you could mount CloudFiles with NFS ?

as for me, I wrote a small sh script checking the mount point every x seconds and remounting it if necessary :S

@mandnzoom : you mean you could mount CloudFiles with NFS ?

as for me, I wrote a small sh script checking the mount point every x seconds and remounting it if necessary :S

@mandmZoom

This comment has been minimized.

Show comment Hide comment
@mandmZoom

mandmZoom Aug 3, 2011

no i could not mount cloudfiles using NFS, so instead use a bigger server with more hard drive space

yes i also used a script to mount it every so often, but after a while all my apache connections started hanging, so i needed to reboot the server which was becoming very risky


From: davidlevy reply@reply.github.com
To: mandm_zoom@yahoo.com
Sent: Wednesday, August 3, 2011 6:16 AM
Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

@mandnzoom : you mean you could mount CloudFiles with NFS ?

as for me, I wrote a small sh script checking the mount point every x seconds and remounting it if necessary :S

Reply to this email directly or view it on GitHub:
#15 (comment)

no i could not mount cloudfiles using NFS, so instead use a bigger server with more hard drive space

yes i also used a script to mount it every so often, but after a while all my apache connections started hanging, so i needed to reboot the server which was becoming very risky


From: davidlevy reply@reply.github.com
To: mandm_zoom@yahoo.com
Sent: Wednesday, August 3, 2011 6:16 AM
Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

@mandnzoom : you mean you could mount CloudFiles with NFS ?

as for me, I wrote a small sh script checking the mount point every x seconds and remounting it if necessary :S

Reply to this email directly or view it on GitHub:
#15 (comment)

@redbo

This comment has been minimized.

Show comment Hide comment
@redbo

redbo Aug 12, 2011

Owner

Sorry, I haven't been able to reproduce cloudfuse crashing or shutting down. Can you tell me what OS you're running on and what sort of operations you're doing on the mounted drive so I can try to reproduce?

Owner

redbo commented Aug 12, 2011

Sorry, I haven't been able to reproduce cloudfuse crashing or shutting down. Can you tell me what OS you're running on and what sort of operations you're doing on the mounted drive so I can try to reproduce?

@mandmZoom

This comment has been minimized.

Show comment Hide comment
@mandmZoom

mandmZoom Aug 12, 2011

hi Thanks for the reply,
I am running on ubuntu 10.04 and i am reading and writing media files to the mounted drive and i have more than 100k media files


From: redbo reply@reply.github.com
To: mandm_zoom@yahoo.com
Sent: Friday, August 12, 2011 6:10 AM
Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

Sorry, I haven't been able to reproduce cloudfuse crashing or shutting down. Can you tell me what OS you're running on and what sort of operations you're doing on the mounted drive so I can try to reproduce?

Reply to this email directly or view it on GitHub:
#15 (comment)

hi Thanks for the reply,
I am running on ubuntu 10.04 and i am reading and writing media files to the mounted drive and i have more than 100k media files


From: redbo reply@reply.github.com
To: mandm_zoom@yahoo.com
Sent: Friday, August 12, 2011 6:10 AM
Subject: Re: [cloudfuse] df: `/media/cloudfiles': Transport endpoint is not connected (#15)

Sorry, I haven't been able to reproduce cloudfuse crashing or shutting down. Can you tell me what OS you're running on and what sort of operations you're doing on the mounted drive so I can try to reproduce?

Reply to this email directly or view it on GitHub:
#15 (comment)

@davidlevy

This comment has been minimized.

Show comment Hide comment
@davidlevy

davidlevy Aug 14, 2011

@redbo : Same for me with Debian 5.

For now I have very few accesses per day (testing) and it's still disconnecting every once in a while (like once a day).
Is there a timeout when no accesses are done for a long period of time ?

@redbo : Same for me with Debian 5.

For now I have very few accesses per day (testing) and it's still disconnecting every once in a while (like once a day).
Is there a timeout when no accesses are done for a long period of time ?

@davidlevy

This comment has been minimized.

Show comment Hide comment
@davidlevy

davidlevy Sep 11, 2011

Still no fix/explanation ?
:O
thanks!

Still no fix/explanation ?
:O
thanks!

@bocomrx

This comment has been minimized.

Show comment Hide comment
@bocomrx

bocomrx Jul 19, 2012

same for me with centos 5.8
also did remounting scripts. a daily one and a health-check one.
the scripts will only work if the process (backup for example) is not stuck in the middle of operation.
(or else, I can't umount, obviously)

help???

bocomrx commented Jul 19, 2012

same for me with centos 5.8
also did remounting scripts. a daily one and a health-check one.
the scripts will only work if the process (backup for example) is not stuck in the middle of operation.
(or else, I can't umount, obviously)

help???

@bocomrx

This comment has been minimized.

Show comment Hide comment
@bocomrx

bocomrx Jul 19, 2012

someone here mentioned nfs?
how can i mount cloudfiles with nfs?

bocomrx commented Jul 19, 2012

someone here mentioned nfs?
how can i mount cloudfiles with nfs?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment