Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

max open file limit is always hitted #70

Closed
richman1000000 opened this issue Apr 2, 2018 · 6 comments
Closed

max open file limit is always hitted #70

richman1000000 opened this issue Apr 2, 2018 · 6 comments

Comments

@richman1000000
Copy link

there is always this error "too many"
image

here the screenshot of running dedup process during backup.
image

@richman1000000
Copy link
Author

richman1000000 commented Apr 3, 2018

I have a system which exports small files in great amount! one folder have 62000 files and I export 16 of those folders currently. I export them to mounted NFS folder.
If NFS is shared from ext4 - no problem, but shared from sdfs - and I have this error.

max-open-files="1024" set vdedup1tb2-volume-cfg.xml

@opendedup
Copy link
Owner

opendedup commented Apr 3, 2018 via email

@richman1000000
Copy link
Author

HI!
I've tried safe-close="true" and safe-close="false"
problem still persists

since service NFS have a max open file 1024 and max-open-files="1024" in xml is set, I've decided to check path that is opened by process during this error

most of those opened files is DDB

image

@richman1000000
Copy link
Author

richman1000000 commented Jun 1, 2018

you can try it yourself by the way.
I think it is better if you reproduse this problem in your environment.
export schema from SAP HANA database on NFS+sdfs storage

@richman1000000
Copy link
Author

I've checked this one Datish Cloud Storage Gateway, - it has same problem

@richman1000000
Copy link
Author

I found resolution of my problem!!

The source of problem is interaction of SDFS + NFS3 server ontop +NFS4 client.
echo 0 > /proc/sys/fs/leases-enable is workaround.
It does not resolve original problem of NFS, but makes it working.
i think you can close this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants