Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metalogger restart bug: metadata files miss #56

Closed
OraCheung opened this issue May 15, 2017 · 3 comments
Closed

Metalogger restart bug: metadata files miss #56

OraCheung opened this issue May 15, 2017 · 3 comments
Assignees
Labels
invalid Issue usually related to OS or MooseFS misconfiguration or using not recommended settings question Question

Comments

@OraCheung
Copy link

OraCheung commented May 15, 2017

Hi:
I used HostA for mfsmaster, HostB for mfsmetalogger. Sometimes when I stop the mfsmetalogger, clean the /var/lib/mfs(remove change log files and metadata files), restart the metalogger, I found that metadata files miss:
ls -lh
total 4.0K
-rw-r----- 1 mfs mfs 2.4K 5May 15 17:25 changelog_ml.0.mfs

But sometimes it work well:
ls -lh
total 36M
-rw-r----- 1 mfs mfs 1.7K 5May 15 17:49 changelog_ml.0.mfs
-rw-r----- 1 mfs mfs 1.4K 5May 15 17:47 changelog_ml_back.0.mfs
-rw-r----- 1 mfs mfs 16K 5May 15 17:47 changelog_ml_back.1.mfs
-rw-r----- 1 mfs mfs 36M 5May 15 17:47 metadata_ml.mfs.back

How can I fix this bug?
As follows:
mfsmetalogger version: 3.0.92-1
mfsmetalogger.cfg: default config

Thanks for your help !

@xandrus
Copy link
Member

xandrus commented May 15, 2017

Hi.

First of all.
All metalogger metdetadata files are rotating and number of change log files can be set in metalogger configuration file.

# number of metadata change log files (default is 50)
# BACK_LOGS = 50

Secondly.
Metalloger by default downloads metadata file from MooseFS master once every 24 hours.

Check /etc/mfs/metalogger.cfg file:
# metadata download frequency in hours (default is 24, should be at least BACK_LOGS/2)
# META_DOWNLOAD_FREQ = 24

You can also change number of previous metadata files.
# number of previous metadata files to be kept (default is 3)
# BACK_META_KEEP_PREVIOUS = 3

@xandrus xandrus added the invalid Issue usually related to OS or MooseFS misconfiguration or using not recommended settings label May 15, 2017
@pkonopelko pkonopelko added the question Question label May 15, 2017
@OraCheung
Copy link
Author

META_DOWNLOAD_FREQ "at least" or "at most" ?
When I: man mfsmetalogger.cfg
META_DOWNLOAD_FREQ
metadata download frequency in hours (default is 24, at most BACK_LOGS/2)
When I: vim mfsmetalogger
# metadata download frequency in hours (default is 24, should be at least BACK_LOGS/2)
# META_DOWNLOAD_FREQ = 24

@OraCheung
Copy link
Author

And the first question is:
When I restart metalogger, most will download all the files, but rarely will not download. When meet the situation not downloading the metadata files, it will never be able to download, unless restart the mfsmaster. I think that the 'META_DOWNLOAD_FREQ' will not affect at the time restart the metalogger.

@borkd borkd closed this as completed Dec 20, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invalid Issue usually related to OS or MooseFS misconfiguration or using not recommended settings question Question
Projects
None yet
Development

No branches or pull requests

4 participants