Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

checkpoint warnign #4

Open
doddys opened this issue May 15, 2018 · 2 comments
Open

checkpoint warnign #4

doddys opened this issue May 15, 2018 · 2 comments
Assignees
Labels
question Further information is requested
Milestone

Comments

@doddys
Copy link
Owner

doddys commented May 15, 2018

Dear Manoj,

how to fix this issue? is this normal?

Checkpoint Status Suppress...
The filesystem checkpoint is 3 hour(s), 4 minute(s) old. This is 308.31% of the configured checkpoint period of 1 hour(s). Warning threshold: 200.00%. 6,318 transactions have occurred since the last filesystem checkpoint. This is 0.63% of the configured checkpoint transaction target of 1,000,000.

@doddys doddys added the question Further information is requested label May 15, 2018
@doddys doddys added this to the Labs milestone May 15, 2018
@doddys
Copy link
Owner Author

doddys commented May 15, 2018

I found this error in the log file of SNN

2018-05-15 04:46:32,705 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint
java.io.IOException: Inconsistent checkpoint fields.
LV = -60 namespaceID = 185358040 cTime = 0 ; clusterId = cluster20 ; blockpoolId = BP-1234263361-172.30.1.187-1526298662632.
Expecting respectively: -60; 1426520126; 0; cluster14; BP-1463659061-172.30.1.187-1526286687045.
	at org.apache.hadoop.hdfs.server.namenode.CheckpointSignature.validateStorageInfo(CheckpointSignature.java:134)
	at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:540)
	at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:360)
	at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$1.run(SecondaryNameNode.java:325)
	at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:444)
	at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:321)
	at java.lang.Thread.run(Thread.java:745)


I fixed it by deleting /dfs/snn.

Is that a correct solution?

@doddys
Copy link
Owner Author

doddys commented May 17, 2018

For HA solution need to execute the following:

hdfs dfsadmin -safemode enter  
hdfs dfsadmin -saveNamespace  
hdfs dfsadmin -safemode leave 

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants