Skip to content

Conversation

tei-k
Copy link
Contributor

@tei-k tei-k commented Oct 5, 2020

Description

https://scalar-labs.atlassian.net/browse/DLT-7288

2020-10-05T07:29:25+00:00       cassandra.system        {"level":"ERROR","thread":"main","message":"CassandraDaemon.java:785 - Exception encountered during startup","hostname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"java.lang.RuntimeException: Unable to gossip with any peers","hos
tname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"\tat org.apache.cassandra.gms.Gossiper.doShadowRound(Gossiper.jav
a:1544) ~[apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"\tat org.apache.cassandra.service.StorageService.checkForEndpoint
Collision(StorageService.java:592) ~[apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"\tat org.apache.cassandra.service.StorageService.prepareToJoin(St
orageService.java:850) ~[apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"\tat org.apache.cassandra.service.StorageService.initServer(Stora
geService.java:709) ~[apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"\tat org.apache.cassandra.service.StorageService.initServer(Stora
geService.java:658) ~[apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"\tat org.apache.cassandra.service.CassandraDaemon.setup(Cassandra
Daemon.java:386) [apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"\tat org.apache.cassandra.service.CassandraDaemon.activate(Cassan
draDaemon.java:628) [apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}
2020-10-05T07:29:25+00:00       cassandra.system        {"unmatched_line":"\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraD
aemon.java:768) [apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}

Done

Fix to use multiline type instead of regexp

Confirm

  • Cassandra system.log
ERROR [main] 2020-10-05 07:04:12,499 CassandraDaemon.java:785 - Exception encountered during startup
java.lang.RuntimeException: Unable to gossip with any peers
        at org.apache.cassandra.gms.Gossiper.doShadowRound(Gossiper.java:1544) ~[apache-cassandra-3.11.8.jar:3.11.8]
        at org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:592) ~[apache-cassandra-3.11.8.jar:3.11.8]
        at org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:850) ~[apache-cassandra-3.11.8.jar:3.11.8]
        at org.apache.cassandra.service.StorageService.initServer(StorageService.java:709) ~[apache-cassandra-3.11.8.jar:3.11.8]
        at org.apache.cassandra.service.StorageService.initServer(StorageService.java:658) ~[apache-cassandra-3.11.8.jar:3.11.8]
        at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:386) [apache-cassandra-3.11.8.jar:3.11.8]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:628) [apache-cassandra-3.11.8.jar:3.11.8]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:768) [apache-cassandra-3.11.8.jar:3.11.8]
  • Cassandra log forwarded to the monitor server
2020-10-05T07:04:12+00:00       cassandra.system        {"level":"ERROR","thread":"main","message":"CassandraDaemon.java:785 - Exception encountered during startup\njava.lang.RuntimeException: Unable to gossip with any peers\n\tat org.apache.cassandra.gms.Gossiper.doShadowRound(Gossiper.java:1544) ~[apache-cassandra-3.11.8.jar:3.11.8]\n\tat org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:592) ~[apache-cassandra-3.11.8.jar:3.11.8]\n\tat org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:850) ~[apache-cassandra-3.11.8.jar:3.11.8]\n\tat org.apache.cassandra.service.StorageService.initServer(StorageService.java:709) ~[apache-cassandra-3.11.8.jar:3.11.8]\n\tat org.apache.cassandra.service.StorageService.initServer(StorageService.java:658) ~[apache-cassandra-3.11.8.jar:3.11.8]\n\tat org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:386) [apache-cassandra-3.11.8.jar:3.11.8]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:628) [apache-cassandra-3.11.8.jar:3.11.8]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:768) [apache-cassandra-3.11.8.jar:3.11.8]","hostname":"cassandra-1"}

Ref

https://docs.fluentd.org/parser/multiline

@tei-k tei-k requested review from ymorimo and feeblefakie October 5, 2020 07:09
@tei-k tei-k self-assigned this Oct 5, 2020
Copy link
Collaborator

@feeblefakie feeblefakie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!
Not sure about the correctness of the regex, but the result looks good to me.

@feeblefakie
Copy link
Collaborator

@ymorimo Merging it but PTAL!

@feeblefakie feeblefakie merged commit 3648fe2 into master Oct 9, 2020
@feeblefakie feeblefakie deleted the fix-td-agent-config-to-support-multiline-for-cassandra branch October 9, 2020 02:17
Copy link
Contributor

@ymorimo ymorimo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants