New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deleted input continue to fill the server log of errors #1005

Closed
andreaconsadori opened this Issue Feb 27, 2015 · 1 comment

Comments

Projects
None yet
2 participants
@andreaconsadori

andreaconsadori commented Feb 27, 2015

2015-02-27T16:56:27.538+01:00 ERROR [ExtractorFilter] Could not load extractors into cache. Returning empty list.
java.util.concurrent.ExecutionException: org.graylog2.database.NotFoundException: Input <54f08472e4b0e9a8aafe9256> not found!
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:137)
at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2348)
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2320)
at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2282)
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2197)
at com.google.common.cache.LocalCache.get(LocalCache.java:3937)
at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4739)
at org.graylog2.filters.ExtractorFilter.loadExtractors(ExtractorFilter.java:73)
at org.graylog2.filters.ExtractorFilter.filter(ExtractorFilter.java:59)
at org.graylog2.buffers.processors.ServerProcessBufferProcessor.handleMessage(ServerProcessBufferProcessor.java:97)
at org.graylog2.shared.buffers.processors.ProcessBufferProcessor.onEvent(ProcessBufferProcessor.java:71)
at org.graylog2.shared.buffers.processors.ProcessBufferProcessor.onEvent(ProcessBufferProcessor.java:33)
at com.lmax.disruptor.WorkProcessor.run(WorkProcessor.java:138)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.graylog2.database.NotFoundException: Input <54f08472e4b0e9a8aafe9256> not found!
at org.graylog2.inputs.InputServiceImpl.find(InputServiceImpl.java:115)
at org.graylog2.filters.ExtractorFilter$1.call(ExtractorFilter.java:78)
at org.graylog2.filters.ExtractorFilter$1.call(ExtractorFilter.java:73)
at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4742)
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3527)
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2319)
... 14 more
2015-02-27T16:56:27.539+01:00 ERROR [StaticFieldFilter] Could not load static fields into cache. Returning empty list.
java.util.concurrent.ExecutionException: org.graylog2.database.NotFoundException: Input <54f08472e4b0e9a8aafe9256> not found!
at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
at com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:137)
at com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2348)
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2320)
at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2282)
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2197)
at com.google.common.cache.LocalCache.get(LocalCache.java:3937)
at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4739)
at org.graylog2.filters.StaticFieldFilter.loadStaticFields(StaticFieldFilter.java:74)
at org.graylog2.filters.StaticFieldFilter.filter(StaticFieldFilter.java:61)
at org.graylog2.buffers.processors.ServerProcessBufferProcessor.handleMessage(ServerProcessBufferProcessor.java:97)
at org.graylog2.shared.buffers.processors.ProcessBufferProcessor.onEvent(ProcessBufferProcessor.java:71)
at org.graylog2.shared.buffers.processors.ProcessBufferProcessor.onEvent(ProcessBufferProcessor.java:33)
at com.lmax.disruptor.WorkProcessor.run(WorkProcessor.java:138)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.graylog2.database.NotFoundException: Input <54f08472e4b0e9a8aafe9256> not found!
at org.graylog2.inputs.InputServiceImpl.find(InputServiceImpl.java:115)
at org.graylog2.filters.StaticFieldFilter$1.call(StaticFieldFilter.java:78)
at org.graylog2.filters.StaticFieldFilter$1.call(StaticFieldFilter.java:74)
at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4742)
at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3527)
at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2319)
... 14 more

@bernd bernd added the bug label Feb 27, 2015

@bernd bernd added this to the 1.0.1 milestone Feb 27, 2015

@bernd bernd self-assigned this Mar 2, 2015

@bernd

This comment has been minimized.

Member

bernd commented Mar 2, 2015

Thank you for the report! This happens when you delete an input and still have messages in the journal that came in through the deleted input. Once such a message is read from the journal and is processed, some database lookups will done for the input id to load extractors and static fields.

We are going to change the exceptions to a WARN message to avoid spamming the logs too much. If you have lots of messages in the journal, you might still see a lot of WARN messages, but I think that is better than being completely silent. Otherwise you would have a hard time debugging missing extracted fields in messages.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment