NULL Reference exception - FATAL GLOBAL-LOGGER when run projections set to All

[PaulGrimshaw]

We have recently deployed the eventstore to a ubuntu virtual server, and get this error shortly after starting, but only with the option RunProjections: All set.

It worked just long enough to log into the web interface and see that the projections tab etc was active, but then failed. The error in the log is:

[PID:04188:028 2016.11.04 16:13:21.979 FATAL GLOBAL-LOGGER       ] Global Unhandled Exception occurred.
System.NullReferenceException: Object reference not set to an instance of an object
  at EventStore.Core.Services.TimerService.ThreadBasedScheduler.DoTiming () [0x00000] in <filename unknown>:0
  at System.Threading.Thread.StartInternal () [0x00000] in <filename unknown>:0

I read through this thread #678, have set the environment variable and checked my kernel version but still fails.

When the projections are set to "None", it runs fine with no errors, and all the projection streams have been created.

[gregoryyoung]

Normally this is due to a kernel regression (you will also get issues eventually running without projections as well). What version of kernel are you running?

Which linux kernel are you running? There was a kernel regression

https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1450584 in Linux
ip-172-31-40-115 3.13.0-48-generic #80-Ubuntu SMP newer version did
not have the issue

[PaulGrimshaw]

4.2.0-34-generic.

I saw reference to that in the other thread, but seems we are a few versions ahead. Could it still be the same issue?

[gregoryyoung]

Yes the issue has come and gone multiple times but is likely the same issue.

On Fri, Nov 4, 2016 at 4:28 PM, Paul Grimshaw notifications@github.com
wrote:

4.2.0-34-generic.

I saw reference to that in the other thread, but seems we are a few
versions ahead. Could it still be the same issue?

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#1085 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAXRWmTc7vOnBPk8mM_YEzV2Z7Oi0_RCks5q610pgaJpZM4KpuF6
.

Studying for the Turing test

[PaulGrimshaw]

So a rollback to pre 3.13.0-48 is recommended?

[gregoryyoung]

I'd have to test varying versions. My laptop/desktop runs fine on 16.04
which I believe is on 4.4

On Fri, Nov 4, 2016 at 4:30 PM, Paul Grimshaw notifications@github.com
wrote:

So a rollback to pre 3.13.0-48 is recommended?

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#1085 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAXRWik4LO73aEj16ypgHLSAxXc7dHTVks5q612TgaJpZM4KpuF6
.

Studying for the Turing test

[PaulGrimshaw]

We're still on 14.04.4 LTS

[PaulGrimshaw]

Followed instructions in last post by siamak-haschemi on other thread, rolling back to 3.19.0-64 has let us continue for now. Thanks for the help, will keep an eye out for a fix.

Just noticed siamak-haschemi's post is from 2 days ago, so perhaps a recent update has triggered this.

[pgermishuys]

Closing this issue for now.

[litch]

I believe I'm getting the same issue - on 4.4.0-45

[PID:10529:030 2016.12.05 17:50:32.202 ERROR QueuedHandlerAutoRes] Error while processing message EventStore.Projections.Core.Messages.ReaderSubscriptionMessage+CommittedEventDistributed in queued handler 'Projection Core #2'.
System.NullReferenceException: Object reference not set to an instance of an object
  at EventStore.Projections.Core.Services.Processing.ReaderSubscriptionBase.PublishProgress (Single roundedProgress) [0x00000] in <filename unknown>:0
  at EventStore.Projections.Core.Services.Processing.ReaderSubscriptionBase.ProcessOne (EventStore.Projections.Core.Messages.CommittedEventDistributed message) [0x00000] in <filename unknown>:0
  at EventStore.Projections.Core.Services.Processing.ReaderSubscription.Handle (EventStore.Projections.Core.Messages.CommittedEventDistributed message) [0x00000] in <filename unknown>:0
  at EventStore.Projections.Core.Services.Processing.EventReaderCoreService.Handle (EventStore.Projections.Core.Messages.CommittedEventDistributed message) [0x00000] in <filename unknown>:0
  at EventStore.Core.Bus.MessageHandler`1[EventStore.Projections.Core.Messages.ReaderSubscriptionMessage+CommittedEventDistributed].TryHandle (EventStore.Core.Messaging.Message message) [0x00000] in <filename unknown>:0
  at EventStore.Core.Bus.InMemoryBus.Publish (EventStore.Core.Messaging.Message message) [0x00000] in <filename unknown>:0
  at EventStore.Core.Bus.InMemoryBus.Handle (EventStore.Core.Messaging.Message message) [0x00000] in <filename unknown>:0
  at EventStore.Core.Bus.QueuedHandlerAutoReset.ReadFromQueue (System.Object o) [0x00000] in <filename unknown>:0
^C

litch@eventstore-0:~$ uname -r
4.4.0-45-generic