Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DB Locked Issues #1720

Closed
tidusjar opened this issue Nov 17, 2017 · 14 comments
Closed

DB Locked Issues #1720

tidusjar opened this issue Nov 17, 2017 · 14 comments
Labels
in progress

Comments

@tidusjar
Copy link
Member

Looks like the DB is locked when running some jobs.

This issue is about that
tidusjar pushed a commit that referenced this issue Nov 17, 2017
Potential fix for the DB locking issue #1720
6d5a823
This was referenced Nov 17, 2017
Closed
Closed
@jaycedk
Copy link

jaycedk commented Nov 18, 2017

Version 3.0.2363
Memory usage after latest update, and climbing.
This is a screen shot after restart 5 min ago.
billede
Screen shot after 10 min.
billede

looks like DB lock, causes memory usage, to the extreme.
Logs
2017-11-18 09:20:32.600 +01:00 [Information] Error occurred during execution of 'RecurringJobScheduler' process. Execution will be retried (attempt #2) in 00:00:01 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
at Dapper.SqlMapper.d__1241.MoveNext() at System.Collections.Generic.List1.AddEnumerable(IEnumerable1 enumerable) at System.Linq.Enumerable.ToList[TSource](IEnumerable1 source)
at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable1 commandTimeout, Nullable1 commandType)
at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass10_0.b__0(DbConnection connection)
at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func2 func, Boolean isWriteLock) at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection) at Hangfire.Server.RecurringJobScheduler.UseConnectionDistributedLock(JobStorage storage, Action1 action)
at Hangfire.Server.RecurringJobScheduler.Execute(BackgroundProcessContext context)
at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 09:20:35.511 +01:00 [Warning] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #3) in 00:00:06 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable1 commandTimeout, Nullable1 commandType)
at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.b__0(DbConnection connection)
at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func2 func, Boolean isWriteLock) at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection) at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func2 action)
at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 09:20:45.043 +01:00 [Information] Error occurred during execution of 'ServerHeartbeat' process. Execution will be retried (attempt #2) in 00:00:03 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action2 paramReader) at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command) at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable1 commandTimeout, Nullable1 commandType) at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass16_0.<Heartbeat>b__0(DbConnection connection) at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass19_0.<UseConnection>b__0(DbConnection connection) at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func2 func, Boolean isWriteLock)
at Hangfire.SQLite.SQLiteStorage.UseConnection(Action1 action, Boolean isWriteLock) at Hangfire.Server.ServerHeartbeat.Execute(BackgroundProcessContext context) at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context) 2017-11-18 09:21:13.081 +01:00 [Error] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #4) in 00:00:10 seconds. Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'. at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db) at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior) at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar() at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command) at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable1 commandTimeout, Nullable1 commandType) at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection) at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func2 func, Boolean isWriteLock)
at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.b__0(IStorageConnection connection)
at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func2 action) at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context) at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context) 2017-11-18 09:21:16.652 +01:00 [Warning] Error occurred during execution of 'Hangfire.SQLite.ExpirationManager' process. Execution will be retried (attempt #3) in 00:00:07 seconds. Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'. at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db) at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior) at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery() at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action2 paramReader)
at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable1 commandTimeout, Nullable1 commandType)
at Hangfire.SQLite.ExpirationManager.<>c__DisplayClass10_0.b__0(DbConnection connection)
at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass19_0.b__0(DbConnection connection)
at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func2 func, Boolean isWriteLock) at Hangfire.SQLite.SQLiteStorage.UseConnection(Action1 action, Boolean isWriteLock)
at Hangfire.SQLite.ExpirationManager.Execute(CancellationToken cancellationToken)
at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 09:21:32.223 +01:00 [Warning] Error occurred during execution of 'RecurringJobScheduler' process. Execution will be retried (attempt #3) in 00:00:06 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
at Dapper.SqlMapper.d__1241.MoveNext() at System.Collections.Generic.List1.AddEnumerable(IEnumerable1 enumerable) at System.Linq.Enumerable.ToList[TSource](IEnumerable1 source)
at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable1 commandTimeout, Nullable1 commandType)
at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass10_0.b__0(DbConnection connection)
at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func2 func, Boolean isWriteLock) at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection) at Hangfire.Server.RecurringJobScheduler.UseConnectionDistributedLock(JobStorage storage, Action1 action)
at Hangfire.Server.RecurringJobScheduler.Execute(BackgroundProcessContext context)
at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 09:21:46.700 +01:00 [Warning] Error occurred during execution of 'ServerHeartbeat' process. Execution will be retried (attempt #3) in 00:00:06 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action2 paramReader) at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command) at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable1 commandTimeout, Nullable1 commandType) at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass16_0.<Heartbeat>b__0(DbConnection connection) at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass19_0.<UseConnection>b__0(DbConnection connection) at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func2 func, Boolean isWriteLock)
at Hangfire.SQLite.SQLiteStorage.UseConnection(Action1 action, Boolean isWriteLock) at Hangfire.Server.ServerHeartbeat.Execute(BackgroundProcessContext context) at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context) 2017-11-18 09:21:54.345 +01:00 [Error] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #5) in 00:00:21 seconds. Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'. at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db) at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior) at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar() at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command) at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable1 commandTimeout, Nullable1 commandType) at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection) at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func2 func, Boolean isWriteLock)
at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.b__0(IStorageConnection connection)
at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)

@tidusjar
Copy link
Member Author

The memory was fine before this update?

@jaycedk
Copy link

jaycedk commented Nov 18, 2017

Yes it was fine before the update.
I have just, install an older version 3.0.2356.
And I'm not seeing the issue, it has now been running for 2 hours.

@tidusjar
Copy link
Member Author

With the new version the memory just keeps climbing and you are still seeing the dB lock issue?

@jaycedk
Copy link

jaycedk commented Nov 18, 2017 •
edited by Magikarplvl4
Loading

Just updatet again to 3.0.2363
Started it and started manual cache.
billede

2017-11-18 11:51:35.370 +01:00 [Information] Hangfire Server stopped.
2017-11-18 11:52:30.537 +01:00 [Information] Start installing Hangfire SQL objects...
2017-11-18 11:52:30.600 +01:00 [Information] Hangfire SQL objects installed.
2017-11-18 11:52:30.621 +01:00 [Information] Starting Hangfire Server
2017-11-18 11:52:30.623 +01:00 [Information] Using job storage: 'SQLite Server: Ombi.db'
2017-11-18 11:52:30.623 +01:00 [Information] Using the following options for Hangfire Server:
2017-11-18 11:52:30.623 +01:00 [Information]     Worker count: 1
2017-11-18 11:52:30.624 +01:00 [Information]     Listening queues: 'default'
2017-11-18 11:52:30.624 +01:00 [Information]     Shutdown timeout: 1.00:00:00
2017-11-18 11:52:30.624 +01:00 [Information]     Schedule polling interval: 00:00:15
2017-11-18 11:53:08.049 +01:00 [Error] StatusCode: 429, Reason: 
2017-11-18 11:53:08.062 +01:00 [Error] StatusCode: 429, Reason: 
2017-11-18 11:53:21.275 +01:00 [Error] StatusCode: NotFound, Reason: Not Found
2017-11-18 11:53:21.356 +01:00 [Error] StatusCode: NotFound, Reason: Not Found
2017-11-18 11:53:21.418 +01:00 [Error] StatusCode: NotFound, Reason: Not Found
2017-11-18 11:53:21.426 +01:00 [Error] StatusCode: NotFound, Reason: Not Found
2017-11-18 11:53:21.490 +01:00 [Error] StatusCode: NotFound, Reason: Not Found
2017-11-18 11:53:21.570 +01:00 [Error] StatusCode: NotFound, Reason: Not Found
2017-11-18 11:53:21.752 +01:00 [Error] StatusCode: NotFound, Reason: Not Found
2017-11-18 12:00:49.679 +01:00 [Information] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #2) in 00:00:03 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:01:02.462 +01:00 [Information] Error occurred during execution of 'ServerHeartbeat' process. Execution will be retried (attempt #2) in 00:00:01 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
   at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action`2 paramReader)
   at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass16_0.<Heartbeat>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass19_0.<UseConnection>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorage.UseConnection(Action`1 action, Boolean isWriteLock)
   at Hangfire.Server.ServerHeartbeat.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:01:24.327 +01:00 [Warning] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #3) in 00:00:04 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:01:32.131 +01:00 [Information] Error occurred during execution of 'RecurringJobScheduler' process. Execution will be retried (attempt #2) in 00:00:02 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
   at Dapper.SqlMapper.<QueryImpl>d__124`1.MoveNext()
   at System.Collections.Generic.List`1.AddEnumerable(IEnumerable`1 enumerable)
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass10_0.<GetAllItemsFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)
   at Hangfire.Server.RecurringJobScheduler.UseConnectionDistributedLock(JobStorage storage, Action`1 action)
   at Hangfire.Server.RecurringJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:01:59.589 +01:00 [Error] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #4) in 00:00:11 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:02:03.027 +01:00 [Warning] Error occurred during execution of 'ServerHeartbeat' process. Execution will be retried (attempt #3) in 00:00:07 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
   at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action`2 paramReader)
   at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass16_0.<Heartbeat>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass19_0.<UseConnection>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorage.UseConnection(Action`1 action, Boolean isWriteLock)
   at Hangfire.Server.ServerHeartbeat.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:02:33.419 +01:00 [Warning] Error occurred during execution of 'RecurringJobScheduler' process. Execution will be retried (attempt #3) in 00:00:08 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
   at Microsoft.Data.Sqlite.SqliteTransaction.Commit()
   at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass22_0`1.<UseTransaction>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorage.UseTransaction[T](Func`3 func, Nullable`1 isolationLevel)
   at Hangfire.SQLite.SQLiteStorage.UseTransaction(Action`2 action)
   at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)
   at Hangfire.Server.RecurringJobScheduler.UseConnectionDistributedLock(JobStorage storage, Action`1 action)
   at Hangfire.Server.RecurringJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:02:42.111 +01:00 [Error] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #5) in 00:00:20 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:03:03.466 +01:00 [Error] Error occurred during execution of 'ServerHeartbeat' process. Execution will be retried (attempt #4) in 00:00:15 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
   at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action`2 paramReader)
   at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass16_0.<Heartbeat>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass19_0.<UseConnection>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorage.UseConnection(Action`1 action, Boolean isWriteLock)
   at Hangfire.Server.ServerHeartbeat.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:03:31.701 +01:00 [Error] Error occurred during execution of 'RecurringJobScheduler' process. Execution will be retried (attempt #4) in 00:00:12 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
   at Dapper.SqlMapper.<QueryImpl>d__124`1.MoveNext()
   at System.Collections.Generic.List`1.AddEnumerable(IEnumerable`1 enumerable)
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass10_0.<GetAllItemsFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)
   at Hangfire.Server.RecurringJobScheduler.UseConnectionDistributedLock(JobStorage storage, Action`1 action)
   at Hangfire.Server.RecurringJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:03:33.373 +01:00 [Error] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #6) in 00:00:33 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:03:50.319 +01:00 [Error] Error occurred during execution of 'ServerHeartbeat' process. Execution will be retried (attempt #5) in 00:00:17 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
   at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action`2 paramReader)
   at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass16_0.<Heartbeat>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass19_0.<UseConnection>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorage.UseConnection(Action`1 action, Boolean isWriteLock)
   at Hangfire.Server.ServerHeartbeat.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:04:31.684 +01:00 [Error] Error occurred during execution of 'RecurringJobScheduler' process. Execution will be retried (attempt #5) in 00:00:18 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
   at Dapper.SqlMapper.<QueryImpl>d__124`1.MoveNext()
   at System.Collections.Generic.List`1.AddEnumerable(IEnumerable`1 enumerable)
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass10_0.<GetAllItemsFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)
   at Hangfire.Server.RecurringJobScheduler.UseConnectionDistributedLock(JobStorage storage, Action`1 action)
   at Hangfire.Server.RecurringJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:04:34.264 +01:00 [Information] Error occurred during execution of 'ServerWatchdog' process. Execution will be retried (attempt #2) in 00:00:02 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
   at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action`2 paramReader)
   at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass17_0.<RemoveTimedOutServers>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorageConnection.RemoveTimedOutServers(TimeSpan timeOut)
   at Hangfire.Server.ServerWatchdog.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:04:37.636 +01:00 [Error] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #7) in 00:00:42 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:05:04.313 +01:00 [Error] Error occurred during execution of 'ServerHeartbeat' process. Execution will be retried (attempt #6) in 00:00:31 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
   at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action`2 paramReader)
   at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass16_0.<Heartbeat>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.<>c__DisplayClass19_0.<UseConnection>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorage.UseConnection(Action`1 action, Boolean isWriteLock)
   at Hangfire.Server.ServerHeartbeat.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:05:36.435 +01:00 [Warning] Error occurred during execution of 'ServerWatchdog' process. Execution will be retried (attempt #3) in 00:00:08 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteNonQuery()
   at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action`2 paramReader)
   at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.Execute(IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass17_0.<RemoveTimedOutServers>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorageConnection.RemoveTimedOutServers(TimeSpan timeOut)
   at Hangfire.Server.ServerWatchdog.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:05:37.796 +01:00 [Error] Error occurred during execution of 'RecurringJobScheduler' process. Execution will be retried (attempt #6) in 00:00:29 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
   at Dapper.SqlMapper.<QueryImpl>d__124`1.MoveNext()
   at System.Collections.Generic.List`1.AddEnumerable(IEnumerable`1 enumerable)
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass13_0.<GetAllEntriesFromHash>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)
   at Hangfire.Server.RecurringJobScheduler.UseConnectionDistributedLock(JobStorage storage, Action`1 action)
   at Hangfire.Server.RecurringJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
2017-11-18 12:05:53.086 +01:00 [Error] Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #8) in 00:00:56 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)

@Magikarplvl4 Magikarplvl4 mentioned this issue Nov 18, 2017
Closed
tidusjar added a commit that referenced this issue Nov 20, 2017
@tidusjar
Moved the schedules jobs into it's own database, see if it helps with…
7ce1c0c 
… the db locking #1720
@tidusjar
Copy link
Member Author

Can people update and see if the latest build helps?

tidusjar added a commit that referenced this issue Nov 20, 2017
@tidusjar
Reduce the memory consumption #1720
ee13720
@KiqoCode
Copy link

I updated today, and well my log is now going crazy with all this:

2017-11-20 16:32:02 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:32:02 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:32:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:02 stdout --- End of inner exception stack trace ---
2017-11-20 16:32:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:02 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:32:02 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:32:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:32:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:32:02 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Couchpotato.CouchPotatoCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:32:02 stdout Recurring job 'CouchPotatoCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:32:02 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:32:02 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:32:02 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:32:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:02 stdout --- End of inner exception stack trace ---
2017-11-20 16:32:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:02 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:32:02 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:32:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:32:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:32:02 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Emby.EmbyContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:32:02 stdout Recurring job 'EmbyContentCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:32:02 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:32:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:32:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:32:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:32:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:32:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:32:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:32:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:32:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Plex.PlexServerContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:32:01 stdout Recurring job 'PlexServerContentCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:32:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:32:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:32:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:32:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:32:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:32:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:32:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:32:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:32:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Radarr.RadarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:32:01 stdout Recurring job 'RadarrCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:32:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:32:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:32:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:32:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:32:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:32:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:32:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:32:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:32:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:32:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Sonarr.SonarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:32:01 stdout Recurring job 'SonarrCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:32:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:31:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:31:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:31:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:31:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:31:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:31:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:31:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:31:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Couchpotato.CouchPotatoCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:31:01 stdout Recurring job 'CouchPotatoCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:31:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:31:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:31:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:31:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:31:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:31:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:31:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:31:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:31:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Emby.EmbyContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:31:01 stdout Recurring job 'EmbyContentCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:31:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:31:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:31:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:31:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:31:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:31:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:31:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:31:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:31:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Plex.PlexServerContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:31:01 stdout Recurring job 'PlexServerContentCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:31:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:31:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:31:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:31:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:31:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:31:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:31:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:31:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:31:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Radarr.RadarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:31:00 stdout Recurring job 'RadarrCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:31:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:31:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:31:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:31:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:31:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:31:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:31:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:31:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:31:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:31:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Sonarr.SonarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:31:00 stdout Recurring job 'SonarrCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:31:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:30:03 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:30:03 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:30:03 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:03 stdout --- End of inner exception stack trace ---
2017-11-20 16:30:03 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:03 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:30:03 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:30:03 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:30:03 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:30:03 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Couchpotato.CouchPotatoCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:30:03 stdout Recurring job 'CouchPotatoCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:30:03 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:30:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:30:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:30:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:30:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:30:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:30:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:30:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:30:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Emby.EmbyContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:30:01 stdout Recurring job 'EmbyContentCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:30:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:30:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:30:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:30:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:30:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:30:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:30:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:30:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:30:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Plex.PlexServerContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:30:01 stdout Recurring job 'PlexServerContentCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:30:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:30:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:30:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:30:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:30:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:30:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:30:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:30:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:30:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Radarr.RadarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:30:00 stdout Recurring job 'RadarrCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:30:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:30:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:30:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:30:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:30:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:30:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:30:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:30:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:30:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:30:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Sonarr.SonarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:30:00 stdout Recurring job 'SonarrCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:30:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:29:02 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:29:02 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:29:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:02 stdout --- End of inner exception stack trace ---
2017-11-20 16:29:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:02 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:29:02 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:29:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:29:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:29:02 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Couchpotato.CouchPotatoCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:29:02 stdout Recurring job 'CouchPotatoCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:29:02 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:29:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:29:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:29:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:29:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:29:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:29:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:29:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:29:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Emby.EmbyContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:29:01 stdout Recurring job 'EmbyContentCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:29:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:29:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:29:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:29:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:29:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:29:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:29:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:29:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:29:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Plex.PlexServerContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:29:00 stdout Recurring job 'PlexServerContentCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:29:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:29:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:29:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:29:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:29:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:29:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:29:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:29:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:29:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Radarr.RadarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:29:00 stdout Recurring job 'RadarrCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:29:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:29:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:29:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:29:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:29:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:29:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:29:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:29:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:29:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:29:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Sonarr.SonarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:29:00 stdout Recurring job 'SonarrCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:29:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:28:02 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:28:02 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:28:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:02 stdout --- End of inner exception stack trace ---
2017-11-20 16:28:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:02 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:28:02 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:28:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:28:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:28:02 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Couchpotato.CouchPotatoCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:28:02 stdout Recurring job 'CouchPotatoCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:28:02 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:28:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:28:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:28:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:28:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:28:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:28:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:28:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:28:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Emby.EmbyContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:28:01 stdout Recurring job 'EmbyContentCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:28:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:28:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:28:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:28:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:28:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:28:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:28:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:28:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:28:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Plex.PlexServerContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:28:00 stdout Recurring job 'PlexServerContentCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:28:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:28:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:28:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:28:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:28:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:28:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:28:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:28:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:28:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Radarr.RadarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:28:00 stdout Recurring job 'RadarrCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:28:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:28:00 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:28:00 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:28:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:00 stdout --- End of inner exception stack trace ---
2017-11-20 16:28:00 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:28:00 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:28:00 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:28:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:28:00 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:28:00 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Sonarr.SonarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:28:00 stdout Recurring job 'SonarrCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:28:00 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:27:03 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:27:03 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:27:03 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:03 stdout --- End of inner exception stack trace ---
2017-11-20 16:27:03 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:03 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:27:03 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:27:03 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:27:03 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:27:03 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Couchpotato.CouchPotatoCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:27:03 stdout Recurring job 'CouchPotatoCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:27:03 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:27:02 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:27:02 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:27:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:02 stdout --- End of inner exception stack trace ---
2017-11-20 16:27:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:02 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:27:02 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:27:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:27:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:27:02 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Emby.EmbyContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:27:02 stdout Recurring job 'EmbyContentCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:27:02 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:27:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:27:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:27:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:27:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:27:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:27:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:27:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:27:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Plex.PlexServerContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:27:01 stdout Recurring job 'PlexServerContentCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:27:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:27:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:27:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:27:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:27:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:27:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:27:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:27:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:27:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Radarr.RadarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:27:01 stdout Recurring job 'RadarrCacher.CacheContent' can not be scheduled due to job load exception.
2017-11-20 16:27:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:27:01 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:27:01 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:27:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:01 stdout --- End of inner exception stack trace ---
2017-11-20 16:27:01 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:27:01 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:27:01 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:27:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:27:01 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:27:01 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Sonarr.SonarrCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:27:01 stdout Recurring job 'SonarrCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:27:01 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]
2017-11-20 16:26:02 stdout at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.b__0(IStorageConnection connection)
2017-11-20 16:26:02 stdout at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
2017-11-20 16:26:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:26:02 stdout --- End of inner exception stack trace ---
2017-11-20 16:26:02 stdout at Hangfire.Storage.InvocationData.Deserialize()
2017-11-20 16:26:02 stdout at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
2017-11-20 16:26:02 stdout at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
2017-11-20 16:26:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
2017-11-20 16:26:02 stdout at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
2017-11-20 16:26:02 stdout Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Couchpotato.CouchPotatoCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
2017-11-20 16:26:02 stdout Recurring job 'CouchPotatoCacher.Start' can not be scheduled due to job load exception.
2017-11-20 16:26:02 stdout �[40m�[1m�[33mwarn�[39m�[22m�[49m: Hangfire.Server.RecurringJobScheduler[0]

@jaycedk
Copy link

jaycedk commented Nov 22, 2017 •
edited
Loading

Hi there
The issue with memory usage has been fixed :)
Thank you

@didyouexpectthat didyouexpectthat mentioned this issue Nov 25, 2017
Closed
@tidusjar
Copy link
Member Author

Is anyone still seeing any db lock issues?

@daymanbpi
Copy link

daymanbpi commented Nov 27, 2017 •
edited
Loading

Not sure if related, but i get this on my latest docker image - lsiodev/ombi-preview
Just continually cycles and will not load.
ombi_v3 | info: Hangfire.SQLite.SQLiteStorage[0]
ombi_v3 | Start installing Hangfire SQL objects...
ombi_v3 | info: Hangfire.SQLite.SQLiteStorage[0]
ombi_v3 | Hangfire SQL objects installed.
ombi_v3 | info: Hangfire.BackgroundJobServer[0]
ombi_v3 | Starting Hangfire Server
ombi_v3 | info: Hangfire.BackgroundJobServer[0]
ombi_v3 | Using job storage: 'SQLite Server: /config/Schedules.db'
ombi_v3 | info: Hangfire.BackgroundJobServer[0]
ombi_v3 | Using the following options for Hangfire Server:
ombi_v3 | info: Hangfire.BackgroundJobServer[0]
ombi_v3 | Worker count: 1
ombi_v3 | info: Hangfire.BackgroundJobServer[0]
ombi_v3 | Listening queues: 'default'
ombi_v3 | info: Hangfire.BackgroundJobServer[0]
ombi_v3 | Shutdown timeout: 1.00:00:00
ombi_v3 | info: Hangfire.BackgroundJobServer[0]
ombi_v3 | Schedule polling interval: 00:00:15
ombi_v3 |
ombi_v3 | Unhandled Exception: System.InvalidOperationException: Unable to resolve service for type 'Ombi.Schedule.Jobs.SickRage.ISickRageSync' while attempting to activate 'Ombi.Schedule.JobSetup'.
ombi_v3 | at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteFactory.CreateArgumentCallSites(Type serviceType, Type implementationType, ISet1 callSiteChain, ParameterInfo[] parameters, Boolean throwIfCallSiteNotFound) ombi_v3 | at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteFactory.CreateConstructorCallSite(Type serviceType, Type implementationType, ISet1 callSiteChain)
ombi_v3 | at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteFactory.TryCreateExact(ServiceDescriptor descriptor, Type serviceType, ISet1 callSiteChain) ombi_v3 | at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteFactory.TryCreateExact(Type serviceType, ISet1 callSiteChain)
ombi_v3 | at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteFactory.CreateCallSite(Type serviceType, ISet1 callSiteChain) ombi_v3 | at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType, ServiceProvider serviceProvider) ombi_v3 | at System.Collections.Concurrent.ConcurrentDictionaryExtensions.GetOrAdd[TKey,TValue,TArg](ConcurrentDictionary2 dictionary, TKey key, Func`3 valueFactory, TArg arg)
ombi_v3 | at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType)
ombi_v3 | at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetService[T](IServiceProvider provider)
ombi_v3 | at Ombi.Startup.Configure(IApplicationBuilder app, IHostingEnvironment env, ILoggerFactory loggerFactory, IMemoryCache cache, IServiceProvider serviceProvider) in C:\projects\requestplex\src\Ombi\Startup.cs:line 181
ombi_v3 | --- End of stack trace from previous location where exception was thrown ---
ombi_v3 | at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
ombi_v3 | at Microsoft.AspNetCore.Hosting.ConventionBasedStartup.Configure(IApplicationBuilder app)
ombi_v3 | at Microsoft.AspNetCore.Hosting.Internal.WebHost.BuildApplication()
ombi_v3 | at Microsoft.AspNetCore.Hosting.WebHostBuilder.Build()
ombi_v3 | at Ombi.Program.Main(String[] args) in C:\projects\requestplex\src\Ombi\Program.cs:line 64
ombi_v3 | Hello, welcome to Ombi
ombi_v3 | Valid options are:
ombi_v3 | Ombi 3.0.2387-DotNetCore
ombi_v3 | Copyright (C) 2017 Ombi
ombi_v3 |
ombi_v3 | -h, --host (Default: http://:5000) Set to a semicolon-separated (;)
ombi_v3 | list of URL prefixes to which the server should respond. For
ombi_v3 | example, http://localhost:123. Use "" to indicate that the
ombi_v3 | server should listen for requests on any IP address or
ombi_v3 | hostname using the specified port and protocol (for example,
ombi_v3 | http://*:5000). The protocol (http:// or https://) must be
ombi_v3 | included with each URL. Supported formats vary between
ombi_v3 | servers.
ombi_v3 |
ombi_v3 | -s, --storage Storage path, where we save the logs and database
ombi_v3 |
ombi_v3 | --help Display this help screen.
ombi_v3 |
ombi_v3 | --version Display version information.

@tidusjar
Copy link
Member Author

@daymanbpi Just pushed out a fix for that, give it 20 minutes and then update and it should be fine

@SlothCroissant
Copy link

I'm seeing the same (or very similar) issues running Docker:

Version | 3.0.2459
Branch | DotNetCore
Github | https://github.com/tidusjar/Ombi
Discord | https://discord.gg/KxYZ64w
Forums | https://forums.ombi.io
OS Architecture | X64
OS Description | Linux 4.9.19-unRAID #1 SMP PREEMPT Thu Mar 30 08:32:28 PDT 2017
Process Architecture | X64
Application Base Path | /app/ombi/

Logs are filled with this:

2017-12-12 12:34:00.929 -06:00 [Warning] Recurring job 'PlexServerContentCacher.CacheContent' can not be scheduled due to job load exception.
Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Plex.PlexServerContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
   at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
   at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
   at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
   at Hangfire.Storage.InvocationData.Deserialize()
   --- End of inner exception stack trace ---
   at Hangfire.Storage.InvocationData.Deserialize()
   at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)
2017-12-12 12:34:01.129 -06:00 [Warning] Recurring job 'EmbyContentCacher.Start' can not be scheduled due to job load exception.
Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Emby.EmbyContentCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
   at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
   at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
   at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
   at Hangfire.Storage.InvocationData.Deserialize()
   --- End of inner exception stack trace ---
   at Hangfire.Storage.InvocationData.Deserialize()
   at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)
2017-12-12 12:34:01.177 -06:00 [Warning] Recurring job 'CouchPotatoCacher.Start' can not be scheduled due to job load exception.
Hangfire.Common.JobLoadException: Could not load the job. See inner exception for the details. ---> System.TypeLoadException: Could not load type 'Ombi.Schedule.Jobs.Couchpotato.CouchPotatoCacher' from assembly 'Ombi.Schedule, Version=3.0.0.0, Culture=neutral, PublicKeyToken=null'.
   at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMarkHandle stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName, ObjectHandleOnStack type, ObjectHandleOnStack keepalive)
   at System.RuntimeTypeHandle.GetTypeByName(String name, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean loadTypeFromPartialName)
   at System.RuntimeType.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase, Boolean reflectionOnly, StackCrawlMark& stackMark)
   at System.Type.GetType(String typeName, Boolean throwOnError, Boolean ignoreCase)
   at Hangfire.Storage.InvocationData.Deserialize()
   --- End of inner exception stack trace ---
   at Hangfire.Storage.InvocationData.Deserialize()
   at Hangfire.Server.RecurringJobScheduler.TryScheduleJob(JobStorage storage, IStorageConnection connection, String recurringJobId, IReadOnlyDictionary`2 recurringJob)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)

Restarting the container resolves the issue for some time. Let me know if you want full logs, and I can provide them.

@tidusjar
Copy link
Member Author

tidusjar commented Jan 2, 2018

This has been resolved.

@tidusjar tidusjar closed this as completed Jan 2, 2018
@azerial
Copy link

azerial commented Jan 12, 2018

Ombi build Version:

V 3.0.2613-PR

Update Branch:

Open Beta

Media Sever:

Plex

Media Server Version:

plexmediaserver (1.10.1.4602-f54242b6b)

Operating System:

Ubuntu 16.04 LTS

Problem Description:

Hey Im having this issue in the latest from the build farm:

Im running this outside of docker by unzipping the archive in /opt/Ombi. I had gotten the issue on the previous version and assumed it was something that the update fixed, so i nuked the /opt/Ombi folder. uncompressed the archive, and re-ran. The log below is the first run on a new installation.

Reproduction Steps:

  1. mkdir /opt/Ombi
  2. cd /opt/Ombi
  3. wget https://ci.appveyor.com/api/buildjobs/33b1fl9ie878e2cj/artifacts/linux.tar.gz
  4. tar xzf linux.tar.gz
  5. Run ombi ./Ombi
  6. Observe the errors in the console

Ombi Applicable Logs (from /logs/ directory or the Admin page):

:/opt/Ombi# ./Ombi
Hello, welcome to Ombi
Valid options are:
Ombi 3.0.2613-PR
Copyright (C) 2018 Ombi

  -h, --host   (Default: http://*:5000) Set to a semicolon-separated (;)
   list of URL prefixes to which the server should respond. For
   example, http://localhost:123. Use "*" to indicate that the
   server should listen for requests on any IP address or
   hostname using the specified port and protocol (for example,
   http://*:5000). The protocol (http:// or https://) must be
   included with each URL. Supported formats vary between
   servers.

  -s, --storageStorage path, where we save the logs and database

  --help   Display this help screen.

  --versionDisplay version information.



We are running on http://*:5000
/opt/Ombi
info: Hangfire.SQLite.SQLiteStorage[0]
  Hangfire SQL objects installed.
info: Hangfire.BackgroundJobServer[0]
  Schedule polling interval: 00:00:15
dbug: Hangfire.Server.BackgroundProcessingServer[0]
  Background process 'BackgroundProcessingServer' started.
dbug: Hangfire.Server.ServerHeartbeat[0]
  Background process 'ServerHeartbeat' started.
dbug: Hangfire.Server.ServerWatchdog[0]
  Background process 'ServerWatchdog' started.
dbug: Hangfire.SQLite.ExpirationManager[0]
  Background process 'Hangfire.SQLite.ExpirationManager' started.
dbug: Hangfire.Server.RecurringJobScheduler[0]
  Background process 'RecurringJobScheduler' started.
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Background process 'DelayedJobScheduler' started.
dbug: Hangfire.Server.Worker[0]
  Background process 'Worker #36c865ac' started.
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'AggregatedCounter' table...
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'Job' table...
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'List' table...
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'Set' table...
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'Hash' table...
Hosting environment: Production
Content root path: /opt/Ombi
Now listening on: http://[::]:5000
Application started. Press Ctrl+C to shut down.
dbug: Ombi.Controllers.External.PlexController[0]
  OK, signing into Plex
dbug: Ombi.Controllers.External.PlexController[0]
  This is our first time, good to go!
dbug: Ombi.Controllers.External.PlexController[0]
  Attempting to sign in to Plex.Tv
dbug: Ombi.Controllers.External.PlexController[0]
  Sign in successful
dbug: Ombi.Controllers.External.PlexController[0]
  Getting servers
dbug: Ombi.Controllers.External.PlexController[0]
  Adding first server
dbug: Ombi.Controllers.External.PlexController[0]
  Finished
info: Ombi.Controllers.IdentityController[0]
  Created the roles
info: Ombi.Controllers.IdentityController[0]
  Added the Admin role
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #1) in 00:00:00 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
dbug: Hangfire.Server.RecurringJobScheduler[0]
  Error occurred during execution of 'RecurringJobScheduler' process. Execution will be retried (attempt #1) in 00:00:00 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
   at Dapper.SqlMapper.<QueryImpl>d__124`1.MoveNext()
   at System.Collections.Generic.List`1.AddEnumerable(IEnumerable`1 enumerable)
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass10_0.<GetAllItemsFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.RecurringJobScheduler.<>c__DisplayClass8_0.<Execute>b__0(IStorageConnection connection)
   at Hangfire.Server.RecurringJobScheduler.UseConnectionDistributedLock(JobStorage storage, Action`1 action)
   at Hangfire.Server.RecurringJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
info: Ombi.Schedule.Jobs.Plex.PlexUserImporter[0]
  Creating Plex user afheverly@gmail.com
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #1) in 00:00:00 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
warn: Hangfire.AutomaticRetryAttribute[0]
  Failed to process the job '3': an exception occurred. Retry attempt 1 of 3 will be performed in 00:00:42.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass23_0.<GetHashTtl>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorageConnection.GetHashTtl(String key)
   at Hangfire.Console.Server.ConsoleContext.FixExpiration()
   at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilter filter, PerformingContext preContext, Func`1 continuation)
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #1) in 00:00:01 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
dbug: Hangfire.Server.Worker[0]
  An exception occurred while processing a job. It will be re-queued.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
   at Dapper.SqlMapper.<QueryImpl>d__124`1.MoveNext()
   at System.Collections.Generic.List`1.AddEnumerable(IEnumerable`1 enumerable)
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass6_0.<GetJobData>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorageConnection.GetJobData(String id)
   at Hangfire.States.BackgroundJobStateChanger.GetJobData(StateChangeContext context)
   at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContext context)
   at Hangfire.Server.Worker.Execute(BackgroundProcessContext context)
dbug: Hangfire.Server.Worker[0]
  Error occurred during execution of 'Worker #36c865ac' process. Execution will be retried (attempt #1) in 00:00:00 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Dapper.SqlMapper.ExecuteReaderWithFlagsFallback(IDbCommand cmd, Boolean wasClosed, CommandBehavior behavior)
   at Dapper.SqlMapper.<QueryImpl>d__124`1.MoveNext()
   at System.Collections.Generic.List`1.AddEnumerable(IEnumerable`1 enumerable)
   at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   at Dapper.SqlMapper.Query[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Boolean buffered, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass6_0.<GetJobData>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.SQLite.SQLiteStorageConnection.GetJobData(String id)
   at Hangfire.States.BackgroundJobStateChanger.GetJobData(StateChangeContext context)
   at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContext context)
   at Hangfire.Server.Worker.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
info: Hangfire.Server.DelayedJobScheduler[0]
  Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #2) in 00:00:04 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #1) in 00:00:00 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #1) in 00:00:00 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #1) in 00:00:01 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Error occurred during execution of 'DelayedJobScheduler' process. Execution will be retried (attempt #1) in 00:00:00 seconds.
Microsoft.Data.Sqlite.SqliteException (0x80004005): SQLite Error 5: 'database is locked'.
   at Microsoft.Data.Sqlite.SqliteException.ThrowExceptionForRC(Int32 rc, sqlite3 db)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.Data.Sqlite.SqliteCommand.ExecuteScalar()
   at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnection cnn, CommandDefinition& command)
   at Dapper.SqlMapper.ExecuteScalar[T](IDbConnection cnn, String sql, Object param, IDbTransaction transaction, Nullable`1 commandTimeout, Nullable`1 commandType)
   at Hangfire.SQLite.SQLiteStorageConnection.<>c__DisplayClass11_0.<GetFirstByLowestScoreFromSet>b__0(DbConnection connection)
   at Hangfire.SQLite.SQLiteStorage.UseConnection[T](Func`2 func, Boolean isWriteLock)
   at Hangfire.Server.DelayedJobScheduler.<>c__DisplayClass10_0.<EnqueueNextScheduledJob>b__0(IStorageConnection connection)
   at Hangfire.Server.DelayedJobScheduler.UseConnectionDistributedLock[T](JobStorage storage, Func`2 action)
   at Hangfire.Server.DelayedJobScheduler.Execute(BackgroundProcessContext context)
   at Hangfire.Server.AutomaticRetryProcess.Execute(BackgroundProcessContext context)

CTRL + C log is continued below:

dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'AggregatedCounter' table...
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'Job' table...
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'List' table...
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'Set' table...
dbug: Hangfire.SQLite.ExpirationManager[0]
  Removing outdated records from the 'Hash' table...
^CApplication is shutting down...
dbug: Hangfire.BackgroundJobServer[0]
  Hangfire Server is stopping...
dbug: Hangfire.Server.ServerWatchdog[0]
  Background process 'ServerWatchdog' stopped.
dbug: Hangfire.SQLite.ExpirationManager[0]
  Background process 'Hangfire.SQLite.ExpirationManager' stopped.
dbug: Hangfire.Server.ServerHeartbeat[0]
  Background process 'ServerHeartbeat' stopped.
dbug: Hangfire.Server.Worker[0]
  Background process 'Worker #36c865ac' stopped.
dbug: Hangfire.Server.DelayedJobScheduler[0]
  Background process 'DelayedJobScheduler' stopped.
dbug: Hangfire.Server.RecurringJobScheduler[0]
  Background process 'RecurringJobScheduler' stopped.
dbug: Hangfire.Server.BackgroundProcessingServer[0]
  Background process 'BackgroundProcessingServer' stopped.
info: Hangfire.BackgroundJobServer[0]
  Hangfire Server stopped.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
in progress
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@azerial @Magikarplvl4 @SlothCroissant @tidusjar @jaycedk @KiqoCode @daymanbpi