Redis cannot save #407
Comments
|
Hi @Harachie |
|
Hi @enricogior , thanks for your fast response. I will replace the version asap and let you know when encountering the issue again. Thanks, |
|
Hi @enricogior , unfortunately the update did not solve the problem. The same problem remains (though with different stack trace). === REDIS BUG REPORT START: Cut & paste starting from here === This errors appears every 5 seconds (on every save operation). Do you have any idea what to do? Kind regards, |
|
Hi @Harachie |
|
Hi @enricogior , here are the ones before the problem appears: [7772] 15 Feb 07:19:25.036 * 1 changes in 3600 seconds. Saving... === REDIS BUG REPORT START: Cut & paste starting from here === Kind regards, |
|
@Harachie |
|
of course I would try it out. Kind regards, |
|
@Harachie |
|
Hi @Harachie |
|
Hi @enricogior , thanks, it's on the server now. Many thanks for your support! Kind regards, |
|
Hi @Harachie |
|
Hi @enricogior , no news, everything runs smooth so far (like always when you add logging :( ). Thanks, |
|
@Harachie |
|
Hi @enricogior , now it happens. --- edit --- === REDIS BUG REPORT START: Cut & paste starting from here === === REDIS BUG REPORT START: Cut & paste starting from here === === REDIS BUG REPORT START: Cut & paste starting from here === === REDIS BUG REPORT START: Cut & paste starting from here === === REDIS BUG REPORT START: Cut & paste starting from here === === REDIS BUG REPORT START: Cut & paste starting from here === Serverredis_version:3.0.501-private Clientsconnected_clients:50 Memoryused_memory:944 Persistenceloading:0 Statstotal_connections_received:108338 Replicationrole:master CPUused_cpu_sys:0.34 CommandstatsClustercluster_enabled:0 Keyspacedb0:keys=41980,expires=13109,avg_ttl=304753252 |
|
Hi @Harachie |
|
Hi @enricogior , Also we are going to replace this server with a new one, Thanks for your help, |
|
Hi @Harachie |
|
Hi @enricogior please download the latest dump file here Kind regards, |
|
@Harachie |
|
Same problem here as well with 3.0.501 Only thing I can do as a workaround is restart every few hours. I can still issue a "SAVE" command and that will work correctly. However the automatic BGSAVEs end with the same error. |
|
Getting the same problem - although I am using version 2.8.2400 |
|
|
Hi @kpturner |
|
That is encouraging - although having read the documentation as instructed I still don't really know exactly what to do. I am new to redis so I don't know how to tell what my maxheap and maxmemory settings are, or how to change them or, to be honest, what to change them to :( Yes, I am a complete newb. |
|
@Harachie |
|
@Harachie |
|
@enricogior |
|
@enricogior Hope it helps to tackle down this problem! --- edit --- Kind regards, |
|
@Harachie |
|
@Harachie |
|
@enricogior Thanks you very much for helping so far! :) |
|
@enricogior |
|
@Harachie |
|
@enricogior void EnsureMemoryIsMapped(const void *buffer, size_t size) {
// Use 'volatile' to make sure the compiler doesn't remove "c = *((char*) (p + offset));"
volatile char c;
char* p = (char*) buffer;
char* pStart = p - ((size_t) p % Globals::pageSize);
char* pEnd = p + size;
if ((size_t) (pEnd - pStart) > Globals::pageSize) {
size_t offset = 0;
while (offset < size) {
if (size < offset) {
offset = size;
} else {
offset += Globals::pageSize;
if (offset > size) {
offset = size;
}
}
c = *((char*) (p + offset));
}
}
}and it's running fine so far. Sometimes I also get "[6096] 20 Jun 09:58:44.475 # AbortForkOperation: 0x00000005 - EndForkOperation: Killing forked process failed.: Zugriff verweigert (=> access denied)" Private Sub TestMemoryBoundary()
Dim payload As Byte()
Dim ms As New IO.MemoryStream
For i As Integer = 1 To 8000
ms.WriteByte(1)
Next
payload = ms.ToArray
Try
Using client As New ServiceStack.Redis.RedisClient
client.FlushAll()
client.Save()
For key As Integer = 1 To 10000000
client.Set("Test:" & key, payload)
Threading.Thread.Sleep(1)
Try
client.BgSave()
Catch rex As ServiceStack.Redis.RedisException
If Not rex.Message.Contains("Background save already") Then
Console.WriteLine("Redis Error: " & rex.ToString)
End If
Catch ex As Exception
Console.WriteLine("General exception: " & ex.ToString)
End Try
If key Mod 50000 = 0 Then
client.FlushAll()
End If
Next
End Using
Catch ex As Exception
Console.WriteLine("General: " & ex.ToString)
End Try
End SubThe other behavior I can only reproduce on the servers. Kind regards, |
|
@Harachie |
|
@enricogior |
|
@Harachie |
|
@enricogior Should I try to run a build without the method? How could I verify that everything works as expected? |
|
@Harachie |
|
@enricogior Kind regards, |
|
@Harachie |
|
@enricogior Kind regards, |
|
@Harachie |
|
@enricogior |
|
@Harachie |
|
The latest release is 3.0.503. |
|
I think this may be a related issue #492 |
|
Hello, I hope it is fine to comment on this topic here, as I suspect having a very similar case here. Using Redis 64bit 3.0.503 on a Windows Server 2008 R2 Standard machine. Memory, disc and CPU resource consumption seems normal, threre are still arround 2 GB of RAM free. I see this error message almost every five minutes, interweaved with several messages about successful fork operations: `[4064] 06 Jul 12:34:14.919 * 10000 changes in 60 seconds. Saving... === REDIS BUG REPORT START: Cut & paste starting from here === How can I gain better understanding about what is going wrong here? Thanks and kind regards, Milen Tilev |
|
Hi @mtilev, I recommend to update to the latest version or 3.0.504 where this issue has been fixed. Kind regards, |
|
Hi @Harachie, this seems to have done the job, thanks. Kind regards, Milen |
|
Hello, @Harachie
by the window server:
|
|
Hi @jerviscui , Kind regards, |
|
@Harachie thankyou. I configure the redis log with loglevel debug.
I'm going to use by the bgsave option. I'll consider using the Unix if the error remains the same. |
Hi,
Redis cannot save on one of our servers after some days of runnig perfectly fine (and being able to save).
After some time the message "MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk" appears.
After a restart of Redis everything is running fine again (can also save via "save" and rewrite via "bgrewriteaof").
In the log files this error occurs every 5 minutes (when trying to save).
=== REDIS BUG REPORT START: Cut & paste starting from here ===
[12456] 12 Feb 14:12:21.207 # Redis version: 3.0.500
[12456] 12 Feb 14:12:21.207 # --- EXCEPTION_ACCESS_VIOLATION
[12456] 12 Feb 14:12:21.207 # --- STACK TRACE
redis-server.exe!LogStackTrace(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:95)(0x0012E7B0, 0x0012FF90, 0x00000001, 0x40123730)
redis-server.exe!UnhandledExceptiontHandler(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x00000001, 0x00000000, 0x00000001, 0xEC5DB977)
kernel32.dll!UnhandledExceptionFilter(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x0012E7B0, 0x00000006, 0x00000000, 0x00000001)
ntdll.dll!MD5Final(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x0012F3F0, 0xE6083A8F, 0x40129C28, 0x00000000)
ntdll.dll!_C_specific_handler(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x00130000, 0x0012FF90, 0x0012FF90, 0x77AD2DD0)
ntdll.dll!RtlDecodePointer(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x00130000, 0x773BDDA0, 0x00012F00, 0xEC5DF31D)
ntdll.dll!RtlUnwindEx(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x0012F3F0, 0x0012EF00, 0x00000000, 0x00000000)
ntdll.dll!KiUserExceptionDispatcher(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x00000004, 0x4014F210, 0x00000001, 0x4009FCDE)
redis-server.exe!rioFileWrite(c:\release\redis\src\rio.c:118)(0x0012F65E, 0x00005C09, 0x00005C09, 0x0012F6E0)
redis-server.exe!rioWrite(c:\release\redis\src\rio.h:100)(0x00000005, 0xE7BFA008, 0x00005C09, 0xE7BFA008)
redis-server.exe!rdbSaveRawString(c:\release\redis\src\rdb.c:305)(0x773D0215, 0x00000001, 0x02807040, 0xDC3F90DD)
redis-server.exe!rdbSaveObject(c:\release\redis\src\rdb.c:515)(0x0012F6E0, 0x00000001, 0xE58F6560, 0xE58F6560)
redis-server.exe!rdbSaveRio(c:\release\redis\src\rdb.c:694)(0x4014F210, 0x00E70000, 0x00000005, 0x01272754)
redis-server.exe!rdbSave(c:\release\redis\src\rdb.c:758)(0x00E70000, 0x56B76EF1, 0x00E70000, 0x00000005)
redis-server.exe!QForkChildInit(c:\release\redis\src\win32_interop\win32_qfork.cpp:337)(0x00000005, 0x00000000, 0x0029DFF0, 0x00000005)
redis-server.exe!QForkStartup(c:\release\redis\src\win32_interop\win32_qfork.cpp:515)(0x00000006, 0x00000000, 0x00000000, 0x0029B760)
redis-server.exe!main(c:\release\redis\src\win32_interop\win32_qfork.cpp:1240)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
redis-server.exe!__tmainCRTStartup(f:\dd\vctools\crt\crtw32\startup\crt0.c:255)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
kernel32.dll!BaseThreadInitThunk(f:\dd\vctools\crt\crtw32\startup\crt0.c:255)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
ntdll.dll!RtlUserThreadStart(f:\dd\vctools\crt\crtw32\startup\crt0.c:255)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
ntdll.dll!RtlUserThreadStart(f:\dd\vctools\crt\crtw32\startup\crt0.c:255)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
[12456] 12 Feb 14:12:21.250 # --- INFO OUTPUT
I could not find any bug report related to the 501 release, so is this fixed or still a problem?
Kind regards,
Bastian Kröger
The text was updated successfully, but these errors were encountered: