Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unknown rdb value type byte. key=[], type=[200] #780

Closed
robert1070 opened this issue Mar 11, 2024 · 9 comments
Closed

unknown rdb value type byte. key=[], type=[200] #780

robert1070 opened this issue Mar 11, 2024 · 9 comments
Labels
type: question Further information is requested

Comments

@robert1070
Copy link

问题描述(Issue Description)

请在这里简要描述你遇到的问题。

源:6.2.7
目标:6.2.7

Please provide a brief description of the issue you encountered.

环境信息(Environment)

  • RedisShake 版本(RedisShake Version):v4.0.3
  • Redis 源端版本(Redis Source Version):6.2.7
  • Redis 目的端版本(Redis Destination Version):6.2.7
  • Redis 部署方式(standalone/cluster/sentinel):cluster
  • 是否在云服务商实例上部署(Deployed on Cloud Provider):无

日志信息(Logs)

image
@robert1070 robert1070 added the type: question Further information is requested label Mar 11, 2024
@suxb201
Copy link
Member

suxb201 commented Mar 12, 2024

用一下新版本试试,新版本也不行的话请发 dump.rdb 过来我排查一下。
https://github.com/tair-opensource/RedisShake/releases/tag/v4.0.5

@robert1070
Copy link
Author

v4.0.4 也尝试过,报错信息是一样的

@suxb201
Copy link
Member

suxb201 commented Mar 12, 2024

用一下新版本 4.0.5 试试,也不行的话请发 dump.rdb 过来我排查一下。

@robert1070
Copy link
Author

以下的几个版本都不行,报错是一样:
06708ebe86747555ff268e495b8b063e redis_shake_3.1.11
fb38221977d956cdb4c67fa48e92a0e9 redis_shake_4.0.4
ef294fedf1db5d701c70c5a2f1100753 redis_shake_4.0.3
4805c7821489fdcbe2172f013e322677 redis_shake_4.0.5

@suxb201
Copy link
Member

suxb201 commented Mar 12, 2024

请发 dump.rdb 过来我排查一下。

@robert1070
Copy link
Author

稍等,文件稍微大一点,我在上传谷歌云盘

@robert1070
Copy link
Author

@suxb201
Copy link
Member

suxb201 commented Mar 12, 2024

97727:C 12 Mar 2024 14:07:48.497 * oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
97727:C 12 Mar 2024 14:07:48.497 * Redis version=7.2.3, bits=64, commit=00000000, modified=0, pid=97727, just started
97727:C 12 Mar 2024 14:07:48.497 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
97727:M 12 Mar 2024 14:07:48.498 * Increased maximum number of open files to 10032 (it was originally set to 256).
97727:M 12 Mar 2024 14:07:48.498 * monotonic clock: POSIX clock_gettime
                _._
           _.-``__ ''-._
      _.-``    `.  `_.  ''-._           Redis 7.2.3 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 97727
  `-._    `-._  `-./  _.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |           https://redis.io
  `-._    `-._`-.__.-'_.-'    _.-'
 |`-._`-._    `-.__.-'    _.-'_.-'|
 |    `-._`-._        _.-'_.-'    |
  `-._    `-._`-.__.-'_.-'    _.-'
      `-._    `-.__.-'    _.-'
          `-._        _.-'
              `-.__.-'

97727:M 12 Mar 2024 14:07:48.501 # WARNING: The TCP backlog setting of 511 cannot be enforced because kern.ipc.somaxconn is set to the lower value of 128.
97727:M 12 Mar 2024 14:07:48.501 * Server initialized
97727:M 12 Mar 2024 14:07:48.502 * Loading RDB produced by version 6.2.7
97727:M 12 Mar 2024 14:07:48.502 * RDB age 12150 seconds
97727:M 12 Mar 2024 14:07:48.502 * RDB memory usage when created 563.62 Mb
97727:M 12 Mar 2024 14:07:48.502 # Internal error in RDB reading offset 0, function at rdb.c:2845 -> Unknown RDB encoding type 200
[offset 0] Checking RDB file dump.rdb
[offset 26] AUX FIELD redis-ver = '6.2.7'
[offset 40] AUX FIELD redis-bits = '64'
[offset 52] AUX FIELD ctime = '1710211518'
[offset 67] AUX FIELD used-mem = '591001008'
[offset 85] AUX FIELD repl-stream-db = '0'
[offset 135] AUX FIELD repl-id = '290e3ddc8ff847e518151ebac3463ddfae45260d'
[offset 159] AUX FIELD repl-offset = '6270783677'
[offset 175] AUX FIELD aof-preamble = '0'
--- RDB ERROR DETECTED ---
[offset 176] Invalid object type: 200
[additional info] While doing: read-type
[additional info] Reading type 0 (string)
[info] 0 keys read
[info] 0 expires
[info] 0 already expired

使用 Redis 也无法加载此 dump.rdb,请考虑是不是使用了闭源代码或者文件损坏。

@robert1070
Copy link
Author

感谢大佬,终于破案了,是我们内部自研的维护的版本

@suxb201 suxb201 closed this as completed Mar 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants