Unable to delete file:rustfs/thanos/01K86DSZ9F8ZV4GWRSVNKEC/meta.json

[cscowx]

Fault Description:

Backend storage uses RustFS

cat /etc/systemd/system/rustfs.service
[Unit]
Description=RustFS Object Storage Server
Documentation=https://rustfs.com/docs/
After=network-online.target
Wants=network-online.target

[Service]
Type=notify
NotifyAccess=main
User=rustfs
Group=rustfs

WorkingDirectory=/usr/local
EnvironmentFile=-/etc/default/rustfs
ExecStart=/usr/local/bin/rustfs $RUSTFS_VOLUMES

LimitNOFILE=1048576
LimitNPROC=32768
TasksMax=infinity

Restart=always
RestartSec=10s

OOMScoreAdjust=-1000
SendSIGKILL=no

TimeoutStartSec=30s
TimeoutStopSec=30s

NoNewPrivileges=true
ProtectSystem=full
ProtectHome=true
PrivateTmp=true
PrivateDevices=true
ProtectClock=true
ProtectKernelTunables=true
ProtectKernelModules=true
ProtectControlGroups=true
RestrictSUIDSGID=true
RestrictRealtime=true

# service log configuration
StandardOutput=append:/var/log/rustfs/rustfs.log
StandardError=append:/var/log/rustfs/rustfs-err.log

[Install]
WantedBy=multi-user.target

mc alias list

rustfs
  URL       : http://192.168.110.220:9000
  AccessKey : thanos20
  SecretKey : 1234567890
  API       : s3v4
  Path      : auto
  Src       : /root/.mc/config.json

kubectl logs -f pod/my-thanos-compact-0 -n monitor
{"caller":"compact.go:659","err":"BaseFetcher: iter bucket: meta.json file exists: 01K86DSZ9F8ZV4GWRSVNFWNKEC: stat s3 object: 500 Internal Server Error","level":"error","msg":"retriable error","ts":"2025-10-29T03:07:55.549901054Z"}

#此文件存在
mc ls rustfs/thanos/01K86DSZ9F8ZV4GWRSVNFWNKEC
[2025-10-23 01:00:27 CST] 989B meta.json

mc cat rustfs/thanos/01K86DSZ9F8ZV4GWRSVNFWNKEC/meta.json
mc: <ERROR> Unable to read from rustfs/thanos/01K86DSZ9F8ZV4GWRSVNFWNKEC/meta.json. 500 Internal Server Error.
#RustFS存储通的版本控制已关闭了
mc version info rustfs/thanos
rustfs/thanos versioning is suspended

#这里已经执行删除操作
mc rm --purge --force rustfs/thanos/01K86DSZ9F8ZV4GWRSVNKEC/meta.json
Removed rustfs/thanos/01K86DSZ9F8ZV4GWRSVNKEC/meta.json.

mc rm -r --force rustfs/thanos/01K86DSZ9F8ZV4GWRSVNFWNKEC
Created delete marker rustfs/thanos/01K86DSZ9F8ZV4GWRSVNFWNKEC/meta.json.

#此文件还是存在
mc ls rustfs/thanos/01K86DSZ9F8ZV4GWRSVNFWNKEC
[2025-10-23 01:00:27 CST] 989B meta.json

为啥这个meta.json文件删不掉？

其它日志：

tail -f rustfs.log

Console WebUI (localhost): http://127.0.0.1:9001/rustfs/console/index.html
CLAUDE DEBUG: init_kms_system called!
140 thanos
Starting Tokio runtime with configured parameters:
worker_threads: 16, max_blocking_threads: 1024, thread_stack_size: 1048576, thread_keep_alive: 60, global_queue_interval: 31, thread_name: rustfs-worker
   API: http://192.168.110.220:9000  http://127.0.0.1:9000
Console WebUI available at: http://192.168.110.220:9001/rustfs/console/index.html
Console WebUI (localhost): http://127.0.0.1:9001/rustfs/console/index.html
CLAUDE DEBUG: init_kms_system called!
140 thanos

tail -f rustfs-err.log
‘’‘
Using default Async write mode in production. To customize, set RUSTFS_OBS_LOG_POOL_CAPA, RUSTFS_OBS_LOG_MESSAGE_CAPA, and RUSTFS_OBS_LOG_FLUSH_MS environment variables.
Production logging initialized: file-only mode to /tmp/rustfs/logs/rustfs.log
Stdout logging disabled in production environment for security and log aggregation.
Log rotation configured for: every day or when size exceeds 100MB, keeping 30 files
Log directory ready: /tmp/rustfs/logs
Log directory permissions set to 755: /tmp/rustfs/logs
Using default Async write mode in production. To customize, set RUSTFS_OBS_LOG_POOL_CAPA, RUSTFS_OBS_LOG_MESSAGE_CAPA, and RUSTFS_OBS_LOG_FLUSH_MS environment variables.
Production logging initialized: file-only mode to /tmp/rustfs/logs/rustfs.log
Stdout logging disabled in production environment for security and log aggregation.
Log rotation configured for: every day or when size exceeds 100MB, keeping 30 files

[loverustfs]

What version of RustFS are you using?

alpha.66?

[cscowx]

Hello, this is the version of the software.

rustfs 1.0.0-alpha.60
build time   : 2025-09-25 01:37:23 +00:00
build profile: release
build os     : linux-x86_64
rust version : rustc 1.90.0 (1159e78c4 2025-09-14)
rust channel : stable-x86_64-unknown-linux-gnu
git branch   : 
git commit   : 9b7f4d477af150dd6beeab117ffb381d8b08dea9
git tag      : 1.0.0-alpha.60
git status   :

[loverustfs]

This bug does exist in this version; please upgrade to the latest version.