Skip to content

panic: runtime error: slice bounds out of range [25893:114] influxdbv2 won't start up #26289

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
raldone01 opened this issue Apr 17, 2025 · 2 comments
Assignees
Labels
area/2.x OSS 2.0 related issues and PRs

Comments

@raldone01
Copy link

❯ docker compose up influxdb-v2
[+] Running 1/1
 ✔ Container docker_featherink-influxdb-v2-1  Created                                                                                                                                                                                                                        0.0s 
Attaching to influxdb-v2-1
influxdb-v2-1  | 2025-04-17T21:20:46.876683483Z info    found existing boltdb file, skipping setup wrapper      {"system": "docker", "bolt_path": "/var/lib/influxdb2/influxd.bolt"}
influxdb-v2-1  | 2025-04-17T21:20:46.991111826Z info    found existing boltdb file, skipping setup wrapper      {"system": "docker", "bolt_path": "/var/lib/influxdb2/influxd.bolt"}
influxdb-v2-1  | ts=2025-04-17T21:20:47.197858Z lvl=info msg="Welcome to InfluxDB" log_id=0vyPrGNG000 version=v2.7.11 commit=fbf5d4ab5e build_date=2024-12-02T17:48:15Z log_level=info
influxdb-v2-1  | ts=2025-04-17T21:20:47.197998Z lvl=warn msg="nats-port argument is deprecated and unused" log_id=0vyPrGNG000
influxdb-v2-1  | ts=2025-04-17T21:20:47.230609Z lvl=info msg="Resources opened" log_id=0vyPrGNG000 service=bolt path=/var/lib/influxdb2/influxd.bolt
influxdb-v2-1  | ts=2025-04-17T21:20:47.231108Z lvl=info msg="Resources opened" log_id=0vyPrGNG000 service=sqlite path=/var/lib/influxdb2/influxd.sqlite
influxdb-v2-1  | ts=2025-04-17T21:20:47.308568Z lvl=info msg="Checking InfluxDB metadata for prior version." log_id=0vyPrGNG000 bolt_path=/var/lib/influxdb2/influxd.bolt
influxdb-v2-1  | ts=2025-04-17T21:20:47.308748Z lvl=info msg="Using data dir" log_id=0vyPrGNG000 service=storage-engine service=store path=/var/lib/influxdb2/engine/data
influxdb-v2-1  | ts=2025-04-17T21:20:47.308799Z lvl=info msg="Compaction settings" log_id=0vyPrGNG000 service=storage-engine service=store max_concurrent_compactions=36 throughput_bytes_per_second=50331648 throughput_bytes_per_second_burst=50331648
influxdb-v2-1  | ts=2025-04-17T21:20:47.308815Z lvl=info msg="Open store (start)" log_id=0vyPrGNG000 service=storage-engine service=store op_name=tsdb_open op_event=start
influxdb-v2-1  | panic: runtime error: slice bounds out of range [25893:114]
influxdb-v2-1  | 
influxdb-v2-1  | goroutine 313 [running]:
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb.ReadSeriesKeyMeasurement(...)
influxdb-v2-1  |        /root/project/tsdb/series_file.go:381
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).execSeriesEntry(0xc0164d41e0, 0xc016915ba0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:701 +0xa5b
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).execEntry(0x0?, 0x0?)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:638 +0x34
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).open(0xc0164d41e0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:166 +0x391
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).Open(0xc0164d41e0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:115 +0x65
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*Partition).openLogFile(0xc01648b0e0, {0xc0164d6780?, 0x72aa596d62c8?})
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/partition.go:280 +0x4a
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*Partition).Open(0xc01648b0e0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/partition.go:219 +0x83e
influxdb-v2-1  | golang.org/x/sync/errgroup.(*Group).Go.func1()
influxdb-v2-1  |        /go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:78 +0x56
influxdb-v2-1  | created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 199
influxdb-v2-1  |        /go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:75 +0x96
influxdb-v2-1 exited with code 0
influxdb-v2-1  | 2025-04-17T21:20:52.995380848Z info    found existing boltdb file, skipping setup wrapper      {"system": "docker", "bolt_path": "/var/lib/influxdb2/influxd.bolt"}
influxdb-v2-1  | 2025-04-17T21:20:53.107399880Z info    found existing boltdb file, skipping setup wrapper      {"system": "docker", "bolt_path": "/var/lib/influxdb2/influxd.bolt"}
influxdb-v2-1  | ts=2025-04-17T21:20:53.276971Z lvl=info msg="Welcome to InfluxDB" log_id=0vyPrd70000 version=v2.7.11 commit=fbf5d4ab5e build_date=2024-12-02T17:48:15Z log_level=info
influxdb-v2-1  | ts=2025-04-17T21:20:53.277101Z lvl=warn msg="nats-port argument is deprecated and unused" log_id=0vyPrd70000
influxdb-v2-1  | ts=2025-04-17T21:20:53.307607Z lvl=info msg="Resources opened" log_id=0vyPrd70000 service=bolt path=/var/lib/influxdb2/influxd.bolt
influxdb-v2-1  | ts=2025-04-17T21:20:53.307784Z lvl=info msg="Resources opened" log_id=0vyPrd70000 service=sqlite path=/var/lib/influxdb2/influxd.sqlite
influxdb-v2-1  | ts=2025-04-17T21:20:53.366462Z lvl=info msg="Checking InfluxDB metadata for prior version." log_id=0vyPrd70000 bolt_path=/var/lib/influxdb2/influxd.bolt
influxdb-v2-1  | ts=2025-04-17T21:20:53.366680Z lvl=info msg="Using data dir" log_id=0vyPrd70000 service=storage-engine service=store path=/var/lib/influxdb2/engine/data
influxdb-v2-1  | ts=2025-04-17T21:20:53.366722Z lvl=info msg="Compaction settings" log_id=0vyPrd70000 service=storage-engine service=store max_concurrent_compactions=36 throughput_bytes_per_second=50331648 throughput_bytes_per_second_burst=50331648
influxdb-v2-1  | ts=2025-04-17T21:20:53.366737Z lvl=info msg="Open store (start)" log_id=0vyPrd70000 service=storage-engine service=store op_name=tsdb_open op_event=start
influxdb-v2-1  | panic: runtime error: slice bounds out of range [12590:109]
influxdb-v2-1  | 
influxdb-v2-1  | goroutine 1221 [running]:
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb.ReadSeriesKeyMeasurement(...)
influxdb-v2-1  |        /root/project/tsdb/series_file.go:381
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).execSeriesEntry(0xc015dd4a50, 0xc0161bfba0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:701 +0xa5b
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).execEntry(0x0?, 0x0?)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:638 +0x34
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).open(0xc015dd4a50)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:166 +0x391
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).Open(0xc015dd4a50)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:115 +0x65
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*Partition).openLogFile(0xc015d5f200, {0xc016393e60?, 0x7bd7150b72c8?})
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/partition.go:280 +0x4a
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*Partition).Open(0xc015d5f200)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/partition.go:219 +0x83e
influxdb-v2-1  | golang.org/x/sync/errgroup.(*Group).Go.func1()
influxdb-v2-1  |        /go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:78 +0x56
influxdb-v2-1  | created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 186
influxdb-v2-1  |        /go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:75 +0x96
influxdb-v2-1  | panic: runtime error: slice bounds out of range [26469:112]
influxdb-v2-1  | 
influxdb-v2-1  | goroutine 1017 [running]:
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb.ReadSeriesKeyMeasurement(...)
influxdb-v2-1  |        /root/project/tsdb/series_file.go:381
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).execSeriesEntry(0xc0169a62d0, 0xc015de1ba0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:701 +0xa5b
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).execEntry(0x0?, 0x0?)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:638 +0x34
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).open(0xc0169a62d0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:166 +0x391
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).Open(0xc0169a62d0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:115 +0x65
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*Partition).openLogFile(0xc015e8b8c0, {0xc016fbe180?, 0x7bd7150b72c8?})
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/partition.go:280 +0x4a
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*Partition).Open(0xc015e8b8c0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/partition.go:219 +0x83e
influxdb-v2-1  | golang.org/x/sync/errgroup.(*Group).Go.func1()
influxdb-v2-1  |        /go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:78 +0x56
influxdb-v2-1  | created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 179
influxdb-v2-1  |        /go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:75 +0x96
influxdb-v2-1  | panic: runtime error: slice bounds out of range [29817:103]
influxdb-v2-1  | 
influxdb-v2-1  | goroutine 1019 [running]:
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb.ReadSeriesKeyMeasurement(...)
influxdb-v2-1  |        /root/project/tsdb/series_file.go:381
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).execSeriesEntry(0xc0169245a0, 0xc01760fba0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:701 +0xa5b
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).execEntry(0x0?, 0x0?)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:638 +0x34
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).open(0xc0169245a0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:166 +0x391
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*LogFile).Open(0xc0169245a0)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/log_file.go:115 +0x65
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*Partition).openLogFile(0xc015e8bb00, {0xc0165007e0?, 0x7bd7150b72c8?})
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/partition.go:280 +0x4a
influxdb-v2-1  | github.com/influxdata/influxdb/v2/tsdb/index/tsi1.(*Partition).Open(0xc015e8bb00)
influxdb-v2-1  |        /root/project/tsdb/index/tsi1/partition.go:219 +0x83e
influxdb-v2-1  | golang.org/x/sync/errgroup.(*Group).Go.func1()
influxdb-v2-1  |        /go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:78 +0x56
influxdb-v2-1  | created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 179
influxdb-v2-1  |        /go/pkg/mod/golang.org/x/sync@v0.7.0/errgroup/errgroup.go:75 +0x96

After a power failure/kernel oops the docker container won't start up anymore.

@davidby-influx
Copy link
Contributor

It looks like your TSI index is corrupted and will need to be rebuilt.

You should remove (or, more safely, move aside) the series file directories and index directories and then rebuild with the following command:

https://docs.influxdata.com/influxdb/v2/reference/cli/influxd/inspect/build-tsi/

@davidby-influx davidby-influx self-assigned this Apr 18, 2025
@davidby-influx davidby-influx added the area/2.x OSS 2.0 related issues and PRs label Apr 18, 2025
@davidby-influx
Copy link
Contributor

No response 1 month.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/2.x OSS 2.0 related issues and PRs
Projects
None yet
Development

No branches or pull requests

2 participants