Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CPUCore() throw error: SIGILL: illegal instruction #3659

Closed
angelala00 opened this issue Aug 16, 2021 · 3 comments
Closed

CPUCore() throw error: SIGILL: illegal instruction #3659

angelala00 opened this issue Aug 16, 2021 · 3 comments
Assignees

Comments

@angelala00
Copy link

angelala00 commented Aug 16, 2021

When I execute command as follows:

#for i in {1..20}; do
i=0
curl -sS -X POST http://localhost:9003/writetagged -d '{
"namespace": "default",
"id": "test-id-'${i}'",
"tags": [
{
"name": "city",
"value": "city-'${i}'"
}
],
"datapoint": {
"timestamp": '"$(date "+%s")"',
"value": 42.123456789
}
}
'
#done

The m3dbnode will throw error:
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: SIGILL: illegal instruction
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: PC=0xbdc280 m=7 sigcode=2
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: goroutine 44775 [running]:
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/x/sync.getCore(0x26439766, 0xed8a833bc, 0x2fcdaa0, 0x3b9aca00, 0x0, 0xed8a833bc, 0x2fcdaa0, 0xc004864600, 0x1556, 0xc004864600, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/x/sync/cpu_linux_amd64.s:9 fp=0xc00a420288 sp=0xc00a420280 pc=0xbdc280
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/x/sync.CPUCore(...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/x/sync/index_cpu.go:72
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/storage.(*dbShardInsertQueue).Insert(0xc0035bf080, 0xc0084b0e00, 0x0, 0x0, 0xed8a833bc, 0x2fcdaa0, 0x40450fcd6e9b9cb2, 0x1, 0x0, 0x0, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/storage/shard_insert_queue.go:291 +0x26b fp=0xc00a4202f8 sp=0xc00a420288 pc=0x10a5dfb
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/storage.(*dbShard).insertSeriesAsyncBatched(0xc004864600, 0x2112d20, 0xc06d04d9e0, 0x7f9526db5340, 0xc0685dc0c0, 0x0, 0x0, 0xed8a833bc, 0x2fcdaa0, 0x40450fcd6e9b9cb2, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/storage/shard.go:1340 +0x209 fp=0xc00a4205f0 sp=0xc00a4202f8 pc=0x10985b9
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/storage.(*dbShard).writeAndIndex(0xc004864600, 0x21250e0, 0xc081e86e70, 0x2112d20, 0xc06d04d9e0, 0x7f9526db5340, 0xc0685dc0c0, 0x0, 0xed8a833bc, 0x2fcdaa0, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/storage/shard.go:1000 +0x24e fp=0xc00a420bb0 sp=0xc00a4205f0 pc=0x1095f9e
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/storage.(*dbShard).WriteTagged(0xc004864600, 0x21250e0, 0xc081e86e70, 0x2112d20, 0xc06d04d9e0, 0x7f9526db5340, 0xc0685dc0c0, 0x0, 0xed8a833bc, 0x2fcdaa0, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/storage/shard.go:887 +0x15e fp=0xc00a420e50 sp=0xc00a420bb0 pc=0x1095aae
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/storage.(*dbNamespace).WriteTagged(0xc09e080e00, 0x21250e0, 0xc081e86e70, 0x2112d20, 0xc06d04d9e0, 0x7f9526db5340, 0xc0685dc0c0, 0x0, 0xed8a833bc, 0x2fcdaa0, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/storage/namespace.go:716 +0x352 fp=0xc00a421160 sp=0xc00a420e50 pc=0x1075672
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/storage.(*db).writeBatch(0xc0917f41c0, 0x21250e0, 0xc081e86e70, 0x2112d20, 0xc06d04d980, 0x7f9526db5308, 0xc08f686420, 0x20bc060, 0xc06c4b19d0, 0xed8a83301, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/storage/database.go:741 +0x35e fp=0xc00a421858 sp=0xc00a421160 pc=0x10474de
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/storage.(*db).WriteTaggedBatch(0xc0917f41c0, 0x21250e0, 0xc081e86e70, 0x2112d20, 0xc06d04d980, 0x7f9526db5308, 0xc08f686420, 0x20bc060, 0xc06c4b19d0, 0x0, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/storage/database.go:699 +0x99 fp=0xc00a4218c8 sp=0xc00a421858 pc=0x1047149
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/storage/cluster.(*clusterDB).WriteTaggedBatch(0xc09186afc0, 0x21250e0, 0xc081e86e70, 0x2112d20, 0xc06d04d980, 0x7f9526db5308, 0xc08f686420, 0x20bc060, 0xc06c4b19d0, 0x0, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: :1 +0xa9 fp=0xc00a421930 sp=0xc00a4218c8 pc=0x16ec319
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/network/server/tchannelthrift/node.(*service).WriteTaggedBatchRaw(0xc06c208900, 0x7f952fa0f0e8, 0xc00a580d60, 0xc00a512f00, 0x0, 0x0)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/network/server/tchannelthrift/node/service.go:1696 +0xa6e fp=0xc00a421b00 sp=0xc00a421930 pc=0x16d886e
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/generated/thrift/rpc.(*tchanNodeServer).handleWriteTaggedBatchRaw(0xc09cfe2b80, 0x7f952fa0f0e8, 0xc00a580d60, 0x213d000, 0xc091ed61b0, 0x1b41740, 0xc00477fbd0, 0x481760, 0x2faeae0, 0xc0235d4500)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/generated/thrift/rpc/tchan-rpc.go:2015 +0xc4 fp=0xc00a421b58 sp=0xc00a421b00 pc=0xde8b04
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/generated/thrift/rpc.(*tchanNodeServer).Handle(0xc09cfe2b80, 0x7f952fa0f0e8, 0xc00a580d60, 0xc007a3b406, 0x13, 0x213d000, 0xc091ed61b0, 0xc00a512e70, 0xc0a054e001, 0x101000000000007, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/generated/thrift/rpc/tchan-rpc.go:1162 +0x10f3 fp=0xc00a421be0 sp=0xc00a421b58 pc=0xde3903
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/uber/tchannel-go/thrift.(*Server).handle(0xc09cfa39a0, 0x2103440, 0xc00a580cd0, 0x20ed000, 0xc09cfe2b80, 0x1db0000, 0xc007a3b406, 0x13, 0xc006e77c80, 0x0, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/github.com/uber/tchannel-go@v1.12.0/thrift/server.go:163 +0x3df fp=0xc00a421d40 sp=0xc00a421be0 pc=0xd234cf
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/uber/tchannel-go/thrift.(*Server).Handle(0xc09cfa39a0, 0x2103440, 0xc00a580cd0, 0xc006e77c80)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/github.com/uber/tchannel-go@v1.12.0/thrift/server.go:237 +0x181 fp=0xc00a421e08 sp=0xc00a421d40 pc=0xd242a1
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/uber/tchannel-go.(*handlerMap).Handle(0xc09cfe0fc0, 0x2103440, 0xc00a580cd0, 0xc006e77c80)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/github.com/uber/tchannel-go@v1.12.0/handlers.go:118 +0xf9 fp=0xc00a421f10 sp=0xc00a421e08 pc=0xce9f19
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/uber/tchannel-go.channelHandler.Handle(0xc00051ed00, 0x2103440, 0xc00a580cd0, 0xc006e77c80)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/github.com/uber/tchannel-go@v1.12.0/handlers.go:126 +0x8c fp=0xc00a421f58 sp=0xc00a421f10 pc=0xcea4ac
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/uber/tchannel-go.(*Connection).dispatchInbound(0xc0a20def00, 0x5100000028, 0xc006e77c80, 0xc06d60e840)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/github.com/uber/tchannel-go@v1.12.0/inbound.go:200 +0x33a fp=0xc00a421fc0 sp=0xc00a421f58 pc=0xced30a
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: runtime.goexit()
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/go/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc00a421fc8 sp=0xc00a421fc0 pc=0x467331
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: created by github.com/uber/tchannel-go.(*Connection).handleCallReq
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/github.com/uber/tchannel-go@v1.12.0/inbound.go:131 +0xcc7
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: goroutine 1 [chan receive, 6 minutes]:
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/x/os.WaitForInterrupt(0xc0006f5500, 0xc0006f53e0)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/x/os/interrupt.go:51 +0x9d
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: github.com/m3db/m3/src/dbnode/server.Run(0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc000186e98, ...)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/dbnode/server/server.go:949 +0x7ccd
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: main.main()
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/m3/src/cmd/services/m3dbnode/main/main.go:100 +0x350
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: goroutine 82 [chan receive]:
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc00070ab20)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:173 +0x3a5
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:91 +0x80
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: goroutine 116 [chan receive]:
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc0006981c0)
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:173 +0x3a5
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
Aug 13 17:34:52 test8c24g03-5 m3dbnode[10106]: /home/odin/steveyubo/gopath/pkg/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:91 +0x80

systeminfo:
cat /proc/version
Linux version 3.10.0-327.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version 4.8.3 20140911 (Red Hat 4.8.3-9) (GCC) ) #1 SMP Thu Nov 19 22:10:57 UTC 2015
cat /etc/centos-release
CentOS Linux release 7.2.1511 (Core)

m3dbversion:
go Runtime version: go1.14.6
Build Version: v0.15.14
Build Revision: 88164cf
Build Branch: master
Build Date: 2020-09-18-15:13:16
Build TimeUnix: 1600413196

I known the closed issue
#3105
but i still don't how to solve it

@gibbscullen
Copy link
Collaborator

@angelala00 -- based on #3105, you will need to make sure you're using a VM that can support this command. This error message comes not having a VM that supports the instrument rdtscp.

@gibbscullen gibbscullen self-assigned this Aug 19, 2021
@angelala00
Copy link
Author

@gibbscullen Thinks. I confirmed that the virtual machine does not support this command. After changing the working mode of the virtual machine, this command is supported and the problem is solved.

@kendrickclark
Copy link

@angelala00 You mentioned you changed the working mode of the virtual machine? Could you explain what that means by chance? I am also seeking a solution

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants