Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pulsar RACE issue #516

Closed
cydrain opened this issue May 11, 2021 · 2 comments · Fixed by #533
Closed

pulsar RACE issue #516

cydrain opened this issue May 11, 2021 · 2 comments · Fixed by #533
Labels
Milestone

Comments

@cydrain
Copy link

cydrain commented May 11, 2021

I'm from Milvus team, we use Pulsar in our system.
When I run unittest, I often see following pulsar RACE issue.
Can you help to fix this?

WARNING: DATA RACE
Read at 0x00c00015de68 by goroutine 144:
  github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).internalClose()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:842 +0x5f1
  github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).runEventsLoop()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:801 +0x29b

Previous write at 0x00c00015de68 by goroutine 208:
  github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).Decompress()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:1062 +0x468
  github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).MessageReceived()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:474 +0x104
  github.com/apache/pulsar-client-go/pulsar/internal.(*connection).handleMessage()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:638 +0x1ab
  github.com/apache/pulsar-client-go/pulsar/internal.(*connection).internalReceivedCommand()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:527 +0x472
  github.com/apache/pulsar-client-go/pulsar/internal.(*connection).run()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:381 +0x57c
  github.com/apache/pulsar-client-go/pulsar/internal.(*connection).start.func1()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:215 +0xc4

Goroutine 144 (running) created at:
  github.com/apache/pulsar-client-go/pulsar.newPartitionConsumer()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:207 +0xf35
  github.com/apache/pulsar-client-go/pulsar.(*consumer).internalTopicSubscribeToPartitions.func1()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_impl.go:315 +0x778

Goroutine 208 (running) created at:
  github.com/apache/pulsar-client-go/pulsar/internal.(*connection).start()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:211 +0x4c
  github.com/apache/pulsar-client-go/pulsar/internal.(*connectionPool).GetConnection()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection_pool.go:100 +0x6de
  github.com/apache/pulsar-client-go/pulsar/internal.(*rpcClient).Request()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/rpc_client.go:112 +0xed
  github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).grabConn()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:951 +0x15d1
  github.com/apache/pulsar-client-go/pulsar.newPartitionConsumer()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:179 +0xc51
  github.com/apache/pulsar-client-go/pulsar.(*consumer).internalTopicSubscribeToPartitions.func1()
      /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_impl.go:315 +0x778
==================
time="2021-05-09T16:12:45Z" level=info msg="[Connection closed]" local_addr="172.18.0.5:39286" remote_addr="pulsar://pulsar:6650"
time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39282->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39282" remote_addr="pulsar://pulsar:6650"
time="2021-05-09T16:12:45Z" level=info msg="[Connection closed]" local_addr="172.18.0.5:39292" remote_addr="pulsar://pulsar:6650"
time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39286->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39286" remote_addr="pulsar://pulsar:6650"
time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39292->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39292" remote_addr="pulsar://pulsar:6650"
time="2021-05-09T16:12:45Z" level=info msg="[Connection closed]" local_addr="172.18.0.5:39284" remote_addr="pulsar://pulsar:6650"
time="2021-05-09T16:12:45Z" level=info msg="[Connection closed]" local_addr="172.18.0.5:39288" remote_addr="pulsar://pulsar:6650"
time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39284->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39284" remote_addr="pulsar://pulsar:6650"
time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39288->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39288" remote_addr="pulsar://pulsar:6650"
--- FAIL: TestAssignSegmentID (0.40s)
    testing.go:1042: race detected during execution of test
FAIL
coverage: 68.0% of statements
FAIL	github.com/milvus-io/milvus/internal/dataservice	4.807s
FAIL
make: *** [test-go] Error 1
Makefile:149: recipe for target 'test-go' failed
2
Error: Process completed with exit code 2.
@cydrain
Copy link
Author

cydrain commented May 14, 2021

Any update ?

@wolfstudy
Copy link
Member

Any update ?

Hello @cydrain Sorry for the late reply to this question. This looks like a bug, I will send a pull request to fix this problem later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants