Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SQLancer: Server restarts during evaluating workload #10160

Open
qvad opened this issue Oct 1, 2021 · 0 comments
Open

SQLancer: Server restarts during evaluating workload #10160

qvad opened this issue Oct 1, 2021 · 0 comments
Assignees
Labels
area/ysql Yugabyte SQL (YSQL) kind/bug This issue is a bug kind/failing-test Tests and testing infra priority/medium Medium priority issue
Projects

Comments

@qvad
Copy link
Contributor

qvad commented Oct 1, 2021

Jira Link: DB-1015
At some moment of running test cluster became temporary unavailable and all testing queries are dropped for various reasons
Unfortunately I can't provide clear scenario right now, because straight reproduce doesn't work

I've found following FATAL stack trace in server logs

F20211001 08:21:39 ../../src/yb/docdb/doc_expr.cc:273] Client should not generate function call instruction with operator 0
    @     0x7f05f34edb9c  yb::LogFatalHandlerSink::send()
    @     0x7f05f0c738ee  google::LogMessage::SendToLog()
    @     0x7f05f0c70a7a  google::LogMessage::Flush()
    @     0x7f05f0c74169  google::LogMessageFatal::~LogMessageFatal()
    @     0x7f05fb1541e2  yb::docdb::DocExprExecutor::EvalTSCall()
    @     0x7f05f47766bc  yb::QLExprExecutor::EvalExpr()
    @     0x7f05fb18cf55  yb::docdb::PgsqlReadOperation::EvalAggregate()
    @     0x7f05fb18f9ff  yb::docdb::PgsqlReadOperation::ExecuteScalar()
    @     0x7f05fb191637  yb::docdb::PgsqlReadOperation::Execute()
    @     0x7f05fc105f13  yb::tablet::AbstractTablet::HandlePgsqlReadRequest()
    @     0x7f05fc13f3a9  yb::tablet::Tablet::HandlePgsqlReadRequest()
    @     0x7f05fcac5596  yb::tserver::TabletServiceImpl::DoReadImpl()
    @     0x7f05fcac664c  yb::tserver::TabletServiceImpl::DoRead()
    @     0x7f05fcac6998  yb::tserver::TabletServiceImpl::CompleteRead()
    @     0x7f05fcac8a3f  yb::tserver::TabletServiceImpl::Read()
    @     0x7f05f941d25e  yb::tserver::TabletServerServiceIf::Handle()
    @     0x7f05f3985fa9  yb::rpc::ServicePoolImpl::Handle()
    @     0x7f05f3929444  yb::rpc::InboundCall::InboundCallTask::Run()
    @     0x7f05f39984c8  yb::rpc::(anonymous namespace)::Worker::Execute()
    @     0x7f05f3587aef  yb::Thread::SuperviseThread()
    @     0x7f05ed82c694  start_thread
    @     0x7f05ecf6941d  __clone
    @              (nil)  (unknown)

INFO log

2021-10-01 08:21:39.928 UTC [14590] ERROR:  operator does not exist: bit >> bit at character 114
2021-10-01 08:21:39.928 UTC [14590] HINT:  No operator matches the given name and argument types. You might need to add explicit type casts.
2021-10-01 08:21:39.928 UTC [14590] STATEMENT:  SELECT ALL t3.c0 FROM t3* RIGHT OUTER JOIN (SELECT CAST(0.3824113 AS INT), ((((((((B'10010010100110011100101011')>>(B'1111110000000111001000101011100')))||(((B'1111111111111111111111111111111110001111011111101001100011000000')||(B'110100011011101101101001011000')))))||(((((B'111000101000101111100000111101')>>(B'1111111111111111111111111111111110111101010000111101101101111100')))<<(((B'1111111111111111111111111111111110011001100010001000100110100100')||(B'1111111111111111111111111111111110110100000101001001100001000010')))))))&(((((((B'1111111111111111111111111111111110111000110001100101010111100001')|(B'1110011110011111110000000000')))|(((NULL)<<(B'1111111111111111111111111111111110010101100101110011011100000011')))))#(((((B'100000000111111011000000000011')||(B'1110110000010110001011000001111')))||(((B'1111111111111111111111111111111110011010110111001101011101001001')#(B'1010111101001110101100111001011')))))))) FROM t0*) AS sub0 ON inet_same_family('169.94.63.48', '84.19.62.145') WHERE 'ON'
E1001 08:21:39.931282 14590 pg_expr.cc:175] No supported Sum TSOpcode for operand type: 10
2021-10-01 08:21:40.262 UTC [12751] LOG:  received fast shutdown request
2021-10-01 08:21:40.263 UTC [12751] LOG:  aborting any active transactions
2021-10-01 08:21:40.263 UTC [12782] FATAL:  terminating background worker "YSQL webserver" due to administrator command
I1001 08:21:40.125100 13296 raft_consensus.cc:3178] T e9ea9bcc1c67405dae24e19195993aac P 4334c19ef24d4a7cbc725c0d4b5d9f64 [term 1 FOLLOWER]: Calling mark dirty synchronously for reason code NEW_LEADER_ELECTED
I1001 08:21:40.125227 13296 replica_state.cc:1095] T e9ea9bcc1c67405dae24e19195993aac P 4334c19ef24d4a7cbc725c0d4b5d9f64 [term 1 FOLLOWER]: Reset our lease: 2467.881s
I1001 08:21:40.132485 14245 raft_consensus.cc:3178] T e9ea9bcc1c67405dae24e19195993aac P 4334c19ef24d4a7cbc725c0d4b5d9f64 [term 1 FOLLOWER]: Calling mark dirty synchronously for reason code FOLLOWER_NO_OP_COMPLETE
I1001 08:21:40.251138 12042 tcp_stream.cc:321] { local: 172.151.62.12:43829 remote: 172.151.28.17:9100 }:  Recv failed: Network error (yb/util/net/socket.cc:557): recvmsg error: Connection reset by peer (system error 104)
@qvad qvad added the area/ysql Yugabyte SQL (YSQL) label Oct 1, 2021
@qvad qvad changed the title SQLancer: Constant server restart during evaluating workload SQLancer: Server restarts during evaluating workload Oct 1, 2021
@m-iancu m-iancu added the kind/bug This issue is a bug label Oct 6, 2021
@m-iancu m-iancu added this to Backlog in YSQL via automation Oct 6, 2021
@m-iancu m-iancu added the priority/medium Medium priority issue label Oct 6, 2021
@yugabyte-ci yugabyte-ci added the kind/failing-test Tests and testing infra label Oct 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ysql Yugabyte SQL (YSQL) kind/bug This issue is a bug kind/failing-test Tests and testing infra priority/medium Medium priority issue
Projects
Status: No status
YSQL
  
Backlog
Development

No branches or pull requests

3 participants