Result of gemini contains only 0

[aleksbykov]

If run several times to same nodes, gemini return results
{
"result": {
"write_ops": 0,
"write_errors": 0,
"read_ops": 0,
"read_errors": 0,
"errors": null
}
}
run next command: ./gemini -d --duration 60s -c 20 -p 100 -m mixed -f -v --test-cluster=34.201.251.194 --oracle-cluster=3.93.183.245
Version of gemini is 0.9.2
while debug log shows that there are a lot of operations:
INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (?,?,?,?,?,?,?,?,?,(?,?)) (values=[861 2010-10-14 831 aAQ1fWYPK map[udt_672245080_3:52 udt_672245080_0:X19J2m9kx udt_672245080_1:true udt_672245080_2:5594391364288805258] 2006-12-15 22:54:25 +0600 +06 0.812 c51db500-53ed-11d4-99b8-b06ebf2a6a60 map[false:14h17m0s true:14h22m0s] TavRBi29 859]) INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (?,?,?,?,?,?,?,?,?,(?,?)) (values=[561 2010-10-14 531 aAQ1fWzfc map[udt_672245080_0:XsJs udt_672245080_1:false udt_672245080_2:8730011856623748374 udt_672245080_3:5831394a326e684678] 2006-12-15 22:54:25 +0600 +06 0.512 c51db500-53ed-11d4-99b9-b06ebf2a6a60 map[false:9h17m0s true:9h22m0s] TavRBi7K 559]) INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (?,?,?,?,?,?,?,?,?,(?,?)) (values=[6 2010-10-14 31 aAQ1fRxcU map[udt_672245080_1:true udt_672245080_2:5594391364288805258 udt_672245080_3:52 udt_672245080_0:X19J2obzb] 2006-12-15 22:54:25 +0600 +06 0.012 c51db500-53ed-11d4-99ba-b06ebf2a6a60 map[true:1h2m0s false:57m0s] TavRBmqU 3]) INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (?,?,?,?,?,?,?,?,?,(?,?)) (values=[1061 2010-10-14 1031 aAQ1fUMZ1 map[udt_672245080_1:true udt_672245080_2:5594391364288805258 udt_672245080_3:52 udt_672245080_0:X19J2kB7o] 2006-12-15 22:54:25 +0600 +06 1.012 c51db500-53ed-11d4-99bb-b06ebf2a6a60 map[false:17h37m0s true:17h42m0s] TavRBnWw 1059]) INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (?,?,?,?,?,?,?,?,?,(?,?)) (values=[961 2010-10-14 931 aAQ1fTj4G map[udt_672245080_0:XsJs udt_672245080_1:false udt_672245080_2:8730011856623748374 udt_672245080_3:5831394a326d465349] 2006-12-15 22:54:25 +0600 +06 0.912 c51db500-53ed-11d4-99bc-b06ebf2a6a60 map[false:15h57m0s true:16h2m0s] TavRBjXB 959]) INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (?,?,?,?,?,?,?,?,?,(?,?)) (values=[1661 2010-10-14 1631 aAQ1fVynJ map[udt_672245080_2:8730011856623748374 udt_672245080_3:5831394a3270337261 udt_672245080_0:XsJs udt_672245080_1:false] 2006-12-15 22:54:25 +0600 +06 1.612 c51db500-53ed-11d4-99bd-b06ebf2a6a60 map[false:27h37m0s true:27h42m0s] TavRBl7O 1659]) INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (?,?,?,?,?,?,?,?,?,(?,?)) (values=[1961 2010-10-14 1931 aAQ1fVIYV map[udt_672245080_1:false udt_672245080_2:8730011856623748374 udt_672245080_3:5831394a326e45684a udt_672245080_0:XsJs] 2006-12-15 22:54:25 +0600 +06 1.912 c51db500-53ed-11d4-99be-b06ebf2a6a60 map[false:32h37m0s true:32h42m0s] TavRBggJ 1959]) SELECT * FROM ks1.table1 WHERE pk0 IN (?) AND col2=? (values=[0.416]) SELECT * FROM ks1.table1 WHERE pk0 IN (?) AND col2=? (values=[1.716]) SELECT * FROM ks1.table1 WHERE pk0 IN (?) AND col2=? (values=[0.716]) SELECT * FROM ks1.table1 WHERE pk0 IN (?) AND col2=? (values=[0.616]) { "result": { "write_ops": 0, "write_errors": 0, "read_ops": 0, "read_errors": 0, "errors": null } } Test run completed. Exiting.

[dahankzter]

Is any data inserted into the databases?

[aleksbykov]

looks yes
pk0 | ck0 | ck1 | ck2 | col0 | col1 | col2 | col3 | col4 | col5
------+------------+------+-----------+------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------------+-------+--------------------------------------+-------------------------------+---------------------
1765 | 2013-03-17 | 1778 | WmD | {udt_672245080_0: 'Twd', udt_672245080_1: True, udt_672245080_2: 7040682313413908320, udt_672245080_3: 0x35383532366536343534} | 2016-05-21 04:46:36.000000+0000 | 1.761 | 686eed00-166f-11d7-a216-b06ebf2a6a60 | {False: 29h26m, True: 28h54m} | ('TNL3', 1740)
1765 | 2014-05-25 | 1710 | SvC4uY7L | {udt_672245080_0: '1Z', udt_672245080_1: False, udt_672245080_2: 311121059771816610, udt_672245080_3: 0x353335613335363836393337} | 1993-02-18 07:10:14.000000+0000 | 1.779 | 27237100-0fcf-11d7-a374-b06ebf2a6a60 | {False: 29h6m, True: 29h55m} | ('QTHaAPz', 1728)
1580 | 1995-09-18 | 1527 | 2OHK8 | {udt_672245080_0: 'VlR2', udt_672245080_1: False, udt_672245080_2: 7440673863886515367, udt_672245080_3: 0x35383663333237393735} | 1991-07-13 21:19:33.000000+0000 | 1.517 | 8a7c0e00-6523-11ed-a25a-b06ebf2a6a60 | {True: 26h28m} | ('PrPWC', 1526)
114 | 2010-10-21 | 164 | SuSl98SzK | {udt_672245080_0: 'aHq', udt_672245080_1: False, udt_672245080_2: 6130137026520133808, udt_672245080_3: 0x3466373237373737343634613661} | 2004-09-05 20:04:27.000000+0000 | 0.149 | df9cc100-56c7-11c5-a0e7-b06ebf2a6a60 | {True: 2h18m} | ('T68it', 109)

[aleksbykov]

One important note, that test cluster and oracle cluster contains by 3 nodes

[dahankzter]

We are using the default consistency Quorum which should make that safe but who knows.

[dahankzter]

When I run locally it looks like this:

mutationJob: INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (592,'1987-03-20',565,'Pct8mXFpy',{udt_672245080_0:'aVNrs1tO'udt_672245080_1:falseudt_672245080_2:6388929652655115703udt_672245080_3:textasblob('3233736a36')},'1998-08-14T02:47:43+02:00',0.509,ee548d00-57b3-11d7-899f-1c4d704231dc,{%!s(bool=false):8h31m0s%!s(bool=true):8h39m0s},('Q1vfCm2E9',564))
validationJob: SELECT * FROM ks1.table1 WHERE pk0 IN (1392) AND ck0 = '1977-06-05' AND ck1 > 1317 AND ck1 < 2626
mutationJob: INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (1787,'1981-05-13',1718,'2EjDRbAlT',{udt_672245080_0:'a5OUV'udt_672245080_1:falseudt_672245080_2:3469870314288085957udt_672245080_3:textasblob('53627a344f51')},'1975-07-04T05:39:11+01:00',1.764,5de39600-bb6a-11d3-89a0-1c4d704231dc,{%!s(bool=true):29h16m0s%!s(bool=false):29h25m0s},('0iH4',1758))
mutationJob: INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (1402,'1978-01-11',1489,'YxOy',{udt_672245080_1:falseudt_672245080_2:5035778477977544371udt_672245080_3:textasblob('527056635530')udt_672245080_0:'O'},'1996-10-19T15:02:18+02:00',1.410,33ed3500-7550-11dd-89a1-1c4d704231dc,{%!s(bool=true):23h21m0s},('P2WU8VX',1472))
mutationJob: INSERT INTO ks1.table1 (pk0,ck0,ck1,ck2,col0,col1,col2,col3,col4,col5) VALUES (1507,'1974-09-04',1580,'1k6cNv',{udt_672245080_0:'SQa8Gtmf'udt_672245080_1:trueudt_672245080_2:313925748075977316udt_672245080_3:textasblob('56364a6b')},'2014-12-31T21:23:31+01:00',1.578,b6756080-5078-11b5-89a2-1c4d704231dc,{%!s(bool=true):25h3m0s%!s(bool=false):25h21m0s},('Vw',1570))
{
    "result": {
      "write_ops": 70755,
      "write_errors": 0,
      "read_ops": 39643,
      "read_errors": 0
    }
  }
Test run completed. Exiting.

Perhaps it is the clustered setup after all. What do you think @penberg ?

[dahankzter]

Does this happen all the time @aleksbykov or was it a one time thing?