Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disappearing data #25

Closed
qbazd opened this issue Jan 13, 2019 · 0 comments
Closed

Disappearing data #25

qbazd opened this issue Jan 13, 2019 · 0 comments
Assignees
Labels
bug Something isn't working
Projects

Comments

@qbazd
Copy link

qbazd commented Jan 13, 2019

Hi all.

I've been playing with this module mainly for stats with Grafana.
I'm getting some strange behaviour.
As data come, reading older data is being unavailable.

My test environment is Redis 5.0.3 (compiled from source).

My test case is to write timeseries of values (time is 0 to sample_len with values of time).
After writing time series. Read whole as smaller overlapping chunks.

I'm expecting to read same chunk size (except for the end of course).
With the first value as beginning of chunk.

I've simplified test to below python source:

import redis

sample_len = 1024
chunk_size = 4
read_chunk_size = 10
shift = 0

REDIS_POOL = redis.ConnectionPool(host='127.0.0.1', port=10302)
redis_client = redis.Redis(connection_pool=REDIS_POOL)

redis_client.delete("test_key")

redis_client.execute_command("ts.create", 'test_key', 0, chunk_size)

for i in range(sample_len):
  redis_client.execute_command("ts.add", 'test_key', i , i)

for i in range(sample_len):
  s = i + shift 
  var = redis_client.execute_command(*['ts.range', 'test_key', s, s + read_chunk_size-1])

  if len(var) > 0:
    print([i, len(var), int(var[0][1])])
  else:
    print([i, 0, "should be " + str(i)])

The example output is:

[0, 4, 0]
[1, 0, 'should be 1']
[2, 0, 'should be 2']
[3, 0, 'should be 3']
[4, 4, 4]
[5, 0, 'should be 5']
[6, 0, 'should be 6']
[7, 0, 'should be 7']
[8, 4, 8]
[9, 0, 'should be 9']
[10, 0, 'should be 10']
[11, 0, 'should be 11']
...
[764, 4, 764]
[765, 0, 'should be 765']
[766, 0, 'should be 766']
[767, 0, 'should be 767']
[768, 10, 768]
[769, 10, 769]
[770, 10, 770]
[771, 10, 771]
[772, 10, 772]
...
[1014, 10, 1014]
[1015, 9, 1015]
[1016, 8, 1016]
[1017, 7, 1017]
[1018, 6, 1018]
[1019, 5, 1019]
[1020, 4, 1020]
[1021, 3, 1021]
[1022, 2, 1022]
[1023, 1, 1023]

I've done tests with branch "master".
Also tested "labels" branch as there was some issues solved, but no luck (diffrent output).

When I do same test in a single loop it works as expected.

What to you think of this?

Best regards.

danni-m added a commit that referenced this issue Jan 27, 2019
@gkorland gkorland added this to To do in 0.1.0 via automation Feb 17, 2019
@gkorland gkorland moved this from To do to Done in 0.1.0 Feb 17, 2019
@gkorland gkorland added the bug Something isn't working label Feb 17, 2019
rafie added a commit that referenced this issue Sep 4, 2019
rafie added a commit that referenced this issue Sep 5, 2019
rafie added a commit that referenced this issue Sep 5, 2019
* CircleCI: build multiarch docker image

* CircleCI: build multiarch docker image #2

* CircleCI: build multiarch docker image #3

* CircleCI: build multiarch docker image #4

* CircleCI: build multiarch docker image #5

* CircleCI: build multiarch docker image #6

* CircleCI: build multiarch docker image #7

* CircleCI: build multiarch docker image #8

* CircleCI: build multiarch docker image #9

* CircleCI: build multiarch docker image #10

* CircleCI: build multiarch docker image #11

* CircleCI: build multiarch docker image #12

* CircleCI: build multiarch docker image #13

* CircleCI: build multiarch docker image #14

* CircleCI: build multiarch docker image #15

* CircleCI: build multiarch docker image #16

* CircleCI: build multiarch docker image #17

* CircleCI: build multiarch docker image #18

* CircleCI: build multiarch docker image #19

* CircleCI: build multiarch docker image #20

* CircleCI: build multiarch docker image #21

* CircleCI: build multiarch docker image #22

* CircleCI: build multiarch docker image #23

* CircleCI: build multiarch docker image #24

* CircleCI: build multiarch docker image #25

* CircleCI: build multiarch docker image #26

* CircleCI: build multiarch docker image #27

* CircleCI: build multiarch docker image #28

* CircleCI: build multiarch docker image

* CircleCI: build multiarch docker image #2

* CircleCI: build multiarch docker image #3

* CircleCI: build multiarch docker image #4

* CircleCI: build multiarch docker image #5

* CircleCI: build multiarch docker image #6

* CircleCI: build multiarch docker image #7

* CircleCI: build multiarch docker image #8

* CircleCI: build multiarch docker image #9

* CircleCI: build multiarch docker image #10

* CircleCI: build multiarch docker image #11

* CircleCI: build multiarch docker image #12

* CircleCI: build multiarch docker image #13

* CircleCI: build multiarch docker image #14

* CircleCI: build multiarch docker image #15

* CircleCI: build multiarch docker image #16

* CircleCI: build multiarch docker image #17

* CircleCI: build multiarch docker image #18

* CircleCI: build multiarch docker image #19

* CircleCI: build multiarch docker image #20

* CircleCI: build multiarch docker image #21

* CircleCI: build multiarch docker image #22

* CircleCI: build multiarch docker image #23

* CircleCI: build multiarch docker image #24

* CircleCI: build multiarch docker image #25

* CircleCI: build multiarch docker image #26

* CircleCI: build multiarch docker image #27

* CircleCI: build multiarch docker image #28

* Readies sync
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
No open projects
0.1.0
  
Done
Development

No branches or pull requests

3 participants