a optimize for realtime query

[haike1363]

hi opentsdb is very good
recently I met a problem:
I want query recently 10 seconds data, example startTime=2017/01/23 19:59:49 endTime=2017/01/23 19:59:59, HBase will return 【 2017/01/23 19:00:00~2017/01/23 19:59:59 】 data, so if more querys the network is full
I slove this problem by set Scanner timeRange
step1:set PutRequest's timestamp
step2:set Scanner timestamp range
if(enable_time_filter_begin) {
scanner.setMinTimestamp(startTime-1);
}
if(enable_time_filter_end) {
scanner.setMaxTimestamp(endTime+1);
}
it make network 100MB/S to little than 10MB/s, it works good

if you add this feature to opentsdb, all the world will be happy!
Looking forward to your reply, best wishes!

[manolama]

Hi, could you paste the config for your TSDB table in HBase? You can try setting the table config to VERSIONS = 1. The max and min timestamps refer to the column times and should rarely be an issue unless:

a) You have TSD compactions enabled and have multiple TSDs running and re-compacting the same row
b) The same data points (same timestamp) are being written multiple times so that there are multiple versions of the column.

Do either of those situations apply?

[IDerr]

Hi, @haike1363
if you question has been answered, could you please close this issue ?

Thanks