[IOTDB-2740] Equal size bucket sampling UDFs: EQUAL_SIZE_BUCKET_RANDOM_SAMPLE, EQUAL_SIZE_BUCKET_AGG_SAMPLE, EQUAL_SIZE_BUCKET_M4_SAMPLE #5518
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
server/src/main/java/org/apache/iotdb/db/query/udf/builtin/UDTFEqualSizeBucketSample.java
Outdated
Show resolved
Hide resolved
server/src/main/java/org/apache/iotdb/db/query/udf/builtin/UDTFEqualSizeBucketSample.java
Outdated
Show resolved
Hide resolved
Comment on lines
58
to
62
| double sum = 0; | ||
| for (int i = 0; i < windowSize; i++) { | ||
| sum += rowWindow.getRow(i).getInt(0) * 1.0 / windowSize; | ||
| } | ||
| collector.putDouble(time, sum); |
There was a problem hiding this comment.
Suggested change
| double sum = 0; | |
| for (int i = 0; i < windowSize; i++) { | |
| sum += rowWindow.getRow(i).getInt(0) * 1.0 / windowSize; | |
| } | |
| collector.putDouble(time, sum); | |
| double sum = 0; | |
| for (int i = 0; i < windowSize; i++) { | |
| sum += rowWindow.getRow(i).getInt(0); | |
| } | |
| collector.putDouble(time, sum / windowSize); |
|
|
||
| #### 等数量分桶聚合采样 | ||
|
|
||
| 采用聚合采样法对输入序列进行采样，用户需要另外提供一个聚合函数参数即 |
There was a problem hiding this comment.
说一下每个桶输出的时间的行为（每个桶采样输出的时间戳为第一个点的时间戳）
Comment on lines
348
to
355
| double avg = 0, sum = 0; | ||
| for (int i = 0; i < windowSize; i++) { | ||
| avg += rowWindow.getRow(i).getInt(0) * 1.0 / windowSize; | ||
| } | ||
| for (int i = 0; i < windowSize; i++) { | ||
| sum += (rowWindow.getRow(i).getInt(0) - avg) * (rowWindow.getRow(i).getInt(0) - avg); | ||
| } | ||
| collector.putDouble(time, sum / windowSize); |
There was a problem hiding this comment.
Suggested change
| double avg = 0, sum = 0; | |
| for (int i = 0; i < windowSize; i++) { | |
| avg += rowWindow.getRow(i).getInt(0) * 1.0 / windowSize; | |
| } | |
| for (int i = 0; i < windowSize; i++) { | |
| sum += (rowWindow.getRow(i).getInt(0) - avg) * (rowWindow.getRow(i).getInt(0) - avg); | |
| } | |
| collector.putDouble(time, sum / windowSize); | |
| double avg = 0, sum = 0; | |
| for (int i = 0; i < windowSize; i++) { | |
| avg += rowWindow.getRow(i).getInt(0); | |
| } | |
| avg /= windowSize; | |
| for (int i = 0; i < windowSize; i++) { | |
| int delta = rowWindow.getRow(i).getInt(0) - avg; | |
| sum += delta * delta; | |
| } | |
| collector.putDouble(time, sum / windowSize); |
SteveYurongSu
changed the title
xinzhongtianxia
pushed a commit
to xinzhongtianxia/iotdb
that referenced
this pull request
Apr 24, 2022
* remotes/upstream/master: Serialize measurement schema of insert node to wal entry (apache#5638) filter non schemaRegionDir (apache#5640) [IOTDB-2976] Add English and Chinese docs for count devices and count storage groups (apache#5635) change jenkins timeout from 2 hours to 3 hours [IOTDB-2740] Equal size bucket sampling UDFs: EQUAL_SIZE_BUCKET_RANDOM_SAMPLE, EQUAL_SIZE_BUCKET_AGG_SAMPLE, EQUAL_SIZE_BUCKET_M4_SAMPLE (apache#5518) Fix the issue that EndTime in FragmentInstanceContext is not set (apache#5636) fix concurrent bug of CachedMNodeContainer.putIfAbsent (apache#5632) [IOTDB-2880] Fix NPE occured in ci test (apache#5634) Fix CI (apache#5639) Add ColumnMerger to merge multipul input columns of same sensor into one column (apache#5630) Add block cancel when GetBlockTask throws exception (apache#5628) fix the bug when matching multi-wildcard in pattern tree (apache#5631) [IOTDB-2835]Fix empty page in selfcheck method of TsFileSequenceReader (apache#5552) Add FragmentInstanceStateMachine for FragmentInstance State change (apache#5615) [IOTDB-2880] Fix import check style (apache#5629) [IOTDB-2971] Fix sink handle memory leak (apache#5626) [rocksdb] updated the interface support (apache#5625) [IOTDB-2970] Code style: Avoid wildcard imports (apache#5622) [IOTDB-2880]Add procedure framework (apache#5477) [rocksdb] add rocksdb properties (apache#5588) # Conflicts: # server/src/main/java/org/apache/iotdb/db/mpp/sql/planner/LocalExecutionPlanner.java
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Add EqualBucketSample in UDF
This PR has:
for an unfamiliar reader.
for code coverage.
Key changed/added classes (or packages if there are too many classes) in this PR