Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dynamicFilterSplitsProcessed to OperatorStats #3217

Merged
merged 1 commit into from Mar 27, 2020

Conversation

raunaqmorarka
Copy link
Member

Exposing how many splits were processed with dynamic filter in table scan via OperatorContext and OperatorStats. (#3005)
E.g.:

{
      "stageId" : 1,
      "pipelineId" : 2,
      "operatorId" : 0,
      "planNodeId" : "355",
      "operatorType" : "ScanFilterAndProjectOperator",
      "totalDrivers" : 2002,
      "addInputCalls" : 662561,
      "addInputWall" : "11.32m",
      "addInputCpu" : "0.00ns",
      "physicalInputDataSize" : "48148296B",
      "physicalInputPositions" : 661815000,
      "internalNetworkInputDataSize" : "0B",
      "internalNetworkInputPositions" : 0,
      "rawInputDataSize" : "48148296B",
      "inputDataSize" : "3309072490B",
      "inputPositions" : 661815000,
      "sumSquaredInputPositions" : 1.023537125E15,
      "getOutputCalls" : 665179,
      "getOutputWall" : "21.65m",
      "getOutputCpu" : "24.25s",
      "outputDataSize" : "9265405160B",
      "outputPositions" : 661815000,
      "physicalWrittenDataSize" : "0B",
      "blockedWall" : "0.00ns",
      "finishCalls" : 0,
      "finishWall" : "0.00ns",
      "finishCpu" : "0.00ns",
      "userMemoryReservation" : "0B",
      "revocableMemoryReservation" : "0B",
      "systemMemoryReservation" : "0B",
      "peakUserMemoryReservation" : "0B",
      "peakSystemMemoryReservation" : "40278B",
      "peakRevocableMemoryReservation" : "0B",
      "peakTotalMemoryReservation" : "40278B",
      "spilledDataSize" : "0B",
      "dynamicFilterSplitsProcessed" : 2002
}

@sopel39 sopel39 merged commit ca1a69a into trinodb:master Mar 27, 2020
@sopel39 sopel39 mentioned this pull request Mar 27, 2020
8 tasks
@sopel39
Copy link
Member

sopel39 commented Mar 27, 2020

merged, thanks!

@raunaqmorarka raunaqmorarka deleted the df_stats branch March 27, 2020 17:03
@martint martint added this to the 332 milestone Apr 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

None yet

3 participants