Skip to content

Commit

Permalink
[SPARK-42333][SQL] Change log level to debug when fetching result set…
Browse files Browse the repository at this point in the history
… from SparkExecuteStatementOperation

### What changes were proposed in this pull request?

Change log level from info to debug when fetching result set from `SparkExecuteStatementOperation`.

### Why are the changes needed?

Avoid generating too many logs:
<img width="1230" alt="image" src="https://user-images.githubusercontent.com/5399861/216561187-6ad00458-d196-4f3a-a314-b2f309aec482.png">

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Unit test.

Closes apache#39876 from wangyum/SPARK-42333.

Authored-by: Yuming Wang <yumwang@ebay.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
  • Loading branch information
wangyum authored and pull[bot] committed Jun 17, 2024
1 parent 424af07 commit 2427438
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -96,7 +96,7 @@ private[hive] class SparkExecuteStatementOperation(
private def getNextRowSetInternal(
order: FetchOrientation,
maxRowsL: Long): TRowSet = withLocalProperties {
log.info(s"Received getNextRowSet request order=${order} and maxRowsL=${maxRowsL} " +
log.debug(s"Received getNextRowSet request order=${order} and maxRowsL=${maxRowsL} " +
s"with ${statementId}")
validateDefaultFetchOrientation(order)
assertState(OperationState.FINISHED)
Expand All @@ -112,7 +112,7 @@ private[hive] class SparkExecuteStatementOperation(
val maxRows = maxRowsL.toInt
val offset = iter.getPosition
val rows = iter.take(maxRows).toList
log.info(s"Returning result set with ${rows.length} rows from offsets " +
log.debug(s"Returning result set with ${rows.length} rows from offsets " +
s"[${iter.getFetchStart}, ${offset}) with $statementId")
RowSetUtils.toTRowSet(offset, rows, dataTypes, getProtocolVersion, getTimeFormatters)
}
Expand Down

0 comments on commit 2427438

Please sign in to comment.