[SPARK-44105][SQL] LastNonNull should be lazily resolved

[zhengruifeng]

What changes were proposed in this pull request?

LastNonNull should be lazily resolved

Why are the changes needed?

to fix https://github.com/apache/spark/pull/41670/files#r1234805869

Does this PR introduce any user-facing change?

no

How was this patch tested?

existing GA and manually check

[zhengruifeng]

manually check with #41670:

(spark_dev_309) ~/Dev/spark (interpolate ✗) bin/pyspark --remote "local[*]" 
Python 3.9.16 (main, Mar  8 2023, 04:29:24) 
Type 'copyright', 'credits' or 'license' for more information
IPython 8.13.2 -- An enhanced Interactive Python. Type '?' for help.
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
23/06/20 15:53:54 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /__ / .__/\_,_/_/ /_/\_\   version 3.5.0.dev0
      /_/

Using Python version 3.9.16 (main, Mar  8 2023 04:29:24)
Client connected to the Spark Connect server at localhost
SparkSession available as 'spark'.

In [1]: import pyspark.pandas as ps

In [2]: import numpy as np

In [3]: psser = ps.Series([1, np.nan, 3], name="a")

In [4]: psser.interpolate()
/Users/ruifeng.zheng/Dev/spark/python/pyspark/sql/connect/expressions.py:945: UserWarning: WARN WindowExpression: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
  warnings.warn(
Out[4]: 23/06/20 15:54:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
23/06/20 15:54:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
23/06/20 15:54:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
23/06/20 15:54:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
23/06/20 15:54:06 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
23/06/20 15:54:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
23/06/20 15:54:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
23/06/20 15:54:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.
23/06/20 15:54:07 WARN WindowExec: No Partition Defined for Window operation! Moving all data to a single partition, this can cause serious performance degradation.

0    1.0
1    2.0
2    3.0
Name: a, dtype: float64

[zhengruifeng]

cc @HyukjinKwon @itholic

[dongjoon-hyun]

+1, LGTM for Apache Spark 3.5.0.

[zhengruifeng]

@dongjoon-hyun @HyukjinKwon thank you for reviewing

[itholic]

Late review. Nice fix, thanks :-)