Add ft_robust_scaler

[zero323]

This PR add ft_robust_scaler as a wrapper for RobustScaler ‒ SPARK-28399 ‒ that

RobustScaler removes the median and scales the data according to the quantile range.

It is applicable for Spark >= 3.0.0

Signed-off-by: zero323 mszymkiewicz@gmail.com

[zero323]

It seems like build on master is older than apache/spark@bb47870

Context: ml feature robust scaler
ft_robust_scaler() works properly: error: java.lang.IllegalArgumentException: invalid method setRelativeError for object 14691/org.apache.spark.ml.feature.RobustScaler fields 0 selected 0
	at sparklyr.Invoke.invoke(invoke.scala:174)
	at sparklyr.StreamHandler.handleMethodCall(stream.scala:122)
	at sparklyr.StreamHandler.read(stream.scala:65)
	at sparklyr.BackendHandler.channelRead0(handler.scala:53)
	at sparklyr.BackendHandler.channelRead0(handler.scala:12)
	at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:328)
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:302)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:352)
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1422)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:374)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:360)
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:931)
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:700)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:635)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:552)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:514)
	at io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1044)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:834) 
  callstack:

[zero323]

It doesn't seem like this can ever happen, but since this pattern is repeated all over the code base, I'll keep it for consistency.

[falaki]

Databricks Connect tests failed. View logs here.

[yitao-li]

@zero323 Nice! Looks like you fixed the build failure and the change looks good to me.

Would you mind signing off your 3 commits (by running git rebase -S -i HEAD~3 where -S means "sign-off") followed by git push --force? Commits being signed off is typically required for contributing to sparklyr.

Once you signed off all your commits the "DCO check" should pass, and then we can merge your commits into master.

[yitao-li]

@zero323 ^^ Nah actually never mind. No need to rebase manually. I'll just append the correct sign-off-by field to your commit message which would be easier.

Thanks for contributing to sparklyr!!

[zero323]

Thanks @falaki and @yitao-li.