pysparklyr 0.2.0

pysparklyr 0.2.0

Fixes

• Adds support for Pandas 3.0 conversion (#169)

• Properly converts Pandas columns to R (#165 - @romangehrn)

• Switches to using the configuration file in Posit Workbench to obtain the
  Databricks OAuth token. This guarantees that RMarkdown and Quarto documents
  that attempt to access a Databricks cluster are successful (#166)

Improvements

• Adds support for Databricks Viewer OAuth credentials.

• Adds support for Snowflake's Snowpark Connect.
  New method name is snowpark_connect.

• Adds support for new ML methodology implemented in Spark 4.0 (#153). Specific
  ML functions now supported are:

  • New in Spark 4.0
    • ml_generalized_linear_regression()
    • ml_isotonic_regression()
    • ml_gbt_classifier()
    • ml_gbt_regressor()
    • ml_aft_survival_regression()
    • ml_bisecting_kmeans()
    • ml_decision_tree_regressor()
    • ml_multiclass_classification_evaluator()
    • ml_regression_evaluator
    • ml_binary_classification_evaluator()
    • ml_clustering_evaluator()
    • ml_kmeans()
    • ml_decision_tree_classifier()
    • ml_cross_validator()
    • ft_word2vec()
    • ft_vector_slicer()
    • ft_vector_indexer()
    • ft_sql_transformer()
    • ft_robust_scaler()
    • ft_regex_tokenizer()
    • ft_quantile_discretizer()
    • ft_polynomial_expansion()
    • ft_pca()
    • ft_one_hot_encoder()
    • ft_ngram()
    • ft_minhash_lsh()
    • ft_min_max_scaler()
    • ft_index_to_string()
    • ft_imputer()
    • ft_idf()
    • ft_feature_hasher()
    • ft_elementwise_product()
    • ft_vector_assembler()
    • ft_dct() / ft_discrete_cosine_transform()
    • ft_bucketed_random_projection_lsh()
    • ft_count_vectorizer()
    • ml_linear_regression()
    • ml_random_forest_regressor()
    • ml_random_forest_classifier()
    • ft_string_indexer()
    • ft_tokenizer()
    • ft_stop_words_remover()
    • ft_hashing_tf()
    • ft_normalizer()
    • ft_binarizer()
    • ft_bucketizer()
    • ft_r_formula()
  • Updated for Spark 4.0
    • ml_logistic_regression()
    • ft_standard_scaler()
    • ft_max_abs_scaler()
    • ml_pipeline()
    • ml_save()

• Tests switch over to using uv for setup