Closed
Description
Description
As seen in 5918 dask training doesn't work on windows with a local cluster.
Reproducible example
cluster = LocalCluster() # Fully-featured local Dask cluster
client = cluster.get_client()
X, y = make_classification(n_samples=10000, n_features=20, n_informative=15, random_state=42)
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=42)
chunk_size = 1000
X_train_dask = da.from_array(X_train, chunks=(chunk_size, X_train.shape[1]))
y_train_dask = da.from_array(y_train, chunks=(chunk_size,))
dask_lgbm = lgb.dask.DaskLGBMClassifier(
num_leaves=31,
learning_rate=0.05,
n_estimators=100,
#machines=machines_str,
client=client
)
dask_lgbm.fit(X_train_dask, y_train_dask)
client.close()
Environment info
LightGBM 4.6.0
pip install lightgbm