Add pyspark
to add-ons options
#3073
Labels
Component: CLI
Issue/PR that addresses the CLI for Kedro
Milestone
Description
pyspark
should be added to the add-ons options, allowing users to get setup for pyspark (see #2506 (comment)). This option should make use of the newspaceflights-pyspark
starter: #2984When a user select
pyspark
they should get the config needed to run Kedro project with pyspark. This shouldn't include the example pipelines. This will happen in a follow up ticket.Possible Implementation
This solution is likely going to be the same as for the other
add-ons
work, leveraging the post-project hooks. Since we'd use the spaceflights-pyspark starter and not the regular template, we probably need to copy some of the logic from the post-project hook in the regular template to the starter.Possible Alternatives
N/A
The text was updated successfully, but these errors were encountered: