Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document example usage with PySpark #365

Open
XQ-UT opened this issue Dec 6, 2023 · 1 comment
Open

Document example usage with PySpark #365

XQ-UT opened this issue Dec 6, 2023 · 1 comment
Labels
documentation Improvements or additions to documentation

Comments

@XQ-UT
Copy link

XQ-UT commented Dec 6, 2023

Is your feature request related to a problem?

We have examples for Java/Scala in the usage page.

It will be great if we can have a usage example for PySpark in this page.

What solution would you like?

For elasticsearch usage, it is something like this

    df.write.format("org.elasticsearch.spark.sql").option(
        "es.nodes",
        es_url,
    ).option(
        "es.port", "443"
    ).option("es.nodes.wan.only", "true").option(
        "es.resource",
        es_index,
    ).option(
        "es.write.operation", "upsert"
    ).option(
        "es.mapping.id", "user_id"
    ).mode(
        "append"
    ).save()

Can we have something like this?

@XQ-UT XQ-UT added enhancement New feature or request untriaged labels Dec 6, 2023
@Xtansia Xtansia added documentation Improvements or additions to documentation and removed enhancement New feature or request untriaged labels Dec 6, 2023
@Xtansia Xtansia changed the title [FEATURE] Example usage for PySpark use case Document example usage with PySpark Dec 6, 2023
@Xtansia
Copy link
Collaborator

Xtansia commented Dec 6, 2023

Hi @XQ-UT, thanks for raising this issue!

There's an example that was provided in a previous question: #153 (comment)

So we basically just need to add this into the USER_GUIDE, if you're so inclined it'd be awesome if you wanted to make a PR contributing the doc update!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

2 participants