Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-29961][doc] Make referencing custom image clearer for Docker #20935

Open
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

liuml07
Copy link
Member

@liuml07 liuml07 commented Sep 30, 2022

What is the purpose of the change

Make referencing custom image clearer for Docker

Brief change log

Rephrase the words how to reference custom image when building with Docker standalone mode.
Also add example code.

Verifying this change

Please make sure both new and modified tests in this PR follows the conventions defined in our code quality guide: https://flink.apache.org/contributing/code-style-and-quality-common.html#testing

This change is a trivial rework / code cleanup without any test coverage.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (yes / no)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
  • The serializers: (yes / no / don't know)
  • The runtime per-record code paths (performance sensitive): (yes / no / don't know)
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know)
  • The S3 file system connector: (yes / no / don't know)

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@liuml07
Copy link
Member Author

liuml07 commented Sep 30, 2022

CC @knaufk @MartijnVisser

@flinkbot
Copy link
Collaborator

flinkbot commented Sep 30, 2022

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

Copy link
Contributor

@MartijnVisser MartijnVisser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@liuml07 Thanks for this, I do think we can improve it a bit more. Please have a look


```Dockerfile
FROM flink:{{< stable >}}{{< version >}}-scala{{< scala_version >}}{{< /stable >}}{{< unstable >}}latest{{< /unstable >}}
RUN wget -P /opt/flink/lib https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-kafka_2.12/{{< version >}}/flink-sql-connector-kafka_scala{{< scala_version >}}-{{< version >}}.jar
```

and reference it (e.g via the `build`) command in the Dockerfile.
and reference it (e.g via the `build`) command in the Dockerfile.
and reference this Dockerfile with the `build` command in the `docker-compose.yml` file.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps it better to actually display the build command that someone needs to type?

Copy link
Member Author

@liuml07 liuml07 Oct 28, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated the doc. After building the doc screenshot is like:
Screenshot 2022-10-27 at 10 20 50 PM

@liuml07 liuml07 force-pushed the minor-standalon-docker.md branch 2 times, most recently from 0f153d2 to 1212fef Compare October 28, 2022 05:20
@liuml07 liuml07 changed the title [hotfix][doc] Make referencing custom image clearer for Docker [FLINK-29961][doc] Make referencing custom image clearer for Docker Nov 9, 2022
@liuml07
Copy link
Member Author

liuml07 commented Nov 9, 2022

This was a hotfix PR but since the latest change introduces some example code, I created a JIRA for it.

Copy link
Contributor

@MartijnVisser MartijnVisser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@roncohen Please also take my suggestion changes into account

@roncohen
Copy link
Contributor

You probably didn’t mean to mention me? ;) @MartijnVisser

@MartijnVisser
Copy link
Contributor

You probably didn’t mean to mention me? ;) @MartijnVisser

I honestly don't know how that happened but indeed, I didn't mean to tag you, apologies 😅

@MartijnVisser
Copy link
Contributor

@liuml07 Can you take my suggested changes into account?

liuml07 and others added 2 commits November 14, 2022 10:52
…docker.md

Co-authored-by: MartijnVisser <martijn@2symbols.com>
…docker.md

Co-authored-by: MartijnVisser <martijn@2symbols.com>

```Dockerfile
FROM flink:{{< stable >}}{{< version >}}-scala{{< scala_version >}}{{< /stable >}}{{< unstable >}}latest{{< /unstable >}}
RUN wget -P /opt/flink/lib https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-kafka_2.12/{{< version >}}/flink-sql-connector-kafka_scala{{< scala_version >}}-{{< version >}}.jar
RUN wget -P /opt/flink/lib https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-kafka/{{< version >}}/flink-sql-connector-kafka_scala-{{< version >}}.jar
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I found the Kafka connector is not including Scala version in the name. So I updated this as well.

@liuml07
Copy link
Member Author

liuml07 commented May 4, 2023

Hi @MartijnVisser could you take another look? Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants