Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Public internal #17

Merged
merged 1 commit into from
Feb 4, 2021
Merged

Public internal #17

merged 1 commit into from
Feb 4, 2021

Conversation

alungu
Copy link

@alungu alungu commented Nov 10, 2020

Q A
Bug fix? no
New feature? no
API breaks? no
Deprecations? no
Related tickets fixes #X, partially #Y, mentioned in #Z
License Apache 2.0

What's in this PR?

Why?

Additional context

Checklist

  • Implementation tested
  • Error handling code meets the guideline
  • Logging code meets the guideline
  • User guide and development docs updated (if needed)

To Do

  • If the PR is not complete but you want to discuss the approach, list what remains to be done here

@alungu alungu added the WIP Work in progress - do not merge label Jan 13, 2021
@alungu alungu merged commit 2377eef into master Feb 4, 2021
@alungu alungu removed the WIP Work in progress - do not merge label Feb 4, 2021
@alungu alungu deleted the public-internal branch February 4, 2021 13:21
aguzovatii pushed a commit to aguzovatii/koperator that referenced this pull request Mar 22, 2023
aguzovatii pushed a commit to aguzovatii/koperator that referenced this pull request Mar 22, 2023
aguzovatii pushed a commit to aguzovatii/koperator that referenced this pull request Mar 23, 2023
ctrlaltluc added a commit that referenced this pull request May 19, 2023
* [INTERNAL] [BUILD] Publish docker images to adobe/kafka-operator and adobe/kafka docker hub repos

- build the koperator docker image
- build Apache kafka docker image
When `kafka-*` tags are created a github action is triggered
to build and push a new adobe/kafka docker image version

* [INTERNAL] make manifests should be called manually, if needed (#25)

We made some chnages for spinnaker annotations and `preserveUnknownFields` that would be overriden by `make manifests`

* [INTERNAL] Allow Kafka to use External DNS for inter-broker protocol (#17) (#22)

* [INTERNAL] Allow external listeners to be used for inner communication (#26)

* [INTERNAL] Ensure external listerners are always the first the advertised.listeners configuration

This is needed for old clients connecting to kafka through Zookeeper that does not have a way
to infer the right listener.
In this case, the first listener in the advertised.listener config is used to connect to brokers.
This patch ensures the external listeners (those reachable from outside) are listed before internal ones

* [INTERNAL] Generate CRDs resources

* [INTERNAL] Upgrade to Kafka 2.8.1 (#36)

* Enable envoy idleTimeout and TCP keep-alive for connections to kafka and clients

1/ Kafka broker defines connections.max.idle.ms=600s
To ensure envoy as a client for kafka broker is terminating
the connection first to avoid network disconnects
this patch is setting the idleTimeout to value slightly less
than that

2/ Enable tcp-keep alive for all TCP connections established by envoy to kafka
and to client (or fronting Load Balancer)

* Enable envoy tls termination (#41)

* [INTERNAL] Build kafka 3.1.1 using Oracle OpenJDK

* Envoy config generated by the operator is invalid in envoy 1.22


Added explicit typeconfig for envoy.filters.http.router

```
[2022-06-16 13:27:58.425][1][info][main] [source/server/server.cc:939] exiting
Didn't find a registered implementation for 'envoy.filters.http.router' with type URL: ''
```

* Added TaintedBrokersSelector to kafkaClusterSpec (#48)

Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>

* Build kafka 3.2.2

* Upgrade kafka to 3.2.3

* Upgrade kafka to 3.3.1

* [Internal] Update helm for adobe builds (#52)

* [INTERNAL] Use local replacement for sub-modules (#54)

As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.

* Upgrade kafka to 3.4.0

---------

Co-authored-by: Adi Muraru <amuraru@adobe.com>
Co-authored-by: Adrian Lungu <adrian.lungu89@gmail.com>
Co-authored-by: Razvan Dobre <dobre.razvan@gmail.com>
Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>
Co-authored-by: Adrian Coman <acoman@adobe.com>
Co-authored-by: aguzovatii <guzovatii.anatolii@gmail.com>
ctrlaltluc added a commit that referenced this pull request Jun 8, 2023
* [INTERNAL] [BUILD] Publish docker images to adobe/kafka-operator and adobe/kafka docker hub repos

- build the koperator docker image
- build Apache kafka docker image
When `kafka-*` tags are created a github action is triggered
to build and push a new adobe/kafka docker image version

* [INTERNAL] make manifests should be called manually, if needed (#25)

We made some chnages for spinnaker annotations and `preserveUnknownFields` that would be overriden by `make manifests`

* [INTERNAL] Allow Kafka to use External DNS for inter-broker protocol (#17) (#22)

* [INTERNAL] Allow external listeners to be used for inner communication (#26)

* [INTERNAL] Ensure external listerners are always the first the advertised.listeners configuration

This is needed for old clients connecting to kafka through Zookeeper that does not have a way
to infer the right listener.
In this case, the first listener in the advertised.listener config is used to connect to brokers.
This patch ensures the external listeners (those reachable from outside) are listed before internal ones

* [INTERNAL] Generate CRDs resources

* [INTERNAL] Upgrade to Kafka 2.8.1 (#36)

* Enable envoy idleTimeout and TCP keep-alive for connections to kafka and clients

1/ Kafka broker defines connections.max.idle.ms=600s
To ensure envoy as a client for kafka broker is terminating
the connection first to avoid network disconnects
this patch is setting the idleTimeout to value slightly less
than that

2/ Enable tcp-keep alive for all TCP connections established by envoy to kafka
and to client (or fronting Load Balancer)

* Enable envoy tls termination (#41)

* [INTERNAL] Build kafka 3.1.1 using Oracle OpenJDK

* Envoy config generated by the operator is invalid in envoy 1.22


Added explicit typeconfig for envoy.filters.http.router

```
[2022-06-16 13:27:58.425][1][info][main] [source/server/server.cc:939] exiting
Didn't find a registered implementation for 'envoy.filters.http.router' with type URL: ''
```

* Added TaintedBrokersSelector to kafkaClusterSpec (#48)

Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>

* Build kafka 3.2.2

* Upgrade kafka to 3.2.3

* Upgrade kafka to 3.3.1

* [Internal] Update helm for adobe builds (#52)

* [INTERNAL] Use local replacement for sub-modules (#54)

As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.

* Upgrade kafka to 3.4.0

---------

Co-authored-by: Adi Muraru <amuraru@adobe.com>
Co-authored-by: Adrian Lungu <adrian.lungu89@gmail.com>
Co-authored-by: Razvan Dobre <dobre.razvan@gmail.com>
Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>
Co-authored-by: Adrian Coman <acoman@adobe.com>
Co-authored-by: aguzovatii <guzovatii.anatolii@gmail.com>
ctrlaltluc added a commit that referenced this pull request Jun 8, 2023
* [INTERNAL] [BUILD] Publish docker images to adobe/kafka-operator and adobe/kafka docker hub repos

- build the koperator docker image
- build Apache kafka docker image
When `kafka-*` tags are created a github action is triggered
to build and push a new adobe/kafka docker image version

* [INTERNAL] make manifests should be called manually, if needed (#25)

We made some chnages for spinnaker annotations and `preserveUnknownFields` that would be overriden by `make manifests`

* [INTERNAL] Allow Kafka to use External DNS for inter-broker protocol (#17) (#22)

* [INTERNAL] Allow external listeners to be used for inner communication (#26)

* [INTERNAL] Ensure external listerners are always the first the advertised.listeners configuration

This is needed for old clients connecting to kafka through Zookeeper that does not have a way
to infer the right listener.
In this case, the first listener in the advertised.listener config is used to connect to brokers.
This patch ensures the external listeners (those reachable from outside) are listed before internal ones

* [INTERNAL] Generate CRDs resources

* [INTERNAL] Upgrade to Kafka 2.8.1 (#36)

* Enable envoy idleTimeout and TCP keep-alive for connections to kafka and clients

1/ Kafka broker defines connections.max.idle.ms=600s
To ensure envoy as a client for kafka broker is terminating
the connection first to avoid network disconnects
this patch is setting the idleTimeout to value slightly less
than that

2/ Enable tcp-keep alive for all TCP connections established by envoy to kafka
and to client (or fronting Load Balancer)

* Enable envoy tls termination (#41)

* [INTERNAL] Build kafka 3.1.1 using Oracle OpenJDK

* Envoy config generated by the operator is invalid in envoy 1.22


Added explicit typeconfig for envoy.filters.http.router

```
[2022-06-16 13:27:58.425][1][info][main] [source/server/server.cc:939] exiting
Didn't find a registered implementation for 'envoy.filters.http.router' with type URL: ''
```

* Added TaintedBrokersSelector to kafkaClusterSpec (#48)

Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>

* Build kafka 3.2.2

* Upgrade kafka to 3.2.3

* Upgrade kafka to 3.3.1

* [Internal] Update helm for adobe builds (#52)

* [INTERNAL] Use local replacement for sub-modules (#54)

As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.

* Upgrade kafka to 3.4.0

---------

Co-authored-by: Adi Muraru <amuraru@adobe.com>
Co-authored-by: Adrian Lungu <adrian.lungu89@gmail.com>
Co-authored-by: Razvan Dobre <dobre.razvan@gmail.com>
Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>
Co-authored-by: Adrian Coman <acoman@adobe.com>
Co-authored-by: aguzovatii <guzovatii.anatolii@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants