Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use local replacement for sub-modules #54

Merged

Conversation

aguzovatii
Copy link

Q A
Bug fix? yes?
New feature? no
API breaks? no
Deprecations? no
Related tickets
License Apache 2.0

What's in this PR?

As part of #929, the local replacement for sub-modules was removed in favor of using valid tags.

Adobe Koperator fork has some internal changes in the api sub-module, so we need to use the local version of the sub-module instead of the upstream version, this forces us to revert the changes from #929.

Why?

Additional context

Checklist

  • Implementation tested
  • Error handling code meets the guideline
  • Logging code meets the guideline
  • User guide and development docs updated (if needed)

To Do

  • If the PR is not complete but you want to discuss the approach, list what remains to be done here

As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.
alex-necula
alex-necula previously approved these changes Mar 28, 2023
@alex-necula
Copy link

alex-necula commented Mar 28, 2023

LGTM

@alex-necula alex-necula dismissed their stale review March 28, 2023 10:38

different proposal

@alex-necula alex-necula mentioned this pull request Mar 28, 2023
5 tasks
@aguzovatii aguzovatii merged commit b1a745e into master Apr 6, 2023
@aguzovatii aguzovatii deleted the aguzovatii/Use_local_replacement_for_sub_modules branch April 6, 2023 13:04
amuraru pushed a commit that referenced this pull request May 16, 2023
As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.
ctrlaltluc added a commit that referenced this pull request May 19, 2023
* [INTERNAL] [BUILD] Publish docker images to adobe/kafka-operator and adobe/kafka docker hub repos

- build the koperator docker image
- build Apache kafka docker image
When `kafka-*` tags are created a github action is triggered
to build and push a new adobe/kafka docker image version

* [INTERNAL] make manifests should be called manually, if needed (#25)

We made some chnages for spinnaker annotations and `preserveUnknownFields` that would be overriden by `make manifests`

* [INTERNAL] Allow Kafka to use External DNS for inter-broker protocol (#17) (#22)

* [INTERNAL] Allow external listeners to be used for inner communication (#26)

* [INTERNAL] Ensure external listerners are always the first the advertised.listeners configuration

This is needed for old clients connecting to kafka through Zookeeper that does not have a way
to infer the right listener.
In this case, the first listener in the advertised.listener config is used to connect to brokers.
This patch ensures the external listeners (those reachable from outside) are listed before internal ones

* [INTERNAL] Generate CRDs resources

* [INTERNAL] Upgrade to Kafka 2.8.1 (#36)

* Enable envoy idleTimeout and TCP keep-alive for connections to kafka and clients

1/ Kafka broker defines connections.max.idle.ms=600s
To ensure envoy as a client for kafka broker is terminating
the connection first to avoid network disconnects
this patch is setting the idleTimeout to value slightly less
than that

2/ Enable tcp-keep alive for all TCP connections established by envoy to kafka
and to client (or fronting Load Balancer)

* Enable envoy tls termination (#41)

* [INTERNAL] Build kafka 3.1.1 using Oracle OpenJDK

* Envoy config generated by the operator is invalid in envoy 1.22


Added explicit typeconfig for envoy.filters.http.router

```
[2022-06-16 13:27:58.425][1][info][main] [source/server/server.cc:939] exiting
Didn't find a registered implementation for 'envoy.filters.http.router' with type URL: ''
```

* Added TaintedBrokersSelector to kafkaClusterSpec (#48)

Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>

* Build kafka 3.2.2

* Upgrade kafka to 3.2.3

* Upgrade kafka to 3.3.1

* [Internal] Update helm for adobe builds (#52)

* [INTERNAL] Use local replacement for sub-modules (#54)

As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.

* Upgrade kafka to 3.4.0

---------

Co-authored-by: Adi Muraru <amuraru@adobe.com>
Co-authored-by: Adrian Lungu <adrian.lungu89@gmail.com>
Co-authored-by: Razvan Dobre <dobre.razvan@gmail.com>
Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>
Co-authored-by: Adrian Coman <acoman@adobe.com>
Co-authored-by: aguzovatii <guzovatii.anatolii@gmail.com>
ctrlaltluc pushed a commit that referenced this pull request Jun 8, 2023
As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.
ctrlaltluc added a commit that referenced this pull request Jun 8, 2023
* [INTERNAL] [BUILD] Publish docker images to adobe/kafka-operator and adobe/kafka docker hub repos

- build the koperator docker image
- build Apache kafka docker image
When `kafka-*` tags are created a github action is triggered
to build and push a new adobe/kafka docker image version

* [INTERNAL] make manifests should be called manually, if needed (#25)

We made some chnages for spinnaker annotations and `preserveUnknownFields` that would be overriden by `make manifests`

* [INTERNAL] Allow Kafka to use External DNS for inter-broker protocol (#17) (#22)

* [INTERNAL] Allow external listeners to be used for inner communication (#26)

* [INTERNAL] Ensure external listerners are always the first the advertised.listeners configuration

This is needed for old clients connecting to kafka through Zookeeper that does not have a way
to infer the right listener.
In this case, the first listener in the advertised.listener config is used to connect to brokers.
This patch ensures the external listeners (those reachable from outside) are listed before internal ones

* [INTERNAL] Generate CRDs resources

* [INTERNAL] Upgrade to Kafka 2.8.1 (#36)

* Enable envoy idleTimeout and TCP keep-alive for connections to kafka and clients

1/ Kafka broker defines connections.max.idle.ms=600s
To ensure envoy as a client for kafka broker is terminating
the connection first to avoid network disconnects
this patch is setting the idleTimeout to value slightly less
than that

2/ Enable tcp-keep alive for all TCP connections established by envoy to kafka
and to client (or fronting Load Balancer)

* Enable envoy tls termination (#41)

* [INTERNAL] Build kafka 3.1.1 using Oracle OpenJDK

* Envoy config generated by the operator is invalid in envoy 1.22


Added explicit typeconfig for envoy.filters.http.router

```
[2022-06-16 13:27:58.425][1][info][main] [source/server/server.cc:939] exiting
Didn't find a registered implementation for 'envoy.filters.http.router' with type URL: ''
```

* Added TaintedBrokersSelector to kafkaClusterSpec (#48)

Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>

* Build kafka 3.2.2

* Upgrade kafka to 3.2.3

* Upgrade kafka to 3.3.1

* [Internal] Update helm for adobe builds (#52)

* [INTERNAL] Use local replacement for sub-modules (#54)

As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.

* Upgrade kafka to 3.4.0

---------

Co-authored-by: Adi Muraru <amuraru@adobe.com>
Co-authored-by: Adrian Lungu <adrian.lungu89@gmail.com>
Co-authored-by: Razvan Dobre <dobre.razvan@gmail.com>
Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>
Co-authored-by: Adrian Coman <acoman@adobe.com>
Co-authored-by: aguzovatii <guzovatii.anatolii@gmail.com>
ctrlaltluc pushed a commit that referenced this pull request Jun 8, 2023
As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.
ctrlaltluc added a commit that referenced this pull request Jun 8, 2023
* [INTERNAL] [BUILD] Publish docker images to adobe/kafka-operator and adobe/kafka docker hub repos

- build the koperator docker image
- build Apache kafka docker image
When `kafka-*` tags are created a github action is triggered
to build and push a new adobe/kafka docker image version

* [INTERNAL] make manifests should be called manually, if needed (#25)

We made some chnages for spinnaker annotations and `preserveUnknownFields` that would be overriden by `make manifests`

* [INTERNAL] Allow Kafka to use External DNS for inter-broker protocol (#17) (#22)

* [INTERNAL] Allow external listeners to be used for inner communication (#26)

* [INTERNAL] Ensure external listerners are always the first the advertised.listeners configuration

This is needed for old clients connecting to kafka through Zookeeper that does not have a way
to infer the right listener.
In this case, the first listener in the advertised.listener config is used to connect to brokers.
This patch ensures the external listeners (those reachable from outside) are listed before internal ones

* [INTERNAL] Generate CRDs resources

* [INTERNAL] Upgrade to Kafka 2.8.1 (#36)

* Enable envoy idleTimeout and TCP keep-alive for connections to kafka and clients

1/ Kafka broker defines connections.max.idle.ms=600s
To ensure envoy as a client for kafka broker is terminating
the connection first to avoid network disconnects
this patch is setting the idleTimeout to value slightly less
than that

2/ Enable tcp-keep alive for all TCP connections established by envoy to kafka
and to client (or fronting Load Balancer)

* Enable envoy tls termination (#41)

* [INTERNAL] Build kafka 3.1.1 using Oracle OpenJDK

* Envoy config generated by the operator is invalid in envoy 1.22


Added explicit typeconfig for envoy.filters.http.router

```
[2022-06-16 13:27:58.425][1][info][main] [source/server/server.cc:939] exiting
Didn't find a registered implementation for 'envoy.filters.http.router' with type URL: ''
```

* Added TaintedBrokersSelector to kafkaClusterSpec (#48)

Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>

* Build kafka 3.2.2

* Upgrade kafka to 3.2.3

* Upgrade kafka to 3.3.1

* [Internal] Update helm for adobe builds (#52)

* [INTERNAL] Use local replacement for sub-modules (#54)

As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.

* Upgrade kafka to 3.4.0

---------

Co-authored-by: Adi Muraru <amuraru@adobe.com>
Co-authored-by: Adrian Lungu <adrian.lungu89@gmail.com>
Co-authored-by: Razvan Dobre <dobre.razvan@gmail.com>
Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>
Co-authored-by: Adrian Coman <acoman@adobe.com>
Co-authored-by: aguzovatii <guzovatii.anatolii@gmail.com>
amuraru pushed a commit that referenced this pull request Jun 10, 2023
As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.
amuraru pushed a commit that referenced this pull request Dec 12, 2023
As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants