Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Systemd ulimits #56 #107

Closed
wants to merge 95 commits into from

Conversation

jvalderrama
Copy link

Include system defaults properties in environment.j2 template
to create unit kafka-broker service.

@jvalderrama jvalderrama mentioned this pull request Jun 20, 2019
joel-hamill and others added 19 commits June 28, 2019 14:40
…S-1976

DOCS-1976 - Move ansible docs to /docs repo
	new file:   all.yml
	new file:   ansible.cfg
	new file:   hosts.yml

Initial Commit.
	new file:   docs/Makefile
	new file:   docs/index.rst
	new file:   plaintext/all.yml
	new file:   plaintext/hosts.yml
	new file:   roles/confluent.common/defaults/main.yml
	new file:   roles/confluent.common/handlers/main.yml
	new file:   roles/confluent.common/tasks/debian.yml
	new file:   roles/confluent.common/tasks/main.yml
	new file:   roles/confluent.common/tasks/redhat.yml
	new file:   roles/confluent.common/tasks/ssl_certs.yml
	new file:   roles/confluent.connect-distributed/defaults/main.yml
	new file:   roles/confluent.connect-distributed/handlers/main.yml
	new file:   roles/confluent.connect-distributed/meta/main.yml
	new file:   roles/confluent.connect-distributed/tasks/main.yml
	new file:   roles/confluent.connect-distributed/templates/connect-distributed.properties.j2
	new file:   roles/confluent.connect-distributed/templates/connect-distributed_sasl_ssl.properties.j2
	new file:   roles/confluent.connect-distributed/templates/connect-distributed_ssl.properties.j2
	new file:   roles/confluent.connect-distributed/templates/environment.j2
	new file:   roles/confluent.connect-distributed/templates/includes/base_connect-distributed.properties.j2
	new file:   roles/confluent.connect-distributed/templates/includes/schema_registry_urls.j2
	new file:   roles/confluent.control-center/defaults/main.yml
	new file:   roles/confluent.control-center/handlers/main.yml
	new file:   roles/confluent.control-center/meta/main.yml
	new file:   roles/confluent.control-center/tasks/main.yml
	new file:   roles/confluent.control-center/templates/control-center.properties.j2
	new file:   roles/confluent.control-center/templates/control-center_sasl_ssl.properties.j2
	new file:   roles/confluent.control-center/templates/control-center_ssl.properties.j2
	new file:   roles/confluent.control-center/templates/environment.j2
	new file:   roles/confluent.control-center/templates/includes/base_control-center.properties.j2
	new file:   roles/confluent.kafka-broker/defaults/main.yml
	new file:   roles/confluent.kafka-broker/handlers/main.yml
	new file:   roles/confluent.kafka-broker/meta/main.yml
	new file:   roles/confluent.kafka-broker/tasks/main.yml
	new file:   roles/confluent.kafka-broker/templates/environment.j2
	new file:   roles/confluent.kafka-broker/templates/includes/base_server.properties.j2
	new file:   roles/confluent.kafka-broker/templates/includes/confluent_support.j2
	new file:   roles/confluent.kafka-broker/templates/server.properties.j2
	new file:   roles/confluent.kafka-broker/templates/server_sasl_ssl.properties.j2
	new file:   roles/confluent.kafka-broker/templates/server_ssl.properties.j2
	new file:   roles/confluent.kafka-rest/defaults/main.yml
	new file:   roles/confluent.kafka-rest/handlers/main.yml
	new file:   roles/confluent.kafka-rest/meta/main.yml
	new file:   roles/confluent.kafka-rest/tasks/main.yml
	new file:   roles/confluent.kafka-rest/templates/environment.j2
	new file:   roles/confluent.kafka-rest/templates/includes/base_kafka-rest.properties.j2
	new file:   roles/confluent.kafka-rest/templates/kafka-rest.properties.j2
	new file:   roles/confluent.kafka-rest/templates/kafka-rest_sasl_ssl.properties.j2
	new file:   roles/confluent.kafka-rest/templates/kafka-rest_ssl.properties.j2
	new file:   roles/confluent.ksql/defaults/main.yml
	new file:   roles/confluent.ksql/handlers/main.yml
	new file:   roles/confluent.ksql/meta/main.yml
	new file:   roles/confluent.ksql/tasks/main.yml
	new file:   roles/confluent.ksql/templates/environment.j2
	new file:   roles/confluent.ksql/templates/includes/base_ksql.properties.j2
	new file:   roles/confluent.ksql/templates/ksql.properties.j2
	new file:   roles/confluent.ksql/templates/ksql_sasl_ssl.properties.j2
	new file:   roles/confluent.ksql/templates/ksql_ssl.properties.j2
	new file:   roles/confluent.preflight/tasks/debian.yml
	new file:   roles/confluent.preflight/tasks/main.yml
	new file:   roles/confluent.preflight/tasks/redhat.yml
	new file:   roles/confluent.schema-registry/defaults/main.yml
	new file:   roles/confluent.schema-registry/handlers/main.yml
	new file:   roles/confluent.schema-registry/meta/main.yml
	new file:   roles/confluent.schema-registry/tasks/main.yml
	new file:   roles/confluent.schema-registry/templates/environment.j2
	new file:   roles/confluent.schema-registry/templates/includes/base_schema-registry.properties.j2
	new file:   roles/confluent.schema-registry/templates/schema-registry.properties.j2
	new file:   roles/confluent.schema-registry/templates/schema-registry_sasl_ssl.properties.j2
	new file:   roles/confluent.schema-registry/templates/schema-registry_ssl.properties.j2
	new file:   roles/confluent.ssl_CA/scripts/certs-create.sh
	new file:   roles/confluent.ssl_CA/tasks/main.yml
	new file:   roles/confluent.tools/defaults/main.yml
	new file:   roles/confluent.tools/meta/main.yml
	new file:   roles/confluent.tools/tasks/main.yml
	new file:   roles/confluent.tools/templates/includes/base_tools.properties.j2
	new file:   roles/confluent.tools/templates/tools.properties.j2
	new file:   roles/confluent.tools/templates/tools_sasl_ssl.properties.j2
	new file:   roles/confluent.tools/templates/tools_ssl.properties.j2
	new file:   roles/confluent.zookeeper/defaults/main.yml
	new file:   roles/confluent.zookeeper/handlers/main.yml
	new file:   roles/confluent.zookeeper/meta/main.yml
	new file:   roles/confluent.zookeeper/tasks/main.yml
	new file:   roles/confluent.zookeeper/templates/environment.j2
	new file:   roles/confluent.zookeeper/templates/myid.j2
	new file:   roles/confluent.zookeeper/templates/zookeeper.properties.j2
	new file:   sasl_ssl/all.yml
	new file:   sasl_ssl/hosts.yml
	new file:   ssl/all.yml
	new file:   ssl/hosts.yml
	modified:   hosts.yml
	new file:   ssl_selfsigned/all.yml
	new file:   ssl_selfsigned/hosts.yml
	new file:   ssl_selfsigned/vars/security_vars.yml
	modified:   hosts.yml
	modified:   roles/confluent.kafka-broker/tasks/main.yml
	new file:   roles/confluent.kafka-broker/templates/server_ssl_self_signed.properties.j2
	new file:   roles/confluent.ssl_selfsigned/scripts/certs-create.sh
	new file:   roles/confluent.ssl_selfsigned/tasks/main.yml
	modified:   all.yml
	modified:   roles/confluent.ssl_selfsigned/scripts/certs-create.sh
	modified:   roles/confluent.ssl_selfsigned/tasks/main.yml
	new file:   ssl_selfsigned/vars/.security_vars.yml.swp
	modified:   ssl_selfsigned/vars/security_vars.yml
	modified:   all.yml
	modified:   roles/confluent.kafka-broker/templates/server_ssl_self_signed.properties.j2
	modified:   all.yml
	new file:   generated_ssl_files/broker_keystore_creds
	new file:   generated_ssl_files/broker_sslkey_creds
	new file:   generated_ssl_files/broker_truststore_creds
	new file:   generated_ssl_files/client_keystore_creds
	new file:   generated_ssl_files/client_sslkey_creds
	new file:   generated_ssl_files/client_truststore_creds
	new file:   generated_ssl_files/snakeoil-ca-1.srl
	modified:   roles/confluent.kafka-broker/templates/server_ssl_self_signed.properties.j2
…ned.properties.j2

	deleted:    ssl_selfsigned/vars/.security_vars.yml.swp
	modified:   all.retry
	deleted:    generated_ssl_files/snakeoil-ca-1.srl
	modified:   roles/confluent.kafka-broker/defaults/main.yml
	new file:   "roles/confluent.ssl_selfsigned/scripts/\\"
	modified:   roles/confluent.ssl_selfsigned/scripts/certs-create.sh
	modified:   roles/confluent.ssl_selfsigned/tasks/main.yml
	modified:   ssl_selfsigned/vars/security_vars.yml
	modified:   roles/confluent.ssl_selfsigned/tasks/main.yml
	modified:   ssl_selfsigned/vars/security_vars.yml
	deleted:    all.retry
	modified:   roles/confluent.kafka-broker/defaults/main.yml
	modified:   roles/confluent.kafka-broker/templates/server_ssl_self_signed.properties.j2
	deleted:    "roles/confluent.ssl_selfsigned/scripts/\\"
	renamed:    roles/confluent.ssl_selfsigned/scripts/certs-create.sh -> roles/confluent.ssl_selfsigned/scripts/certs-import.sh
	modified:   roles/confluent.ssl_selfsigned/tasks/main.yml
	modified:   ssl_selfsigned/vars/security_vars.yml
	modified:   roles/confluent.schema-registry/tasks/main.yml
	new file:   roles/confluent.schema-registry/templates/schema-registry_ssl_selfsigned.properties.j2
	modified:   roles/confluent.ssl_selfsigned/tasks/main.yml
	modified:   roles/confluent.connect-distributed/tasks/main.yml
	new file:   roles/confluent.connect-distributed/templates/connect-distributed_ssl_selfsigned.properties.j2
JumaX and others added 16 commits July 24, 2019 10:25
	deleted:    ssl_customcerts/hosts.yml.org
	modified:   ssl_customcerts/vars/security_vars.yml

Corrected invalid settings in hosts file and updated documentation for vars.
…ary for rest of the install. install succeeded
kerberos realm hardcoded to confluent.example.com
	renamed:    templates/kerberosenvironment.j2 -> templates/kerberos_environment.j2

Corrected naming convention on templates file.
	renamed:    templates/kerberosenvironment.j2 -> templates/kerberos_environment.j2

Changed naming convention to be more appropriate.
	modified:   roles/confluent.control-center/defaults/main.yml
	modified:   roles/confluent.kafka-rest/defaults/main.yml
	modified:   roles/confluent.schema-registry/defaults/main.yml
	modified:   roles/confluent.zookeeper/defaults/main.yml

Removed extraneous realm variable.
@JumaX JumaX self-requested a review July 26, 2019 14:09
@JumaX JumaX self-assigned this Jul 26, 2019
@JumaX JumaX added the enhancement New feature or request label Jul 26, 2019
@JumaX
Copy link
Contributor

JumaX commented Jul 26, 2019

@jvalderrama This is a great idea. I would actually recommend increasing the limit to 500k. I would also recommend applying this change to all components, not just the Brokers. Connect for example, can use a lot of file handlers.

We have also just released 5.3.0 where cp-ansible is now fully supported. Can you rebase your changes to the 5.3.0-post branch.

JumaX and others added 3 commits July 29, 2019 08:36
Corrected link to Contribution documentation.
Include system defaults properties in environment.j2 template
to create unit kafka-broker service
Jorge Valderrama added 2 commits July 31, 2019 11:38
to create unit connect-distributed service
to create control-center,kafka-rest,ksql,schema-registry and
zookeeper unit services
@jvalderrama
Copy link
Author

@JumaX I had increased the limit to 500k like you suggested, I am also applied this change to all componets, it is: connect-distributed, control-center, kafka-broker, kafka-rest, ksql, schema-registry and zookeeper.

@JumaX
Copy link
Contributor

JumaX commented Sep 3, 2019

@jvalderrama Thanks for your work on this. We've actually merged in this request as part of the latest merged pr, found here: #124. Will close this out.

@JumaX JumaX closed this Sep 3, 2019
domenicbove added a commit to domenicbove/cp-ansible that referenced this pull request Feb 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants