Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TaskLauncherProperties not being mapped properly from platform account #4186

Closed
chrisjs opened this issue Oct 7, 2020 · 2 comments
Closed
Assignees
Labels
type/bug Is a bug report

Comments

@chrisjs
Copy link
Contributor

chrisjs commented Oct 7, 2020

While investigating spring-cloud/spring-cloud-deployer-kubernetes#398 (comment) it was found that properties set into the scdf configmap that should be populated into TaskLauncherProperties is not happening.

For example:

  cloud:
    dataflow:
      task:
        platform:
          kubernetes:
            accounts:
              dev:
                limits:
                    memory: 1024Mi
                    cpu: 1
                backoffLimit: 1

Likely this is due to the glue between SCDF and deployer, for example:

In SCDF KubernetesTaskPlatformFactory.createLauncher there is:

         KubernetesTaskLauncher kubernetesTaskLauncher = new KubernetesTaskLauncher(
				kubernetesProperties, kubernetesClient, containerFactory);

Yet on the deployer side, in KubernetesTaskLauncher that constructor would be:

       @Autowired
	public KubernetesTaskLauncher(KubernetesDeployerProperties properties,
			KubernetesClient client, ContainerFactory containerFactory) {
		this(properties, new KubernetesTaskLauncherProperties(), client, containerFactory);
	}

which creates a new KubernetesTaskLauncherProperties so calling taskLauncherProperties.getBackoffLimit(); in say for example KubernetesTaskLauncher.getBackoffLimit(..) is just going to return null...

@sabbyanandan
Copy link
Contributor

@ilayaperumalg @cppwfs: This sounds problematic; is this still an issue?

ilayaperumalg added a commit to ilayaperumalg/spring-cloud-dataflow that referenced this issue May 27, 2021
 - Introduce Platform task launcher properties to include K8s task launcher properties
 - Construct the task launcher using this explicit property
 - Update test

Resolves spring-cloud#4186
@ilayaperumalg
Copy link
Contributor

Yes, we need an explicit K8s task launcher properties extracted from the K8s platform account properties to be used in the K8s task launcher. Fixed via #4546

ilayaperumalg added a commit to ilayaperumalg/spring-cloud-dataflow that referenced this issue May 27, 2021
 - Introduce Platform task launcher properties to include K8s task launcher properties
 - Construct the task launcher using this explicit property
 - Update test

Resolves spring-cloud#4186
@cppwfs cppwfs closed this as completed in 56a1362 May 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug Is a bug report
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants