Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failed to create stream with multiple input and output bindings on scdf for vmware tanzu 1.12.2 #4912

Closed
xgueret opened this issue May 16, 2022 · 4 comments
Assignees
Milestone

Comments

@xgueret
Copy link

xgueret commented May 16, 2022

Description:

when I try create a stream using 'double pipe' in dsl stream create mystream --definition "cremProcessorApp || cremSinkApp || fluxApp || sourceApp" we have the following exception : applicationType must not be null.
For information all applications have been registered with the type app in order to manually create binding of our stream for multi output.

Here is the stackTrace:

2022-05-16T16:32:50.09+0200 [RTR/dataflow 4] OUT dataflow-744c68f9-d302-4757-bd22-c7afef898e5d.apps.foundry.sii24.pole-emploi.intra - [2022-05-16T14:32:50.032782148Z] "GET /streams/definitions/ds0 HTTP/1.1" 404 0 157 "https://dataflow-744c68f9-d302-4757-bd22-c7afef898e5d.apps.foundry.sii24.pole-emploi.intra/dashboard/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.0.0 Safari/537.36" "10.200.250.13:45348" "10.200.90.170:61080" x_forwarded_for:"10.200.250.13" x_forwarded_proto:"https" vcap_request_id:"b1ced31f-4726-4986-5e20-2bc95272299f" response_time:0.063684 gorouter_time:0.000192 app_id:"5bd6dba9-9442-4b97-96f3-5acb346b24f5" app_index:"0" instance_id:"2e520be5-958b-4300-7fe7-ed76" x_cf_routererror:"-" x_b3_traceid:"443ee0526664296e32719e74c893ad84" x_b3_spanid:"443ee0526664296e32719e74c893ad84" x_b3_parentspanid:"-" b3:"443ee0526664296e32719e74c893ad84-443ee0526664296e32719e74c893ad84" 2022-05-16T16:32:55.30+0200 [APP/PROC/WEB/dataflow 0] OUT 2022-05-16 14:32:55.299 WARN 16 --- [nio-8080-exec-8] o.s.c.d.s.c.RestControllerAdvice : Caught exception while handling a request: Could not find stream definition named ds041 2022-05-16T16:32:55.30+0200 [RTR/dataflow 4] OUT dataflow-744c68f9-d302-4757-bd22-c7afef898e5d.apps.foundry.sii24.pole-emploi.intra - [2022-05-16T14:32:55.293096722Z] "GET /streams/definitions/ds041 HTTP/1.1" 404 0 159 "https://dataflow-xxx/dashboard/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.0.0 Safari/537.36" "xx.xxx.xx.xx:xxxxx" "xx.xxx.xx.xxx:xxxxx" x_forwarded_for:"xx.xxx.xxx.xx" x_forwarded_proto:"https" vcap_request_id:"954e18d8-16a5-46fb-4733-9ca50a35cff1" response_time:0.009584 gorouter_time:0.000403 app_id:"5bd6dba9-9442-4b97-96f3-5acb346b24f5" app_index:"0" instance_id:"2e520be5-958b-4300-7fe7-ed76" x_cf_routererror:"-" x_b3_traceid:"0177c8c1bd7b009c106b352b08181af9" x_b3_spanid:"0177c8c1bd7b009c106b352b08181af9" x_b3_parentspanid:"-" b3:"0177c8c1bd7b009c106b352b08181af9-0177c8c1bd7b009c106b352b08181af9" 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT 2022-05-16 14:32:56.924 ERROR 16 --- [nio-8080-exec-6] o.s.c.d.s.c.RestControllerAdvice : Caught exception while handling a request 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT java.lang.IllegalArgumentException: applicationType must not be null 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.util.Assert.notNull(Assert.java:201) ~[spring-core-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.cloud.dataflow.core.DataFlowAppDefinition.<init>(DataFlowAppDefinition.java:62) ~[spring-cloud-dataflow-core-2.9.2.jar:2.9.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.cloud.dataflow.core.StreamAppDefinition.<init>(StreamAppDefinition.java:51) ~[spring-cloud-dataflow-core-2.9.2.jar:2.9.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.cloud.dataflow.core.StreamAppDefinition$Builder.build(StreamAppDefinition.java:256) ~[spring-cloud-dataflow-core-2.9.2.jar:2.9.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at com.vmware.dataflow.stream.MultiInMultiOutStreamApplicationBuilder.build(MultiInMultiOutStreamApplicationBuilder.java:74) ~[scdf-pro-server-core-1.4.2.jar:1.4.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at com.vmware.dataflow.stream.ProStreamDefinitionService.getAppDefinitions(ProStreamDefinitionService.java:33) ~[scdf-pro-server-core-1.4.2.jar:1.4.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.cloud.dataflow.server.service.impl.DefaultStreamService.createStream(DefaultStreamService.java:408) ~[spring-cloud-dataflow-server-core-2.9.2.jar:2.9.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.cloud.dataflow.server.service.impl.DefaultStreamService$$FastClassBySpringCGLIB$$89697014.invoke(<generated>) ~[spring-cloud-dataflow-server-core-2.9.2.jar:2.9.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:783) ~[spring-aop-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753) ~[spring-aop-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) ~[spring-tx-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) ~[spring-tx-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) ~[spring-tx-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753) ~[spring-aop-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:698) ~[spring-aop-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.cloud.dataflow.server.service.impl.DefaultStreamService$$EnhancerBySpringCGLIB$$d103fd08.createStream(<generated>) ~[spring-cloud-dataflow-server-core-2.9.2.jar:2.9.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.cloud.dataflow.server.controller.StreamDefinitionController.save(StreamDefinitionController.java:150) ~[spring-cloud-dataflow-server-core-2.9.2.jar:2.9.2] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_322] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_322] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_322] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_322] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) ~[spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) ~[spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) ~[spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) ~[spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) ~[spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) ~[spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1067) ~[spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963) ~[spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) [spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) [spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at javax.servlet.http.HttpServlet.service(HttpServlet.java:681) [tomcat-embed-core-9.0.56.jar:4.0.FR] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) [spring-webmvc-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) [tomcat-embed-core-9.0.56.jar:4.0.FR] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) [tomcat-embed-websocket-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.ForwardedHeaderFilter.doFilterInternal(ForwardedHeaderFilter.java:156) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:327) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:121) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:115) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:105) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:149) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:149) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter.doFilterInternal(BearerTokenAuthenticationFilter.java:121) [spring-security-oauth2-resource-server-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.ui.DefaultLogoutPageGeneratingFilter.doFilterInternal(DefaultLogoutPageGeneratingFilter.java:58) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:237) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:223) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:218) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:212) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.oauth2.client.web.OAuth2AuthorizationRequestRedirectFilter.doFilterInternal(OAuth2AuthorizationRequestRedirectFilter.java:178) [spring-security-oauth2-client-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:110) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:80) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:336) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:211) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:183) [spring-security-web-5.5.4.jar:5.5.4] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) [spring-boot-actuator-2.5.8.jar:2.5.8] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [RTR/dataflow 4] OUT dataflow-xxx - [2022-05-16T14:32:56.906144378Z] "POST /streams/definitions?name=xxx&definition=cremProcessorApp%20%7C%7C%20cremSinkApp%20%7C%7C%20fluxApp%20%7C%7C%20sourceApp&description= HTTP/1.1" 500 0 140 "https://dataflow-xxx/dashboard/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.0.0 Safari/537.36" "xx.xxx.xxx.xx:xxxxx" "xx.xxx.xx.xxx:xxxxx" x_forwarded_for:"xx.xxx.xxx.xx" x_forwarded_proto:"https" vcap_request_id:"d6bd0758-0bd0-4d1e-487b-03d5b786a0db" response_time:0.023305 gorouter_time:0.000487 app_id:"5bd6dba9-9442-4b97-96f3-5acb346b24f5" app_index:"0" instance_id:"2e520be5-958b-4300-7fe7-ed76" x_cf_routererror:"-" x_b3_traceid:"73438659bcc8e3ee23f8e497ed10274c" x_b3_spanid:"73438659bcc8e3ee23f8e497ed10274c" x_b3_parentspanid:"-" b3:"73438659bcc8e3ee23f8e497ed10274c-73438659bcc8e3ee23f8e497ed10274c" 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) [spring-web-5.3.14.jar:5.3.14] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.cloudfoundry.router.ClientCertificateMapper.doFilter(ClientCertificateMapper.java:79) [client_certificate_mapper-1.11.0_RELEASE.jar:na] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:540) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:769) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:357) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:382) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:895) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1732) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) [tomcat-embed-core-9.0.56.jar:9.0.56] 2022-05-16T16:32:56.92+0200 [APP/PROC/WEB/dataflow 0] OUT at java.lang.Thread.run(Thread.java:750) [na:1.8.0_322] 2022-05-16T16:32:58.00+0200 [APP/PROC/WEB/dataflow 0] OUT 2022-05-16 14:32:58.002 WARN 16 --- [nio-8080-exec-5] o.s.c.d.s.c.RestControllerAdvice : Caught exception while handling a request: Could not find stream definition named ds041 2022-05-16T16:32:58.00+0200 [RTR/dataflow 4] OUT dataflow-xxx - [2022-05-16T14:32:57.989854548Z] "GET /streams/definitions/ds041 HTTP/1.1" 404 0 159 "https://dataflow-xxxx/dashboard/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.0.0 Safari/537.36" "xx.xxx.xxx.xx:xxxxx" "xx.xxx.xx.xxx:xxxxx" x_forwarded_for:"xx.xxx.xxx.xx" x_forwarded_proto:"https" vcap_request_id:"88a6ae3b-5b0a-435b-62e1-91d42d1dfac7" response_time:0.014884 gorouter_time:0.000545 app_id:"5bd6dba9-9442-4b97-96f3-5acb346b24f5" app_index:"0" instance_id:"2e520be5-958b-4300-7fe7-ed76" x_cf_routererror:"-" x_b3_traceid:"584c8bded51b281f177fc68e1445f0e4" x_b3_spanid:"584c8bded51b281f177fc68e1445f0e4" x_b3_parentspanid:"-" b3:"584c8bded51b281f177fc68e1445f0e4-584c8bded51b281f177fc68e1445f0e4"

Release versions:

{ "versions": { "implementation": { "name": "scdf-pro-server", "version": "1.4.2" }, "core": { "name": "Spring Cloud Data Flow Core", "version": "2.9.2" }, "dashboard": { "name": "Spring Cloud Dataflow UI", "version": "3.2.2" }, "shell": { "name": "Spring Cloud Data Flow Shell", "version": "2.9.2", "url": "https://repo1.maven.org/maven2/org/springframework/cloud/spring-cloud-dataflow-shell/2.9.2/spring-cloud-dataflow-shell-2.9.2.jar" } }, "features": { "streams": true, "tasks": true, "schedules": true, "monitoringDashboardType": "NONE" }, "runtimeEnvironment": { "appDeployer": { "deployerImplementationVersion": "2.8.2", "deployerName": "Spring Cloud Skipper Server", "deployerSpiVersion": "2.8.2", "javaVersion": "1.8.0_322", "platformApiVersion": "", "platformClientVersion": "", "platformHostVersion": "", "platformSpecificInfo": { "default": "cloudfoundry" }, "platformType": "Skipper Managed", "springBootVersion": "2.5.8", "springVersion": "5.3.14" }, "taskLaunchers": [ { "deployerImplementationVersion": "2.7.2", "deployerName": "CloudFoundryAppDeployer", "deployerSpiVersion": "2.7.2", "javaVersion": "1.8.0_322", "platformApiVersion": "2.171.0", "platformClientVersion": "unknown", "platformHostVersion": "unknown", "platformSpecificInfo": { "Space": "playground", "API Endpoint": "https://xxxx", "Organization": "XXXX" }, "platformType": "Cloud Foundry", "springBootVersion": "2.5.8", "springVersion": "5.3.14" } ] }, "monitoringDashboardInfo": { "url": "", "source": "default-scdf-source", "refreshInterval": 15 }, "security": { "isAuthentication": true, "isAuthenticated": true, "username": "xxx", "roles": [ "ROLE_CREATE", "ROLE_DEPLOY", "ROLE_DESTROY", "ROLE_MODIFY", "ROLE_SCHEDULE", "ROLE_VIEW" ] } }

Steps to reproduce:

  1. Registered all app with type app
  2. Create the stream using only double pipe in the definition between each app
    => exception thrown (see log above)
@github-actions github-actions bot added the status/need-triage Team needs to triage and take a first look label May 16, 2022
@markpollack
Copy link
Contributor

We have got this report from another user, we will prioritize investigating into it and get back to you. Thanks for reporting.

@markpollack markpollack added status/need-investigation Oh need to look under a hood and removed status/need-triage Team needs to triage and take a first look labels May 17, 2022
@corneil
Copy link
Contributor

corneil commented Jun 14, 2022

This error is specific to Spring Cloud Data Flow Pro and the fix has been merge to 1.5.0-SNAPSHOT.

@onobc
Copy link
Contributor

onobc commented Jun 15, 2022

We can keep it open as it will be addressed in the upcoming Pro 1.4.6 (OSS Dataflow 2.9.5) release as part of https://github.com/pivotal/scdf-pro/issues/124

@onobc onobc added this to the 2.9.5 milestone Jun 15, 2022
@onobc onobc removed the status/need-investigation Oh need to look under a hood label Jun 15, 2022
@onobc
Copy link
Contributor

onobc commented Jun 21, 2022

Closing as it is covered in the PRO repo.

@onobc onobc closed this as completed Jun 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants