Search before asking
What happened
[root@jzyc-test-150 bin]# ll /data/flink/lib/
total 311328
-rwxrwxrwx 1 root root 42760 Apr 27 16:44 flink-cdc-cli-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 395236 Apr 27 16:33 flink-cdc-common-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 62760 Apr 27 16:50 flink-cdc-composer-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 22202386 Apr 27 19:41 flink-cdc-dist-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 21383663 Apr 27 16:33 flink-cdc-pipeline-connector-mysql-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 13030854 Apr 27 16:34 flink-cdc-pipeline-connector-starrocks-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 3632300 Apr 27 16:34 flink-cdc-pipeline-connector-values-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 198365 Apr 10 21:01 flink-cep-1.20.3.jar
-rwxrwxrwx 1 root root 563713 Apr 10 21:01 flink-connector-files-1.20.3.jar
-rwxrwxrwx 1 root root 439729 Apr 17 2025 flink-connector-jdbc-3.3.0-1.20.jar
-rwxrwxrwx 1 root root 102376 Apr 10 21:01 flink-csv-1.20.3.jar
-rwxrwxrwx 1 root root 125950125 Apr 10 21:01 flink-dist-1.20.3.jar
-rwxrwxrwx 1 root root 204407 Apr 10 21:01 flink-json-1.20.3.jar
-rwxrwxrwx 1 root root 21060636 Apr 10 21:01 flink-scala_2.12-1.20.3.jar
-rwxrwxrwx 1 root root 21717881 Apr 27 16:35 flink-sql-connector-mysql-cdc-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 20394579 Apr 27 16:35 flink-sql-connector-oracle-cdc-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 15714642 Apr 10 21:01 flink-table-api-java-uber-1.20.3.jar
-rwxrwxrwx 1 root root 38424411 Apr 10 21:01 flink-table-planner-loader-1.20.3.jar
-rwxrwxrwx 1 root root 3548975 Apr 10 21:01 flink-table-runtime-1.20.3.jar
-rwxrwxrwx 1 root root 356379 Apr 10 21:01 log4j-1.2-api-2.24.3.jar
-rwxrwxrwx 1 root root 348513 Apr 10 21:01 log4j-api-2.24.3.jar
-rwxrwxrwx 1 root root 1914666 Apr 10 21:01 log4j-core-2.24.3.jar
-rwxrwxrwx 1 root root 25319 Apr 10 21:01 log4j-slf4j-impl-2.24.3.jar
-rwxrwxrwx 1 root root 2513563 Jul 1 2022 mysql-connector-java-8.0.30.jar
-rwxrwxrwx 1 root root 4210517 Apr 17 12:57 ojdbc8-19.3.0.0.jar
-rwxrwxrwx 1 root root 41125 Feb 8 2022 slf4j-api-1.7.36.jar
-rwxrwxrwx 1 root root 262664 Feb 22 2020 xdb-19.3.0.0.jar
[root@jzyc-test-150 bin]# ll /data/dinky/extends/flink1.20/
total 623584
drwxrwxrwx 2 root root 128 Apr 14 17:54 dinky
-rwxrwxrwx 1 root root 42760 Apr 27 16:44 flink-cdc-cli-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 395236 Apr 27 16:33 flink-cdc-common-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 62760 Apr 27 16:50 flink-cdc-composer-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 22202386 Apr 27 19:41 flink-cdc-dist-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 21383663 Apr 27 16:33 flink-cdc-pipeline-connector-mysql-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 13030854 Apr 27 16:34 flink-cdc-pipeline-connector-starrocks-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 3632300 Apr 27 16:34 flink-cdc-pipeline-connector-values-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 198365 Apr 10 21:01 flink-cep-1.20.3.jar
-rwxrwxrwx 1 root root 563713 Apr 10 21:01 flink-connector-files-1.20.3.jar
-rwxrwxrwx 1 root root 439729 Apr 17 2025 flink-connector-jdbc-3.3.0-1.20.jar
-rwxrwxrwx 1 root root 102376 Apr 10 21:01 flink-csv-1.20.3.jar
-rwxrwxrwx 1 root root 125950125 Apr 10 21:01 flink-dist-1.20.3.jar
-rwxrwxrwx 1 root root 21060636 Apr 10 21:01 flink-scala_2.12-1.20.3.jar
-rwxrwxrwx 1 root root 987674 Sep 20 2025 flink-sql-client-1.20.3.jar
-rwxrwxrwx 1 root root 21717881 Apr 27 16:35 flink-sql-connector-mysql-cdc-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 20394579 Apr 27 16:35 flink-sql-connector-oracle-cdc-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 15714642 Apr 10 21:01 flink-table-api-java-uber-1.20.3.jar
-rwxrwxrwx 1 root root 21620512 Apr 17 02:05 flink-table-planner_2.12-1.20.1.jar
-rwxrwxrwx 1 root root 38425851 Apr 17 01:56 flink-table-planner-loader-1.20.1.jar
-rwxrwxrwx 1 root root 38424411 Apr 17 12:53 flink-table-planner-loader-1.20.3.jar
-rwxrwxrwx 1 root root 3548975 Apr 10 21:01 flink-table-runtime-1.20.3.jar
-rwxrwxrwx 1 root root 261095424 Apr 17 01:25 lib.tar.gz
-rwxrwxrwx 1 root root 356379 Apr 10 21:01 log4j-1.2-api-2.24.3.jar
-rwxrwxrwx 1 root root 348513 Apr 10 21:01 log4j-api-2.24.3.jar
-rwxrwxrwx 1 root root 25319 Apr 10 21:01 log4j-slf4j-impl-2.24.3.jar
-rwxrwxrwx 1 root root 2513563 Jul 1 2022 mysql-connector-java-8.0.30.jar
-rwxrwxrwx 1 root root 4210517 Apr 17 12:52 ojdbc8-19.3.0.0.jar
-rwxrwxrwx 1 root root 41125 Feb 8 2022 slf4j-api-1.7.36.jar
[root@jzyc-test-150 bin]#
Start Process:FlinkSubmit/21
Start Process Step:SUBMIT_PRECHECK
2026-04-27 19:46:38.563 INFO org.dinky.service.impl.TaskServiceImpl(190): Start check and config task, task:mysql2sr_pip
Process Step SUBMIT_PRECHECK exit with status:FINISHED
Start Process Step:SUBMIT_EXECUTE
Start Process Step:SUBMIT_BUILD_CONFIG
2026-04-27 19:46:38.570 INFO org.dinky.service.impl.TaskServiceImpl(308): Start initialize FlinkSQLEnv:
2026-04-27 19:46:38.571 INFO org.dinky.service.impl.TaskServiceImpl(328): Initializing data permissions...
2026-04-27 19:46:38.649 INFO org.dinky.service.impl.TaskServiceImpl(330): Finish initialize FlinkSQLEnv.
2026-04-27 19:46:38.686 INFO org.dinky.service.impl.TaskServiceImpl(258): Init remote cluster
Process Step SUBMIT_BUILD_CONFIG exit with status:FINISHED
2026-04-27 19:46:38.924 INFO org.dinky.service.task.FlinkSqlTask(69): Initializing Flink job config...
Process Step SUBMIT_EXECUTE exit with status:FAILED
java.lang.RuntimeException: java.lang.IllegalArgumentException: Missing required field "source" in top-level configuration
at org.dinky.trans.pipeline.FlinkCDCPipelineOperation.execute(FlinkCDCPipelineOperation.java:103)
at org.dinky.interceptor.FlinkInterceptor.build(FlinkInterceptor.java:53)
at org.dinky.executor.Executor.pretreatExecute(Executor.java:250)
at org.dinky.executor.Executor.executeSql(Executor.java:263)
at org.dinky.job.runner.JobPipelineRunner.run(JobPipelineRunner.java:101)
at org.dinky.job.JobManager.executeSql(JobManager.java:308)
at org.dinky.service.task.FlinkSqlTask.execute(FlinkSqlTask.java:70)
at org.dinky.service.impl.TaskServiceImpl.executeJob(TaskServiceImpl.java:213)
at org.dinky.service.impl.TaskServiceImpl.executeJob(TaskServiceImpl.java:204)
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at org.dinky.aop.ProcessAspect.processStepAround(ProcessAspect.java:110)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
at org.dinky.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$743181b0.executeJob()
at org.dinky.service.impl.TaskServiceImpl.submitTask(TaskServiceImpl.java:341)
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
at org.dinky.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$743181b0.submitTask()
at org.dinky.controller.TaskController.submitTask(TaskController.java:103)
at org.dinky.controller.TaskController$$FastClassBySpringCGLIB$$5b68bd32.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at org.dinky.aop.TaskOperationPermissionAspect.processAround(TaskOperationPermissionAspect.java:82)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at org.dinky.aop.ProcessAspect.processAround(ProcessAspect.java:73)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
at org.dinky.controller.TaskController$$EnhancerBySpringCGLIB$$c971363b.submitTask()
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:497)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129)
at io.undertow.websockets.jsr.JsrWebSocketFilter.doFilter(JsrWebSocketFilter.java:173)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:114)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at cn.dev33.satoken.filter.SaPathCheckFilterForServlet.doFilter(SaPathCheckFilterForServlet.java:55)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84)
at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)
at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68)
at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)
at io.undertow.servlet.handlers.RedirectDirHandler.handleRequest(RedirectDirHandler.java:68)
at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:117)
at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57)
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46)
at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64)
at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60)
at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77)
at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43)
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
at io.undertow.servlet.handlers.SendErrorPageHandler.handleRequest(SendErrorPageHandler.java:52)
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:275)
at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:79)
at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:134)
at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:131)
at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48)
at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43)
at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:255)
at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:79)
at io.undertow.servlet.handlers.ServletInitialHandler$1$1.run(ServletInitialHandler.java:106)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:551)
at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:103)
at io.undertow.server.Connectors.executeRootHandler(Connectors.java:393)
at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:852)
at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:2019)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1558)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1449)
at org.xnio.XnioWorker$WorkerThreadFactory$1$1.run(XnioWorker.java:1282)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.IllegalArgumentException: Missing required field "source" in top-level configuration
at org.apache.flink.cdc.cli.parser.YamlPipelineDefinitionParser.validateJsonNodeKeys(YamlPipelineDefinitionParser.java:486)
at org.apache.flink.cdc.cli.parser.YamlPipelineDefinitionParser.parse(YamlPipelineDefinitionParser.java:130)
at org.apache.flink.cdc.cli.parser.YamlPipelineDefinitionParser.parse(YamlPipelineDefinitionParser.java:125)
at org.dinky.trans.pipeline.FlinkCDCPipelineOperation.execute(FlinkCDCPipelineOperation.java:98)
... 165 more
Process FlinkSubmit/21 exit with status:FAILED
What you expected to happen
EXECUTE PIPELINE WITH YAML (
pipeline:
name: mysql2sr_pip
parallelism: 4
source:
type: mysql
hostname: ***
port: 3306
username: flink_cdc
password: ***
jdbc-properties:
useSSL: false
allowPublicKeyRetrieval: true
database: wms_his
table: wms_his.cdc_user
snapshot:
allow-empty: true
chunk-key-column: id
chunk-size: 8096
server-id: 1001-1008
server-time-zone: Asia/Shanghai
enable-binlog-read: true
sink:
type: starrocks
load-url: :8030
jdbc-url: jdbc:mysql://:9030/wms_his
username: wms_sr
password: ****
database: wms_his
auto-table-creation: true
schema-auto-merge: true
upsert: true
primary-key-follow-source: true
route:
- source-table: wms_his.cdc_user
sink-database: wms_his
ddl-sync: true
)
How to reproduce
执行以上pipline报错
Anything else
执行以上pipline报错
Version
1.2.0
Are you willing to submit PR?
Code of Conduct
Search before asking
What happened
[root@jzyc-test-150 bin]# ll /data/flink/lib/
total 311328
-rwxrwxrwx 1 root root 42760 Apr 27 16:44 flink-cdc-cli-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 395236 Apr 27 16:33 flink-cdc-common-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 62760 Apr 27 16:50 flink-cdc-composer-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 22202386 Apr 27 19:41 flink-cdc-dist-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 21383663 Apr 27 16:33 flink-cdc-pipeline-connector-mysql-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 13030854 Apr 27 16:34 flink-cdc-pipeline-connector-starrocks-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 3632300 Apr 27 16:34 flink-cdc-pipeline-connector-values-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 198365 Apr 10 21:01 flink-cep-1.20.3.jar
-rwxrwxrwx 1 root root 563713 Apr 10 21:01 flink-connector-files-1.20.3.jar
-rwxrwxrwx 1 root root 439729 Apr 17 2025 flink-connector-jdbc-3.3.0-1.20.jar
-rwxrwxrwx 1 root root 102376 Apr 10 21:01 flink-csv-1.20.3.jar
-rwxrwxrwx 1 root root 125950125 Apr 10 21:01 flink-dist-1.20.3.jar
-rwxrwxrwx 1 root root 204407 Apr 10 21:01 flink-json-1.20.3.jar
-rwxrwxrwx 1 root root 21060636 Apr 10 21:01 flink-scala_2.12-1.20.3.jar
-rwxrwxrwx 1 root root 21717881 Apr 27 16:35 flink-sql-connector-mysql-cdc-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 20394579 Apr 27 16:35 flink-sql-connector-oracle-cdc-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 15714642 Apr 10 21:01 flink-table-api-java-uber-1.20.3.jar
-rwxrwxrwx 1 root root 38424411 Apr 10 21:01 flink-table-planner-loader-1.20.3.jar
-rwxrwxrwx 1 root root 3548975 Apr 10 21:01 flink-table-runtime-1.20.3.jar
-rwxrwxrwx 1 root root 356379 Apr 10 21:01 log4j-1.2-api-2.24.3.jar
-rwxrwxrwx 1 root root 348513 Apr 10 21:01 log4j-api-2.24.3.jar
-rwxrwxrwx 1 root root 1914666 Apr 10 21:01 log4j-core-2.24.3.jar
-rwxrwxrwx 1 root root 25319 Apr 10 21:01 log4j-slf4j-impl-2.24.3.jar
-rwxrwxrwx 1 root root 2513563 Jul 1 2022 mysql-connector-java-8.0.30.jar
-rwxrwxrwx 1 root root 4210517 Apr 17 12:57 ojdbc8-19.3.0.0.jar
-rwxrwxrwx 1 root root 41125 Feb 8 2022 slf4j-api-1.7.36.jar
-rwxrwxrwx 1 root root 262664 Feb 22 2020 xdb-19.3.0.0.jar
[root@jzyc-test-150 bin]# ll /data/dinky/extends/flink1.20/
total 623584
drwxrwxrwx 2 root root 128 Apr 14 17:54 dinky
-rwxrwxrwx 1 root root 42760 Apr 27 16:44 flink-cdc-cli-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 395236 Apr 27 16:33 flink-cdc-common-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 62760 Apr 27 16:50 flink-cdc-composer-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 22202386 Apr 27 19:41 flink-cdc-dist-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 21383663 Apr 27 16:33 flink-cdc-pipeline-connector-mysql-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 13030854 Apr 27 16:34 flink-cdc-pipeline-connector-starrocks-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 3632300 Apr 27 16:34 flink-cdc-pipeline-connector-values-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 198365 Apr 10 21:01 flink-cep-1.20.3.jar
-rwxrwxrwx 1 root root 563713 Apr 10 21:01 flink-connector-files-1.20.3.jar
-rwxrwxrwx 1 root root 439729 Apr 17 2025 flink-connector-jdbc-3.3.0-1.20.jar
-rwxrwxrwx 1 root root 102376 Apr 10 21:01 flink-csv-1.20.3.jar
-rwxrwxrwx 1 root root 125950125 Apr 10 21:01 flink-dist-1.20.3.jar
-rwxrwxrwx 1 root root 21060636 Apr 10 21:01 flink-scala_2.12-1.20.3.jar
-rwxrwxrwx 1 root root 987674 Sep 20 2025 flink-sql-client-1.20.3.jar
-rwxrwxrwx 1 root root 21717881 Apr 27 16:35 flink-sql-connector-mysql-cdc-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 20394579 Apr 27 16:35 flink-sql-connector-oracle-cdc-3.6.0-1.20.jar
-rwxrwxrwx 1 root root 15714642 Apr 10 21:01 flink-table-api-java-uber-1.20.3.jar
-rwxrwxrwx 1 root root 21620512 Apr 17 02:05 flink-table-planner_2.12-1.20.1.jar
-rwxrwxrwx 1 root root 38425851 Apr 17 01:56 flink-table-planner-loader-1.20.1.jar
-rwxrwxrwx 1 root root 38424411 Apr 17 12:53 flink-table-planner-loader-1.20.3.jar
-rwxrwxrwx 1 root root 3548975 Apr 10 21:01 flink-table-runtime-1.20.3.jar
-rwxrwxrwx 1 root root 261095424 Apr 17 01:25 lib.tar.gz
-rwxrwxrwx 1 root root 356379 Apr 10 21:01 log4j-1.2-api-2.24.3.jar
-rwxrwxrwx 1 root root 348513 Apr 10 21:01 log4j-api-2.24.3.jar
-rwxrwxrwx 1 root root 25319 Apr 10 21:01 log4j-slf4j-impl-2.24.3.jar
-rwxrwxrwx 1 root root 2513563 Jul 1 2022 mysql-connector-java-8.0.30.jar
-rwxrwxrwx 1 root root 4210517 Apr 17 12:52 ojdbc8-19.3.0.0.jar
-rwxrwxrwx 1 root root 41125 Feb 8 2022 slf4j-api-1.7.36.jar
[root@jzyc-test-150 bin]#
Start Process:FlinkSubmit/21
Start Process Step:SUBMIT_PRECHECK
2026-04-27 19:46:38.563 INFO org.dinky.service.impl.TaskServiceImpl(190): Start check and config task, task:mysql2sr_pip
Process Step SUBMIT_PRECHECK exit with status:FINISHED
Start Process Step:SUBMIT_EXECUTE
Start Process Step:SUBMIT_BUILD_CONFIG
2026-04-27 19:46:38.570 INFO org.dinky.service.impl.TaskServiceImpl(308): Start initialize FlinkSQLEnv:
2026-04-27 19:46:38.571 INFO org.dinky.service.impl.TaskServiceImpl(328): Initializing data permissions...
2026-04-27 19:46:38.649 INFO org.dinky.service.impl.TaskServiceImpl(330): Finish initialize FlinkSQLEnv.
2026-04-27 19:46:38.686 INFO org.dinky.service.impl.TaskServiceImpl(258): Init remote cluster
Process Step SUBMIT_BUILD_CONFIG exit with status:FINISHED
2026-04-27 19:46:38.924 INFO org.dinky.service.task.FlinkSqlTask(69): Initializing Flink job config...
Process Step SUBMIT_EXECUTE exit with status:FAILED
java.lang.RuntimeException: java.lang.IllegalArgumentException: Missing required field "source" in top-level configuration
at org.dinky.trans.pipeline.FlinkCDCPipelineOperation.execute(FlinkCDCPipelineOperation.java:103)
at org.dinky.interceptor.FlinkInterceptor.build(FlinkInterceptor.java:53)
at org.dinky.executor.Executor.pretreatExecute(Executor.java:250)
at org.dinky.executor.Executor.executeSql(Executor.java:263)
at org.dinky.job.runner.JobPipelineRunner.run(JobPipelineRunner.java:101)
at org.dinky.job.JobManager.executeSql(JobManager.java:308)
at org.dinky.service.task.FlinkSqlTask.execute(FlinkSqlTask.java:70)
at org.dinky.service.impl.TaskServiceImpl.executeJob(TaskServiceImpl.java:213)
at org.dinky.service.impl.TaskServiceImpl.executeJob(TaskServiceImpl.java:204)
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at org.dinky.aop.ProcessAspect.processStepAround(ProcessAspect.java:110)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
at org.dinky.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$743181b0.executeJob()
at org.dinky.service.impl.TaskServiceImpl.submitTask(TaskServiceImpl.java:341)
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
at org.dinky.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$743181b0.submitTask()
at org.dinky.controller.TaskController.submitTask(TaskController.java:103)
at org.dinky.controller.TaskController$$FastClassBySpringCGLIB$$5b68bd32.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at org.dinky.aop.TaskOperationPermissionAspect.processAround(TaskOperationPermissionAspect.java:82)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at org.dinky.aop.ProcessAspect.processAround(ProcessAspect.java:73)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
at org.dinky.controller.TaskController$$EnhancerBySpringCGLIB$$c971363b.submitTask()
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:497)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
at io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:129)
at io.undertow.websockets.jsr.JsrWebSocketFilter.doFilter(JsrWebSocketFilter.java:173)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:114)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at cn.dev33.satoken.filter.SaPathCheckFilterForServlet.doFilter(SaPathCheckFilterForServlet.java:55)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:67)
at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84)
at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)
at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68)
at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)
at io.undertow.servlet.handlers.RedirectDirHandler.handleRequest(RedirectDirHandler.java:68)
at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:117)
at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57)
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46)
at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64)
at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60)
at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77)
at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43)
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
at io.undertow.servlet.handlers.SendErrorPageHandler.handleRequest(SendErrorPageHandler.java:52)
at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:275)
at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:79)
at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:134)
at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:131)
at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48)
at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43)
at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:255)
at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:79)
at io.undertow.servlet.handlers.ServletInitialHandler$1$1.run(ServletInitialHandler.java:106)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:551)
at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:103)
at io.undertow.server.Connectors.executeRootHandler(Connectors.java:393)
at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:852)
at org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
at org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:2019)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1558)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1449)
at org.xnio.XnioWorker$WorkerThreadFactory$1$1.run(XnioWorker.java:1282)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.IllegalArgumentException: Missing required field "source" in top-level configuration
at org.apache.flink.cdc.cli.parser.YamlPipelineDefinitionParser.validateJsonNodeKeys(YamlPipelineDefinitionParser.java:486)
at org.apache.flink.cdc.cli.parser.YamlPipelineDefinitionParser.parse(YamlPipelineDefinitionParser.java:130)
at org.apache.flink.cdc.cli.parser.YamlPipelineDefinitionParser.parse(YamlPipelineDefinitionParser.java:125)
at org.dinky.trans.pipeline.FlinkCDCPipelineOperation.execute(FlinkCDCPipelineOperation.java:98)
... 165 more
Process FlinkSubmit/21 exit with status:FAILED
What you expected to happen
EXECUTE PIPELINE WITH YAML (
pipeline:
name: mysql2sr_pip
parallelism: 4
source:
type: mysql
hostname: ***
port: 3306
username: flink_cdc
password: ***
jdbc-properties:
useSSL: false
allowPublicKeyRetrieval: true
database: wms_his
table: wms_his.cdc_user
snapshot:
allow-empty: true
chunk-key-column: id
chunk-size: 8096
server-id: 1001-1008
server-time-zone: Asia/Shanghai
enable-binlog-read: true
sink:
type: starrocks
load-url: :8030
jdbc-url: jdbc:mysql://:9030/wms_his
username: wms_sr
password: ****
database: wms_his
auto-table-creation: true
schema-auto-merge: true
upsert: true
primary-key-follow-source: true
route:
- source-table: wms_his.cdc_user
sink-database: wms_his
ddl-sync: true
)
How to reproduce
执行以上pipline报错
Anything else
执行以上pipline报错
Version
1.2.0
Are you willing to submit PR?
Code of Conduct