[Bug] yarn application mode not support expression variable

[ningyanhui]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

set 'pipeline.operator-chaining'='true';
-- register a MySQL table 'users' in Flink SQL
-- crm_v_t_we_work_chat
drop table if exists crm_v_t_we_work_chat_target;
CREATE TABLE `crm_v_t_we_work_chat_target` (
  `id` int,
  `chat_id` varchar(50),
  `chat_name` varchar(50),
  `chat_owner` varchar(50),
  `chat_create_time` timestamp,
  `create_time` timestamp,
  `update_time` timestamp,
  `project_type` int,
  `record_day` varchar(10),
  `chat_type` varchar(50),
  `has_delete` BOOLEAN,
  `dismiss_time` timestamp,
  PRIMARY KEY (`id`) NOT ENFORCED
)  WITH (
   'connector' = 'jdbc',
   'url' = 'jdbc:mysql://host:3306/crm?useSSL=false',
   'username' = '',
   'password' = '',
   'table-name' = 'crm_v_t_we_work_chat'
);

drop table if exists we_work_chat_source;
CREATE TABLE `we_work_chat_source` (
  `id` int,
  `chat_id` varchar(50),
  `chat_name` varchar(50),
  `chat_owner` varchar(50),
  `chat_create_time` timestamp,
  `create_time` timestamp,
  `update_time` timestamp,
  `project_type` int,
  `record_day` varchar(10),
  `chat_type` varchar(50),
  `has_delete` BOOLEAN,
  `dismiss_time` timestamp,
  PRIMARY KEY (`id`) NOT ENFORCED
)  WITH (
   'connector' = 'mysql-cdc',
    'hostname' = '',
    'port' = '3306',
    'username' = '',
    'password' = '',
    'database-name' = 'jx_we_work',
    'table-name' = 'we_work_chat',
    'server-id' = '240229001',
    'scan.startup.mode' = 'timestamp',
    'scan.startup.timestamp-millis' = '${dateUtil.current() - 1800000}'
);

-- write data into the JDBC table from the other table "T"
insert into crm_v_t_we_work_chat_target select * from we_work_chat_source;

flinksql job use yarn-application submit yarn

error message detail:
Caused by: org.dinky.data.exception.DinkyException: The variable name or jexl key of sql dateUtil.current() - 60000 does not exist.
at org.dinky.executor.VariableManager.getVariable(VariableManager.java:178) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]
at org.dinky.executor.VariableManager.replaceVariable(VariableManager.java:267) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]
at org.dinky.executor.VariableManager.parseVariable(VariableManager.java:249) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]

What you expected to happen

job can normal running

How to reproduce

use expression variable and submit a job with yarn application

Anything else

No response

Version

dev

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[github-actions]

Hello @ningyanhui, this issue is about CDC/CDCSOURCE, so I assign it to @aiwenmo. If you have any questions, you can comment and reply.

你好 @ningyanhui, 这个 issue 是关于 CDC/CDCSOURCE 的，所以我把它分配给了 @aiwenmo。如有任何问题，可以评论回复。