You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I had searched in the issues and found no similar issues.
What happened
set'pipeline.operator-chaining'='true';
-- register a MySQL table 'users' in Flink SQL-- crm_v_t_we_work_chatdroptable if exists crm_v_t_we_work_chat_target;
CREATETABLE `crm_v_t_we_work_chat_target` (
`id`int,
`chat_id`varchar(50),
`chat_name`varchar(50),
`chat_owner`varchar(50),
`chat_create_time`timestamp,
`create_time`timestamp,
`update_time`timestamp,
`project_type`int,
`record_day`varchar(10),
`chat_type`varchar(50),
`has_delete`BOOLEAN,
`dismiss_time`timestamp,
PRIMARY KEY (`id`) NOT ENFORCED
) WITH (
'connector'='jdbc',
'url'='jdbc:mysql://host:3306/crm?useSSL=false',
'username'='',
'password'='',
'table-name'='crm_v_t_we_work_chat'
);
droptable if exists we_work_chat_source;
CREATETABLE `we_work_chat_source` (
`id`int,
`chat_id`varchar(50),
`chat_name`varchar(50),
`chat_owner`varchar(50),
`chat_create_time`timestamp,
`create_time`timestamp,
`update_time`timestamp,
`project_type`int,
`record_day`varchar(10),
`chat_type`varchar(50),
`has_delete`BOOLEAN,
`dismiss_time`timestamp,
PRIMARY KEY (`id`) NOT ENFORCED
) WITH (
'connector'='mysql-cdc',
'hostname'='',
'port'='3306',
'username'='',
'password'='',
'database-name'='jx_we_work',
'table-name'='we_work_chat',
'server-id'='240229001',
'scan.startup.mode'='timestamp',
'scan.startup.timestamp-millis'='${dateUtil.current() - 1800000}'
);
-- write data into the JDBC table from the other table "T"insert into crm_v_t_we_work_chat_target select*from we_work_chat_source;
flinksql job use yarn-application submit yarn
error message detail:
Caused by: org.dinky.data.exception.DinkyException: The variable name or jexl key of sql dateUtil.current() - 60000 does not exist.
at org.dinky.executor.VariableManager.getVariable(VariableManager.java:178) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]
at org.dinky.executor.VariableManager.replaceVariable(VariableManager.java:267) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]
at org.dinky.executor.VariableManager.parseVariable(VariableManager.java:249) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]
What you expected to happen
job can normal running
How to reproduce
use expression variable and submit a job with yarn application
Zzm0809
changed the title
yarn application mode not support expression variable
[Bug] yarn application mode not support expression variable
Mar 1, 2024
Search before asking
What happened
flinksql job use yarn-application submit yarn
error message detail:
Caused by: org.dinky.data.exception.DinkyException: The variable name or jexl key of sql dateUtil.current() - 60000 does not exist.
at org.dinky.executor.VariableManager.getVariable(VariableManager.java:178) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]
at org.dinky.executor.VariableManager.replaceVariable(VariableManager.java:267) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]
at org.dinky.executor.VariableManager.parseVariable(VariableManager.java:249) ~[dinky-app-1.15-1.0.0-rc4-jar-with-dependencies.jar:?]
What you expected to happen
job can normal running
How to reproduce
use expression variable and submit a job with yarn application
Anything else
No response
Version
dev
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: