Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Sort] Add metric computing for Oracle and MongoDB #5242

Closed
2 tasks done
gong opened this issue Jul 27, 2022 · 0 comments · Fixed by #5298
Closed
2 tasks done

[Feature][Sort] Add metric computing for Oracle and MongoDB #5242

gong opened this issue Jul 27, 2022 · 0 comments · Fixed by #5298

Comments

@gong
Copy link
Contributor

gong commented Jul 27, 2022

Description

Add metric computing for mongodb and oracle

Use case

User only need add with param "inlong.metric":"<groupId>&<streamId>&<nodeId>" when use flink sql.
example:

  create table `table_groupId_streamId_nodeId1`(
    `age` INT,
    `name` STRING,
    PRIMARY KEY(`age`) NOT ENFORCED)
    WITH (
    'connector' = 'mongodb-cdc-inlong',
   'hosts' = 'localhost:27017,localhost:27018,localhost:27019',
   'username' = 'flinkuser',
   'password' = 'flinkpw',
   'database' = 'inventory',
   'collection' = 'products'
   'inlong.metric' = 'pgGroup&pgStream&pgNode1'
);

CREATE TABLE `table_groupId_streamId_nodeId2`(
    PRIMARY KEY (`name`,`age`) NOT ENFORCED,
    `name` STRING,
    `age` INT)
    WITH (
    'connector' = 'print'
);

   INSERT INTO `table_groupId_streamId_nodeId2`
    SELECT
    `name` AS `name`,
    `age` AS `age`
    FROM `table_groupId_streamId_nodeId1`;

wo can set flink-conf.yaml add metric report

metric.reporters: promgateway
metrics.reporter.promgateway.class: org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter
metrics.reporter.promgateway.host: ip
metrics.reporter.promgateway.port: 9091
metrics.reporter.promgateway.interval: 60 SECONDS
metrics.reporter.promgateway.filterLabelValueCharacters: false

we can see metric in pushgateway.

I will add this feature for oracle cdc and mongodb cdc
link issue

No response

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

@healchow healchow changed the title [Feature] [Sort] Add metric computing for mongodb and oracle [Feature][Sort] Add metric computing for Oracle and MongoDB Jul 28, 2022
@healchow healchow added this to the 1.3.0 milestone Jul 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants