Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][DataProxy] DataProxy is not sending data to Pulsar #5110

Closed
2 tasks done
dadalongvs opened this issue Jul 19, 2022 · 12 comments
Closed
2 tasks done

[Bug][DataProxy] DataProxy is not sending data to Pulsar #5110

dadalongvs opened this issue Jul 19, 2022 · 12 comments
Labels

Comments

@dadalongvs
Copy link

What happened

dp is not sending data to pulsar.
image
image

What you expected to happen

There is a record of data consumption in pulsar, and the last data generated in clickhouse.

How to reproduce

When I finished the approval and kept adding data to the local source file, no data was generated in clickhouse. Finally, after finding the problem, I found that there was no data in pulsar.
image
image
image

Environment

centos 7

InLong version

master

InLong Component

InLong DataProxy

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

@dadalongvs dadalongvs added the type/bug Something is wrong label Jul 19, 2022
@baomingyu
Copy link
Contributor

Message has been sent to dp? and If the message has been sent to dp, please confirm whether the expected topic configuration information is contained in conf/topics.properties,

@baomingyu
Copy link
Contributor

In addition, please check whether the log contains the following information。
image
image

@dadalongvs
Copy link
Author

@baomingyu
image
image
There is this error in inlong-dataproxy/logs/.
image

@baomingyu
Copy link
Contributor

Please check if this topic exists in the pulsar cluster. and check the initial configuration steps of the cluster. If the initial configuration information of the cluster in the Manager is incorrect, the topic may not be created in advance.

@dadalongvs
Copy link
Author

@baomingyu
There is a corresponding topic in pulsar, but the topic always shows no data consumption

@dockerzhang
Copy link
Contributor

this issue may be the same with #5163, and we will look into it.

@dockerzhang
Copy link
Contributor

fixed in #5189. Please check again.

@healchow healchow changed the title [Bug]dp is not sending data to pulsar [Bug][DataProxy] DataProxy is not sending data to Pulsar Jul 24, 2022
@dadalongvs
Copy link
Author

When I use the latest code, I still can't get the data to pulsar, and new errors occurs.
agent_errorlog
managererrorlog

@ly100120
Copy link

这个问题你是否已经解决?我碰到了同样的问题,束手无策。1.4.0版本

@github-actions
Copy link

This issue is stale because it has been open for 60 days with no activity.

@github-actions github-actions bot added the stage/stale Issues or PRs that had no activity for a long time label Nov 15, 2022
@dockerzhang
Copy link
Contributor

@ly100120 please add the steps to reproduce the issue.

@github-actions github-actions bot removed the stage/stale Issues or PRs that had no activity for a long time label Nov 23, 2022
@dockerzhang
Copy link
Contributor

@ly100120 please try the latest code, and create a new Issue if it appears again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants