Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker: transform multiagent mode into multisink in a single agent #1675

Closed
AlvaroVega opened this issue Jun 20, 2019 · 4 comments
Closed

Docker: transform multiagent mode into multisink in a single agent #1675

AlvaroVega opened this issue Jun 20, 2019 · 4 comments

Comments

@AlvaroVega
Copy link
Member

AlvaroVega commented Jun 20, 2019

Currently in multiagent is using one agent for sink.
· agent_mysql.conf
cygnus-ngsi.sources = http-source
cygnus-ngsi.sinks = mysql-sink
cygnus-ngsi.channels = mysql-channel
cygnus-ngsi.sources.http-source.channels = mysql-channel
cygnus-ngsi.sources.http-source.port = 5050
· agent_mongo.conf
cygnus-ngsi.sources = http-source
cygnus-ngsi.sinks = mongo-sink
cygnus-ngsi.channels = mongo-channel
cygnus-ngsi.sources.http-source.channels = mongo-channel
cygnus-ngsi.sources.http-source.port = 5051

The desired behaviour is to have one single agent conf with several sinks:
· agent.conf
cygnus-ngsi.sources = http-source-mysql http-source-mongo
cygnus-ngsi.sinks = mysql-sink mongo-sink
cygnus-ngsi.channels = mysql-channel mongo-channel
cygnus-ngsi.sources.http-source-mysql.channels = mysql-channel
cygnus-ngsi.sources.http-source-mysql.port = 5050
cygnus-ngsi.sources.http-source-mongo.channels = mongo-channel
cygnus-ngsi.sources.http-source-mysql.port = 5051

I guess this change will reduce usage or resources (from N java process -> 1 java process)

@fgalan
Copy link
Member

fgalan commented Jun 20, 2019

Currently, we have one agent per process per sink. I mean something like this (port number maybe are not the official ones I'm using the number only to illustrate)

  • Process 1, port 5050, sink MySQL
  • Process 2, port 5051, sink CKAN
  • Process 3, port 5052, sink HDFS
    ...

I think the idea is keeping the same association (i.e. port 5050 for MySQL, port 5051 for CKAN, port 5052 per HDFS) so from a functional point of view the behavior for end systems in the same but having only one Java process.

@AlvaroVega
Copy link
Member Author

Yes, it will keep current port association to sink like you said.

@AlvaroVega
Copy link
Member Author

implemented in #1678

@fgalan
Copy link
Member

fgalan commented Jun 25, 2019

Can be closed now that PR #1678 has been merged?

@fgalan fgalan added this to the release/1.15.0 milestone Jun 25, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants