[STORM-340] Add topology submission REST API and UI button

[jira-importer]

STORM-205 added REST API to Storm, but these API are only used to monitor/manage a topology. Users still have to submit a new topology through command line. We can design a new REST API to achieve this so that a client outside of a Storm cluster can submit and manage topologies remotely.

This is the API I have in mind:
/api/topology/:id (PUT)
In the body the user can specify the jar location and class name.

However, user still need to upload the jar to nimbus, for which we have two choices:
1) design an API to upload the jar (e.g. in base64) then reference the upload location in topology submission API:
/api/jarupload/:loc (POST)
2) make storm support hadoop file system so that we can upload the jar to HDFS then call the submission API.

Further we can add a button to storm UI, using which one can submit a new topology.

---

Originally reported by shanyu, imported from: Add topology submission REST API and UI button

• assignee: sriharsha
• status: Resolved
• priority: Major
• resolution: Duplicate
• resolved: 2015-07-10T17:01:32+01:00
• imported: 2025-01-24

[jira-importer]

jwellington:

There is already an API to submit Topologies programmatically through the Thrift Interface to Nimbus:

See Thrift definition here:

https://github.com/apache/incubator-storm/blob/master/storm-core/src/storm.thrift

I have done this myself before. You upload the jar in chunks, and then send it the Job definition telling it to the use the said jar.

Building a UI for it is another thing entirely. I agree though this is something that should be baked in to the existing UI.

[jira-importer]

mohandv:

Juan Moreno the Link https://github.com/apache/incubator-storm/blob/master/storm-core/src/storm.thrift is broken , can you provide the API details to submit a Topologies programmatically

[jira-importer]

srdo:

The current link is https://github.com/apache/storm/blob/4966d7a69318d2ca690c47dd43466b03574e5e9e/storm-client/src/storm.thrift, without knowing more about this I'd guess looking at

storm/storm-client/src/storm.thrift

Line 668 in 4966d7a

void submitTopology(1: string name, 2: string uploadedJarLocation, 3: string jsonConf, 4: StormTopology topology) throws (1: AlreadyAliveException e, 2: InvalidTopologyException ite, 3: AuthorizationException aze);

might be a place to start?

[jira-importer]

[Duplicates: STORM-615]