-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
provide a response description for supervisor status api #15031
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change | ||||
---|---|---|---|---|---|---|
|
@@ -1311,6 +1311,29 @@ Host: http://ROUTER_IP:ROUTER_PORT | |||||
``` | ||||||
</details> | ||||||
|
||||||
#### Response Description | ||||||
The response `payload` contains the following structure: | ||||||
|
||||||
|Property|Type|Description| | ||||||
|---|---|---| | ||||||
|`dataSource`|String|The target datasource.| | ||||||
|`stream`|String|Name of the topic or stream that the ingestion is reading from.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|`partitions`|Integer|Number of partitions in the source stream.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|`replicas`|Integer|Number of replicas being used per task for high availability where 1 means no redundancy.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|`durationSeconds`|Integer|Seconds that each task spends reading before moving to a publishing state.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|`activeTasks`|Array of Object|Lists the tasks that are reading from the stream, each with: <table><tbody><tr><td>`startTime`</td><td>String</td><td>Task start time.</td></tr><tr><td>`remainingTime`</td><td>Integer</td><td>The time remaining in the reading state</td><tr><tr><td>`currentOffsets`</td><td>Map < String , Integer ></td><td>The list of partitions that the task is reading from with the latest offset consumed from each.</td></tr><tr><td>`lag`</td><td>Map < String , Integer ></td><td>The number of messages pending to read from each partition.</td></tr></tbody></table> | | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Instead of a nested table, consider creating a separate table for Also, the Map interface should probably be in code font. |
||||||
|`publishingTasks`|Array of Object|Lists the tasks that are publishing segments to Deep Storage and awaiting handoff confirmation. For detailed structure see `activeTasks` above.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|`latestOffsets`|Map < String, Integer >|The lastest offset consumed from the stream by partition.| | ||||||
|`minimumLag`|Map < String, Integer >|The number of messages pending to read from stream by partition.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Should the Map interface be in code font? |
||||||
|`aggregateLag`|Integer|The sum of minimum lags (see above) across all partitions.| | ||||||
|`offsetLastUpdated`|String|Contains the timestamp of when the stream offsets were last inspected.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|`suspended`|Boolean|True if the supervisor is in a SUSPENDED state.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|`healthy`|Boolean|True if the supervisor and its tasks are currently healthy.| | ||||||
|`state`|String|Overall state of the supervisor. | | ||||||
|`detailedState`|String|Current stage of processing for the supervisor.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Should this say "state" instead of "stage"? |
||||||
|`recentErrors`|Array of String|Errors reported recently by supervisor managed tasks.| | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
|
||||||
## Audit history | ||||||
|
||||||
An audit history provides a comprehensive log of events, including supervisor configuration, creation, suspension, and modification history. | ||||||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.