-
Notifications
You must be signed in to change notification settings - Fork 205
/
worker.go
272 lines (237 loc) · 13.2 KB
/
worker.go
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
// The MIT License
//
// Copyright (c) 2020 Temporal Technologies Inc. All rights reserved.
//
// Copyright (c) 2020 Uber Technologies, Inc.
//
// Permission is hereby granted, free of charge, to any person obtaining a copy
// of this software and associated documentation files (the "Software"), to deal
// in the Software without restriction, including without limitation the rights
// to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
// copies of the Software, and to permit persons to whom the Software is
// furnished to do so, subject to the following conditions:
//
// The above copyright notice and this permission notice shall be included in
// all copies or substantial portions of the Software.
//
// THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
// IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
// FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
// AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
// LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
// OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
// THE SOFTWARE.
package internal
import (
"context"
"time"
)
type (
// WorkerOptions is used to configure a worker instance.
// The current timeout resolution implementation is in seconds and uses math.Ceil(d.Seconds()) as the duration. But is
// subjected to change in the future.
WorkerOptions struct {
// Optional: To set the maximum concurrent activity executions this worker can have.
// The zero value of this uses the default value.
// default: defaultMaxConcurrentActivityExecutionSize(1k)
MaxConcurrentActivityExecutionSize int
// Optional: Sets the rate limiting on number of activities that can be executed per second per
// worker. This can be used to limit resources used by the worker.
// Notice that the number is represented in float, so that you can set it to less than
// 1 if needed. For example, set the number to 0.1 means you want your activity to be executed
// once for every 10 seconds. This can be used to protect down stream services from flooding.
// The zero value of this uses the default value
// default: 100k
WorkerActivitiesPerSecond float64
// Optional: To set the maximum concurrent local activity executions this worker can have.
// The zero value of this uses the default value.
// default: 1k
MaxConcurrentLocalActivityExecutionSize int
// Optional: Sets the rate limiting on number of local activities that can be executed per second per
// worker. This can be used to limit resources used by the worker.
// Notice that the number is represented in float, so that you can set it to less than
// 1 if needed. For example, set the number to 0.1 means you want your local activity to be executed
// once for every 10 seconds. This can be used to protect down stream services from flooding.
// The zero value of this uses the default value
// default: 100k
WorkerLocalActivitiesPerSecond float64
// Optional: Sets the rate limiting on number of activities that can be executed per second.
// This is managed by the server and controls activities per second for your entire taskqueue
// whereas WorkerActivityTasksPerSecond controls activities only per worker.
// Notice that the number is represented in float, so that you can set it to less than
// 1 if needed. For example, set the number to 0.1 means you want your activity to be executed
// once for every 10 seconds. This can be used to protect down stream services from flooding.
// The zero value of this uses the default value.
// default: 100k
TaskQueueActivitiesPerSecond float64
// Optional: Sets the maximum number of goroutines that will concurrently poll the
// temporal-server to retrieve activity tasks. Changing this value will affect the
// rate at which the worker is able to consume tasks from a task queue.
// default: 2
MaxConcurrentActivityTaskPollers int
// Optional: To set the maximum concurrent workflow task executions this worker can have.
// The zero value of this uses the default value.
// default: defaultMaxConcurrentTaskExecutionSize(1k)
MaxConcurrentWorkflowTaskExecutionSize int
// Optional: Sets the maximum number of goroutines that will concurrently poll the
// temporal-server to retrieve workflow tasks. Changing this value will affect the
// rate at which the worker is able to consume tasks from a task queue. Due to
// internal logic where pollers alternate between stick and non-sticky queues, this
// value cannot be 1 and will panic if set to that value.
// default: 2
MaxConcurrentWorkflowTaskPollers int
// Optional: Enable logging in replay.
// In the workflow code you can use workflow.GetLogger(ctx) to write logs. By default, the logger will skip log
// entry during replay mode so you won't see duplicate logs. This option will enable the logging in replay mode.
// This is only useful for debugging purpose.
// default: false
EnableLoggingInReplay bool
// Optional: Disable sticky execution.
// Sticky Execution is to run the workflow tasks for one workflow execution on same worker host. This is an
// optimization for workflow execution. When sticky execution is enabled, worker keeps the workflow state in
// memory. New workflow task contains the new history events will be dispatched to the same worker. If this
// worker crashes, the sticky workflow task will timeout after StickyScheduleToStartTimeout, and temporal server
// will clear the stickiness for that workflow execution and automatically reschedule a new workflow task that
// is available for any worker to pick up and resume the progress.
// default: false
//
// Deprecated: DisableStickyExecution harms performance. It will be removed soon. See SetStickyWorkflowCacheSize
// instead.
DisableStickyExecution bool
// Optional: Sticky schedule to start timeout.
// The resolution is seconds. See details about StickyExecution on the comments for DisableStickyExecution.
// default: 5s
StickyScheduleToStartTimeout time.Duration
// Optional: sets root context for all activities. The context can be used to pass external dependencies
// like DB connections to activity functions.
// Note that this method of passing dependencies is not recommended anymore.
// Instead, use a structure with fields that contain dependencies and activities
// as the structure member functions. Then pass all the dependencies on the structure initialization.
BackgroundActivityContext context.Context
// Optional: Sets how workflow worker deals with non-deterministic history events
// (presumably arising from non-deterministic workflow definitions or non-backward compatible workflow
// definition changes) and other panics raised from workflow code.
// default: BlockWorkflow, which just logs error but doesn't fail workflow.
WorkflowPanicPolicy WorkflowPanicPolicy
// Optional: worker graceful stop timeout
// default: 0s
WorkerStopTimeout time.Duration
// Optional: Enable running session workers.
// Session workers is for activities within a session.
// Enable this option to allow worker to process sessions.
// default: false
EnableSessionWorker bool
// Uncomment this option when we support automatic restablish failed sessions.
// Optional: The identifier of the resource consumed by sessions.
// It's the user's responsibility to ensure there's only one worker using this resourceID.
// For now, if user doesn't specify one, a new uuid will be used as the resourceID.
// SessionResourceID string
// Optional: Sets the maximum number of concurrently running sessions the resource support.
// default: 1000
MaxConcurrentSessionExecutionSize int
// Optional: If set to true, a workflow worker is not started for this
// worker and workflows cannot be registered with this worker. Use this if
// you only want your worker to execute activities.
// default: false
DisableWorkflowWorker bool
// Optional: If set to true worker would only handle workflow tasks and local activities.
// Non-local activities will not be executed by this worker.
// default: false
LocalActivityWorkerOnly bool
// Optional: If set overwrites the client level Identify value.
// default: client identity
Identity string
// Optional: If set defines maximum amount of time that workflow task will be allowed to run. Defaults to 1 sec.
DeadlockDetectionTimeout time.Duration
// Optional: The maximum amount of time between sending each pending heartbeat to the server. Regardless of
// heartbeat timeout, no pending heartbeat will wait longer than this amount of time to send. To effectively disable
// heartbeat throttling, this can be set to something like 1 nanosecond, but it is not recommended.
// default: 60 seconds
MaxHeartbeatThrottleInterval time.Duration
// Optional: The default amount of time between sending each pending heartbeat to the server. This is used if the
// ActivityOptions do not provide a HeartbeatTimeout. Otherwise, the interval becomes a value a bit smaller than the
// given HeartbeatTimeout.
// default: 30 seconds
DefaultHeartbeatThrottleInterval time.Duration
// Interceptors to apply to the worker. Earlier interceptors wrap later
// interceptors.
//
// When worker interceptors are here and in client options, the ones in
// client options wrap the ones here. The same interceptor should not be set
// here and in client options.
Interceptors []WorkerInterceptor
// Optional: Callback invoked on fatal error. Immediately after this
// returns, Worker.Stop() will be called.
OnFatalError func(error)
// Optional: Disable eager activities. If set to true, activities will not
// be requested to execute eagerly from the same workflow regardless of
// MaxConcurrentEagerActivityExecutionSize.
//
// Eager activity execution means the server returns requested eager
// activities directly from the workflow task back to this worker which is
// faster than non-eager which may be dispatched to a separate worker.
DisableEagerActivities bool
// Optional: Maximum number of eager activities that can be running.
//
// When non-zero, eager activity execution will not be requested for
// activities schedule by the workflow if it would cause the total number of
// running eager activities to exceed this value. For example, if this is
// set to 1000 and there are already 998 eager activities executing and a
// workflow task schedules 3 more, only the first 2 will request eager
// execution.
//
// The default of 0 means unlimited and therefore only bound by
// MaxConcurrentActivityExecutionSize.
//
// See DisableEagerActivities for a description of eager activity execution.
MaxConcurrentEagerActivityExecutionSize int
// Optional: Disable allowing workflow and activity functions that are
// registered with custom names from being able to be called with their
// function references.
//
// Users are strongly recommended to set this as true if they register any
// workflow or activity functions with custom names. By leaving this as
// false, the historical default, ambiguity can occur between function names
// and aliased names when not using string names when executing child
// workflow or activities.
DisableRegistrationAliasing bool
}
)
// WorkflowPanicPolicy is used for configuring how worker deals with workflow
// code panicking which includes non backwards compatible changes to the workflow code without appropriate
// versioning (see workflow.GetVersion).
// The default behavior is to block workflow execution until the problem is fixed.
type WorkflowPanicPolicy int
const (
// BlockWorkflow is the default policy for handling workflow panics and detected non-determinism.
// This option causes workflow to get stuck in the workflow task retry loop.
// It is expected that after the problem is discovered and fixed the workflows are going to continue
// without any additional manual intervention.
BlockWorkflow WorkflowPanicPolicy = iota
// FailWorkflow immediately fails workflow execution if workflow code throws panic or detects non-determinism.
// This feature is convenient during development.
// WARNING: enabling this in production can cause all open workflows to fail on a single bug or bad deployment.
FailWorkflow
)
// ReplayNamespace is namespace for replay because startEvent doesn't contain it
const ReplayNamespace = "ReplayNamespace"
// IsReplayNamespace checks if the namespace is from replay
func IsReplayNamespace(dn string) bool {
return ReplayNamespace == dn
}
// NewWorker creates an instance of worker for managing workflow and activity executions.
// client - client created with client.Dial() or client.NewLazyClient().
// taskQueue - is the task queue name you use to identify your client worker, also
// identifies group of workflow and activity implementations that are hosted by a single worker process.
// options - configure any worker specific options.
func NewWorker(
client Client,
taskQueue string,
options WorkerOptions,
) *AggregatedWorker {
workflowClient, ok := client.(*WorkflowClient)
if !ok {
panic("Client must be created with client.Dial() or client.NewLazyClient()")
}
return NewAggregatedWorker(workflowClient, taskQueue, options)
}