/
CHANGES.txt
325 lines (231 loc) · 12.3 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
STELLA, CHANGES
#### 2.1.2 (2011-07-06) ###############################
* FIXED: Stella::Report#postprocess loads log from a hash.
* ADDED: Wait only up to 35 seconds for a remote checkup
* CHANGE: Move stella/api.rb content to stella.rb
* CHANGE: CLI output
* CHANGE: Removed Stella::Template and require 'erb'
#### 2.1.1 (2011-07-06) ###############################
* ADDED: Append more info URI to CLI output for remote checkups
#### 2.1.0 (2011-07-06) ###############################
* FIXED: Different CLI output when a testplan is specified
* ADDED: Handle bad or missing api credentials
* ADDED: Globals -A and -K for supplying API credentials
* CHANGE: Default output is now CLI (use -F json)
* CHANGE: Global -f is now -u (for usecase)
* CHANGE: Global -F is now -f (output format)
* CHANGE: STELLA_USER env var is now STELLA_ACCOUNT
#### 2.0.3 (2011-07-06) ###############################
* ADDED: Stella::API
* ADDED: --remote global for running checkups via www.blamestella.com (beta)
#### 2.0.2 (2011-06-09) ###############################
* FIXED: Gibbler ID fixes
* ADDED: --wait option for checkup command
* CHANGE: Don't freeze testplan
#### 2.0.1 (2011-06-08) ###############################
NOTE: First release of 2.x.
#### 0.8.X (XXXX-XX-XX) ###############################
NOTE: We're now focusing our effort on 2.0, so these features are still
outstanding for a 1.x release (they probably won't be worked on).
* TODO: Force response block content type.
* TODO: Add option to dump full request/response output to a file by client
* TODO: review cookie handling. Not always sent automatically.
* TODO: review :variables in URI elements
* TODO: global responses
* TODO: request block conditions.
* TODO: process templates for calls to set in get blocks
#### 0.8.8 (2011-02-26) ###############################
* FIXED: Require benelux 0.5.17 (fixed for Ruby 1.9.2)
#### 0.8.7.002 (2010-06-14) ###############################
* FIXED: Specifying a host w/ a path and no testplan no longer doubles up the path
* ADDED: Global HTTP client timeout ("stella -T 60")
* CHANGE: Timeouts are reported as exceptions.
#### 0.8.7 (2010-05-21) ###############################
* FIXED: sequential, rsequential, and random values were broken for Arrays
* FIXED: Support for supplying test durations in the form "5m" (300 seconds)
* CHANGE: Enforce port 443 if port 80 and scheme is HTTPS.
#### 0.8.6 (2010-04-14) ###############################
* FIXED: Wait option and hosts on CLI were not being passed correctly
* CHANGE: Stella::Testplan#userid now used in digest calculation.
* CHANGE: Moved ProcSource to Storable
* CHANGE: Don't auto freeze testrun.
* CHANGE: Store Stella::Data::HTTP::Request#wait as a Range
* ADDED: Stella::Testplan#userid
* ADDED: Stella.post
* ADDED: Stella::Logger.debug
* ADDED: Print wait time for each request at verbose level 3 (-vvv)
#### 0.8.5 (2010-03-27) ###############################
* FIXED: Add User-Agent header if Stella.agent is not null and one is not already provided
* FIXED: Client wait (undefined method '>' for Range error)
* CHANGE: Testrun#samples contains all data samples for each event in a given batch
* CHANGE: Renamed Testrun#events -> Testrun#event_probes
* ADDED: Testrun#logsize
* ADDED: Store HTTP status codes in Testrun#stats
* ADDED: Store error messages in Sample#errors
* ADDED: Stella.get now takes a block
* ADDED: Stella.agent
#### 0.8.4 (2010-03-19) ###############################
* FIXED: Misc issues getting and setting headers, params, and resources
* FIXED: There was no response body in Stella::Engine::Log objects
* CHANGE: Store URIs as strings in Stella::Engine::Log objects
* CHANGE: Stella::Data::HTTP now uses @header instead of @headers
* ADDED: Testrun#etime, Testrun#running?
* ADDED: Testrun.elapsed_seconds
* ADDED: Testrun.granularity which replaces Load::ROTATE_TIMELINE
#### 0.8.3 (2010-03-15) ###############################
* FIXED: Testrun digest handling
* FIXED: Testrun.id will be converted to a Gibbler::Digest if it's a String.
* FIXED: Reconstituting Testrun from a hash (samples and stats)
* CHANGE: Removed dashes from CLI params: notemplate, nostats, nowait, withheader, withparam
* CHANGE: Engine is now called via Testrun#run
* CHANGE: Use the ID attribute (e.g. Testplan.id) instead of digest or digest_cache (which only
be used once to generate an ID
* ADDED: Testrun#client_options
* ADDED: Reconstituting Stella::Testrun and Stella::Testplan objects from JSON/Hash
* ADDED: Testrun objects are now frozen after the run
* ADDED: Testrun#userid, Testrun#runinfo
* ADDED: Default Testrun status is "new"
* ADDED: Testrun#run now accepts an options hash which is passed to Engine#run
* ADDED: Engine option: with_content (populate Testrun#log during a load test)
* ADDED: First batch of requests store header content (for load tests)
#### 0.8.2 (2010-03-05) ###############################
* FIXED: Misc issues with usage via module (Stella::Engine.load)
* FIXED: ANSI code method stubs only created when Drydock not available
* CHANGE: Remove all logs except summary and exceptions
* CHANGE: Renamed .stella/logs/latest/request-exceptions to .stella/logs/latest/exceptions
* CHANGE: Removed unused Load implementations and renamed LoadQueue to Load
* CHANGE: Added proper names for statistics (response_time instead of do_request)
* CHANGE: Benelux 0.5.8 dependency
* CHANGE: Cleaned up generate mode CLI output
* CHANGE: Removed no-logging option
* CHANGE: Renamed Testrun#summary to Testrun#stats
* CHANGE: Pass entire URI when calling Testplan#new
* CHANGE: Engine objects are now classes
* CHANGE: Engine#run methods now return instance of Stella::Testrun
* ADDED: JSON statistics log (.stella/logs/latest/stats)
#### 0.8.1.002 (2010-02-20) ###############################
* FIXED: fail on connection error
* CHANGE: Remove hanna dependency
* CHANGE: Now store complete headers sent rather than just configured.
#### 0.8.1 (2010-02-10) ###############################
* FIXED: Handling of non ASCII characters with Nokogiri parsing in Ruby 1.9
* FIXED: warning in Ruby 1.9
* FIXED: Setting of domain for HTTP authentication when the request URI
is a fully qualified URI.
* CHANGE: Don't attempt to convert parameters or headers to ERB templates.
* CHANGE: Randomize order of usecase when generating load
* CHANGE: noparams and noheader now default to off. Must use with-param and with-header.
* ADDED: Stella.get
#### 0.8.0 (2010-01-16) ###############################
NOTE: The configuration language changed slightly in this release.
See the README for more information on what needs to be updated.
* FIXED: HTTP auth failures
* FIXED: Request timeouts should count towards failures
* FIXED: Stella::Client ID was changing between requests in certain conditions
* FIXED: HTTP delete now works correctly
* FIXED: Missing rsequential method in Container
* FIXED: Don't override user agent header when specified
* FIXED: variables testplan example.
* FIXED: Print reports again when load test is interrupted
* FIXED: Sporadic ERB template error under high concurrency
* CHANGE: A proper message displayed when no host specified
* CHANGE: Don't append httpclient info to User-Agent header
* CHANGE: param and header helper methods now return strings instead of Procs.
* CHANGE: Verbosity level 2 now prints only params, 3 w/ headers, 4 w/ body
* ADDED: follow responses can contain definition blocks
* ADDED: Support for specifying default path prefix on CLI
* ADDED: Support for specifying timeouts
* ADDED: Friendly error for empty request configs
#### 0.7.7 (2009-12-05) ###############################
* FIXED: JSON parse error when nil body
* FIXED: URI query parameter encoding
* CHANGE: Removed Stella::Testplan::Stats
* CHANGE: Better output for errors during functional tests
* CHANGE: Global variables now implemented in Stella::Testplan.global
and can be used like usecase and request resources.
* CHANGE: Variable replacement now checks the client container
resources before the usecase resources.
* ADDED: Stella::Testplan#to_json
* ADDED: Stella::Data::Helpers#read_file
* ADDED: Stella::Data::Helpers#resequential
* ADDED: Stella::Data::Helpers#path
* ADDED: no-param, no-header options
* ADDED: Follow redirects within one request definition
* ADDED: Support for specifying HTTP AUTH domain in usecase config
#### 0.7.6 (2009-11-24) ###############################
* FIXED: httpclient fix: use full request URI (i.e. path and query string) in authentication (NOTE: SSPINegotiateAuth and NegotiateAuth not tested)
* FIXED: Use request URI in authentication domain
#### 0.7.5 (2009-11-16) ###############################
* FIXED: Correctly capture exceptions in Client
* FIXED: Issue with printing the dot (.) for the start of every usecase
* FIXED: Stats samples not cleared between background calculations
* CHANGE: Do not include testplan, usecase, or request descriptions in digest calculation
* CHANGE: Use 6 digit digest in log directory names
* CHANGE: Client aborts usecase on unhandled exceptions
* ADDED: Support for $perlstyle variables in config
* ADDED: Print log dir below summary report
#### 0.7.4 (2009-11-11) ###############################
* FIXED: Proper handling for timeout errors
* CHANGE: Log directory is now YYYYMMDD-HH-mm-ss-SHA1
* ADDED: Logging to .stella/log
* ADDED: Global variables via --var
* ADDED: Using naive CSV parsing via quickcsv (CSV lib is slooow for large files)
* ADDED: Testplan file cache (load a file only once)
#### 0.7.3 (2009-10-30) ###############################
* FIXED: warning: regexp match /.../n against to UTF-8 string
* ADDED: Arrival rate
* ADDED: Added HTTP auth per request
#### 0.7.2 (2009-10-29) ###############################
* FIXED: bin/stella exits with 1 if any request fails.
* CHANGE: sequential and rsequential resourcing is now global
across all clients.
* ADDED: Automatic form parsing for html pages
* ADDED: Container now has params and headers from the request
* ADDED: Assume HTTP response codes >= 400 are failed requests
unless a response block is defined for that status in which
case the block must return fail.
* ADDED: Support for HTTP Basic authentication
* ADDED: Templating for resources parameters and headers.
* ADDED: Built-in variable :HOSTNAME can be overriden by CLI argument.
* ADDED: Automatic JSON parsing in response blocks (as 'doc')
#### 0.7.1 (2009-10-21) ###############################
NOTE: Complete rewrite. Features include:
* New internal architecture.
* Improved stability and output for high thread loads.
* Updated configuration syntax
* Granular reporting via Benelux
#### 0.6.0 (2009-03-15) ###############################
http://github.com/solutious/stella/tree/0.6
* COMPLETE REWRITE!
* The commands and API from 0.5.x are no longer supported. This ain't your grandmother's Stella.
* NEW: Tests are now defined using a DSL. See tryouts/dsl_tryout.rb for an example.
* NEW: Tests are run with Ruby directly: ruby testplan.rb (for now)
#### 0.5.6 (2009-02-04) ###############################
* API Change: watch is replaced by pcap and proxy.
* "stella watch -C" is now "stella pcap"
* "stella watch -P" is now "stella proxy"
* Fixed body printing bug for stella -v watch -C
* Added adapter tests
* Improved RDocs
#### 0.5.5 (2009-01-14) ###############################
http://github.com/solutious/stella/tree/stella-0.5.5
* Now has specs (33 specifications, 303 requirements)
* New dependency: test-spec (development copy only)
* Added delano/drydock to vendor (was delano/frylock).
* Improved argument handling for load tool adapters (httperf not complete)
* Re-built Stella::Storable and subclasses (now using "field" method)
* Test::Stats, Test::Run::Summary cleanup
* Fixed RubyGems require error
* Fixed stddev bug by removing weak math, adding stats class from Mongrel
* Fixed --agent error
#### 0.5.4-alpha (2009-01-07) #########################
http://github.com/solutious/stella/tree/stella-0.5.4-alpha
* New command: watch. Monitor HTTP traffic with Ruby-Pcap (unix only) or proxy. Pcap also supports DNS sniffing.
* Improved error handling for stats output
* Now runs on Ruby 1.9.1, JRuby
* Added Windows support for most features
* Added patch for Ruby-Pcap
* Added friendly error handling for Apache Bench, Siege, and Httperf
#### 0.5.3-preview (2008-12-23) #######################
http://github.com/solutious/stella/tree/e4d2bd8db3d1323fbc3b8bbb7f703ce7b8c88551
* Initial public release