Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Newer
Older
100644 53 lines (36 sloc) 2.493 kb
e2ce67a @AlexBaranosky [Issue #82] adding backlog file for the formula epic
AlexBaranosky authored
1
a9286d3 @AlexBaranosky [Issue #82] updated backlog with new insights
AlexBaranosky authored
2 * [x] improve formula failure reporting
3 a. [x] report the first failure
4 b. [x] make sure the fact count only increases once per formula
e2ce67a @AlexBaranosky [Issue #82] adding backlog file for the formula epic
AlexBaranosky authored
5
a9286d3 @AlexBaranosky [Issue #82] updated backlog with new insights
AlexBaranosky authored
6 * [x] make number of generated facts per formula dynamically bindable
968f636 @AlexBaranosky renames and cleanups etc.
AlexBaranosky authored
7 a. [x] throw an exception if this value is set < 1
e2ce67a @AlexBaranosky [Issue #82] adding backlog file for the formula epic
AlexBaranosky authored
8
a9286d3 @AlexBaranosky [Issue #82] updated backlog with new insights
AlexBaranosky authored
9 * [x] figure out how to make syntax validation errors show something more sensible than the
10 error message you'd see for a problem with a fact validation problem
fdae82b @AlexBaranosky [Issue #82] updating formulas backlog
AlexBaranosky authored
11
9980189 @AlexBaranosky [Issue #82] updated backlog; organized t-formula
AlexBaranosky authored
12 * [x] don't run more tests than need be if there is already failure in this formula's batch.
e2ce67a @AlexBaranosky [Issue #82] adding backlog file for the formula epic
AlexBaranosky authored
13
1ae1ad3 @AlexBaranosky [Issue #82] updates to formula backlog
AlexBaranosky authored
14 * [x] syntax validate thata formula only has one check in it
57ed06c @AlexBaranosky [Issue #82] a lot more syntax validations for formula
AlexBaranosky authored
15 a. [x] need to make this more thorough... right now the only test of this feature checks a
1ae1ad3 @AlexBaranosky [Issue #82] updates to formula backlog
AlexBaranosky authored
16 simple provided case, but needs to work with against-background, background and
57ed06c @AlexBaranosky [Issue #82] a lot more syntax validations for formula
AlexBaranosky authored
17 other more interesting cases
18 b. [ ] it is more thorough now, but let's make it *seriously* thoough :)
1ae1ad3 @AlexBaranosky [Issue #82] updates to formula backlog
AlexBaranosky authored
19
20 * [x] formula macro calls a (constantly []) version of shrink on failures
d0165f2 @AlexBaranosky [Issue #82] updated formula backlog
AlexBaranosky authored
21
df6caf7 @AlexBaranosky [Issue #82] added notion of a future-formula/pending-formula/incipient-f...
AlexBaranosky authored
22 * [x] add future-formula (and variant names)
d6c488a @AlexBaranosky [Issue #82] added opt-map to formulas with :num-trials key to specify nu...
AlexBaranosky authored
23
24 * [x] cleaner syntax for overriding number of trials per formula. Use the
0b44a64 @AlexBaranosky [Issue #82] renamed *num-generations-per-formula* -> *num-trials*
AlexBaranosky authored
25 *num-trials* var just for global changes or changes to be visible
d6c488a @AlexBaranosky [Issue #82] added opt-map to formulas with :num-trials key to specify nu...
AlexBaranosky authored
26 for groups of formulas.
27
e81ea73 @AlexBaranosky [Issue #82] validate that only valid opt-map keys is :num-trials
AlexBaranosky authored
28 * [x] validate that opt-map is only used with valid keys.
d6c488a @AlexBaranosky [Issue #82] added opt-map to formulas with :num-trials key to specify nu...
AlexBaranosky authored
29
5906a1d @AlexBaranosky [Issue #82] validate that :num-trials can only be set to 1+
AlexBaranosky authored
30 * [x] validate that :num-trials is 1+
df6caf7 @AlexBaranosky [Issue #82] added notion of a future-formula/pending-formula/incipient-f...
AlexBaranosky authored
31
064624b @AlexBaranosky [Issue #82] updating backlog
AlexBaranosky authored
32 * [ ] Work with Meikel Brandmeyer to combine ClojureCheck's Generators with Shrink.
33 implement shrinking. Report only the first fully shrunken failure
1ae1ad3 @AlexBaranosky [Issue #82] updates to formula backlog
AlexBaranosky authored
34 [ ] 'shrink' depends on domain of 'generate'
72af5b1 @AlexBaranosky [Issue #82] more ideas added to the formula backlog
AlexBaranosky authored
35
1ae1ad3 @AlexBaranosky [Issue #82] updates to formula backlog
AlexBaranosky authored
36 * [ ] ability to override shrink function on a per generator basis
37 a. [ ] ablity to not shrink at all on a per generator basis (make a nice syntactic
38 sugar for this... as it is one of the cases of the above.
9980189 @AlexBaranosky [Issue #82] updated backlog; organized t-formula
AlexBaranosky authored
39
40 * [ ] fix strange error if you run (formula [a 1] 1 =>)
41 ... since the formula macro splices in :formula :formula-in-progress
42 possibly solution is to not using fact macro inside of formula,
43 but instead do something like tabular
a9286d3 @AlexBaranosky [Issue #82] updated backlog with new insights
AlexBaranosky authored
44
9980189 @AlexBaranosky [Issue #82] updated backlog; organized t-formula
AlexBaranosky authored
45
df6caf7 @AlexBaranosky [Issue #82] added notion of a future-formula/pending-formula/incipient-f...
AlexBaranosky authored
46 * [ ] if line numbers shift, then ensure that they always report correctly -- so far I
47 don't know if this even needs to change, since it seems to work fine. Think about
48 it and decide if tests to prevent regressions are useful here.
a9286d3 @AlexBaranosky [Issue #82] updated backlog with new insights
AlexBaranosky authored
49
9980189 @AlexBaranosky [Issue #82] updated backlog; organized t-formula
AlexBaranosky authored
50 * [ ] consider implementing with @marick's metaconstant syntax
1ae1ad3 @AlexBaranosky [Issue #82] updates to formula backlog
AlexBaranosky authored
51 a. [ ] if we do metaconstant style, implement generator overriding
52
e81ea73 @AlexBaranosky [Issue #82] validate that only valid opt-map keys is :num-trials
AlexBaranosky authored
53 * [ ] figure out what part of t-formulas is registering as a lot more than 1 report per formula. (100???)
Something went wrong with that request. Please try again.