-
Notifications
You must be signed in to change notification settings - Fork 0
/
changelog.txt
executable file
·80 lines (64 loc) · 3.05 KB
/
changelog.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
v.1.5.1
- experimental option to delete file from source after download
- fixes for typos in logging
v.1.5.0
- added fieldtransform to do crosswalks
- fix for ACT header to match weird, undocumented Fireworks restrictions
v.1.4.0
- added fieldtransform to split ACTID and SSN into separate fields
- updated changefields to allow a transform to return a list instead of a string and create additional columns as needed
- fixed incorrect log line regarding files remaining after filtering
v.1.3.1
- fixed crash if using ACT score type with score-entryterm field transform
v.1.3.0
- added option to merge files from a source for destinations that can only accept one file
- added field transform to convert SAT and ACT graduation dates into entry term for CRMs
v.1.2.1
- added error checking and message if no transform module found with name given in settings
v.1.2.0
- ability to chain together transforms
- added file rename transform module
- added field change transform module (which itself has modules)
- initial field change modules are drop column, replace, and trim choice list
- removed old drop column transform module (merged into field change transform)
- added debug logging to all transform modules
- fixes to handle random UTF8 characters at the end of files without crashing
- SAT date format is no longer handled as a special case (i.e. it needs to be in the config for your SAT source)
v.1.1.2
- fix for regression error in ftps connection module
- fix for regression error in remotesites with date logic
v.1.1.1
- fix so script doesn't crash if settings.py is missing
v.1.1.0
- added smb connection module
- fix to convert string path in POSIX format to correct OS path
v.1.0.0
- changed the modules from sources and destinations to connections and transforms
- sources are now defined by a type of connection
- destinations are now defined by a type of connection with filters (plain text or regex) and transforms
- the default date filter can be overriden with plain text or regex if needed
- the default sourcefolder for destination files can be overriden in destination settings
- all source and destination configuration now done in a python dict in the settings file
- all connections have Download and Upload functions (even if they do nothing in some cases)
- connections included are carnegie, ftps, localfile, sat, sftp
- transforms included are dropcolumns and fixedtocsv
- completely revamped readme file
v.0.6.0
- added ability to have multiple destinations
- added Download function to FTPS class
- cleaned up module imports
- added a localfile destination (still work in progress)
v.0.5.0
- abstracted SFTP and FTPS functions to make modules easier to build
v.0.4.0
- override date more gracefully handled if in incorrect format
- updates for consistent date handling in all modules
- disabled download cache management by default
- changed logs to daily roll and keep 7 by default
v.0.3.0
- added cache management for download folder
v.0.2.0
- changed location of stored files
- now keep all downloaded files (cache management coming in future version)
v.0.1.0
- initial coding