@@ -24,19 +24,19 @@ writing. Learn the concept and tricks in depth.
24
24
- [ Use of ` custom_func ` , Specially ` javascript ` ] ( ./doc/use_of_custom_funcs.md ) : An in depth look of how ` custom_func `
25
25
is used, specially the all mighty ` javascript ` (and ` javascript_with_context ` ).
26
26
- [ CSV Schema in Depth] ( ./doc/csv_in_depth.md ) : everything about schemas for CSV input.
27
- - [ Fixed-Length Schema in Depth] ( ./doc/fixedlength_in_depth .md ) : everything about schemas for fixed-length (e.g. TXT)
27
+ - [ Fixed-Length Schema in Depth] ( ./doc/fixedlength2_in_depth .md ) : everything about schemas for fixed-length (e.g. TXT)
28
28
input
29
29
- [ JSON/XML Schema in Depth] ( ./doc/json_xml_in_depth.md ) : everything about schemas for JSON or XML input.
30
30
- [ EDI Schema in Depth] ( ./doc/edi_in_depth.md ) : everything about schemas for EDI input.
31
31
- [ Programmability] ( ./doc/programmability.md ) : Advanced techniques for using omniparser (or some of its components) in
32
32
your code.
33
33
34
34
References:
35
- - [ Custom Functions] ( ./doc/customfuncs.md ) : a complete reference of all built-in custom functions.
35
+ - [ Custom Functions] ( ./doc/customfuncs.md ) : a complete reference of all built-in custom functions.
36
36
37
37
Examples:
38
38
- [ CSV Examples] ( extensions/omniv21/samples/csv )
39
- - [ Fixed-Length Examples] ( extensions/omniv21/samples/fixedlength )
39
+ - [ Fixed-Length Examples] ( extensions/omniv21/samples/fixedlength2 )
40
40
- [ JSON Examples] ( extensions/omniv21/samples/json )
41
41
- [ XML Examples] ( extensions/omniv21/samples/xml ) .
42
42
- [ EDI Examples] ( extensions/omniv21/samples/edi ) .
@@ -67,6 +67,7 @@ situations.
67
67
- Golang 1.14 or later.
68
68
69
69
## Recent Major Feature Additions/Changes
70
+ - 2022/8: Added ` fixedlength2 ` file format that supersedes the original ` fixed-length ` format with support of hierarchical and nested envelopes.
70
71
- 1.0.0 Released!
71
72
- Added ` Transform.RawRecord() ` for caller of omniparser to access the raw ingested record.
72
73
- Deprecated ` custom_parse ` in favor of ` custom_func ` (` custom_parse ` is still usable for
@@ -78,16 +79,16 @@ back-compatibility, it is just removed from all public docs and samples).
78
79
- Upgrade omni schema version to ` omni.2.1 ` due a number of incompatible schema changes:
79
80
- ` 'result_type' ` -> ` 'type' `
80
81
- ` 'ignore_error_and_return_empty_str ` -> ` 'ignore_error' `
81
- - ` 'keep_leading_trailing_space' ` -> ` 'no_trim' `
82
+ - ` 'keep_leading_trailing_space' ` -> ` 'no_trim' `
82
83
- Changed how we handle custom functions: previously we always use strings as in param type as well as result param
83
84
type. Not anymore, all types are supported for custom function in and out params.
84
85
- Changed the way how we package custom functions for extensions: previously we collect custom functions from all
85
86
extensions and then pass all of them to the extension that is used; This feels weird, now changed to only the custom
86
87
functions included in a particular extension are used in that extension.
87
- - Deprecated/removed most of the custom functions in favor of using 'javascript'.
88
+ - Deprecated/removed most of the custom functions in favor of using 'javascript'.
88
89
- A number of package renaming.
89
90
- Added CSV file format support in omniv2 handler.
90
- - Introduced IDR node cache for allocation recycling.
91
+ - Introduced IDR node cache for allocation recycling.
91
92
- Introduced [ IDR] ( ./doc/idr.md ) for in-memory data representation.
92
93
- Added trie based high performance ` times.SmartParse ` .
93
94
- Command line interface (one-off ` transform ` cmd or long-running http ` server ` mode).
0 commit comments