Skip to content

Commit

Permalink
add tap-csv encoding option (#758)
Browse files Browse the repository at this point in the history
* add tap-csv encoding option

* Update _data/meltano/extractors/tap-csv/meltanolabs.yml
  • Loading branch information
pnadolny13 committed Sep 1, 2022
1 parent bdbb1a6 commit 7757cd0
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions _data/meltano/extractors/tap-csv/meltanolabs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,26 +18,26 @@ settings:
label: Files
kind: array
description: |
Array of objects with `entity`, `path`, and `keys` keys:
Array of objects with `entity`, `path`, `keys`, and `encoding` [Optioanl] keys:
* `entity`: The entity name, used as the table name for the data loaded from that CSV.
* `path`: Local path (relative to the project's root) to the file to be ingested. Note that this may be a directory, in which case all files in that directory and any of its subdirectories will be recursively processed
* `keys`: The names of the columns that constitute the unique keys for that entity.
Each input CSV file must be a traditionally-delimited CSV (comma separated columns, newlines indicate new rows, double quoted values).
* `encoding`: [Optional] The file encoding to use when reading the file (i.e. "latin1", "UTF-8"). Use this setting when you get a UnicodeDecodeError error.
Each input CSV file must be a traditionally-delimited CSV (comma separated columns, newlines indicate new rows, double quoted values).
The first row is the header defining the attribute name for that column and will result to a column of the same name in the database. It must have a valid format with no spaces or special characters (like for example `!` or `@`, etc).
- name: csv_files_definition
label: CSV Files Definition
description: |
Project-relative path to JSON file holding array of objects with `entity`, `path`, and `keys` keys, as ascribed under [Files](#files):
Project-relative path to JSON file holding array of objects with `entity`, `path`, `keys`, and `encoding` [Optional] keys, as ascribed under [Files](#files):
```json
[
{
"entity": "<entity>",
"path": "<path>",
"keys": ["<key>"]
"keys": ["<key>"],
},
// ...
]
Expand Down

0 comments on commit 7757cd0

Please sign in to comment.