This repository has been archived by the owner on Sep 23, 2024. It is now read-only.
Tap doesn't clean special characters in headers and hence fails #202
Labels
bug
Something isn't working
Describe the bug
A clear and concise description of what the bug is.
The Tap has no functionality to handle junk characters/special characters in headers ( that is not visible to naked eyes) . Also it doesn't remove spaces in between headers ("column name" -> column_name) to make it more suitable for databases and it doesn't remove the trailing white spaces in headers. These all are very crucial since some third-party apps exports there data directly to s3 and we don't have much say in controlling the headers. and as per the standard column names should not contain spaces or special character.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
A clear and concise description of what you expected to happen.
if the column has special character, it should be removed and spaces should be replaced with _,
ex: "\ufeffmessage_id" -> "message_id"
"message id" -> "message_id"
message%%id-> message_id
Screenshots
If applicable, add screenshots to help explain your problem.
Your environment
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: