You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Optimization - add flexible column inputs to SQL raw data loading scrips. Ideally read column names from file, sql copy the file then drop any columns not used in processing
#48
Open
drotheram opened this issue
Jan 28, 2021
· 0 comments
Sometimes small changes in raw files such as the addition of an index column break the workflow and create maintenance overhead. The stack would be more flexible and robust if it dynamically reads file headers rather than assuming the inputs conform to a rigid standard.
The text was updated successfully, but these errors were encountered:
Sometimes small changes in raw files such as the addition of an index column break the workflow and create maintenance overhead. The stack would be more flexible and robust if it dynamically reads file headers rather than assuming the inputs conform to a rigid standard.
The text was updated successfully, but these errors were encountered: