Destination MSSQL: failing with cannot participate in a columnstore index

[harshithmullapudi]

• Is this your first time deploying Airbyte?: Yes 👍
• OS Version / Instance: Almalinux
• Memory / Disk: 4Gb / 20 GB
• Deployment: Docker
• Airbyte Version: v0.39.30-alpha
• Source name/version: Files CSV
• Destination name/version: MS SQL 2016 on Windows
• Step: sync
• Description: syncing does not work and throws various errors - depending on my setting for the CSV file which is: https://opendata.dwd.de/climate_environment/CDC/regional_averages_DE/annual/sunshine_duration/regional_averages_sd_year.txt .

https://discuss.airbyte.io/t/csv-files-source-special-settings-needed-to-sync-to-ms-sql/1720

[harshithmullapudi]

logs-35.txt
logs-47.txt

Here are the logs

[mmoole]

pardon, since this is about MS SQL and not MySQL, would it be possible to adjust the title accordingly?

[mmoole]

with a newer version of Airbyte and the connector this error regarding MSSQL seems to be no more reproducible 👍🏼

[etsybaev]

Based on provided example (see link below) I see that we have 2 columns with the same name "Jahr;Jahr;"
https://opendata.dwd.de/climate_environment/CDC/regional_averages_DE/annual/sunshine_duration/regional_averages_sd_year.txt

The issue may be similar to #5171. The only point in case of 5171 it's related to stream names, meanwhile in our case it's related to column names

[etsybaev]

It seems to work now. I assume that previously it failed as we had 2 fields with the same name and different types. But please be aware that there is some minor name transforming that will be done to make names a little bit different.