Can we support DownloadFileFromText with charset parameter or by default supporting special characters

[stevanuswijaya]

Can we support DownloadFileFromText with charset parameter or by default supporting special characters? I'm currently trying to create a CSV file with Swedish characters in it (ÄÅÖäåö).

But the result is wrong:

It's working if I added the code as in the image.

Thanks

[arivera12]

Seems weird to me, the DownloadFileFromText should be able to support all characters since it's utf-8 but not every charset maybe in the same encoding format when reading from any source.

As you can see this extension method

BlazorDownloadFile/BlazorDownloadFile/Extensions/StringExtensions.cs

Line 13 in 3f6383d

public static string ToBase64Encode(this string plainText)

Encodes all text to bytes using utf8, are you sure your problem exactly or may reside over there?

I don't think this should be a JavaScript issue at all but maybe from c# encoding since JavaScript downloads the file as-is without any encoding or conversions.

If you can send me a repro I may fix it.

Can you confirm that before sending the text to the DownloadFileFromText method the text is correctly encoded and they get interpreted incorrectly after downloading and opening the file?

[arivera12]

That error can also occur with the text editor and how does it's interprets the characters.

What software you are using to open the csv file? MS Excel?

[stevanuswijaya]

As you can see here, when I call BlazorDownloadFile, the string was still okay.

I'm using MS Excel to open the csv file.

[arivera12]

Ok, good can you check which charset enconding is your MS Excel opening the csv file?

[arivera12]

Can you check if the .csv file opened in notepad to see if it's encoded wrongly?

[arivera12]

Can you check if the .csv file opened in notepad to see if it's encoded wrongly?

If opened in notepad is wrong then I will expose the charset encoding as an option with a default value to prevent breaking changes on the api.

Please let me know asap.

[arivera12]

I would like also to know if after using the extension to base64encode does your encoding gets broken.

[stevanuswijaya]

I opened the bad the file with notepad++.

The encoding: UTF-8

But in excel:

The good file after changing the BlazorDownloadFile script in notepad++:

Encoding: UTF8-BOM

In excel:

[stevanuswijaya]

I tried to change the base64encode this code instead as you instructed

and we still get same bad result

[arivera12]

Thanks for the investigation and the input I will take a deeper look on it.

Can you share any sample data for me in json format?

So I can use it has a test case?

[arivera12]

Wait a minute I read this in a hurry, in notepad++ the file opened ok. But in excel is wrong but after changing the encoding file format in notepad++ the excel read ok?

[arivera12]

This seems to be an issue with excel on how interprets csv filed but not rather with this library and the download process.

Reference:
https://stackoverflow.com/questions/6002256/is-it-possible-to-force-excel-recognize-utf-8-csv-files-automatically

[arivera12]

Please upload for me a test json data so I can retest those special chars there seems to be a workaround this in the reference link.

[stevanuswijaya]

Here is the test json, I had same issue with it. Let me know if you need more information.
test data.zip

Sorry for late reply, I think we have a huge time difference and I was really busy at work :)

[arivera12]

New release
Install-Package BlazorDownloadFile -Version 2.1.4

@stevanuswijaya I didn't had time to test your attached file data but it should work for you out of the box.

I am in a hurry.

Please try out this new package version.

Take a look of this commit for more details.

I turned on by default encoderShouldEmitUTF8Identifier so this should work for you out of the box.

Please try it out and give me your feedback when ever it's possible.

[stevanuswijaya]

Hi

Unfortunately, I still got same problem.

[arivera12]

Ok, give me a time so I can retest this with more free time, reopening.

[arivera12]

It's seems I got it working now.

[arivera12]

Install-Package BlazorDownloadFile -Version 2.1.5

Please give me feedback if this does work for you properly now!

[arivera12]

Install-Package BlazorDownloadFile -Version 2.1.6

encoderShouldEmitUTF8Identifier is now false as default please remember turning this option true when downloading the csv file.

[stevanuswijaya]

It's working properly now! Thanks for the help!