Unicode support

[rudolfninja]

I tried your lib and it seemed very user friendly, thank you for that.
But I faced with problem handling files with uncode (cyrrilic) symbols.
Is it planned to add unicode support or is there any workaround to make your lib "understand" unicode?
I need to write unicode-strings in cells, but there is no suitable function.

Thanks.

[tfussell]

Hi @rudolfninja, I'm glad to hear that it's easy to use. Unicode is supported throughout the library. For the most part, std::string is used to hold UTF-8 encoded strings. It can be difficult to create a string literal containing unicode characters in a source file. Where exactly are you having trouble using Cyrillic characters? Filenames? Cell values?

[rudolfninja]

When I'm trying to write Russian text to cell or when I'm trying to open(save) file with Russian name.
Bad conversation exception is thrown from path.cpp
#ifdef _MSC_VER std::wstring path::wstring() const { std::wstring_convert<std::codecvt_utf8<wchar_t>> convert; return convert.from_bytes(string()); } #endif
When trying to write Russian symbols to file I have GENX_BAD_UTF8 exception

[tfussell]

How are you initializing the filename string? If it's a string literal in the source file, you need to use the appropriate prefix to ensure the correct encoding is used, probably L"" or u8"". See here for more info http://en.cppreference.com/w/cpp/language/string_literal . You also need to save the file with the correct encoding (in VS, File->Save with encoding->UTF-8). If you're getting the string from an argument or somewhere else, you need to make sure it's correctly encoded when you receive it.

[rudolfninja]

I'm getting string as a command line argument. I'll try to find the way to check it somehow

[tfussell]

Linux or Windows? If Windows, you'll probably need to use the Windows-specific entry point that passes arguments as strings of wchar_ts, wmain:

int wmain(int argc, wchar_t *argv[])
{
    const auto arg1 = std::wstring(argv[1]);
    ...
}

If needed, convert a wstring to string with a library like utfcpp or use the built-in (but deprecated) codecvt like this:

#include <codevt>
#include <locale>
...
std::wstring_convert<std::codecvt_utf8<wchar_t>, wchar_t> converter;
const auto utf8_string = converter.to_bytes(wchar_string);

[rudolfninja]

std::wstring_convert<std::codecvt_utf8<wchar_t>, wchar_t> converter; const auto utf8_string = converter.to_bytes(wchar_string);
Solved the problem! Thanks.

[tfussell]

Glad to hear it!