New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to open multibyte filename on Windows passed by command argument #7060

Closed
yuntan opened this Issue Jul 22, 2017 · 7 comments

Comments

Projects
None yet
3 participants
@yuntan
Contributor

yuntan commented Jul 22, 2017

  • nvim --version: master 4bcc70b
  • Vim (version: 8.0) behaves differently? Yes
  • Operating system/version: Windows 10 (Japanese locale)
  • Terminal name/version: powershell.exe (ConEmu)
  • $TERM:

Steps to reproduce using nvim -u NORC

  1. Create text file as multibyte filename (ex. 日本語.txt)
  2. Open 日本語.txt with vim vim -u NORC .\日本語.txt
  3. :echo bufname('%') returns .\日本語.txt
  4. Write something and save
  5. Open 日本語.txt with nvim nvim -u NORC .\日本語.txt
  6. Nothing shown in the buffer
  7. :echo bufname('%') returns .\<93><fa><96>{<8c><ea>.txt

Actual behavior

https://gyazo.com/4b74d937fc39f3afcbdb60f2b43eb739

Expected behavior

vim screenshot (encoding not set correctly)
https://gyazo.com/f260d3873dd7a0af259a908465d4d73f

@yuntan

This comment has been minimized.

Contributor

yuntan commented Jul 22, 2017

Note that I can open 日本語.txt by :e 日本語.txt in neovim.

@justinmk

This comment has been minimized.

Member

justinmk commented Jul 22, 2017

Similar but not the same as #4889

Somewhere between receiving the argument and loading the buffer...

@yuntan

This comment has been minimized.

Contributor

yuntan commented Jul 22, 2017

Encoding of argument (**argv of https://github.com/neovim/neovim/blob/master/src/nvim/main.c#L221) is cp932 on Japanese locale Windows. It should be converted to utf-8, I think. This problem may also occurs on Korean and Chinese locale Windows.

@yuntan

This comment has been minimized.

@justinmk

This comment has been minimized.

Member

justinmk commented Jul 22, 2017

Thanks for digging that up. On unix-likes we only support utf8 terminals, but on Windows we can't expect that, "8 bit" codepages are very common.

@bfredl

This comment has been minimized.

Member

bfredl commented Jul 22, 2017

IIRC the code detecting "default" (system) encoding (which we still allow different from UTF-8) only was restored on unix, not for windows.

@yuntan

This comment has been minimized.

Contributor

yuntan commented Jul 23, 2017

Tried to fix the issue (not tested enough), seems working
yuntan@008ba42#diff-21cf87db76bbcab0a3b5054f99b4ef85R245

yuntan added a commit to yuntan/neovim that referenced this issue Aug 18, 2017

yuntan added a commit to yuntan/neovim that referenced this issue Aug 18, 2017

yuntan added a commit to yuntan/neovim that referenced this issue Aug 19, 2017

yuntan added a commit to yuntan/neovim that referenced this issue Aug 19, 2017

justinmk added a commit that referenced this issue Aug 22, 2017

justinmk added a commit to justinmk/neovim that referenced this issue Aug 24, 2017

nateozem added a commit to nateozem/neovim that referenced this issue Oct 5, 2017

nateozem added a commit to nateozem/neovim that referenced this issue Oct 5, 2017

justinmk added a commit to justinmk/neovim that referenced this issue Nov 8, 2017

NVIM v0.2.1
FEATURES:
0e873a3 Lua(Jit) built-in neovim#4411
5b32bce Windows: `:terminal` neovim#7007
7b0ceb3 UI/API: externalize cmdline neovim#7173
b67f58b UI/API: externalize wildmenu neovim#7454
b23aa1c UI: 'winhighlight' neovim#6597
17531ed UI: command-line coloring (`:help input()-highlight`) neovim#6364
244a1f9 API: execute lua directly from the remote api neovim#6704
45626de API: `get_keymap()` neovim#6236
db99982 API: `nvim_get_hl_by_name()`, `nvim_get_hl_by_id()` neovim#7082
dc68538 menu_get() function neovim#6322
9db42d4 :cquit : take an error code argument neovim#7336
9cc185d job-control: serverstart(): support ipv6 neovim#6680
1b7a9bf job-control: sockopen() neovim#6594
6efe84a clipboard: fallback to tmux clipboard neovim#6894
6016ac2 clipboard: customize clipboard with `g:clipboard` neovim#6030
3a86dd5 ruby: override ruby host via `g:ruby_host_prog` neovim#6841
16cce1a debug: $NVIM_LOG_FILE neovim#6827
0cba3da `:checkhealth` built-in, validates $VIMRUNTIME neovim#7399

FIXES:
105d680 TUI: more terminals, improve scroll/resize neovim#6816
cb912a3 :terminal : handle F1-F12, other keys neovim#7241
619838f inccommand: improve performance neovim#6949
04b3c32 inccommand: Fix matches for zero-width neovim#7487
60b1e8a inccommand: multiline, other fixes neovim#7315
f1f7f3b inccommand: Ignore leading modifiers in the command neovim#6967
1551f71 inccommand: fix 'gdefault' lockup neovim#7262
6338199 API: bufhl: support creating new groups neovim#7414
541dde3 API: allow K_EVENT during operator-pending
8c732f7 terminal: adjust for 'number' neovim#7440
5bec946 UI: preserve wildmenu during jobs/events neovim#7110
c349083 UI: disable 'lazyredraw' during ui_refresh. neovim#6259
51808a2 send FocusGained/FocusLost event instead of pseudokey neovim#7221
133f8bc shada: preserve unnamed register on restart neovim#4700
1b70a1d shada: avoid assertion on corrupt shada file neovim#6958
9f534f3 mksession: Restore tab-local working directory neovim#6859
de1084f fix buf_write() crash neovim#7140
7f76986 syntax: register 'Normal' highlight group neovim#6973
6e7a8c3 RPC: close channel if stream was closed neovim#7081
85f3084 clipboard: disallow recursion; show hint only once neovim#7203
8d1ccb6 clipboard: performance, avoid weird edge-cases neovim#7193
01487d4 'titleold' neovim#7358
01e53a5 Windows: better path-handling, separator (slash) hygiene neovim#7349
0f2873c Windows: multibyte startup arguments neovim#7060

CHANGES:
9ff0cc7 :terminal : start in normal-mode neovim#6808
032b088 lower priority of 'cursorcolumn', 'colorcolumn' neovim#7364
2a3bcd1 RPC: Don't delay notifications when request is pending neovim#6544
023f67c :terminal : Do not change 'number', 'relativenumber' neovim#6796
1ef2d76 socket.c: Disable Nagle's algorithm on TCP sockets neovim#6915
6720fe2 help: `K` tries Vim help instead of manpage neovim#3104
7068370 help, man.vim: change "outline" map to `gO` neovim#7405

@justinmk justinmk referenced this issue Nov 8, 2017

Merged

NVIM v0.2.1 #7505

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment