Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature Request: Finish full unicode support (M:N cell rendering, ZWJ?) #1472

Open
Tracked by #190
giosal opened this issue Jun 23, 2019 · 9 comments
Open
Tracked by #190

Feature Request: Finish full unicode support (M:N cell rendering, ZWJ?) #1472

giosal opened this issue Jun 23, 2019 · 9 comments
Assignees
@lhecker
Labels
Area-Rendering Text rendering, emoji, complex glyph & font-fallback issues Issue-Feature Complex enough to require an in depth planning process and actual budgeted, scheduled work. Product-Conhost For issues in the Console codebase Product-Terminal The new Windows Terminal.
Milestone
Up Next

Comments

@giosal
Copy link

giosal commented Jun 23, 2019 •
edited

Summary of the new feature/enhancement

When the Terminal came out, there was a mention of Unicode support, but I can see that it's still not there. There is no support for Georgian script yet.
@giosal giosal added the Issue-Feature Complex enough to require an in depth planning process and actual budgeted, scheduled work. label Jun 23, 2019
@ghost ghost added Needs-Triage It's a new issue that the core contributor team needs to triage at the next triage meeting Needs-Tag-Fix Doesn't match tag requirements labels Jun 23, 2019
@DHowett-MSFT DHowett-MSFT changed the title Feature Request - add full Unicode support, still no Georgian scripts Feature Request: Finish full unicode support (M:N cell rendering, ZWJ?) Jun 27, 2019
@DHowett-MSFT DHowett-MSFT added Area-Rendering Text rendering, emoji, complex glyph & font-fallback issues Product-Conhost For issues in the Console codebase Product-Terminal The new Windows Terminal. labels Jun 27, 2019
@ghost ghost removed the Needs-Tag-Fix Doesn't match tag requirements label Jun 27, 2019
@DHowett-MSFT
Copy link
Contributor

This is now the master issue for all good good rendering efforts.

@DHowett-MSFT DHowett-MSFT removed the Needs-Triage It's a new issue that the core contributor team needs to triage at the next triage meeting label Jun 27, 2019
@giosal
Copy link
Author

giosal commented Jun 27, 2019

I apologize for not providing this detail previously, but I have just checked all three modes available on my laptop - PowerShell, CMD and Ubuntu WSL1 - it's not available in any of them.

@miniksa
Copy link
Member

miniksa commented Jun 27, 2019

It's alright. We know that we're not done in this space and when we sat in triage, we couldn't believe we didn't file the issue yet. Congrats, yours is now the master tracking that we still have work to do to live up to our Unicode promise.

@zadjii-msft zadjii-msft added this to the Terminal v1.0 milestone Jul 2, 2019
This was referenced Aug 28, 2019
Closed
Closed
This was referenced Nov 15, 2019
Closed
Closed
@miniksa miniksa mentioned this issue Nov 22, 2019
Closed
@DHowett-MSFT DHowett-MSFT mentioned this issue Nov 28, 2019
Closed
This was referenced Dec 19, 2019
Closed
Closed
@skyline75489 skyline75489 mentioned this issue Apr 18, 2020
Closed
5 tasks
DHowett-MSFT referenced this issue May 8, 2020
@leonMSFT @DHowett
Make most emojis full-width (#5795)
ef8e4bf 
The table that we refer to in `CodepointWidthDetector.cpp` to determine
whether or not a codepoint should be rendered as Wide vs Narrow was
based off EastAsianWidth[1].  If a codepoint wasn't included in this
table, they're considered Narrow. Many emojis aren't specified in the
EAW list, so this PR supplements our table with emoji codepoints from
emoji-data[2] in order to render most, if not all, emojis as full-width.

There are certain codepoints I've added to the comments (in case we want
to add them officially to the table in the future) that Microsoft
decided to give an emoji presentation even if it's specified as
Narrow/Ambiguous in the EAW list and are _not_ specified in the Unicode
emoji list. These include all of the Mahjong Tiles block, different
direction pencils (✎✐), different pointing index fingers (☜, ☞) among
others. I have no idea if I've captured all of them, as I don't know of
an easy way to detect which are Microsoft specific emojis.

## Validation Steps Performed
I have looked at so many emojis that I dream emoji.

These screenshots aren't encompassing _all_ emoji but I've tried to grab
a couple from all across the codepoint ranges:

Before:
![before](https://user-images.githubusercontent.com/57155886/81445092-2051a980-912d-11ea-9739-c9f588da407d.png)

After:
![after](https://user-images.githubusercontent.com/57155886/81445107-2778b780-912d-11ea-9615-676c2150e798.png)

[1] http://www.unicode.org/Public/UCD/latest/ucd/EastAsianWidth.txt
[2] https://www.unicode.org/Public/13.0.0/ucd/emoji/emoji-data.txt

Closes #900

(cherry picked from commit 7ae3433)
This was referenced Jun 18, 2020
Closed
Closed
@francogp
Copy link

francogp commented Jun 20, 2020 •
edited

maybe its related to this issue #6615

@zadjii-msft zadjii-msft mentioned this issue Dec 1, 2021
Closed
@zadjii-msft zadjii-msft mentioned this issue Jan 3, 2022
Closed
@zadjii-msft zadjii-msft modified the milestones: Terminal Backlog, Backlog Jan 4, 2022
@paul-at paul-at mentioned this issue Jan 16, 2022
Open
@j4james j4james mentioned this issue Feb 6, 2022
Closed
@zadjii-msft zadjii-msft mentioned this issue Feb 25, 2022
Closed
@miniksa miniksa removed their assignment Mar 31, 2022
@DHowett DHowett mentioned this issue Apr 19, 2022
Closed
@DHowett DHowett mentioned this issue May 17, 2022
Open
@zadjii-msft zadjii-msft modified the milestones: Backlog, Terminal v1.16 Jun 21, 2022
@aroberge aroberge mentioned this issue Sep 20, 2022
Closed
@lhecker lhecker modified the milestones: Terminal v1.17, 22H2 Nov 5, 2022
@zadjii-msft zadjii-msft modified the milestones: 22H2, Up Next Dec 5, 2022
@ofek
Copy link
Contributor

ofek commented Mar 4, 2023

Has there been any progress on this?

@JustinGrote
Copy link

Trying to use unicode still results in weird spaces that don't occur in other terminals
image

@DHowett
Copy link
Member

DHowett commented Mar 24, 2023

still

That would be why this workitem is still open 😄

@JustinGrote
Copy link

JustinGrote commented Mar 24, 2023 •
edited

@DHowett whoops, I didn't fully flesh out that info, I should have made it a sub-issue, sorry for the bump notify, it wasn't my intent :)

@parasyte parasyte mentioned this issue Aug 29, 2023
Open
@zadjii-msft zadjii-msft mentioned this issue Oct 16, 2023
Open
@tig tig mentioned this issue Oct 29, 2023
Open
This was referenced Mar 18, 2024
Closed
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lhecker lhecker

Labels
Area-Rendering Text rendering, emoji, complex glyph & font-fallback issues Issue-Feature Complex enough to require an in depth planning process and actual budgeted, scheduled work. Product-Conhost For issues in the Console codebase Product-Terminal The new Windows Terminal.
Projects
None yet
Milestone
Up Next
Development

No branches or pull requests
10 participants
@DHowett @lhecker @francogp @ofek @DHowett-MSFT @JustinGrote @miniksa @zadjii-msft @giosal @cinnamon-msft