Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Words registered in Meilisearch Synonyms are automatically converted to Chinese (Simplified), so you can process them as Japanese. #3646

Closed
hieunguyen5501 opened this issue Apr 6, 2023 · 5 comments
Labels
support Issues related to support questions

Comments

@hieunguyen5501
Copy link

Words registered in Meilisearch Synonyms are automatically converted to Chinese (Simplified), so you can process them as Japanese.
Eg: 会計 => 会计

I use api update synonyms with body as:
{
"アカウンティング": ["会計"]
}
When i call get synonyms api to see the result the words are converted to:
{
"アカウンティング": [
"会计"
]
}

I hope you can save the correct words registered in synonyms.

Screenshots:
image
image

Meilisearch version: v0.29.3

@curquiza curquiza added the support Issues related to support questions label Apr 6, 2023
@oluademola
Copy link

Hello @hieunguyen5501. I believe this problem is related to this issue. The reason for this is that meilisearch normalizes synonyms before storing them. This means that when you retrieve the synonym list, the normalized synonyms are displayed rather than the ones you originally sent. It should be fixed in the attached issue; however, there is currently no ETA for this. Hope this answers your question. Thanks.

@hieunguyen5501
Copy link
Author

Hello @hieunguyen5501. I believe this problem is related to this issue. The reason for this is that meilisearch normalizes synonyms before storing them. This means that when you retrieve the synonym list, the normalized synonyms are displayed rather than the ones you originally sent. It should be fixed in the attached issue; however, there is currently no ETA for this. Hope this answers your question. Thanks.

@oluademola Thanks for your reply, Would you give a timeframe to fix this?

@oluademola
Copy link

Hello @hieunguyen5501, as I mentioned above, there is currently no ETA for this, but the team is well aware of this issue

@miiton
Copy link

miiton commented Apr 11, 2023

Hello @hieunguyen5501 @oluademola

If the problem is that when you register a synonym, you "see" the normalized value when you look at the settings, then #2760 you presented is correct, but I think it is correct that the synonym is internally normalized.

If the problem is that Japanese Kanji characters are converted to simplified characters, which prevents searching, this is a known problem, so I suggest you try the image in #3588 to see if it solves the problem.

@ManyTheFish
Copy link
Member

ManyTheFish commented Apr 13, 2023

Hello @hieunguyen5501, @oluademola, and @miiton,

As @oluademola and @miiton said, your issue mixes several problems:

  1. Meilisearch prints the normalized value of the synonym (Internal representation of synonyms shouldn't be showed when displaying settings #2760), it's a known issue but we didn't have the time to fix it so far, we are really sorry for that.
  2. Japanese and Chinese support conflicts in Meilisearch and it is a hard issue to solve for the moment, that's why we have a dedicated image for Japanese that deactivate Chinese support, don't hesitate to use it! (Force japanese v1.1.0 #3588)

Sorry for these inconveniences, and thank you @oluademola and @miiton for your answers!

I close this issue in favor of the ones linked before.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
support Issues related to support questions
Projects
None yet
Development

No branches or pull requests

5 participants