support sanskrit diacriticals

[sujato]

Is your feature request related to a problem? Please describe.

My app uses Buddhist texts with Pali and Sanskrit but they're not supported in orama.

Describe the solution you'd like

Support common uses for Pali and Sanskrit.

Here are the usual substitutions:

ā = a
ī = i
ū = u
ṛ = r
ḷ = l
ṃ = m
ṁ = m
ḥ = h
ś = sh
ṣ = sh
ṭ = t
ḍ = d
ṇ = n
ṅ = n
ñ = n or ny or gn
ḻ = l
ḹ = l
ṝ = r

And the respective charcodes, including uppercase. I think!

240
241
256
257
298
299
346
347
362
363
7692
7693
7716
7717
7734
7735
7736
7737
7738
7739
7744
7745
7746
7747
7748
7749
7750
7751
7770
7771
7772
7773
7778
7779
7788
7789

[micheleriva]

/bounty 50

[algora-pbc]

💎 $50 bounty created by micheleriva
🙋 If you start working on this, comment /attempt #465 to notify everyone
👉 To claim this bounty, submit a pull request that includes the text /claim #465 somewhere in its body
📝 Before proceeding, please make sure you can receive payouts in your country
💵 Payment arrives in your account 2-5 days after the bounty is rewarded
💯 You keep 100% of the bounty award
🙏 Thank you for contributing to oramasearch/orama!

Attempt	Started (GMT+0)	Solution
🟢 @utsav00	Sep 19, 2023, 4:23:33 PM	WIP
🔴 @Nabhag8848	Sep 19, 2023, 4:27:12 PM	WIP
🟢 @melsonic	Oct 1, 2023, 8:59:49 PM	#503

[utsav00]

I'd like to take a stab at this.
/attempt #465

Options

• Cancel my attempt

[Nabhag8848]

/attempt #465

Options

• Cancel my attempt

[algora-pbc]

Note: The user @utsav00 is already attempting to complete issue #465 and claim the bounty. If you attempt to complete the same issue, there is a chance that @utsav00 will complete the issue first, and be awarded the bounty. We recommend discussing with @utsav00 and potentially collaborating on the same solution versus creating an alternate solution.

[rishi-raj-jain]

@micheleriva

Can you help me where these subsitutions are done?

[melsonic]

/attempt #465

Options

• Cancel my attempt

[algora-pbc]

💡 @melsonic submitted a pull request that claims the bounty. You can visit your org dashboard to reward.

[algora-pbc]

🎉🎈 @melsonic has been awarded $50! 🎈🎊