How to combine keywords with random markdown

[mimoduo]

Heya Chevrotain community!

I'm absolute in aawww with how easy it is to work with chevrotain just got stuck in a bit of a rut :x

Any idea how I could combine standard tokens with arbitrary/random markdown with potential spaces in them?

Something like:

participant mamma
participant itzy
mamma -> itzy: Itsa mia mamma **mia**
itzy -> mamma: Pajama [bahama](bahamammaa.com)

Any help would be appreciated!

[msujew]

Hey @mimoduo,

I think there are multiple approaches to this problem:

1. Add token delimiters to the markdown (similar to comments), so that they can be identified as single tokens. You could maybe argue that : and \n can be used as start and end sequences for the markdown token.
2. Build a parser rule that's actually able to parse markdown. I'm not totally sure whether this is actually possible, due to markdown not being an LLk language.
3. Build a custom tokenizer that returns markdown content as a single token. This is probably doable, but quite a bit of work. It's also arguably the cleanest solution that has no influence on the target language.

[mimoduo]

Heya @msujew

Thank you so much for the reply and a fresh set of eyes!

#1 seems like a perfectly valid way to get the job done and matches well with the syntax already in place
#2 and #3 are outta my league but to anyone else who's smarter and encounters the same needs go for it ;)

Enjoy the rest of your day!

Sincerely,
Bryan Stoner