Wordsiv 0.2

[tallpauley]

Wordsiv 0.2

I'm picking up Wordsiv again (at this moment). If you use this project at all, let me know what you think of this tentative roadmap for 0.2!

• Performance: Wordsiv 0.1 is horribly slow because it does filtering in Python loops. Using regex directly on word lists and word/count TSVs is an order of magnitude faster since it's implemented in C.
• Language Support: WordSiv 0.1 was really only tested with English. WordSiv 0.2 will provide compatibility and useful filtering for Arabic/Persian, thanks to @jmsole!
• DrawBot compatibility: Type designers use the DrawBot app. Let's add support for a simple DrawBot-like API and maximize compatibility (source package discovery for one).
• Simplify Source Data: Let's make it easier for our users to create and distribute their own word lists or word/count TSVs.
• Remove Markov: I may consider Markov (and other LLM-based approaches) in the future, but for now the current implementation on Markovify is hacky, and it's trickier for type designers to contribute models in different languages.

Some other possible features are:

• Set Cover Model: I've done some experimenting with a greedy set cover algorithm to generate a paragraph which chooses words which "cover" all possible letter pairs.