Repository navigation
Improved Task Managent
Lots of little changes around backend to give us the ability to add a significant number of sources, mostly around task management and adding lots of fall back options for all tasks
Changes
- Added a list of acceptable tags and now reject any tag added that isn't on that list to ensure we don't end up with LLM hallucinations causing things like 'TV' 'Television' etc
- Completely changed task management from a simple cron to using Celery which allows us to run much smaller tasks more often, handle failures appropiately and only call all of our scripts when needed
- Continued to break out everything into utility files and makes our scripts as small as possible
- Changed 'feed' to 'topic' to make it a bit clearer
- Added ability to show tags and scores on frontend for debugging
- Improved our LLM workflows, adding descriptions and other prompt adjustments
- Added Gemini Flash as a key part of our workflow and in general added lots and lots of LLM redundancy to all tasks
- Created first pass of BDD which will be a big part of the next push into testing
Full Changelog: 0.0.4...0.0.5