This is an Open Source news application, built largely in Golang, Typescript, and Python. The goal of this application is to give users control over their personalization, and to be as transparent as possible while doing so. https://truba.news
At the same time it aims to provide a boilerplate experience for self-hosting a fullstack application, enabling the rapid ability to do all of the following:
- Have separate environments
- Queue async tasks for service availability
- Monitor & trace services to troubleshoot performance
- Manage users
- Collect user feedback/data
- Scrape external data
- Extract features
- Train & test ML models with Jupyter
- Use the trained ML models for recommendations
A living list of sources that are used can be found here
Monorepo Multibranch Pipeline for CI/CD.
Environments are namespaced, with the Jupyter service pointed on the development envrionment
Communication Diagram: https://docs.google.com/drawings/d/1bK8-KgHAQ7AyQKpqLYPwv1mSkQZ3ThVu2fzXNFTJYQo/edit?usp=sharing
Client facing API docs: https://developcoreui.truba.news/redoc
Visit the readme in the /helm directory
- Start by adding a directory to this repo with the name of your service. This service mus contain a Dockerfile which can build the service.
- Edit the
./helm/values.yamlfile by adding a values to theservices - From the /helm directory run
helm upgrade <your-app-name> .
Note that a new environment comes packaged with the web, user, socket, core, ml, user services as well as an instance of mongodb and redis. This means that you may need to increase the number of nodes you're using to run your cluster.
- Increase the minimum node count on the environments node poll by 1
- Find the new untainted node with
kubectl get nodesthenkubectl describe node <node-name> kubectl label node <node-name> spray=<new-environment-name>kubectl taint node <node-name> spray=<new-environment-name>:NoSchedule- Add the new Environment to the
./helm/values.yaml - From the /helm directory run
helm upgrade <your-app-name> .