NewsMatcher is a set of Python scripts that work in sequence to pull a collection of news articles, index them, and match them by story. The result is a JSON file containing an array of stories, with each story including all related articles.
Currently, NewsMatcher uses RSS feeds to gather articles. However, the long-term goal is to implement a more user-controlled method for news gathering.
- Automated news article collection from RSS feeds
- Article indexing for efficient processing
- Story matching algorithm to group related articles
- JSON output for easy integration with other systems
- Fetches articles from configured RSS feeds
- Indexes the collected articles
- Applies a matching algorithm to group articles into stories
- Outputs a JSON file with an array of stories, each containing related articles
- Clone this repository
- Navigate to the project directory
- Create and activate a virtual environment
- Install requirements.txt
Run the main pipeline script: python pipeline.py
To add or modify RSS feeds, edit the rss_feeds.json file in the project directory.
Contributions are welcome! Please feel free to submit a Pull Request.
If you have any questions, suggestions, or feedback, please don't hesitate to reach out:
- Email: naffenuf@yahoo.com
- GitHub Issues: Create an issue
This project is licensed under the MIT License - see the LICENSE file for details.
NewsMatcher is provided as-is, without any warranties or guarantees. Users are responsible for complying with all applicable laws and regulations regarding the use and distribution of news content.