Australian Financial Review Web Scraper with Sentiment Analysis

Welcome to Tomai, an Elixir-based web scraping project that harnesses the power of Crawly, GenServer, and Bumblebee to provide sentiment analysis for Australian Financial Review (AFR) articles. With Tomai, you can effortlessly extract valuable insights from AFR's wealth of financial news and reports.

Getting Started

To start using Tomai and unleash its web scraping and sentiment analysis capabilities:

1. Installation: Run mix setup to install and set up the required dependencies.

2. Scrape AFR Articles: Use Tomai's web scraping functionality powered by Crawly to collect articles from the Australian Financial Review. Our scraper is designed to efficiently fetch content from AFR's pages.

3. Sentiment Analysis: Tomai's integration with Bumblebee allows you to run sentiment analysis on the scraped articles. It classifies each story into positive, neutral, or negative sentiment categories, giving you a deeper understanding of the financial news landscape.

4. Explore the Results: Once you have collected the data and sentiment analysis results, you can explore the insights generated by Tomai. Use the information to make data-driven decisions or to gain a better understanding of financial news sentiment.

To start your Phoenix server:

• Run mix setup to install and setup dependencies
• Start Phoenix endpoint with mix phx.server or inside IEx with iex -S mix phx.server

Now you can visit localhost:4000 from your browser.