📰 The Newspaper

A modern, full-stack news aggregation platform with real-time weather forecasts and stock market data. Built with Next.js 16, TypeScript, and MongoDB.

Live Demo | Report Bug | Request Feature

✨ Features

📰 Multi-Source News Aggregation

Real-time news from NewsAPI and New York Times
Automatic daily updates via cron jobs
Search and filter by source, keywords, or date
400+ articles daily across 6 categories:
- Business
- Technology
- World News
- Science
- Health
- Sports

🌤️ Weather Dashboard

Real-time weather data from OpenWeatherMap
5-day forecast with hourly breakdowns
Interactive visualizations using Recharts:
- Temperature bar charts
- Humidity line graphs
- Weather condition pie charts
Location autocomplete with geocoding
Geolocation support for automatic location detection

📈 Stock Market Data

Real-time stock prices via Market Data API
Support for major stock symbols (AAPL, GOOGL, TSLA, etc.)
Multi-currency conversion (USD, EUR, GBP, JPY, etc.)
Clean, responsive card-based interface

🤖 Automated Data Management

Cron jobs for automatic news ingestion (daily at midnight UTC)
Database cleanup to maintain optimal performance (7-day retention)
Smart deduplication to prevent duplicate articles
Efficient MongoDB indexing for fast queries

🚀 Demo

Modern landing page with feature cards and smooth animations

Searchable news feed with category filtering

Interactive weather dashboard with data visualizations

🛠️ Tech Stack

Frontend

Next.js 16 (App Router, React Server Components)
TypeScript - Type-safe development
Tailwind CSS - Utility-first styling
Recharts - Data visualization library

Backend

Next.js API Routes - Serverless functions
MongoDB Atlas - Cloud database
Mongoose - ODM for MongoDB

APIs & Services

NewsAPI - News headlines
New York Times API - Premium news content
OpenWeatherMap API - Weather data
Market Data API - Stock market data
Frankfurter API - Currency conversion
BigDataCloud API - Geolocation

DevOps

Vercel - Deployment and hosting
Vercel Cron Jobs - Scheduled tasks
GitHub Actions - CI/CD (optional)

📋 Prerequisites

Before you begin, ensure you have:

Node.js 18.x or higher
npm or yarn
MongoDB Atlas account (free tier works!)
API keys for:

⚡ Quick Start

1. Clone the repository

git clone https://github.com/Esstar612/newspaper.git
cd newspaper

2. Install dependencies

npm install

3. Set up environment variables

Create a .env.local file in the root directory:

# MongoDB
MONGODB_URI=mongodb+srv://username:password@cluster.mongodb.net/newspaper

# News APIs
NEWS_API_KEY=your_newsapi_key
NYT_API_KEY=your_nyt_api_key

# Weather API
OPENWEATHER_API_KEY=your_openweather_key

# Stock Market API
MARKET_DATA_API_KEY=your_market_data_key

# Cron Security (optional but recommended)
CRON_SECRET=your_secret_key_here

4. Run the development server

npm run dev

Open http://localhost:3000 in your browser.

5. Build for production

npm run build
npm start

🗄️ Database Schema

Article Model

{
  title: String,           // Article headline
  description: String,     // Article summary
  url: String,            // Article URL (unique)
  imageUrl: String,       // Featured image
  source: String,         // News source (NYT, NewsAPI, etc.)
  publishedAt: Date,      // Publication date
  providerId: String,     // Source-specific ID
  createdAt: Date,        // Auto-generated
  updatedAt: Date         // Auto-generated
}

Indexes

url: Unique index for deduplication
publishedAt: Sorted queries
source + publishedAt: Filtered sorted queries

🔄 Cron Jobs

The app uses Vercel Cron Jobs to automate data management:

News Ingestion (`0 0 * * *` - Daily at midnight UTC)

// Fetches from multiple sources
- NewsAPI: 100 articles
- NYT Business: 50 articles
- NYT Technology: 50 articles
- NYT World: 50 articles
- NYT Science: 50 articles
- NYT Health: 50 articles
- NYT Sports: 50 articles
// Total: ~400 articles/day

Database Cleanup (`0 3 * * *` - Daily at 3 AM UTC)

// Maintains optimal database size
- Removes articles older than 7 days
- Keeps ~14,000 articles max
- Database size: ~14 MB

📊 API Usage & Costs

All APIs are used within free tier limits:

API	Daily Usage	Free Limit	% Used
NewsAPI	1 call	100 calls	1%
NYT API	6 calls	500 calls	1.2%
OpenWeatherMap	On-demand	1,000 calls	Variable
Market Data	On-demand	100 calls	Variable

Total Cost: $0/month 🎉

🎨 Features Breakdown

News Page

Search: Full-text search across titles and descriptions
Filters: Filter by news source (NewsAPI, NYT, etc.)
Pagination: Cursor-based pagination for infinite scroll
Responsive Cards: Beautiful article cards with images
External Links: Direct links to original articles

Weather Page

Current Weather: Temperature, conditions, humidity
5-Day Forecast: Detailed hourly predictions
Location Search: Autocomplete city search
Geolocation: Automatic location detection
Visualizations:
- Temperature trends (bar chart)
- Humidity patterns (line chart)
- Weather distribution (pie chart)

Stocks Page

Real-Time Prices: Live stock market data
Currency Conversion: Convert to 30+ currencies
Popular Stocks: Quick access to major symbols
Clean UI: Simple, readable design

🚀 Deployment

Deploy to Vercel

Fork this repository
Import to Vercel

Go to vercel.com/new
Import your forked repository
Vercel will auto-detect Next.js

Add Environment Variables

Go to Project Settings → Environment Variables
Add all keys from .env.local

Deploy

Click "Deploy"
Your app will be live in ~2 minutes!

Verify Cron Jobs

Go to Project Settings → Crons
You should see 2 cron jobs listed

Custom Domain (Optional)

Go to Project Settings → Domains
Add your custom domain
Configure DNS records as instructed

🧪 Testing

Run all tests

npm test

Test specific API routes

# Test news ingestion
curl http://localhost:3000/api/cron/ingest-news

# Test weather API
curl http://localhost:3000/api/weather?q=London

# Test stock API
curl http://localhost:3000/api/stocks/AAPL

📁 Project Structure

newspaper/
├── app/
│   ├── api/
│   │   ├── admin/
│   │   │   └── ingest-news/      # Manual news ingestion
│   │   ├── cron/
│   │   │   ├── ingest-news/      # Automated news fetch
│   │   │   └── cleanup-old-news/ # Database cleanup
│   │   ├── forecast/             # Weather forecast
│   │   ├── geocoding/            # Location search
│   │   ├── news/                 # News feed API
│   │   ├── stocks/[symbol]/      # Stock data
│   │   └── weather/              # Current weather
│   ├── news/                     # News page
│   ├── stocks/                   # Stocks page
│   ├── weather/                  # Weather page
│   └── page.tsx                  # Landing page
├── components/
│   ├── ArticleCard.tsx           # News article card
│   ├── Header.tsx                # Navigation header
│   ├── TemperatureBarGraph.tsx   # Weather chart
│   ├── HumidityLineGraph.tsx     # Weather chart
│   └── WeatherPieChart.tsx       # Weather chart
├── lib/
│   └── db.ts                     # MongoDB connection
├── models/
│   └── Article.ts                # Article schema
├── public/                       # Static assets
├── vercel.json                   # Cron configuration
├── .env.local                    # Environment variables (not committed)
└── package.json

🤝 Contributing

Contributions are what make the open-source community amazing! Any contributions you make are greatly appreciated.

Fork the Project
Create your Feature Branch (git checkout -b feature/AmazingFeature)
Commit your Changes (git commit -m 'Add some AmazingFeature')
Push to the Branch (git push origin feature/AmazingFeature)
Open a Pull Request

🐛 Known Issues

Weather timing precision limited on Vercel Hobby plan (±59 minutes)
News API free tier limited to 100 requests/day
Stock data may have slight delays (free tier limitation)

See open issues for a full list of known issues.

🔮 Roadmap

📝 License

Distributed under the MIT License. See LICENSE for more information.

👤 Author

Star Olaojo

GitHub: @Esstar612
LinkedIn: Star Olaojo
Portfolio: https://esstar612.github.io/my_portfolio/

🙏 Acknowledgments

⭐ Show your support

Give a ⭐️ if this project helped you!

📧 Contact

Project Link: https://github.com/Esstar612/newspaper

Live Demo: https://newspaper-kohl.vercel.app

Made with ❤️ by Star Olaojo

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
app		app
components		components
docs/screenshots		docs/screenshots
lib		lib
models		models
public		public
.env.example		.env.example
.env.local.example		.env.local.example
.eslintrc.json		.eslintrc.json
.gitattributes		.gitattributes
.gitignore		.gitignore
CONTRIBUTING.md		CONTRIBUTING.md
LICENSE		LICENSE
README.md		README.md
eslint.config.mjs		eslint.config.mjs
next.config.js		next.config.js
package-lock.json		package-lock.json
package.json		package.json
postcss.config.js		postcss.config.js
qodana.yaml		qodana.yaml
setup.sh		setup.sh
tailwind.config.js		tailwind.config.js
tsconfig.json		tsconfig.json
vercel.json		vercel.json

Folders and files

Latest commit

History

Repository files navigation

📰 The Newspaper

✨ Features

📰 Multi-Source News Aggregation

🌤️ Weather Dashboard

📈 Stock Market Data

🤖 Automated Data Management

🚀 Demo

🛠️ Tech Stack

Frontend

Backend

APIs & Services

DevOps

📋 Prerequisites

⚡ Quick Start

1. Clone the repository

2. Install dependencies

3. Set up environment variables

4. Run the development server

5. Build for production

🗄️ Database Schema

Article Model

Indexes

🔄 Cron Jobs

News Ingestion (0 0 * * * - Daily at midnight UTC)

Database Cleanup (0 3 * * * - Daily at 3 AM UTC)

📊 API Usage & Costs

🎨 Features Breakdown

News Page

Weather Page

Stocks Page

🚀 Deployment

Deploy to Vercel

Custom Domain (Optional)

🧪 Testing

Run all tests

Test specific API routes

📁 Project Structure

🤝 Contributing

🐛 Known Issues

🔮 Roadmap

📝 License

👤 Author

🙏 Acknowledgments

⭐ Show your support

📧 Contact

About

Topics

Resources

License

Contributing

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

News Ingestion (`0 0 * * *` - Daily at midnight UTC)

Database Cleanup (`0 3 * * *` - Daily at 3 AM UTC)

Packages