Web Scraper — Java + Angular

AI is Good · hereandnowai.com

---

Overview

A full-stack lead-scraping platform built by HERE AND NOW AI. The backend uses Spring Boot + Selenium to scrape and persist lead data; the frontend is an Angular dashboard for real-time visibility and control.

Tech Stack

Layer	Technology
Backend	Java 25, Spring Boot 4.0.2, Maven 4
Scraping	Selenium 4 (headless Chrome)
Database	PostgreSQL, Spring Data JPA, Hibernate
Frontend	Angular 21, TypeScript
Build	Maven Wrapper, Angular CLI

Project Structure

web-scraper-java/
├── backend/          # Spring Boot REST API + scraping engine
│   ├── src/main/     # Application source
│   └── src/test/     # Unit & integration tests
└── frontend/         # Angular dashboard
    └── src/app/
        ├── components/   # LeadTable, ScrapeControl
        ├── models/       # Lead model
        └── services/     # LeadService, ThemeService

Getting Started

Prerequisites

• JDK 25+
• Node.js 20+ & Angular CLI 21
• PostgreSQL 14+

Backend

cd backend

# Configure database credentials in src/main/resources/application.properties
# spring.datasource.url=jdbc:postgresql://localhost:5432/webscraper
# spring.datasource.username=postgres
# spring.datasource.password=postgres

./mvnw spring-boot:run

The API starts on http://localhost:8080.

Frontend

cd frontend
npm install
ng serve

The dashboard starts on http://localhost:4200.

API Endpoints

Method	Endpoint	Description
GET	/api/leads	Retrieve all leads
POST	/api/leads	Create a lead manually
DELETE	/api/leads/{id}	Delete a lead
POST	/api/scrape	Trigger scraping job

Contributing

Pull requests are welcome. Please open an issue first to discuss significant changes.

---

Built with ❤️ by HERE AND NOW AI · "AI is Good"
📧 info@hereandnowai.com · 🌐 hereandnowai.com