Skip to content
Spring Boot + JSoup + ROME web scraper and RSS feed generator
Java
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
gradle/wrapper
src
.gitignore
LICENSE
README.md
build.gradle
gradlew
gradlew.bat
settings.gradle

README.md

Spring Boot + JSoup + ROME

Web scraper and RSS feed generator

Spring Boot based example application for website scraping and RSS feed generation.

Technologies

  • Spring Boot
  • Gradle
  • JSoup
  • ROME
  • Lombok
  • PostgreSQL

Configuration

  • Create PostgreSQL database and configure connection in application.properties

  • Build with Gradle

    ./gradlew build

Endpoints

  • GET /scrap – Scrap all websites on demand

  • GET /rss – Get general RSS feed

  • GET /rss/<TARGET_WEBSITE_ID> – Get RSS feed for specific website

More information

You can’t perform that action at this time.