This project fetches data from two different URLs, processes the data, and then serves the results through an API endpoint. It fetches posts from the provided URLs, calculates a score based on each post's vote state and author, and then sorts the results based on the score. The sorted results are then written to an output file named output.json
.
This project uses the following dependencies:
To set up the project, follow these steps:
- Clone the repository to your local machine.
- Install the dependencies using npm:
npm install
. - Fill in the required values for the headers in the
headers
object inindex.js
. - Run the project using
npm start
.
Once the server is running, you can access the results through the API endpoint /results
. This endpoint returns the sorted results in JSON format.
- GET /results: Returns the sorted results in JSON format.
This is a Python script to scrape the leaderboard data from PCMEMES.NET and save it to a JSON file.
- requests
- BeautifulSoup
- json
- time
- re
- logging
To use this script, you need to provide your access token and client ID. Additionally, make sure you have Python installed on your system.
python scraper.py
This script scrapes data from the PCMEMES.NET leaderboard for various URLs. It extracts usernames and corresponding upvotes, applies a multiplier, and saves the data to a JSON file.
You need to set your access token and client ID in the script before running it.
This project is licensed under the GPL-3.0 License. See the LICENSE file for details.
Created by RIOTCOKE