This script engages with APIs to collect data and conduct fundamental computations for identifying the optimal approach to generate profits within the game. It also comes with a preconfigured and continuously updating Google Sheet for seamless utilization.
Taylor Swift Spotify Stream Trend Dashboard
Python (scrapy, asyncIO), Apache Airflow, GCP (Storage Bucket, Functions, BigQuery, VM), dbt, Terraform, Docker
have you ever visit the anime site again and again waiting for the new episode?
This course presents to the students recent research and industrial issues pertaining to data engineering, database systems and technologies. Various topics of interests that are directly or indirectly affecting or are being influenced by data engineering, database systems and technologies are explored and discussed.
Tracking the Kaggle LeaderBoard progress and visualize the data with Stramlit.
This repo is for web data scraping. Feel free to show your ❤️ by giving a star ⭐
A scrapy scraper scrapes scrapable scrap (data) from Rokomari.com (A rokomari book scraper)
Miscellaneous Python applications or scripts I've made to help me learn Python and use as productivity tools.
A fully automated cryptocurrency data pipeline using Airflow. Scrapes CoinMarketCap, processes top cryptos, and stores the data in SQLite.
Discord Bot with information about the NBA!
To retrieve video links from YouTube playlist and extract video info from them using YouTube Data API v3 and CSV
This repository contains a Python project for scraping skincare product data from Sociolla.com. It collects details on over 7,500 products, including brand, price, user interactions, and availability, supporting analysis of market trends and customer preferences.
Data Analytics, Machine Learning, Full Stack Progressive Web App with Gemini API
A simple file downloader / scraper for NOVA School of Science and Technology's own e-learning platform, CLIP.
A display of data scraping ideas from multiple sources.
A GUI-based application for creating, searching, and scraping MARC records. Easily catalog bibliographic data, query multiple libraries, and export MARC records in various formats. Designed for librarians and researchers.
A web scraping app that is able to scrape an entire section of the IKEA catalog of 3270 products in 1.95 seconds using asynchronous requests
🛬 An automated solution to scrape data from various flight companies using their API requests performed in the browsers.
Add a description, image, and links to the data-scraping topic page so that developers can more easily learn about it.
To associate your repository with the data-scraping topic, visit your repo's landing page and select "manage topics."