Python Data Processing Portfolio

Overview

This repository showcases my ability to extract and manage data using Python. It includes three key scripts: web scraping, database storage integration, and API data retrieval.

Scripts Description

1. Azure Blob Storage Data Upload

• Filename: azure_blob_upload.py
• Function: Automatically fetches and uploads stock data to Azure Blob Storage on a schedule.

2. Web Scraping and CSV Creation

• Filename: web_scraping_csv.py
• Function: Scrapes news data from a website and saves it as a CSV file.

3. API Data Extraction and Aggregation

• Filename: api_data_aggregation.py
• Function: Fetches trade data via an API and aggregates it into a summarized format.

Technologies Used

• Python 3
• Libraries: requests, pandas, BeautifulSoup, azure.storage.blob
• APIs: UN Comtrade, Azure Blob Storage