This is a jdbc client project from my early days as a Computer Science student
This programm was created for the fifth semester class Database Management Systems and is the one of the final projects for the class
A jdbc application that runs queries in pgAdmin to simulate the functionality of an insurance company's database using Apache Spark RDD for query implementation.
- Tip 1: I record the second runtime in order for the buffers to initialize
- Tip 2: I use the EXPLAIN command for the execution plan
- Tip 3: I run the queries in sequence so that the changes to buffers, parallelism, etc. continue to be active for the next query
- Insert the data from the given dataset using proper queries and the command VACUUM FULL
- Implement some functionality using proper queries:
a. Find the customer who had the greatest mileage to a specific timestamp
b. Find the average mileage for the last month from all the data
c. Find the monthly sum of mileage for each customer
d. Find the average distance traveled for each customer
e. Find the average mileage per region.
- Tip 4: Configure PostgreSQL to use more buffer than your computer's RAM with the command ALTER SYSTEM SET shared_buffers TO '256MB';
- Run queries again
- Tip 5: Configure PostgreSQL to use all the processing power of your computer with the command max_parallel_workers_per_gather
- Create the appropriate indexes in the db to run the queries above faster
- Break the dataset into shards / partitions using inheritance between tables using range method
- Connect databse with JDBC client in Java using the proper library
- Write a Java console application that will calculate some statistics, execute a query in Spark and will use the partitioning
- There is a predetermined dataset used for this project
- The comments to make the code understandable, are within the archives
- This project was written in Eclipse Java IDE
- This repository was created to show the variety of the work I did and experience I gained as a student