Data Transit Library The purpose of this project is to create a library for a company to transfer their data efficiently without needing to have deep knowledge about different data sources and transfer channels. This library will introduce API's and abstractions that developers can use to design and implement data transfer infrastructures. The client wants to start the first phase by reading bulk data, 500,000 records from a random generated excel file and adding to a Redis database, in the second phase the loaded data should import to a SQL database. this process should be multithreaded and of course as fast as possible.
Problem:
Data Transit Library The purpose of this project is to create a library for a company to transfer their data efficiently without needing to have deep knowledge about different data sources and transfer channels.
This library will introduce API's and abstractions that developers can use to design and implement data transfer infrastructures. The client wants to start the first phase by reading bulk data, 500,000 records from a random generated excel file and adding to a Redis database, in the second phase the loaded data should import to a SQL database.
this process should be multithreaded and of course as fast as possible.
Explanation
This three different parts of a DDD project have been put in three projects: ClientApp.Infrastructure, ClientApp.Domain and ClientApp.API.
Also the abstract logic to transfer data has been implemented in project DataTransferLib as an external library.
The Controller to test is 'TeamController' and there is a test json postman export file 'TeamCollection.postman_collection' located in 'Files' folder
Data Transit Library The purpose of this project is to create a library for a company to transfer their data efficiently without needing to have deep knowledge about different data sources and transfer channels. This library will introduce API's and abstractions that developers can use to design and implement data transfer infrastructures. The c…
shahrzadabedi/DataTransferProject
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Data Transit Library The purpose of this project is to create a library for a company to transfer their data efficiently without needing to have deep knowledge about different data sources and transfer channels. This library will introduce API's and abstractions that developers can use to design and implement data transfer infrastructures. The c…
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published