Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generic data backup script #76

Open
3 tasks
tushar5526 opened this issue Jun 21, 2023 · 14 comments
Open
3 tasks

Generic data backup script #76

tushar5526 opened this issue Jun 21, 2023 · 14 comments
Labels
C4GT community - legacy

Comments

@tushar5526
Copy link
Collaborator

tushar5526 commented Jun 21, 2023 •
edited
Loading

Description

Set up a generic data backup script, that can take consistent backups of data from folders and then upload it to any S3 compatible storage.

Expected Outcome

  • The script should take care of log rotations and deleting old logs
  • The script should tag backups appropriately
  • It should be generic and parameterized enough to take backups of any folder, on specific intervals specified in cron format and with the right tags.
  • The script should setup a cron job that takes these backups regularly

Acceptance Criteria

  • The script should take care of log rotations and deleting old logs
  • The script should tag backups appropriately
  • It should be generic and parameterized enough to take backups of any folder, on specific intervals specified in cron format and with the right tags.

Implementation Details

It should be an interactive CLI script

Mockups / Wireframes

NA

Product Name

UCI

Organization Name:

Samagra

Domain

DPG

Tech Skills Needed:

Python or JS

Mentor(s)

@tushar5526

Complexity

High

Category

CI/CD

Sub Category

Maintenance
@Mandeep-009
Copy link

Hey! I know Javascript and I want to work on this issue. Can you guide me in this?

@starks-and-wolves
Copy link

Hey @tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

@tushar5526
Copy link
Collaborator Author

tushar5526 commented Jul 17, 2023 •
edited
Loading

Hey @tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

Assume a docker-compose setup with multiple DBs (could be SQL or NO-SQL) persisting their data in a folder mounted in docker. The script should be able to satisfy the acceptance criteria and expected outcome.

It does not have to be something written from scratch, and you can also build on top of existing solutions/ tools out there for data backups.

@yash14171
Copy link

Hey I can solve this issue ,how to move forward?

@tushar5526
Copy link
Collaborator Author

Hey I can solve this issue ,how to move forward?

Hi please refer this comment - #76 (comment)

@yash14171
Copy link

Hey @tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

Assume a docker-compose setup with multiple DBs (could be SQL or NO-SQL) persisting their data in a folder mounted in docker. The script should be able to satisfy the acceptance criteria and expected outcome.

It does not have to be something written from scratch, and you can also build on top of existing solutions/ tools out there for data backups.

It's ok but how can I pull request for this issue?

@tushar5526
Copy link
Collaborator Author

tushar5526 commented Jul 21, 2023 •
edited
Loading

Hey @tushar5526, I have previously created cron jobs to store data in an s3 bucket. I would like to contribute to this project. Please let me know the detailed requirements for it.

Assume a docker-compose setup with multiple DBs (could be SQL or NO-SQL) persisting their data in a folder mounted in docker. The script should be able to satisfy the acceptance criteria and expected outcome.
It does not have to be something written from scratch, and you can also build on top of existing solutions/ tools out there for data backups.

It's ok but how can I pull request for this issue?

The pull request is a script that meets the above criteria. You can attach screenshots of the script or a small demo on how to use the script.

@yash14171
Copy link

yash14171 commented Jul 21, 2023 via email

@tushar5526
Copy link
Collaborator Author

You can make a PR on this repo only. There are services already in the docker-compose that store data in folder mounts. You will have to create a script for that. Is there anything else you need clarification for, I am not able to understand your doubt.

@yash14171
Copy link

yash14171 commented Jul 21, 2023 via email

@yash14171
Copy link

Hey Tushar can u help me up here and tell me how to make a pr

@yash14171
Copy link

i created the script that meets the all criteria and i am ready to submit it to you.How to do that?

@tushar5526
Copy link
Collaborator Author

@yash14171 https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/proposing-changes-to-your-work-with-pull-requests/creating-a-pull-request

@yash14171
Copy link

yash14171 commented Jul 24, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
C4GT community - legacy
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@tushar5526 @starks-and-wolves @Mandeep-009 @yash14171