Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Duplication mitigations #112

Merged
merged 3 commits into from
Feb 15, 2022
Merged

Duplication mitigations #112

merged 3 commits into from
Feb 15, 2022

Conversation

shitwolfymakes
Copy link
Collaborator

@shitwolfymakes shitwolfymakes commented Feb 10, 2022

These changes fix the edge case in the current filter queries, and adds debug logging to help ensure that values aren't being changed between assignment and usage. Right now, if a duplicate run occurs at anytime before the original rip completes (transcoding, etc.), it will not fail if there are no successful rips of the same disk stored in the database

To solve this, I have changed the filter statements from WHERE status = "success" to WHERE NOT status = "fail". This will register active rips of the same disk as valid duplicates, handling this edge case.

Note this shouldn't affect TV series, as each disk should have a unique crc

@sonarcloud
Copy link

sonarcloud bot commented Feb 10, 2022

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@codeclimate
Copy link

codeclimate bot commented Feb 10, 2022

Code Climate has analyzed commit 15696df and detected 0 issues on this pull request.

View more on Code Climate.

@1337-server 1337-server merged commit 051627d into 1337-server:v2_devel Feb 15, 2022
@shitwolfymakes shitwolfymakes deleted the duplication-mitigations branch February 17, 2022 00:28
1337-server added a commit that referenced this pull request Mar 19, 2022
* refactored into functions

* added handling harness for script options

* added logic to run proper installation function

* Fixed errors

* added pycharm-community install

* implemented install_arm_dev_env

* implemented launch_setup

* added call for launch_setup

* minor change for clarity

* hard-coding path since the user folder is already created

* refactored to run in correct dirs

* fixed command to run under arm user

* fix command to properly run without hanging script

* moved dev environment installation location

* grab the ip of the site that's now running

* fixed errors and added logic

* Fixed permissions issue

* removed deprecated file

* pycharm runs as "other", so the 777 is needed

* rollback broken queries merged by #112

* added ALSA install to script to avoid breakage on Ubuntu Server instances

* Added handling for arm group/user already existing

* Added installs for lsscsi and net-tools

* Added coloration to logging statements

* Added Markdown v3.3.4 explicitly to requirements.txt, to fix breaking change caused by 3.3.5 (see Python-Markdown/markdown#1203)

* Putting alsa install first to hopefully fix continuing error calling aplay in scripts

* fixed out of order parameters

* fixed bad parameter

* updated the clone command for testing updated requirements

* moved checkout command a better spot

* fixed typo

* fixed typo

* Ubuntu loud script fix for 1337-server/automatic-ripping-machine issue #111

* Ubuntu quiet script fix for 1337-server/automatic-ripping-machine issue #111

* added logic to prevent duplicating fstab entries

* Moved heredocs to custom files

* fixed typos

* fix for broken service start

* refactored into functions

* added handling harness for script options

* added logic to run proper installation function

* Fixed errors

* added pycharm-community install

* implemented install_arm_dev_env

* implemented launch_setup

* added call for launch_setup

* minor change for clarity

* hard-coding path since the user folder is already created

* refactored to run in correct dirs

* fixed command to run under arm user

* fix command to properly run without hanging script

* moved dev environment installation location

* grab the ip of the site that's now running

* fixed errors and added logic

* Fixed permissions issue

* removed deprecated file

* pycharm runs as "other", so the 777 is needed

* added ALSA install to script to avoid breakage on Ubuntu Server instances

* Added handling for arm group/user already existing

* Added installs for lsscsi and net-tools

* Added coloration to logging statements

* Added Markdown v3.3.4 explicitly to requirements.txt, to fix breaking change caused by 3.3.5 (see Python-Markdown/markdown#1203)

* Putting alsa install first to hopefully fix continuing error calling aplay in scripts

* fixed out of order parameters

* fixed bad parameter

* updated the clone command for testing updated requirements

* moved checkout command a better spot

* fixed typo

* fixed typo

* Ubuntu loud script fix for 1337-server/automatic-ripping-machine issue #111

* Ubuntu quiet script fix for 1337-server/automatic-ripping-machine issue #111

* added logic to prevent duplicating fstab entries

* Moved heredocs to custom files

* fixed typos

* fix for broken service start

* refactored into functions

* added handling harness for script options

* added logic to run proper installation function

* Fixed errors

* added pycharm-community install

* implemented install_arm_dev_env

* implemented launch_setup

* added call for launch_setup

* minor change for clarity

* hard-coding path since the user folder is already created

* refactored to run in correct dirs

* fixed command to run under arm user

* fix command to properly run without hanging script

* moved dev environment installation location

* grab the ip of the site that's now running

* fixed errors and added logic

* Fixed permissions issue

* removed deprecated file

* pycharm runs as "other", so the 777 is needed

* added ALSA install to script to avoid breakage on Ubuntu Server instances

* Added handling for arm group/user already existing

* Added installs for lsscsi and net-tools

* Added coloration to logging statements

* Added Markdown v3.3.4 explicitly to requirements.txt, to fix breaking change caused by 3.3.5 (see Python-Markdown/markdown#1203)

* Putting alsa install first to hopefully fix continuing error calling aplay in scripts

* fixed out of order parameters

* fixed bad parameter

* updated the clone command for testing updated requirements

* moved checkout command a better spot

* fixed typo

* fixed typo

* Ubuntu loud script fix for 1337-server/automatic-ripping-machine issue #111

* Ubuntu quiet script fix for 1337-server/automatic-ripping-machine issue #111

* added logic to prevent duplicating fstab entries

* Moved heredocs to custom files

* fixed typos

* fix for broken service start

* refactored into functions

* added handling harness for script options

* added logic to run proper installation function

* Fixed errors

* added pycharm-community install

* implemented install_arm_dev_env

* implemented launch_setup

* added call for launch_setup

* minor change for clarity

* hard-coding path since the user folder is already created

* refactored to run in correct dirs

* fixed command to run under arm user

* fix command to properly run without hanging script

* moved dev environment installation location

* grab the ip of the site that's now running

* fixed errors and added logic

* Fixed permissions issue

* removed deprecated file

* pycharm runs as "other", so the 777 is needed

* Added handling for arm group/user already existing

* Added installs for lsscsi and net-tools

* Added coloration to logging statements

* Putting alsa install first to hopefully fix continuing error calling aplay in scripts

* fixed out of order parameters

* fixed bad parameter

* updated the clone command for testing updated requirements

* moved checkout command a better spot

* fixed typo

* Ubuntu loud script fix for 1337-server/automatic-ripping-machine issue #111

* added logic to prevent duplicating fstab entries

* Moved heredocs to custom files

* fixed typos

* refactored into functions

* added handling harness for script options

* added logic to run proper installation function

* Fixed errors

* added pycharm-community install

* implemented install_arm_dev_env

* implemented launch_setup

* added call for launch_setup

* minor change for clarity

* hard-coding path since the user folder is already created

* refactored to run in correct dirs

* fixed command to run under arm user

* fix command to properly run without hanging script

* moved dev environment installation location

* grab the ip of the site that's now running

* fixed errors and added logic

* Fixed permissions issue

* pycharm runs as "other", so the 777 is needed

* added ALSA install to script to avoid breakage on Ubuntu Server instances

* Added handling for arm group/user already existing

* Added installs for lsscsi and net-tools

* Added coloration to logging statements

* Putting alsa install first to hopefully fix continuing error calling aplay in scripts

* fixed out of order parameters

* fixed bad parameter

* updated the clone command for testing updated requirements

* moved checkout command a better spot

* fixed typo

* Ubuntu loud script fix for 1337-server/automatic-ripping-machine issue #111

* added logic to prevent duplicating fstab entries

* Moved heredocs to custom files

* fixed typos

* refactored into functions

* added handling harness for script options

* added logic to run proper installation function

* Fixed errors

* added pycharm-community install

* implemented install_arm_dev_env

* implemented launch_setup

* added call for launch_setup

* minor change for clarity

* hard-coding path since the user folder is already created

* refactored to run in correct dirs

* fixed command to run under arm user

* fix command to properly run without hanging script

* moved dev environment installation location

* grab the ip of the site that's now running

* fixed errors and added logic

* Fixed permissions issue

* pycharm runs as "other", so the 777 is needed

* reverted changes

* removed deprecated checkout

* fixed typo

* delete old symlinks broken by the reinstallation process

* fixed typo

* auto-accept bc these repos are core to the install

* remove deprecated checkout command

* fixed broken evaluations

* fixed not finding the existing armui.service due to the space being where a / should be

* stop and remove and existing ARM install to avoid FileNotFound errors caused by the service being deleted after the source code it runs is deleted during script runtime

* refactored repeated logic into function run_makemkv(cmd)

* added update_key.sh

* installer now sets permissions for the new update_keys.sh

* fixed permissions set on the service file during install

* updated install scripts to set proper permissions for update_key.sh

* Overhaul of makemkv.py, everything needed to be done at the same time (I know, I know...)

* added noqa tags for variables that aren't being used

* Nicer printing of the logging statement

* Make sure each title is transcoded in order

* updated LICENSE

* Removed getkeys.py

* Updated VERSION

* Revert "Removed getkeys.py"

This reverts commit 2e73b5d.

* Fix bug in file sorting

* Update deb-install-quiet.sh

* Update debian-setup.sh

* Create docker-publish.yml

* Update docker-publish.yml

* Update README.md

* Push to dockerhub

* Delete build-push-action.yml

* Delete docker-publish.yml

* Create docker-publish.yml

* more github action tests

* Update docker-publish.yml

* Update docker-publish.yml

* Fixes #128 - doc strings showed wrong types leading to confusion

Index page will now correctly update the card header with correct details

* cleaning some js code to reduce warnings/errors

* cleaning some js code to reduce warnings/errors

* Removing unused variables from makemkv
Adding the progress from makemkv to logging
Cleaning some js code to reduce warnings/errors (tested FF&Chrome)

* Removing commented unused code
Small refactoring to be more compliant

* fix variable name

* flake8

* Fixes #129

* Revert "Merge branch 'v2_master' into v2_devel"

This reverts commit 58cb03a, reversing
changes made to 4b0793d.

Co-authored-by: wolfy <wolfy@shitwolfymakes.com>
Co-authored-by: wolfy <wolfy@shitwolfymakes>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants