Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get file list after removal of undesired directories like __MACOSX: Redmine 13508 #203

Merged
merged 4 commits into from
Dec 21, 2017

Conversation

MounaSafiHarab
Copy link
Contributor

@MounaSafiHarab MounaSafiHarab commented Nov 15, 2017

The pipeline 1) gets the list of files from the unzipped uploaded file, then 2) removes the __MACOSX directory, and then 3) loops through the file list generated in step 1) and removes all those starting with a . (including the .DS_Store file).

a) The logic should be that we swap steps 1 and 2 so that the file list we are dealing with in the rest of the script excludes the __MACOSX directory and the files within.
b) Add line breaks after file/directory removal for user readability of the messages at the terminal (cleanup)

@MounaSafiHarab
Copy link
Contributor Author

MounaSafiHarab commented Nov 15, 2017

To test; you can create a fake __MACOSX directory within the zip, and within that, another fake file which starts with a filename starting with a ..

Note: Insertion proceeds anyway (i.e. no pre-mature exit), just that the error messages are not intuitive to the user at the terminal...

@davidblader, for CCNA, check the HMC7811 scan if you want to test this:
Before my change, you would get at the terminal the following messages:
rm /tmp/ImagingUpload-11-5-ILqIUk/__MACOSX/HMC7811_154907_Initial_MRI/._.DS_Storerm: cannot remove /tmp/ImagingUpload-11-5-ILqIUk/__MACOSX/HMC7811_154907_Initial_MRI/..DS_Store': No such file or directory
rm /tmp/ImagingUpload-11-5-ILqIUk/__MACOSX/HMC7811_154907_Initial_MRI/OAx_T2star_GRE/.
.DS_Storerm: cannot remove /tmp/ImagingUpload-11-5-ILqIUk/__MACOSX/HMC7811_154907_Initial_MRI/OAx_T2star_GRE/._.DS_Store': No such file or directory rm /tmp/ImagingUpload-11-5-ILqIUk/HMC7811_154907_Initial_MRI/.DS_Storerm /tmp/ImagingUpload-11-5-ILqIUk/HMC7811_154907_Initial_MRI/OAx_T2star_GRE/.DS_Store

####Get a list of files from the folder#####################
#############Loop through the files#########################
############################################################
my $cmd = "cd " . $this->{'uploaded_temp_folder'} . "; find -name '__MACOSX' | xargs rm -rf";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change command to use delete option with find instead of piping into xargs

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@davidblader can you please re-test? I modified the one line as was discussed in the Imaging meeting of Nov'24th.

@driusan
is this line better now?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there something wrong with the -delete option?

@nicolasbrossard also pointed out that you don't need the cd since find takes a directory as the first parameter.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@driusan @nicolasbrossard
so I changed the command line again,
is this better?

@MounaSafiHarab MounaSafiHarab changed the base branch from major to 19.0-dev November 30, 2017 19:22
@@ -110,7 +110,7 @@ sub IsCandidateInfoValid {
####Get a list of files from the folder#####################
#############Loop through the files#########################
############################################################
my $cmd = "find -path " . $this->{'uploaded_temp_folder'} . " -name '__MACOSX' -delete ";
my $cmd = "find -path " . quotemeta($this->{'uploaded_temp_folder'}) . " -name '__MACOSX' -delete ";
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the quotemeta was recommended by @nicolasbrossard

@MounaSafiHarab
Copy link
Contributor Author

@davidblader
could you please re-test?

@MounaSafiHarab
Copy link
Contributor Author

MounaSafiHarab commented Dec 21, 2017

@davidblader

did you test it as well? if yes, can you @nicolasbrossard merge after you take a final look since you and @driusan recommended these changes?

@davidblader
Copy link
Contributor

ah yes sorry i forgot to add the manual test label. worked as expected

@nicolasbrossard nicolasbrossard merged commit a9d6d0d into aces:19.0-dev Dec 21, 2017
cmadjar pushed a commit that referenced this pull request Jan 30, 2018
* Mapping empty date of birth and scan to undef when empty so that it can be inserted in MySQL 5.7 (#205)

* Creected code that tests if two float numbers are equal (#206)

* [Cleanup]: Remove duplicate DBI.pm; Redmine 13613 (#207)

* Add TarchiveID to mri_protocol_violated_scans (#211)

* Adding TarchiveID information in mri_protocol_violated_scans table

* Cleaned up commented parts

* Renamed $tarchiveInfo to $tarchiveInfoRef for consistencies

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508 (#203)

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508

* change xargs to deleting from the find command

* Dave and Nick feedback

* Nicolas feedback; escaping the directory name

* Refactor smart matching code in DTI.pm (#215)

* Better MINC toolkit sourcing command in README and updated VERSION file (#260)

* Better MINC toolkit sourcing command and updated VERSION file

* cecile feedback

* Updating QC tables if the -deleteQCdata flag is not set. Will update FileID to NULL in files_qcstatus and feedback_mri_comments (#261)

* README has also within it LORIS-MRI version number, so update (#268)
cmadjar pushed a commit that referenced this pull request Feb 22, 2018
* Initial import of files from http://code.google.com/p/dicom-archive/

* add two configurable options is_site and is_sge

* Added new getIncomingDir config function

* Added missing semi-colons.

* Modifies the temporairy values of $data_dir, $get_dicom_info and $mail_user  variables

* Places back the forward slash in the email-address

* Modifies the temporairy value for the tarchive_librairy location

* Modified the tarchivelibdir temp value

* Set the if_sge to false by default

* Fixed the dcmodify --insert-tag option to --insert (option used in more recent dcmodify).

* Updates the mri_upload table

* Includes option to update the mri_upload table

* Modification to the profileTemplate to be able to use DTIPrep pipeline

* Added get_DTI_Site_CandID_Visit function in profile file

* Cosmetic changes

* Cosmetic changes

* Fixed typos and indentation

* Correct spelling mistakes

* 1) added the functionality to insert the extension , 2) fixed
indentation

* Removed the filetype option

* Changed the queries to use the prepared statements

* Modified $d to $dir in profileTemplate

* Remove .DS_Store file from DICOM source directory before creating new object.
Other fails while reading content of dcm source directory

* Modified getSubjectIDs so that it uses PatientName instead of PatientID
lookupCenterID using patient name instead of PatientID

* 	modified:   profileTemplate

* Moved reference to ~/.neurodb to .loris_mri directory

* Some more files

* Replaced .neurodb by .loris_mri in updateHeaders.pl

* Removed the full path

* DicomTar.pl should use proper $profile name instead of prod

* Sometime DICOM Header may not have Invertion Time field (0018,9079). Set Inversion Time to 0 in tarchive_series to avoid error message: DBD::mysql::st execute failed: Data truncated for column 'InversionTime'

* DICOM HEADER may not have Inversion time (0018,9079) set which cause
tarchives_series sql table who expect a double to receive an empty string.

* THIS IS A DUPLICATE from opionnalProfileFixInDicomTar pull request please ignore change in dicomTar.pl

THIS IS A DUPLICATE from opionnalProfileFixInDicomTar pull request please ignore change in dicomTar.pl

* removed useless numbers

* Added $subjectID{'createVisitLabel'} option to profile template.

* Changed $subjectID{'createVisitLabel'} type to boolean

* added exit 0 at the end of the file

* cosmetic change

* Added a new option config $bin_dir

* Fixed the option

* Defined(@array) is deprecated.                    Removed error message on the console defined(@array) is deprecated at... (Maybe you should just omit the defined()?)

* Removed all occurences of defined(@array).

* replaced the sourcelocation column by DecompressedLocation

* Added functionality to insert PET DICOMs in tarchive tables.

* Fixed indentation in the pull request.

* NIfTI support of the imaging pipeline (profileTemplate change).

* Added -centerName option in call to dicomTar.pl.

* Made ArchiveLocation relative in tarchive table.

* Created a MySQL scripted patch to make ArchiveLocation in the tarchive table relative.

* Added functionality to print query on one line.

* Cleaned up and prepared statement for queries in main directory of dicom-archive-tools

* Prepared mysql statement for DCMSUM.pm

* Fixed bug inserted while integrating mysql prepare statements

* Removed the Deprecated definition of array: !@Settings instead of !defined @Settings, to be in line with pull request #95

* One more consistency check on verbose and notification spool tables

* One more explicit Done message

* Fixes the insert in DCMSUM.pm so it does not set the creatinguser field in the tarchive table to NULL when the pipeline is run in auto-launch mode.

* site or rather, study, no longer hard coded

* removed extra ~ and the comments as per Cecile feedback

* adding TarchiveSeriesID to the tarchive_files

* Added the getSNRModalities function

* added flair

* typo

* typo AGAIN

* added comment based on SeriesUID and EchoTime

* Removed getIncomingDir routine from profileTemplate; it is no longer used. Same as PR35

* Revert "adding TarchiveSeriesID to the tarchive_files"

* isFileToBeRegisteredGivenProtocol in Profile now returns 1 if ne unknown

* Incorporate comment of Dave

* I cna not type wihtout making typos

* re-adding TarchiveSeriesID to the tarchive_files

* swap inserts

* added comment

* updated the comment with tarchive_files

* Loris-MRI configurations moved to the front end from the $profile file: Redmine 8893 (#45)

* Loris-MRI configurations moved to the front end from the $profile file: Redmine 8893

* went through all the files that get the settings from the prod file

* removed prefix from the Get_DTI_Site function

* consistency in DB versus NeuroDB

* one dollar sign instead of 2; but have no clue why

* Cecile required changes

* Remove all .DS_Store files anywhere in the tree, and __MACOSX directory  (#46)

* Remove all .DS_Store files anywhere in the tree

* The command will not complain even if it does not find a file to delete.

* Incorporate the additional changes from Mouna

* Do not store PatientName header in notification_spool table:Redmine 13506

* update README

* Check consistent upload_id and filename when running the pipeline: Redmine 13507 (#202)

* Check consistent upload_id and filename when running the pipeline: Redmine 13507

* make copy and paste a bit more intelligent

* Mapping empty date of birth and scan to undef when empty so that it can be inserted in MySQL 5.7 (#205)

* Creected code that tests if two float numbers are equal (#206)

* [Cleanup]: Remove duplicate DBI.pm; Redmine 13613 (#207)

* Add TarchiveID to mri_protocol_violated_scans (#211)

* Adding TarchiveID information in mri_protocol_violated_scans table

* Cleaned up commented parts

* Renamed $tarchiveInfo to $tarchiveInfoRef for consistencies

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508 (#203)

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508

* change xargs to deleting from the find command

* Dave and Nick feedback

* Nicolas feedback; escaping the directory name

* Refactor smart matching code in DTI.pm (#215)

* Better MINC toolkit sourcing command in README and updated VERSION file (#260)

* Better MINC toolkit sourcing command and updated VERSION file

* cecile feedback

* Updating QC tables if the -deleteQCdata flag is not set. Will update FileID to NULL in files_qcstatus and feedback_mri_comments (#261)

* README has also within it LORIS-MRI version number, so update (#268)

* Installer: Populate the default LORIS config settings for the MRI paths (Redmine 13915) (#272)

* Populate Loris-MRI code path for new installs since the user is asked to enter the MRI project name

* Populate other MRI data path with a better option than the default LORIS %PROJECTNAME

* post installation checks

* Add the condition Dave brought up during the imaging meeting; i.e. only change it for those that did not do it in the front end already

* Ceciles feedback

* oopsie
nicolasbrossard pushed a commit that referenced this pull request Feb 27, 2018
* Mapping empty date of birth and scan to undef when empty so that it can be inserted in MySQL 5.7 (#205)

* Creected code that tests if two float numbers are equal (#206)

* [Cleanup]: Remove duplicate DBI.pm; Redmine 13613 (#207)

* Add TarchiveID to mri_protocol_violated_scans (#211)

* Adding TarchiveID information in mri_protocol_violated_scans table

* Cleaned up commented parts

* Renamed $tarchiveInfo to $tarchiveInfoRef for consistencies

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508 (#203)

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508

* change xargs to deleting from the find command

* Dave and Nick feedback

* Nicolas feedback; escaping the directory name

* Refactor smart matching code in DTI.pm (#215)

* Better MINC toolkit sourcing command in README and updated VERSION file (#260)

* Better MINC toolkit sourcing command and updated VERSION file

* cecile feedback

* Updating QC tables if the -deleteQCdata flag is not set. Will update FileID to NULL in files_qcstatus and feedback_mri_comments (#261)

* README has also within it LORIS-MRI version number, so update (#268)

* Installer: Populate the default LORIS config settings for the MRI paths (Redmine 13915) (#272)

* Populate Loris-MRI code path for new installs since the user is asked to enter the MRI project name

* Populate other MRI data path with a better option than the default LORIS %PROJECTNAME

* post installation checks

* Add the condition Dave brought up during the imaging meeting; i.e. only change it for those that did not do it in the front end already

* Ceciles feedback

* oopsie
nicolasbrossard pushed a commit that referenced this pull request Feb 28, 2018
…d resolve conflicts (#280)

* Initial import of files from http://code.google.com/p/dicom-archive/

* add two configurable options is_site and is_sge

* Added new getIncomingDir config function

* Added missing semi-colons.

* Modifies the temporairy values of $data_dir, $get_dicom_info and $mail_user  variables

* Places back the forward slash in the email-address

* Modifies the temporairy value for the tarchive_librairy location

* Modified the tarchivelibdir temp value

* Set the if_sge to false by default

* Fixed the dcmodify --insert-tag option to --insert (option used in more recent dcmodify).

* Updates the mri_upload table

* Includes option to update the mri_upload table

* Modification to the profileTemplate to be able to use DTIPrep pipeline

* Added get_DTI_Site_CandID_Visit function in profile file

* Cosmetic changes

* Cosmetic changes

* Fixed typos and indentation

* Correct spelling mistakes

* 1) added the functionality to insert the extension , 2) fixed
indentation

* Removed the filetype option

* Changed the queries to use the prepared statements

* Modified $d to $dir in profileTemplate

* Remove .DS_Store file from DICOM source directory before creating new object.
Other fails while reading content of dcm source directory

* Modified getSubjectIDs so that it uses PatientName instead of PatientID
lookupCenterID using patient name instead of PatientID

* 	modified:   profileTemplate

* Moved reference to ~/.neurodb to .loris_mri directory

* Some more files

* Replaced .neurodb by .loris_mri in updateHeaders.pl

* Removed the full path

* DicomTar.pl should use proper $profile name instead of prod

* Sometime DICOM Header may not have Invertion Time field (0018,9079). Set Inversion Time to 0 in tarchive_series to avoid error message: DBD::mysql::st execute failed: Data truncated for column 'InversionTime'

* DICOM HEADER may not have Inversion time (0018,9079) set which cause
tarchives_series sql table who expect a double to receive an empty string.

* THIS IS A DUPLICATE from opionnalProfileFixInDicomTar pull request please ignore change in dicomTar.pl

THIS IS A DUPLICATE from opionnalProfileFixInDicomTar pull request please ignore change in dicomTar.pl

* removed useless numbers

* Added $subjectID{'createVisitLabel'} option to profile template.

* Changed $subjectID{'createVisitLabel'} type to boolean

* added exit 0 at the end of the file

* cosmetic change

* Added a new option config $bin_dir

* Fixed the option

* Defined(@array) is deprecated.                    Removed error message on the console defined(@array) is deprecated at... (Maybe you should just omit the defined()?)

* Removed all occurences of defined(@array).

* replaced the sourcelocation column by DecompressedLocation

* Added functionality to insert PET DICOMs in tarchive tables.

* Fixed indentation in the pull request.

* NIfTI support of the imaging pipeline (profileTemplate change).

* Added -centerName option in call to dicomTar.pl.

* Made ArchiveLocation relative in tarchive table.

* Created a MySQL scripted patch to make ArchiveLocation in the tarchive table relative.

* Added functionality to print query on one line.

* Cleaned up and prepared statement for queries in main directory of dicom-archive-tools

* Prepared mysql statement for DCMSUM.pm

* Fixed bug inserted while integrating mysql prepare statements

* Removed the Deprecated definition of array: !@Settings instead of !defined @Settings, to be in line with pull request #95

* One more consistency check on verbose and notification spool tables

* One more explicit Done message

* Fixes the insert in DCMSUM.pm so it does not set the creatinguser field in the tarchive table to NULL when the pipeline is run in auto-launch mode.

* site or rather, study, no longer hard coded

* removed extra ~ and the comments as per Cecile feedback

* adding TarchiveSeriesID to the tarchive_files

* Added the getSNRModalities function

* added flair

* typo

* typo AGAIN

* added comment based on SeriesUID and EchoTime

* Removed getIncomingDir routine from profileTemplate; it is no longer used. Same as PR35

* Revert "adding TarchiveSeriesID to the tarchive_files"

* isFileToBeRegisteredGivenProtocol in Profile now returns 1 if ne unknown

* Incorporate comment of Dave

* I cna not type wihtout making typos

* re-adding TarchiveSeriesID to the tarchive_files

* swap inserts

* added comment

* updated the comment with tarchive_files

* Loris-MRI configurations moved to the front end from the $profile file: Redmine 8893 (#182)

* Loris-MRI configurations moved to the front end from the $profile file: Redmine 8893

* went through all the files that get the settings from the prod file

* added the install scripts

* removed prefix from the Get_DTI_Site function

* added data_dir as projects like IBIS could have it different from mincPath

* Greg feedback on DB::DBI, removal of defined, and a masked variable declaration

* added the script for existing projects to populate their default database values with those from their prod file

* function return value

* IBIS has all sorts of differences, the updates in this commit account for those

* data_dir renamed to dataDirBasepath

* Cecile feedback and applying her comments to all other files

* fixed the message where the values is kept at its default, and removed debug print

* Loris-MRI configurations moved to the front end from the $profile file: Redmine 8893 (#45)

* Loris-MRI configurations moved to the front end from the $profile file: Redmine 8893

* went through all the files that get the settings from the prod file

* removed prefix from the Get_DTI_Site function

* consistency in DB versus NeuroDB

* one dollar sign instead of 2; but have no clue why

* Cecile required changes

* [ImagingUpload.pm] Look inside file type and not file path for the word dicom (#178)

* Look inside file type and not file path for the word dicom

* check for the whole dicom type string

* spaces

* spaces

* Fix file count in mri_upload when deleting a minc file and then re-inserting (#180)

* fixed minc deletion (#185)

* Remove all .DS_Store files anywhere in the tree, and __MACOSX directory  (#46)

* Remove all .DS_Store files anywhere in the tree

* The command will not complain even if it does not find a file to delete.

* Incorporate the additional changes from Mouna

* Removed files starting with . and __MACOSX directory from the uploaded scans: Redmine 11670 (#186)

* started

* first attempt finished

* cleanup

* included mounas feedback

* Updating README with proper dpkg (#190)

* [Installation] Fixing more installation errors (#191)

* Fixing more errors

* This will be much clearer

* changed new_nmi to nmi

* missed one :p

* [SQL] Fixing MySQL 5.7 group by during visit creation (#192)

* Fixing MySQL 5.7 group by during visit creation

* Missed comma

* Removing newVisitNo in group by

* Added option to also re-insert deleted minc files (Same as PR#179) (#193)

* added option to also re-insert

* Remove profile changes

* removing IBIS specific fields

* No need to show another example of sql query

* adding documentation and making sql more generic

* more updates

* fix path to run from mri directory

* Option to re-insert deleted minc files: Based off of PR 179

* remove the original file

* better readme

* Cecile comments

* relative to example scripts directory

* Modified the deletemincsqlwrapper.pl so that when no files are found with the query, it prints it out so that the user do not feel like nothing happened.

* revert to t1 from adniT1

* remove the wrong file

* minor thing

* chmod, run tarchiveLoader without seriesUID as an argument, and small messages change

* [Install] Readme Version update, installer CentOS improvements (#188)

* committing Readme version and installer changes

* adding Readme changes

* setting VERSION file to 18.0.0

* additional Readme updates

* formatting in Readme

* re-integrating updates

* removing period

* New installs now also have their Imaging Pipeline ConfigSettings populated based on the user answers during the installation process: Redmine 13199

* minor echo message change

* rebasing removed Christine changes so add them again

* update the dicom archive repo link (#199)

Update submodule link for dicom_archive.

* Do not store PatientName header in notification_spool table:Redmine 13506

* update README

* Check consistent upload_id and filename when running the pipeline: Redmine 13507 (#202)

* Check consistent upload_id and filename when running the pipeline: Redmine 13507

* make copy and paste a bit more intelligent

* Mapping empty date of birth and scan to undef when empty so that it can be inserted in MySQL 5.7 (#205)

* Creected code that tests if two float numbers are equal (#206)

* [Cleanup]: Remove duplicate DBI.pm; Redmine 13613 (#207)

* Add TarchiveID to mri_protocol_violated_scans (#211)

* Adding TarchiveID information in mri_protocol_violated_scans table

* Cleaned up commented parts

* Renamed $tarchiveInfo to $tarchiveInfoRef for consistencies

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508 (#203)

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508

* change xargs to deleting from the find command

* Dave and Nick feedback

* Nicolas feedback; escaping the directory name

* Refactor smart matching code in DTI.pm (#215)

* Better MINC toolkit sourcing command in README and updated VERSION file (#260)

* Better MINC toolkit sourcing command and updated VERSION file

* cecile feedback

* Updating QC tables if the -deleteQCdata flag is not set. Will update FileID to NULL in files_qcstatus and feedback_mri_comments (#261)

* README has also within it LORIS-MRI version number, so update (#268)

* Installer: Populate the default LORIS config settings for the MRI paths (Redmine 13915) (#272)

* Populate Loris-MRI code path for new installs since the user is asked to enter the MRI project name

* Populate other MRI data path with a better option than the default LORIS %PROJECTNAME

* post installation checks

* Add the condition Dave brought up during the imaging meeting; i.e. only change it for those that did not do it in the front end already

* Ceciles feedback

* oopsie

* resolve some unresolved conflicts and remove all added empty lines

* Ceciles feedback to remove duplicate getconfigsetting

* feedback after discussing with Nick
cmadjar pushed a commit to cmadjar/Loris-MRI that referenced this pull request Jun 28, 2018
* Mapping empty date of birth and scan to undef when empty so that it can be inserted in MySQL 5.7 (aces#205)

* Creected code that tests if two float numbers are equal (aces#206)

* [Cleanup]: Remove duplicate DBI.pm; Redmine 13613 (aces#207)

* Add TarchiveID to mri_protocol_violated_scans (aces#211)

* Adding TarchiveID information in mri_protocol_violated_scans table

* Cleaned up commented parts

* Renamed $tarchiveInfo to $tarchiveInfoRef for consistencies

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508 (aces#203)

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508

* change xargs to deleting from the find command

* Dave and Nick feedback

* Nicolas feedback; escaping the directory name

* Refactor smart matching code in DTI.pm (aces#215)

* Better MINC toolkit sourcing command in README and updated VERSION file (aces#260)

* Better MINC toolkit sourcing command and updated VERSION file

* cecile feedback

* Updating QC tables if the -deleteQCdata flag is not set. Will update FileID to NULL in files_qcstatus and feedback_mri_comments (aces#261)

* README has also within it LORIS-MRI version number, so update (aces#268)
cmadjar added a commit that referenced this pull request Jan 21, 2019
* Forward changes merged (today) into 19.0-dev to major (#209)

* Mapping empty date of birth and scan to undef when empty so that it can be inserted in MySQL 5.7 (#205)

* Creected code that tests if two float numbers are equal (#206)

* [Cleanup]: Remove duplicate DBI.pm; Redmine 13613 (#207)

* A first pass at creating this script

* Using the MRIProcessingUtility to determine center name, candidate ID ...

*  few additions. Back up time before the weekend!!

* Update major with the latest 19.0-dev branch changes (#265)

* Mapping empty date of birth and scan to undef when empty so that it can be inserted in MySQL 5.7 (#205)

* Creected code that tests if two float numbers are equal (#206)

* [Cleanup]: Remove duplicate DBI.pm; Redmine 13613 (#207)

* Add TarchiveID to mri_protocol_violated_scans (#211)

* Adding TarchiveID information in mri_protocol_violated_scans table

* Cleaned up commented parts

* Renamed $tarchiveInfo to $tarchiveInfoRef for consistencies

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508 (#203)

* Get file list after removal of undesired directories like __MACOSX: Redmine 13508

* change xargs to deleting from the find command

* Dave and Nick feedback

* Nicolas feedback; escaping the directory name

* Refactor smart matching code in DTI.pm (#215)

* Better MINC toolkit sourcing command in README and updated VERSION file (#260)

* Better MINC toolkit sourcing command and updated VERSION file

* cecile feedback

* Updating QC tables if the -deleteQCdata flag is not set. Will update FileID to NULL in files_qcstatus and feedback_mri_comments (#261)

* README has also within it LORIS-MRI version number, so update (#268)

* Some more code

* Finalized a first working version of the file. Need to properly log and exit. More input checking and parsing metadata are required as well

* Modified file_insertion.pl based on discussions from the imaging meeting

* Implemented log file, notification and temporary exit codes

* fixed some notifications

* Checking that the uploadID is valid

* Nicolas's feedback

* added the exit codes from NeuroDB::ExitCodes

documented the script using Perldoc

added support to read a JSON file to insert metadata into parameter_file. Also fixed a bug in MRIProcessingUtility.pm introduced by a conflict when merging latest version of aces/minor

renamed file_insertion.pl to imaging_non_minc_insertion.pl

modified the notifications to use imaging non minc file insertion

forgot to rename the .md file to imaging_non_minc_insertion.md

also missed renaming the script in mass_perldoc script

updated documentation and help section of the script with the correct name of the script

* Integrated Nicolas' improvement feedback

* Mélanie's feedback

* Adding the cpan install Jll JSON command to the install script

* Nicolas' feedback
@cmadjar cmadjar added this to the N/A milestone Feb 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants