Skip to content

Block 2 Ingest

Jump to bottom
Eric E Palmer edited this page Oct 23, 2026 · 1 revision

Block 2 - Ingest V0

(./) Copied over from working--needs to be more general.

Description

This block additionally populates the F3 orig directory's IMAGEFILES/NOMINALS/ and SUMFILES/ sub-directories with Detailed Survey image files which are consistent across sub-tests in readiness for registering Detailed Survey images.

Assumptions

  • You have invoked a Bourne-Again Shell (bash) on ormacsrv1.lpl.arizona.edu
  • You are a member of the group OREX\spc
  • You have set up a skeleton directory in the following format:
 /SPC_Test/F3G-Nav/
                   ORex/
                            DATA/
                   base/
                            IMAGEFILES/
                            SHAPEFILES/
                   lsupport/
                   orig/
                   results/
                   test/

(./) Need to figure out how we will refer to these and if they should be links. I only linked this one as a sample to see!

User inputs

  • testID - Name of the F3 test directory (for example, 'F3E-Limbs')
  • blockID - User-specified identifier for typescript textfile name (for example, 'Block-02-01-IngestImages-TestSpecific')

Procedure

1. Initial inputs

testID=F3G-Nav
blockID=Block-02-01-IngestImages-TestSpecific

2. Set-up

cd /SPC_Test/$testID
script
date
pwd
ls -l

(./) Not sure how this will appear. Fix numbering.

}}}
=== 3. Populate sub-directories ===
{{{
rsync -ha base/F3G-IMAGEFILES/M60* base/IMAGEFILES/
rsync -ha base/F3G-IMAGEFILES/P60* base/IMAGEFILES/
ls -l base/IMAGEFILES/

rsync -ha base/F3G-DSM-NOMINALS/M60* orig/NOMINALS/
ls -l orig/NOMINALS

rsync -ha base/F3G-DSM-SUMFILES/M60* orig/SUMFILES/
ls -l orig/SUMFILES

(./) should those have further subheadings on them for each section??

}}}


=== 4. Generate PICTLIST.TXT file ===
{{{
ls base/IMAGEFILES/M* | cut -d '/' -f 3 | cut -d '.' -f 1 > lsupport/PICTLIST.TXT
ls base/IMAGEFILES/P* | cut -d '/' -f 3 | cut -d '.' -f 1 >> lsupport/PICTLIST.TXT
sed -i -e 's/^/ /' lsupport/PICTLIST.TXT 
echo END >> lsupport/PICTLIST.TXT
awk '/M/ { print $1 }' lsupport/PICTLIST-TAG1-100mx100m.TXT > lsupport/PICTLIST.TXT
awk '/P59/ { print $1 }' lsupport/PICTLIST-TAG1-100mx100m.TXT >> lsupport/PICTLIST.TXT
sed -i -e 's/^/ /' lsupport/PICTLIST.TXT 
echo END >> lsupport/PICTLIST.TXT
cat lsupport/PICTLIST.TXT

5. Generate list of images needing registering/autoregistering

awk '/M60/ { print $1 }' lsupport/PICTLIST-TAG1-100mx100m.TXT > lsupport/PICTLIST-forRegistering.TXT
sed -i -e 's/^/ /' lsupport/PICTLIST-forRegistering.TXT 
echo END >> lsupport/PICTLIST-forRegistering.TXT
cat lsupport/PICTLIST-forRegistering.TXT

6. Complete procedure

exit
if [ ! -d /SPC_Test/$testID/log ]; then
  mkdir /SPC_Test/$testID/log
fi
mv typescript /SPC_Test/$testID/log/log-typescript-${blockID}

(Compiled by DL)

Clone this wiki locally