diff --git a/cob_datapipeline/scripts/ingest_marc.sh b/cob_datapipeline/scripts/ingest_marc.sh index ea7b603e..c31ef515 100755 --- a/cob_datapipeline/scripts/ingest_marc.sh +++ b/cob_datapipeline/scripts/ingest_marc.sh @@ -18,6 +18,11 @@ gem install bundler bundle config set force_ruby_platform true bundle install --without=debug +# force Ruby’s external/internal encodings to UTF-8 +export RUBYOPT='-E UTF-8' +export LANG=en_US.UTF-8 +export LC_ALL=en_US.UTF-8 + data_in=$(echo $DATA | jq -r '.[]') if [ -z "$COMMAND" ]; then diff --git a/doc/production-solr-collection-swap-process.md b/doc/production-solr-collection-swap-process.md index 5143df47..d4a5a2f7 100644 --- a/doc/production-solr-collection-swap-process.md +++ b/doc/production-solr-collection-swap-process.md @@ -13,6 +13,7 @@ These steps are broken down into three sections as these parts can be run sequen 1. Trigger the `boundwith_move_alma_sftp_to_s3` Dag and wait for completion. 1. Skip this step if you want to reuse the s3 alma_sftp files from the last run. 1. Turn off the `catalog_pre_production_oai_harvest_v2` Dag. +1. Check the tul_cob-catalog-solr and cob_index repositories for any code changes. If there are any code changes that need to be included in the reindex, create a new release. 1. Set the Airflow variables required for the full reindex: 1. Ensure the variable `CATALOG_PRE_PRODUCTION_SOLR_CONFIG` is using the correct version of solr configs. See the [tul_cob-catalog-solr releases](https://github.com/tulibraries/tul_cob-catalog-solr/releases) to confirm latest version, if needed. 1. Ensure the variable `PRE_PRODUCTION_COB_INDEX_VERSION` is the correct version of cob_index. See the [cob_index releases](https://github.com/tulibraries/cob_index/releases) to confirm latest version, if needed.