Update single record in SOLR takes too much time

[peer35]

Started PATCH "/records/289" for 130.37.15.198 at 2023-01-31 08:23:59 +0000
I, [2023-01-31T08:23:59.167496 #13]  INFO -- : Processing by RecordsController#update as HTML
I, [2023-01-31T08:23:59.168461 #13]  INFO -- :   Parameters: {"utf8"=>"✓", "authenticity_token"=>"g+7BS7YNQtFp88oz0iJuJ48nAHPjNKn7BlgALjGsYLcVfS38gAUkJ4u4XvyQqu93GG0E+8Tn1JpsXIKHUFhSWw==", "record"=>{"endnum"=>"298", "title"=>"A systematic review of the scales used for the measurement of cancer-related fatigue (CRF)", "doi"=>"10.1093/annonc/mdn537", "url"=>["<Go to ISI>://WOS:000262718000003", "https://www.ncbi.nlm.nih.gov/pubmed/18678767"], "abstract"=>"Background: Fatigue in cancer is very common and can be experienced at all stages of disease and in survivors. There is no accepted definition of cancer-related fatigue (CRF) and no agreement on how it should be measured. A number of scales have been developed to quantify the phenomenon of CRF. These vary in the quality of psychometric properties, ease of administration, dimensions of CRF covered and extent of use in studies of cancer patients. This review seeks to identify the available tools for measuring CRF and to make recommendations for ongoing research into CRF.", "issn"=>"0923-7534", "issue"=>"1", "journal"=>"Annals of Oncology", "accnum"=>"WOS:000262718000003", "author_str"=>"Minton, O.;Stone, P.", "pubyear"=>"2009", "startpage"=>"17-25", "ss"=>["Physical state", "Emotional state", "Cognitive/mental state"], "fs"=>["Physical functioning", "Cognitive/mental functioning"], "age"=>["Children (0-18)", "Adults (18-65)", "Seniors (65+)"], "disease"=>["Neoplasms and related symptoms"], "pnp"=>["Patient Reported Outcome"], "tmi"=>["1 - Questionnaires"], "instrument_ids"=>["", "1520", "463", "6930", "2356", "6931", "6940", "2366", "733", "6936", "2370", "736", "2372", "4330", "6922"], "admin_notes"=>"Converted from old COSMIN database\r\ntest2", "status"=>"published"}, "commit"=>"Update Record", "id"=>"289"}
I, [2023-01-31T08:23:59.194074 #13]  INFO -- : <ActionController::Parameters {"endnum"=>"298", "title"=>"A systematic review of the scales used for the measurement of cancer-related fatigue (CRF)", "doi"=>"10.1093/annonc/mdn537", "url"=>["<Go to ISI>://WOS:000262718000003", "https://www.ncbi.nlm.nih.gov/pubmed/18678767"], "abstract"=>"Background: Fatigue in cancer is very common and can be experienced at all stages of disease and in survivors. There is no accepted definition of cancer-related fatigue (CRF) and no agreement on how it should be measured. A number of scales have been developed to quantify the phenomenon of CRF. These vary in the quality of psychometric properties, ease of administration, dimensions of CRF covered and extent of use in studies of cancer patients. This review seeks to identify the available tools for measuring CRF and to make recommendations for ongoing research into CRF.", "issn"=>"0923-7534", "issue"=>"1", "journal"=>"Annals of Oncology", "accnum"=>"WOS:000262718000003", "pubyear"=>"2009", "startpage"=>"17-25", "ss"=>["Physical state", "Emotional state", "Cognitive/mental state"], "fs"=>["Physical functioning", "Cognitive/mental functioning"], "age"=>["Children (0-18)", "Adults (18-65)", "Seniors (65+)"], "disease"=>["Neoplasms and related symptoms"], "pnp"=>["Patient Reported Outcome"], "tmi"=>["1 - Questionnaires"], "instrument_ids"=>["1520", "463", "6930", "2356", "6931", "6940", "2366", "733", "6936", "2370", "736", "2372", "4330", "6922"], "admin_notes"=>"Converted from old COSMIN database\r\ntest2", "status"=>"published", "bpv"=>[], "ghp"=>[], "oql"=>[], "author"=>["Minton, O.", "Stone, P."]} permitted: true>
I, [2023-01-31T08:23:59.236790 #13]  INFO -- : add to solr index 289
I, [2023-01-31T08:24:13.219273 #13]  INFO -- : Redirected to http://adminyoda.labs.vu.nl:3013/catalog/289
I, [2023-01-31T08:24:13.221120 #13]  INFO -- : Completed 302 Found in 14052ms (ActiveRecord: 25.8ms

On the producton server it goes to 30 seconds and even over 60 seconds for other records.

[peer35]

Interestingly this does not happen when you do the add to a still empty index.

Short-term work-around:

• delay solr update. This means the catalog page the user is dropped at will not have been updated. Consider redirecting to another page. 745b258#diff-4bc02ce24627ca734a0f0006642df5ec3f7c07cf669126d6f52a7d23eaeffcce

Longer term:

• First update the config to get rid of deprecation warnings.
• Analyze why add to solr takes so long.

[peer35]

https://solr.apache.org/guide/solr/latest/configuration-guide/commits-transaction-logs.html

[peer35]

Fixed up the backend record show page. All record updating now works via delay.