Nextant not scraping documents #74
Comments
|
First, you should fix the 'text_general' field-type: ./occ nextant:check --fix Then, have a look to this thread: |
|
@daita thank you for your fast response I must admit I don't really know what i am doing with solr/nextant I have started looking at the thread you have posted, however, regarding your first recommendation the check --fix command does not appear to fix the text_general field-type. the command runs as bellow but if the check is re-run i t still fails repeatedly. root@webserver:~# sudo -u www-data php /var/www/owncloud/occ nextant:check --fix
Your solr contains 93199 documents :
just a little more information for you.. i did have to remove and re added the nextant app. this resolved some of the problems i was having. |
|
hmm, thanks for the report, I guess there is a conflict with the default field-type from the default config of your core (solr). I'll see what I can do to fix this next release Note that I do not think this create any major issue; nextant should still work |
|
In the meanwhile, can you check the logs of your solr when you're trying to nextant:check --fix ? Does it produce any error message ? |
|
no errors are produced @daita I have run the check along with verbose logging. I did have a large amount of the bellow errors LukeRequestHandler Error getting file length for [segments_97] java.nio.file.NoSuchFileException: /var/solr/data/nextant2/data/index/segments_97 However i font think there are related. unfortunately I am currently moving the VM to a new host so will not be able to fault find this further until that is complete. Thank you for all your help |
|
Are you using Solr 6.3.0 ? https://help.nextcloud.com/t/psa-nextant-does-not-like-solr-6-3-0/5297/1 |
|
Can you try this version: https://github.com/nextcloud/nextant/releases/tag/0.10.0-rc ? |
|
0.10.0 is out and should fix this issue |
Firstly my apologies if this has already been covered. I could not see a similar issue.
On a frash solr install and nextant 0.6.6 I am unable to complete a full test search
running nextant:check --info results in the following
array (
'instant' => true,
'configured' => '1',
'ping' => true,
'solr_url' => 'HIDDEN',
'solr_core' => 'HIDDEN',
'solr_timeout' => '30',
'nextant_version' => '0.6.6 (beta)',
'index_files' => '1',
'index_files_needed' => '0',
'index_files_max_size' => '40',
'index_files_tree' => '1',
'index_files_sharelink' => '1',
'index_files_external' => '0',
'index_files_encrypted' => '0',
'index_files_filters_text' => '1',
'index_files_filters_pdf' => '1',
'index_files_filters_office' => '1',
'index_files_filters_image' => '0',
'index_files_filters_audio' => '0',
'index_files_filters_extensions' => '',
'display_result' => '2',
'replace_core_search' => 0,
'current_docs' => 93199,
'current_segments' => 22,
'bookmarks_app_enabled' => false,
'index_bookmarks' => '1',
'index_bookmarks_needed' => '0',
'index_live' => '1',
'index_live_queuekey' => '540???',
'index_delay' => '2',
'index_locked' => '1479409886',
'index_files_last' => '1479339676',
'index_files_last_format' => 'Wed, 16 Nov 2016 23:41:16 +0000',
'index_bookmarks_last' => '1479339676',
'index_bookmarks_last_format' => 'Wed, 16 Nov 2016 23:41:16 +0000',
'source' => 'check',
)
Pinging 10.72.0.2:8983/solr/nextant2 : ok
Checking Solr schema fields
The text was updated successfully, but these errors were encountered: