New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Solr version should be explicitly defined as ckan requirement #3673

Open
SergK opened this Issue Jul 6, 2017 · 4 comments

Comments

Projects
None yet
4 participants
@SergK
Contributor

SergK commented Jul 6, 2017

CKAN Version if known (or site URL)

ckan (2.8.0a0)

Please describe the expected behavior

nosetest should pass with solr version 6.2 or at least it should be explicitly mentioned that tests use solr version solr-4.3.1 and the same version should be used for production use. We can also upgrade to solr-6.2, then tests should be updated as well.

Please describe the actual behaviour

Run nosetests test with solr version 6.2

nosetests --ckan --reset-db --with-pylons=test-core.ini --nologcapture --with-coverage --cover-package=ckan --cover-package=ckanext --with-xunit --xunit-file=$CIRCLE_TEST_REPORTS/nose/junit.xml --segments=$SEGMENTS ckan ckanext`

It is expected to pass the test, but it fails:

 /home/jenkins/workspace/bos-ckan.test/venv/bin/nosetests --ckan --reset-db --with-pylons=test-core.ini --nologcapture --with-coverage --cover-package=ckan --cover-package=ckanext --with-xunit --xunit-file=/home/jenkins/workspace/bos-ckan.test/nose/junit.xml --segments=01234 ckan ckanext
No handlers could be found for logger "ckan.lib.uploader"
...../home/jenkins/workspace/bos-ckan.test/venv/local/lib/python2.7/site-packages/sqlalchemy/orm/unitofwork.py:79: SAWarning: Usage of the 'related attribute set' operation is not currently supported within the execution stage of the flush process. Results may not be consistent.  Consider using alternative event listeners or connection-level operations instead.
  sess._flush_warning("related attribute set")
...................................................................................................................................................................................................................................................................................F........................S............................................................................................................................................................................................................................................................................................................................................................................................................................................................
======================================================================
FAIL: ckan.tests.legacy.lib.test_solr_search_index.TestSolrSearch.test_1_basic
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/workspace/bos-ckan.test/venv/local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/home/jenkins/workspace/bos-ckan.test/ckan/ckan/tests/legacy/lib/test_solr_search_index.py", line 54, in test_1_basic
    assert len(results) == 2
AssertionError

What steps can be taken to reproduce the issue?

  • Configure solr version 6.2
  • run nosetest
nosetests --ckan --reset-db --with-pylons=test-core.ini --nologcapture --with-coverage --cover-package=ckan --cover-package=ckanext --with-xunit --xunit-file=$CIRCLE_TEST_REPORTS/nose/junit.xml --segments=$SEGMENTS ckan ckanext`
@amercader

This comment has been minimized.

Show comment
Hide comment
@amercader

amercader Jul 6, 2017

Member

@SergK You are right, we should document the supported Solr versions.

@TkTech you worked on this recently, any ideas on what we should recommend?

Are there any extra steps that need to be added to these instructions to support Solr 5 or 6?

http://docs.ckan.org/en/latest/maintaining/installing/install-from-package.html#install-and-configure-solr

As for this particular issue it looks like the behaviour of Solr 6 has changed (@wardi mentioned fq issues)

Member

amercader commented Jul 6, 2017

@SergK You are right, we should document the supported Solr versions.

@TkTech you worked on this recently, any ideas on what we should recommend?

Are there any extra steps that need to be added to these instructions to support Solr 5 or 6?

http://docs.ckan.org/en/latest/maintaining/installing/install-from-package.html#install-and-configure-solr

As for this particular issue it looks like the behaviour of Solr 6 has changed (@wardi mentioned fq issues)

@TkTech

This comment has been minimized.

Show comment
Hide comment
@TkTech

TkTech Jul 7, 2017

Contributor

We can list usable versions but they release so frequently and with such poor quality releases there's little point in supporting anything official. Currently CKAN can work with minor changes from v3 to v6 (see #3510)

Contributor

TkTech commented Jul 7, 2017

We can list usable versions but they release so frequently and with such poor quality releases there's little point in supporting anything official. Currently CKAN can work with minor changes from v3 to v6 (see #3510)

@Cheomm88

This comment has been minimized.

Show comment
Hide comment
@Cheomm88

Cheomm88 Feb 7, 2018

Contributor

Hello,
I have just installed CKAN in Ubuntu and it seems it uses solR v.3.6. I'm working in another installation but this time in centOS and all tutorials/hows to talks about using solR 1.4.x

Which version should I install?

"Hows to"
https://github.com/ckan/ckan/wiki/How-to-install-CKAN-2.5.2-on-CentOS-6.8
https://github.com/ckan/ckan/wiki/How-to-install-CKAN-2.4.1-on-CentOS-7

Contributor

Cheomm88 commented Feb 7, 2018

Hello,
I have just installed CKAN in Ubuntu and it seems it uses solR v.3.6. I'm working in another installation but this time in centOS and all tutorials/hows to talks about using solR 1.4.x

Which version should I install?

"Hows to"
https://github.com/ckan/ckan/wiki/How-to-install-CKAN-2.5.2-on-CentOS-6.8
https://github.com/ckan/ckan/wiki/How-to-install-CKAN-2.4.1-on-CentOS-7

@TkTech

This comment has been minimized.

Show comment
Hide comment
@TkTech

TkTech May 14, 2018

Contributor

I'm in favor of only officially supporting recent versions of Solr with the next release. Solr has been pushing breaking update versions too quickly for us to support a wide range of versions perpetually.

Version 6.6.* is stable and trivial to install from the Solr site. Solr maintainers seem to be behind with debian and most other distros being stuck on 3.6.2. Our documentation and packages should never recommend using the system solr package.

Documentation really needs updating, we have some install guides recommending solr 1.4.1. We should stop covering "how to install solr" in all install guides and just point to the Solr guide. We're just creating duplicate, often incorrect/outdated documentation that adds extra maintenance.

@amercader thoughts on pegging to 6.6.2 for now? I will update the schema and lib/search, along with any documentation I can find.

Contributor

TkTech commented May 14, 2018

I'm in favor of only officially supporting recent versions of Solr with the next release. Solr has been pushing breaking update versions too quickly for us to support a wide range of versions perpetually.

Version 6.6.* is stable and trivial to install from the Solr site. Solr maintainers seem to be behind with debian and most other distros being stuck on 3.6.2. Our documentation and packages should never recommend using the system solr package.

Documentation really needs updating, we have some install guides recommending solr 1.4.1. We should stop covering "how to install solr" in all install guides and just point to the Solr guide. We're just creating duplicate, often incorrect/outdated documentation that adds extra maintenance.

@amercader thoughts on pegging to 6.6.2 for now? I will update the schema and lib/search, along with any documentation I can find.

@rossjones rossjones referenced this issue Jun 7, 2018

Closed

Solr #2333

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment