Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate external libraries for full-text indices on MariaDB #126

Closed
marfox opened this issue Nov 15, 2018 · 4 comments
Assignees
Labels
Projects
Milestone

Comments

@marfox
Copy link
Member

@marfox marfox commented Nov 15, 2018

SQL Alchemy does not natively support creation of fullt-text indices.
Investigate https://github.com/mengzhuo/sqlalchemy-fulltext-search

@marfox marfox added the task label Nov 15, 2018
@marfox marfox added this to the Importer milestone Nov 15, 2018
@marfox marfox added this to To do in soweego via automation Nov 15, 2018
@marfox marfox moved this from To do to Upcoming in soweego Nov 20, 2018
@marfox marfox moved this from Upcoming to Doing in soweego Nov 21, 2018
@marfox marfox self-assigned this Nov 21, 2018
@MaxFrax

This comment has been minimized.

Copy link
Collaborator

@MaxFrax MaxFrax commented Nov 26, 2018

Currently our projects database setup is the following:

dialect: mysql
driver: pymysql
storage engine:*'INNODB
MariaDB version: 10.0.36

From https://mariadb.com/kb/en/library/full-text-index-overview/:

Full-text indexes can be used only with MyISAM and Aria tables, from MariaDB 10.0.5 with InnoDB tables and from MariaDB 10.0.15 with Mroonga tables, and can be created only for CHAR, VARCHAR, or TEXT columns.

As we can see from above our current configuration INNODB against MariaDB 10.0.36 does not support full text indices.

NOTICE: The we are using this MariaDB version due to current Mix-n-match tool forge setup.

@MaxFrax

This comment has been minimized.

Copy link
Collaborator

@MaxFrax MaxFrax commented Nov 26, 2018

There is another useful take away from the MariaDB docs: index in our scenario should be created after the huge data insertion. In this way we will achieve better performances.

@MaxFrax

This comment has been minimized.

Copy link
Collaborator

@MaxFrax MaxFrax commented Nov 27, 2018

It seems that the docs are wrong. I've just tried to create a full text index and the show index from query shows it. Actually, using also the MATCH AGAINST construct returns results.

@marfox

This comment has been minimized.

Copy link
Member Author

@marfox marfox commented Nov 29, 2018

It seems that the docs are wrong. I've just tried to create a full text index and the show index from query shows it. Actually, using also the MATCH AGAINST construct returns results.

Indeed, I have already tried to build full-text indices in #35

@MaxFrax MaxFrax assigned MaxFrax and unassigned marfox Dec 12, 2018
@marfox marfox closed this in #152 Dec 29, 2018
soweego automation moved this from Doing to Done Dec 29, 2018
marfox added a commit that referenced this issue Dec 29, 2018
Closes #90 and #126
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
soweego
  
Done
2 participants
You can’t perform that action at this time.