Stemmer

[FilipBolt]

Added code comments around stemmer for future reference.

Have lemmatizer locally, but need to figure out how to handle resource files (in general in this project).

Also added markdown notes on project guidelines about coding standard.

Output of tests:

> py.test --cov=takepod test

========================================== test session starts
==========================================
platform linux -- Python 3.6.5, pytest-3.7.4, py-1.6.0, pluggy-0.7.1
rootdir: /home/filip/Documents/Doktorski/Projects/Podium, inifile:
plugins: cov-2.6.0
collected 4 items

test/test_base_model.py
.                                                                         [ 25%]
test/test_metrics.py
.                                                                            [ 50%]
test/test_preproc.py
.                                                                            [ 75%]
test/test_pytest.py
.                                                                             [100%]

----------- coverage: platform linux, python 3.6.5-final-0 -----------
Name                                                Stmts   Miss  Cover
-----------------------------------------------------------------------
takepod/__init__.py                                     1      0   100%
takepod/metrics/__init__.py                             3      0   100%
takepod/models/__init__.py                              0      0   100%
takepod/models/base/__init__.py                         0      0   100%
takepod/models/base_model.py                           11      3    73%
takepod/models/simple_sentiment_analysis.py            66     66     0%
takepod/preproc/__init__.py                             0      0   100%
takepod/preproc/lemmatizer/__init__.py                  0      0   100%
takepod/preproc/lemmatizer/croatian_lemmatizer.py      67     67     0%
takepod/preproc/stemmer/__init__.py                     0      0   100%
takepod/preproc/stemmer/croatian_stemmer.py            36     12    67%
takepod/storage/__init__.py                             0      0   100%
-----------------------------------------------------------------------
TOTAL                                                 184    148    20%


======================================= 4 passed in 0.84 seconds
========================================

[mttk]

Cool, this is pretty simple for a stemmer. IMO we can also export the stopwords to a file (since the rules as well as the trasnforms are in a file), translate and comment everything and it's ok.

[mttk]

Are all of the requirements actually required?

[FilipBolt]

You're right, I've trimmed down the list (roughly manually) and found that https://medium.com/@tomagee/pip-freeze-requirements-txt-considered-harmful-f0bce66cf895

I'll put the link in the README.md.

[FilipBolt]

Hope to have taken into account your comments. I rewrote the most of the stemmer and added tests to familiarize myself with it. The requirements file should also be cleaner, thanks for all the useful suggestions.

py.test --cov-report term-missing --cov=takepod test                                                   ========================================== test session starts ==========================================
platform linux -- Python 3.6.5, pytest-3.7.4, py-1.6.0, pluggy-0.7.1
rootdir: /home/filip/Documents/Doktorski/Projects/Podium, inifile:
plugins: cov-2.6.0
collected 8 items

test/test_base_model.py .                                                                         [ 12%]
test/test_metrics.py .                                                                            [ 25%]
test/test_preproc.py .....                                                                        [ 87%]
test/test_pytest.py .                                                                             [100%]

----------- coverage: platform linux, python 3.6.5-final-0 -----------
Name                                                Stmts   Miss  Cover   Missing
---------------------------------------------------------------------------------
takepod/__init__.py                                     1      0   100%
takepod/metrics/__init__.py                             3      0   100%
takepod/models/__init__.py                              0      0   100%
takepod/models/base/__init__.py                         0      0   100%
takepod/models/base_model.py                           11      3    73%   8, 15, 19
takepod/preproc/__init__.py                             0      0   100%
takepod/preproc/lemmatizer/__init__.py                  0      0   100%
takepod/preproc/lemmatizer/croatian_lemmatizer.py      67     67     0%   1-119
takepod/preproc/stemmer/__init__.py                     0      0   100%
takepod/preproc/stemmer/croatian_stemmer.py            35      0   100%
takepod/storage/__init__.py                             0      0   100%
---------------------------------------------------------------------------------
TOTAL                                                 117     70    40%


======================================= 8 passed in 0.89 seconds ========================================