update SyferText.py #145
Merged
update SyferText.py #145
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
updated versions for SyferText_0.1.0
updated versions for SyferText Setup.py for version 0.1.0
AlanAboudib
requested changes
Jul 10, 2020
There was a problem hiding this comment.
Thank you @ramesht007 for this PR. Please consider a few changes
AlanAboudib
approved these changes
Jul 13, 2020
AlanAboudib
added a commit
that referenced
this pull request
Jul 13, 2020
This reverts commit 51a7286.
|
Thanks @AlanAboudib for giving me the opportunity |
AlanAboudib
added a commit
that referenced
this pull request
Jan 20, 2021
* Created the LanguageModel class * Added add_pipe_template() to LanguageModel class * Updated language_model.py * Added set_vocab() and set_tokenizer() to Language * Implemented State search across the private grid * Create the State class * Create the StatePointer class * Renamed download_copy to get_copy * Added and attributed to State and pipe components * Bug fix * Added state load/dump functionality to the tokenizer * functional state load/dump and rule loading for Tokenizer * Delete PULL_REQUEST_TEMPLATE.md * working state load/dump and rule loading for Vocab * Working tokenization in local mode * Added simplify() and detail() to StatePointer * Compatibility with a new syft version * Added support to PySyft > 0.2.6 * remote state load for tokenizer and vocab * Updated LanguageModel and created LanguageModelPointer class * Added code to deploy states * language model deploy is working * LanguageModel search and load working * update SyferText.py (#145) * # updated setup.py updated versions for SyferText_0.1.0 * # updated verisons updated versions for SyferText Setup.py for version 0.1.0 * # updated setup.py * # made improvments * Update README.md (#146) * Update README.md modified installation guide of language models. * Update README.md * Update README.md Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Added support for loading vectors to Vocab (#150) * Black reformat * Merge master in 0.1.0 (#163) * Added the Lexeme class (#67) * Basic struct of Lexeme with setting attributes methods * Functions for getting lexical attributes and LexemeMeta class * Integer attributes ids for all the attributes of the Lexeme class * Lexeme lookup table in Vocab * Enum Class for attributes * Upgraded Vocab class, For lex_store and other basic functions. * Removed the start_pos and end_pos attributes from the TokenMeta class and it's corresponding usage in Tokenizer. * Extended Token class with various attributes of tokens and integrated Lexeme class with Tokens * Removed space_after attribute from TokenMeta * Added stop words list from spavy and integrated with Lexeme * Added tests for Lexeme class and its attributes * Added test for token attributes * Added Docstring for all attributes corresponding to Lexeme class and it's integration with Token, Language, Vocab classes * Resolved error in creation LexemeMeta in remote tokenization * Updating Remote Tokenizaation Tutorial (part 1) * Load vectors in vocab * update notebook tut 1 * load vector fix * Apply suggestions from code review Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Apply suggestions from code review Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Apply suggestions from code review Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update syfertext/vocab.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update syfertext/vocab.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update syfertext/vocab.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update syfertext/vocab.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * reforamting and function names updates * minor updates * lex->lex_meta * lexi->lex_meta * Apply suggestions from code review Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Major refactoring of code related to Lexemes. Introduces new method for adding custom flags, checking and setting flag for token * reformating * syntax errors * minor debugging * minor updates * Minor changes * minor refactoring of lexeme * refactoring * minor debugging * removed capping on maximum number of flags * added __str__mehod in token,was removed by mistake * Added tests for setting, checking, adding flags * black tests * minor change * minor change * removed lex_rank_test for lexemes * minor updates * removed add flags method from vocab Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update README.md * Added _get_valid_tokens() to Doc and Span (#114) * Added _get_valid_tokens() method * Removed redundant implementation in vector property * Refactored span, added _get_valid_tokens() Removed redundant implementation in vector property * Refactored doc_pointer.py * Typo corrected * Added suggested changes * Fixed typo * Incroporated suggested changes * Update syfertext/doc.py * Black files * Black files again :| Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Created CONTRIBUTORS.md file * docs: add sachin-101 as a contributor (#121) * docs: update README.md [skip ci] * docs: create .all-contributorsrc [skip ci] * update file path to CONTRIBUTORS.md Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: Nilansh Rajput <2017csb1092@iitrpr.ac.in> * docs: add AlanAboudib as a contributor (#122) * docs: update CONTRIBUTORS.md [skip ci] * docs: update .all-contributorsrc [skip ci] Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> * docs: add Nilanshrajput as a contributor (#127) * docs: update CONTRIBUTORS.md [skip ci] Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: Nilansh Rajput <2017csb1092@iitrpr.ac.in> * Add path to CONTRIBUTORS.md in Readme * docs: add bicycleman15 as a contributor (#128) * docs: update CONTRIBUTORS.md [skip ci] * docs: update .all-contributorsrc [skip ci] * docs: update CONTRIBUTORS.md [skip ci] * docs: update .all-contributorsrc [skip ci] Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: Nilansh Rajput <2017csb1092@iitrpr.ac.in> * Add support section at README (#129) * Remove all-contributors badge * Pypi publish (#104) * Files for Publishing syfertext on pypi * Workflow for publishing on pypi with github action * black reformat setup file * update python version * Update setup.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * remove release automation Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Replace Numpy arrays by torch tensors (#132) * # addded tensor to doc.py * # check for errors * # changed test_lang * # added token_types * # revert test_lang * Update doc.py * Remove numpy use from doc.py * Convert loaded vectors to torch tensors * Removed numpy from language tests * Remove Numpy instance from token.py * # removed numpy instances from tests * Remove Numy i=use from lexemes.py * remocve numpy import from vectors.py * # black test * # removed dtype * Add type hints at doc pointer * # fixed typos * Update syfertext/pointers/doc_pointer.py * # fixed import * import correction Co-authored-by: Nilansh Rajput <2017csb1092@iitrpr.ac.in> Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Removed garbage_collect_data from __init__() functions (#115) * Set garbage_collect_data to True Made garbage_collect_data argument value independent of the value passed by PySyft * Remove garbage_collect_data from init of Pointer classes Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update Pysyft version 0.2.7 on master (#149) * Update syft to Pysyft master branch syft pointing to PySyft https://github.com/OpenMined/PySyft@bc5337507047b325e79cb9b2060abac4bdc08f3f" * Added support for loading vectors to Vocab (#150) * Update README.md * Fix typo (#151) * typo fix * Update tutorials/usecases/UC01 - Sentiment Classifier - Private Datasets - (Secure Training).ipynb * Update tutorials/usecases/UC01 - Sentiment Classifier - Private Datasets - (Secure Training).ipynb * Update tutorials/usecases/UC01 - Sentiment Classifier - Private Datasets - (Secure Training).ipynb * Update tutorials/usecases/UC01 - Sentiment Classifier - Private Datasets - (Secure Training).ipynb Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update README.md * Update Readme (#117) * Update Readme * Update README.md Co-authored-by: kyscg <yasaswisrichandragandhi@gmail.com> * adding all contributors badge * readme syfertext introduction update * Update README.md * Update README.md * Update README.md Co-authored-by: kyscg <yasaswisrichandragandhi@gmail.com> Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update README.md * Update LICENSE * update syft version pypi release (#154) * update syft version pypi release To maintain stability with PyGrid and Pysyft, syft version should be consistent * black reformat setup.py * Update setup.py * added local model * added local model * black test * Update README.md * Update README.md * Update README.md * Proto id generation update (#159) * Msgpack code as hash of class name * added state * Add Simple tagger states, get the tests running * Black Reformat 0.1.0 * run pre-commit hook * Merge master into 0.1.0, resolve errors * reformat * Got all test running on mater+0.1.0 merge * remove temp debug file * bllack setup.py * Update README.md * Update syfertext/utils.py * minor refactoring Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> Co-authored-by: Sachin Kumar <sachinkumar04428@gmail.com> Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: Ramesht Shukla <36106177+ramesht007@users.noreply.github.com> Co-authored-by: praveenjoshi01 <praveenjoshi007@gmail.com> Co-authored-by: kyscg <yasaswisrichandragandhi@gmail.com> Co-authored-by: ramesht007 <shre611shukla@gmail.com> * Documentation Added (#164) * Added support for loading vectors to Vocab (#150) * Docs v.0.0 * Autodoc typehints removed * reqs * requirements edited * Added mmh3 * Removing other formats * Docs updated * Reformatted using black * Tokenizer issue solved * Reformatted tokenizer using black * Span reformatted * Update Tokenizer arguments * Tokenizer Doc String edited * Include private and special members * dict, weakref, module removed * Removed private and inherited methids * Stop words module removed from docs * Update syfertext/tokenizer.py * Version added Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> Co-authored-by: Nilansh Rajput <rajputnilansh@gmail.com> * Support for adding a single label classifier to a pipeline (#168) * Added support for loading vectors to Vocab * Added support for loading vectors to Vocab (#150) * Black * Added SingleLabelClassifier class with working initial functionality * small fixes * Fixed tests * removed unnecessary import * Updated team members in Readme * Update README.md * Fixed pipeline parsing. (#178) - implemented subpipeline resue * Implemented remote inference for SingleLabelClassifier (#180) * Support for remote inference using SingleLabelClassifier * Removed print statements * Fixed tokenization bug (#181) * Grid update (#172) * Update SyferText for Pygrid compatibility Got tutorials running on grid nodes, add protocol cmnds for encrypted vector * Bump up Pysyft version to 0.2.9 * point syft to tag0.2.9 * Apply suggestions from code review * minor changes from suggestion * send pipeline in deploy call * update decode_logits * black reformat Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Register state and pipeline from remote worker (#185) * Small_patch (#186) * add protocol in avg_doc_encd, correct pysyft link * add fss protocol in singl_lbl_clsfr * - Removed __len__ from SpanPointer and DocPointer #152 (#183) - Removed assert statements on len from tests * Corrected get_copy functions (#189) * fix for vector shapes (#190) * fix for vector shapes * Fixed tests * Remove state objects from pipeline (#193) * remove state objects from pipeline * Update pysyft to master branch (0.2.9) * Fix python=3.7 in CI build python3.9 raising error * remove storing state object in pipeline and associated fucntions and replace with state_info * Add tests for remote single label classifier (#194) * Update average doc encoder for no encryption case * Update single label classifier logits * Add tests for remote single label inference * Fix SingleLabelClassifier test to operate with pointers * Update local and remote tests for single label classifier * Add init file to resolve pytest conflict * Rename test to avoid name conflict * Update test to cover loading deployed pipeline * Fix access * Move local tests to distributed, restructured tests, corrected comments * Add test case for local single label inference before deployment * Syfertext 0.1.0 (#196) * Update average doc encoder for no encryption case * Update single label classifier logits * Add tests for remote single label inference * Fix SingleLabelClassifier test to operate with pointers * Update local and remote tests for single label classifier * Add init file to resolve pytest conflict * Rename test to avoid name conflict * Update test to cover loading deployed pipeline * Fix access * Move local tests to distributed, restructured tests, corrected comments * Add test case for local single label inference before deployment * Add remote label inference tests with access, update test pipeline * Implementing caching when loading from PyGrid nodes (#191) * Update SyferText for Pygrid compatibility Got tutorials running on grid nodes, add protocol cmnds for encrypted vector * Bump up Pysyft version to 0.2.9 * point syft to tag0.2.9 * Apply suggestions from code review * Init updated * File route changed * black formatting * Updated cache location * Tested pipeline on virtual workers * Loading from cache functionality completed * Caching test v1 * Adding Pysyft branch * Added type tuple in single_label_classifer * Resolving suggestions * Black formatting the changes * Removed redundant lines and improved test * Disabled the faulty test for the time being and removed cache_pipeline.py from tutorials * Retrying CI Co-authored-by: Nilanshrajput <2017csb1092@iitrpr.ac.in> Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * added pricon2020 tutorial notebook (#195) * added pricon2020 tutorial notebook * Fixed PySyft dependency version to 0.2.9 * Updated Syft version to the commit prior to 0.3.0 * Add pipeline parsing tests (#192) * add pipeline re-use tests * fix pipeline re-use tests * black Co-authored-by: Jatin Prakash <jatinprakash@Jatins-MacBook-Air.local> Co-authored-by: Ramesht Shukla <36106177+ramesht007@users.noreply.github.com> Co-authored-by: Apsal S Kalathukunnel <47264503+apzl@users.noreply.github.com> Co-authored-by: Nilanshrajput <2017csb1092@iitrpr.ac.in> Co-authored-by: Sachin Kumar <sachinkumar04428@gmail.com> Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: praveenjoshi01 <praveenjoshi007@gmail.com> Co-authored-by: kyscg <yasaswisrichandragandhi@gmail.com> Co-authored-by: ramesht007 <shre611shukla@gmail.com> Co-authored-by: Hersh Dhillon <hershdhillon23@gmail.com> Co-authored-by: Nilansh Rajput <rajputnilansh@gmail.com> Co-authored-by: duggalsu <5505558+duggalsu@users.noreply.github.com> Co-authored-by: j-chim <jennychim@gmail.com> Co-authored-by: Jatin Prakash <47978882+bicycleman15@users.noreply.github.com> Co-authored-by: Jatin Prakash <jatinprakash@Jatins-MacBook-Air.local>
AlanAboudib
added a commit
that referenced
this pull request
Jan 21, 2021
* Created the LanguageModel class * Added add_pipe_template() to LanguageModel class * Updated language_model.py * Added set_vocab() and set_tokenizer() to Language * Implemented State search across the private grid * Create the State class * Create the StatePointer class * Renamed download_copy to get_copy * Added and attributed to State and pipe components * Bug fix * Added state load/dump functionality to the tokenizer * functional state load/dump and rule loading for Tokenizer * Delete PULL_REQUEST_TEMPLATE.md * working state load/dump and rule loading for Vocab * Working tokenization in local mode * Added simplify() and detail() to StatePointer * Compatibility with a new syft version * Added support to PySyft > 0.2.6 * remote state load for tokenizer and vocab * Updated LanguageModel and created LanguageModelPointer class * Added code to deploy states * language model deploy is working * LanguageModel search and load working * update SyferText.py (#145) * # updated setup.py updated versions for SyferText_0.1.0 * # updated verisons updated versions for SyferText Setup.py for version 0.1.0 * # updated setup.py * # made improvments * Update README.md (#146) * Update README.md modified installation guide of language models. * Update README.md * Update README.md Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Added support for loading vectors to Vocab (#150) * Black reformat * Merge master in 0.1.0 (#163) * Added the Lexeme class (#67) * Basic struct of Lexeme with setting attributes methods * Functions for getting lexical attributes and LexemeMeta class * Integer attributes ids for all the attributes of the Lexeme class * Lexeme lookup table in Vocab * Enum Class for attributes * Upgraded Vocab class, For lex_store and other basic functions. * Removed the start_pos and end_pos attributes from the TokenMeta class and it's corresponding usage in Tokenizer. * Extended Token class with various attributes of tokens and integrated Lexeme class with Tokens * Removed space_after attribute from TokenMeta * Added stop words list from spavy and integrated with Lexeme * Added tests for Lexeme class and its attributes * Added test for token attributes * Added Docstring for all attributes corresponding to Lexeme class and it's integration with Token, Language, Vocab classes * Resolved error in creation LexemeMeta in remote tokenization * Updating Remote Tokenizaation Tutorial (part 1) * Load vectors in vocab * update notebook tut 1 * load vector fix * Apply suggestions from code review Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Apply suggestions from code review Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Apply suggestions from code review Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update syfertext/vocab.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update syfertext/vocab.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update syfertext/vocab.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update syfertext/vocab.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * reforamting and function names updates * minor updates * lex->lex_meta * lexi->lex_meta * Apply suggestions from code review Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Major refactoring of code related to Lexemes. Introduces new method for adding custom flags, checking and setting flag for token * reformating * syntax errors * minor debugging * minor updates * Minor changes * minor refactoring of lexeme * refactoring * minor debugging * removed capping on maximum number of flags * added __str__mehod in token,was removed by mistake * Added tests for setting, checking, adding flags * black tests * minor change * minor change * removed lex_rank_test for lexemes * minor updates * removed add flags method from vocab Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update README.md * Added _get_valid_tokens() to Doc and Span (#114) * Added _get_valid_tokens() method * Removed redundant implementation in vector property * Refactored span, added _get_valid_tokens() Removed redundant implementation in vector property * Refactored doc_pointer.py * Typo corrected * Added suggested changes * Fixed typo * Incroporated suggested changes * Update syfertext/doc.py * Black files * Black files again :| Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Created CONTRIBUTORS.md file * docs: add sachin-101 as a contributor (#121) * docs: update README.md [skip ci] * docs: create .all-contributorsrc [skip ci] * update file path to CONTRIBUTORS.md Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: Nilansh Rajput <2017csb1092@iitrpr.ac.in> * docs: add AlanAboudib as a contributor (#122) * docs: update CONTRIBUTORS.md [skip ci] * docs: update .all-contributorsrc [skip ci] Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> * docs: add Nilanshrajput as a contributor (#127) * docs: update CONTRIBUTORS.md [skip ci] Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: Nilansh Rajput <2017csb1092@iitrpr.ac.in> * Add path to CONTRIBUTORS.md in Readme * docs: add bicycleman15 as a contributor (#128) * docs: update CONTRIBUTORS.md [skip ci] * docs: update .all-contributorsrc [skip ci] * docs: update CONTRIBUTORS.md [skip ci] * docs: update .all-contributorsrc [skip ci] Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: Nilansh Rajput <2017csb1092@iitrpr.ac.in> * Add support section at README (#129) * Remove all-contributors badge * Pypi publish (#104) * Files for Publishing syfertext on pypi * Workflow for publishing on pypi with github action * black reformat setup file * update python version * Update setup.py Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * remove release automation Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Replace Numpy arrays by torch tensors (#132) * # addded tensor to doc.py * # check for errors * # changed test_lang * # added token_types * # revert test_lang * Update doc.py * Remove numpy use from doc.py * Convert loaded vectors to torch tensors * Removed numpy from language tests * Remove Numpy instance from token.py * # removed numpy instances from tests * Remove Numy i=use from lexemes.py * remocve numpy import from vectors.py * # black test * # removed dtype * Add type hints at doc pointer * # fixed typos * Update syfertext/pointers/doc_pointer.py * # fixed import * import correction Co-authored-by: Nilansh Rajput <2017csb1092@iitrpr.ac.in> Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Removed garbage_collect_data from __init__() functions (#115) * Set garbage_collect_data to True Made garbage_collect_data argument value independent of the value passed by PySyft * Remove garbage_collect_data from init of Pointer classes Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update Pysyft version 0.2.7 on master (#149) * Update syft to Pysyft master branch syft pointing to PySyft https://github.com/OpenMined/PySyft@bc5337507047b325e79cb9b2060abac4bdc08f3f" * Added support for loading vectors to Vocab (#150) * Update README.md * Fix typo (#151) * typo fix * Update tutorials/usecases/UC01 - Sentiment Classifier - Private Datasets - (Secure Training).ipynb * Update tutorials/usecases/UC01 - Sentiment Classifier - Private Datasets - (Secure Training).ipynb * Update tutorials/usecases/UC01 - Sentiment Classifier - Private Datasets - (Secure Training).ipynb * Update tutorials/usecases/UC01 - Sentiment Classifier - Private Datasets - (Secure Training).ipynb Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update README.md * Update Readme (#117) * Update Readme * Update README.md Co-authored-by: kyscg <yasaswisrichandragandhi@gmail.com> * adding all contributors badge * readme syfertext introduction update * Update README.md * Update README.md * Update README.md Co-authored-by: kyscg <yasaswisrichandragandhi@gmail.com> Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Update README.md * Update LICENSE * update syft version pypi release (#154) * update syft version pypi release To maintain stability with PyGrid and Pysyft, syft version should be consistent * black reformat setup.py * Update setup.py * added local model * added local model * black test * Update README.md * Update README.md * Update README.md * Proto id generation update (#159) * Msgpack code as hash of class name * added state * Add Simple tagger states, get the tests running * Black Reformat 0.1.0 * run pre-commit hook * Merge master into 0.1.0, resolve errors * reformat * Got all test running on mater+0.1.0 merge * remove temp debug file * bllack setup.py * Update README.md * Update syfertext/utils.py * minor refactoring Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> Co-authored-by: Sachin Kumar <sachinkumar04428@gmail.com> Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: Ramesht Shukla <36106177+ramesht007@users.noreply.github.com> Co-authored-by: praveenjoshi01 <praveenjoshi007@gmail.com> Co-authored-by: kyscg <yasaswisrichandragandhi@gmail.com> Co-authored-by: ramesht007 <shre611shukla@gmail.com> * Documentation Added (#164) * Added support for loading vectors to Vocab (#150) * Docs v.0.0 * Autodoc typehints removed * reqs * requirements edited * Added mmh3 * Removing other formats * Docs updated * Reformatted using black * Tokenizer issue solved * Reformatted tokenizer using black * Span reformatted * Update Tokenizer arguments * Tokenizer Doc String edited * Include private and special members * dict, weakref, module removed * Removed private and inherited methids * Stop words module removed from docs * Update syfertext/tokenizer.py * Version added Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> Co-authored-by: Nilansh Rajput <rajputnilansh@gmail.com> * Support for adding a single label classifier to a pipeline (#168) * Added support for loading vectors to Vocab * Added support for loading vectors to Vocab (#150) * Black * Added SingleLabelClassifier class with working initial functionality * small fixes * Fixed tests * removed unnecessary import * Updated team members in Readme * Update README.md * Fixed pipeline parsing. (#178) - implemented subpipeline resue * Implemented remote inference for SingleLabelClassifier (#180) * Support for remote inference using SingleLabelClassifier * Removed print statements * Fixed tokenization bug (#181) * Grid update (#172) * Update SyferText for Pygrid compatibility Got tutorials running on grid nodes, add protocol cmnds for encrypted vector * Bump up Pysyft version to 0.2.9 * point syft to tag0.2.9 * Apply suggestions from code review * minor changes from suggestion * send pipeline in deploy call * update decode_logits * black reformat Co-authored-by: Alan Aboudib <agabudeeb@gmail.com> * Register state and pipeline from remote worker (#185) * Small_patch (#186) * add protocol in avg_doc_encd, correct pysyft link * add fss protocol in singl_lbl_clsfr * - Removed __len__ from SpanPointer and DocPointer #152 (#183) - Removed assert statements on len from tests * Corrected get_copy functions (#189) * fix for vector shapes (#190) * fix for vector shapes * Fixed tests * Remove state objects from pipeline (#193) * remove state objects from pipeline * Update pysyft to master branch (0.2.9) * Fix python=3.7 in CI build python3.9 raising error * remove storing state object in pipeline and associated fucntions and replace with state_info * Add tests for remote single label classifier (#194) * Update average doc encoder for no encryption case * Update single label classifier logits * Add tests for remote single label inference * Fix SingleLabelClassifier test to operate with pointers * Update local and remote tests for single label classifier * Add init file to resolve pytest conflict * Rename test to avoid name conflict * Update test to cover loading deployed pipeline * Fix access * Move local tests to distributed, restructured tests, corrected comments * Add test case for local single label inference before deployment * added pricon2020 tutorial notebook * Fixed PySyft dependency version to 0.2.9 * Updated Syft version to the commit prior to 0.3.0 * Toy Tokenizer test with syft 030 * Working SpacyTokenizer. Removed lexemes and vocab from doc and tokens * Removed Underscore class and replaced it by Dicts * Renamed property in TextDoc to * Updated README Co-authored-by: Ramesht Shukla <36106177+ramesht007@users.noreply.github.com> Co-authored-by: Apsal S Kalathukunnel <47264503+apzl@users.noreply.github.com> Co-authored-by: Nilanshrajput <2017csb1092@iitrpr.ac.in> Co-authored-by: Sachin Kumar <sachinkumar04428@gmail.com> Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com> Co-authored-by: praveenjoshi01 <praveenjoshi007@gmail.com> Co-authored-by: kyscg <yasaswisrichandragandhi@gmail.com> Co-authored-by: ramesht007 <shre611shukla@gmail.com> Co-authored-by: Hersh Dhillon <hershdhillon23@gmail.com> Co-authored-by: Nilansh Rajput <rajputnilansh@gmail.com> Co-authored-by: duggalsu <5505558+duggalsu@users.noreply.github.com> Co-authored-by: j-chim <jennychim@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Updated versions for SyferText_0.1.0 for issue #139