Can't view sample code.

[sbmaruf]

I'm following this page.
The colab notebook can't be accessed. Here is the link of the page. I am trying to access sample code link. https://github.com/google/sentencepiece/blob/master/tensorflow/README.md

[omarsar]

Same problem here as well! I also wasn't able to run the example code on the README file. I figured the interface changed. Or I may be wrong?

>>> import sentencepiece as spm
>>> s = spm.SentencePieceProcessor()
>>> s.Load('spm.model')
>>> for n in range(5):
...     s.SampleEncodeAsPiece('New York', -1, 0.1)
... 
['▁', 'N', 'e', 'w', '▁York']
['▁', 'New', '▁York']
['▁', 'New', '▁Y', 'o', 'r', 'k']
['▁', 'New', '▁York']
['▁', 'New', '▁York']

[ebuildy]

You can use dir(s) to list the available methods:

['DecodeIds', 'DecodeIdsAsSerializedProto', 'DecodePieces', 'DecodePiecesAsSerializedProto', 'EncodeAsIds', 'EncodeAsPieces', 'EncodeAsSerializedProto', 'GetPieceSize', 'GetScore', 'IdToPiece', 'IsControl', 'IsUnknown', 'IsUnused', 'Load', 'LoadFromSerializedProto', 'LoadOrDie', 'LoadVocabulary', 'NBestEncodeAsIds', 'NBestEncodeAsPieces', 'NBestEncodeAsSerializedProto', 'PieceToId', 'ResetVocabulary', 'SampleEncodeAsIds', 'SampleEncodeAsPieces', 'SampleEncodeAsSerializedProto', 'SetDecodeExtraOptions', 'SetEncodeExtraOptions', 'SetVocabulary', '__class__', '__del__', '__delattr__', '__dict__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattr__', '__getattribute__', '__getitem__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__le__', '__len__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__str__', '__subclasshook__', '__swig_destroy__', '__swig_getmethods__', '__swig_setmethods__', '__weakref__', 'bos_id', 'decode_ids', 'decode_ids_as_serialized_proto', 'decode_pieces', 'decode_pieces_as_serialized_proto', 'encode_as_ids', 'encode_as_pieces', 'encode_as_serialized_proto', 'eos_id', 'get_piece_size', 'get_score', 'id_to_piece', 'is_control', 'is_unknown', 'is_unused', 'load', 'load_from_serialized_proto', 'load_vocabulary', 'nbest_encode_as_ids', 'nbest_encode_as_pieces', 'nbest_encode_as_serialized_proto', 'pad_id', 'piece_to_id', 'reset_vocabulary', 'sample_encode_as_ids', 'sample_encode_as_pieces', 'sample_encode_as_serialized_proto', 'set_decode_extra_options', 'set_encode_extra_options', 'set_vocabulary', 'this', 'unk_id']

Here, there is a typo: SampleEncodeAsPieces

[naveenkumarg651]

I am trying to run sentencepiece example give in readme but stuck with this following error

import sentencepiece as spm
s = spm.SentencePieceProcessor()
module 'sentencepiece' has no attribute 'SentencePieceProcessor'