Skip to content

Normalize captitalization in entry point identifiers + increment version #132

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
May 2, 2023
Merged

Normalize captitalization in entry point identifiers + increment version #132

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
f5dbd43
Normalize captitalization in entry point identifiers
shadeMe May 2, 2023
45e55b2
Set version to `0.0.8`
shadeMe May 2, 2023
06b25de
Preserve the casing of `HF`
shadeMe May 2, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion curated_transformers/tests/tokenization/test_bbpe_encoder.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
@pytest.fixture
def toy_encoder(test_dir):
encoder = build_byte_bpe_encoder_v1()
encoder.init = registry.model_loaders.get("curated-transformers.ByteBPELoader.v1")(
encoder.init = registry.model_loaders.get("curated-transformers.ByteBpeLoader.v1")(
vocab_path=test_dir / "toy-vocab.json", merges_path=test_dir / "toy-merges.txt"
)
encoder.initialize()
Expand Down
4 changes: 2 additions & 2 deletions curated_transformers/tests/tokenization/test_registry.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@
"encoder_name",
[
"curated-transformers.BertWordpieceEncoder.v1",
"curated-transformers.ByteBPEEncoder.v1",
"curated-transformers.ByteBpeEncoder.v1",
"curated-transformers.CamembertSentencepieceEncoder.v1",
"curated-transformers.CharEncoder.v1",
"curated-transformers.SentencepieceEncoder.v1",
Expand All @@ -22,7 +22,7 @@ def test_encoder_from_registry(encoder_name):
@pytest.mark.parametrize(
"loader_name",
[
"curated-transformers.ByteBPELoader.v1",
"curated-transformers.ByteBpeLoader.v1",
"curated-transformers.CharEncoderLoader.v1",
"curated-transformers.HFTransformerEncoderLoader.v1",
"curated-transformers.HFPieceEncoderLoader.v1",
Expand Down
6 changes: 3 additions & 3 deletions setup.cfg
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
[metadata]
version = 0.0.7
version = 0.0.8
description = Curated transformer models
url = https://github.com/explosion/curated-transformers
author = Explosion
Expand Down Expand Up @@ -34,7 +34,7 @@ spacy_architectures =
curated-transformers.LastTransformerLayerListener.v1 = curated_transformers.models.listeners:build_last_transformer_layer_listener_v1
curated-transformers.ScalarWeightingListener.v1 = curated_transformers.models.listeners:build_scalar_weighting_listener_v1
curated-transformers.BertWordpieceEncoder.v1 = curated_transformers.tokenization:build_bert_wordpiece_encoder_v1
curated-transformers.ByteBPEEncoder.v1 = curated_transformers.tokenization:build_byte_bpe_encoder_v1
curated-transformers.ByteBpeEncoder.v1 = curated_transformers.tokenization:build_byte_bpe_encoder_v1
curated-transformers.CamembertSentencepieceEncoder.v1 = curated_transformers.tokenization:build_camembert_sentencepiece_encoder_v1
curated-transformers.CharEncoder.v1 = curated_transformers.tokenization:build_char_encoder_v1
curated-transformers.SentencepieceEncoder.v1 = curated_transformers.tokenization:build_sentencepiece_encoder_v1
Expand All @@ -49,7 +49,7 @@ spacy_cli =
curated-transformers.quantize = curated_transformers.cli.quantize:quantize_cli

thinc_model_loaders =
curated-transformers.ByteBPELoader.v1 = curated_transformers.tokenization:build_byte_bpe_encoder_loader_v1
curated-transformers.ByteBpeLoader.v1 = curated_transformers.tokenization:build_byte_bpe_encoder_loader_v1
curated-transformers.CharEncoderLoader.v1 = curated_transformers.tokenization:build_char_encoder_loader_v1
curated-transformers.HFTransformerEncoderLoader.v1 = curated_transformers.models:build_hf_transformer_encoder_loader_v1
curated-transformers.HFPieceEncoderLoader.v1 = curated_transformers.tokenization:build_hf_piece_encoder_loader_v1
Expand Down