Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: translate: Using camembert model to instantiate roberta model #903

Open
bact opened this issue Feb 11, 2024 · 1 comment
Open

bug: translate: Using camembert model to instantiate roberta model #903

bact opened this issue Feb 11, 2024 · 1 comment
Labels
bug bugs in the library
Projects
Milestone

Comments

@bact
Copy link
Member

bact commented Feb 11, 2024

Description

"You are using a model of type camembert to instantiate a model of type roberta. This is not supported for all configurations of models and can yield errors." warning issued during test_translate test.

Possibly from scb_1m_th-en_spm model.

Expected results

No warning

Current results

See https://github.com/PyThaiNLP/pythainlp/actions/runs/7861725110/job/21450401313#step:5:1449

Steps to reproduce

Run test_translate.py

PyThaiNLP version

5.0.1

Python version

3.8

Operating system and version

Linux and Mac

More info

No response

Possible solution

No response

Files

Relevant code blocks:

class TestTranslatePackage(unittest.TestCase):
def test_translate(self):
# remove("scb_1m_th-en_spm")
self.assertIsNone(download_model_all())

def download_model_all() -> None:
"""
Download all translation models in advance
"""
_download_install(_EN_TH_MODEL_NAME)
_download_install(_TH_EN_MODEL_NAME)

_EN_TH_MODEL_NAME = "scb_1m_en-th_moses"
# SCB_1M-MT_OPUS+TBASE_en-th_moses-spm_130000-16000_v1.0.tar.gz
_EN_TH_FILE_NAME = "SCB_1M-MT_OPUS+TBASE_en-th_moses-spm_130000-16000_v1.0"
_TH_EN_MODEL_NAME = "scb_1m_th-en_spm"
# SCB_1M-MT_OPUS+TBASE_th-en_spm-spm_32000-joined_v1.0.tar.gz
_TH_EN_FILE_NAME = "SCB_1M-MT_OPUS+TBASE_th-en_spm-spm_32000-joined_v1.0"

@bact bact added the bug bugs in the library label Feb 11, 2024
@bact bact added this to the 5.1 milestone Feb 11, 2024
@bact bact changed the title bug: Using camembert model to instantiate roberta model bug: translate: Using camembert model to instantiate roberta model Feb 11, 2024
@bact bact added this to To do in PyThaiNLP Feb 11, 2024
@wannaphong
Copy link
Member

wannaphong commented Mar 4, 2024

I have a computing problems , so I will change this issues as future plan.

Oh wrong issue

@wannaphong wannaphong modified the milestones: 5.1, Future Mar 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug bugs in the library
Projects
PyThaiNLP
  
To do
Development

No branches or pull requests

2 participants