Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

corrigir erros de palavra desconhecida #55

Open
leoalenc opened this issue May 31, 2022 · 4 comments
Open

corrigir erros de palavra desconhecida #55

leoalenc opened this issue May 31, 2022 · 4 comments
Assignees
@leoalenc
Labels
invalid This doesn't seem right tagging This issue relates to pos-tagging tools This issue relates to Python code

Comments

@leoalenc
Copy link
Contributor

leoalenc commented May 31, 2022 •
edited
Loading

Erros de palavra desconhecida nos textos etiquetados do corpus compilado a partir de Navarro (2016):

gr -ho "[^[:space:]]+/\?\?\?" *[0-9][0-9]-pos.txt | sort | uniq -c | sort -nr

9 yawé/???
8 reyúri/???
7 Compadre/???
4 ayúri/???
4 amú-itá/???
3 yambeú-kwáu/???
3 kuri/???
2 waá-itá/???
2 wã/???
2 uyuyuká/???
2 uyukupiri/???
2 usú-putari/???
2 ukapiri/???
2 tupauku/???
2 sumuara-kunhã/???
2 Sapukaya-apigawa/???
2 ruí/???
2 reyúka/???
2 real/???
2 poh/???
2 penhé/???
2 nheengarisararana/???
2 mamentu/???
2 amukwesé/???
1 yawewera/???
1 Yawé/???
1 yambué-kwáu/???
1 yakumãme/???
1 xe/???
1 witá/???
1 Watarampuá/???
1 uyupiri-kwáu/???
1 uyumusurí-kwáu/???
1 uyumundú/???
1 uyumumurã/???
1 uyumaãwera/???
1 uyuká-yuká/???
1 Uyenũ-yuíri/???
1 utuká-tuká/???
1 usu/???
1 Usika-pawa/???
1 usepimeẽ/???
1 upurungitá-kwáu/???
1 Upukwari/???
1 upuká-puká/???
1 upuẽ-puẽ/???
1 upitá-putari/???
1 Upisí-pisika/???
1 upiripana-putari/???
1 upinaitikawera/???
1 unheẽwera/???
1 unheengariwera/???
1 unhana/???
1 umundawera/???
1 umukwekatu/???
1 umeẽ-kwáu/???
1 umanú/???
1 umanhana/???
1 ukupí-kupiri/???
1 ukiri-kwáu/???
1 ukaú-kaú/???
1 ú/???
1 tukunaré/???
1 tuí/???
1 Tik/???
1 tĩ/???
1 Ti/???
1 tatatingawasú/???
1 Taria-itá/???
1 taité/???
1 ta/???
1 suri/???
1 supé../???
1 seẽíma/???
1 rupitá-itá/???
1 rirewara/???
1 Reyúri/???
1 reyumusurí/???
1 Reyeré-yeréu/???
1 rẽukwáu/???
1 retamawara/???
1 resú-kwáu/???
1 Resarú-kwáu/???
1 remanú/???
1 purã-puranga/???
1 purangamirĩ/???
1 “puranga/???
1 purakisawaíma/???
1 pukú-pukú/???
1 piterarupí../???
1 pisãwera/???
1 Pewapikantu/???
1 pé../???
1 Paranãme/???
1 paranãme/???
1 panhẽuka/???
1 Panhẽsuú/???
1 panhẽsuú/???
1 panhē/???
1 paá,urubú/???
1 niti/???
1 nhũ/???
1 nhaã-itá/???
1 nhaá/???
1 mũyara/???
1 murakisara/???
1 Mukũi-itá/???
1 mirá-itawasú/???
1 mbauíma/???
1 makú/???
1 Maãyawé/???
1 Má/???
1 Kwá-itá/???
1 kurumiwasú/???
1 kiwira/???
1 kiinhaíma/???
1 kawĩrana/???
1 José/???
1 Joana/???
1 Iwakape/???
1 Iwaka-pe/???
1 iwá/???
1 iurá/???
1 ira/???
1 gantĩme/???
1 Eh/???
1 Ee/???
1 compadre/???
1 ayuyuká/???
1 Ayuyeréu/???
1 ayuseruka/???
1 Ayúri/???
1 Asuiwara/???
1 ara”/???
1 anhũresú/???
1 Amunhã-pawa/???
1 Amaã-putari/???
1 Ah!/???
@leoalenc leoalenc added invalid This doesn't seem right tools This issue relates to Python code tagging This issue relates to pos-tagging labels May 31, 2022
@leoalenc leoalenc self-assigned this May 31, 2022
@leoalenc
Copy link
Contributor Author

leoalenc commented May 31, 2022 •
edited
Loading

Análise dos erros

Classificação

  1. construções com auxiliares, por exemplo, putari e kwáu
  2. interjeições
  3. formas dos verbos yuka e yuri acentuadas (ver forma "yúri" #28)
  4. nomes próprios
  5. termos em português (compadre)
  6. compostos com -apigawa e -kunhã (ver construir adivinhador morfológico de classe de palavra #46)
  7. sinais de pontuação (aspas, vírgula, reticências "quebradas")
  8. negação niti
  9. forma pukú-pukú
  10. plural com -itá de pronomes
  11. formas com vogal oral em vez de nasal (penhé)
  12. derivados com sufixos produtivos (-ína)

@leoalenc leoalenc mentioned this issue May 31, 2022
Closed
leoalenc added a commit that referenced this issue May 31, 2022
@leoalenc
corrige item 8 #55
b53489f
This was referenced May 31, 2022
Closed
Closed
leoalenc added a commit that referenced this issue Jun 1, 2022
@leoalenc
resolve #14, contribui com #55
c5c70e6
@leoalenc leoalenc changed the title corrigir erros de palavras desconhecidas corrigir erros de palavra desconhecida Jun 1, 2022
This was referenced Jun 2, 2022
Closed
Closed
Closed
leoalenc added a commit that referenced this issue Jun 2, 2022
@leoalenc
resolve #62, contribui para #55
5f383e7
leoalenc added a commit that referenced this issue Jun 2, 2022
@leoalenc
resolve #61, contribui para #55
9f5bf91
@leoalenc
Copy link
Contributor Author

leoalenc commented Jun 3, 2022

Após os últimos commits, a lista de erros reduziu-se:

gr -ho "[^[:space:]]+/\?\?\?" *[0-9][0-9]-pos.txt | sort | uniq -c | sort -nr

7 Compadre/???
3 yambeú-kwáu/???
3 kuri/???
2 wã/???
2 uyuyuká/???
2 uyukupiri/???
2 usú-putari/???
2 ukapiri/???
2 tupauku/???
2 sumuara-kunhã/???
2 Sapukaya-apigawa/???
2 ruí/???
2 real/???
2 poh/???
2 penhé/???
2 nheengarisararana/???
2 mamentu/???
2 amukwesé/???
1 yawewera/???
1 yambué-kwáu/???
1 yakumãme/???
1 xe/???
1 witá/???
1 Watarampuá/???
1 uyupiri-kwáu/???
1 uyumusurí-kwáu/???
1 uyumundú/???
1 uyumumurã/???
1 uyumaãwera/???
1 uyuká-yuká/???
1 Uyenũ-yuíri/???
1 utuká-tuká/???
1 usu/???
1 Usika-pawa/???
1 usepimeẽ/???
1 upurungitá-kwáu/???
1 Upukwari/???
1 upuká-puká/???
1 upuẽ-puẽ/???
1 upitá-putari/???
1 Upisí-pisika/???
1 upiripana-putari/???
1 upinaitikawera/???
1 unheẽwera/???
1 unheengariwera/???
1 unhana/???
1 umundawera/???
1 umukwekatu/???
1 umeẽ-kwáu/???
1 umanú/???
1 umanhana/???
1 ukupí-kupiri/???
1 ukiri-kwáu/???
1 ukaú-kaú/???
1 ú/???
1 tukunaré/???
1 tuí/???
1 Tik/???
1 tĩ/???
1 Ti/???
1 tatatingawasú/???
1 Taria-itá/???
1 taité/???
1 ta/???
1 suri/???
1 seẽíma/???
1 rirewara/???
1 reyumusurí/???
1 Reyeré-yeréu/???
1 rẽukwáu/???
1 retamawara/???
1 resú-kwáu/???
1 Resarú-kwáu/???
1 remanú/???
1 purã-puranga/???
1 purangamirĩ/???
1 purakisawaíma/???
1 pukú-pukú/???
1 pisãwera/???
1 Pewapikantu/???
1 Paranãme/???
1 paranãme/???
1 panhẽuka/???
1 Panhẽsuú/???
1 panhẽsuú/???
1 panhē/???
1 paá,urubú/???
1 nhũ/???
1 nhaá/???
1 mũyara/???
1 murakisara/???
1 mirá-itawasú/???
1 mbauíma/???
1 makú/???
1 Maãyawé/???
1 Má/???
1 kurumiwasú/???
1 kiwira/???
1 kiinhaíma/???
1 kawĩrana/???
1 Iwakape/???
1 Iwaka-pe/???
1 iwá/???
1 iurá/???
1 ira/???
1 gantĩme/???
1 Eh/???
1 Ee/???
1 compadre/???
1 ayuyuká/???
1 Ayuyeréu/???
1 ayuseruka/???
1 Asuiwara/???
1 anhũresú/???
1 Amunhã-pawa/???
1 Amaã-putari/???
1 Ah/???

This was referenced Jun 3, 2022
Closed
Closed
leoalenc added a commit that referenced this issue Jun 3, 2022
@leoalenc
resolve #63 #64, contribui com #55
cb55f63
This was referenced Jun 3, 2022
Open
Open
Closed
Closed
Closed
leoalenc added a commit that referenced this issue Jun 4, 2022
@leoalenc
contribui para #55
ec18350
@leoalenc
Copy link
Contributor Author

leoalenc commented Jun 4, 2022

Nova redução do número de erros com ec18350:

gr -ho "[^[:space:]]+/\?\?\?" *[0-9]-pos.txt | sort | uniq -c | sort -nr

7 Compadre/???
3 yambeú-kwáu/???
2 uyuyuká/???
2 uyukupiri/???
2 usú-putari/???
2 ukapiri/???
2 tupauku/???
2 sumuara-kunhã/???
2 Sapukaya-apigawa/???
2 real/???
2 poh/???
2 penhé/???
2 nheengarisararana/???
2 mamentu/???
2 amukwesé/???
1 yawewera/???
1 yambué-kwáu/???
1 yakumãme/???
1 Watarampuá/???
1 uyupiri-kwáu/???
1 uyumusurí-kwáu/???
1 uyumundú/???
1 uyumumurã/???
1 uyumaãwera/???
1 uyuká-yuká/???
1 Uyenũ-yuíri/???
1 utuká-tuká/???
1 Usika-pawa/???
1 usepimeẽ/???
1 upurungitá-kwáu/???
1 Upukwari/???
1 upuká-puká/???
1 upuẽ-puẽ/???
1 upitá-putari/???
1 Upisí-pisika/???
1 upiripana-putari/???
1 upinaitikawera/???
1 unheẽwera/???
1 unheengariwera/???
1 unhana/???
1 umundawera/???
1 umukwekatu/???
1 umeẽ-kwáu/???
1 umanú/???
1 umanhana/???
1 ukupí-kupiri/???
1 ukiri-kwáu/???
1 ukaú-kaú/???
1 tukunaré/???
1 tĩ/???
1 tatatingawasú/???
1 Taria-itá/???
1 ta/???
1 suri/???
1 seẽíma/???
1 rirewara/???
1 reyumusurí/???
1 Reyeré-yeréu/???
1 rẽukwáu/???
1 retamawara/???
1 resú-kwáu/???
1 Resarú-kwáu/???
1 remanú/???
1 purã-puranga/???
1 purangamirĩ/???
1 purakisawaíma/???
1 pukú-pukú/???
1 pisãwera/???
1 Pewapikantu/???
1 Paranãme/???
1 paranãme/???
1 panhẽuka/???
1 Panhẽsuú/???
1 panhẽsuú/???
1 panhē/???
1 nhũ/???
1 nhaá/???
1 mũyara/???
1 murakisara/???
1 mirá-itawasú/???
1 mbauíma/???
1 Maãyawé/???
1 Má/???
1 kurumiwasú/???
1 kiwira/???
1 kiinhaíma/???
1 kawĩrana/???
1 Iwakape/???
1 Iwaka-pe/???
1 iwá/???
1 ira/???
1 gantĩme/???
1 Ee/???
1 compadre/???
1 ayuyuká/???
1 Ayuyeréu/???
1 ayuseruka/???
1 Asuiwara/???
1 anhũresú/???
1 Amunhã-pawa/???
1 Amaã-putari/???

This was referenced Jun 4, 2022
Closed
Closed
leoalenc added a commit that referenced this issue Jun 5, 2022
@leoalenc
resolve #72 #73 #76, contribui para #55 #66
7a46f55
This was referenced Jun 8, 2022
Closed
Closed
Closed
leoalenc added a commit that referenced this issue Jun 11, 2022
@leoalenc
contribui para #55
1cf1e93
leoalenc added a commit that referenced this issue Jun 11, 2022
@leoalenc
contribui para #55
77d226d
leoalenc added a commit that referenced this issue Jun 11, 2022
@leoalenc
contribui para #55
576fda1
@leoalenc
Copy link
Contributor Author

Mais uma redução do número de erros com os últimos commits:

7 Compadre/???
4 umanũ/???
3 yambeú-kwáu/???
2 uyuyuká/???
2 uyukupiri/???
2 usú-putari/???
2 sumuara-kunhã/???
2 Sapukaya-apigawa/???
2 real/???
2 penhé/???
2 nheengarisararana/???
2 amukwesé/???
1 yawewera/???
1 yambué-kwáu/???
1 yakumãme/???
1 Watarampuá/???
1 uyupiri-kwáu/???
1 uyumusurí-kwáu/???
1 uyumundú/???
1 uyumumurã/???
1 uyumaãwera/???
1 uyuká-yuká/???
1 Uyenũ-yuíri/???
1 utuká-tuká/???
1 Usika-pawa/???
1 usepimeẽ/???
1 upurungitá-kwáu/???
1 Upukwari/???
1 upuká-puká/???
1 upuẽ-puẽ/???
1 upitá-putari/???
1 Upisí-pisika/???
1 upiripana-putari/???
1 upinaitikawera/???
1 unheẽwera/???
1 unheengariwera/???
1 umundawera/???
1 umukwekatu/???
1 umeẽ-kwáu/???
1 ukupí-kupiri/???
1 ukiri-kwáu/???
1 ukaú-kaú/???
1 tatatingawasú/???
1 seẽíma/???
1 rirewara/???
1 reyumusurí/???
1 Reyeré-yeréu/???
1 retamawara/???
1 resú-kwáu/???
1 Resarú-kwáu/???
1 remanũ/???
1 purã-puranga/???
1 purangamirĩ/???
1 purakisawaíma/???
1 pukú-pukú/???
1 pisãwera/???
1 Pewapikantu/???
1 Paranãme/???
1 paranãme/???
1 panhẽuka/???
1 Panhẽsuú/???
1 panhẽsuú/???
1 panhē/???
1 nhũ/???
1 nhaá/???
1 mũyara/???
1 murakisara/???
1 mirá-itawasú/???
1 mbauíma/???
1 Maãyawé/???
1 kurumiwasú/???
1 kiwira/???
1 kiinhaíma/???
1 kawĩrana/???
1 Iwakape/???
1 Iwaka-pe/???
1 iwá/???
1 gantĩme/???
1 Ee/???
1 compadre/???
1 ayuyuká/???
1 Ayuyeréu/???
1 ayuseruka/???
1 Asuiwara/???
1 anhũresú/???
1 Amunhã-pawa/???
1 amanũ/???
1 Amaã-putari/???

This was referenced Jun 19, 2022
Open
Open
leoalenc added a commit that referenced this issue Oct 10, 2022
@leoalenc
resolve #149, contribui para #55 #145
f1a7c4c
@leoalenc leoalenc mentioned this issue Dec 11, 2022
Closed
@leoalenc leoalenc mentioned this issue Apr 5, 2023
Closed
5 tasks
@leoalenc leoalenc mentioned this issue Aug 31, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@leoalenc leoalenc

Labels
invalid This doesn't seem right tagging This issue relates to pos-tagging tools This issue relates to Python code
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@leoalenc