Skip to content

issues Search Results · repo:codertimo/BERT-pytorch language:Python

Filter by

87 results
 (57 ms)

87 results

incodertimo/BERT-pytorch (press backspace or delete to remove)

codertimo/BERT-pytorch
Clarification on Padding Process in BERT Model Construction

Hi there, In my endeavor to construct a BERT model from the ground up for the purpose of gaining hands-on experience and a comprehensive understanding of the model, I have encountered a point of confusion ...
  • AliHaiderAhmad001
  • Opened 
    on Nov 24, 2023
  • #107

codertimo/BERT-pytorch
Why Segment Embedding number only 3?

import torch.nn as nn class SegmentEmbedding(nn.Embedding): def __init__(self, embed_size=512): super().__init__(3, embed_size, padding_idx=0) This is the source code. ...
  • UTimeStrange
  • 1
  • Opened 
    on Nov 21, 2023
  • #106

codertimo/BERT-pytorch
请问训练得到的模型后缀为.model.ep*格式，应该如何进行后续的调用呢？

想利用自己微调的模型生成向量 但是加载模型应该如何加载呢？之前用tf加载时需要3个文件，谢谢！
  • Jwinre
  • Opened 
    on May 23, 2023
  • #103

codertimo/BERT-pytorch
GELU is available in PyTorch

the GELU class is available in PyTorch (https://pytorch.org/docs/stable/generated/torch.nn.GELU.html). No need to implement it in utils/GELU.py
  • hubin-keio
  • 1
  • Opened 
    on Mar 15, 2023
  • #102

codertimo/BERT-pytorch
how to fine tune model with trained weight

Hello @codertimo , it is a nice repo. If I want to fine tune pretrained bert model, such as BERT-Base, Uncased by google, how can I do it?
  • MingchangLi
  • Opened 
    on Jan 10, 2023
  • #100

codertimo/BERT-pytorch
What dataset did you use to train model?

Can you tell me which dataset you used to train the model?
  • suhyeong10
  • 2
  • Opened 
    on Oct 19, 2022
  • #99

codertimo/BERT-pytorch
why specify `ignore_index=0` in the NLLLoss function in BERTTrainer?

trainer/pretrain.py class BERTTrainer: def __init__(self, ...): ... # Using Negative Log Likelihood Loss function for predicting the masked_token self.criterion = nn.NLLLoss(ignore_index=0) ...
  • Jasmine969
  • 1
  • Opened 
    on Jul 7, 2022
  • #98

codertimo/BERT-pytorch
bert-vocab?

bert-vocab is a py?I can t run it.
  • nlpCSir
  • 1
  • Opened 
    on Apr 22, 2022
  • #96

codertimo/BERT-pytorch
Pooler layer?

I noticed that their is a pooler layer in original BERT that seems not present here. Did I miss something?
  • lihaoxin2020
  • Opened 
    on Jan 17, 2022
  • #95

codertimo/BERT-pytorch
It keeps trying to use CUDA despite --with_cuda False option

Hello, I have tried to run bert with --with_cuda False, but the model keeps running forward function on cuda. These are my command line and the error message I got. bert -c corpus.small -v vocab.small ...
  • hanyangii
  • Opened 
    on Nov 5, 2021
  • #94
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue search results · GitHub