Update model.py

[darsh169]

last_hidden_state from BertModel. Please review the changes

[hasanhuz]

Hi Darshan, Thank you for the pull request. Your changes are fine, but it is not really necessary for the work in this GitHub repository. Are you trying to use different layers of the BERT-Encoder instead of the last output layer?

[darsh169]

Thanks for the review @hasanhuz ! when cloned the repo in colab the error occurred at [last_hidden_state, pooler_output = self.bert(input_ids=input_ids)] the line which I modified and error was -too many values to unpack. self.bert(input_ids=input_ids)[0] gives the last hidden state of bert model which i thought is the need here.
for reference: huggingface/transformers#1950
would like hear your thoughts on this

[hasanhuz]

Yes, this makes sense because you added the argument (output_hidden_states=True) to the BERT model, which returns three outputs instead of two. These outputs include the last hidden state, pooler output and all hidden states.

I would suggest that you keep everything intact unless you'd like to use different layers of the BERT-Encoder. If that's the case, please let me know and I'd be more than happy to add this to my code!

[darsh169]

Exactly, as last hidden state is accessible without using BertConfig the we can go without it surely.
Please check the recent commit

[hasanhuz]

This also works fine. But you could still use the original implementation and get the same thing :)