Skip to content
#

intermediate-layer

Star

Here are 4 public repositories matching this topic...

Language: All
Filter by language
All 4 Jupyter Notebook 2 Python 2

gazelle93 / Using-output-from-the-specific-intermediate-layer-of-BERT

Star 0

This project aims to customize BERT to use the output of the specific intermediate layer of pre-trained BERT for certain target tasks. The number of hidden layers is the parameter that can be specified by the user and if the parameter is larger than 12, from the 1st to 12th layer is replaced to the pre-trained BERT while from 13th layer is rando…

bert customize intermediate-layer
  • Updated Apr 11, 2022
  • Python

Improve this page

Add a description, image, and links to the intermediate-layer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the intermediate-layer topic, visit your repo's landing page and select "manage topics."

Learn more