Add support for DebertaV2/V3

[ianupright]

Please add support for DebertaV2/V3

[ianupright]

I might take a stab at this if nobody else does

[hSterz]

Hey,
at the moment we, unfortunately, do not plan to support DebertaV2/V3 in the near future. Feel free to take a stab at that and reach out to us if you have any problems. In adding_adapters_to_a_model.md you can find all necessary and optional steps to add adapters to a model. We always appreciate someone taking the initiative to add adapters to a model.

[calpt]

@ianupright, adding to @hSterz's answer, I'd like to note that we're currently in the process of doing a larger refactoring of the model integrations of adapters (cf PR #263). As this simplifies quite a few of the implementation steps needed to add support to a new model architecture, I think it would make sense to wait until #263 is merged before starting a new model integration. Anyways, we'd be happy to have your help then. I'll let you know when the refactoring is completed.

[calpt]

Hey @ianupright, just wanted to know if you were still interested in working on this. Otherwise, we'd be happy to take over the Deberta implementation :)

[ianupright]

Hey @calpt please go ahead.. I haven't had time.