How to extract embeddings generated by Colbert?

[BlueKiji77]

I am trying to use RAPTOR hierarchical clustering with Colbertv2 but I need to extract the embeddings generated by the model for the clustering step which involve a Gaussian Mixture Model.

How do I go about doing that? Any help would be appreciated.

[kyirong6]

@BlueKiji77 hey. looking to do the same thing. Were you able to come up with a solution for this?

[BlueKiji77]

You would have to use the CollectionEncoder from the colbert repo

…

On Fri, 14 Jun 2024, 5:15 pm Choenden Kyirong, ***@***.***> wrote: @BlueKiji77 <https://github.com/BlueKiji77> hey. looking to do the same thing. Were you able to come up with a solution for this? — Reply to this email directly, view it on GitHub <#216 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AVGT5Q3UPPGDLCCV5UCUI5TZHMJI7AVCNFSM6AAAAABIBFC7NWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNRYGM2DOMJSGU> . You are receiving this because you were mentioned.Message ID: ***@***.***>