fixed-size vector for each large document

[zahra-rou]

Is it possible to get a fixed-size vector (embedding) for each document (way more than 1000 characters) before fine-tuning the model?

[Ashutosh-Adhikari]

Hi @zahra-rou, if i understand your question, how about get embeddings for each sentence of the document and aggregate these vectors? The aggregation may (not) be learnt here.

[Ashutosh-Adhikari]

Closing this, feel free to open it again.