Sentence Transformers' Token Pooling Awareness Training: Enhancing Performance of Multi-vector Embedding Models
Sentence Transformers introduces Token Pooling for consciousness training, reducing the representation size by merging similar word vectors, while maintaining 97.8% of the information content, and reducing the document vectors to 1/4 of the original size, effectively improving the retrieval performance of multi-vector embedding models.
