ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
Paper
• 2602.16609 • Published
• 6
ColBERT-Zero 🐶
First large-scale fully pre-trained ColBERT model using only public data, outperforming GTE-ModernColBERT and GTE-ModernBERT
-
-
lightonai/ColBERT-Zero
Sentence Similarity • 0.1B • Updated • 3.63k • • 32 -
lightonai/ColBERT-Zero-supervised
Sentence Similarity • 0.1B • Updated • 531 • 3 -
lightonai/ColBERT-Zero-unsupervised
Sentence Similarity • 0.1B • Updated • 1.42k • 2 -
lightonai/ModernColBERT-embed-base
Sentence Similarity • 0.1B • Updated • 26 -
lightonai/ModernColBERT-embed-base-supervised
Sentence Similarity • 0.1B • Updated • 32 -
lightonai/ModernColBERT-embed-base-kd-only
Sentence Similarity • 0.1B • Updated • 57 • 1 -
lightonai/ColBERT-Zero-noprompts
Sentence Similarity • 0.1B • Updated • 50 • 2 -
lightonai/ColBERT-Zero-supervised-noprompts
Sentence Similarity • 0.1B • Updated • 29 -
lightonai/ColBERT-Zero-unsupervised-noprompts
Sentence Similarity • 0.1B • Updated • 32