Pixel Linguist II - a Pixel-Linguist Collection

Pixel-Linguist 's Collections

Pixel Linguist II

Pixel Linguist II

updated Sep 3

Vision-only encoders for language representation directly in pixel space.

On the Design Fundamentals of Pixel Text Representation Learning

Paper • 2609.01147 • Published Sep 1 • 30
Pixel-Linguist/Pixel-Linguist-II-Pretrain

Feature Extraction • 0.7B • Updated Sep 2 • 88 • 1

Note Stage 1: foundational multilingual pretraining.
Pixel-Linguist/Pixel-Linguist-II-Midtrain

Feature Extraction • 0.7B • Updated Sep 2 • 100 • 2

Note Stage 1 + Stage 2: full curriculum.
Pixel-Linguist/Pixel-Linguist-II-Midtrain-Only

Feature Extraction • 0.7B • Updated Sep 2 • 102 • 3

Note Stage 2 only: paper headline English STS and ViDoRe model.