Scaling Embeddings Outperforms Scaling Experts in Language Models
Paper • 2601.21204 • Published • 105
Junyuan Shang
sjy1203
AI & ML interests
NLP
Recent Activity
upvoted a paper 28 days ago
Scaling Embeddings Outperforms Scaling Experts in Language Models upvoted a paper about 2 months ago
Native Audio-Visual Alignment for Generation authored a paper 5 months ago
DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads FusionOrganizations
None yet