Should We Still Pretrain Encoders with Masked Language Modeling?
Paper
•
2507.00994
•
Published
•
78
Hicham Randrianarivo
chicham
AI & ML interests
None yet
Recent Activity
updated
a dataset
about 1 month ago
artefactory/Argimi-Legal-French-Jurisprudence
updated
a dataset
about 1 month ago
artefactory/Argimi-Ardian-Finance-10k-text
updated
a dataset
about 1 month ago
artefactory/Argimi-Ardian-Finance-10k-text
Organizations
upvoted
a
paper
about 2 months ago
upvoted
an
article
about 2 months ago
Article
Should We Still Pretrain Encoders with Masked Language Modeling?
By
and 3 others
•
•
21
upvoted
an
article
6 months ago
Article
Introducing EuroBERT: A High-Performance Multilingual Encoder Model
By
and 3 others
•
•
146