Popular repositories Loading

1. simalign simalign Public

   Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)

   Python 365 50

2. GlotLID GlotLID Public

   💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

   Python 142 8

3. Glot500 Glot500 Public

   Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023

   Python 103 4

4. GlotCC GlotCC Public

   🕸 GlotCC Dataset and Pipline -- NeurIPS 2024

   Jupyter Notebook 19

5. GlotScript GlotScript Public

   🖋 Resource and Tool for Writing System Identification -- LREC 2024

   Python 17 2

6. ofa ofa Public

   A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining

   Python 17 2