NCAI-CALM

non-profit

https://github.com/NCAI-Research/CALM

AI & ML interests

Training Arabic BERT collaboratively over the internet

CALM's activity

mryab

authored a paper 2 months ago

Towards Best Practices for Open Datasets for LLM Training

Paper • 2501.08365 • Published Jan 14 • 56

mryab

authored a paper 4 months ago

RedPajama: an Open Dataset for Training Large Language Models

Paper • 2411.12372 • Published Nov 19, 2024 • 53

yhn112

authored a paper 9 months ago

Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees

Paper • 2110.03313 • Published Oct 7, 2021 • 1

mryab

authored a paper 9 months ago

Distributed Methods with Compressed Communication for Solving Variational Inequalities, with Theoretical Guarantees

Paper • 2110.03313 • Published Oct 7, 2021 • 1

yhn112

authored 5 papers 9 months ago

Secure Distributed Training at Scale

Paper • 2106.11257 • Published Jun 21, 2021 • 1

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

Paper • 2301.11913 • Published Jan 27, 2023 • 1

Distributed Deep Learning in Open Collaborations

Paper • 2106.10207 • Published Jun 18, 2021 • 2

Training Transformers Together

Paper • 2207.03481 • Published Jul 7, 2022 • 5

A critical look at the evaluation of GNNs under heterophily: Are we really making progress?

Paper • 2302.11640 • Published Feb 22, 2023 • 1

mryab

authored 5 papers 11 months ago

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Paper • 2211.05100 • Published Nov 9, 2022 • 29

RuCoLA: Russian Corpus of Linguistic Acceptability

Paper • 2210.12814 • Published Oct 23, 2022 • 1

Petals: Collaborative Inference and Fine-tuning of Large Models

Paper • 2209.01188 • Published Sep 2, 2022 • 1

Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding

Paper • 2402.12374 • Published Feb 19, 2024 • 3

The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Models

Paper • 2404.05904 • Published Apr 8, 2024 • 9

Zaid

authored 4 papers about 1 year ago

ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic

Paper • 2402.12840 • Published Feb 20, 2024 • 1

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts

Paper • 2202.01279 • Published Feb 2, 2022

Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP

Paper • 2112.10508 • Published Dec 20, 2021

Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources

Paper • 2201.10066 • Published Jan 25, 2022

mryab

authored a paper about 1 year ago

Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvements

Paper • 2401.06766 • Published Jan 12, 2024 • 2

Zaid

authored a paper about 1 year ago

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning

Paper • 2402.06619 • Published Feb 9, 2024 • 55