README.md

---
title: README
emoji: 🌍
colorFrom: gray
colorTo: pink
sdk: static
pinned: false
---

# CrisisTransformers | State-of-the-art contextual and semantically meaningful sentence embeddings for crisis-related social media texts

CrisisTransformers is a family of pre-trained language models and sentence encoders introduced in the following papers:

 - Pre-trained models and sentence encoders: [CrisisTransformers: Pre-trained language models and sentence encoders for crisis-related social media texts](https://www.sciencedirect.com/science/article/pii/S0950705124005501)
 - Multi-lingual sentence encoders: [Semantically Enriched Cross-Lingual Sentence Embeddings for Crisis-related Social Media Texts](https://arxiv.org/abs/2403.16614)
 - Mini models: ["Actionable Help" in Crises: A Novel Dataset and Resource-Efficient Models for Identifying Request and Offer Social Media Posts](https://arxiv.org/abs/2502.16839)

The models were trained on a massive corpus of over 15 billion word tokens from tweets associated with 30+ crisis events, such as disease outbreaks, natural disasters, conflicts, etc.