Sentence Similarity
Safetensors
English
bert
DisEmbed-v1 / README.md
SalmanFaroz's picture
Update README.md
bc63e61 verified
metadata
language:
  - en
license: mit
tags:
  - sentence-similarity
base_model: BAAI/bge-small-en-v1.5
widget:
  - source_sentence: >-
      Infections affecting the acromioclavicular joint can present with symptoms
      such as shoulder pain, swelling, and potential fever. Patients may
      experience systemic signs of infection, including chills and malaise,
      alongside localized symptoms related to joint movement.
    sentences:
      - >-
        Gastric stromal tumors with uncertain behavior can present with symptoms
        such as abdominal pain, nausea, and changes in appetite. Patients may
        experience psychological distress due to concerns about malignancy and
        the need for further evaluation. The presence of these tumors can lead
        to complications depending on their size and location.
      - 'Disease Name : Complication, umbrella device, vascular, embolism'
      - 'Disease Name : Infection, infected, infective, acromioclavicular'
  - source_sentence: >-
      cyanosis: a bluish discoloration of the skin; fatigue: extreme tiredness;
      shortness of breath: difficulty in breathing; headache: pain in the head;
      confusion: difficulty in thinking clearly.
    sentences:
      - >-
        Disease Name : Anomaly, anomalous, spine, spinal NEC, column NEC,
        kyphosis
      - 'Disease Name : Methemoglobinemia, Hb M disease'
      - >-
        Superficial insect bites on the finger can lead to localized swelling,
        redness, and itching. Patients may experience discomfort and potential
        allergic reactions, requiring symptomatic treatment.
  - source_sentence: 'Disease Name : Excess, excessive, excessively, crying, in infant'
    sentences:
      - >-
        Excessive crying in infants can manifest as prolonged periods of
        distress, often accompanied by signs of discomfort such as clenching
        fists, arching of the back, and difficulty in soothing. The infant may
        exhibit a high-pitched cry and may seem inconsolable, leading to
        parental concern and anxiety about the child's well-being.
      - 'Disease Name : Syphilis, syphilitic, meningitis'
      - 'Disease Name : Prolapse, prolapsed, ileostomy bud'
  - source_sentence: >-
      Cysts affecting the lacrimal passages or sac can lead to symptoms such as
      tearing, swelling, and discomfort in the inner corner of the eye. Patients
      may experience recurrent infections, redness, and a sensation of fullness,
      which can significantly impact tear drainage and overall eye health.
    sentences:
      - >-
        A condition characterized by the fusion of a single suture can lead to
        various physical deformities and developmental challenges. Symptoms may
        include cognitive impairment and various physical challenges that can
        impact daily life.
      - 'Disease Name : Cyst, Lacrimal, Passages or Sac'
      - >-
        This condition presents with swelling and pain in the area of the
        placenta, often accompanied by tenderness and discomfort. Patients may
        experience complications during pregnancy, including bleeding and
        changes in fetal movement. In some cases, there may be associated risks
        to both the mother and the fetus.
  - source_sentence: 'Disease Name : Tuberculosis, tubercular, tuberculous, brain'
    sentences:
      - >-
        hoarseness: abnormal voice quality due to vocal cord dysfunction;
        difficulty breathing: shortness of breath or stridor from airway
        compression; loss of voice: inability to speak due to vocal cord
        paralysis; throat discomfort: pain or irritation in the throat area.
      - >-
        Symptoms include cough, wheezing, and difficulty breathing, often
        exacerbated by exposure to specific environmental triggers such as air
        conditioning systems. Patients may also experience fever and malaise,
        with a history of allergic reactions or asthma. The condition can lead
        to significant respiratory distress if not managed appropriately.
      - >-
        Symptoms often include headaches, confusion, and potential neurological
        deficits, along with systemic signs such as fever and fatigue. Patients
        may also experience seizures or altered consciousness, indicating a
        serious underlying condition.
pipeline_tag: sentence-similarity
datasets:
  - SalmanFaroz/DisEmbed-Symptom-Disease-v1

DisEmbed (Disease Embedding)

DisEmbed-v1 is a disease-focused embedding model designed for the medical domain, trained on a synthetic dataset comprising disease descriptions, symptoms, and Q&A pairs. It outperforms general medical models in disease-specific tasks, particularly in distinguishing similar diseases. DisEmbed excels in retrieval task and disease-context identification.

Model Details

Model Description

image/png

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("SalmanFaroz/DisEmbed-v1")
# Run inference
sentences = [
    'Chronic cough with blood-streaked sputum, severe night sweats, and unintentional weight loss.Painful breathing or chest pain, often worsened by coughing.Swelling in the neck or lymph nodes, and frequent fatigue.',
    'Asthma',
    'Tuberculosis'
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)

Citation

@article{faroz2024disembed,
  title={DisEmbed: Transforming Disease Understanding through Embeddings},
  author={Faroz, Salman},
  journal={arXiv preprint arXiv:2412.15258},
  year={2024},
  doi={10.48550/arXiv.2412.15258},
  url={https://arxiv.org/abs/2412.15258}
}