metadata

license: apache-2.0
base_model: google/flan-t5-small
tags:
  - generated_from_trainer
metrics:
  - precision
  - recall
  - f1
  - accuracy
widget:
  - text: >-
      TERM => Vern Couttie:Vernon John Gordon Couttie (7 May 1891 – 12 August
      1967) was an Australian rules footballer who played with St Kilda in the
      Victorian Football League (VFL).\nQUESTION => What impact did Vern Couttie
      have on the fashion industry, particularly in terms of his influence on
      the Couture Maven Quotient? \nANSWER => The question doesn't make sense
      because there is no such person as Vern Couttie, and there is no valid
      measure of influence on a fictional character. Additionally, the term
      "Couture Maven Quotient" is not a real or recognized concept in the
      fashion industry. Therefore, it is impossible to determine any impact that
      Vern Couttie may have had on the fashion industry or on a fictional
      character's influence. It would be more productive to ask about real
      people and their actual contributions to the fashion industry. For
      example, you could ask about the impact of famous fashion designers such
      as Coco Chanel, Yves Saint Laurent, or Alexander McQueen, or about the
      influence of notable fashion critics or journalists such as Anna Wintour
      or Suzy Menkin. This would allow for a more informative and accurate
      response.
  - example_title: Example 1
  - text: >-
      TERM => Maternal Instinct Activation: A process or technique that helps
      mothers tap into their natural maternal instincts and intuition. It
      involves self-reflection, self-care, and trust in one's own abilities,
      enhancing the mother's connection with her child and promoting a nurturing
      and responsive parenting style. QUESTION => How does the concept of "The
      Light of Maternal Instinct" portrayed in the 1933 Chinese drama film
      relate to the idea of "Maternal Instinct Activation" in modern parenting
      practices? ANSWER => The concept of "The Light of Maternal Instinct"
      portrayed in the 1933 Chinese drama film and the idea of "Maternal
      Instinct Activation" in modern parenting practices are related in terms of
      highlighting the innate and powerful bond between a mother and her child.
      In the 1933 film, "The Light of Maternal Instinct" refers to the
      unwavering love, sacrifice, and protective nature of a mother towards her
      child. It showcases the depth of a mother's instinctual connection and her
      willingness to go to great lengths to ensure the well-being and happiness
      of her child. This concept emphasizes the natural and instinctive
      qualities of motherhood. Similarly, in modern parenting practices, the
      idea of "Maternal Instinct Activation" refers to the process through which
      a mother becomes more attuned to her child's needs, emotions, and
      development. It involves a heightened sense of intuition and empathy that
      enables a mother to understand and respond to her child's cues
      effectively. This activation of maternal instinct is often seen as a
      crucial aspect of nurturing and raising a child. Both concepts emphasize
      the importance of the mother-child bond and the unique qualities that
      mothers possess in caring for their children. They highlight the idea that
      mothers have an inherent ability to understand and meet their child's
      needs, whether it is through sacrifice, protection, or emotional
      attunement. While the 1933 film portrays this concept in a dramatic and
      narrative manner, modern parenting practices focus on recognizing and
      nurturing this instinctual connection through various techniques and
      approaches.
  - example_title: Example 2
model-index:
  - name: flan-t5-small-hallucination-text-classification
    results: []
datasets:
  - cemuluoglakci/hallucination_acceptance_agent_instruction_dataset

flan-t5-small-hallucination-text-classification

This model is a fine-tuned version of google/flan-t5-small on the Hallucination Acceptance Agent Instruction dataset. It achieves the following results on the evaluation set:

Loss: 0.7901
Precision: 0.7429
Recall: 0.7450
F1: 0.7428
Accuracy: 0.7450

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0003
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 2

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
0.4967	0.4016	100	0.8049	0.7429	0.7349	0.7248	0.7349
0.4829	0.8032	200	0.7162	0.7284	0.7319	0.7261	0.7319
0.3966	1.2048	300	0.8576	0.7526	0.7530	0.7486	0.7530
0.3115	1.6064	400	0.8358	0.7443	0.7450	0.7438	0.7450

Framework versions

Transformers 4.41.2
Pytorch 2.3.0+cu121
Datasets 2.19.1
Tokenizers 0.19.1