pranavdarshan/OS-Script-Evaluator

Model Card for Model ID

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

• Developed by: Nihar Mandahas
• Model type: Pytorch,Finetuned Llama2-7b-chat
• License: [More Information Needed]
• Finetuned from model: NousResearch/Llama-2-7b-chat-hf

Model Sources [optional]

• Repository: https://github.com/PranavDarshan/AutoGrader
• Paper [optional]: https://ieeexplore.ieee.org/document/10817016
• Demo [optional]: [More Information Needed]

Uses

The model developed in this study is designed to assist in the automated evaluation of answer scripts, specifically within the domain of operating systems. It aims to streamline the grading process by reducing the time required for evaluation and eliminating human bias.

Foreseeable Users:

Educators and Examiners – University professors and teachers who assess student responses can leverage the system to expedite grading and maintain consistency. Students – By ensuring fair and unbiased evaluation, students receive objective feedback, improving their learning experience. Academic Institutions – Schools and universities can integrate this system into their assessment frameworks, enhancing efficiency in large-scale evaluations. Affected Stakeholders:

Handwritten Answer Evaluation – The integration of handwriting recognition ensures that students who submit handwritten scripts are evaluated fairly. Educational Technology Providers – The model can be adopted into existing learning management systems to enhance automated assessment tools. Policy Makers in Education – Standardized, unbiased grading could influence educational reforms related to assessment methodologies. The model operates by utilizing a fine-tuned Large Language Model (LLM) and Retrieval-Augmented Generation (RAG) to fetch contextual information from prescribed textbooks. Additionally, it integrates handwriting recognition for evaluating manually written answer scripts. The entire system is deployed on an interactive web platform using AWS SageMaker, ensuring scalability and accessibility.

By addressing the challenges associated with traditional grading, this model aims to revolutionize the assessment process, making it more efficient, accurate, and fair.

Direct Use

[More Information Needed]

Downstream Use [optional]

[More Information Needed]

Out-of-Scope Use

[More Information Needed]

Bias, Risks, and Limitations

[More Information Needed]

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Training Details

Training Data

[More Information Needed]

Training Procedure

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

• Training regime: [More Information Needed]

Speeds, Sizes, Times [optional]

[More Information Needed]

Evaluation

Testing Data, Factors & Metrics

Testing Data

[More Information Needed]

Factors

[More Information Needed]

Metrics

[More Information Needed]

Results

[More Information Needed]

Summary

Model Examination [optional]

[More Information Needed]

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

• Hardware Type: [More Information Needed]
• Hours used: [More Information Needed]
• Cloud Provider: [More Information Needed]
• Compute Region: [More Information Needed]
• Carbon Emitted: [More Information Needed]

Technical Specifications [optional]

Model Architecture and Objective

[More Information Needed]

Compute Infrastructure

[More Information Needed]

Hardware

[More Information Needed]

Software

[More Information Needed]

Citation [optional]

BibTeX:

[More Information Needed]

APA:

[More Information Needed]

Glossary [optional]

[More Information Needed]

More Information [optional]

[More Information Needed]

Model Card Authors [optional]

[More Information Needed]

Model Card Contact

[More Information Needed]