badaoui/deepset-roberta-base-squad2-neuron

Neuron-Optimized deepset/roberta-base-squad2

This repository contains AWS Neuron-optimized files for deepset/roberta-base-squad2.

Model Details

• Base Model: deepset/roberta-base-squad2
• Task: question-answering
• Optimization: AWS Neuron compilation
• Generated by: badaoui
• Generated using: Optimum Neuron Compiler Space

Usage

This model has been optimized for AWS Neuron devices (Inferentia/Trainium). To use it:

from optimum.neuron import NeuronModelForQuestionAnswering

model = NeuronModelForQuestionAnswering.from_pretrained("badaoui/deepset-roberta-base-squad2-neuron")

Performance

These files are pre-compiled for AWS Neuron devices and should provide improved inference performance compared to the original model when deployed on Inferentia or Trainium instances.

Original Model

For the original model, training details, and more information, please visit: deepset/roberta-base-squad2