Compiled engines for running Whisper with TRT LLM for much faster inference.
baseten
company
Verified
AI & ML interests
None defined yet.
Recent Activity
View all activity
Collections
1
models
659
baseten/deepseek-v3-engine-32k
Updated
•
2
baseten/deepseek-v3-engine
Updated
•
9
baseten/whisper_trt_large_v3_test_NVIDIA_A100_SXM4_80GB_0_13_0
Updated
baseten/whisper_trt_medium_test_NVIDIA_H100_80GB_HBM3_0_13_0
Updated
baseten/whisper_trt_large_v3_turbo_test_NVIDIA_H100_80GB_HBM3_0_13_0
Updated
baseten/btest-Llama-3.1-8B-Instruct-NVIDIA-H100-80GB-HBM3-v0.16.0-TP16
Updated
•
12
baseten/BertForSequenceClassificationTesting
Updated
•
463
baseten/smol_llama-101M-GQAForSequenceClassification
Text Classification
•
Updated
•
405
baseten/RandomQwen2ForSequenceClassification-0.5B
Text Classification
•
Updated
•
222
baseten/whisper_trt_large_v3_testrilla_post1_NVIDIA_L4_0_13_0
Updated