RedHatAI
/

Voxtral-Mini-3B-2507-FP8-dynamic

Automatic Speech Recognition

text-generation-inference

automatic-speech-translation

audio-text-to-text

video-text-to-text

compressed-tensors

Model card Files Files and versions

alexmarques commited on 2 days ago

Commit

2a5e1fd

·

verified ·

1 Parent(s): 9e8cd11

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -223,6 +223,7 @@ recipe = QuantizationModifier(
 oneshot(
     model=model,
     recipe=recipe,
 )
 SAVE_DIR = MODEL_ID.rstrip("/").split("/")[-1] + "-FP8-dynamic"

 oneshot(
     model=model,
     recipe=recipe,
+    processor=processor,
 )
 SAVE_DIR = MODEL_ID.rstrip("/").split("/")[-1] + "-FP8-dynamic"