---
language:
- en
base_model:
- openai/gpt-oss-120b
- unsloth/gpt-oss-120b-BF16
pipeline_tag: text-generation
tags:
- gpt_oss
- vllm
- fp8
- conversational
- compressed-tensors
- text-generation-inference
license: apache-2.0
license_name: apache-2.0
name: RedHatAI/gpt-oss-120b-FP8-Dynamic
description: This model was obtained by quantizing the weights and activations to FP8 data type. It is based on the gpt-oss-120b-BF16 architecture.
readme: https://huggingface.co/RedHatAI/gpt-oss-120b-FP8-Dynamic/main/README.md
tasks:
- text-to-text
provider: RedHatAI
license_link: https://www.apache.org/licenses/LICENSE-2.0
---

# RedHatAI/gpt-oss-120b-FP8-Dynamic

## Model Overview
- **Model Architecture:** gpt-oss-120b-BF16
  - **Input:** Text
  - **Output:** Text
- **Model Optimizations:**
  - **Weight quantization:** FP8
  - **Activation quantization:** FP8
- **Release Date:** 08/13/2025
- **Version:** 1.0
- **Model Developers:** RedHatAI

Quantized version of [unsloth/gpt-oss-120b-BF16](https://huggingface.co/unsloth/gpt-oss-120b-BF16).