JPishikawa
/

Llama-3.3-Swallow-70B-Instruct-v0.4-FP8-Dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

This model is the quantized version of tokyotech-llm/Llama-3.3-Swallow-70B-Instruct-v0.4 by LLM Compressor.
This model adheres to the same licensing terms as the original model.

Downloads last month: 6

Safetensors

Model size

70.6B params

Tensor type

BF16

·

F8_E4M3

·

Model tree for JPishikawa/Llama-3.3-Swallow-70B-Instruct-v0.4-FP8-Dynamic

Base model

tokyotech-llm/Llama-3.3-Swallow-70B-Instruct-v0.4

Quantized

(10)

this model