Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation
Transformers
Safetensors
llama
facebook
meta
llama-3
int8
vllm
chat
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
text-generation-inference
8-bit precision
Model card Files
xet
Community
3
robgreenberg3 commited on
Commit
e2bfb7d
·
verified ·
1 Parent(s): 2dc9aa6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -33,6 +33,10 @@ tasks:
33
  - text-to-text
34
  provider: Meta
35
  license_link: https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/LICENSE
 
 
 
 
36
  ---
37
  <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
38
  Meta-Llama-3.1-8B-Instruct-quantized.w8a8
 
33
  - text-to-text
34
  provider: Meta
35
  license_link: https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/LICENSE
36
+ validated_on:
37
+ - RHOAI 2.20
38
+ - RHAIIS 3.0
39
+ - RHELAI 1.5
40
  ---
41
  <h1 style="display: flex; align-items: center; gap: 10px; margin: 0;">
42
  Meta-Llama-3.1-8B-Instruct-quantized.w8a8