Hugging Face's logo

TheStageAI
/
Elastic-Mistral-7B-Instruct-v0.3

Text Generation
text2text-generation
Model card Files
xet
Community
14
psynote123 commited on
Commit
17ffec8
·
verified ·
1 Parent(s): 75fcdba

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -30,7 +30,11 @@ __Goals of elastic models:__
30
  > It's important to note that specific quality degradation can vary from model to model. For instance, with an S model, you can have 0.5% degradation as well.
31
 
32
 
33
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6487003ecd55eec571d14f96/BV-6-DVgNW-aqcmY1Zr20.png)
 
 
 
 
34
 
35
  -----
36
 
@@ -155,7 +159,7 @@ __100 input/300 output; tok/s:__
155
 
156
  | GPU/Model | S | M | L | XL | Original | W8A8, int8 |
157
  |-----------|-----|---|---|----|----------|------------|
158
- | H100 | 189 | 166 | 148 | 134 | 49 | 192 |
159
  | L40s | 79 | 68 | 59 | 47 | 38 | 82 |
160
 
161
 
 
30
  > It's important to note that specific quality degradation can vary from model to model. For instance, with an S model, you can have 0.5% degradation as well.
31
 
32
 
33
+ ![image/png](
34
+
35
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6799fc8e150f5a4014b030ca/V8hpZ-cA9vE5Ijyodp6Ih.png)
36
+
37
+ )
38
 
39
  -----
40
 
 
159
 
160
  | GPU/Model | S | M | L | XL | Original | W8A8, int8 |
161
  |-----------|-----|---|---|----|----------|------------|
162
+ | H100 | 186 | 180 | 168 | 136 | 48 | 192 |
163
  | L40s | 79 | 68 | 59 | 47 | 38 | 82 |
164
 
165