codys12
/

bitnet-r1-llama-8b

Text Generation

text-generation-inference

Model card Files Files and versions

codys12 commited on May 12

Commit

bdf6b3b

·

verified ·

1 Parent(s): bf4275d

Upload LlamaForCausalLM

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -23,7 +23,7 @@
     "modules_to_not_convert": [],
     "quant_method": "bitnet",
     "quantization_mode": "offline",
-    "use_rms_norm": true
   },
   "rms_norm_eps": 1e-05,
   "rope_scaling": {

     "modules_to_not_convert": [],
     "quant_method": "bitnet",
     "quantization_mode": "offline",
+    "with_rms_norm": true
   },
   "rms_norm_eps": 1e-05,
   "rope_scaling": {