PrunaAI
/

mosaicml-mpt-7b-bnb-4bit-smashed

4-bit precision

Model card Files Files and versions

mosaicml-mpt-7b-bnb-4bit-smashed / fc.py

sharpenb's picture

Upload folder using huggingface_hub (#1)

2868357 verified over 1 year ago

167 Bytes

	from torch import nn
	FC_CLASS_REGISTRY = {'torch': nn.Linear}
	try:
	import transformer_engine.pytorch as te
	FC_CLASS_REGISTRY['te'] = te.Linear
	except:
	pass