Update README.md
b41df82
verified
-
1.74 kB
Rename phi4-mini-8da4w.pte to phi4-mini-INT8-INT4.pte
-
1.04 kB
Create LICENSE
-
11.7 kB
Update README.md
-
249 Bytes
Upload tokenizer
-
423 Bytes
Upload tokenizer
-
4.9 kB
Upload Phi3ForCausalLM
-
169 Bytes
Upload Phi3ForCausalLM
-
2.42 MB
Upload tokenizer
-
3.02 GB
Rename phi4-mini-8da4w.pte to phi4-mini-INT8-INT4.pte
pytorch_model-00001-of-00002.bin
Detected Pickle imports (17)
- "torch.CharStorage",
- "torch._tensor._rebuild_from_type_v2",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.float32",
- "torchao.dtypes.uintx.q_dq_layout.QDQTensorImpl",
- "torchao.dtypes.uintx.q_dq_layout.QDQLayout",
- "torch.BFloat16Storage",
- "torchao.quantization.quant_api._int8_asymm_per_token_quant",
- "torch.serialization._get_layout",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torch.device",
- "torch._utils._rebuild_tensor_v2",
- "torch.int8"
How to fix it?
4.99 GB
Upload Phi3ForCausalLM
pytorch_model-00002-of-00002.bin
Detected Pickle imports (17)
- "torch.CharStorage",
- "torch._tensor._rebuild_from_type_v2",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch.float32",
- "torchao.dtypes.uintx.q_dq_layout.QDQTensorImpl",
- "torchao.dtypes.uintx.q_dq_layout.QDQLayout",
- "torch.BFloat16Storage",
- "torchao.quantization.quant_api._int8_asymm_per_token_quant",
- "torch.serialization._get_layout",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torch.device",
- "torch._utils._rebuild_tensor_v2",
- "torch.int8"
How to fix it?
1.66 GB
Upload Phi3ForCausalLM
pytorch_model.bin
Detected Pickle imports (17)
- "torchao.dtypes.uintx.q_dq_layout.QDQTensorImpl",
- "torch._utils._rebuild_tensor_v2",
- "torch.CharStorage",
- "torchao.quantization.quant_api._int8_asymm_per_token_quant",
- "torch._tensor._rebuild_from_type_v2",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torchao.dtypes.uintx.q_dq_layout.QDQLayout",
- "torch.int8",
- "torch.device",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.BFloat16Storage",
- "torch.serialization._get_layout",
- "torch.FloatStorage",
- "torch.float32",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "collections.OrderedDict"
How to fix it?
4.81 GB
Upload Phi3ForCausalLM
-
16.3 kB
Upload Phi3ForCausalLM
pytorch_model_converted.bin
Detected Pickle imports (17)
- "torchao.quantization.quant_api._int8_asymm_per_token_quant",
- "collections.OrderedDict",
- "torch._tensor._rebuild_from_type_v2",
- "torch.float32",
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "torch.FloatStorage",
- "torchao.dtypes.uintx.q_dq_layout.QDQLayout",
- "torch._utils._rebuild_tensor_v2",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torch.device",
- "torch.CharStorage",
- "torch.BFloat16Storage",
- "torch.int8",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.serialization._get_layout",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torchao.dtypes.uintx.q_dq_layout.QDQTensorImpl"
How to fix it?
4.81 GB
Rename phi4-mini-8da4w-converted.bin to pytorch_model_converted.bin
-
587 Bytes
Upload tokenizer
-
15.5 MB
Upload tokenizer
-
2.52 kB
Upload tokenizer
-
3.91 MB
Upload tokenizer
