HuggingFaceH4
/

Qwen2.5-1.5B-Instruct-gkd

Model card Files Files and versions

Metrics Training metrics Community

Qwen2.5-1.5B-Instruct-gkd / checkpoint-172 /global_step171

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

kashif's picture

kashif HF Staff

Upload GKD trained model and tokenizer

6b0d76d verified 3 months ago

bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
3.09 GB
xet

Upload GKD trained model and tokenizer 3 months ago
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict"
How to fix it?
3.09 GB
xet

Upload GKD trained model and tokenizer 3 months ago
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
3.09 GB
xet

Upload GKD trained model and tokenizer 3 months ago
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "torch.FloatStorage",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict"
How to fix it?
3.09 GB
xet

Upload GKD trained model and tokenizer 3 months ago
bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
3.09 GB
xet

Upload GKD trained model and tokenizer 3 months ago
bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage"
How to fix it?
3.09 GB
xet

Upload GKD trained model and tokenizer 3 months ago
mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "__builtin__.set",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict",
- "torch.Size"
How to fix it?
3.09 GB
xet

Upload GKD trained model and tokenizer 3 months ago