Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • VoxCPM

  • Log In
  • Sign Up

DevQuasar
/
PowerInfer.SmallThinker-21BA3B-Instruct-GGUF

Text Generation
GGUF
conversational
Model card Files Files and versions
xet
Community
PowerInfer.SmallThinker-21BA3B-Instruct-GGUF
64.1 GB
  • 1 contributor
History: 8 commits
csabakecskemeti's picture
csabakecskemeti
Upload PowerInfer.SmallThinker-21BA3B-Instruct.Q4_K_M.gguf with huggingface_hub
93a4290 verified about 2 months ago
  • .gitattributes
    1.89 kB
    Upload PowerInfer.SmallThinker-21BA3B-Instruct.Q4_K_M.gguf with huggingface_hub about 2 months ago
  • PowerInfer.SmallThinker-21BA3B-Instruct.Q2_K.gguf
    8.02 GB
    xet
    Upload PowerInfer.SmallThinker-21BA3B-Instruct.Q2_K.gguf with huggingface_hub about 2 months ago
  • PowerInfer.SmallThinker-21BA3B-Instruct.Q4_K_M.gguf
    13.1 GB
    xet
    Upload PowerInfer.SmallThinker-21BA3B-Instruct.Q4_K_M.gguf with huggingface_hub about 2 months ago
  • PowerInfer.SmallThinker-21BA3B-Instruct.f16-00001-of-00002.gguf
    39.9 GB
    xet
    Upload PowerInfer.SmallThinker-21BA3B-Instruct.f16-00001-of-00002.gguf with huggingface_hub about 2 months ago
  • PowerInfer.SmallThinker-21BA3B-Instruct.f16-00002-of-00002.gguf
    3.13 GB
    xet
    Upload PowerInfer.SmallThinker-21BA3B-Instruct.f16-00002-of-00002.gguf with huggingface_hub about 2 months ago
  • README.md
    874 Bytes
    Update README.md about 2 months ago