-
-
-
-
-
-
Inference Providers
Active filters:
gptq
xiangxinai/Xiangxin-Guardrails-Text
Text Generation
•
3B
•
Updated
•
176
•
7
alpindale/c4ai-command-r-plus-GPTQ
Text Generation
•
17B
•
Updated
•
39
•
21
TechxGenus/Meta-Llama-3-8B-Instruct-GPTQ
Text Generation
•
2B
•
Updated
•
4.39k
•
5
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
1B
•
Updated
•
5.58k
•
22
openbmb/MiniCPM-o-2_6-int4
Any-to-Any
•
Updated
•
4.68k
•
52
JunHowie/Fin-R1-GPTQ-Int8
Feature Extraction
•
2B
•
Updated
•
16
•
2
numind/NuExtract-2.0-4B-GPTQ
Image-Text-to-Text
•
1B
•
Updated
•
87
•
3
SicariusSicariiStuff/Negative_LLAMA_70B_GPTQ_4-bit-128
Text Generation
•
11B
•
Updated
•
5
•
1
QuantTrio/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
655
•
1
baichuan-inc/Baichuan-M2-32B-GPTQ-Int4
Text Generation
•
6B
•
Updated
•
1.68k
•
10
groxaxo/Qwen3-32B-AWorld-W8A16
9B
•
Updated
•
39
•
2
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
9
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
14
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
25
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
25
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
8
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
9
•
2
elinas/vicuna-13b-4bit
Text Generation
•
Updated
•
6
•
45
TheBloke/koala-7B-GPTQ
Text Generation
•
1B
•
Updated
•
31
•
31
TheBloke/koala-7B-HF
Text Generation
•
Updated
•
1.82k
•
21
TheBloke/koala-13B-HF
Text Generation
•
Updated
•
1.81k
•
41
TheBloke/koala-13B-GPTQ
Text Generation
•
2B
•
Updated
•
21
•
38
TheBloke/galpaca-30B-GPTQ
Text Generation
•
Updated
•
10
•
48
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
9
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
6
TheBloke/vicuna-7B-v0-GPTQ
Text Generation
•
1B
•
Updated
•
24
•
15
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
6
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
8
•
3
TheBloke/gpt4-alpaca-lora-30B-GPTQ
Text Generation
•
5B
•
Updated
•
17
•
20
TheBloke/gpt4-alpaca-lora-13B-GPTQ
Text Generation
•
2B
•
Updated
•
15
•
20