Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

266

Full-text search

Active filters: torchao

liangel/TinyLlama-1.1B-Chat-v1.0-FP8

Text Generation • 1B • Updated 11 days ago • 21

medmekk/Meta-Llama-3.2-1B-torchao-af8-wf8

Text Generation • Updated 9 days ago • 42

torchao-testing/opt-125m-Int4WeightOnlyConfig-v1-0.14.dev

Updated 9 days ago • 177

medmekk/Meta-Llama-3.2-1B-torchao-aint8-wint8

Text Generation • Updated 8 days ago • 9

torchao-testing/opt-125m-Float8WeightOnlyConfig-v2-0.14.0.dev-safetensors

0.2B • Updated 7 days ago • 5

metascroy/Phi-4-mini-instruct-INT8-INT4

Text Generation • Updated 7 days ago • 60

metascroy/Qwen3-4B-INT8-INT4

Text Generation • Updated 7 days ago • 71

jerryzh168/Phi-4-mini-instruct-INT4

Text Generation • Updated 1 day ago • 84

torchao-testing/opt-125m-Int8DynamicActivationIntxWeightConfig-v2-0.14.0.dev

Updated 7 days ago • 21

torchao-testing/opt-125m-Int8DynamicActivationIntxWeightConfig-v1-0.14.0.dev

Updated 6 days ago • 138

torchao-testing/opt-125m-IntxWeightOnlyConfig-v1-0.14.0.dev

Updated 6 days ago • 121

torchao-testing/opt-125m-IntxWeightOnlyConfig-v2-0.14.0.dev

Updated 7 days ago • 9

torchao-testing/opt-125m-AWQConfig-Int4WeightOnlyConfig-v2-0.14.0.dev

Text Generation • Updated 7 days ago • 23

medmekk/SmolLM3-3B-QAT-Float8

Text Generation • Updated 7 days ago • 113

medmekk/SmolLM3-3B-PTQ-Float8

Text Generation • Updated 7 days ago • 23

jerryzh168/Qwen3-8B-AWQ-INT4

Text Generation • Updated 5 days ago • 136

lvj/Qwen3-4B-parq-4b-weight-4b-embed-shared

Text Generation • Updated 5 days ago • 21

metascroy/SmolLM3-3B-INT8-INT4

Text Generation • Updated 5 days ago • 15

Enferlain/dinov3-vit7b16-pretrain-lvd1689m-int4

Updated about 9 hours ago • 7

jerryzh168/Qwen3-8B-INT4-skip_lm_head

Text Generation • Updated 4 days ago • 44

ConicCat/RewardAnything-8B-v1-ao-int8da8w8

Text Generation • Updated 2 days ago • 22

jerryzh168/Qwen3-8B-AWQ-INT4-leaderboard_math_hard

Text Generation • Updated 3 days ago • 27

liangel/Qwen3-8B-INT4-skip_lm_head

Text Generation • 8B • Updated 4 days ago • 13

jerryzh168/Qwen3-8B-AWQ-INT4-mmlu

Text Generation • Updated 3 days ago • 45

lvj/Qwen3-4B-parq-2b-weight-4b-embed-shared

Text Generation • Updated about 10 hours ago • 210

namgyu-youn/Qwen3-8B-SMOOTHQUANT-W8A8

Text Generation • Updated about 21 hours ago