Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,702

Full-text search

Active filters: 4-bit

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated 3 days ago • 12.3k • 31

mlx-community/Qwen3.5-9B-MLX-4bit

2B • Updated 4 days ago • 11.1k • 22

Intel/Qwen3.5-35B-A3B-int4-AutoRound

6B • Updated 6 days ago • 5.19k • 18

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated 9 days ago • 21.3k • 23

Qwen/Qwen3.5-122B-A10B-GPTQ-Int4

Image-Text-to-Text • 125B • Updated 3 days ago • 5k • 17

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 3 days ago • 10.5k • 16

mlx-community/Qwen3.5-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated 9 days ago • 18.1k • 14

Qwen/Qwen3.5-397B-A17B-GPTQ-Int4

Image-Text-to-Text • Updated 3 days ago • 1.46k • 13

Intel/Qwen3.5-122B-A10B-int4-AutoRound

20B • Updated 5 days ago • 16.1k • 10

Kbenkhaled/Qwen3.5-27B-NVFP4

Image-Text-to-Text • 17B • Updated 7 days ago • 7.09k • 9

Intel/Qwen3.5-397B-A17B-int4-AutoRound

Updated 6 days ago • 4.91k • 9

mlx-community/Qwen3.5-9B-4bit

Image-Text-to-Text • 2B • Updated 4 days ago • 8.12k • 7

mlx-community/Qwen3.5-4B-MLX-4bit

1.0B • Updated 4 days ago • 5.62k • 7

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated 4 days ago • 52.5k • 8

kaitchup/Qwen3.5-27B-autoround-W4A16

7B • Updated 7 days ago • 769 • 6

Kbenkhaled/Qwen3.5-35B-A3B-NVFP4

Image-Text-to-Text • Updated 7 days ago • 3.59k • 5

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated 12 days ago • 275 • 6

steampunque/Qwen3.5-9B-MP-GGUF

9B • Updated 3 days ago • 575 • 4

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated about 18 hours ago • 4

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • 71B • Updated Dec 6, 2024 • 694k • 40

mlx-community/gpt-oss-20b-MXFP4-Q8

Text Generation • Updated Aug 29, 2025 • 543k • 34

mlx-community/Qwen3.5-122B-A10B-4bit

Image-Text-to-Text • 20B • Updated 9 days ago • 6.18k • 4

QuantTrio/Qwen3.5-35B-A3B-AWQ

Image-Text-to-Text • 36B • Updated 8 days ago • 41.4k • 8

QuantTrio/Qwen3.5-122B-A10B-AWQ

Image-Text-to-Text • 125B • Updated 8 days ago • 20.7k • 10

mlx-community/Qwen3.5-4B-4bit

1.0B • Updated 4 days ago • 37.3k • 3

QuantTrio/Qwen3.5-9B-AWQ

Image-Text-to-Text • 10B • Updated 2 days ago • 1.7k • 3

lukey03/Qwen3.5-9B-abliterated-MLX-4bit

Text Generation • 1B • Updated 2 days ago • 700 • 3

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • 7B • Updated Feb 17, 2024 • 446 • 45

LiquidAI/LFM2.5-1.2B-Instruct-MLX-4bit

Text Generation • 0.2B • Updated Jan 7 • 1.27k • 9

nota-ai/Solar-Open-100B-NotaMoEQuant-Int4

Text Generation • Updated Jan 26 • 3.09k • 44