Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,821

Full-text search

Active filters: 4-bit

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated about 20 hours ago • 2.49k • 20

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated 1 day ago • 45.8k • 20

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated 9 days ago • 418k • 125

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated about 11 hours ago • 5 • 8

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 7 days ago • 244k • 75

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated 1 day ago • 414 • 5

parlance-labs/hc-mistral-alpaca

Updated Feb 14 • 27 • 4

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 84.5k • 47

Qwen/Qwen1.5-110B-Chat-GPTQ-Int4

Text Generation • Updated 24 days ago • 36.1k • 13

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated 24 days ago • 109 • 5

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 9.34k • 74

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 11.8k • 103

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 5.56k • 18

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated 1 day ago • 159 • 3

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 24.6k • 301

TheBloke/Xwin-MLewd-13B-v0.2-GPTQ

Text Generation • Updated Oct 15, 2023 • 302 • 40

TheBloke/medicine-LLM-GPTQ

Text Generation • Updated Jan 15 • 16.6k • 11

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 38.8k • 178

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated 24 days ago • 1.43k • 6

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 44.1k • 27

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 17 days ago • 398k • 107

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated 18 days ago • 9.1k • 36

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated 7 days ago • 18k • 30

lucyknada/chargoddard_llama3-42b-v0-4.0bpw-EXL2

Text Generation • Updated Apr 22 • 3 • 2

ruslanmv/llama3-8B-medical

Text Generation • Updated 8 days ago • 481 • 7

MaziyarPanahi/Llama-3-8B-Instruct-v0.8-GGUF

Text Generation • Updated 6 days ago • 1.51k • 2

cortecs/Llama-3-SauerkrautLM-70b-Instruct-GPTQ

Text Generation • Updated 6 days ago • 53 • 2

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 11 days ago • 11.2k • 8

bineric/NorskGPT-Llama-3-70b-adapter

Text Generation • Updated 3 days ago • 11 • 2

bujido/Llama3-70B-Chinese-Chat-AWQ-32k

Text Generation • Updated 5 days ago • 17 • 2