Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,252

Full-text search

Active filters: 4-bit

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 7 days ago • 316k • 103

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 9 days ago • 131k • 66

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated about 9 hours ago • 367k • 116

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated 24 days ago • 55.9k • 41

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 1 day ago • 5

MaziyarPanahi/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated 1 day ago • 5

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Apr 4 • 38.7k • 156

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 31.1k • 174

MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.4-GGUF

Text Generation • Updated 6 days ago • 2.21k • 6

MaziyarPanahi/Yi-1.5-9B-Chat-GGUF

Text Generation • Updated 1 day ago • 4

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 57.7k • 355

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated 9 days ago • 9.7k • 27

study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int4

Text Generation • Updated 21 days ago • 213 • 3

solidrust/Hermes-2-Pro-Llama-3-8B-AWQ

Text Generation • Updated 11 days ago • 452 • 8

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 2.84k • 545

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 93 • 126

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 10.8k • 70

TheBloke/Xwin-MLewd-13B-v0.2-GPTQ

Text Generation • Updated Oct 15, 2023 • 311 • 40

TheBloke/zephyr-7B-beta-GPTQ

Text Generation • Updated Oct 27, 2023 • 6.54k • 55

TheBloke/SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation • Updated Dec 13, 2023 • 296 • 10

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 199 • 85

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Mar 22 • 54.2k • 23

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 25.5k • 41

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • Updated 14 days ago • 287 • 7

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 243 • 6

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated 25 days ago • 31.8k • 11

Qwen/Qwen1.5-32B-Chat-GPTQ-Int4

Text Generation • Updated 14 days ago • 9.85k • 23

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • Updated 14 days ago • 4.83k • 13

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated 28 days ago • 31.6k • 71

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 3.1k • 52