Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,308

Full-text search

Active filters: 4-bit

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated 25 days ago • 19.6k • 4

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated 9 days ago • 9.98k • 27

openlynn/Llama-3-Soliloquy-8B-GPTQ

Text Generation • Updated 20 days ago • 32 • 5

ruslanmv/llama3-8B-medical

Text Generation • Updated 20 days ago • 404 • 5

Melon/Meta-Llama-3-70B-Instruct-AutoAWQ-4bit

Text Generation • Updated 16 days ago • 86 • 3

scb10x/typhoon-v1.5-72b-instruct-awq

Text Generation • Updated 5 days ago • 32 • 2

62y26y/phi-3-bangla-instruct

Text Generation • Updated 7 days ago • 5 • 2

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated 4 days ago • 4.18k • 2

TheBloke/wizardLM-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 154 • 106

TheBloke/guanaco-65B-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.42k • 265

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 239 • 64

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • Updated Sep 27, 2023 • 5 • 21

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 141k • 248

TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 15.3k • 257

TheBloke/Luna-AI-Llama2-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 17.7k • 85

TheBloke/Nous-Hermes-Llama2-GPTQ

Text Generation • Updated Sep 27, 2023 • 1k • 58

baichuan-inc/Baichuan2-13B-Chat-4bits

Text Generation • Updated Jan 8 • 197 • 85

TheBloke/MLewdBoros-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 35 • 23

TheBloke/MLewd-L2-Chat-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 24 • 29

Qwen/Qwen-14B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 9.59k • 100

TheBloke/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Sep 29, 2023 • 366k • 73

Vulkane/120-Days-of-Sodom-LoRA-Mistral-7b

Text Generation • Updated Sep 30, 2023 • 7 • 8

TheBloke/dolphin-2.1-mistral-7B-GPTQ

Text Generation • Updated Oct 11, 2023 • 197 • 32

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 95 • 28

TheBloke/CausalLM-14B-AWQ

Text Generation • Updated Nov 9, 2023 • 9 • 10

TheBloke/CausalLM-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 9 • 3

TheBloke/Dolphin-2.1-70B-GPTQ

Text Generation • Updated Oct 25, 2023 • 3 • 7

TheBloke/zephyr-7B-beta-GPTQ

Text Generation • Updated Oct 27, 2023 • 6.58k • 55

TheBloke/Echidna-13B-v0.3-GPTQ

Text Generation • Updated Oct 28, 2023 • 4 • 8

TheBloke/Mistral-ClaudeLimaRP-v3-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 4 • 3