Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,247

Full-text search

Active filters: 4-bit

TheBloke/LLaMA2-13B-Tiefighter-AWQ

Text Generation • Updated Nov 9, 2023 • 55 • 35

TheBloke/Dolphin-2.1-70B-GPTQ

Text Generation • Updated Oct 25, 2023 • 3 • 7

TheBloke/Echidna-13B-v0.3-GPTQ

Text Generation • Updated Oct 28, 2023 • 4 • 8

TheBloke/Mistral-ClaudeLimaRP-v3-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 4 • 3

TheBloke/Uncensored-Jordan-13B-GPTQ

Text Generation • Updated Oct 30, 2023 • 2 • 8

TheBloke/Uncensored-Jordan-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 2 • 4

TheBloke/Xwin-MLewd-7B-V0.2-GPTQ

Text Generation • Updated Oct 31, 2023 • 77 • 19

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 58.2k • 31

TheBloke/deepseek-coder-1.3b-instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 26 • 2

TheBloke/deepseek-coder-1.3b-instruct-GPTQ

Text Generation • Updated Nov 5, 2023 • 244 • 5

TheBloke/Euryale-1.4-L2-70B-GPTQ

Text Generation • Updated Nov 18, 2023 • 8 • 2

01-ai/Yi-34B-Chat-4bits

Text Generation • Updated 15 days ago • 649 • 58

TheBloke/Yi-34B-Chat-AWQ

Text Generation • Updated Nov 23, 2023 • 306 • 12

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Mar 22 • 24.8k • 5

TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 14, 2023 • 6.46k • 54

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 35.1k • 40

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 93.5k • 35

dvijay/mistral-alpaca2k-3e-lora

Text Generation • Updated Dec 16, 2023 • 2 • 1

TheBloke/finance-LLM-AWQ

Text Generation • Updated Dec 24, 2023 • 10 • 5

ybelkada/Mixtral-8x7B-Instruct-v0.1-bnb-4bit

Text Generation • Updated Jan 12 • 2.06k • 58

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Mar 22 • 14.1k • 9

TheBloke/medicine-LLM-13B-AWQ

Text Generation • Updated Jan 1 • 85 • 6

TheBloke/bagel-dpo-34b-v0.2-AWQ

Text Generation • Updated Jan 2 • 284 • 6

LoneStriker/Air-Striker-Mixtral-8x7B-ZLoss-LoRA

Text Generation • Updated Jan 22 • 647 • 1

TheBloke/Nous-Capybara-limarpv3-34B-GPTQ

Text Generation • Updated Jan 11 • 12 • 3

TheBloke/Open_Gpt4_8x7B_v0.2-AWQ

Text Generation • Updated Jan 12 • 125 • 2

TheBloke/finance-LLM-13B-GPTQ

Text Generation • Updated Jan 15 • 16.6k • 2

TheBloke/medicine-LLM-GPTQ

Text Generation • Updated Jan 15 • 16.6k • 8

TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ

Text Generation • Updated Jan 16 • 7.85k • 20

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 187 • 6