Edit Models filters

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

117

Full-text search

Active filters: gptq

study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int4

Text Generation • Updated 27 days ago • 292 • 4

MaziyarPanahi/Starling-LM-7B-beta-GPTQ

Text Generation • Updated Mar 29 • 67 • 4

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated 28 days ago • 4.49k • 15

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated 28 days ago • 4.64k • 16

modelscope/Yi-1.5-9B-Chat-GPTQ

Text Generation • Updated 7 days ago • 8 • 1

modelscope/Yi-1.5-34B-Chat-GPTQ

Text Generation • Updated 7 days ago • 49 • 1

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 6 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 4 • 69

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 29 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 315 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 3 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 3 • 2

elinas/vicuna-13b-4bit

Text Generation • Updated Apr 5, 2023 • 8 • 46

TheBloke/koala-7B-HF

Text Generation • Updated Jun 5, 2023 • 3.45k • 20

TheBloke/koala-13B-HF

Text Generation • Updated Jun 5, 2023 • 3.54k • 41

TheBloke/galpaca-30B-GPTQ

Text Generation • Updated Aug 21, 2023 • 6 • 48

Ancestral/Dolly_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 2 • 5

Ancestral/PPO_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 3

Ancestral/Dolly_Malion-6b-4bit-128g

Text Generation • Updated Apr 10, 2023 • 2

4bit/pygmalion-6b-4bit-128g

Text Generation • Updated Apr 13, 2023 • 4 • 3

4bit/koala-13B-GPTQ-4bit-128g

Text Generation • Updated May 4, 2023 • 2

pszemraj/stablelm-7b-sft-v7e3-autogptq-4bit-128g

Text Generation • Updated Jun 2, 2023 • 3 • 3

ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g

Text Generation • Updated May 7, 2023 • 2

qwopqwop/KoAlpaca-Polyglot-5.8B-GPTQ

Text Generation • Updated May 19, 2023 • 3 • 3

qwopqwop/KoAlpaca-Polyglot-12.8B-GPTQ

Text Generation • Updated May 19, 2023 • 3 • 5

digitous/13B-Chimera

Text Generation • Updated May 24, 2023 • 3.36k • 6

digitous/13B-HyperMantis_GPTQ_4bit-128g

Text Generation • Updated May 24, 2023 • 4 • 12

elinas/chronos-13b-4bit

Text Generation • Updated Jun 23, 2023 • 40 • 21

disarmyouwitha/koala13b_test

Text Generation • Updated May 29, 2023 • 3

Technotech/RedPajama-Base-3B-4bit-128g

Text Generation • Updated Jul 6, 2023 • 6