Edit Models filters

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

Other with no match

Carbon Emissions

Models

2,777

Full-text search

Active filters: 8-bit

Abzu/mpt-7b-storywriter-q8

Text Generation • Updated Jul 7, 2023 • 8 • 1

Abzu/mpt-30b-q8

Text Generation • Updated Jul 7, 2023 • 8 • 3

Abzu/mpt-30b-chat-q8

Text Generation • Updated Jul 7, 2023 • 7 • 1

Mediocreatmybest/blip2-opt-2.7b_8bit

Image-to-Text • Updated Aug 27, 2023 • 23 • 2

Mediocreatmybest/blip2-opt-6.7b_8bit

Image-to-Text • Updated Aug 27, 2023 • 8 • 1

Mediocreatmybest/blip2-flan-t5-xxl_8bit

Visual Question Answering • Updated Jul 9, 2023 • 7

gretelai/falcon-7b

Text Generation • Updated Jul 10, 2023 • 1

sgowdaks/falcon-40b-instruct-8bit

Updated Jul 11, 2023 • 1

FabbriSimo01/GPT_Large_Quantized

Text Generation • Updated Jul 15, 2023 • 3.5k

FabbriSimo01/Bloom_1b_Quantized

Text Generation • Updated Jul 15, 2023 • 3.49k

FabbriSimo01/Facebook_opt_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 3.51k

FabbriSimo01/Cerebras_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 3.49k

vivekraina/Falcon-8bit-test

Text Generation • Updated Jul 19, 2023 • 2

trillionmonster/Baichuan-13B-Chat-8bit

Text Generation • Updated Jul 25, 2023 • 3 • 9

vivekraina/Llama-2-7b-hf-8bit

Text Generation • Updated Jul 20, 2023 • 12 • 3

guardrail/llama-2-7b-guanaco-8bit-sharded

Text Generation • Updated Jul 20, 2023 • 5 • 4

richardr1126/spider-skeleton-wizard-coder-8bit

Text Generation • Updated Jul 26, 2023 • 3 • 1

rbiswasfc/falcon-7b-8bit

Text Generation • Updated Jul 21, 2023 • 2

pligor/gr7.5b-dolly

Text Generation • Updated Jul 24, 2023 • 1 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • Updated Nov 19, 2023 • 22 • 3

osiria/primo

Text Generation • Updated Aug 12, 2023 • 3 • 2

vivym/chatglm2-6b-int4

Text2Text Generation • Updated Jul 27, 2023 • 1

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 1

Matsakitkat/Mobility_Future_expectation

Text Generation • Updated Aug 1, 2023 • 4

anhtunguyen98/flan-t5-xxl-8bit

Text2Text Generation • Updated Jul 28, 2023 • 2

vivekraina/Llama-2-13b-chat-hf-8bit

Text Generation • Updated Jul 28, 2023 • 13

Mediocreatmybest/instructblip-vicuna-13b_8bit

Text2Text Generation • Updated Nov 19, 2023 • 17

TransformerTales/llama-2-7b-8bit-nested

Text Generation • Updated Aug 5, 2023 • 8 • 2

legendhasit/xgen-7b-8k-open-instruct-8bit

Text Generation • Updated Jul 31, 2023 • 2

Harshvir/LaMini-Neo-1.3B-Mental-Health_lora

Text Generation • Updated Jul 31, 2023 • 3.69k • 1