Edit Models filters

text-generation-inference

4-bit precision

AutoTrain Compatible

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,230

Full-text search

Active filters: quantized

afrideva/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 29 days ago • 1.18k • 1

afrideva/Yi-1.5-9B-Chat-GGUF

Text Generation • Updated 29 days ago • 515

afrideva/Yi-1.5-6B-GGUF

Text Generation • Updated 29 days ago • 1.16k • 2

jpodivin/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Text Generation • Updated 29 days ago • 395

MaziyarPanahi/Yi-1.5-6B-Chat-GGUF

Text Generation • Updated 29 days ago • 28.9k • 10

afrideva/Meta-Llama-3-8Bee-GGUF

Text Generation • Updated 29 days ago • 958 • 1

MaziyarPanahi/Yi-1.5-9B-Chat-GGUF

Text Generation • Updated 29 days ago • 1.88k • 5

MaziyarPanahi/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated 29 days ago • 633 • 6

afrideva/TeenyTinyLlama-160m-GGUF

Text Generation • Updated 29 days ago • 294

afrideva/TeenyTinyLlama-460m-GGUF

Text Generation • Updated 29 days ago • 477

afrideva/TeenyTinyLlama-460m-Chat-GGUF

Text Generation • Updated 29 days ago • 462

afrideva/GIST-all-MiniLM-L6-v2-GGUF

Text Generation • Updated 29 days ago • 199

afrideva/llama3_8b_chat_brainstorm-GGUF

Text Generation • Updated 28 days ago • 1.01k

afrideva/pip-code-bandit-GGUF

Text Generation • Updated 28 days ago • 1.02k

afrideva/pip-library-etl-1.3b-GGUF

Text Generation • Updated 28 days ago • 1.09k

afrideva/pip-sql-1.3b-GGUF

Text Generation • Updated 28 days ago • 1.02k

afrideva/Morph-Caller-GGUF

Text Generation • Updated 28 days ago • 959

afrideva/llama3-instrucTrans-enko-8b-GGUF

Text Generation • Updated 28 days ago • 986

afrideva/Llama-2-7b-chat-igbo-yoruba-2024-04-12_23-35-37-GGUF

Text Generation • Updated 28 days ago • 1.1k

afrideva/yoruba-embedding-model-GGUF

Text Generation • Updated 28 days ago • 242

afrideva/Buzz-8b-Large-v0.5-GGUF

Text Generation • Updated 28 days ago • 926

afrideva/Meta-Llama-3-8B-conceptnet_UsedFor_en_en-GGUF

Text Generation • Updated 27 days ago • 922

FallenMerick/Space-Whale-Lite-13B-GGUF

Text Generation • Updated 25 days ago • 128

afrideva/Mermaid-Llama-3-5B-Pruned-GGUF

Text Generation • Updated 25 days ago • 1.53k

afrideva/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated 25 days ago • 1.29k

afrideva/Mermaid-Llama-6.7B-RAG-Code-Instruct-GGUF

Text Generation • Updated 25 days ago • 1.39k

afrideva/Llama-3-8B-Synthia-v3.5-GGUF

Text Generation • Updated 25 days ago • 827

legraphista/RoLlama2-7b-Instruct-GGUF

Text Generation • Updated 18 days ago • 1.46k • 1

legraphista/RoLlama2-7b-Chat-GGUF

Text Generation • Updated 18 days ago • 1.39k • 1

legraphista/RoLlama2-7b-Base-GGUF

Text Generation • Updated 18 days ago • 1.37k • 1