Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-v0.1-GGUF

Text Generation
Transformers
GGUF
5 languages
mixtral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Mixture of Experts
text-generation-inference
Model card Files Community
33
New discussion

[AUTOMATED] Model Memory Requirements
#30 opened about 1 month ago by model-sizer-bot

Thanks. iQ1_S Actually Works.

1
#28 opened about 1 month ago by Phil337

LMStudio

1
#27 opened about 1 month ago by MrZoidberg

mistral-community

4
#22 opened about 1 month ago by ehartford

Cannot load

6
#21 opened about 1 month ago by Iommed

Were all the quantizations produced w/ importance matrices?

7
#19 opened about 1 month ago by venketh