Hugging Face's logo

AwanLLM
/
Meta-Llama-3-8B-Instruct-Dolfin-v0.1-exl2-h8-8bpw-exl2

Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
8-bit precision
exl2
Model card Files Community
AwanLLM commited on
Commit
d459653
•
1 Parent(s): 71fd805

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -49,15 +49,17 @@ Instruct format:
49
 
50
  Quants:
51
 
52
- GGUF: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Dolfin-v0.1-GGUF
 
 
53
 
54
  FP16: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin
55
 
56
  Exllamav2:
57
 
58
- 4bpw: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Dolfin-v0.1-exl2-h8-4bpw-exl2
59
 
60
- 8bpw: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Dolfin-v0.1-exl2-h8-8bpw-exl2
61
 
62
 
63
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
 
49
 
50
  Quants:
51
 
52
+ AWQ: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-AWQ
53
+
54
+ GGUF: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-v0.1-GGUF
55
 
56
  FP16: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin
57
 
58
  Exllamav2:
59
 
60
+ 4bpw: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-v0.1-exl2-h8-4bpw-exl2
61
 
62
+ 8bpw: https://huggingface.co/AwanLLM/Meta-Llama-3-8B-Instruct-Dolfin-v0.1-exl2-h8-8bpw-exl2
63
 
64
 
65
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)