bullerwins
/

gradientai_Llama-3-8B-Instruct-262k_exl2_8.0bpw

Text Generation

Inference Endpoints

text-generation-inference

8-bit precision

Model card Files Files and versions Community

bullerwins commited on Apr 26

Commit

1fab41b

•

1 Parent(s): fc4ac96

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -6,6 +6,9 @@ tags:
 - meta
 - llama-3
 ---
 <img src="https://cdn-uploads.huggingface.co/production/uploads/655bb613e8a8971e89944f3e/TSa3V8YpoVagnTYgxiLaO.png" width="200"/>
 # Llama-3 8B Instruct 262k

 - meta
 - llama-3
 ---
+This is an EXL2 quant made with [exllamav2](https://github.com/turboderp/exllamav2) at 8.0bpw
 <img src="https://cdn-uploads.huggingface.co/production/uploads/655bb613e8a8971e89944f3e/TSa3V8YpoVagnTYgxiLaO.png" width="200"/>
 # Llama-3 8B Instruct 262k