Hugging Face's logo

MaziyarPanahi
/
Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation
Transformers
GGUF
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
Model card Files Community
9
MaziyarPanahi commited on
Commit
4ed9dc7
•
1 Parent(s): 4978c21

Upload folder using huggingface_hub (#5)

Browse files

- c3f3af22a2a7fffd03d22975daa139ac5857d7f97569c2cb63fb79239b0de6e5 (9d6311b11790e38125c7b3f718db89c8777ea126)
- ad2dfe1d10b4bd9b70be9431691f9db30cf8330767e47aae29182e2c75770dae (1e766055567f0c2285c5aeff1869a7359a2dc350)
- de7a251204ebaaef9476a8b61518f1ca38153154fc50d0c90a175899a1614592 (ad5830fa7b6e74346327cccdaa39dc08ba7509a9)
- 328ebb870c1ade0fa2ff1b531c5f6514a148e3b7c75f3f9fbf09db4fa4f59189 (0dc19c18be8176fa3821dcbd022898559634cdbc)
- c67a4c62e6e435887747209b41d191c39f4121bbd124b4f607b48e1e3ba678b3 (643573202b6a178e7ebdaf87a3e123b418753126)
- 546799dd76789c8e4a0f10ad1b368f2a376f01a4a32a5773cb19360bb03b304c (de5e777ec717e1d03e0a476e3db61ab568cc60ac)

Files changed (6) hide show
  1. .gitattributes +5 -0
  2. Llama-3-8B-Instruct-32k-v0.1.IQ1_M.gguf +3 -0
  3. Llama-3-8B-Instruct-32k-v0.1.IQ1_S.gguf +3 -0
  4. Llama-3-8B-Instruct-32k-v0.1.IQ2_XS.gguf +3 -0
  5. Llama-3-8B-Instruct-32k-v0.1.IQ3_XS.gguf +3 -0
  6. Llama-3-8B-Instruct-32k-v0.1.IQ4_XS.gguf +3 -0
.gitattributes CHANGED
@@ -44,3 +44,8 @@ Llama-3-8B-Instruct-32k-v0.1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
  Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
  Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
  Llama-3-8B-Instruct-32k-v0.1.fp16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
44
  Llama-3-8B-Instruct-32k-v0.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
  Llama-3-8B-Instruct-32k-v0.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
  Llama-3-8B-Instruct-32k-v0.1.fp16.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Llama-3-8B-Instruct-32k-v0.1.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Llama-3-8B-Instruct-32k-v0.1.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Llama-3-8B-Instruct-32k-v0.1.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Llama-3-8B-Instruct-32k-v0.1.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Llama-3-8B-Instruct-32k-v0.1.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct-32k-v0.1.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da2fcce3d8c58bc2a755fe27d678063a507b87fd1098abe25ab0f605b96a7c7f
3
+ size 2161971456
Llama-3-8B-Instruct-32k-v0.1.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1dcb15882bf8150acc1cfc674068c3bfbc774da26c6c696f757f4b6721974ccc
3
+ size 2019627264
Llama-3-8B-Instruct-32k-v0.1.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83769ca2286890e43ea38db8d7ea9986da1bc17dbd80005c24bc75c099dced9b
3
+ size 2605781248
Llama-3-8B-Instruct-32k-v0.1.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ff1b951b4ff829b2d7efbc256f2601d96e03326213b2779b14bfc40ab96d80a
3
+ size 3518746880
Llama-3-8B-Instruct-32k-v0.1.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:871e5fdb3b7af047da25712a800c06cc9bd049139273e53cea0b3c77b86cdb4f
3
+ size 4447662336