Kindly asking for quants
Kindly asking @TheBloke and @LoneStriker or @Panchovix if you could make quants of this? Thanks a lot in advance!
I know it's kinda weird if I test it myself, but in my own tests, the Q2_K and IQ3_XXS quants I made already surpassed the original miqu-1-70b.q5_K_M.gguf. So hope to get it out there and see what experiences others make with this.
I'll add it to the queue
I'll add it to the queue
@LoneStriker Thank you very much! If you're up to it: I've also just uploaded wolfram/miquliz-120b (https://huggingface.co/wolfram/miquliz-120b) which is a mix of miqu and lzlv. I'd be delighted if you could add that, too. Thanks a lot for all you do!
I'll add it to the queue
@LoneStriker Thank you very much! If you're up to it: I've also just uploaded wolfram/miquliz-120b (https://huggingface.co/wolfram/miquliz-120b) which is a mix of miqu and lzlv. I'd be delighted if you could add that, too. Thanks a lot for all you do!
Adding to the queue.
Thank you so much! Didn't expect GGUF quants, but looks like you're now doing God's TheBloke's work as well. ;) Seriously, thanks, you were faster than I could ever be.