Resources

CUDA extension not installed (even after manual compile and pip install)

#26 opened about 1 hour ago by

markemicek

GGUF format

#25 opened 8 months ago by

giladgd

TypeError: 'NoneType' object is not iterable in .../models_settings.py

#24 opened 9 months ago by

thinktink

Calibration dataset used to perform GPTQ

#23 opened 9 months ago by

ht-rohit

A weird bug

#22 opened 10 months ago by

XceptDev

Offloading to cpu not working?

#21 opened 10 months ago by

fahadh4ilyas

May I ask why the GPTQ version is slow

#20 opened 10 months ago by

lynngao815

can you upload a falcon-40b-GPTQ?

#18 opened 12 months ago by

Gian-hf

Update README.md

#17 opened 12 months ago by

saattrupdan

OOM when running the simple code again in jupyter notebook

#16 opened 12 months ago by

becks2000

Issues with Auto

#15 opened 12 months ago by

Devonance

What is the different between GPTQ and QLoRA?

#12 opened 12 months ago by

Ichsan2895

error when loading sucessful and prompting simple text

#11 opened about 1 year ago by

joseph3553

Custom 4-bit Finetuning 5-7 times faster inference than QLora

#7 opened about 1 year ago by

rmihaylov

Error when attempting to run.. Appears model files are missing or configuration issue

#6 opened about 1 year ago by

jdc4429

cuda extension not installed

#5 opened about 1 year ago by

becks2000

3bit quantization

#3 opened about 1 year ago by

nbzj

GGML?

#2 opened about 1 year ago by

creative420

Unfortunately I can't run on text-generation-webui

#1 opened about 1 year ago by

Suoriks