Hessians?
#2
by
somehumanperson1
- opened
Hi. Do you still have the hessians for yi? I'm trying to quantize a finedtuned yi model but computing the hessians is very slow, so it would be faster to use a precomputed one. Thanks.
...I think Quantize is much slower than computing Hessians,
you can set --batch_size 1 in Hessians and Quantize
Ok, I will try that thanks.
somehumanperson1
changed discussion status to
closed