How to load in fp16?
#16
by
kopyl
- opened
Please help
Sorry for the delayed replay. Do you want to load in fp16 for evaluation or training?
@SeanLee97 no problem, thank you very much. I ended up realizing that fp32 is fine for me :)
No more need to load it in fp16 anymore.
But yeah, i needed it for the inference.