chatglm-6b-demo

Runtime error

Received a few CUDA related issues. Probably it needs a better GPU? or some part of the code is not releasing the GPU ram?

by xianbao HF staff - opened Mar 22, 2023

Owner Mar 22, 2023

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 154.00 MiB (GPU 0; 14.76 GiB total capacity; 13.67 GiB already allocated; 73.75 MiB free; 13.92 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
nlgxr 2023-03-22T02:39:49.728Z Traceback (most recent call last):

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment