Model keeps downloading

#158
by 1geek0 - opened

The model keeps downloading over and over again

These are the only lines of code I've run:

from transformers import AutoTokenizer,AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("bigscience/bloom")

model = AutoModelForCausalLM.from_pretrained("bigscience/bloom", device_map="auto",
torch_dtype="auto")```

![image.png](https://cdn-uploads.huggingface.co/production/uploads/1671194619631-633dbefc67e67df066ee5dbc.png)
BigScience Workshop org

This is expected. The model is 350gb so we actually save it in shards, seperate smaller files. So you have to download all the shards to get it working.

Ah, didn't read the model size. Thanks

1geek0 changed discussion status to closed

Sign up or log in to comment