Sentence Similarity
sentence-transformers
PyTorch
Safetensors
Transformers
English
mpnet
fill-mask
feature-extraction
Inference Endpoints
5 papers

Some weights of MPNetModel were not initialized

#17
by david-h - opened

I am getting this giant warning after finetuning my model, saving it, and loading it again using AutoModelForSentenceEmbedding from train_script.py. Can someone help me understand if I can ignore this? All the weights appear related to encoder layers which may be unused when doing sentence embedding? I can't tell, unfortunately. Thank you!

image.png

Sign up or log in to comment