Open-Orca

/

Mistral-7B-OpenOrca

like 657

Trying to deploy this model in Sagemaker.

Inference deployment details:

instance_type =  g5.2xlarge
TGI image version = 1.1.0

Error details:

ValueError: Non-consecutive added token '<unk>' found. Should have index 32000 but has index 0 in saved vocabulary.