Works great on oobabooga, but always ends with assistant
#3
by
Noodlz
- opened
loading this up this seems to work great! but for some reason every response ends with the word assistant
The solution is to edit three json files to use correct EOS token:
https://huggingface.co/turboderp/Llama-3-70B-Instruct-exl2/discussions/1
In total I had to edit three files: tokenizer_config.json, special_tokens_map.json and config.json.