Questions about chat template
#1
by
ckso
- opened
can support chat template in tokenizer_config.json?
https://huggingface.co/docs/transformers/chat_templating
It is added in original repository:
https://huggingface.co/openchat/openchat_3.5/discussions/27The chat template from original repository is:
GPT4 Correct User: Hello<|end_of_turn|>GPT4 Correct Assistant:
And this quantized version is:
GPT4 User: {prompt}<|end_of_turn|>GPT4 Assistant:
Should follow the original repository?
Yup, the chat template is not correct. @TheBloke could you update to match the base repo? Thanks