Support single integer or empty list as input to decode

#7
by peakji - opened

Based on the documentation and reference implementation of the Hugging Face tokenizer, the decode method should accept both a single integer or an empty list as input.

This simple modification would make ChatGLM-6B compatible with inference frameworks such as Basaran.

peakji changed pull request title from Update tokenization_chatglm.py to Support single integer or empty list as input to decode
peakji changed pull request status to closed
zxdu20 changed pull request status to open
zxdu20 changed pull request status to merged

Sign up or log in to comment