glm-10b-chinese / added_tokens.json
zxdu20's picture
init commit
7a1cab8
{
"<|endoftext|>": 50000,
"[SEP]": 50001,
"[CLS]": 50002,
"[MASK]": 50003,
"[UNUSED1]": 50004,
"[UNUSED2]": 50005,
"<|startofpiece|>": 50006,
"<|endofpiece|>": 50007,
"[sMASK]": 50008,
"[gMASK]": 50009
}