New discussion

流式的什么时候出啊

#35 opened 8 months ago by dingxiang000

--num-gpus 2 error

#26 opened 12 months ago by zjtzpanxb

体验执行compute报错

1
#21 opened about 1 year ago by Kaibiao

体验报错

#20 opened about 1 year ago by Kaibiao

为什么分词里没有pad_id?

1
#19 opened about 1 year ago by cos0sin0

如何让模型能以stream方式输出?

5
#10 opened about 1 year ago by zlei

不支持流式输出?

1
#7 opened about 1 year ago by betterme

llama.cpp format?

2
#5 opened about 1 year ago by joorei