Text Generation
Transformers
Safetensors
Spanish
English
Chinese
mistral
openchat
C-RLFT
function-calling
function calling
GGUF
conversational
Inference Endpoints
text-generation-inference

How many functions are too many?

#3
by kjhamilton - opened

I may have quite a few functions, at what point do you think it breaks down and is too many for it to make the right decision?

Trelis org

I haven't tested, but certainly 2-3 works well.

The training set only uses 2 functions max, so perhaps there may be issues if you go a lot further than this.

Of course, the model context limit puts an upper bound in place too.

RonanMcGovern changed discussion status to closed

Sign up or log in to comment