Best top k, top p, temp and instruct settings?
#29
by
Derpyandflutterbatlover
- opened
I need the best settings for rp
@Derpyandflutterbatlover
It entirely depends on the type of usecase you're dealing with.
If you want more creativity in the outputs you should have high temperature values and vice versa for stable outputs. Moreover, Mistral models are trained for stability in the generated outputs so you can expect similar completions even when you change the values by a lot.
Hence, I would suggest you to take a look at this really cool blog https://huggingface.co/blog/how-to-generate by Patrick von Platen, to decide on your required parameters.