Virt-io/SillyTavern-Presets

Samplers are a work in progress
If you need help adapting the presets to your needs, feel free to open a discussion.
Turn on trim if you like it I just suffer from FOMO.

Thanks to:
SerialKicked for fixing context
saishf for testing all the bad versions
Lewdiculous for testing and quantizing
Herman555 for reminding me that some models need a jailbreak
Clevyby for sharing their sampler knowledge
shrinkedd for ideas

SillyTavern Presets

Usage

Make sure to grab both context and instruct templates. It should look something like this.

When using these presets you must set Example Messages Behavior: Never include examples otherwise they will be sent twice.

The reason for this, is because I explicitly set for them to be sent. The default behavior is for them to just be added at the end of the context prompt.

Character Cards

The following is just personal preference. However, it is recommended for a better experience.

Create a new neutral persona(USER_01)
For scenario, use a really vague description. This is to prevent the LLM from locking in. (Unless you want that)
I am currently running https://github.com/gaffe-buck/tavern-v2-character-creator inside a container

Choosing a mode

Prepend one of the following, before your request.

> Text Editor

> Character Creator

> Flexible P-list Formatter

> Ali-chat Generator

> Opening Scenario Writer

Example:

> Text Editor

---

Re-write the scenario in a dark fantasy philosophical style.

Example:

> Opening Scenario Writer

Create an opening scene for Char, Char enters a coffee shop.

> Text Editor

Re-write Char's opening scenario, in a dark comedy style.

Samplers

I have decided to remove old samplers and only keep basic presets, I want people to play around and find what works best for them. Change context to desired context length

SillyTavern Docs

Temperature Feel free to play with this one, lower values are more grounded.

Min-P Higher values chop off more probabilities.

Values between 0.025 - 0.10 are good, personally I would use 0.075 or lower.

Repetition Penalty Tries to decrease repetition.

Do not set it higher than 1.2.

1.05 - 1.15 seem to work fine.

Rep Pen Range The range of tokens which Repetition Penalty can see. I have it set to 2048.

Frequency Penalty Decreases repetition.

Presence Penalty Increases word variety.

Dynamic Temperature Min and Max temps, free to change as desired.

Exponent, do not set Exponent higher than the default of 1.

You might want to try playing around and setting it lower than 1, this pushes lower probabilies higher.

When setting exponent lower than 1, set Min-P a little higher (0.075)

Smooth Sampling This one is great, smoothens out probabilities.

Lower is more diverse.

Recommended range 0.1 - 0.3