Context window?
#10
by
oliviermills
- opened
Could you clarify the context window size?
The base model has a context size of 65k tokens, but we only fine-tuned it on 2048 tokens due to the nature of the dataset.