Edit model card

Uploaded model

  • Developed by: NotAiLOL
  • License: apache-2.0
  • Finetuned from model : unsloth/tinyllama-bnb-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Model details

Metrics

  • Epoch number: 2
  • Training steps: 2334
  • Train runtime: 5960.197s
  • Training loss: 0.521200

Prompt format

The model follows alpaca prompt.

Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

### Instruction:
{}

### Input:
{}

### Response:
{}
Downloads last month
737
Safetensors
Model size
1.1B params
Tensor type
FP16
·

Finetuned from

Dataset used to train NotAiLOL/Athena-TinyLlama-v0.1

Collection including NotAiLOL/Athena-TinyLlama-v0.1