Finetuned Hansoldeco Domain dataset
(Specialized on interiror Q&A and defective things on it.)
load_in_8bit=True
batch_size = 1 num_epochs = 3 micro_batch = 1 gradient_accumulation_steps = batch_size // micro_batch lora target
2 X A100 80GB
Base Model = CohereForAI/c4ai-command-r-plus
license : cc-by-nc-4.0 (non-commercial as cohere mentioned)
- Downloads last month
- 0