Jamba Notebook

by Severian - opened Apr 2

Apr 2

Hey @mlabonne ! Awesome work, thanks for sharing. I have been trying to train Jamba myself with my normal fine-tuning code/approach and have been having mixed results. Would you be willing to share the LazyAxolotl notebook? I oddly enough have never tried the Axolotl framework but think this might be the best way to train Jamba effectively after various set-ups.

Thanks for all your great work and insights!

mlabonne

Owner Apr 2

Thanks @Severian ! Sure, here's the Colab notebook: https://colab.research.google.com/drive/1alsgwZFvLPPAwIgkAxeMKHQSJYfW7DeZ?usp=sharing

Severian

Apr 2

Many thanks! Excited to try it out

Severian changed discussion status to closed Apr 2

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment