Starting Tiny with Protein LLaMA
•
1
Nick Doiron
monsoon-nlp
AI & ML interests
plant DNA, multilingual and language tutor models
Articles
Organizations
Posts
2
Post
1671
Making some progress on TinyLLaMA for plant proteins 🌱🧬 and navigating the UniProt database https://huggingface.co/blog/monsoon-nlp/greenbeing-and-protein-models
Post
2746
I'm working on Matryoshka embeddings for proteins 🦠🧬 - while that's cooking, here are cosine-distances of selected pairs from UniProt's 1024-dim embeddings, within train/test/validation splits
monsoon-nlp/protein-pairs-uniprot-swissprot
Papers
2
spaces
8
models
40
monsoon-nlp/llama3-dnapretrain-kaniwa
Updated
monsoon-nlp/llama3-protein-annotation
Updated
monsoon-nlp/tinyllama-mixpretrain-uniprottune
Updated
•
14
monsoon-nlp/nyc-savvy-llama2-7b-lora-adapter
Updated
monsoon-nlp/tinyllama-mixpretrain-quinoa-sciphi
Text Generation
•
Updated
•
16
monsoon-nlp/tinyllama-proteinpretrain-quinoa
Text Generation
•
Updated
•
103
monsoon-nlp/BioMedGPT-16bit
Text Generation
•
Updated
•
46
monsoon-nlp/gpt-nyc-small
Text Generation
•
Updated
•
15
monsoon-nlp/mamba130-proteinpretrain-quinoa
Text Generation
•
Updated
•
8
monsoon-nlp/protein-matryoshka-embeddings
Sentence Similarity
•
Updated
•
6
•
3