mrm8488 (Manuel Romero)

upvoted an article 5 days ago

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 17

upvoted a collection 5 days ago

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 28 items • Updated Mar 23 • 172

upvoted a collection 7 days ago

Performance LLMs - Base Models

Collection

22 items • Updated 7 days ago • 6

upvoted an article 8 days ago

Article

seemore: Implement a Vision Language Model from Scratch

By

•

2 days ago

• 37

upvoted a paper 13 days ago

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published 29 days ago • 17

upvoted an article 15 days ago

Article

Welcome Llama 3 - Meta's new open LLM

16 days ago

• 228

upvoted a collection 16 days ago

fuck quadratic attention

Collection

11 items • Updated 9 days ago • 17

upvoted a paper 17 days ago

TransformerFAM: Feedback attention is working memory

Paper • 2404.09173 • Published 19 days ago • 42

upvoted an article 21 days ago

Article

Vision Language Models Explained

23 days ago

• 60

upvoted a paper 21 days ago

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Paper • 2404.03715 • Published 29 days ago • 57

upvoted a paper 30 days ago

Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order

Paper • 2404.00399 • Published Mar 30 • 39

upvoted 3 collections about 2 months ago

upvoted 2 collections 2 months ago

Agentics

Collection

13 items • Updated Feb 28 • 1

Instruction-Tuned Models ES

Collection

Instruction-tuned models in Spanish and other related languages • 7 items • Updated 10 days ago • 4

upvoted a paper 2 months ago

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21 • 104

upvoted a collection 2 months ago

OpenCodeInterpreter

Collection

18 items • Updated Mar 3 • 71

upvoted 3 papers 2 months ago

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 45

User-LLM: Efficient LLM Contextualization with User Embeddings

Paper • 2402.13598 • Published Feb 21 • 17

Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains

Paper • 2402.05140 • Published Feb 6 • 18

upvoted a collection 2 months ago

LLMS - Knowledge / Domain Adaptions

Collection

2 items • Updated Feb 21 • 1

upvoted a paper 2 months ago

Instruction-tuned Language Models are Better Knowledge Learners

Paper • 2402.12847 • Published Feb 20 • 25

upvoted 3 collections 2 months ago

🌌 Cosmopedia

Collection

Resources for Cosmopedia dataset • 5 items • Updated Feb 20 • 8

OLMo Suite

Collection

Artifacts for the first set of OLMo models. • 12 items • Updated 10 days ago • 34

Benchmarks

Collection

15 items • Updated Feb 19 • 2

upvoted a paper 2 months ago

In Search of Needles in a 10M Haystack: Recurrent Memory Finds What LLMs Miss

Paper • 2402.10790 • Published Feb 16 • 39

upvoted a paper 3 months ago

AutoMathText: Autonomous Data Selection with Language Models for Mathematical Texts

Paper • 2402.07625 • Published Feb 12 • 10

upvoted a collection 3 months ago

datasets-SPIN

Collection

Generated synthetic data used to finetune SPIN. • 8 items • Updated Feb 9 • 10

upvoted 4 papers 3 months ago

StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

Paper • 2402.01391 • Published Feb 2 • 41

Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception

Paper • 2401.16158 • Published Jan 29 • 15

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 134

The Rise and Potential of Large Language Model Based Agents: A Survey

Paper • 2309.07864 • Published Sep 14, 2023 • 5

upvoted a collection 3 months ago

Canonical models

Collection

This collection lists all the historical (pre-"Hub") canonical model checkpoints, i.e. repos that were not under an org or user namespace • 68 items • Updated Feb 13 • 13

upvoted a paper 3 months ago

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 72

upvoted 3 collections 4 months ago

MoEs papers reading list

Collection

38 items • Updated 24 days ago • 114

haiku

Collection

🌸 This is a collection of synthetic datasets built to help improve the ability of open language models to better write haikus through the use of DPO • 3 items • Updated Jan 16 • 4

Comparing DPO with IPO and KTO

Collection

A collection of chat models to explore the differences between three alignment techniques: DPO, IPO, and KTO. • 56 items • Updated Jan 9 • 31

upvoted 2 papers 4 months ago

Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization

Paper • 2308.14469 • Published Aug 28, 2023 • 6

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

Paper • 2312.16862 • Published Dec 28, 2023 • 28

upvoted 2 collections 5 months ago

🐍 Mamba fine-tuned models

Collection

A collection with ClibrAIn's Mamba fine-tuned models • 3 items • Updated Dec 18, 2023 • 11

Awesome SFT datasets

Collection

A curated list of interesting datasets to fine-tune language models with. • 43 items • Updated 21 days ago • 88

upvoted 5 papers 5 months ago

UniIR: Training and Benchmarking Universal Multimodal Information Retrievers

Paper • 2311.17136 • Published Nov 28, 2023 • 7

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 170

Exponentially Faster Language Modelling

Paper • 2311.10770 • Published Nov 15, 2023 • 117

Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model

Paper • 2311.13231 • Published Nov 22, 2023 • 25

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

upvoted a collection 6 months ago

Zephyr 7B

Collection

Models, datasets, and demos associated with Zephyr 7B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 9 items • Updated 21 days ago • 136

upvoted 4 papers 7 months ago

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

Paper • 2310.08659 • Published Oct 12, 2023 • 19

Fast-ELECTRA for Efficient Pre-training

Paper • 2310.07347 • Published Oct 11, 2023 • 2

CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing

Paper • 2305.11738 • Published May 19, 2023 • 3

Offline Prompt Evaluation and Optimization with Inverse Reinforcement Learning

Paper • 2309.06553 • Published Sep 13, 2023 • 4

upvoted a paper 8 months ago

CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages

Paper • 2309.09400 • Published Sep 17, 2023 • 77

upvoted a paper 10 months ago

Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Paper • 2306.02707 • Published Jun 5, 2023 • 45

Manuel Romero PRO

AI & ML interests

Organizations

mrm8488's activity

GaLore: Advancing Large Model Training on Consumer-grade Hardware

seemore: Implement a Vision Language Model from Scratch

Welcome Llama 3 - Meta's new open LLM

Vision Language Models Explained