Collections

19

Moral Foundations of Large Language Models

Paper • 2310.15337 • Published Oct 23, 2023 • 1
Specific versus General Principles for Constitutional AI

Paper • 2310.13798 • Published Oct 20, 2023 • 2
Contrastive Prefence Learning: Learning from Human Feedback without RL

Paper • 2310.13639 • Published Oct 20, 2023 • 21
RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback

Paper • 2309.00267 • Published Sep 1, 2023 • 45

137

-

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

1

-

1

Moral Foundations of Large Language Models

Specific versus General Principles for Constitutional AI

Contrastive Prefence Learning: Learning from Human Feedback without RL

RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback

Zephyr Chat

Zephyr: Direct Distillation of LM Alignment

HuggingFaceH4/zephyr-7b-beta

HuggingFaceH4/zephyr-7b-alpha

Zephyr: Direct Distillation of LM Alignment

A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity

Secrets of RLHF in Large Language Models Part I: PPO

Zephyr: Direct Distillation of LM Alignment

LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders

PERL: Parameter Efficient Reinforcement Learning from Human Feedback

ReFT: Representation Finetuning for Language Models

Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models

Zephyr: Direct Distillation of LM Alignment

FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models

bigcode/starcoder2-15b

Zephyr: Direct Distillation of LM Alignment

mixedbread-ai/mxbai-rerank-large-v1

Metadata Might Make Language Models Better

Empirical Analysis of the Strengths and Weaknesses of PEFT Techniques for LLMs

PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques

Zephyr: Direct Distillation of LM Alignment

LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models

NEFTune: Noisy Embeddings Improve Instruction Finetuning

SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling

Soaring from 4K to 400K: Extending LLM's Context with Activation Beacon

Attention Is All You Need

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

RoBERTa: A Robustly Optimized BERT Pretraining Approach

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captions

ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks

Vision-Language Models as a Source of Rewards

StemGen: A music generation model that listens