nbroad (Nicholas Broad)

upvoted an article 2 days ago

Article

License to Call: Introducing Transformers Agents 2.0

6 days ago

• 63

upvoted an article 3 days ago

Article

2024-04-22 - Hub Incident Post Mortem

By

•

1 day ago

• 15

upvoted a paper 7 days ago

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Paper • 2405.00732 • Published 20 days ago • 107

upvoted an article 16 days ago

Article

Powerful ASR + diarization + speculative decoding with Hugging Face Inference Endpoints

18 days ago

• 50

upvoted a paper 22 days ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published 26 days ago • 230

upvoted a paper 23 days ago

Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding

Paper • 2404.16710 • Published 23 days ago • 55

upvoted 3 collections 2 months ago

upvoted a collection 3 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 72

upvoted 3 papers 3 months ago

OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web

Paper • 2402.17553 • Published Feb 27 • 21

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21 • 104

Scaling Laws for Downstream Task Performance of Large Language Models

Paper • 2402.04177 • Published Feb 6 • 16

upvoted 3 papers 4 months ago

The Stack: 3 TB of permissively licensed source code

Paper • 2211.15533 • Published Nov 20, 2022 • 5

Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Text

Paper • 2401.12070 • Published Jan 22 • 40

Pheme: Efficient and Conversational Speech Generation

Paper • 2401.02839 • Published Jan 5 • 14

upvoted a paper 5 months ago

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 72

upvoted 2 papers 6 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents

Paper • 2306.16527 • Published Jun 21, 2023 • 42

upvoted a paper 7 months ago

In-Context Pretraining: Language Modeling Beyond Document Boundaries

Paper • 2310.10638 • Published Oct 16, 2023 • 26

upvoted 4 papers 8 months ago

RMT: Retentive Networks Meet Vision Transformers

Paper • 2309.11523 • Published Sep 20, 2023 • 32

Efficient Streaming Language Models with Attention Sinks

Paper • 2309.17453 • Published Sep 29, 2023 • 13

Kosmos-2.5: A Multimodal Literate Model

Paper • 2309.11419 • Published Sep 20, 2023 • 47

PDFTriage: Question Answering over Long, Structured Documents

Paper • 2309.08872 • Published Sep 16, 2023 • 51

upvoted 4 papers 10 months ago

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales

Paper • 2308.01320 • Published Aug 2, 2023 • 42

Retentive Network: A Successor to Transformer for Large Language Models

Paper • 2307.08621 • Published Jul 17, 2023 • 167

Becoming self-instruct: introducing early stopping criteria for minimal instruct tuning

Paper • 2307.03692 • Published Jul 5, 2023 • 24

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Paper • 2211.05100 • Published Nov 9, 2022 • 23

upvoted a paper 11 months ago

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

Paper • 2306.07954 • Published Jun 13, 2023 • 111

Nicholas Broad PRO

AI & ML interests

Articles

Accelerating Document AI

Organizations

nbroad's activity

License to Call: Introducing Transformers Agents 2.0

2024-04-22 - Hub Incident Post Mortem

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Powerful ASR + diarization + speculative decoding with Hugging Face Inference Endpoints

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Layer Skip: Enabling Early Exit Inference and Self-Speculative Decoding

Research Papers

Empowering SLMs

Synthetic Data Generation

💫 StarCoder2

OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Scaling Laws for Downstream Task Performance of Large Language Models

The Stack: 3 TB of permissively licensed source code

Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Text

Pheme: Efficient and Conversational Speech Generation

Improving Text Embeddings with Large Language Models

Zephyr: Direct Distillation of LM Alignment

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents

In-Context Pretraining: Language Modeling Beyond Document Boundaries

RMT: Retentive Networks Meet Vision Transformers

Efficient Streaming Language Models with Attention Sinks

Kosmos-2.5: A Multimodal Literate Model

PDFTriage: Question Answering over Long, Structured Documents

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales

Retentive Network: A Successor to Transformer for Large Language Models

Becoming self-instruct: introducing early stopping criteria for minimal instruct tuning

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation