24 28 55

Marc Sun

marcsun13

_marcsun

SunMarc

AI & ML interests

LLM, Quantization, Training, Inference

Articles

Organizations

marcsun13's activity

upvoted a paper 25 days ago

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 94

upvoted an article about 1 month ago

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 239

upvoted a collection about 1 month ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated Apr 18 • 525

upvoted 10 articles about 1 month ago

Article

Vision Language Models Explained

Apr 11

• 82

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 126

Article

Overview of natively supported quantization schemes in 🤗 Transformers

Sep 12, 2023

• 6

Article

Making LLMs lighter with AutoGPTQ and transformers

Aug 23, 2023

• 11

Article

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

Aug 17, 2022

• 19

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 31

Article

Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval

Mar 22

• 35

Article

quanto: a pytorch quantization toolkit

Mar 18

• 13

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 19

Article

Outpainting II - Differential Diffusion

•

27 days ago

• 24

upvoted a paper about 1 month ago

KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

Paper • 2402.02750 • Published Feb 5 • 3

upvoted a paper 2 months ago

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Paper • 2403.09029 • Published Mar 14 • 52

upvoted 3 papers 3 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 124

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 566

BiLLM: Pushing the Limit of Post-Training Quantization for LLMs

Paper • 2402.04291 • Published Feb 6 • 48

upvoted 2 papers 4 months ago

Mixtral of Experts

Paper • 2401.04088 • Published Jan 8 • 152

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 81

upvoted a paper 5 months ago

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 253

upvoted a collection 5 months ago

BLIP models

Collection

A collection of all BLIP models • 8 items • Updated 9 days ago • 12

upvoted a paper 5 months ago

ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks

Paper • 2312.08583 • Published Dec 14, 2023 • 9

upvoted 2 papers 6 months ago

Effective Quantization for Diffusion Models on CPUs

Paper • 2311.16133 • Published Nov 2, 2023 • 4

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

upvoted a collection 8 months ago

Recent models: last 100 repos, sorted by creation date

Collection

The last 100 repos I have created. Sorted by creation date descending, so the most recently created repos appear at the top. • 121 items • Updated Jan 31 • 446

upvoted 2 papers 10 months ago

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 34

GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

Paper • 2210.17323 • Published Oct 31, 2022 • 5