Wolfram Ravenwolf

wolfram

AI & ML interests

Local LLMs

Articles

Organizations

wolfram's activity

New activity in nvidia/Llama3-ChatQA-1.5-70B 15 days ago
New activity in wolfram/miquliz-120b-v2.0 about 2 months ago
New activity in wolfram/miquliz-120b-v2.0-GGUF 2 months ago
New activity in wolfram/miquliz-120b-v2.0 2 months ago

VRAM Estimates

5
#3 opened 2 months ago by ernestr

Merge method

1
#4 opened 2 months ago by dnhkng
New activity in wolfram/miqu-1-103b 2 months ago

Can't wait to test

5
#4 opened 3 months ago by froggeric
New activity in wolfram/miqu-1-103b 3 months ago

Kindly asking for quants

7
#2 opened 3 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-3.5bpw-h6-exl2 3 months ago

Update README.md

#1 opened 3 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-3.0bpw-h6-exl2 3 months ago

Update README.md

#1 opened 3 months ago by wolfram
New activity in LoneStriker/miqu-1-103b-2.4bpw-h6-exl2 3 months ago

Update README.md

#1 opened 3 months ago by wolfram
New activity in wolfram/miquliz-120b-v2.0 3 months ago

GPTQ / AWQ

1
#2 opened 3 months ago by agahebr
New activity in wolfram/miqu-1-120b 3 months ago

Guidance on GPU VRAM Split?

5
#3 opened 3 months ago by nmitchko
New activity in wolfram/miqu-1-103b 3 months ago
New activity in wolfram/miquliz-120b-v2.0-GGUF 3 months ago

iMatrix, IQ2_XS & IQ2_XXS

13
#2 opened 3 months ago by Nexesenex
New activity in wolfram/miqu-1-120b 3 months ago

Performance

13
#2 opened 3 months ago by KnutJaegersberg
New activity in wolfram/miquliz-120b-v2.0-3.0bpw-h6-exl2 3 months ago

VRAM requirements

7
#1 opened 3 months ago by sophosympatheia
New activity in wolfram/miquliz-120b 3 months ago

benchmarks?

1
#1 opened 3 months ago by distantquant
New activity in LoneStriker/miquliz-120b-4.0bpw-h6-exl2 3 months ago

Update README.md

#1 opened 3 months ago by wolfram
New activity in LoneStriker/miquliz-120b-2.9bpw-h6-exl2 3 months ago

Update README.md

#1 opened 3 months ago by wolfram
New activity in LoneStriker/miquliz-120b-2.65bpw-h6-exl2 3 months ago

Update README.md

#1 opened 3 months ago by wolfram
New activity in LoneStriker/miquliz-120b-2.4bpw-h6-exl2 3 months ago

Update README.md

#2 opened 3 months ago by wolfram
New activity in wolfram/miqu-1-120b 3 months ago

Kindly asking for quants

4
#1 opened 3 months ago by wolfram
New activity in LoneStriker/wolfram_miqu-1-120b-GGUF 3 months ago

Update README.md

#1 opened 3 months ago by wolfram

Update README.md

#2 opened 3 months ago by wolfram

Update README.md

#1 opened 3 months ago by wolfram

Update README.md

#1 opened 3 months ago by wolfram

Update README.md

#1 opened 3 months ago by wolfram

Update README.md

#1 opened 3 months ago by wolfram

Update README.md

#1 opened 3 months ago by wolfram
New activity in mlabonne/Beyonder-4x7B-v2 4 months ago
New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 5 months ago
New activity in DiscoResearch/DiscoLM-120b 5 months ago

Summoning EXL2 version ;)

9
#2 opened 5 months ago by wolfram
New activity in migtissera/Tess-XL-v1.0 6 months ago

Any chance for an EXL2 version?

15
#2 opened 6 months ago by wolfram
New activity in TheBloke/Nous-Capybara-34B-GGUF 6 months ago

Incorrect EOS token

9
#2 opened 6 months ago by Henk717
New activity in TheBloke/Airoboros-L2-70B-3.1.2-GGUF 7 months ago

Broken model!

1
#1 opened 7 months ago by wolfram
New activity in lizpreciatior/lzlv_70b_fp16_hf 7 months ago

Pretty good

5
#1 opened 7 months ago by Sao10K
New activity in TheBloke/EverythingLM-13B-V3-16K-GGUF 8 months ago

Broken model?

4
#1 opened 8 months ago by wolfram
New activity in migtissera/Synthia-13B-v1.2 8 months ago

Call for quantization

1
#1 opened 8 months ago by wolfram
New activity in tiiuae/falcon-180B-chat 8 months ago

RoPE scaling?

#6 opened 8 months ago by wolfram
New activity in Open-Orca/OpenOrcaxOpenChat-Preview2-13B 10 months ago

Prompt template discrepancy

4
#4 opened 10 months ago by wolfram
New activity in jarradh/llama2_70b_chat_uncensored 10 months ago

Please fix the misleading naming

4
#1 opened 10 months ago by wolfram
New activity in TheBloke/Llama-2-13B-chat-GGML 10 months ago
New activity in AlekseyKorshuk/vicuna-7b about 1 year ago