Nathan Habib

#753 opened 10 days ago by

alozowski

New activity in open-llm-leaderboard/open_llm_leaderboard 11 days ago

apply-ruff

7

#748 opened 15 days ago by

alozowski

New activity in open-llm-leaderboard/open_llm_leaderboard 17 days ago

Understanding raw result data files

#729 opened 29 days ago by

jerome-white

New activity in open-llm-leaderboard/open_llm_leaderboard 19 days ago

No good way to identify number of activated parameters causes MIxtral evaluation failures

28

#680 opened about 2 months ago by

0-hero

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

GSM8K failure with Llama 3 finetunes

12

#703 opened about 1 month ago by

jeiku

New activity in open-llm-leaderboard/results about 1 month ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#57 opened about 1 month ago by

New activity in open-llm-leaderboard/requests about 1 month ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#102 opened about 1 month ago by

New activity in databricks/dbrx-base 2 months ago

Update README.md

#16 opened 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 3 months ago

Model evaluation failed after 2 days

17

#622 opened 3 months ago by

migtissera

bigstral and bigyi both failed

#628 opened 3 months ago by

ehartford

New activity in open-llm-leaderboard/results 3 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#46 opened 3 months ago by

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#45 opened 3 months ago by

New activity in google/gemma-7b 3 months ago

Fix typo

#15 opened 3 months ago by

New activity in open-llm-leaderboard/details_google__gemma-2b 3 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#1 opened 3 months ago by

New activity in open-llm-leaderboard/details_google__gemma-7b 3 months ago

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#1 opened 3 months ago by

New activity in open-llm-leaderboard/requests 3 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#59 opened 3 months ago by

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#58 opened 3 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 4 months ago

Model not found on hub

#584 opened 4 months ago by

akshay326

152334H/miqu-1-70b-sf marked as private or deleted

#587 opened 4 months ago by

TNTOutburst

Model submission

#590 opened 4 months ago by

axra

gsm8k score largely different from local run

#591 opened 4 months ago by

mobicham

Create REBOOT.md

#586 opened 4 months ago by

nisten

Model not showing up in the queue

#588 opened 4 months ago by

bhavyaaiplanet

Is the eval server down?

#589 opened 4 months ago by

appoose

can I see MMLU By Task?

#559 opened 4 months ago by

jijivski

invisible models in openllm leaderboard

13

#554 opened 4 months ago by

leejunhyeok

[FLAG] Garrulus and Turdus based models

#548 opened 4 months ago by

MichaelKarpe

Add Mute Button for Notifications

#547 opened 4 months ago by

aigeek0x0

Cannot reproduce accuracy of mncai/Llama2-7B-guanaco-dolphin-500 gsm8k

16

#527 opened 5 months ago by

zhentaocc

New activity in open-llm-leaderboard/open_llm_leaderboard 5 months ago

Model works fine on A100 (80GB) GPU

#541 opened 5 months ago by

aigeek0x0

missing evaluation results of finished eval

16

#529 opened 5 months ago by

fblgit

Details of run not Found

#518 opened 5 months ago by

arshadshk

Evaluation of Dolphin Mixtral series failed

#517 opened 5 months ago by

Dampfinchen

Bagel 8x7B evaluation failed

5

#516 opened 5 months ago by

Dampfinchen

my model is not showing on the llm leaderboard

#504 opened 5 months ago by

abdulrahman-nuzha

Update src/submission/check_validity.py

#509 opened 5 months ago by

BearSean

undeleted/unprivate model is invisible in leaderboard

11

#487 opened 5 months ago by

leejunhyeok

Models Failure

11

#374 opened 7 months ago by

Weyaxi

Model deletion from LLM leaderboard

#476 opened 6 months ago by

Toten5

Bug- model show incorrect # Params

#499 opened 5 months ago by

felixz

[FLAG] zyh3826 / GML-Mistral-merged-v1

#503 opened 5 months ago by

nlpguy

Model Upload Error: This model has been already submitted.

7

#506 opened 5 months ago by

kyujinpy

Remove model

#507 opened 5 months ago by

jeonsworld

Why is "trust_remote_code" not supported?

#501 opened 5 months ago by

Q-bert

[FLAG] ceadar-ie / FinanceConnect-13B

#502 opened 5 months ago by

nlpguy

Request for removal of models

#500 opened 5 months ago by

sequelbox

l3utterfly/minima-3b-layla-v2 shown as "submitted" but cannot find it anywhere

#493 opened 5 months ago by

l3utterfly

Model evaluation failed

#494 opened 5 months ago by

adamo1139

Deployed For Evaluation Still Not On Leaderboard

#497 opened 5 months ago by

vikash06

Model not visible on leaderboard

#489 opened 5 months ago by

mwitiderrick

There seems to be a problem with the mixtral finetuning evaluations

9

#491 opened 5 months ago by

DavidGF

New activity in OpenGVLab/MVBench_Leaderboard 6 months ago

Better citation readability

#1 opened 6 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 6 months ago

Metis-0.3 failed

#479 opened 6 months ago by

Mihaiii

What does it mean for a model to be in the Running evaluation queue?

#480 opened 6 months ago by

Mihaiii

Potential data contamination with regards to ultrafeedback-binarized and Nectar datasets

42

#474 opened 6 months ago by

killawhale2

nathan-flagged-models-vis

5

#478 opened 6 months ago by

Brainstorming: Suggestions for improving the leaderboard

25

#477 opened 6 months ago by

xxyyy123

Please check this failed task

#446 opened 6 months ago by

JosephusCheung

Please remove the wrong item