Spaces:

open-llm-leaderboard
/

open_llm_leaderboard

Running on CPU Upgrade

App Files Files Community

770

Average Column

#724

by DaytonaPhil - opened about 1 month ago

Discussion

DaytonaPhil

about 1 month ago

•

edited about 1 month ago

The AVERAGE column is statistically invalid. It should be removed.

clefourrier

Open LLM Leaderboard org about 1 month ago

Hi!
Though not all dataset contain the same number of samples, we still want to average the model score across "capabilities", seeing each task as a unique block. We'll keep it as is.

clefourrier changed discussion status to closed about 1 month ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment