Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
What is `m_mmul` benchmark?
#7
by
zhiminy
- opened
Is that MMLU?
yes but italian translated!
yes but italian translated!
Thanks! I mean, is it m_mmul in Italian for MMLU?
no it's a typo in my brain :), the metrics is mmlu_it but for some time I was convicted that the name of the evaluation was mmul.
FinancialSupport
changed discussion status to
closed