Skip to content

GitLab

Menu

Projects Groups Snippets

Loading...
Help
Sign in / Register

L lm-evaluation-harness
Project information
- Project information
- Activity
- Labels
- Members
Repository
- Repository
- Files
- Commits
- Branches
- Tags
- Contributors
- Graph
- Compare
Issues 0
- Issues 0
- List
- Boards
- Service Desk
- Milestones
Merge requests 0
- Merge requests 0
CI/CD
- CI/CD
- Pipelines
- Jobs
- Schedules
Deployments
- Deployments
- Environments
- Releases
Monitor
- Monitor
- Incidents
Packages & Registries
- Packages & Registries
- Package Registry
- Infrastructure Registry
Analytics
- Analytics
- Value stream
- CI/CD
- Repository
Wiki
- Wiki
Snippets
- Snippets
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards

Collapse sidebar

gao qiong
lm-evaluation-harness
Repository
Branches

You need to sign in or sign up before continuing.

Overview
Active
Stale
All

main default protected

c12e5bec · fix: utf-8 encoding for logged sample files was missing (#2082) · Jul 09, 2024

Download source code

zip tar.gz tar.bz2 tar
scipy-optional

a6034d0c · make scipy an extra · Jul 08, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
masakhane-io/main

42401fa2 · revert parts back to main · Jul 08, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
multiprompt

7e186d53 · add method to have 1 yaml with multiple tasks · Jul 05, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
lintang-multimodal-prototyping

8bce8cf6 · add mmmu tasks · Jul 02, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
hailey-multimodal-prototyping

5b62a529 · add WIP hf vlm class · Jul 02, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
multimodal-support

baf28096 · update process results · Jul 02, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
multimodal-prototyping merged

67a990e7 · update gemma-2 default BOS behavior (#2049) · Jul 02, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
multimodal-evals

593998e8 · fixes · Jul 02, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
mmlu-pro

5be2bb10 · update files · Jun 27, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
add-paloma-benchmark

4bf44695 · update on names · Jun 19, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
prettify-lm_eval-tasks-list

8c45b0c0 · add Output Type column · Jun 08, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
chat_template

a6d3c058 · add documentation on adding chat template compatibility to model_guide · Jun 01, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
inverse-scaling-tasks

d7457ad3 · remove target_delimiter · May 31, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
winogender

a67e1297 · Merge branch 'main' of https://github.com/EleutherAI/lm-evaluation-harness into winogender · May 24, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
tinyBenchmarks

a9f21c25 · add conditional import ; fix task names · May 07, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
based-tasks

e162dc46 · run linters · Apr 26, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
lama_primed_negated

97e3c9fe · added lama primed and negated dataset · Apr 18, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
t5v2-alt-plus

fe44f98e · Update new_task_guide.md · Apr 16, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar
readme-overwrite

5b8adc79 · start to reorganize readme · Apr 07, 2024

Compare

Download source code

zip tar.gz tar.bz2 tar

Prev
1
2
3
4
Next