hongst yjoonjang commited on
Commit
3529662
·
1 Parent(s): d4e648c

Use full KURE-Reranker names in the figure and fix a missing space in the PPS note (#2)

Browse files

- Use full KURE-Reranker names in the figure and fix a missing space in the PPS note (f5a17034eddd6e745548308f871bff4f562db435)
- Align the figure legend with the x=1000 tick (092f4039ed1244333cd8eeb140d93242b2dfb957)
- Move the figure legend slightly left of the x=1000 tick (725a83c4c4d440f9ab6831ad2abe0f9bfe581dfa)


Co-authored-by: Youngjoon Jang <yjoonjang@users.noreply.huggingface.co>

Files changed (2) hide show
  1. README.md +1 -1
  2. assets/pps_vs_ndcg9.png +2 -2
README.md CHANGED
@@ -143,7 +143,7 @@ The figure plots mean nDCG@10 against mean PPS across the nine Korean benchmarks
143
  | telepix/PIXIE-Spell-Reranker-Preview-0.6B | 596M | 0.7806 | 99.6 |
144
  | cross-encoder/ettin-reranker-1b-v1 | 1.0B | 0.6901 | 49.7 |
145
 
146
- PPS is measured on a single NVIDIA RTX A6000 48GB per model and averaged over the nine benchmarks.Inputs are length-sorted and dynamically padded within each batch.
147
 
148
  `jinaai/jina-reranker-v3` and `jinaai/jina-reranker-v3.5` are listwise rerankers that cannot be compared under the same 8,192-token condition on MLDR, so they are excluded from the 9-subset table and their MLDR cells are left blank below.
149
 
 
143
  | telepix/PIXIE-Spell-Reranker-Preview-0.6B | 596M | 0.7806 | 99.6 |
144
  | cross-encoder/ettin-reranker-1b-v1 | 1.0B | 0.6901 | 49.7 |
145
 
146
+ PPS is measured on a single NVIDIA RTX A6000 48GB per model and averaged over the nine benchmarks. Inputs are length-sorted and dynamically padded within each batch.
147
 
148
  `jinaai/jina-reranker-v3` and `jinaai/jina-reranker-v3.5` are listwise rerankers that cannot be compared under the same 8,192-token condition on MLDR, so they are excluded from the 9-subset table and their MLDR cells are left blank below.
149
 
assets/pps_vs_ndcg9.png CHANGED

Git LFS Details

  • SHA256: 99ba835554b7c39a471a033633472e0138339e45d9bfce2ef67cb3b08b4f5d51
  • Pointer size: 131 Bytes
  • Size of remote file: 110 kB

Git LFS Details

  • SHA256: 5b10c89e253670c6d812bd652cee8c9b9591983ede58a9d7ce7472fde6653c95
  • Pointer size: 131 Bytes
  • Size of remote file: 113 kB