Benchmark
Long-Range Arena (LRA)
-
Long-range arena is an effort toward systematic evaluation of efficient transformer models. The project aims at establishing benchmark tasks/dtasets using which we can evaluate transformer-based models in a systematic way, by assessing their generalization power, computational efficiency, memory foot-print, etc.
-
Long-range arena also implements different variants of Transformer models in JAX, using Flax.
-
This first initial release includes the benchmarks for the paper Long Range Arena: A benchmark for Efficient Transformers.