Since their introduction in 2017, transformers have quickly become the dominant architecture for achieving state-of-the-art results on a variety of …