In encoder-decoder architectures, the outputs of the encoder blocks act because the queries towards the intermediate representation from the decoder, which offers the keys and values to determine a representation from the decoder conditioned around the encoder. This interest is known as cross-interest.A scaled-down multi-lingual variant of PaLM, qu