<br />

|---|
| [![](https://www.tensorflow.org/images/GitHub-Mark-32px.png) View source on GitHub](https://github.com/tensorflow/models/blob/v2.20.0/official/nlp/modeling/models/seq2seq_transformer.py#L646-L650) |

Initializer for attention layers in Seq2SeqTransformer.

    tfm.nlp.models.attention_initializer(
        hidden_size
    )