<br />

|---|
| [![](https://www.tensorflow.org/images/GitHub-Mark-32px.png) View source on GitHub](https://github.com/tensorflow/models/blob/v2.20.0/official/nlp/modeling/networks/__init__.py) |

Networks are combinations of [`tf.keras`](https://www.tensorflow.org/api_docs/python/tf/keras) layers (and possibly other networks).

They are [`tf.keras`](https://www.tensorflow.org/api_docs/python/tf/keras) models that would not be trained alone. It encapsulates
common network structures like a transformer encoder into an easily
handled object with a standardized configuration.

## Classes

[`class AlbertEncoder`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/AlbertEncoder): ALBERT (<https://arxiv.org/abs/1810.04805>) text encoder network.

[`class BertEncoder`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/BertEncoder): Bi-directional Transformer-based encoder network.

[`class BertEncoderV2`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/BertEncoderV2): Bi-directional Transformer-based encoder network.

[`class Classification`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/Classification): Classification network head for BERT modeling.

[`class EncoderScaffold`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/EncoderScaffold): Bi-directional Transformer-based encoder network scaffold.

[`class FNet`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/FNet): FNet encoder network.

[`class FunnelTransformerEncoder`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/FunnelTransformerEncoder): Funnel Transformer-based encoder network.

[`class MobileBERTEncoder`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/MobileBERTEncoder): A Keras functional API implementation for MobileBERT encoder.

[`class PackedSequenceEmbedding`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/PackedSequenceEmbedding): An embedding network supporting packed sequences and position ids.

[`class SpanLabeling`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/SpanLabeling): Span labeling network head for BERT modeling.

[`class SparseMixer`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/SparseMixer): Sparse Mixer encoder network.

[`class XLNetBase`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/XLNetBase): Base XLNet model.

[`class XLNetSpanLabeling`](https://www.tensorflow.org/api_docs/python/tfm/nlp/networks/XLNetSpanLabeling): Span labeling network head for XLNet on SQuAD2.0.