<br />

|---|
| [![](https://www.tensorflow.org/images/GitHub-Mark-32px.png) View source on GitHub](https://github.com/tensorflow/datasets/blob/v4.9.10/tensorflow_datasets/core/deprecated/text/text_encoder.py#L116-L217) |

Byte-encodes text.

Inherits From: [`TextEncoder`](https://www.tensorflow.org/datasets/api_docs/python/tfds/deprecated/text/TextEncoder)

    tfds.deprecated.text.ByteTextEncoder(
        additional_tokens=None
    )

<br />

<br />

<br />

| ## Args ||
|---|---|
| `additional_tokens` | `list<str>`, list of additional tokens. These will be assigned vocab ids `[1, 1+len(additional_tokens)]`. Useful for things like "end-of-string" tokens (e.g. ""). |

<br />

<br />

<br />

<br />

| ## Attributes ||
|---|---|
| `additional_tokens` | <br /> <br /> |
| `vocab_size` | Size of the vocabulary. Decode produces ints \[1, vocab_size). |

<br />

## Methods

### `decode`

[View source](https://github.com/tensorflow/datasets/blob/v4.9.10/tensorflow_datasets/core/deprecated/text/text_encoder.py#L158-L194)

    decode(
        ids
    )

Decodes a list of integers into text.

### `encode`

[View source](https://github.com/tensorflow/datasets/blob/v4.9.10/tensorflow_datasets/core/deprecated/text/text_encoder.py#L136-L156)

    encode(
        s
    )

Encodes text into a list of integers.

### `load_from_file`

[View source](https://github.com/tensorflow/datasets/blob/v4.9.10/tensorflow_datasets/core/deprecated/text/text_encoder.py#L214-L217)

    @classmethod
    load_from_file(
        filename_prefix
    )

Load from file. Inverse of save_to_file.

### `save_to_file`

[View source](https://github.com/tensorflow/datasets/blob/v4.9.10/tensorflow_datasets/core/deprecated/text/text_encoder.py#L209-L212)

    save_to_file(
        filename_prefix
    )

Store to file. Inverse of load_from_file.