Attend the Women in ML Symposium on December 7 Register now

tff.analytics.heavy_hitters.iblt.IbltTensorEncoder

Stay organized with collections Save and categorize content based on your preferences.

Encodes the strings into an IBLT data structure.

Inherits From: IbltEncoder

value_shape Shape of the values.
*args See IbltEncoder.
**kwargs See IbltEncoder.

Methods

compute_chunks

View source

Returns Tensor containing integer chunks for input strings.

Args
input_strings A tensor of strings.

Returns
A 2D tensor with rows consisting of integer chunks corresponding to the string indexed by the row and a trimmed input_strings that can fit in the IBLT.

compute_iblt

View source

Returns Tensor containing the values of the IBLT data structure.

Args
input_strings A 1D tensor of strings.
input_values A tensor of shape (num_input_strings, value_shape) containing values for each string.

Returns
A tuple of tensors where the first one is of shape [repetitions, table_size, num_chunks+2] whose value at index (r, h, c) corresponds to chunk c of the keys if c < num_chunks, to the counts if c == num_chunks, and to the checks if c == num_chunks + 1. The second one is of shape [repetitions, table_size, product(value_shape)] and contains the tensor values at each key.