Find the token count of each document/row.
tft.word_count(
tokens, name=None
)
tokens
is either a RaggedTensor
or SparseTensor
, representing tokenized
strings. This function simply returns size of each row, so the dtype is not
constrained to string.
Args |
tokens
|
either
(1) a two-dimensional SparseTensor , or
(2) a RaggedTensor with ragged rank of 1, non-ragged rank of 1
of dtype tf.string containing tokens to be counted
|
name
|
(Optional) A name for this operation.
|
Returns |
A one-dimensional Tensor the token counts of each row.
|
Raises |
ValueError
|
if tokens is neither sparse nor ragged
|