tf_agents.utils.common.get_contiguous_sub_episodes

Computes mask on sub-episodes which includes only contiguous components.

next_time_steps_discount Tensor of shape [batch_size, total_steps] corresponding to environment discounts on next time steps (i.e. next_time_steps.discount).

A float Tensor of shape [batch_size, total_steps] specifying mask including only contiguous components. Each row will be of the form [1.0] * a + [0.0] * b, where a >= 1 and b >= 0, and in which the initial sequence of ones corresponds to a contiguous sub-episode.