View source on GitHub |
NextQueuedSequenceBatch stores deferred SequenceQueueingStateSaver data.
tf.contrib.training.NextQueuedSequenceBatch(
state_saver
)
This class is instantiated by SequenceQueueingStateSaver
and is accessible
via its next_batch
property.
Attributes | |
---|---|
batch_size
|
The batch_size of the given batch.
Usually, this is the batch_size requested when initializing the SQSS, but if allow_small_batch=True this will become smaller when inputs are exhausted. |
context
|
A dict mapping keys of input_context to batched context.
|
insertion_index
|
The insertion indices of the examples (when they were first added).
These indices start with the value -2**63 and increase with every call to the prefetch op. Each whole example gets its own insertion index, and this is used to prioritize the example so that its truncated segments appear in adjacent iterations, even if new examples are inserted by the prefetch op between iterations. |
key
|
The key names of the given truncated unrolled examples.
The format of the key is:
where |
length
|
The lengths of the given truncated unrolled examples.
For initial iterations, for which |
next_key
|
The key names of the next (in iteration) truncated unrolled examples.
The format of the key is:
if
where |
sequence
|
An int32 vector, length batch_size : the sequence index of each entry.
When an input is split up, the sequence values
are assigned to each split. |
sequence_count
|
An int32 vector, length batch_size : the sequence count of each entry.
When an input is split up, the number of splits is equal to:
|
sequences
|
A dict mapping keys of input_sequences to split and rebatched data.
|
total_length
|
The lengths of the original (non-truncated) unrolled examples. |
Methods
save_state
save_state(
state_name, value, name=None
)
Returns an op to save the current batch of state state_name
.
Args | |
---|---|
state_name
|
string, matches a key provided in initial_states .
|
value
|
A Tensor .
Its type must match that of initial_states[state_name].dtype .
If we had at input:
then the shape of
|
name
|
string (optional). The name scope for newly created ops. |
Returns | |
---|---|
A control flow op that stores the new state of each entry into the state saver. This op must be run for every iteration that accesses data from the state saver (otherwise the state saver will never progress through its states and run out of capacity). |
Raises | |
---|---|
KeyError
|
if state_name does not match any of the initial states
declared in initial_states .
|
state
state(
state_name
)
Returns batched state tensors.
Args | |
---|---|
state_name
|
string, matches a key provided in initial_states .
|
Returns | |
---|---|
A Tensor : a batched set of states, either initial states (if this is
the first run of the given example), or a value as stored during
a previous iteration via save_state control flow.
Its type is the same as initial_states["state_name"].dtype .
If we had at input:
then
|
Raises | |
---|---|
KeyError
|
if state_name does not match any of the initial states
declared in initial_states .
|