tff.program.PrefetchingDataSource

A tff.program.FederatedDataSource that prefetches data.

Inherits From: FederatedDataSource

tff.program.PrefetchingDataSource(
    data_source: tff.program.FederatedDataSource,
    total_iterations: int,
    iterations_to_prefetch: int,
    k_to_prefetch: int,
    prefetch_threshold: int = 0
)

data_source A tff.program.FederatedDataSource used to prefetch data from.
total_iterations The total number of iterations.
iterations_to_prefetch The number of iterations to prefetch.
k_to_prefetch The number of clients to prefetch per round. Must be greater than 1 and must be the same across all iterations; attempts to select any other number of clients will fail.
prefetch_threshold The threshold below which the data source starts prefetching.

ValueError If k_to_prefetch is not greater than 1.

federated_type The type of the data returned by calling select on an iterator.

Methods

iterator

View source

iterator() -> tff.program.PrefetchingDataSourceIterator

Returns a new iterator for retrieving data from this data source.