|View source on GitHub|
Uniform replay buffer in Python.
The base class provides all the functionalities of a uniform replay buffer: - add samples in a First In First Out way. - read samples uniformly.
PyHashedReplayBuffer is a flavor of the base class which compresses the observations when the observations have some partial overlap (e.g. when using frame stacking).
class PyUniformReplayBuffer: A Python-based replay buffer that supports uniform sampling.