You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The existing implementation of the ReplayBuffer is inefficient in terms of memory consumption. In particular, it stores the same observation twice, once as an observation and once as a corresponding next_observation.
The purpose of this issue is to construct a more efficient implementation of the buffer class.
The text was updated successfully, but these errors were encountered:
The existing implementation of the ReplayBuffer is inefficient in terms of memory consumption. In particular, it stores the same observation twice, once as an
observation
and once as a correspondingnext_observation
.The purpose of this issue is to construct a more efficient implementation of the buffer class.
The text was updated successfully, but these errors were encountered: