For now, this just unconditionally frees unused resources from the
previous frame after building a new frame. We may want to throttle this
back at some point.

Also, the cache used is potentially inefficient and can be easily
improved.

We don't free texture pages at the GL level yet.