Old cached files not being deleted

I'm not sure if I've installed this wrong or there's a permissions issue here, but the cached html files for my Craft installation pile up pretty quickly. Meaning that I end up having to manually go in and purge the cache every couple of weeks before my server is full.

Any ideas?