iedorep: Memory management issues

[bbdaniels]

Crashes when user manually sets memory in dofile -- assuming this is because Stata uses clear all or equivalent in background when memory settings are changed. Need to check.

@kbjarkefur -- Having a different issue where it seems that making so many temp copies of a 40MB dataset is causing Stata to be unable to restore or store locals appropriately. Have you seen anything like this before? It is 30 vars, 250k obs so it's not enormous, and even 100 copies of it would only make 4GB which should not be a strain on my system at all. And yet I have locals disappearing and getting the message unable to restore data due to insufficient memory in cases.

[bbdaniels]

One option here is to not save every data state to use cf later, and instead use the hashes or signatures. This would lead to some loss of precision.... but perhaps it is worth it, at least optionally, if this is hard to solve.

[bbdaniels]

Solution proposed in 975f66c