LMT should provide a utility to clear old raw data #22

haasken opened this Issue Oct 24, 2013 · 0 comments

1 participant


It would be useful if LMT had a script, an option to lmtsh, or an option to lmt_agg.cron that would clear raw data which is older than a certain date. Perhaps this could be in the form of a shell script that can be run manually or set up to run as a cron job.

I was thinking a shell script that executes a bunch of MySQL commands like this one would do the trick:

mysql -p$(cat /etc/lmt/rwpasswd) -e "DELETE MDS_OPS_DATA 

Of course the actual shell script would need options for which data tables to clear and the time frame to clear. @morrone please advise whether this is a reasonable addition to LMT. If so, I will create this script and its documentation and issue a pull request.

Other options considered:

  1. Add this functionality to lmt_agg.cron. This might be misleading because this script is for aggregation, not clearing. On the plus side, it could make sure that data which has not been aggregated yet is not deleted. It probably doesn't need to be implemented in Perl though.
  2. Add this functionality to lmtsh. This would have to be done manually and not as a cron job. However, there is already some clearing functionality here with the "clr" command.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment