Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP

Loading…

LMT should provide a utility to clear old raw data #22

Open
haasken opened this Issue · 0 comments

1 participant

@haasken

It would be useful if LMT had a script, an option to lmtsh, or an option to lmt_agg.cron that would clear raw data which is older than a certain date. Perhaps this could be in the form of a shell script that can be run manually or set up to run as a cron job.

I was thinking a shell script that executes a bunch of MySQL commands like this one would do the trick:

mysql -p$(cat /etc/lmt/rwpasswd) -e "DELETE MDS_OPS_DATA 
FROM MDS_OPS_DATA INNER JOIN TIMESTAMP_INFO 
ON MDS_OPS_DATA.TS_ID=TIMESTAMP_INFO.TS_ID 
WHERE TIMESTAMP < '$TIMESTAMP';"

Of course the actual shell script would need options for which data tables to clear and the time frame to clear. @morrone please advise whether this is a reasonable addition to LMT. If so, I will create this script and its documentation and issue a pull request.

Other options considered:

  1. Add this functionality to lmt_agg.cron. This might be misleading because this script is for aggregation, not clearing. On the plus side, it could make sure that data which has not been aggregated yet is not deleted. It probably doesn't need to be implemented in Perl though.
  2. Add this functionality to lmtsh. This would have to be done manually and not as a cron job. However, there is already some clearing functionality here with the "clr" command.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Something went wrong with that request. Please try again.