Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Objects are not removed from local even when enabled "Delete local objects" #444

Open
prabhakaran8737 opened this issue Nov 14, 2021 · 10 comments

Comments

@prabhakaran8737
Copy link

prabhakaran8737 commented Nov 14, 2021

In my case I am using Amazon s3 as external object and files are synced after running cron job. Now it is bit confusing whether files are from local or external object. I have enabled Delete local objects but still the size before sync and after sync are same.

Here is my object report

Object-status

@kisonay
Copy link

kisonay commented Nov 14, 2021

I would only expect 14mb to be locally. It will take some time for the local files to cleanup and be removed (it isn't instant)

@prabhakaran8737
Copy link
Author

@kisonay Problem exists since yesterday. You know how to cross check? Also in above screenshot "Only in External storage" is 0 still.

@prabhakaran8737
Copy link
Author

I would only expect 14mb to be locally. It will take some time for the local files to cleanup and be removed (it isn't instant)

May I know the settings for this to happen?

@prabhakaran8737 prabhakaran8737 changed the title How to cross check if files are from external object Objects are not removed from local even when enabled "Delete local objects" Nov 16, 2021
@prabhakaran8737
Copy link
Author

I would only expect 14mb to be locally. It will take some time for the local files to cleanup and be removed (it isn't instant)

If not instant is this related to CRON job timing which we schedule?

@aspark21
Copy link

Have you regenerated a report?

The report is created by a nightly task \tool_objectfs\task\generate_status_report

So while change may have occured you don't have an up to date report

@prabhakaran8737
Copy link
Author

@aspark21 thank you for the response. Yes I have regenerated. This is my recent report, If you see Only in External storage is still 0
Screenshot 2021-11-17 at 7 24 55 AM

@danmarsden
Copy link
Member

are you running cron on your site correctly? - or are you manually triggering events/cron when needed? This plugin requires multiple cron tasks to run multiple times overnight and with larger sites the process can take some time (days/weeks) as it tries to be kind to the API's and doesn't do everything all at once but slowly migrates the content and deletes the local data when ready.

@prabhakaran8737
Copy link
Author

prabhakaran8737 commented Nov 17, 2021

@danmarsden I have few questions

  1. Only after migrating everything, local data will be deleted?
  2. In my server data directory is 148GB and in Amazon s3 also size is 148.1GB, So I assume everything is transferred.

This is my cronjob schedular in server, running for the past 3 days.

* * * * * /opt/cpanel/ea-php74/root/usr/bin/php /to/public_html/admin/cli/cron.php > /dev/null 2>&1

And in application
Screenshot 2021-11-17 at 7 56 09 AM

@prabhakaran8737
Copy link
Author

@danmarsden still files are removed from my the server. Cron are running regularly

@danmarsden
Copy link
Member

not sure what else I can suggest sorry - it works for us - and we have this running in a massive number of sites...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants