You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@syahnur197 I am leaning towards solution 1 at the moment. It has a few advantages:
more scalable because we don't have to scrape everything all the time
more resilient because we even if some pages fail it is still fine.
similar flow can be used for both providers. e.g. if page is unavailable for jobcentre, then it is inactive. if entry is older than x days in bruneida, then mark deleted.
Currently implementation adds new job listings but does not remove old ones.
2 ways to do this.
The text was updated successfully, but these errors were encountered: