Database Architecture
We are using AWS DynamoDB as our Database engine solution.
Here is our Database Definition Schema:
In order to offer our users the best choice in terms of activities on the platform, and as we do not afford to pay full-time employees to browse the internet, check the qualities of found activities and share them on our plateform, we use an automated script.
This script is used to Scrape the internet (at the moment, it only supports TripAdvisor) retrieve its best activities per category, and import it in our Database, so we can reference the market's most trusted actors to relay their activities to our end users.
This script is based on jsdom (DOM emulation/manipulation for node.js) and it allows us at Shrike/Spotters to easily, effortlessly and automatically scrape the internet and stay up-to-date with the market's best offers.
In the future, this script may find multiple evolutions:
- More interfaces with other actors such as AirBnB Experiences....
- Transform these scripts into lambda functions, executed by time trigger (every day for exemple, so our plateform may manage itself)