Skip to content
This repository has been archived by the owner on Oct 6, 2022. It is now read-only.

Lambda Crawler which extracts content from websites and saves it to AWS Elasticsearch

Notifications You must be signed in to change notification settings

storyblok/lambda-crawler-aws-elasticsearch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

lambda-crawler

how to use

  1. Create a elasticsearch domain on Amazon AWS
  2. Change the host config in client.js to your elasticsearch domain
  3. Clone and build this Lambda application and make zip package.
  4. Deploy lambda-crawler.zip from AWS Management Console.

how to make zip package

git clone https://github.com/storyblok/lambda-crawler-aws-elasticsearch
cd lambda-crawler-aws-elasticsearch
npm install
npm run build
# lambda-crawler.zip

About

Lambda Crawler which extracts content from websites and saves it to AWS Elasticsearch

Topics

Resources

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published