Skip to content
Turn any website to API by several clicks (serverless and support SPA!)
Branch: master
Clone or download
Latest commit 3c772b9 Apr 12, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
backend fix path bug Mar 26, 2019
frontend update footer and description Apr 3, 2019
.editorconfig init Jan 23, 2019
.eslintignore improve code quality Mar 25, 2019
.eslintrc improve code quality Mar 25, 2019
.gitignore improve code quality Mar 25, 2019
.gitpod.yml improve code quality Mar 25, 2019
.upignore improve code quality Mar 25, 2019
LICENSE improve code quality Mar 25, 2019
README.md update contact Apr 12, 2019
package-lock.json update contact Apr 12, 2019
package.json improve code quality Mar 25, 2019
up.json update footer and description Apr 3, 2019

README.md

CloudQuery

Join us

Turn any website to API by several clicks.

Try online: https://cloudquery.t9t.io

API

Query params:

  • url: url of the webpage you want to fetch
  • selectors: css selectors describing the elements interests you

Returns:

  • innerText: element innerText
  • href: element href

Run locally

# install dependencies
npm i
# start frontend server(for auto restart when code change)
npm run sb
# start backend server(for auto restart when code change)
npm run sf

# visit http://localhost:1234

How to deploy your own CloudQuery to AWS lambda

1. Configuration

  • update profile(AWS Credential Profiles) in up.json to use your own aws account
  • update rateLimit in config.json to set your own rate limit (Default: 5 request/hour)

2. Deploy

# deploy to aws lambda
up

# see the URL of your CloudQuery
up url

# deploy production version(to cloudquery.t9t.io)
up deploy production

Develop online

You can run CloudQuery in a free online dev environment using Gitpod:

Open in Gitpod

Thanks

  • up for deploying serverless API to AWS with ease
  • serverless-chrome for running chrome on AWS lambda
  • finder for making it easy to select elements on webpage
You can’t perform that action at this time.