Promise and Callback based website-info getter using meta data of websites.
- Get any web page source code with webget
- Get any website logo, title and description
- Support modren metatag scraping
- Fully promise and callback based
- Support with ES6 async/await
- Support multiple metatag scraping
| ES5 | ES6 | Callback | Promise | async/await |
|---|---|---|---|---|
| ✔ | ✔ | ✔ | ✔ | ✔ |
Using npm:
$ npm install webgetUsing bower:
$ bower install webgetUsing yarn:
$ yarn add webget<meta name="description" content="Website info api"/>
<meta name="keywords" content="webget, api, nodejs"/>
<meta name="subject" content="website subject">
<meta name="copyright"content="nepsho">
<meta name="language" content="en">
<meta name="robots" content="index,follow" />
<meta name="revised" content="Saturday, May 9th, 2019, 0:00 am" />
<meta name="abstract" content="any abstract">
<meta name="topic" content="any topic">
<meta name="summary" content="any summary">
<meta name="author" content="bcrazydreamer, bcrazydreamer@gmail.com">
<meta name="designer" content="bcrazydreamer">
<meta name="reply-to" content="bcrazydreamer@gmail.com">
<meta name="url" content="https://nepsho.github.io/">
<meta name="category" content="any category"><meta name="og:title" content="WebGet"/>
<meta name="og:type" content="API"/>
<meta name="og:url" content="https://nepsho.github.io/"/>
<meta name="og:image" content="https://nepsho.github.io/lib/img/logo.png"/>
<meta name="og:email" content="bcrazydreamer@gmail.com"/>
<meta name="og:phone_number" content="123-456-7890"/>| S. No | a | b | c | d |
|---|---|---|---|---|
| 1 | logo | description | title | keywords |
| 2 | copyright | language | robots | revised |
| 3 | reply-to | topic | summary | author |
| 4 | country-name | url | category | site_name |
| 5 | phone_number |
const webget = require("webget")To get html of any webpage:
/* Callback method */
webget.gethtml("https://nepsho.github.io/example/meta_tags.html",(data)=>{
console.log(data);
})
/* Promise method */
webget.gethtml("https://nepsho.github.io/example/meta_tags.html").then(function(data) {
console.log(data);
}).catch(function(error) {
console.log(error);
});
/* async/await method */
async function demo(){
var result = await webget.gethtml("https://nepsho.github.io/example/meta_tags.html");
console.log(result);
}
/* Sample output
{
url : 'https://nepsho.github.io/example/meta_tags.html'
status : 200,
success : true,
html : "<html></html>"
}
*/To get meta of any webpage: for meta request a option is required which control and specify the desired output.
var option = {
fields; ["logo","description","title"] /*fields you want*/
};or
var option = {
fields; ["*"] /*for all supported field*/
};/* Callback method */
webget.getmeta("https://nepsho.github.io/example/meta_tags.html",option,(data)=>{
console.log(data);
})
/* Promise method */
webget.getmeta("https://nepsho.github.io/example/meta_tags.html",option).then(function(data){
console.log(data)
}).catch(function(error) {
console.log(error);
});
/* async/await method */
async function demo(){
var result = await webget.getmeta("https://nepsho.github.io/example/meta_tags.html",option);
console.log(result);
}
/* Sample output
{
logo : "https://nepsho.github.io/lib/img/logo.png",
title : "NepSho",
description : "Promise and callback based website-info getter using metadata of websites..."
}
*/In case of empty option then a default option is automatically set which contain logo, title and description. In this API both core function is designed in such way we can user as promise and as callback.
MIT licence
@BCrazyDreamer