Find file
Fetching contributors…
Cannot retrieve contributors at this time
executable file 108 lines (55 sloc) 2.77 KB

Built-in modules comes with several built-in modules which can be accessed through the command line or web interface.

To run a built-in module, run


To see usage details, run

$ [MODULE] help


This module calculates the hash/checksum of each element of input. Available hashes are [md5, crc32, sha1, sha256, sha512, ...]

Example 1 - find the MD5 hash of a string

$ echo "this is a string" | digest md5
   => b37e16c620c055cf8207b999e3270e9b


This module checks a URL's Google pagerank (rate limits apply)

Example 1 - find the pagerank of

$ echo "" | pagerank


This module provides DNS resolution utilities

Example 1 - resolve domains and output "domain,ip"

$ resolve < domains.txt

Example 2 - return domains that do not resolve (potentially available)

$ resolve available < domains.txt

Example 3 - return domains that do resolve

$ resolve found < domains.txt

Example 4 - return unique IPs

$ resolve ips < domains.txt


Makes a HEAD request to each URL of input and returns the status code

Example 1 - return the status code (url,status)

$ cat urls.txt | -s statuscode

Example 2 - find URLs that 404

$ cat urls.txt | -s statuscode 404

Example 3 - find URLs that redirect

$ cat urls.txt | -s statuscode 3


The query module can be used to quickly select data from a URL. Usage: $ query url [selector] [attribute]

Example 1 - pull front page stories from reddit

$ query "" a.title

Example 2 - pull the href attribute from these links

$ query "" a.title href


This module is a simple wrapper for node-validator. Available filters are: [int, url, ip, alpha, alphanumeric, email]

Example 1 - remove lines that do not match a filter

$ validate [FILTER] < list.txt

Example 2 - output lines that do not match a filter (remove valid lines)

$ validate not [FILTER] < list.txt


This module evaluates an expression on each line of input and emits the result (unless the result is null)

Example 1 - remove empty lines

$ -s eval "input.trim() != '' ? input : null" < input.txt > modified.txt

Example 2 - convert a TSV (tab separated file) to CSV

$ -s eval "input.split('\t').join(',')" < data.tsv > data.csv


This module uses map/reduce to count word occurrences in a file

$ word_count < input.txt