Skip to content
Common Crawler Index
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
config
data
src/CommonCrawler
test
view/common-crawler/index
.gitignore
.travis.yml
CONDUCT.md
LICENSE
Module.php
README.md
TODO.md
autoload_classmap.php
autoload_function.php
autoload_register.php
composer.json

README.md

Common Crawler Index

Common Crawler library based on PHP using Zend Framework

How to run from web !

<<project url>>/commoncrawler

How to run from console !

php public/index.php commooncrawler

Download / Install

 composer require vrkansagara/common-crawl

Demo

https://vrkansagara.in/commoncrawler

SQL

CREATE TABLE `common_index` (
  `id` int(11) NOT NULL,
  `cindex` varchar(25) NOT NULL,
  `name` varchar(20) NOT NULL,
  `timegate` varchar(50) NOT NULL,
  `cdx_api` varchar(55) NOT NULL,
  `status` tinyint(1) NOT NULL DEFAULT '0',
  `created_at` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP,
  `updated_at` timestamp NOT NULL DEFAULT '0000-00-00 00:00:00' ON UPDATE CURRENT_TIMESTAMP
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

SQLite

CREATE TABLE common_index
(
    id INTEGER PRIMARY KEY AUTOINCREMENT NOT NULL,
    "index" VARCHAR(25) NOT NULL,
    name VARCHAR(20) NOT NULL,
    timegate VARCHAR(50) NOT NULL,
    cdx_api VARCHAR(55) NOT NULL
);

To follow the path look to the master follow the master walk with the master see through the master become the master.

You can’t perform that action at this time.