Web Scraper - Crawler - In Development Stage

PLAM - PHP Laravel Angular MongoDB

A basic web scraper app built on top of Angular, Laravel and MongoDB.

How To Use • Credits •

How To Use

To clone and run this application, you'll need Git and Node.js (which comes with npm), Laravel and MongoDB installed on your computer. Make sure that your php.ini includes mongodb extension.

Installation

From your command line:

# Create a new Laravel project (run command from root directory)
$ composer create-project laravel/laravel backend

# Create a new Angular app (run command from root directory)
$ ng new frontend

# Clone this repository
$ git clone https://github.com/AjixDev/WebScraper.git

# Go into the backend directory
$ cd backend

# Install backend dependencies
$ php composer.phar install

# Go into the frontend directory (run command from a new terminal)
$ cd frontend

# Install frontend dependencies
$ npm install

# Run the backend server (runs on laravel default localhost:8000)
$ php artisan serve

# Run the frontend server (runs on angular default localhost:4200)
$ ng serve

Seeding and Migration

Database connection settings can be edited directly inside backend\config\database.php. However, the more secure and highly recommended approach is to edit the DB connection details as .env constants.

# Migrate the web_pages_table collection to the database
$ php artisan migrate

Credits

This software uses the following open source libraries and packages:

• mongodb/laravel-mongodb
• guzzlehttp/guzzle

---

ajixdev.github.io  ·  GitHub @AjixDev  ·  LinkedIn @Roy Aji