Skip to content

Commit

Permalink
Merge pull request #46 from rpkoller/patch-1
Browse files Browse the repository at this point in the history
Changes for the headline structure of the readme
  • Loading branch information
alex-moreno committed Feb 11, 2021
2 parents da0b87a + ea1164d commit 9d47cbb
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,15 +9,15 @@ Before you start, Clone / fork this repository and go into the folder.
There are two ways of using this tool: With [Vagrant](#Vagrant) or [Docker](#Docker).


# Vagrant
## Vagrant
Download and install [Vagrant](https://www.vagrantup.com/downloads).

## Requirements
### Requirements
- PHP 7.0
- Sqlite
- A (maybe big) list of urls to crawl. Robots.txt and Sitemaps detected automatically

## Installation
### Installation

1. Run:
```composer install```
Expand All @@ -26,7 +26,7 @@ Download and install [Vagrant](https://www.vagrantup.com/downloads).

```cp config.sample.php config.php```

# Usage
### Usage

Create a .csv which contains a list of urls to iterate over (see example.csv).

Expand Down Expand Up @@ -58,7 +58,7 @@ Whilst debugging, increase verbosity by adding a number of `-v` flags.
`-vv` : very verbose
`-vvv` : debug

# Configuration
### Configuration

There are some settings that you can configure, like the headers that you'll send to the site or the concurrency that you want to use.

Expand Down

0 comments on commit 9d47cbb

Please sign in to comment.