- Clone the repository
git clone <url-of-this-repository>- Install the dependencies with npm
npm install- Fix Puppeteer by launching the following command (powershell or bash, not cmd)
./bin/init| Parameter | Description | Default value |
|---|---|---|
| bot_name | Name of the bot | 'metacritic' |
| date | Date of the data | Date with this format : "2023-01-01" |
| root_path | Root path of the project | path.resolve('.') |
| data_directory | Directory where the data will be stored | 'data' |
| executable_path | Path to the executable | '' |
| os | Operating system | OS |
| executable | Executable | 'chrome' |
| headless | Headless mode | 'true' |
| start | Index of first task | 0 |
| end | Index of last task | -1 |
Available browsers :
| Name | Value |
|---|---|
| Chrome | 'chrome' |
| Edge | 'edge' |
| Firefox | 'firefox' |
Available operating systems :
| Name | Value |
|---|---|
| Windows | 'windows' |
| Linux | 'linux' |
| Mac | 'mac' |
Example :
To execute the script with edge as browser on the current operating system :
node index.js --executable="edge"To execute the script with chrome headless on linux :
node index.js --executable="chrome" --headless="true" --os="linux"To execute a chunk of tasks (from the tenth to the twentieth task):
node index.js --start=10 --end=20