Skip to content

42 project - Web scrapper and metadta/ExIF extractor

Notifications You must be signed in to change notification settings

Link-Wolf/arachnida

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Link-Wolf - arachnida 42 grade - 100 / 100 Year - 2022 stars - arachnida forks - arachnida issues - arachnida OS - linux

Logo

Piscine Cybersecurity - Arachnida

spider..scorpion..or both
A web scrapper that extract images and a metadata/ExIF extractor

Report Bug · Request Feature

Table of Contents
  1. Goal
  2. Getting Started
  3. Usage examples
  4. Contributing

Goal

arachnida

This cybersecurity project is composed by two differents executables. The first one, spider, is a web scrapper that extract and download images (jpeg, png, gif and bpm) from a website, and is able to act recursively on the links found in the website. The second one, scorpion, is an ExIF tool that extract metadata from images (jpeg, png, gif and bpm)

Both are written using NodeJS and use a minimal amount of external libraries, the logic is mostly homemade.

(back to top)

Getting Started

Prerequisites

Installation

  1. Clone the repo

    $> git clone https://github.com/Link-Wolf/arachnida.git
  2. Launch one of the two executables

    $> cd arachnida
    $> ./spider [-r] [-l level] [-p path] url

    -r : recursive mode -l : level of recursion -p : path to save images url : url to scrap


    $> cd arachnida
    $> ./scorpion FILE1 [FILE2 ...]

    FILE : path to image

(back to top)

Usage examples

Spider

spider

Scorpion

scorpion

(back to top)

Contributing

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

(back to top)

Releases

No releases published

Packages

No packages published