MetaFinder

Search for documents in a domain through Search Engines. The objective is to extract metadata.

Installation:

> pip3 install metafinder

Upgrades are also available using:

> pip3 install metafinder --upgrade

Usage

MetaFinder can be used in 2 ways:

CLI

metafinder -d domain.com -l 20 -o folder [-t 10] -go -bi -ba

Parameters:

• d: Specifies the target domain.
• l: Specify the maximum number of results to be searched in the searchs engines.
• o: Specify the path to save the report.
• t: Optional. Used to configure the threads (4 by default).
• v: Show Metafinder version.
• Search Engines to select (Google by default):
  • go: Optional. Search in Google.
  • bi: Optional. Search in Bing.
  • ba: Optional. Search in Baidu. (Experimental)

In Code

import metafinder.extractor as metadata_extractor

documents_limit = 5
domain = "target_domain"
result = metadata_extractor.extract_metadata_from_google_search(domain, documents_limit)
# result = metadata_extractor.extract_metadata_from_bing_search(domain, documents_limit)
# result = metadata_extractor.extract_metadata_from_baidu_search(domain, documents_limit)
authors = result.get_authors()
software = result.get_software()
for k,v in result.get_metadata().items():
    print(f"{k}:")
    print(f"|_ URL: {v['url']}")
    for metadata,value in v['metadata'].items():
        print(f"|__ {metadata}: {value}")

document_name = "test.pdf"
try:
    metadata_file = metadata_extractor.extract_metadata_from_document(document_name)
    for k,v in metadata_file.items():
        print(f"{k}: {v}")
except FileNotFoundError:
    print("File not found")

Example

Author

This project has been developed by:

• Josué Encinar García -- @JosueEncinar

Contributors

• Félix Brezo Fernández -- @febrezo

Disclaimer!

The software is designed to leave no trace in the documents we upload to a domain. The author is not responsible for any illegitimate use.