Skip to content

YiraBot 1.0.7
Compare
Choose a tag to compare
@OwenOrcan OwenOrcan released this 25 Jan 02:35
· 81 commits to master since this release
1.0.7
d57ca75

YiraBot Release Notes: Version 1.0.7

Overview

In this latest update, YiraBot Version 1.0.7, the focus is on refining and enhancing the command-line interface (CLI) aspect of the tool. This version marks a significant step in YiraBot's journey, further solidifying its position as a robust and versatile Python library for web crawling and data extraction. With an emphasis on user experience, efficiency, and versatility, Version 1.0.7 introduces a suite of new features and improvements that cater to a wide range of web crawling needs. Whether it's for data analysis, SEO audits, or content aggregation, YiraBot now offers more powerful and user-friendly options for professionals and enthusiasts alike. This update not only streamlines existing functionalities but also introduces new commands and features that enhance the tool's adaptability to various web environments and user requirements.

New Features

Dynamic Delay for Server Load Management

  • Dynamic Delay: Introduces a dynamic delay mechanism in crawling processes. This feature adjusts the crawling speed based on the server's response time, minimizing server overwhelm.

Enhanced Data Extraction and Storage

  • JSON Data Extraction: Added functionality to extract crawl data into JSON format. This can be activated using the -json flag during the crawl command.

Advanced Crawling Commands

  • Check Command: A new check command is implemented, enabling YiraBot to crawl through a website and identify any broken links or potential issues.
  • Get-HTML Command: The get-html command is introduced to create an exact HTML copy of a website, which is then saved as an HTML file.

Performance Improvements

  • Increased Speed: YiraBot's overall performance and crawling speed have been significantly improved, offering a faster and more efficient web crawling experience.

Example Usage

yirabot check example.com
yirabot get-html example.com
yirabot crawl example.com -json
Assets 2
Loading