Releases: zrashwani/arachnid
Releases · zrashwani/arachnid
2.2.1
PHP 8.0 compatibility
Merge pull request #37 from zrashwani/php8-compatibility PHP8 compatibility
PHP 7.4 compatibility
- Dependencies update to support php 7.4
- Replace
illuminate/support
package withtightenco/collect
to provide collections with minimal dependency
Adding Support for js sites and bug fixes
This release includes major changes:
1- Adding support for JS based sites, using Symfony Panther client
2- Fixing broken links detection
3- Prevent loading full Dom document for external links
4- Adding additional information for link data, including: canonical links, h2 tags contents ..etc.
Adding javascript support using chrome driver
Major refactoring and adding support for javascript based websites by creating Chrome adapter, and wrapping it over Symfony Panther component
Adding LinksCollection class
- adding
LinksCollection
class - adding dependency on
illuminate/support
package - Implementing methods to provide simple statistics about links crawled
- Adding
source_link
key to indicate in which page the link exists
Improvements and refactoring
merge work in pull request #17
1.0.4
Update dependency version
update Goutte dependency to be version 3.1
Version 1.0.2
Crawlable link rules and duplicate links fixed