Skip to content

v0.3.14

Choose a tag to compare

@github-actions github-actions released this 20 Oct 16:22
· 52 commits to master since this release

Changelog

  • cc9e5c2 Generate docs.
  • f5ddf37 Manage S3 paths for collector, extractor and media from deployment configuration. Deploy now is field of Spider struct. Paths field for Deploy struct. Simplify spider initialization. All tests are passed.
  • 4be79d5 Optional deploy flag (simplify for windmill flow input).
  • 00218bd Provide default paths if collect ot payload path are empty.
  • f60a42a Reformat file.
  • d200894 Remove deploy flag. Use Spider.Deploy field instead.
  • 2d3ef59 Remove single url command.
  • 5746516 Skip images less than 1kb.
  • 2aa2b0a Spider check command requires new check ID as argument. Windmill check command uses current Windmill job ID as check ID.
  • 82db131 Trial now require spider ID.
  • d90616c Use page URL as article title fallback.