Skip to content

Releases: simonw/shot-scraper

0.15

12 Sep 20:57
b530e06
Compare
Choose a tag to compare
  • New --log-requests option for logging out newline-delimited JSON showing all requests made while rendering a page, including image and asset loads. #88
  • New shot-scraper pdf formatting options: --format, --width, --height, --scale and --print-background. Thanks, Eddie Chapman. #87
  • Removed -h shortcut for help - use --help instead. -h was clashing with the shorter version of --height. Thanks, Matthew Bafford. #84

0.14.3

02 Aug 23:41
c8686ff
Compare
Choose a tag to compare

0.14.2

28 Jul 18:32
2e9d09a
Compare
Choose a tag to compare

0.14.1

22 May 14:24
3039524
Compare
Choose a tag to compare

0.14

19 May 23:45
Compare
Choose a tag to compare

0.13

18 Apr 18:29
Compare
Choose a tag to compare
  • shot-scraper auth --devtools option for opening DevTools when authenticating with a site. #66
  • shot-scraper multi -n/--no-clobber option for skipping screenshots where the output image already exists on disk. #70

0.12

11 Apr 19:32
7f04706
Compare
Choose a tag to compare
  • --selector-all option to take a screenshot that encompasses every element matching the specified CSS selector - complements --selector which takes a screenshot of just the first element matching that selector. See Specifying elements using JavaScript filters. #64
  • selector_all: and selectors_all: keys in the shot-scraper multi YAML format.
  • --js-selector and --js-selector-all options for specifying elements to screenshot using a JavaScript expression, for cases which cannot be handled using CSS selectors #43. The following example takes a screenshot of the first paragraph on the page that mentions shot-scraper:
    shot-scraper https://github.com/simonw/shot-scraper \
      --js-selector 'el.tagName == "P" && el.innerText.includes("shot-scraper")'
    
  • js_selector:, js_selectors:, js_selector_all: and js_selectors_all: equivalent keys in the shot-scraper multi YAML format.
  • --user-agent option for setting a custom user agent header. #63
  • --browser webkit option for running WebKit - thanks, Ryan Murphy. #56

0.11

08 Apr 20:06
ed8977a
Compare
Choose a tag to compare
  • New shot-scraper accessibility --timeout option, thanks Ben Welsh. #59
  • shot-scraper auth --browser option for authentication using a browser other than Chromium. #61
  • Using --quality now results in a JPEG file with the correct .jpg extension. Thanks, Ian Wootten. #58
  • New --reduced-motion flag for emulating the "prefers-reduced-motion" media feature. Thanks, Ryan Murphy. #49

0.10

29 Mar 00:25
e59e720
Compare
Choose a tag to compare

0.9

14 Mar 00:05
9c73ed6
Compare
Choose a tag to compare
0.9
  • New shot-scraper javascript command for executing JavaScript against a web page and returning the result to the console as JSON: #38

    % shot-scraper javascript datasette.io document.title
    "Datasette: An open source multi-tool for exploring and publishing data"
    

    This can be used for web scraping and data extraction. Any JavaScript errors will cause the command to return an exit code of 1, so this can also be used to run tests against a website from within a continuous integration environment such as GitHub Actions.

  • The shot-scraper pdf and shot-scraper accessibility commands can both now be used with local files in addition to URLs. #37

  • The output: key is no longer required in YAML shot configuration: if omitted, an automatic filename will be used instead. #40

  • An empty YAML file no longer produces an error. #41