Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spider mode not working with wraith #422

Closed
rubig opened this issue Apr 14, 2016 · 1 comment
Closed

Spider mode not working with wraith #422

rubig opened this issue Apr 14, 2016 · 1 comment

Comments

@rubig
Copy link

rubig commented Apr 14, 2016

Hi all,

I could not get wraith working under spider mode.

Standard capture mode works fine.

ubuntu@ip-10-224-91-168:~/wraith$ wraith capture configs/carsalesspider.yaml
DEBUG: #################################################
DEBUG:   Wraith version:     3.1.4
DEBUG:   Ruby version:       ruby 1.9.3p484 (2013-11-22 revision 43786) [x86_64-linux]

DEBUG:   ImageMagick:        Version: ImageMagick 6.7.7-10 2014-03-06 Q16 http://www.imagemagick.org

DEBUG:   PhantomJS version:  2.1.1

DEBUG:   CasperJS version:   Couldn't find nor compute phantom.casperPath, exiting.

DEBUG: #################################################
DEBUG:
Config validated. No serious issues found.
no paths defined in config, crawling from site root
/var/lib/gems/1.9.1/gems/wraith-3.1.4/lib/wraith/spider.rb:64:in `spider': undefined local variable or method `wraith' for #<Wraith::Crawler:0x00000000cc9ef8> (NameError)
        from /var/lib/gems/1.9.1/gems/wraith-3.1.4/lib/wraith/spider.rb:36:in `determine_paths'
        from /var/lib/gems/1.9.1/gems/wraith-3.1.4/lib/wraith/spider.rb:24:in `check_for_paths'
        from /var/lib/gems/1.9.1/gems/wraith-3.1.4/lib/wraith/cli.rb:36:in `check_for_paths'
        from /var/lib/gems/1.9.1/gems/wraith-3.1.4/lib/wraith/cli.rb:134:in `block in capture'
        from /var/lib/gems/1.9.1/gems/wraith-3.1.4/lib/wraith/cli.rb:28:in `within_acceptable_limits'
        from /var/lib/gems/1.9.1/gems/wraith-3.1.4/lib/wraith/cli.rb:131:in `capture'
        from /var/lib/gems/1.9.1/gems/thor-0.19.1/lib/thor/command.rb:27:in `run'
        from /var/lib/gems/1.9.1/gems/thor-0.19.1/lib/thor/invocation.rb:126:in `invoke_command'
        from /var/lib/gems/1.9.1/gems/thor-0.19.1/lib/thor.rb:359:in `dispatch'
        from /var/lib/gems/1.9.1/gems/thor-0.19.1/lib/thor/base.rb:440:in `start'
        from /var/lib/gems/1.9.1/gems/wraith-3.1.4/bin/wraith:5:in `<top (required)>'
        from /usr/local/bin/wraith:23:in `load'
        from /usr/local/bin/wraith:23:in `<main>'

Config file info:

##############################################################
##############################################################
# This is an example configuration provided by Wraith.
# Feel free to amend for your own requirements.
# ---
# This particular config is intended to demonstrate how
# to use Wraith in 'spider' mode.
##############################################################
##############################################################


# Add as many domains as necessary. Key will act as a label
domains:
  my_site:       "http://www.carsales.com"
  my_other_site: "http://www.carsales.com"

# Notice the absence of a `paths` property. When no paths are provided, Wraith defaults to
# spidering mode to check your entire website.

# A list of URLs to skip when spidering.
# Ruby regular expressions can be used, if prefixed with `!ruby/regexp` as defined in the YAML Cookbook<200b>.
# See http://www.yaml.org/YAML_for_ruby.html#regexps
spider_skips:
#  - /foo/bar.html           # Matches /foo/bar.html explicitly
#  - !ruby/regexp /^\/baz\// # Matches any URLs that start with /baz

# the filename of the spider file to use. Default: spider.txt
spider_file: example_com_spider.txt

# the number of days to keep the site spider file
spider_days: 10

# amount of fuzz ImageMagick will use when comparing images. A higher fuzz makes the comparison less strict.
fuzz: '20%'

# the maximum acceptable level of difference (in %) between two images.
# Wraith considers it a failure if an image diff goes above this threshold.
threshold: 5

# screen widths (and optional height) to resize the browser to before taking the screenshot
screen_widths:
  - 1280

# the engine to run Wraith with.
browser: "phantomjs"

# the directory that your latest screenshots will be stored in
directory: 'www/csspider'

# choose how results are displayed in the gallery (default is `alphanumeric` if omitted)
# Different screen widths are always grouped together.
# Options:
#   alphanumeric - all paths (with or without a difference) are shown, sorted by path
#   diffs_first - all paths (with or without a difference) are shown, sorted by difference size (largest first)
#   diffs_only - only paths with a difference are shown, sorted by difference size (largest first)
mode: diffs_first

verbose: true

Cheers,
Ming Zhu

@ChrisBAshton
Copy link
Contributor

Duplicate of #401. Thanks for the detailed config and output information though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants