Skip to content

Commit

Permalink
Ruby 1.9.3 fix
Browse files Browse the repository at this point in the history
  • Loading branch information
buren committed Oct 24, 2014
1 parent 0bc7e09 commit fe50d51
Show file tree
Hide file tree
Showing 4 changed files with 8 additions and 6 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# SiteMapper
[![Code Climate](https://codeclimate.com/github/buren/site_mapper.png)](https://codeclimate.com/github/buren/site_mapper)
[![Gem Version](https://badge.fury.io/rb/site_mapper.svg)](http://badge.fury.io/rb/site_mapper) [![Build Status](https://travis-ci.org/buren/site_mapper.svg?branch=master)](https://travis-ci.org/buren/site_mapper) [![Dependency Status](https://gemnasium.com/buren/site_mapper.svg)](https://gemnasium.com/buren/site_mapper)
[![Gem Version](https://badge.fury.io/rb/site_mapper.svg)](http://badge.fury.io/rb/site_mapper) [![Build Status](https://travis-ci.org/buren/site_mapper.svg?branch=master)](https://travis-ci.org/buren/site_mapper) [![Dependency Status](https://gemnasium.com/buren/site_mapper.svg)](https://gemnasium.com/buren/site_mapper) [![Coverage Status](https://img.shields.io/coveralls/buren/site_mapper.svg)](https://coveralls.io/r/buren/site_mapper)

Map all links on a given site.
SiteMapper will try to respect `/robots.txt`
Expand Down
6 changes: 3 additions & 3 deletions lib/site_mapper/crawler.rb
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,9 @@ module SiteMapper
class Crawler
# @param [String] url base url for crawler
# @param [Hash] resolve (optional false by default)
def initialize(url, resolve: false)
@base_url = Request.resolve_url(url)
@options = { resolve: resolve }
def initialize(url, options = {})
@base_url = Request.resolve_url(url)
@options = { resolve: false }.merge(options)
@crawl_url = CrawlUrl.new(@base_url)
@fetch_queue = CrawlQueue.new
@processed = Set.new
Expand Down
5 changes: 3 additions & 2 deletions lib/site_mapper/request.rb
Original file line number Diff line number Diff line change
Expand Up @@ -50,9 +50,10 @@ def get_response_body(*args)
# @example Resolve google.com
# resolve_url('google.com')
# # => 'https://www.google.com'
def resolve_url(url, with_query: true)
def resolve_url(url, options = {})
options = { with_query: true }.merge(options)
resolved = UrlResolver.resolve(url)
resolved = remove_query(resolved) unless with_query
resolved = remove_query(resolved) unless options[:with_query]
resolved
end

Expand Down
1 change: 1 addition & 0 deletions spec/spec_helper.rb
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
require 'simplecov'
require 'coveralls'
Coveralls.wear!

SimpleCov.formatter = SimpleCov::Formatter::MultiFormatter[
SimpleCov::Formatter::HTMLFormatter,
Expand Down

0 comments on commit fe50d51

Please sign in to comment.