Every repository with this icon (
) is private.
Every repository with this icon (
) is public.
| Description: | A simple to learn and use, yet powerful web scraping toolkit! edit |
-
I had the understanding that firewatir was not a requirement in order to use scrubyt for normal scrapes - that firewatir was used for ajax scrapes. Yet I get this when I try requiring scrubyt in irb:
irb(main):001:0> require 'rubygems' => true irb(main):002:0> require 'scrubyt' LoadError: no such file to load -- firewatir from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require' from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require' from /usr/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/navigation/agents/firewatir.rb:2 from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `gem_original_require' from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `require' from /usr/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt.rb:29 from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:36:in `gem_original_require' from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:36:in `require' from (irb):2 irb(main):003:0>I actually an in to this with the latest master, uninstalled that and installed 0.4.06 and still got the above error. Normally I would go ahead and install the required gem but I spent an hour last night trying to get firewatir installed correctly on OS X 10.5.6 to no avail. I'd rather just side step firewatir for now since the majority of things I'm scraping are actually xhtml docs anyways.
Comments
-
I get this error when I try to run any example..
c:/ruby/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/navigation/agents/mechanize.rb:178:in
fill_textfield': undefined method[]=' for nil:NilClass (NoMethodError)from c:/ruby/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/navigation/navigation_actions.rb:27:in `eval' from c:/ruby/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/navigation/agents/mechanize.rb:178:in `fill_textfield' from c:/ruby/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/navigation/navigation_actions.rb:27:in `fill_textfield' from C:/Documents and Settings/JB/Mina dokument/NetBeansProjects/SBBotbeta1/lib/test1.rb:6 from c:/ruby/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/shared/extractor.rb:75:in `instance_eval' from c:/ruby/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/shared/extractor.rb:75:in `initialize' from c:/ruby/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/shared/extractor.rb:32:in `new' from c:/ruby/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/shared/extractor.rb:32:in `define'I have all the dependencies installed..
Comments
gerwinbrunner
Wed Sep 30 13:58:57 -0700 2009
| link
and here 2
Hey all!,
for me this guide fixed the issue we have: http://www.egeland.net/foswiki/bin/view/Main/ScrubyTthanks
-
I just installed the latest versions of hpricot and mechanize and am getting all kinds of undefined method errors. What versions of the gems should I be including? Shouldn't this be specified in the gemspec? You should consider tightening that up.
Comments
-
0 votes
Here is the fix: http://www.hindoogle.com/blog/2009/09/scrubyt-traverse_for_match-nilclass/
Here is the error:
/opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/utils/shared_utils.rb:42:in
traverse_for_match': undefined methodeach' for nil:NilClass (NoMethodError)from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/utils/shared_utils.rb:42:in `call' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/utils/shared_utils.rb:42:in `traverse_for_match' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/utils/shared_utils.rb:42:in `each' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/utils/shared_utils.rb:42:in `traverse_for_match' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/utils/shared_utils.rb:44:in `call' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/utils/shared_utils.rb:44:in `traverse_for_match' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/utils/simple_example_lookup.rb:36:in `find_node_from_text' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/scraping/filters/tree_filter.rb:67:in `generate_XPath_for_example' ... 7 levels... from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/shared/extractor.rb:75:in `initialize' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/shared/extractor.rb:32:in `new' from /opt/local/lib/ruby/gems/1.8/gems/scrubyt-0.4.06/lib/scrubyt/core/shared/extractor.rb:32:in `define' from my-scraper.rb:11Comments
