relevance / tarantula

Source
Commits
Network (12)
Issues (7)
Graphs
Branch: master

a big hairy fuzzy spider that crawls your site, wreaking havoc — Read more

Sort by: Priority | Votes | Last Updated

Loading…

12.

0 votes

relevance-tarantula 0.3.0 gem has not been built and published by github
3 comments Created 3 months ago by sumbach

Title

Body
Not sure if this is a general issue with github, but the 0.3.0 gem has not been built. I pulled down the code, built, and tested with Gist - 16215 and everything looks okay. http://hasmygembuiltyet.org/relevance/tarantula http://gems.github.com/list.html
or cancel

Not sure if this is a general issue with github, but the 0.3.0 gem has not been built. I pulled down the code, built, and tested with Gist - 16215 and everything looks okay.

http://hasmygembuiltyet.org/relevance/tarantula
http://gems.github.com/list.html

Comments

relevance Mon Sep 14 04:52:25 -0700 2009 | link

This looks like it is a github issue. Some of our other gems have not built this weekend either. Hopefully it will be resolved soon.

Comment
This looks like it is a github issue. Some of our other gems have not built this weekend either. Hopefully it will be resolved soon.
or cancel

garlandgroup Wed Sep 23 08:04:52 -0700 2009 | link

Friendly FYI: 0.3.0 still not built and published on github as far as I can tell.

Comment
Friendly FYI: 0.3.0 still not built and published on github as far as I can tell.
or cancel

glv Thu Sep 24 15:43:32 -0700 2009 | link

0.3.0 still hasn't been build and published, but 0.3.3 has. Use that instead. :-)

Comment
0.3.0 *still* hasn't been build and published, but 0.3.3 has. Use that instead. :-)
or cancel

Parsed with GitHub Flavored Markdown
10.

0 votes

fix
x

ruby19
x

Tarantula has bad ruby 1.9 case syntax
1 comment Created 4 months ago by spicycode

Title

Body
See form_submission.rb around line 50 for an example
or cancel

See form_submission.rb around line 50 for an example

Comments

jasonrudolph Fri Aug 21 08:16:58 -0700 2009 | link

Fixed in commit 2d6d96.

http://github.com/relevance/tarantula/commit/2d6d967e610652a08a81f360f4a7e5a85a80d072

Comment
Fixed in commit 2d6d96. http://github.com/relevance/tarantula/commit/2d6d967e610652a08a81f360f4a7e5a85a80d072
or cancel

Parsed with GitHub Flavored Markdown
8.

0 votes

techdebt
x

Unify FormSubmission and AttackFormSubmission
1 comment Created 6 months ago by glv

Title

Body
These two classes are an embarrassment of duplicated code. The default fuzzing strategy implemented in FormSubmission should be implemented as (say) BasicAttackHandler, and AttackFormSubmission should be renamed to FormSubmission with BasicAttachHandler included by default in the set of attacks. (As part of this, the distinction between fuzzers and attacks can be eliminated in Crawler; a fuzzer *is* an attack, and the artificial distinction is confusing. Note that this will be an incompatible change, because the distinction is exposed in test cases. But it's still the right thing to do.)
or cancel

These two classes are an embarrassment of duplicated code. The default fuzzing strategy implemented in FormSubmission should be implemented as (say) BasicAttackHandler, and AttackFormSubmission should be renamed to FormSubmission with BasicAttachHandler included by default in the set of attacks.

(As part of this, the distinction between fuzzers and attacks can be eliminated in Crawler; a fuzzer is an attack, and the artificial distinction is confusing. Note that this will be an incompatible change, because the distinction is exposed in test cases. But it's still the right thing to do.)

Comments

glv Fri Sep 04 08:15:26 -0700 2009 | link

Fixed by 837628b

Comment
Fixed by 837628bc9d3f8db0cf76d0c8b27914b8b4973dfd
or cancel

Parsed with GitHub Flavored Markdown
7.

0 votes

techdebt
x

Move link and form processing into Link and AttackFormSubmission classes
1 comment Created 6 months ago by glv

Title

Body
Many of the things we'd like to improve about Tarantula (including #3) would be easier if Tarantula's domain model were smarter. Link and AttackFormSubmission are currently dumb classes; Crawler is responsible for following links as well as doing all the fuzzing and submission of forms. Making Link and AttackFormSubmission smarter is the first step toward unifying links and forms into a single queue, which will make all kinds of fixes and enhancements easier.
or cancel

Many of the things we'd like to improve about Tarantula (including #3) would be easier if Tarantula's domain model were smarter. Link and AttackFormSubmission are currently dumb classes; Crawler is responsible for following links as well as doing all the fuzzing and submission of forms. Making Link and AttackFormSubmission smarter is the first step toward unifying links and forms into a single queue, which will make all kinds of fixes and enhancements easier.

Comments

glv Fri Sep 04 08:14:35 -0700 2009 | link

Fixed by 7feacff

Comment
Fixed by 7feacff0895b1899f87629d791d4bc264a09e35d
or cancel

Parsed with GitHub Flavored Markdown
4.

0 votes

fix
x

rake tarantula:report does not open HTML report when a test fails
1 comment Created 7 months ago by relevance

Title

Body
"rake tarantula:report" only opens the HTML report if all Tarantula tests pass. (When all tests pass, you don’t usually need to look at the report. You really want to see the report when tests are failing.) "rake tarantula:report" should always show the HTML report, regardless of whether the Tarantula tests pass or fail. [original LH ticket](http://relevance.lighthouseapp.com/projects/17868/tickets/11) This ticket has 0 attachment(s).
or cancel

"rake tarantula:report" only opens the HTML report if all Tarantula tests pass. (When all tests pass, you don’t usually need to look at the report. You really want to see the report when tests are failing.)

"rake tarantula:report" should always show the HTML report, regardless of whether the Tarantula tests pass or fail.

original LH ticket

This ticket has 0 attachment(s).

Comments

jasonrudolph Fri May 22 12:33:08 -0700 2009 | link

rake tarantula:report now always open the HTML report even if there are test failures. Closed by 61ab75f.

Comment
rake tarantula:report now always open the HTML report even if there are test failures. Closed by 61ab75f87de4faf8e285ecc307a85e8b56bf7fb4.
or cancel

Parsed with GitHub Flavored Markdown
2.

0 votes

feature
x

Finish Redesign
2 comments Created 7 months ago by relevance

Title

Body
[original LH ticket](http://relevance.lighthouseapp.com/projects/17868/tickets/10) This ticket has 0 attachment(s).
or cancel
original LH ticket

This ticket has 0 attachment(s).

Comments
relevance Sun May 17 07:19:30 -0700 2009 | link

Finish Redesign

Implementation started in commit 0ea9d8b.

http://github.com/relevance/tarantula/commit/0ea9d8bd44beaabefefd6d82f280c62b6f4a87c5

A few cleanup items remain before closing out this ticket.

by Jason Rudolph

Comment
**Finish Redesign** Implementation started in commit 0ea9d8b. http://github.com/relevance/tarantula/commit/0ea9d8bd44beaabefefd6d82f280c62b6f4a87c5 A few cleanup items remain before closing out this ticket. by Jason Rudolph
or cancel
jasonrudolph Fri May 29 09:06:55 -0700 2009 | link
Finish redesign. Closed by 598c1d8.

Replace use of images for buttons. Use vanilla CSS styling instead.

Remove obsolete button image files and update gemspec accordingly.

Fix problem where long test names exceed button width.

Decided to always show the test result body and log (instead of using JavaScript to hide/show these sections).
Comment
Finish redesign. Closed by 598c1d8cba32b147fbe47bf4dc230ff99a08acdb. - Replace use of images for buttons. Use vanilla CSS styling instead. - Remove obsolete button image files and update gemspec accordingly. - Fix problem where long test names exceed button width. - Decided to always show the test result body and log (instead of using JavaScript to hide/show these sections).
or cancel
Parsed with GitHub Flavored Markdown
1.

0 votes

fix
x

Dependency issue starting with new rails project
4 comments Created 7 months ago by relevance

Title

Body
After following the instructions on the the github page I could not get it to run on a new rails app. here is what I tried $ rails spider-app (i am using 2.3.2 for this) $ gem install relevance-tarantula—source http://gems.github.com added this to my test.rb at the bottom config.gem ‘relevance-tarantula’, :source => “http://gems.github.com”, :lib => ‘relevance/tarantula’ $ mkdir -p vendor/gems $ cd vendor/gems $ sudo gem unpack relevance-tarantula added this to the bottom of the rake file load File.join(RAILS_ROOT, Dir[“vendor/gems/relevance-tarantula-/tasks/.rake”]) $ rake tarantula:setup $ rake tarantula:test then I get this error: ... /Users/Tony/.gem/ruby/1.8/gems/rake-0.8.3/lib/rake/rake_test_loader.rb:5:in `each’ /Users/Tony/.gem/ruby/1.8/gems/rake-0.8.3/lib/rake/rake_test_loader.rb:5 Missing these required gems: relevance-tarantula You’re running: ruby 1.8.6.114 at /System/Library/Frameworks/Ruby.framework/Versions/1.8/usr/bin/ruby rubygems 1.3.1 at /Users/Tony/.gem/ruby/1.8, /Library/Ruby/Gems/1.8, /System/Library/Frameworks/Ruby.framework/Versions/1.8/usr/lib/ruby/gems/1.8 Run `rake gems:install` to install the missing gems. rake aborted! Command failed with status (1): [/System/Library/Frameworks/Ruby.framework/...] I can see the gem installed both in vendor and locally when I do a gem list -l tarantula. [original LH ticket](http://relevance.lighthouseapp.com/projects/17868/tickets/17) This ticket has 0 attachment(s).
or cancel
After following the instructions on the the github page I could not get it to run on a new rails app.

here is what I tried

$ rails spider-app (i am using 2.3.2 for this) $ gem install relevance-tarantula—source http://gems.github.com

added this to my test.rb at the bottom config.gem ‘relevance-tarantula’, :source => “http://gems.github.com”, :lib => ‘relevance/tarantula’

$ mkdir -p vendor/gems $ cd vendor/gems $ sudo gem unpack relevance-tarantula

added this to the bottom of the rake file load File.join(RAILS_ROOT, Dir[“vendor/gems/relevance-tarantula-/tasks/.rake”])

$ rake tarantula:setup $ rake tarantula:test

then I get this error: ... /Users/Tony/.gem/ruby/1.8/gems/rake-0.8.3/lib/rake/rake_test_loader.rb:5:in `each’ /Users/Tony/.gem/ruby/1.8/gems/rake-0.8.3/lib/rake/rake_test_loader.rb:5 Missing these required gems: relevance-tarantula

You’re running: ruby 1.8.6.114 at /System/Library/Frameworks/Ruby.framework/Versions/1.8/usr/bin/ruby rubygems 1.3.1 at /Users/Tony/.gem/ruby/1.8, /Library/Ruby/Gems/1.8, /System/Library/Frameworks/Ruby.framework/Versions/1.8/usr/lib/ruby/gems/1.8

Run rake gems:install to install the missing gems. rake aborted! Command failed with status (1): [/System/Library/Frameworks/Ruby.framework/...]

I can see the gem installed both in vendor and locally when I do a gem list -l tarantula.

original LH ticket

This ticket has 0 attachment(s).

Comments
relevance Sun May 17 07:19:22 -0700 2009 | link

Dependency issue starting with new rails project

I dug a little deeper and found out that the missing required gem was htmlentities.

I just needed to look at the top of the stack instead of the one at the bottom.

no such file to load -- htmlentities
/Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:in gem_original_require’ /Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:inrequire’ /Library/Ruby/Gems/1.8/gems/activesupport-2.3.2/lib/active_support/dependencies.rb:158:in require’ /Users/Tony/dev/rails/spider/vendor/gems/relevance-tarantula-0.1.7/lib/relevance/tarantula.rb:14 /Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:ingem_original_require’ /Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:in require’ /Library/Ruby/Gems/1.8/gems/activesupport-2.3.2/lib/active_support/dependencies.rb:158:inrequire’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/rails/gem_dependency.rb:179:in load’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:305:inload_gems’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:305:in each’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:305:inload_gems’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:167:in process’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:113:insend’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:113:in run’ /Users/Tony/dev/rails/spider/config/environment.rb:9 ./test/tarantula/../test_helper.rb:2:inrequire’ ./test/tarantula/../test_helper.rb:2 ./test/tarantula/tarantula_test.rb:1:in require’ ./test/tarantula/tarantula_test.rb:1 /Library/Ruby/Gems/1.8/gems/rake-0.8.4/lib/rake/rake_test_loader.rb:5:inload’ /Library/Ruby/Gems/1.8/gems/rake-0.8.4/lib/rake/rake_test_loader.rb:5 /Library/Ruby/Gems/1.8/gems/rake-0.8.4/lib/rake/rake_test_loader.rb:5:in `each’ /Library/Ruby/Gems/1.8/gems/rake-0.8.4/lib/rake/rake_test_loader.rb:5 Missing these required gems:
relevance-tarantula

by Tony Eichelberger

Comment
**Dependency issue starting with new rails project** I dug a little deeper and found out that the missing required gem was htmlentities. I just needed to look at the top of the stack instead of the one at the bottom. no such file to load -- htmlentities /Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:in `gem_original_require’ /Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:in `require’ /Library/Ruby/Gems/1.8/gems/activesupport-2.3.2/lib/active_support/dependencies.rb:158:in `require’ /Users/Tony/dev/rails/spider/vendor/gems/relevance-tarantula-0.1.7/lib/relevance/tarantula.rb:14 /Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:in `gem_original_require’ /Library/Ruby/Site/1.8/rubygems/custom_require.rb:31:in `require’ /Library/Ruby/Gems/1.8/gems/activesupport-2.3.2/lib/active_support/dependencies.rb:158:in `require’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/rails/gem_dependency.rb:179:in `load’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:305:in `load_gems’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:305:in `each’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:305:in `load_gems’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:167:in `process’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:113:in `send’ /Library/Ruby/Gems/1.8/gems/rails-2.3.2/lib/initializer.rb:113:in `run’ /Users/Tony/dev/rails/spider/config/environment.rb:9 ./test/tarantula/../test_helper.rb:2:in `require’ ./test/tarantula/../test_helper.rb:2 ./test/tarantula/tarantula_test.rb:1:in `require’ ./test/tarantula/tarantula_test.rb:1 /Library/Ruby/Gems/1.8/gems/rake-0.8.4/lib/rake/rake_test_loader.rb:5:in `load’ /Library/Ruby/Gems/1.8/gems/rake-0.8.4/lib/rake/rake_test_loader.rb:5 /Library/Ruby/Gems/1.8/gems/rake-0.8.4/lib/rake/rake_test_loader.rb:5:in `each’ /Library/Ruby/Gems/1.8/gems/rake-0.8.4/lib/rake/rake_test_loader.rb:5 Missing these required gems: relevance-tarantula by Tony Eichelberger
or cancel

relevance Sun May 17 07:19:23 -0700 2009 | link

Dependency issue starting with new rails project

Thanks for reporting this issue. We’ll find a clean Linux installation (i.e., with no gems pre-installed) and see if we can recreate this issue. If we’re able to reproduce it, we’ll look into updating Tarantula to properly declare its dependencies.

by Jason Rudolph

Comment
**Dependency issue starting with new rails project** Thanks for reporting this issue. We’ll find a clean Linux installation (i.e., with no gems pre-installed) and see if we can recreate this issue. If we’re able to reproduce it, we’ll look into updating Tarantula to properly declare its dependencies. by Jason Rudolph
or cancel
jasonrudolph Fri May 22 08:55:53 -0700 2009 | link
This issue is caused by the inability for RubyGems to resolve dependencies from Rubyforge when you specifically list GitHub as the source for the installation.

$ gem install relevance-tarantula --source http://gems.github.com WARNING: Installing to ~/.gem since /usr/lib/ruby/gems/1.8 and /usr/bin aren't both writable. ERROR: Error installing relevance-tarantula: relevance-tarantula requires htmlentities (>= 0, runtime)

SOLUTION 1

Install from Rubyforge

$ gem install tarantula WARNING: Installing to ~/.gem since /usr/lib/ruby/gems/1.8 and /usr/bin aren't both writable. Building native extensions. This could take a while... Successfully installed htmlentities-4.0.0 Successfully installed hpricot-0.8.1 Successfully installed tarantula-0.1.8 3 gems installed Installing ri documentation for htmlentities-4.0.0... Installing ri documentation for hpricot-0.8.1... Installing ri documentation for tarantula-0.1.8... Installing RDoc documentation for htmlentities-4.0.0... Installing RDoc documentation for hpricot-0.8.1... Installing RDoc documentation for tarantula-0.1.8...

SOLUTION 2

Add GitHub as a source for your RubyGems installation

$ gem sources -a http://gems.github.com http://gems.github.com added to sources $ gem install relevance-tarantula WARNING: Installing to ~/.gem since /usr/lib/ruby/gems/1.8 and /usr/bin aren't both writable. Building native extensions. This could take a while... Successfully installed htmlentities-4.0.0 Successfully installed hpricot-0.8.1 Successfully installed relevance-tarantula-0.1.8 3 gems installed Installing ri documentation for htmlentities-4.0.0... Installing ri documentation for hpricot-0.8.1... Installing ri documentation for relevance-tarantula-0.1.8... Installing RDoc documentation for htmlentities-4.0.0... Installing RDoc documentation for hpricot-0.8.1... Installing RDoc documentation for relevance-tarantula-0.1.8...
Comment
This issue is caused by the inability for RubyGems to resolve dependencies from Rubyforge when you specifically list GitHub as the source for the installation. $ gem install relevance-tarantula --source http://gems.github.com WARNING: Installing to ~/.gem since /usr/lib/ruby/gems/1.8 and /usr/bin aren't both writable. ERROR: Error installing relevance-tarantula: relevance-tarantula requires htmlentities (>= 0, runtime) ## SOLUTION 1 Install from Rubyforge $ gem install tarantula WARNING: Installing to ~/.gem since /usr/lib/ruby/gems/1.8 and /usr/bin aren't both writable. Building native extensions. This could take a while... Successfully installed htmlentities-4.0.0 Successfully installed hpricot-0.8.1 Successfully installed tarantula-0.1.8 3 gems installed Installing ri documentation for htmlentities-4.0.0... Installing ri documentation for hpricot-0.8.1... Installing ri documentation for tarantula-0.1.8... Installing RDoc documentation for htmlentities-4.0.0... Installing RDoc documentation for hpricot-0.8.1... Installing RDoc documentation for tarantula-0.1.8... ## SOLUTION 2 Add GitHub as a source for your RubyGems installation $ gem sources -a http://gems.github.com http://gems.github.com added to sources $ gem install relevance-tarantula WARNING: Installing to ~/.gem since /usr/lib/ruby/gems/1.8 and /usr/bin aren't both writable. Building native extensions. This could take a while... Successfully installed htmlentities-4.0.0 Successfully installed hpricot-0.8.1 Successfully installed relevance-tarantula-0.1.8 3 gems installed Installing ri documentation for htmlentities-4.0.0... Installing ri documentation for hpricot-0.8.1... Installing ri documentation for relevance-tarantula-0.1.8... Installing RDoc documentation for htmlentities-4.0.0... Installing RDoc documentation for hpricot-0.8.1... Installing RDoc documentation for relevance-tarantula-0.1.8...
or cancel
jasonrudolph Fri May 22 08:57:32 -0700 2009 | link

Update README with better instructions for installing from GitHub. Closed by d492625.

Comment
Update README with better instructions for installing from GitHub. Closed by d492625751989e06f11701acc3045276e0a5f281.
or cancel

Parsed with GitHub Flavored Markdown