Skip to content

Commit

Permalink
+ gemsearch indexes
Browse files Browse the repository at this point in the history
  • Loading branch information
floere committed Feb 18, 2011
1 parent a987668 commit a32ccf4
Show file tree
Hide file tree
Showing 71 changed files with 572,414 additions and 387,735 deletions.
41,117 changes: 20,519 additions & 20,598 deletions client/data/gems.csv

Large diffs are not rendered by default.

6 changes: 4 additions & 2 deletions client/gem.rb
Original file line number Diff line number Diff line change
Expand Up @@ -27,10 +27,11 @@ def self.find ids, _ = {}

attr_reader :id

def initialize id, name, versions, authors, dependencies
def initialize id, name, versions, authors, dependencies, summary
@id, @name, @versions = id, name, versions
@authors = authors.split(/\|/).join(', ')
@dependencies = dependencies.split(/\|/).join(', ')
@summary = summary
end

# "Rendering" ;)
Expand All @@ -40,7 +41,8 @@ def initialize id, name, versions, authors, dependencies
def to_s
dependencies = "<p class='dependencies'>#{@dependencies}</p>" if @dependencies && !@dependencies.empty?
authors = "<p class='authors'>☺ #{@authors}</p>" if @authors && !@authors.empty?
"<div class='gem'><p><a href='http://rubygems.org/gems/#{@name}'>#{@name}</a></p>#{dependencies}#{authors}</div>"
summary = "<p class='summary'>#{@summary}</p>"
"<div class='gem'><p><a href='http://rubygems.org/gems/#{@name}'>#{@name}</a><p>#{summary}<p></p>#{dependencies}#{authors}</div>"
end

end
1 change: 1 addition & 0 deletions server/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
log/*.log
11 changes: 7 additions & 4 deletions server/app/application.rb
Original file line number Diff line number Diff line change
Expand Up @@ -11,14 +11,14 @@ class PickySearch < Application
# Indexing: How text is indexed.
#
default_indexing removes_characters: /[^a-zA-Z0-9\s\/\_\-\"\&\|\.]/, # whitelist
stopwords: /\b(and|the|of|it|in|for)\b/,
stopwords: /\b(and|the|of|a|on|at|it|in|for|to)\b/,
splits_text_on: /[\s\/\_\-\"\&\|]/,
substitutes_characters_with: CharacterSubstituters::WestEuropean.new # Normalizes special user input, Ä -> Ae, ñ -> n etc.

# Querying: How query text is handled.
#
default_querying removes_characters: /[^äöüáéíóúàèßa-zA-Z0-9\s\/\-\_\,\&\.\"\~\*\:]/, # Picky needs control chars *"~: to pass through.
stopwords: /\b(and|the|of|it|in|for)\b/,
stopwords: /\b(and|the|of|a|on|at|it|in|for)\b/,
splits_text_on: /[\s\/\-\_\,\&]+/,

maximum_tokens: 5, # Amount of tokens passing into a query (5 = default).
Expand All @@ -27,7 +27,7 @@ class PickySearch < Application
# Define an index. Use a database etc. source?
# See http://github.com/floere/picky/wiki/Sources-Configuration#sources
#
gems_index = index :gems, Sources::CSV.new(:name, :versions, :author, :dependencies, file: 'data/gems.csv')
gems_index = index :gems, Sources::CSV.new(:name, :versions, :author, :dependencies, :summary, file: 'data/gems.csv')
gems_index.define_category :name,
similarity: Similarity::Phonetic.new(2),
partial: Partial::Substring.new(from: 1),
Expand All @@ -47,8 +47,11 @@ class PickySearch < Application
similarity: Similarity::Phonetic.new(2),
partial: Partial::Substring.new(from: 1),
qualifiers: [:dependency, :dependencies, :depends, :using, :uses, :use, :needs]

gems_index.define_category :summary,
partial: Partial::None.new

options = { :weights => { [:name] => +1 } }
options = { :weights => { [:name] => +1, [:summary] => -2 } }

full_gems = Query::Full.new gems_index, options
live_gems = Query::Live.new gems_index, options
Expand Down
41,117 changes: 20,519 additions & 20,598 deletions server/data/gems.csv

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion server/index/development/gems/author_exact_index.json

Large diffs are not rendered by default.

Binary file modified server/index/development/gems/author_exact_similarity.dump
Binary file not shown.
2 changes: 1 addition & 1 deletion server/index/development/gems/author_exact_weights.json

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion server/index/development/gems/author_partial_index.json

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion server/index/development/gems/author_partial_weights.json

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Binary file modified server/index/development/gems/dependencies_exact_similarity.dump
Binary file not shown.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion server/index/development/gems/name_exact_index.json

Large diffs are not rendered by default.

Binary file modified server/index/development/gems/name_exact_similarity.dump
Binary file not shown.
2 changes: 1 addition & 1 deletion server/index/development/gems/name_exact_weights.json

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion server/index/development/gems/name_partial_index.json

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion server/index/development/gems/name_partial_weights.json

Large diffs are not rendered by default.

Loading

0 comments on commit a32ccf4

Please sign in to comment.