Web Search Engine Homework

Project API

1. Brower to QueryHandler API
   1. the url should be /suggest?query=sth&type=term or phrase, phrase means requesting phrases, term means requesting for single words.
   2. QueryHandler creates a ranker and call ranker.SuggestQuery(String partial_query, String type).
   

Instructions

1. Compile
   at root directory of this repository(i.e. directory that consists folders lib, src and data)
   $ javac -cp lib/jsoup-1.8.1.jar src/edu/nyu/cs/cs2580/*.java
   
2. Document Qualitiy Computation
   at the same directory
   
   
   Mining Mode
   $ java -cp src edu.nyu.cs.cs2580.SearchEngine --mode=mining --options=conf/engine.conf
   
   
   Indexing mode
   $ java -cp src:lib/jsoup-1.8.1.jar edu.nyu.cs.cs2580.SearchEngine --mode=index --options=conf/engine.conf
   
   
   Serving mode
   $ java -cp src:lib/jsoup-1.8.1.jar edu.nyu.cs.cs2580.SearchEngine --mode=serve --options=conf/engine.conf --port=25813
   
   
3. Spearman coefficient
   $ java -cp src edu.nyu.cs.cs2580.Spearman data/index/pagerank.idx data/index/numviews.idx
   

Project Report Requirement

• Motivation & Related Works
  • • What problem are you solving?
  • • What assumptions are you making?
  • • What does the system do?
  • • What papers and/or systems have you looked at?
• Design & Architecture
  • • How did you arrive at your final design? What other alternatives were considered?
  • • What are the major components of your system?
• Implementation
  • • Details of each individual components, e.g., algorithms, APIs, etc.
  • • Include how to run your code
• Evaluation:
  • • Quality and/or performance
  • • Dataset (both corpora and queries) used for evaluation
  • • Baseline approaches compared against
  • • Effects of changing various parameters