Skip to content

The goal of this project to implement a naive search engine with MapReduce on Apache Hadoop.

Notifications You must be signed in to change notification settings

KerimKochekov/IBD1

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Assignment №1. MapReduce. Simple Text Indexer

User guide

To run Indexer Engine:

$hadoop jar <jar_name>.jar Indexer <path to input directory in HDFS> <path to output directory in HDFS> 
Example: $hadoop jar project3.jar Indexer /EnWikiSmall /indexer_output

To run Query Engine:

$hadoop jar <jar_name>.jar Query <path to output directory of indexer in HDFS> <query text> <number of most relevant docs> 
Example: $hadoop jar project3.jar Query /indexer_output "Big data technologies" 5

About

The goal of this project to implement a naive search engine with MapReduce on Apache Hadoop.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages