Skip to content

lehoso/HadoopDemo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

注意事项

hdfsdemo通过HDFS上传下载文件

HDFS_CRUD

windows环境下需要使用uitls.exe

可从github下载,并且要设置环境变量 HADOOP_HOME=Location 【安装解压的位置】 PATH添加:%HADOOP_HOME%\bin 和 %HADOOP_HOME%\sbin

Hadoop集群是3.3,建议pom.xml的hadoop依赖包也是3.3

MapReduce单词统计

mapred-default.xml mapred-site.xml 调优化调参

MapReduce 倒排索引

InvertedIndex

MapReduce 数据去重

Dedup

ZookeeperTest

zookeeper API 使用java

About

Java操作Hadoop练习

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages