Skip to content

This repository was created on June 9, 2022. At that stage, I have benn learning Hadoop. In order to better record my learning process, I set up this repository.

Notifications You must be signed in to change notification settings

JunXie-ZH/Hadoop_Java_study

Repository files navigation

Hadoop_Java_study

This repository was created on June 9, 2022. At that stage, I have been learning Hadoop. In order to better record my learning process, I set up this repository.

这个项目记录了我学习hadoop的主要内容,我依照时间顺序进行了记录。

1 在docker上配置hadoop集群

具体见文件夹Docker_Hadoop

首先我查看了hadoop的一些教程,第一个就看到了菜鸟教程

https://www.runoob.com/w3cnote/hadoop-setup.html

该教程中描述:

Docker 是一个容器管理系统,它可以向虚拟机一样运行多个"虚拟机"(容器),并构成一个集群。因为虚拟机会完整的虚拟出一个计算机来,所以会消耗大量的硬件资源且效率低下,而 Docker 仅提供一个独立的、可复制的运行环境,实际上容器中所有进程依然在主机上的内核中被执行,因此它的效率几乎和主机上的进程一样(接近100%)。

感觉所有教程都认为自己是最好的,现阶段我确实还搞不懂这是否是最适合我的一种学习环境,但我采用了这种方式。当我学有所成时,会回来评价下该方式。

2 HDFS

About

This repository was created on June 9, 2022. At that stage, I have benn learning Hadoop. In order to better record my learning process, I set up this repository.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages