Hadoop集群部署01-环境准备

环境信息

ubuntu 24.04
jdk1.8.0_202
hadoop-3.2.4
zookeeper-3.8.4
三台服务器部署上面部署zookeeper集群和hadoop集群

配置hosts

root@hadoop1:~# cat /etc/hosts
#
127.0.1.1 localhost.localdomain VM-0-9-ubuntu
127.0.0.1 localhost

::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts

172.21.0.9  hadoop1
172.21.0.11 hadoop2
172.21.0.6  hadoop3

配置ssh免密登陆

key必须使用旧版本的

root@hadoop1:~# ssh-keygen -t rsa -b 2048 -f ~/.ssh/id_rsa -m PEM
Generating public/private rsa key pair.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_rsa
Your public key has been saved in /root/.ssh/id_rsa.pub
The key fingerprint is:
SHA256:sX0tNtBXQ7bqt5NKLG58yVcEWI92+t/3nS+cKVYJ0gQ root@hadoop1
The key's randomart image is:
+---[RSA 2048]----+
|          E. oo+.|
|           .o o+o|
|        . .o. +oo|
|         +..o+.o.|
|        S ..=ooo |
|           oooo..|
|          ...*.++|
|          .o=+*+B|
|          .o.oo+@|
+----[SHA256]-----+

将/root/.ssh/id_rsa.pub的内容添加到每台机器的/root/.ssh/authorized_keys中。
将/root/.ssh/id_rsa/root/.ssh中

#确保密钥权限
chmod 600 /root/.ssh/*

java环境

#解压jdk和maven
tar xvf jdk-8u202-linux-x64.tar.gz -C /usr/local/
tar xvf apache-maven-3.8.6-bin.tar.gz -C /usr/local/

#环境变量配置
tee /etc/profile.d/javaENV.sh <<-'EOF'
export MAVEN_HOME=/usr/local/apache-maven-3.8.6
export JAVA_HOME=/usr/local/jdk1.8.0_202

export PATH="$PATH:$JAVA_HOME/bin"
export PATH="$PATH:$MAVEN_HOME/bin"

export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export JRE_HOME=$JAVA_HOME/jre

EOF

#测试版本信息
source /etc/profile
java -version
mvn --version