1. Johngo学长首页
  2. 技术点详细复盘专题
  3. 大数据

安装ambari

• 大数据 • 阅读 43

安装Mysql

  1. 下载并安装
wget -i -c http://dev.mysql.com/get/mysql57-community-release-el7-10.noarch.rpm
yum -y install mysql57-community-release-el7-10.noarch.rpm
yum -y install mysql-community-server
  1. 启动mysql并查看密码
Systemctl start mysqld
Grep "password" /var/log/mysqld.log
  1. 修改root密码
Alter user user() identified by 'admin123';
  1. 修改my.cnf配置文件

collation_server=utf8_general_ci
character_set_server=utf8
default-storage-engine=INNODB

default_character-set=utf8
  1. 查看字符集
mysql> show variables like 'character_set_%';
+--------------------------+----------------------------+
| Variable_name            | Value                      |
+--------------------------+----------------------------+
| character_set_client     | utf8                       |
| character_set_connection | utf8                       |
| character_set_database   | utf8                       |
| character_set_filesystem | binary                     |
| character_set_results    | utf8                       |
| character_set_server     | utf8                       |
| character_set_system     | utf8                       |
| character_sets_dir       | /usr/share/mysql/charsets/ |
+--------------------------+----------------------------+
8 rows in set (0.00 sec)
  1. 创建ambari数据库及用户及远程登录
mysql> create database ambari character set utf8;
Query OK, 1 row affected (5.00 sec)
mysql> CREATE USER 'ambari'@'%'IDENTIFIED BY 'admin123';
Query OK, 0 rows affected (0.00 sec)
mysql> GRANT ALL PRIVILEGES ON ambari.* TO 'ambari'@'%';
Query OK, 0 rows affected (0.00 sec)
mysql> FLUSH PRIVILEGES;
Query OK, 0 rows affected (0.00 sec)
  1. 创建hive数据库及用户及远程登录
mysql> create database hive character set utf8;
Query OK, 1 row affected (0.00 sec)
mysql> CREATE USER 'hive'@'%'IDENTIFIED BY 'admin123';
Query OK, 0 rows affected (0.00 sec)
mysql> GRANT ALL PRIVILEGES ON hive.* TO 'hive'@'%';
Query OK, 0 rows affected (0.00 sec)
mysql> FLUSH PRIVILEGES;
Query OK, 0 rows affected (0.00 sec)
  1. 创建oozie数据库及用户及远程登录
mysql> create database oozie character set utf8;
Query OK, 1 row affected (0.00 sec)
mysql> CREATE USER 'oozie'@'%'IDENTIFIED BY 'admin123';
Query OK, 0 rows affected (0.00 sec)
mysql> GRANT ALL PRIVILEGES ON oozie.* TO 'oozie'@'%';
Query OK, 0 rows affected (0.00 sec)
mysql> FLUSH PRIVILEGES;
Query OK, 0 rows affected (0.00 sec)
  1. 创建ranger数据库及用户及远程登录
mysql> create database ranger character set utf8;
Query OK, 1 row affected (0.00 sec)
mysql> CREATE USER 'rangeradmin'@'%'IDENTIFIED BY 'admin123';
Query OK, 0 rows affected (0.00 sec)
mysql> GRANT ALL PRIVILEGES ON ranger.* TO 'rangeradmin'@'%';
Query OK, 0 rows affected (0.00 sec)
mysql> FLUSH PRIVILEGES;
Query OK, 0 rows affected (0.00 sec)

安装apache

  1. 安装apache
Yum -y install httpd
  1. 启动
Systemctl start httpd

配置本地yum源

  1. 配置ambari.repo
[root@localhost yum.repos.d]

[ambari-2.7.3.0]

name=ambari Version - ambari-2.7.3.0
baseurl=http://172.16.10.119/ambari/ambari/centos7/2.7.3.0-139
gpgcheck=1
gpgkey=http://172.16.10.119/ambari/ambari/centos7/2.7.3.0-139/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
  1. 配置HDP.repo
[root@localhost yum.repos.d]

[HDP-3.1.0.0]
name=HDP Version - HDP-3.1.0.0
baseurl=http://172.16.10.119/hdp/HDP/centos7
gpgcheck=1
gpgkey=http://172.16.10.119/hdp/HDP/centos7/3.1.0.0-78/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.22
baseurl=http://172.16.10.119/hdp/HDP-UTILS-1.1.0.22
gpgcheck=1
gpgkey=http://172.16.10.119/hdp/HDP-UTILS-1.1.0.22/HDP-UTILS/centos7/1.1.0.22/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

[HDP-GPL-3.1.0.0]
name=HDP-UTILS Version - HDP-GPL-3.1.0.0
baseurl=http://172.16.10.119/hdp/HDP-GPL
gpgcheck=1
gpgkey=http://172.16.10.119/hdp/HDP-GPL/centos7/3.1.0.0-78/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
  1. 创建源目录并解压安装包
Mkdir /var/www/html/ambari
Mkdir /var/www/html/hdp
tar -zxvf ambari-2.7.3.0-centos7.tar.gz -C /var/www/html/ambari/
tar -zxvf HDP-3.1.0.0-centos7-rpm.tar.gz -C /var/www/html/hdp/
tar -zxvf HDP-UTILS-1.1.0.22-centos7.tar.gz -C /var/www/html/hdp/HDP-UTILS-1.1.0.22/
tar -zxf HDP-GPL-3.1.0.0-centos7-gpl.tar.gz -C /var/www/html/hdp/
  1. 生成本地源并创建源数据
createrepo /var/www/html/hdp/HDP/centos7/
createrepo /var/www/html/hdp/HDP-UTILS-1.1.0.22/
createrepo /var/www/html/hdp/HDP-GPL/
  1. 分发repo文件
Scp ambari.repo HDP.repo root@172.16.10.106:/etc/yum.repo.d/
Scp ambari.repo HDP.repo root@172.16.10.107:/etc/yum.repo.d/

配置ssh互信（所有机器都需要执行）

  1. 生成密钥及免密登录
ssh-keygen -t rsa
ssh-copy-id -i root@172.16.10.105
ssh-copy-id -i root@172.16.10.106
ssh-copy-id -i root@172.16.10.107

配置hosts件及主机名(所有服务器都需要执行

  1. 配置host文件
Cat /etc/hosts
172.16.10.119       yum     yum.hdp
172.16.10.105       nd-00   nd-00.hdp
172.16.10.106    nd-01   nd-01.hdp
172.16.10.107 nd-02   nd-02.hdp
  1. 配置主机名
Hostnamectl set-hostname nd-00.hdp

修改network文件（所有机器都需要执行）

cat /etc/sysconfig/network

NETWORKING=yes
HOSTNAME=nd-00.hdp

配置JAVA环境

  1. 解压JDK及配置环境变量
tar -zxf jdk-8u171-linux-x64.tar.gz -C /data/java

tee -a /etc/profile.d/java.sh <<EOF
export JAVA_HOME=/data/java/jdk1.8.0_171
export JRE_HOME=/data/java/jdk1.8.0_171/jre
export PATH=$PATH:/data/java/jdk1.8.0_171/bin
export CLASSPATH=./:/data/java/jdk1.8.0_171/lib:/data/java/jdk1.8.0_171/jre/lib
EOF

Source /etc/profile.d/java.sh

安装ambari-server及初始化（只在master安装）

  1. 下载mysql驱动
mv mysql-connector-java-8.0.5.jar /usr/share/java/mysql-connector-java.jar
  1. 安装ambari
yum -y install ambari-server
  1. 初始化ambari
Ambari-server setup
Using python  /usr/bin/python
Setup ambari-server
Checking SELinux...

SELinux status is 'disabled'
Customize user account for ambari-server daemon [y/n] (n)? y
Enter user account for ambari-server daemon (root):root
Adjusting ambari-server permissions and ownership...

Checking firewall status...

Checking JDK...

[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Custom JDK
==============================================================================
Enter choice (1): 2
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.

WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.

Path to JAVA_HOME: /data/java/jdk1.8.0_171
Validating JDK on Ambari Server...done.

Check JDK version for Ambari Server...

JDK version found: 8
Minimum JDK version is 8 for Ambari. Skipping to setup different JDK for Ambari Server.

Checking GPL software agreement...

GPL License for LZO: https://www.gnu.org/licenses/old-licenses/gpl-2.0.en.html
Enable Ambari Server to download and install GPL Licensed LZO packages [y/n] (n)? y
Completing setup...

Configuring database...

Enter advanced database configuration [y/n] (n)? y
Configuring database...

==============================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL / MariaDB
[4] - PostgreSQL
[5] - Microsoft SQL Server (Tech Preview)
[6] - SQL Anywhere
[7] - BDB
==============================================================================
Enter choice (1): 3
Hostname (localhost): nd-00
Port (3306):
Database name (ambari):
Username (ambari):
Enter Database Password (bigdata):
Re-enter password:
Configuring ambari database...

Should ambari use existing default jdbc /usr/share/java/mysql-connector-java.jar [y/n] (y)? y
Configuring remote database connection properties...

WARNING: Before starting Ambari Server, you must run the following DDL directly from the database shell to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
Proceed with configuring remote database connection properties [y/n] (y)? y
Extracting system views...

ambari-admin-2.7.3.0.139.jar
....

Ambari repo file contains latest json url http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json, updating stacks repoinfos with it...

Adjusting ambari-server permissions and ownership...

Ambari Server 'setup' completed successfully.
  1. 根据提示导入sql文件
Mysql -uambari -p
Use ambari
Source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql;
  1. 启动ambari-server
Ambari-server start

安装ambari

安装ambari-agent（需要在所有的服务器安装）

  1. 安装及启动
Yum -y install ambari-server
Ambari-agent start

访问Ambari web页面

  1. 默认端口8080，Username：admin；Password：admin；http://192.168.121.100:8080
    安装ambari
    安装ambari
  2. 开始安装集群，启用安装向导创建集群
    安装ambari
  3. 配置集群名称
    安装ambari
  4. 选择版本
    安装ambari
  5. 配置节点、密钥
    安装ambari
    安装ambari
  6. 选择大数据组件
    安装ambari
  7. 节点分配
    安装ambari
  8. 分配从属和客户端
    安装ambari
  9. 定制服务
    安装ambari
    安装ambari
ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar

安装ambari
安装ambari
安装ambari
  1. 集群整体概况，点击部署
    安装ambari
    安装ambari
    安装ambari
  2. 等待启动完毕，不用担心警告，后期可以调整，搭建完成，可以在展示页面进行查看集群状态。
    安装ambari
    安装ambari
  3. 可以查看监控界面，可以看到大数据组件中出现错误，单个组件点开处理，由于本次搭建集群使用虚拟机，性能不好，可以少选择一些组件。
    安装ambari

Original: https://blog.csdn.net/qq_34158880/article/details/126119537
Author: JACK-JIE
Title: 安装ambari

原创文章受到原创版权保护。转载请注明出处：https://www.johngo689.com/817655/

转载文章受原作者版权保护。转载请注明原作者出处！

赞 (0)
0

【自取】最近整理的，有需要可以领取学习：



Linux核心资料大放送~

全栈面试题汇总（持续更新&可下载）

一个提高学习100%效率的工具！

【超详细】深度学习面试题目！

LeetCode Python刷题答案下载！

LeetCode Java版刷题答案下载！

LeetCode C++ 版本，抓紧保存！

LeetCode GO语言 刷题答案下载！

大家都在看

亲爱的 Coder【最近整理，可免费获取】👉 最新必读书单  | 👏 面试题下载  | 🌎 免费的AI知识星球