centos6.8集群搭建

关机：halt

重启：reboot

修改本机ip：

1	vim /etc/sysconfig/network-scripts/ifcfg-eth0

DEVICE=eth0
HWADDR=00:0C:29:81:D1:F5
TYPE=Ethernet
UUID=2934354a-b8b3-4fcd-9bd4-8bb9142b87ce
ONBOOT=yes
NM_CONTROLLED=yes
BOOTPROTO=static
IPADDR=192.168.2.128
GATEWAY=192.168.2.1
BROADCAST=192.168.2.255
DNS1=8.8.8.8
DNS2=114.114.114.114

修改hosts：

1	vim /etc/hosts

1	192.168.2.128 hadoop100

重启网络服务：

1 2	service NetworkManager stop /etc/init.d/network restart

关闭关机自启：

1	chkconfig NetworkManager off

设置nameserver：

1 2	vim /etc/resolv.conf nameserver 192.168.2.1

配置防火墙：

# 关闭
service iptables stop
# 关闭开机自启
chkconfig iptables off
# 查看防火墙状态
service iptables status

Ubuntu黑屏

netsh winsock reset

修改ip之后需要删除一个文件才能成功

1	rm /etc/udev/rules.d/70-persistent-net.rules

SSH免密登录

生产密钥ssh-keygen -t rsa
私钥发送本机ssh-copy-id localhost
公钥发送其他计算机ssh-copy-id 192.168.2.128

记一次UUID和HWADDR的坑

在虚拟机设置中获取MAC地址00:50:56:25:32:15

在/etc/sysconfig/network-scripts/ifcfg-eth0中添加HWADDR=xxx

使用uuidgen eth0生成UUID，并在/etc/sysconfig/network-scripts/ifcfg-eth0中添加

删除rm -rf /etc/udev/rules.d/70-persistent-net.rules

重启

也可以克隆虚拟机后，直接修改/etc/udev/rules.d/70-persistent-net.rules，将eth1改为eth0，然后复制HWADDR写入/etc/sysconfig/network-scripts/ifcfg-eth0

设置yum阿里镜像

备份

cp /etc/yum.repos.d/CentOS-Base.repo /etc/yum.repos.d/CentOS-Base.repo.backup

配置软件源

# Centos-6
wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-6.repo

# Centos-7
wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-7.repo

生成缓存

yum makecache

集群分发工具

scp
rsync

xsync

#!/bin/bash
#1 获取输入参数个数，若没有参数，直接退出
pcount=$#
if((pcount==0)); then
echo no args;
exit;
fi

#2 获取文件名称
p1=$1
fname=`basename $p1`
echo fname=$fname

#3 获取上级目录的绝对路径
pdir=`cd -P $(dirname $p1); pwd`
echo pdir=$pdir

#4 获取当前用户名称
user=`whoami`

#5 循环
for((host=103; host<105; host++)); do
	echo ----------hadoop$host------------
	rsync -rvl $pdir/$fname $user@hadoop$host:$pdir
done

集群时间同步ntp

Centos6.8安装MySQL5.7

下载 https://dev.mysql.com/downloads/mysql, (wget https://dev.mysql.com/get/Downloads/MySQL-5.7/mysql-5.7.31-linux-glibc2.12-x86_64.tar.gz) 选择对应版本，上传到虚拟机，解压
卸载系统自带MySQLrpm -qa|grep mysql，若存在则yum remove ***
创建用户组和用户

创建用户组groupadd mysql

创建用户useradd -r -g mysql mysql
给MySQL用户指定专有用户和用户组
- 创建data文件夹cd /usr/local/mysql，mkdir data
- 指定用户组和用户cd /usr/local,chown -R mysql mysql/,chgrp -R mysql mysql/
初始化MySQL
- cd /usr/local/mysql/bin,yum -y install numactl
- ./mysqld --initialize --user=mysql --basedir=/usr/local/mysql/ --datadir=/usr/local/mysql/data/ --lc_messages_dir=/usr/local/mysql/share --lc_messages=en_US,记住生成的临时密码T(nUEMv&f2-7
  
  如果忘记密码或者想重新初始化，可以先将mysql/data目录中文件删除，然后再执行初始化命令

配置my.cnf

vim /etc/my.cnf

1
2
3

[mysqld]
basedir=/usr/local/mysql
datadir=/usr/local/mysql/data

启动MySQL

cd /usr/local/mysql/bin

./mysqld_safe --user=mysql &
设置开机自启动

cd /usr/local/mysql/support-files/

cp mysql.server /etc/init.d/mysql

vim /etc/init.d/mysql
1
2
basedir=/usr/local/mysql/
datadir=/usr/local/mysql/data/
授权chmod +x /etc/init.d/mysql

设为开机启动chkconfig --add mysql
启动服务
- 启动service mysql start
- 停止service mysql stop
- 重启service mysql restart
- 查看service mysql status
登录MySQL

cd /usr/local/mysql/bin

./mysql -u root -p

修改密码set password=password("root");

登录授权grant all privileges on *.* to'root' @'%' identified by '123456';

授权生效flush privileges;

Centos6.8安装Redis

下载 http://download.redis.io/releases/redis-5.0.8.tar.gz 解压
进入redis目录，make && make install
将redis安装为系统服务并后台启动

cd /usr/local/redis/utils

./install_server.sh
查看redis服务启动情况systemctl status redis_6379.service

centos6没有systemctl命令，可以使用service —status-all显示所有服务
启动redis客户端
设置允许远程连接
- 编辑redis配置文件vim /etc/redis/6379.conf
- 将bind 127.0.0.1改为0.0.0.0
- 设置访问密码，将#requirepass foobared注释去掉，并将foobared改为密码。使用auth password进行验证
- 重启redis systemctl restart redis_6379.service

Docker部署Redis
- docker pull redis
- `mkdir -p /root/redis/redis01/conf
  mkdir -p /root/redis/redis01/data
  cd /root/redis/redis01/conf
  
  下载一个redis.conf文件
  wget http://download.redis.io/redis-stable/redis.conf
  `
- cd ../ docker run -p 6379:6379 --name hbk_redis -v $PWD/conf/redis.conf:/etc/redis/redis.conf -v $PWD/data:/data -d redis redis-server /etc/redis/redis.conf --appendonly yes
- 修改redis.conf
  1
  2
  3
  4
  5
  6
  7
  8
  9
  10
  # bind 127.0.0.1
  bind 0.0.0.0
  
  # protected-mode yes
  protected no
  
  # requirepass foobared
  requirepass 123456
  
  #daemon 不能是yes

Centos6.8安装RabbitMQ

安装Erlang
- 安装依赖包yum install xmlto gcc gcc-c++ kernel-devel m4 ncurses-devel openssl-devel unixODBC-devel wxBase wxGTK wxGTK-gl perl -y
- Erlang下载yum install -y erlang-19.0.4-1.el6.x86_64.rpm
安装RabbitMQ

curl -s https://packagecloud.io/install/repositories/rabbitmq/erlang/script.rpm .sh | sudo bash

使用Docker部署RabbitMQ(management才有页面)
- docker pull rabbitmq:management
- docker run -d -p 5672:5672 -p 15672:15672 --name rabbitmq rabbitmq:management

Ubuntu18.04更换阿里镜像

查找源配置文件

find / -name sources.list

修改source.list

deb http://mirrors.aliyun.com/ubuntu/ bionic main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ bionic-security main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic-security main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ bionic-updates main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic-updates main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ bionic-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic-backports main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ bionic-proposed main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ bionic-proposed main restricted universe multiverse

sudo apt-get update

设置yum阿里镜像

集群时间同步ntp

Centos6.8安装MySQL5.7

Centos6.8安装Redis

下载一个redis.conf文件

Centos6.8安装RabbitMQ