详细部署文档见D:\Blog\source_posts\Clickhouse集群部署\下的word文档
ROOT部署
| 一: 安装docker和docker-compose | ||||
|---|---|---|---|---|
| 服务器 | 操作用户 | 序列 | 步骤 | 操作命令 |
| 168.130.7.11 (APP1) 168.130.7.12 (APP2) 168.130.7.13 (DB1) 168.130.7.14 (DB2) 168.130.7.15 (CP1) 168.130.7.16 (CP2) | root | 1 | 准备工作:hylc.zip | 上传 hylc.zip 到 /home/hybrisk 目录 |
| cd /home/hybrisk | ||||
| unzip hylc.zip | ||||
| cd hylc | ||||
| mv docker_deploy ../ | ||||
| cd ../docker_deploy/1.docker-setup | ||||
| 2 | 安装docker和docker-compose | tar -zxf docker-20.10.11.tgz | ||
| cp docker/* /usr/local/bin/ | ||||
| cp docker-compose-Linux-x86_64 /usr/local/bin/docker-compose | ||||
| chmod +x /usr/local/bin/docker-compose | ||||
| 3 | 新建docker配置文件 | mkdir -p /etc/docker/ | ||
| 创建配置文件1 | vi /etc/docker/daemon.json | |||
| 填写文件内容（6行） | { “registry-mirrors”: [ “https://registry.docker-cn.com" ], “data-root”: “/home/hybrisk/docker” } | |||
| 创建配置文件2 | vi /usr/lib/systemd/system/docker.service | |||
| 填写文件内容（23行） | [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network-online.target firewalld.service Wants=network-online.target [Service] Type=notify ExecStart=/usr/local/bin/dockerd ExecReload=/bin/kill -s HUP $MAINPID LimitNOFILE=infinity LimitNPROC=infinity TimeoutStartSec=0 Delegate=yes KillMode=process Restart=on-failure StartLimitBurst=3 StartLimitInterval=60s [Install] WantedBy=multi-user.target | |||
| 4 | 加载并启动docker | systemctl daemon-reload | ||
| systemctl enable docker | ||||
| systemctl start docker | ||||
| 5 | 把hybrisk加入docker用户组，并对相应的文件赋权 | groupadd docker | ||
| usermod -aG docker hybrisk | ||||
| systemctl daemon-reload | ||||
| systemctl restart docker | ||||
| chown -R hybrisk:docker /home/hybrisk/docker | ||||
| chown -R hybrisk:docker /usr/local/bin/containerd /usr/local/bin/docker /usr/local/bin/ctr /usr/local/bin/runc | ||||
| chown -R hybrisk:docker /etc/docker/daemon.json | ||||
| chown -R hybrisk:docker /usr/lib/systemd/system/docker.service | ||||
| cd /home/hybrisk | ||||
| chown -R hybrisk:hybrisk docker_deploy | ||||
| chown -R hybrisk:hybrisk hylc hylc.zip |
| 二: 安装ClickHouse | ||||
|---|---|---|---|---|
| 服务器 | 用户 | 序列 | 描述 | 操作步骤 |
| 168.130.7.13(DB1) 168.130.7.14(DB2) 168.130.7.16(CP2) | root | 1 | 确认clickhouse用户已经创建 确认clickhouse数据目录 如果没有，需要运维团队确认 | ls /home/clickhouse |
| ls /home/clickhouse/data | ||||
| 2 | 准备工作:installs.zip | 上传ClickHouse安装文件installs.zip 到 /home/clickhouse/data 目录 | ||
| cd /home/clickhouse/data | ||||
| unzip installs.zip | ||||
| cd installs | ||||
| 3 | 解压安装包 | tar -zxf clickhouse-client-22.3.6.5-amd64.tgz | ||
| tar -zxf clickhouse-common-static-22.3.6.5-amd64.tgz | ||||
| tar -zxf clickhouse-server-22.3.6.5-amd64.tgz | ||||
| 4 | 安装公共包 | ./clickhouse-common-static-22.3.6.5/install/doinst.sh | ||
| 5 | 安装服务端 | ./clickhouse-server-22.3.6.5/install/doinst.sh 输入hybrisk 输入N | ||
| 6 | 安装客户端 | ./clickhouse-client-22.3.6.5/install/doinst.sh | ||
| 7 | 如果防火墙开启，增加端口配置 | systemctl status firewalld 确认返回： Active: active(running)。 如返回内容中包含 Active: inactive (dead)，则表示服务器没有开启防火墙，可以直接跳到第9步 | ||
| firewall-cmd –add-port=8123/tcp –permanent | ||||
| firewall-cmd –add-port=9000/tcp –permanent | ||||
| firewall-cmd –add-port=9004/tcp –permanent | ||||
| firewall-cmd –reload | ||||
| 8 | 创建数据挂载目录 (根据实际硬盘挂载目录再调整) | mkdir -p /home/clickhouse/data/ck1 | ||
| 9 | 给目录赋权 | chown clickhouse:clickhouse -R /home/clickhouse/data/ck1 | ||
| 10 | 配置目录属主赋予clickhouse用户 | chown clickhouse:clickhouse -R /etc/clickhouse-server | ||
| chown clickhouse:clickhouse -R /etc/clickhouse-client | ||||
| chown clickhouse:clickhouse -R /home/clickhouse/data | ||||
| root | 11 | 备份工具安装： clickhouse-backup | cd /home/clickhouse/data/installs | |
| tar -xf clickhouse-backup.tar | ||||
| cd clickhouse-backup | ||||
| cp clickhouse-backup /usr/local/bin/ | ||||
| chown clickhouse:clickhouse -R /usr/local/bin/clickhouse-backup | ||||
| chown clickhouse:clickhouse -R /home/clickhouse/data |
应用部署
| 一: 启动ClickHouse | ||||
|---|---|---|---|---|
| 服务器 | 用户 | 序列 | 描述 | 操作步骤 |
| 168.130.7.13(DB1) 168.130.7.14(DB2) 168.130.7.16(CP2) | clickhouse | 1 | 创建默认配置文件备份目录 | mkdir /etc/clickhouse-server/bk |
| 2 | 移除默认配置文件 | chmod -R 775 /etc/clickhouse-server/ | ||
| mv /etc/clickhouse-server/* /etc/clickhouse-server/bk | ||||
| 3 | 上传配置文件/13/* | cd /etc/clickhouse-server | ||
| 中转机下载13.zip | ||||
| unzip 13.zip | ||||
| cd 13 | ||||
| mv * ../ | ||||
| chmod -R 755 /etc/clickhouse-server/ | ||||
| 4 | 上传配置文件/14/* | cd /etc/clickhouse-server | ||
| 中转机下载14.zip | ||||
| unzip 14.zip | ||||
| cd 14 | ||||
| mv * ../ | ||||
| chmod -R 755 /etc/clickhouse-server/ | ||||
| 5 | 上传配置文件/16/* | cd /etc/clickhouse-server | ||
| 中转机下载16.zip | ||||
| unzip 16.zip | ||||
| cd 16 | ||||
| mv * ../ | ||||
| chmod -R 755 /etc/clickhouse-server/ | ||||
| 7 | 手动创建日志目录 | mkdir /home/clickhouse/data/log | ||
| 8 | 压缩备份脚本 | cd /etc/clickhouse-server | ||
| zip -r bk.zip bk | ||||
| rm -rf bk | ||||
| 9 | 启动clickhouse | clickhouse start |
| 二: ClickHouse 导入数据 | |||||
|---|---|---|---|---|---|
| 服务器 | 用户 | 序列 | 描述 | 操作步骤 | |
| 168.130.7.16(CP2) | clickhouse | 1 | 创建备份目录(表结构) | mkdir /var/lib/clickhouse/backup | |
| mkdir /home/clickhouse/data/ck1/backup | |||||
| 2 | 上传 ch_bk_yyyymmdd.table.zip | 上传至 /var/lib/clickhouse/backup 目录 | |||
| 上传 ch_bk_yyyymmdd.data.zip | 上传至 /home/clickhouse/data/ck1/backup 目录 | ||||
| 3 | 上传三份配置文件到备份目录 config_13.xml, config_14.xml, config_15,xml | 上传至 /var/lib/clickhouse/backup | 一台服务器执行 | ||
| 4 | 登录客户端 | clickhouse-client -h 127.0.0.1 -u cebrisk –password | |||
| 5 | 创建数据库 | create database chdb on cluster jxshares; | |||
| 6 | 退出客户端 | exit | |||
| 7 | 导入表结构及数据 | clickhouse-backup restore -c /var/lib/clickhouse/backup/config_13.yml -s ch_bk_yyyymmdd | |||
| clickhouse-backup restore -c /var/lib/clickhouse/backup/config_14.yml -s ch_bk_yyyymmdd | |||||
| clickhouse-backup restore -c /var/lib/clickhouse/backup/config_16.yml ch_bk_yyyymmdd |
| 三: 导入MySQL数据 | |||||
|---|---|---|---|---|---|
| 服务器 | 用户 | 序列 | 描述 | 操作步骤 | |
| 168.130.7.13 (DB1) | mysql | 1 | 导入数据 | 项目组提供数据文件，由行方数据库运维人员导入 | 完成 |
| mysql -u hybrisk -p | |||||
| use hybrisk | |||||
| source /备份脚本路径/xxx.sql |
| 四: 安装应用 | ||||
|---|---|---|---|---|
| 服务器 | 用户 | 序列 | 描述 | 操作步骤 |
| 168.130.7.11(APP1) 168.130.7.12(APP2) | hybrisk | 1 | 上传文件 docker_deploy_xx.zip | 上传至 /home/hybrisk/ 目录 |
| 2 | 放置安装文件 | mkdir /home/hybrisk/tmp | ||
| mv docker_deploy_xx.zip /home/hybrisk/tmp/ | ||||
| cd /home/hybrisk/tmp/ | ||||
| unzip docker_deploy_xx.zip | ||||
| cd docker_deploy | ||||
| mv * /home/hybrisk/docker_deploy | ||||
| 3 | 进镜像目录 | cd /home/hybrisk/docker_deploy/images | ||
| 4 | 加载Nginx镜像 | docker load < prmnginx.tar | ||
| 5 | 加载金融算法镜像 | docker load < fin_server_1.2.0.tar | ||
| 6 | docker load < fin_jupyter_1.0.0.tar | |||
| 7 | docker load < jxhub_1.0.0.tar | |||
| 8 | 加载jdk镜像 | docker load < openjdk_8u292-jdk_GMT8_1.0.tar | ||
| docker load < jxhub_1.0.0.tar |
| 五: 安装应用 | ||||
|---|---|---|---|---|
| 服务器 | 用户 | 序列 | 描述 | 操作步骤 |
| 168.130.7.15(CP1) 168.130.7.16(CP2) | hybrisk | 1 | 上传文件 docker_deploy_xx.zip | 上传至 /home/hybrisk/ 目录 |
| 2 | 放置安装文件 | mkdir /home/hybrisk/tmp | ||
| mv docker_deploy_xx.zip /home/hybrisk/tmp/ | ||||
| cd /home/hybrisk/tmp/ | ||||
| unzip docker_deploy_xx.zip | ||||
| cd docker_deploy | ||||
| mv * /home/hybrisk/docker_deploy | ||||
| 3 | 进镜像目录 | cd /home/hybrisk/docker_deploy/images | ||
| 7 | 加载jdk镜像 | docker load < openjdk_8u292-jdk_GMT8_1.0.tar | ||
| 六: 启动应用 | ||||
| 服务器 | 用户 | 序列 | 描述 | 操作步骤 |
| 168.130.7.11(APP1) 168.130.7.12(APP2) 168.130.7.15(CP1) 168.130.7.16(CP2) | hybrisk | 1 | 登录启动目录 | cd /home/hybrisk/docker_deploy/dc-start |
| 2 | 启动所有应用 | docker-compose up -d | ||
| 3 | 停止所有应用 | docker-compose down | ||
| 4 | 重启某个应用 | docker-compose restart 某应用 | ||
| 七: 验证 | ||||
| 服务器 | 用户 | 序列 | 描述 | 操作步骤 |
| 办公终端 | 1 | 绩效归因服务 | http://168.130.7.17/hxbweb/ | |
| 2 | 绩效归因中台 | http://168.130.7.17/dpweb/ | ||
| 堡垒机/跳板机 | 3 | 注册中心 | http://168.130.7.11:8761 | |
| 4 | 金融算法开发平台 | http://168.130.7.11:8001 | ||
| 5 | MySQL连接 | 168.130.7.18:3306/dbrisk | ||
| 6 | ClickHouse连接(dbeaver) | 168.130.7.19:8123/chdb |
验证
