OceanBase在線擴(kuò)容縮容

IT那活兒發(fā)布于2023-01-11 13:20 / 3510人閱讀

一. 基本概述

現(xiàn)有集群 1-1-1架構(gòu),每個(gè)zone里面只有一個(gè)observer

擴(kuò)容后2-2-2，每個(gè)zone里面有兩個(gè)observer

二. observer服務(wù)器準(zhǔn)備

配置建議和原集群中的observer一模一樣

1. 所有主機(jī)配置主機(jī)名及/etc/hosts

hostnamectl set-hostname ob5
hostnamectl set-hostname ob6
hostnamectl set-hostname ob7

配置/etc/hosts文件
192.168.8.147  ob5
192.168.8.148  ob6
192.168.8.149   ob7

2. 所有主機(jī)關(guān)閉防火墻與selinux

1) 關(guān)閉防火墻,并開(kāi)機(jī)禁用
systemctl stop firewalld.service
systemctl disable firewalld.service
systemctl status firewalld.service
2) 禁用selinux
sed -i s@SELINUX=enforcing@SELINUX=disabled@g /etc/selinux/config
grep "^SELINUX=" /etc/selinux/config
3) 重啟
reboot
4) 檢查
systemctl status firewalld.service
iptables -L
getenforce

3. 所有主機(jī)配置NTP

vi /etc/ntp.conf

注釋文件中的以下4行
#server 0.centos.pool.ntp.org iburst
#server 1.centos.pool.ntp.org iburst
#server 2.centos.pool.ntp.org iburst
#server 3.centos.pool.ntp.org iburst

在末行添加NTP服務(wù)器IP地址，我這里是本地NTP服務(wù)器,就使用OCP主機(jī)最為時(shí)鐘源
server 192.168.8.130

重啟NTP服務(wù)，預(yù)計(jì)5~10分鐘就會(huì)同步，可手動(dòng)拉同步
systemctl restart ntpd.service
ntpq -p

--檢查時(shí)間誤差
clockdiff 192.168.8.130

4. 允許root SSH

vi /etc/ssh/sshd_config
注釋
#PermitRootLogin no
systemctl restart sshd.service

5. 關(guān)閉numa

判斷系統(tǒng)是否開(kāi)啟了numa 功能
grep -i numa /var/log/dmesg
如果出現(xiàn)了："No NUMA configuration found" ，則證明是關(guān)閉了numa 功能，如果是其他內(nèi)容，則為開(kāi)啟了numa

--關(guān)閉numa
vi /etc/default/grub
在 GRUB_CMDLINE_LINUX 參數(shù)的末尾增加 ：numa=off


[root@ob6 clonescripts]# vi /etc/default/grub
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="$(sed s, release .*$,,g /etc/system-release)"
GRUB_DEFAULT=saved
GRUB_DISABLE_SUBMENU=true
GRUB_TERMINAL_OUTPUT="console"
GRUB_CMDLINE_LINUX="crashkernel=auto rd.lvm.lv=vg0/lv_root rd.lvm.lv=vg0/lv_swap rhgb quiet numa=off elevator=deadline numa=off"
GRUB_DISABLE_RECOVERY="true"

--重建grub 配置文件
grub2-mkconfig -o /boot/grub2/grub.cfg
--重啟操作系統(tǒng)
reboot

三. 部署Observer

使用自動(dòng)化部署工具部署Observer

1.安裝自動(dòng)化部署工具

rpm –ivh t-oceanbase-antman-1.3.6-1919351.alios7.x86_64.rpm
cd /root/t-oceanbase-antman/clonescripts
./clone.sh –h 獲取幫助

2. 添加admin用戶

./clone.sh –u

3. 修改屬主屬組

chown admin:admin -R /data/1
chown admin:admin -R /data/log1

4. 對(duì)每臺(tái)服務(wù)器的操作系統(tǒng)內(nèi)核進(jìn)行設(shè)置

cd /root/t-oceanbase-antman/clonescripts
./clone.sh -r ob –c

5. 安裝依賴包

cd /root/t-oceanbase-antman/clonescripts
./clone.sh -r ob –m

6. 部署前環(huán)境檢查

統(tǒng)一檢查腳本

cd /root/t-oceanbase-antman/clonescripts
./clone.sh –t

也可以使用如下檢查方法：

sh precheck.sh –m ob          ob主機(jī)使用

關(guān)注failed項(xiàng)，處理好后繼續(xù)檢查，直到所有的檢查項(xiàng)都通過(guò)。

四. 在OCP擴(kuò)容

1. 添加主機(jī)

直到新添加的observer的狀態(tài)為空閑。

2. 添加observer

3. 注意事項(xiàng)

添加遇到問(wèn)題，日志如下：


2021-03-10 10:43:20.703  INFO 67 --- [ task-2,0abda3d4bc1b4206,14188bec0edd] c.a.o.c.metadb.task.TaskInstanceEntity : task 35868 run with context Context(parallelIdx=-1, stringMap={cluster_name=cluster, cluster_id=2, service_type=OB_CLUSTER, rpm_name=oceanbase-2.2.73-20201117154111.el7.x86_64.rpm, service_name=cluster:1, target_operate_status=NORMAL, zone_name=zone3, server_port=2882, service_version=2.2.73, ob_cluster_id=1}, listMap={root_server_ips=[192.168.8.132, 192.168.8.131, 192.168.8.133], host_ids=[8], server_ips=[192.168.8.147]})

2021-03-10 10:43:20.705  INFO 67 --- [ task-2,0abda3d4bc1b4206,14188bec0edd] c.a.o.c.metadb.task.TaskInstanceEntity : executor node ip:192.168.8.130

2021-03-10 10:43:20.707 ERROR 67 --- [ task-2,0abda3d4bc1b4206,14188bec0edd] com.alipay.ocp.core.util.ExceptionUtils : Checked Exception: com.alipay.ocp.core.exception.IllegalArgumentException occurred with code error.file.meta.not.found, and args [sys-package, oceanbase-2.2.73-20201117154111.el7.x86_64.rpm]

2021-03-10 10:43:20.710 ERROR 67 --- [ task-2,0abda3d4bc1b4206,14188bec0edd] c.a.o.core.task.manager.TaskManagerImpl : got exception while execute task:
com.alipay.ocp.core.exception.IllegalArgumentException: [OCP IllegalArgumentException]: status=400 BAD_REQUEST, errorCode=FILE_META_NOT_FOUND, args=sys-package,oceanbase-2.2.73-20201117154111.el7.x86_64.rpm at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_152]
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_152]
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_152]
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_152]
at com.alipay.ocp.core.util.ExceptionUtils.newException(ExceptionUtils.java:96) ~[ocp-core-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.core.util.ExceptionUtils.throwException(ExceptionUtils.java:90) ~[ocp-core-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.core.util.ExceptionUtils.illegalArgs(ExceptionUtils.java:29) ~[ocp-core-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.service.compute.softwarepackage.SoftwarePackageService.getPackageByName(SoftwarePackageService.java:233) ~[ocp-service-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.service.task.business.host.ReserveHostTask.getSoftwarePackageId(ReserveHostTask.java:73) ~[ocp-service-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.service.task.business.host.ReserveHostTask.run(ReserveHostTask.java:45) ~[ocp-service-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.core.metadb.task.TaskInstanceEntity.run(TaskInstanceEntity.java:192) ~[ocp-core-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.core.task.manager.TaskManagerImpl.lambda$null$1(TaskManagerImpl.java:177) ~[ocp-core-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.core.task.manager.TaskManagerImpl.redirectOutputIfNotSysSchedule(TaskManagerImpl.java:221) ~[ocp-core-2.5.0-20210105.jar!/:2.5.0-20210105]
at com.alipay.ocp.core.task.manager.TaskManagerImpl.lambda$executeTask$2(TaskManagerImpl.java:149) ~[ocp-core-2.5.0-20210105.jar!/:2.5.0-20210105] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_152]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_152]
at com.alipay.ocp.core.thread.TraceDecorator.lambda$decorate$0(TraceDecorator.java:28) ~[ocp-core-2.5.0-20210105.jar!/:2.5.0-20210105]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) ~[na:1.8.0_152]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:627) ~[na:1.8.0_152]
at java.lang.Thread.run(Thread.java:882) ~[na:1.8.0_152]