SFCFS操作手冊

1、symantec 大中國區(qū)顧問服務(wù)中國聯(lián)通sfcfs操作手冊sep, 2011version 1.文件信息版本document titlesfcfs操作手冊subjectversion1.0date2011/9/7authorfilenamecomments關(guān)于文檔該文件可以與symantec consultant取得聯(lián)系獲得最新版本修改歷史日期作者版本修改內(nèi)容 目錄1storage foundation for rac/cfs簡單操作21.1命令行操作簡介21.1.0如何重啟主機(jī)21.1.1檢查cluster狀態(tài)21.1.2 啟動服務(wù)組21.1.3 停止服務(wù)組21.1.4 切換服務(wù)組21.1

2、.5 停止某個資源21.1.6啟動某個資源21.1.7發(fā)現(xiàn)某個資源出錯后清除錯誤21.1.8如果資源無法啟動或停止需要flush狀態(tài)21.1.9查看心跳信息21.1.10查看cluster支持rac/cfs的狀態(tài)21.1.11查看磁盤狀態(tài)21.1.12查看 disk group 狀態(tài)21.1.13查看disk group 剩余空間21.1.14查看 volume 的狀態(tài)21.1.15 添加一個disk group21.1.16在disk group中添加一塊盤21.1.17創(chuàng)建stripe的volume21.1.18創(chuàng)建文件系統(tǒng)21.1.19 mount文件系統(tǒng)21.1.20查看cluster

3、的日志21.1.21查看volume manager的日志21.1.22刪除一個volume21.1.23刪除一個disk group21.1.24如何擴(kuò)大或縮小文件系統(tǒng)21.1.25如何禁止fencing21.1.26 shutdown說明21.1.27檢查磁盤的serial number21.1.28如何查看license key21.1.29如何添加license key21.1.30如何查看多路徑信息21.1.31如何讓cluster兩主機(jī)都停止后啟動一臺主機(jī)提供服務(wù)21.1.32如何停止一個hba卡上的i/o（用于升級微碼）21.1.33如何更換一個hba卡21.1.34如何添加一個

4、oracle使用的裸設(shè)備21.1.35如何停止cluster軟件21.1.36如何手工import disk group并啟動volume21.1.37如何手工deport disk group22圖形界面簡介22.1cluster圖形界面22.2volume manager圖形界面23高級操作23.1dmp操作23.1.1如何禁止多路徑23.1.2查看磁盤路徑的常用命令23.1.3查看dmp路徑的常用命令23.1.4查看controller的常用命令23.1.5查看陣列的常用命令23.1.6查看dmp 的實(shí)時i/o 狀態(tài)23.1.7如何升級陣列的微碼23.1.8對磁盤i/o錯誤的處理23.1

5、.9查看asl和apm 信息23.1.10添加對不支持陣列的簡單支持23.1.11磁盤名稱的顯示方式23.1.12重新生成磁盤名23.1.13cvm的操作23.2fencing key操作23.2.1查看key的方法23.2.2清除key的方法123.2.3清除key的方法223.2.4清除key的方法323.3snapshot操作23.3.1說明23.3.2創(chuàng)建dco version 2023.3.3創(chuàng)建full-size instant snapshot23.3.4創(chuàng)建space-optimized instant snapshot23.3.5創(chuàng)建emulation of third-mi

6、rror break-off snapshot23.3.6其它操作23.3.7snapshot的性能調(diào)優(yōu)23.4mirror操作23.4.1注意事項(xiàng)23.4.2常見操作23.4.3性能調(diào)優(yōu)23.4.4對ssb情況的處理23.5site mirror23.5.1注意事項(xiàng)23.5.2配置site mirror23.5.3對存在的disk group配置site mirror23.5.4日常操作21 storage foundation for rac/cfs簡單操作storage foundation for rac/cfs的操作可以采用命令行、java圖形界面和web界面進(jìn)行。1.1 命令行操作

7、簡介1.1.0如何重啟主機(jī)sfrac/sfcfs for aix環(huán)境下要使用shutdown ry 0命令來重啟主機(jī)，不能使用 reboot命令shutdown ry 0命令會執(zhí)行/etc/rc.d下的k腳本，會正常地停止cluster軟件，而reboot不會。如果使用reboot命令重啟后，需要查看errpt,如果有fencing的報錯，并且無法import disk group, 就要使用 vxfenclearpre命令后重啟主機(jī)才能恢復(fù)正常。 1.1.1檢查cluster狀態(tài)rp84db1:/#hastatus sum 查看總體的cluster狀態(tài)- system state- syst

8、em state frozen a rp84db1 running 0 a rp84db2 running 0 - group state- group system probed autodisabled state b oradb rp84db1 y n online b oradb rp84db2 y n online b ccolap_sg rp84db1 y n offline b ccolap_sg rp84db2 y n online b cvm rp84db1 y n online b cvm rp84db2 y n online rp84db1:/#hastatus 用于查看

9、動態(tài)的cluster信息 attempting to connect.connectedgroup resource system message - - - - rp84db1 running rp84db2 running oradb rp84db1 online oradb rp84db2 online -cvm rp84db1 online cvm rp84db2 online ccolap_sg rp84db2 online ccolap_sg rp84db1 offline cfsocrvote rp84db1 online - cfsocrvote rp84db2 online

10、cfsoradb rp84db1 online cfsoradb rp84db2 online cfsorafb rp84db1 online cfsorafb rp84db2 online - dgocrvote rp84db1 online dgocrvote rp84db2 online dgora rp84db1 online dgora rp84db2 online vxfsckd rp84db1 online - vxfsckd rp84db2 online cvm_clus rp84db1 online cvm_clus rp84db2 online cvm_vxconfigd

11、rp84db1 online cvm_vxconfigd rp84db2 online - ccolap_dg rp84db2 online ccolap_dg rp84db1 offline ccolap_oradb_vol rp84db2 online ccolap_oradb_vol rp84db1 offline ccolap_orafb_vol rp84db2 online - ccolap_orafb_vol rp84db1 offline ccolap_etl_vol rp84db2 online ccolap_etl_vol rp84db1 offline ccolap_ora

12、db_mnt rp84db2 online ccolap_oradb_mnt rp84db1 offline - ccolap_orafb_mnt rp84db2 online ccolap_orafb_mnt rp84db1 offline ccolap_etl_mnt rp84db2 online ccolap_etl_mnt rp84db1 offline ccolap_ip rp84db2 online - ccolap_ip rp84db1 offline ccolap_nic rp84db2 online ccolap_nic rp84db1 online ccolap_oracl

13、e rp84db2 online ccolap_oracle rp84db1 offline - ccolap_listener rp84db2 online ccolap_listener rp84db1 offline 1.1.2 啟動服務(wù)組#hagrp online -sys 1.1.3 停止服務(wù)組#hagrp offline -sys 1.1.4 切換服務(wù)組這個操作相當(dāng)于在一邊停止服務(wù)組，在另一邊驅(qū)動服務(wù)組#hagrp switch -to 1.1.5 停止某個資源#hares offline -sys 1.1.6啟動某個資源#hares online -sys 1.1.7發(fā)現(xiàn)某個資源

14、出錯后清除錯誤#hares clear -sys 1.1.8如果資源無法啟動或停止需要flush狀態(tài)#hagrp flush -sys 1.1.9查看心跳信息rp84db1:/#gabconfig -agab port memberships=port a gen 705d01 membership 01port b gen 705d07 membership 01port d gen 705d06 membership 01port f gen 705d0f membership 01port h gen 705d05 membership 01port o gen 705d04 membe

15、rship 01port v gen 705d0b membership 01port w gen 705d0d membership 011.1.10查看cluster支持rac/cfs的狀態(tài)rp84db1:/#vxdctl -c modemode: enabled: cluster active - slavemaster: rp84db2相當(dāng)與oracle中的lsnodes1.1.11查看磁盤狀態(tài)#vxdisk o alldgs list device type disk group statusdevice type disk group statusc0t6d0 auto:lvm -

16、 - lvmc2t6d0 auto:lvm - - lvmc25t0d1 auto:cdsdisk - (vxfencoorddg) onlinec25t0d3 auto:cdsdisk - (vxfencoorddg) onlinec25t0d4 auto:lvm - - lvmc25t0d6 auto:cdsdisk - (vxfencoorddg) onlinec25t1d0 auto:cdsdisk - (ccolapdg) onlinec25t1d1 auto:cdsdisk - (ccolapdg) onlinec31t0d2 auto:cdsdisk ocrvotedg01 oc

17、rvotedg online sharedc31t0d5 auto:cdsdisk oradg02 oradg online sharedc31t0d7 auto:cdsdisk oradg01 oradg online sharedc31t1d2 auto:cdsdisk - (ccolapdg) online1.1.12查看 disk group 狀態(tài)#vxdg listname state idoradg enabled,shared,cds 1237977903.46.rp84db1ocrvotedg enabled,shared,cds 1237979570.48.rp84db1 1

18、.1.13查看disk group 剩余空間#vxdg free group disk device tag offset length flagsoradg oradg01 c31t0d7 c31t0d7 398508160 20872960 -ocrvotedg ocrvotedg01 c31t0d2 c31t0d2 972800 26496 -1.1.14查看 volume 的狀態(tài)disk group: oradgdg name nconfig nlog minors group-idst name state dm_cnt spare_cnt appvol_cntdm name dev

19、ice type privlen publen staterv name rlink_cnt kstate state primary datavols srlrl name rvg kstate state rem_host rem_dg rem_rlnkco name cachevol kstate statevt name rvg kstate state nvolumev name rvg/vset/co kstate state length readpol prefplex utypepl name volume kstate state length layout ncol/wi

20、d modesd name plex disk diskoffs length col/off device modesv name plex volname nvollayr length col/off am/nm modesc name plex cache diskoffs length col/off device modedc name parentvol logvolsp name snapvol dcoex name assoc vc perms mode statesr name kstatedg oradg default default 45000 1237977903.

21、46.rp84db1dm oradg01 c31t0d7 auto 32768 419381120 -dm oradg02 c31t0d5 auto 32768 52379520 -v oradbvol - enabled active 398458880 select - fsgenpl oradbvol-01 oradbvol enabled active 398458880 concat - rwsd oradg01-01 oradbvol-01 oradg01 0 398458880 0 c31t0d7 enav orafbvol - enabled active 52428800 s

22、elect - fsgenpl orafbvol-01 orafbvol enabled active 52428800 concat - rwsd oradg02-01 orafbvol-01 oradg02 0 52379520 0 c31t0d5 enasd oradg01-02 orafbvol-01 oradg01 398458880 49280 52379520 c31t0d7 enadisk group: ocrvotedgdg name nconfig nlog minors group-idst name state dm_cnt spare_cnt appvol_cntdm

23、 name device type privlen publen staterv name rlink_cnt kstate state primary datavols srlrl name rvg kstate state rem_host rem_dg rem_rlnkco name cachevol kstate statevt name rvg kstate state nvolumev name rvg/vset/co kstate state length readpol prefplex utypepl name volume kstate state length layou

24、t ncol/wid modesd name plex disk diskoffs length col/off device modesv name plex volname nvollayr length col/off am/nm modesc name plex cache diskoffs length col/off device modedc name parentvol logvolsp name snapvol dcoex name assoc vc perms mode statesr name kstatedg ocrvotedg default default 3500

25、0 1237979570.48.rp84db1dm ocrvotedg01 c31t0d2 auto 32768 999296 -v ocrvotevol - enabled active 972800 select - fsgenpl ocrvotevol-01 ocrvotevol enabled active 972800 concat - rwsd ocrvotedg01-01 ocrvotevol-01 ocrvotedg01 0 972800 0 c31t0d2 ena1.1.15 添加一個disk group添加cluster的disk groupvxdg -s init 添加普

26、通的disk groupvxdg init 1.1.16在disk group中添加一塊盤#vxdg g adddisk 1.1.17創(chuàng)建stripe的volume#vxassist g make 500g layout=stripe stripeunit=64k ncol=21.1.18創(chuàng)建文件系統(tǒng)#mkfs v vxfs o largefiles /dev/vx/rdsk/ 1.1.19 mount文件系統(tǒng)mount cluster的文件系統(tǒng):#mount v vxfs o cluster,largefiles /dev/vx/dsk/ /mount文件系統(tǒng):#mount v vxfs o

27、 largefiles /dev/vx/dsk/ /1.1.20查看cluster的日志#tail f /var/vrtsvcs/log/engine_a.log2006/10/22 19:44:25 vcs notice v-16-1-10447 group ysdb_sg is online on system rp84db12006/10/22 19:44:25 vcs info v-16-6-15004 (rp84db1) hatrigger:failed to send trigger for nfs_restart; script doesnt exist2006/10/22 19

28、:44:25 vcs info v-16-6-15004 (rp84db1) hatrigger:failed to send trigger for postonline; script doesnt exist2006/10/22 20:55:53 vcs info v-16-1-10077 received new cluster membership2006/10/22 20:55:53 vcs notice v-16-1-10080 system (rp84db1) - membership: 0x3, jeopardy: 0x22006/10/22 20:55:53 vcs err

29、or v-16-1-10087 system rp84db2 (node 1) is in regardy membership - membership: 0x3, jeopardy: 0x22006/10/22 20:55:53 vcs info v-16-6-15004 (rp84db2) hatrigger:failed to send trigger for injeopardy; script doesnt exist2006/10/22 20:56:46 vcs info v-16-1-10077 received new cluster membership2006/10/22

30、 20:56:46 vcs notice v-16-1-10080 system (rp84db1) - membership: 0x3, jeopardy: 0x02006/10/22 20:56:46 vcs notice v-16-1-10086 system rp84db2 (node 1) is in regular membership - membership: 0x31.1.21查看volume manager的日志aix使用#errpt ahp-ux查看/var/log/syslog/syslog.log1.1.22刪除一個volume#vxedit g -rf rm 1.1

31、.23刪除一個disk group#vxdg destroy 1.1.24如何擴(kuò)大或縮小文件系統(tǒng)to resize a file system and a volume that contains it, the vxresize command can beused. the command should be run from the cvm master node. if resizing the volume orthe file system independent of each other, then the command should be run from the cvmm

32、aster node or the cfs primary node respectively.to determine the primary node for a file system in a cluster, type:# fsclustadm v showprimary mount_pointto determine if the current node is the master cvm node, type:# vxdctl -c modemode: enabled: cluster active - slavemaster: star33如果cvm的master和cfs的p

33、rimary node在一邊，可以使用如下命令# vxresize -g -b -f vxfs 10g (此命令只能用于mount起來的文件系統(tǒng))1.1.25如何禁止fencingyou may have to disable fencing in the following cases: the cluster has been upgraded to the latest sfcfs stack and the storage does notsupport scsi-3 pgr feature. during installation fencing was turned on but

34、later you want to turn it off.by default, the vxfen driver operates with i/o fencing enabled. to disable this featurewithout removing the coordinator disks, you must create the file /etc/vxfenmode andinclude a string within the file to notify the vxfen driver, then stop and restart the driver,as ins

35、tructed below:# echo vxfen_mode=disabled /etc/vxfenmode# /etc/rc.d/rc2.d/s97vxfen stop# /etc/rc.d/rc2.d/s97vxfen start1.1.26 shutdown說明不要使用reboot進(jìn)行停機(jī)要使用shutdown fr或shutdown r y now進(jìn)行shutdown fr會自動將上面的服務(wù)組停止后才重啟1.1.27檢查磁盤的serial number# vxfenadm -i /dev/rhdisk75vendor id : emcproduct id : symmetrixrev

36、ision : 5567serial number : 42031000a#vxdmpinq /dev/rhdisk751.1.28如何查看license key#vxlicrep1.1.29如何添加license key#vxlicinst可以在線添加,立刻生效1.1.30如何查看多路徑信息方法1:vxdisk list 如vxdisk list genesis0_0輸出的最后五行numpaths: 4hdisk39state=enabledhdisk77state=enabledhdisk115state=enabledhdisk153state=enabled如果線路出錯，狀態(tài)會變成di

37、sabled同時要注意如果一個盤上沒有任何i/o,磁盤的狀態(tài)會一直是enabled當(dāng)盤上有i/o后并發(fā)現(xiàn)線路上有錯誤，磁盤的狀態(tài)會變成disabled方法2:列出主機(jī)所有的控制器# vxdmpadm listctlr all列出主機(jī)一條控制器上的所有磁盤路徑# vxdmpadm getsubpaths ctlr=方法 3:#vxdisk path1.1.31如何讓cluster兩主機(jī)都停止后啟動一臺主機(jī)提供服務(wù)在啟動后運(yùn)行/sbin/gabconfig c x可以適用于rac/cfs環(huán)境1.1.32如何停止一個hba卡上的i/o（用于升級微碼）列出主機(jī)所有的控制器# vxdmpadm list

38、ctlr allto disable a controller, use the following command:# vxdmpadm disable ctlr=1.1.33如何更換一個hba卡列出主機(jī)所有的控制器# vxdmpadm listctlr allto disable a controller, use the following command:# vxdmpadm disable ctlr=rmdev dl刪除hba卡的磁盤cfgmgr識別磁盤vxdmpadm enable ctlr=1.1.34如何添加一個oracle使用的裸設(shè)備# vxassist -g make # vxedit -g set user=oracle group=dba mode=660 例如# vxassis