Replace Node Hardware
This is a script for replacing the hardware in a cluster that will boot up
on the system disk of a SAN back end 3PAR storage device.
<node_name> refers to the node that is being replaced.
Setup Hardware:
Install 8x 300GB 10K SAS Disks
Mount in rack
Connect ILO to NETMGT on HUB20/21/22/23 with ethernet
Connect fibre channel FGA and FGB to SAN4 or SAN5 with fibre
Apply power
Setup DNS:
search for free IP addresses, 172.20.40.XX for ILO
DNS set ILO 172.20.40.XX
Setup ILO Telnet:
Serial into ILO !initial connection
Username: Admin
Password: *******
$ CM !enter command menu
$ LC !edit lan configuration
$ (A) !config all
$ M !add hostname
$ I !add ip
$ S !add subnet
$ G !add gateway address 172.20.40.1
$ Q !quit the lan configuration
$ SA -TELNET E !enable telnet for ILO
$ XD -reset !reset the ILO
Test ILO connection from remote PC via telnet
$ CM
$ PC -ON !turn on the machine
Setup DVD:
Telnet into ILO with Admin
$ CO !enter console
$ Boot menuÂ
$ Boot from DVD
Setup USB:
Telnet into ILO with Admin
$ CO !enter console
$ Boot menu
$ EFI Shell !enter the EFI shell
$ FSX: !set the device as USB
$ CD EFI\VSI
$ VMS_LOADER.EFI
Setup Devices:
$ 8 !execute DCL Commands
$ MC MSA$UTIL !opens msa utility
$ SET CONTROLLER PKA0: !setup controller PKA0
$ SHOW DISKS !show disk info
$ DELETE UNIT 0 !deletes default unit
$ ADD UNIT 0 /DISK=(1) /RAID=0 /SIZE=200GB !setting up raid 0 of 1 disk, each disk having 200GB
$ ADD UNIT 1 /DISK=(2) /RAID=0 /SIZE=200GB
$ ADD UNIT 2 /DISK=(3) /RAID=0 /SIZE=200GB
$ ADD UNIT 3 /DISK=(4) /RAID=0 /SIZE=200GB
$ ADD UNIT 4 /DISK=(5) /RAID=0 /SIZE=200GB
$ ADD UNIT 5 /DISK=(6) /RAID=0 /SIZE=200GB
$ ADD UNIT 6 /DISK=(7) /RAID=0 /SIZE=200GB
$ ADD UNIT 7 /DISK=(8) /RAID=0 /SIZE=200GB
$ EXIT !exit MSA utility
$ MC SYSMAN IO AUTOCONFIGURE !discover new drives
$ SHOW DEVICE DK !show all local devices
$ INITIALIZE DKA6: DVD_COPY !disk for DVD copy
$ INITIALIZE DKA7: LOCAL_BOOT !disk for local boot
Create Local Boot:
$ LOGOFF !return to DVD menu
1 !Install OpenVMS,run through the OpenVMS install procedure
DKA7:
INITIALIZE
Keep Label
ODS-5
Dont enable hardlinks
Add boot option
Default boot value
Username: System
Password: lcl*******
Not part of cluster
SCSNODE: <node_name>
No DECnet
Default system ID
GB time zone
No Product Authorization Keys
No DECwindows Motif
No DECnet-Plus
No DECnet Phase IV
Yes TCPIP/IP Services
Yes Default options
9 !shutdown the DVD boot
Reboot
B !enter boot menu
1 !pick the local maintenance boot. it will need bootingx twice
$ MOUNT DKA6: /FOREIGN
$ MOUNT DNA0: /OVER=ID
$ BACKUP /IMAGE DNA0: DKA6: !create a copy of the DVD
$ DISMOUNT DNA0:
$ DISMOUNT DKA6:
$ MOUNT DKA6: /OVER=ID
$ @SYS$MANAGER:BOOT_OPTIONS
$ 2 !display boot options
$ 3 !remove all old boot options
$ 1 !add boot option
$ DKA6:
$ 3 !set it as lowest option, below EFI
$ DVD_Boot
$ 2 !display new boot option
$ 5 !validate boot option
$ E !exit boot option
Configure SAN:
Install Java 7 on remote PC !found on software drive, remove other versions
Open Control Panel
Open JAVA Control Panel
Security
Edit Site List...
Add http://san4sw1 !adding allowed connections for web server
Add http://san4sw2
Add http://san5sw1
Add http://san5sw2
Open CMD
JAVAWS "http://san4sw1/switchExplorer_installed.html"
Dont upgrade
Accept and Run
Username: admin
Password: net*****
Configure -> Zone Admin
Disconnect Fibre !the physical fibre cables from one end
Alias -> Refresh
Take screen shot of WWNs
Connect Fibre
Compare and find new WWN
(OR) Login to New <node_name> Local Boot
$ SHOW DEVICE FG
$ SHOW DEVICE FGA0: /FULL
Make note of Node Name !this will be the new WWN
New Alias
Name: ALI_<node_name>_FGA
Move new WWN to Alias Members
Zone
New Zone
Name: ZON_<node_name>_4PAR
Move new Alias to Zone Members
Move 4PAR Alias' to Zone Members
Zone Config
Set SanConfigXX (latest) !take care as the config version reverts to oldest
Clone
Name San4Config_XX+1
Add new Zon
Save Config
Change to San4Config_XX+1
Enable Config
San4Config_XX+1
!repeat for SAN5
JAVAWS "http://san5sw1/switchExplorer_installed.html"
Dont upgrade
Accept and Run
Username: admin
Password: net*******
Configure -> Zone Admin
Disconnect Fibre
Alias -> Refresh
Take screen shot of WWNs
Connect Fibre
Compare and find new WWN
(OR) Login to New <node_name>
$ SHOW DEVICE FG
$ SHOW DEVICE FGB0: /FULL
Make note of Node Name !this will be the new WWN
New Alias to Zone Config Members
Name: ALI_<node_name>_FGB
Move new WWN to Alias Members
Zone
New Zone
Name: ZON_<node_name>_4PAR
Move new Alias to Zone Members
Move 4PAR Alias' to Zone Members
Zone Config
Set SanConfigXX (latest)
Clone
Name San5Config_XX+1
Add new Zon to Zone Config Members
Save Config
Change to San5Config_XX+1
Enable Config
San5Config_XX+1
Configure 3PAR:
Open HP 3PAR Management Console
Select 4PAR
Username: 3paradm
Password: 3par******
Hosts
Create Host...
Name: <node_name>_i2
Host Set: OpenVMS
Host OS: OpenVMS
IP Address: 172.20.102.XX
Move 4 Available WWNS to Assigned WWNs
Skip iSCSI
Host Sets
OpenVMS -> Edit
Move new Available Host to Assigned Host
Make note of <node_name> system disk !used for creating boot option
Shutdown Old <node_name>:
Login to Old <node_name> ILO
$ CO
Login as System
$ SHOW DEV DK !find an empty local disk
$ MOUNT DKAX: /FOREIGN
$ BACKUP /IMAGE $1$DGA23XX: DKAX: !backup the <node_name> system disk
$ DISMOUNT DKAX:
$ @SYS$SYSTEM:SHUTDOWN !make sure to shut down before booting New <node_name>
Pick Remove_Node option
Configure SAN Boot:
Login to New <node_name> ILO
$ CO
Boot into LOCAL_BOOT
Login as System
$ MC SYSMAN IO AUTOCONFIGURE /LOG !discover new drives
$ SHOW DEV DG !show the SAN disks
$ MOUNT $1$DGAXXXX: /OVER=(SHADOW,ID) !remove shadowing info
$ DISMOUNT $1$DGAXXX:
$ MOUNT $1$DGAXXX: /OVER=ID
$ @SYS$MANAGER:BOOT_OPTIONS !opening boot options
$ 1 !add new boot option
$ $1$DGA23XX: !add the <node_name> system disk
Set at 1
$ 5 !validate the boot option
$ 1 !pick option 1 (may not work as it isn't mounted)
$ E
Boot New <node_name>:
Login to New <node_name> ILO
$ CO
Boot into LOCAL_BOOT
Login as System
$ @SYS$SYSTEM:SHUTDOWN
Reboot
$ B !enter boot menu
Select first option
Login as System
$ @SYS$UPDATE:AUTOGEN !set parameters to new hardware
$ @SYS$SYSTEM:SHUTDOWN
Reboot
$ @SYS$MANAGER:TCPIP$CONFIG !start up TCPIP config file
$ 1
$ 2
$ X !pick the connected port
$ 1
$ 172.20.102.XX/24 !ip address of <node_name>
$ 172.20.102.1 !gateway address
$ E
$ E
$ 5 !start TCPIP services
Test remote connection from remote PC
Decommision Old <node_name>
Open HP 3PAR Management Console
Select 4PAR
Username: 3paradm
Password: 3par******
Hosts
Host Sets
OpenVMS -> Edit
Move Old <node_name> from Assigned to Available !remove the old host
Hosts
Remove Old <node_name>
Open CMD
JAVAWS "http://san4sw1/switchExplorer_installed.html"
Dont upgrade
Accept and Run
Username: admin
Password: net*****
Configure -> Zone Admin
Zone Config
Set to latest San4Config_XX+1
Clone
Name: San4Config_XX+2
Remove old Zon of Old <node_name> !remove the old configuration
Save Config
Set to latest San4Config_XX+2
Enable Config
Set to latest San4Config_XX+2
!repeat for San5
JAVAWS "http://san5sw1/switchExplorer_installed.html"
Dont upgrade
Accept and Run
Username: admin
Password: net*****
Configure -> Zone Admin
Zone Config
Set to latest San4Config_XX+1
Clone
Name: San5Config_XX+2
Remove old Zon of Old <node_name>
Save Config
Set to latest San5Config_XX+2
Enable Config
Set to latest San5Config_XX+2
Login to Old <node_name> ILO
$ CM
$ PC -OFF
Disconnect Power, Ethernet and Fibre
Remove machine from rack
Remove the Disks and store in a safe place
Store machine in a safe space
Remove Old <node_name> ILO DNS entry
Remove New <node_name> ILO DNS entry
Add <node_name> ILO DNS entry for Reverse and Forward