Steps of Updating NetScaler
NetScalers are running in Active/Standby mode, the update should be scheduled in two days for each pair in case there is an issue that requires an immediate rollback.
Postpone all NetScaler changes on the Netscalers which are under the update except for urgencies.
Day 1
- Confirm DC1 and DC2 are in HA mode.
Under
System -> High Availability -> Nodes
, you can see two nodes. - Force failover to DC1 Netscaler instance as the primary (May not required if DC1 instance is primary). You need to refresh the page on the browser to see the change.
force failover
- Save configuration on DC1 and DC2
- Check services on CLI of DC2 (Version 1). Recommend to copy and paste one command a time or they'd be placed randomly in the log.
show hostname
show version
sh ha node
stat lb vserver -fullValues
stat cs vserver -fullValues
stat serviceGroup -fullValues
stat service -fullValues
stat vpn vserver -fullValues
stat tcp
show ns running
- Shutdown DC2 instance and take a snapshot DC2 instance. Always prefer to use
Shut Down Guest OS
since it notifies the system whilePower Off
directly shut the power off. - Boot up DC2 instance and upgrade DC2 instance
- If the system reports insufficient diskspace, delete the old update files/folders under
/var/nsinstall/
- USE a console window to check the system status since the web GUI won't refresh itself during the update.
- If the system reports insufficient diskspace, delete the old update files/folders under
- Confirm version and HA are good before failover to DC2. Save configurations on DC2
show version
sh ha node
- Failover to DC2 instance as the primary
force failover
- Check services on DC2 (Version 2)
- The services should be in the status as same as they were before the update
- Some services take time
show hostname
show version
sh ha node
stat lb vserver -fullValues
stat cs vserver -fullValues
stat serviceGroup -fullValues
stat service -fullValues
stat vpn vserver -fullValues
stat tcp
show ns running
- Confirm Version 1 and Version 2 are the same
- encryption phases change from time to time, they should NOT be the same
- HA node status should be different since the synchronization will stop between different versions.
- Do NOT delete Version 1 and Version 2
Day 2
- Save configurations on DC1 and DC2
- Shutdown DC1 instance and take snapshot of DC1 instance
- Set DC2 - STAYPRIMARY, on dc2
set ha node -haStatus STAYPRIMARY
- Set DC1 - STAYSECONDARY, on dc1
set ha node -haStatus STAYSECONDARY
- Check services on DC2 (Version 3)
show hostname
show version
sh ha node
stat lb vserver -fullValues
stat cs vserver -fullValues
stat serviceGroup -fullValues
stat service -fullValues
stat vpn vserver -fullValues
stat tcp
show ns running
- Confirm Version 2 and Version 3 is the same
- Boot up DC1 instance and upgrade DC1 instance
- Check services on DC1 (Version 4). Some services may show DOWN at this step
show hostname
show version
sh ha node
stat lb vserver -fullValues
stat cs vserver -fullValues
stat serviceGroup -fullValues
stat service -fullValues
stat vpn vserver -fullValues
stat tcp
show ns running
- Confirm services except for running status between Version 1 and Version 4
- Activate HA on DC1 & 2
set ha node -haStatus enable
- Check if DC2 is Primary and DC1 is Secondary
- Check services on DC2 (Version 5)
show hostname
show version
sh ha node
stat lb vserver -fullValues
stat cs vserver -fullValues
stat serviceGroup -fullValues
stat service -fullValues
stat vpn vserver -fullValues
stat tcp
show ns running
- Confirm Version 5 and Version 1 is the same
- Failover to DC1
force ha failover
It can be applied to either DC1 or DC2
- Check services on DC1 (Version 6)
show hostname
show version
sh ha node
stat lb vserver -fullValues
stat cs vserver -fullValues
stat serviceGroup -fullValues
stat service -fullValues
stat vpn vserver -fullValues
stat tcp
show ns running
- Confirm Version 6 and Version 1 is the same
- KEEP log Version 1-6 and the snapshots for at least a week
Rollback
During Day 1 Update
- Stop DC2 instance
- Rollback DC2 with the snapshot created before the update
- Confirm services
After Day 1 Update
- Failover to DC1 instance
- Stop DC2 instance
- Rollback DC2 with the snapshot created before the update
- Confirm services
During Day 2 Update - Partial rollback
- Stop DC1 instance
- Rollback DC1 with the snapshot created before the update
- Confirm services
- mainly for the number of services and configs
- the running status may be different with DOWN mainly
During Day 2 Update - Full rollback
- Stop DC1 instance
- Rollback DC1 with the snapshot created before the update
- Failover to DC1 instance
- Confirm services
- Perform DC2 instance rollback as mentioned above
After Day 2 Update
- Rollback DC2 instance
- Failover to DC2 instance
- Confirm services
- Rollback DC1 instance
- Confirm services
- Failover to DC1
- Confirm services