Table Of ContentVersion 7.1 SP7 Administrator’s Guide
Table of Contents
Introduction .................................................................................................................................................. 12
IBM Resiliency Orchestration 7.1 SP7 ....................................................................................................... 12
Purpose ....................................................................................................................................................... 13
Getting Started ............................................................................................................................................ 14
Using Online Help ................................................................................................................................... 15
Navigation Bar ......................................................................................................................................... 16
Breadcrumbs ............................................................................................................................................ 16
Working Area .......................................................................................................................................... 17
Right Pane ............................................................................................................................................... 17
Administration Overview ........................................................................................................................ 17
About IBM Resiliency Orchestration ...................................................................................................... 18
Log Out .................................................................................................................................................... 18
Help ......................................................................................................................................................... 18
Quick Start ............................................................................................................................................... 19
Changing Password ................................................................................................................................. 20
Reset Password ........................................................................................................................................... 21
Architecture Overview ................................................................................................................................ 22
Overview ..................................................................................................................................................... 22
Key Features ............................................................................................................................................ 23
Key Benefits ............................................................................................................................................ 27
How IBM Resiliency Orchestration Works? ........................................................................................... 29
Understanding Concepts .......................................................................................................................... 30
Status of a Group ........................................................................................................................................ 37
Execution Mode ....................................................................................................................................... 38
Execution Status ...................................................................................................................................... 39
Recovery Status ....................................................................................................................................... 40
Business Continuity Modes ......................................................................................................................... 43
Business Continuity States .......................................................................................................................... 45
RPO-RTO .................................................................................................................................................... 48
About RPO, RTO ........................................................................................................................................ 48
Recovery Point Objective ........................................................................................................................ 48
Recovery Time Objective ........................................................................................................................ 48
Managing RPO and RTO ............................................................................................................................ 48
Compute Current App RPO ..................................................................................................................... 48
Compute current Data RPO ..................................................................................................................... 49
Compute current RTO and display the desired RTO and estimated RTO values ................................... 49
Pre- requisites ............................................................................................................................................. 54
Additional Support ...................................................................................................................................... 54
Starting and Stopping IBM Resiliency Orchestration Server Services ...................................................... 54
On Server Restart .................................................................................................................................... 55
Starting and Stopping IBM Resiliency Orchestration Agents .................................................................... 55
Starting IBM Resiliency Orchestration Agents ........................................................................................... 55
Starting Agents on the UNIX Server ....................................................................................................... 56
Stopping IBM Resiliency Orchestration Agents on Window Server ........................................................... 58
Stopping Agents on the UNIX Server ..................................................................................................... 58
Verifying IBM Resiliency Orchestration Agents ......................................................................................... 60
Verifying Agents on Windows Server .................................................................................................... 60
Verifying Agents on UNIX Server .......................................................................................................... 60
Verifying the processes of Agents on UNIX Server ............................................................................... 61
Refreshing Details ...................................................................................................................................... 63
Configuration ............................................................................................................................................... 66
Configuring IBM Resiliency Orchestration ................................................................................................ 66
Tomcat Configuration ................................................................................................................................. 66
Tomcats logs rotation .............................................................................................................................. 69
Agent Configuration ................................................................................................................................... 70
Configuring Agents ................................................................................................................................. 70
Site Controller ......................................................................................................................................... 70
Agentless ................................................................................................................................................. 73
Agent Listing ........................................................................................................................................... 86
Configuring WAN Agent ........................................................................................................................ 89
User Management ....................................................................................................................................... 91
Setting up Users ....................................................................................................................................... 91
Adding Users ........................................................................................................................................... 92
Modifying Users ...................................................................................................................................... 96
Deleting Users ......................................................................................................................................... 97
Setting System Options for Users ............................................................................................................ 97
Editing User Preferences ....................................................................................................................... 100
Configuring LDAP ................................................................................................................................ 100
Configuring AD ..................................................................................................................................... 105
Division of the User Management System ............................................................................................ 110
Known Limitations ................................................................................................................................ 114
Listing Configured Users ...................................................................................................................... 115
Appendix ............................................................................................................................................... 118
Notifications .............................................................................................................................................. 121
Configuring Notifications ...................................................................................................................... 121
Email Notification ................................................................................................................................. 122
SMS Notification ................................................................................................................................... 123
SNMP Notification ................................................................................................................................ 123
Notification List ..................................................................................................................................... 123
Configuring SNMP Trap Forwarder ..................................................................................................... 126
Configuring Email Server ...................................................................................................................... 128
Configuring Email Templates ............................................................................................................... 129
Business Process Integration .................................................................................................................... 130
Listing Business Process Schedules ...................................................................................................... 131
Adding Business Process ....................................................................................................................... 132
Configuring Business Process ............................................................................................................... 133
Custom Event ........................................................................................................................................ 133
Scheduling ............................................................................................................................................. 135
Managing Business Process .................................................................................................................. 136
Deleting Business Process ..................................................................................................................... 137
Continuity Workflows ........................................................................................................................... 138
Workflow Manager ................................................................................................................................... 140
Working with Actions ........................................................................................................................... 141
Creating new workflow ......................................................................................................................... 155
Deleting Workflow ................................................................................................................................ 156
Importing or Exporting a Workflow ...................................................................................................... 157
Scheduling Business Process Workflow / Drills ................................................................................... 159
Automatic Retry on Failure ................................................................................................................... 162
Single Stepping Actions in Workflows ................................................................................................. 163
Synchronizing Workflow with RPO/RTO ............................................................................................ 164
Publish/ Save as a Draft ......................................................................................................................... 165
Previewing Workflow ........................................................................................................................... 166
Workflow Version History/ Rollback ................................................................................................... 166
Workflow Key Value List ..................................................................................................................... 167
Workflow Configuration Limitations .................................................................................................... 171
Configuring Approver List .................................................................................................................... 171
Recovery Automation Library (RAL) ........................................................................................................ 172
AWS ...................................................................................................................................................... 173
Description ............................................................................................................................................ 210
Inputs ..................................................................................................................................................... 210
Outputs .................................................................................................................................................. 211
Description ............................................................................................................................................ 212
Inputs ..................................................................................................................................................... 212
Outputs .................................................................................................................................................. 212
Description ............................................................................................................................................ 214
Inputs ..................................................................................................................................................... 214
Outputs .................................................................................................................................................. 214
Description ............................................................................................................................................ 216
Inputs ..................................................................................................................................................... 216
Outputs .................................................................................................................................................. 217
Description ............................................................................................................................................ 218
Inputs ..................................................................................................................................................... 218
Outputs .................................................................................................................................................. 219
Database Level ...................................................................................................................................... 219
File ......................................................................................................................................................... 291
Process ................................................................................................................................................... 308
Repeatable ............................................................................................................................................. 315
Replication Level ................................................................................................................................... 315
Replication ............................................................................................................................................. 518
IBM Internal (This is not for field use.) ................................................................................................ 520
Workflow ............................................................................................................................................... 538
Trigger Site Level Drill ............................................................................................................................. 568
Trigger Site Level FO ............................................................................................................................... 569
Zerto .......................................................................................................................................................... 570
Zerto Logon ........................................................................................................................................... 570
Zerto Logoff .......................................................................................................................................... 570
Zerto Change Recovery Host ................................................................................................................ 570
Zerto Delete VRA .................................................................................................................................. 571
Zerto Failover ........................................................................................................................................ 571
Zerto Failover Test ................................................................................................................................ 571
Zerto Force Sync VPG .......................................................................................................................... 571
Zerto Launch New VRA ....................................................................................................................... 572
Zerto Resume VPG ................................................................................................................................ 573
Zerto Unprotect VPG ............................................................................................................................ 573
Zerto Wait for Task Complete ............................................................................................................... 574
Zerto Is VPG Exist ................................................................................................................................ 574
Zerto Create VPG Settings .................................................................................................................... 574
Zerto Delete VPG .................................................................................................................................. 575
Low Touch Oracle DG .............................................................................................................................. 575
Supported Features ................................................................................................................................ 575
Overview ............................................................................................................................................... 576
Prerequisites .......................................................................................................................................... 576
Low Touch Wizard - Primary Server .................................................................................................... 577
Primary Database ................................................................................................................................... 579
AWS Information .................................................................................................................................. 581
Low Touch Execution workflow ........................................................................................................... 584
Configuration ............................................................................................................................................ 587
Configuring RPO/ RTO ......................................................................................................................... 587
Configuring Notification Regarding Events .......................................................................................... 591
Configuring Event Policy ...................................................................................................................... 592
Adding Polar Event Script ..................................................................................................................... 594
Site Ticker ................................................................................................................................................. 595
Show Expired Ticker ............................................................................................................................. 596
Add Site Ticker ...................................................................................................................................... 596
Vault Framework ...................................................................................................................................... 597
Introduction ........................................................................................................................................... 597
Configuring Vault .................................................................................................................................. 599
Vault Agent ........................................................................................................................................... 610
Vault Features ........................................................................................................................................ 611
Subsystems IBM Supports .................................................................................................................... 614
Dashboards ................................................................................................................................................. 615
DR Operational Dashboard ..................................................................................................................... 615
DR Manager Dashboard .......................................................................................................................... 618
Manage ........................................................................................................................................................ 622
Filters ........................................................................................................................................................ 622
Group Health ............................................................................................................................................ 624
Sites ........................................................................................................................................................... 624
Application Group .................................................................................................................................... 626
Application Group ................................................................................................................................. 626
AG Listing ............................................................................................................................................. 630
AG Details ............................................................................................................................................. 631
Relationship ........................................................................................................................................... 631
Recovery Group ........................................................................................................................................ 633
Recovery Group ..................................................................................................................................... 633
RG Listing ............................................................................................................................................. 634
RG Details ............................................................................................................................................. 635
Relationship in RG ................................................................................................................................ 635
Continuity Workflows ............................................................................................................................... 637
Executing Workflows ................................................................................................................................ 638
Executing Workflow ............................................................................................................................. 638
Health Monitoring .................................................................................................................................... 641
Viewing Group Relationship ................................................................................................................. 641
RPO and RTO Monitoring ........................................................................................................................ 642
Monitoring Replication ............................................................................................................................. 643
Viewing Recovery Group Replication Details .......................................................................................... 644
Monitor ....................................................................................................................................................... 645
Filters ........................................................................................................................................................ 645
Group Health ............................................................................................................................................ 647
Sites ........................................................................................................................................................... 647
Application Group .................................................................................................................................... 649
Application Group ................................................................................................................................. 649
AG Listing ............................................................................................................................................. 654
AG Details ............................................................................................................................................. 654
Relationship ........................................................................................................................................... 654
Recovery Group ........................................................................................................................................ 656
Recovery Group ..................................................................................................................................... 656
RG Listing ............................................................................................................................................. 657
RG Details ............................................................................................................................................. 658
Relationship in RG ................................................................................................................................ 658
Continuity Workflows ............................................................................................................................... 659
Executing Workflows ................................................................................................................................ 661
Executing Workflow ............................................................................................................................. 661
Health Monitoring .................................................................................................................................... 664
Viewing Group Relationship ................................................................................................................. 664
RPO and RTO Monitoring ........................................................................................................................ 666
Continuity Monitoring Overview .............................................................................................................. 667
Monitoring Replication ............................................................................................................................. 667
Viewing Recovery Group Replication Details .......................................................................................... 668
Events .......................................................................................................................................................... 669
Event Alarm .............................................................................................................................................. 670
View Events ............................................................................................................................................... 670
Viewing Group Events .............................................................................................................................. 673
Filtering Events ........................................................................................................................................ 674
Complete Listing of Events ....................................................................................................................... 675
Viewing Sequence of Events ..................................................................................................................... 680
System Events ............................................................................................................................................ 681
Monitoring Events .................................................................................................................................... 682
Monitoring Users and Passwords for raised Events ................................................................................ 682
Recovery Automation ................................................................................................................................ 684
Managing Groups ..................................................................................................................................... 684
Group Maintenance - Working with Different Modes of Group .......................................................... 684
Business Continuity Operations ............................................................................................................ 689
Start and Stop Replication ..................................................................................................................... 704
Managing Events ................................................................................................................................... 708
Drills ............................................................................................................................................................ 715
Configuring Drills .................................................................................................................................... 716
Switchover ............................................................................................................................................. 717
Switchback ............................................................................................................................................ 718
Custom Drills ......................................................................................................................................... 719
IntegrityCheck Test Place holder .......................................................................................................... 721
Listing Drill Schedules .......................................................................................................................... 721
Executing Drills ........................................................................................................................................ 722
Drills State ............................................................................................................................................. 724
Drill Listing ........................................................................................................................................... 727
Tracking Drills ....................................................................................................................................... 727
Changing Drills Mode ........................................................................................................................... 728
Drills Interfering with BCO ................................................................................................................... 728
Identifying Group under Unrestricted Test Mode ................................................................................. 729
Effect of Drills on Group Status ............................................................................................................ 729
Viewing Drills ....................................................................................................................................... 729
Viewing Drills for a Group .................................................................................................................... 730
Viewing automation status .................................................................................................................... 731
Viewing Drills History Report .............................................................................................................. 731
Viewing Workflow Calendar ................................................................................................................ 732
Viewing Recent Execution Drills Status ............................................................................................... 733
Drills Management ................................................................................................................................ 733
Scheduled .................................................................................................................................................. 734
Viewing Scheduled ................................................................................................................................ 735
Scheduling Workflows .......................................................................................................................... 735
Executing .................................................................................................................................................. 736
Executing ............................................................................................................................................... 736
Summary ................................................................................................................................................... 738
Viewing Summary ................................................................................................................................. 738
Select Workflow .................................................................................................................................... 739
Viewing workflow details ..................................................................................................................... 739
Editing Workflows ................................................................................................................................ 741
Viewing Published workflow by logged in user ........................................................................................ 742
Viewing Published workflow by logged in user ................................................................................... 742
Working with Workflow Manager ........................................................................................................... 743
Working with Workflow Manager ............................................................................................................ 743
Workflow Execution Page ......................................................................................................................... 744
Resuming workflow after IBM Server failure ........................................................................................... 745
Dealing with Failures of Workflow Execution ......................................................................................... 746
Stopping Workflows .................................................................................................................................. 747
Approving/Rejecting a workflow before execution ................................................................................... 748
Approving a workflow .......................................................................................................................... 748
Rejecting a workflow ............................................................................................................................ 748
DryRun ...................................................................................................................................................... 749
Mode ...................................................................................................................................................... 749
Process ................................................................................................................................................... 749
Workflow Enhancements .......................................................................................................................... 750
Confirmation of Workflow Execution ................................................................................................... 750
Dryrun Execution .................................................................................................................................. 750
Nested Workflow (Navigation to Workflow within a Workflow) ........................................................ 750
View Workflows ................................................................................................................................... 751
Workflows Visual Distinction ............................................................................................................... 751
Stopping/Aborting Parent Workflows ................................................................................................... 751
Propagation of Nested Workflow Status ............................................................................................... 751
Parent Workflow Summary Counts ....................................................................................................... 751
Glimpse of Nested Workflows .............................................................................................................. 752
Validating and Fortifying Nested Workflows ....................................................................................... 752
Validation ................................................................................................................................................... 753
View Rules ................................................................................................................................................ 753
Listing Validation Rules ........................................................................................................................ 753
Tasks ......................................................................................................................................................... 754
Listing Tasks ......................................................................................................................................... 754
Creating Tasks ....................................................................................................................................... 755
Modifying Tasks .................................................................................................................................... 757
Deleting Tasks ....................................................................................................................................... 757
Executing Tasks ..................................................................................................................................... 758
Viewing Execution History ................................................................................................................... 758
Reports ........................................................................................................................................................ 761
Reports Overview ...................................................................................................................................... 761
You can generate the following reports: ............................................................................................... 761
Viewing Reports ........................................................................................................................................ 763
Printing Reports ........................................................................................................................................ 774
Internet Explorer: ................................................................................................................................... 774
Firefox: .................................................................................................................................................. 774
Customizing Reports ................................................................................................................................. 775
Group Summary Report ............................................................................................................................ 775
Test Summary Report ................................................................................................................................ 778
To generate Test Summary Report: ....................................................................................................... 779
Custom Report Framework ....................................................................................................................... 782
Data Capturing Module to Generate Custom Reports ........................................................................... 782
Advanced Reports Module .................................................................................................................... 792
Audit Logging ........................................................................................................................................... 800
Viewing Audit Log Report .................................................................................................................... 802
Scheduling Audit Log Report ................................................................................................................ 803
Listing Scheduled Audit Log Reports ................................................................................................... 805
Modifying Audit Log Report Schedule ................................................................................................. 805
Deleting Audit Log Report Schedule .................................................................................................... 807
Discovery ..................................................................................................................................................... 809
Sites ........................................................................................................................................................... 809
Adding Organization ............................................................................................................................. 809
Adding Sites .......................................................................................................................................... 810
Modifying Sites ..................................................................................................................................... 812
Deleting Site .......................................................................................................................................... 813
Site Listing ............................................................................................................................................. 813
Subsystem .................................................................................................................................................. 814
Auto Discovery ...................................................................................................................................... 815
Credentials ............................................................................................................................................. 815
Create New Credential Using SSH ........................................................................................................ 816
Agent Upgrade ....................................................................................................................................... 819
Prerequisites ............................................................................................................................................. 819
Component & WAN .................................................................................................................................. 823
Datasets .................................................................................................................................................. 831
Protection Schemes ............................................................................................................................... 854
Modifying Protection Schemes ................................................................................................................. 892
Deleting Protection Schemes .................................................................................................................... 893
Agent Node Configuration ........................................................................................................................ 893
Converged ................................................................................................................................................. 894
UCS Directors ....................................................................................................................................... 895
UCS Director vDC Map for DR ............................................................................................................ 897
Management Service ................................................................................................................................. 902
Adding Management Service ................................................................................................................ 902
Modifying Management Service ........................................................................................................... 906
Deleting Management Service .............................................................................................................. 907
Management Service List ...................................................................................................................... 908
SRA ........................................................................................................................................................... 909
SRA Discovery ...................................................................................................................................... 909
SRA Listing ........................................................................................................................................... 910
ADC Profile .............................................................................................................................................. 911
Adding ADC Profile .............................................................................................................................. 912
Modifying ADC Profile ......................................................................................................................... 915
Deleting ADC Profile ............................................................................................................................ 915
Listing ADC Profile .............................................................................................................................. 916
Group Creation ......................................................................................................................................... 917
Groups ................................................................................................................................................... 917
Creating / Editing Groups ...................................................................................................................... 918
Creating Recovery Groups ................................................................................................................... 919
Viewing Recovery Group Details ......................................................................................................... 925
Editing Recovery Group ........................................................................................................................ 926
Application Group Workflow Auto Generation .................................................................................... 929
Network Component ............................................................................................................................. 930
Support for Cluster ................................................................................................................................ 930
Creating an Application Group ............................................................................................................. 931
Viewing Application Group details ....................................................................................................... 934
Editing Application Group .................................................................................................................... 934
Deleting a Group ................................................................................................................................... 935
IBM Resiliency Orchestration Logs ......................................................................................................... 937
Working with Logger ................................................................................................................................ 937
Logger Overview ...................................................................................................................................... 938
Setting Debug Level .................................................................................................................................. 941
Retaining Log ............................................................................................................................................ 941
Operational History .................................................................................................................................. 943
Purge Log Now ...................................................................................................................................... 943
Setting Log File Size ................................................................................................................................. 945
Fetching Log Files .................................................................................................................................... 946
System Capture ......................................................................................................................................... 947
Listing Log Files ....................................................................................................................................... 950
Filtering Log Files and Advanced Log Fetching ...................................................................................... 951
Fetching Log files using CLI tools ............................................................................................................ 953
Resiliency Orchestration Log Fetching / Extracting ............................................................................. 953
Resiliency Orchestration Log Admin .................................................................................................... 957
Licensing ..................................................................................................................................................... 959
Licensing ................................................................................................................................................... 959
Licensing Introduction .............................................................................................................................. 960
Procuring and Uploading License ............................................................................................................ 961
Viewing License information procured ................................................................................................. 961
Uploading License ................................................................................................................................. 962
Upgrading license .................................................................................................................................. 963
View the Uploaded License ...................................................................................................................... 964
Enabling / Disabling for a Group ............................................................................................................. 965
License Usage ........................................................................................................................................... 965
Home Page Options .................................................................................................................................. 971
High Availability of IBM Resiliency Orchestration Server ................................................................... 973
High Availability (HA) of IBM Resiliency Orchestration Server ............................................................ 973
Continuity Operation Recovery ................................................................................................................ 974
Continuity Recovery .................................................................................................................................. 974
Event Management Recovery ................................................................................................................... 976
Drills Recovery ......................................................................................................................................... 976
Description:BCM, failures occurred. Functioning of PR is down, replication is not occurring. DR impaired. Failover Active. The control of business is switched to DR site. PR . Toll Free: 1800 1027305. Starting and Stopping the schema, see the Active Directory programmer's Guide at the Microsoft Web site. Note