Clearing a “Data Replication is broken” alarm

Last Updated : Sep 14, 2023 |

Use this procedure to clear a Data Replication is broken alarm on either an SBC HA pair or on an active-active EMS pair.

Caution:

This procedure is service interrupting and will cause down time on the deployment. Try to do this during low or no traffic periods.

Condition

Alarm message text
Data Replication is broken
Alarm level
Critical

Solution

Procedure

  1. On SBC A in an HA pair or the Primary EMS in an active-active EMS pair, do the following:
    1. Do a database backup using the following command:

      /usr/local/ipcs/db/scripts/dbmanage.py --takedb-backup

    2. Stop replication using the following command:

      /usr/local/ipcs/icu3/scripts/bdrmon.py --breakreplication

  2. On SBC B in an HA pair or the Secondary EMS in an active-active EMS pair, do the following:
    1. Do a database backup using the following command:

      /usr/local/ipcs/db/scripts/dbmanage.py --takedb-backup

    2. Stop replication using the following command:

      /usr/local/ipcs/icu3/scripts/bdrmon.py --breakreplication

  3. Reboot SBC A or the Primary EMS using the following command:

    /sbin/reboot

  4. Once SBC A or the Primary EMS is online and processes are up, reboot SBC B or the Secondary EMS using the following command:

    /sbin/reboot