Troubleshooting for Upgrade Errors

UPGRADE FAILED: another operation (install/upgrade/rollback) is in progress

While performing the upgrade (./appviewxctl upgrade --config .appviewxctl.yaml), if the system encounters the error of UPGRADE FAILED: another operation (install/upgrade/rollback) is in progress as shown below. Perform the following steps:
  1. Fetch the deployment history of avx-app helm deployment using command mentioned below. 
    helm history avx-app -n avx
  2. Find the most recent revision of avx-app which is in deployed state.
    In this case Revision 2 is the most recent upgrade.
  3. Run the rollback command to retrieve the deployment from failed state. 
    helm rollback avx-app <REVISION NUMBER> -n avx
    Example: 
    helm rollback avx-app 2 -n avx
  4. Re-run the helm history avx-app -n avx command to verify the rollback is complete.

Failure Issue during Upgrade

  1. Go to the section Cleanup of OpenBao and follow the steps provided.
  2. When the cleanup is complete, install in the following order: 
    
#Install OpenBao
./appviewxctl --config .appviewxctl.yaml installOpenbao

# Restore Vault
./vault_restore_openbao_migration.sh -p <vault backup file full path>

# Restore Mongo
./mongo_restore.sh <mongo backup file full path>

# Upgrade Plugins
./appviewxctl upgrade --config .appviewxctl.yaml

Login Issue after Upgrade

If a login issue occurs after the upgrade:
  1. Perform he vault cleanup, refer the section Vault/Consul Cleanup.
  2. Reinstall OpenBao.
  3. Restore the Vault data.
  4. Now, repeat the application upgrade process.