ZxBackup - Zextras Forum

How to ensure backup consistency after doMailboxMove

massimo.vitali — Wed, 23 Dec 2020 15:16:15 +0000

Hi all. Running following configuration:

Network Modules NG Version: 3.1.3
Network Modules NG commit: 94c34c6eb8b985dfdd37515cf641d6950020b92c
ZAL Version: 2.16.0
ZAL commit: 2b7f623d77f2eff5714eb58dcd3d4f844c759ab9
Zimbra version: 8.8.15_GA_3975 20201017004308 20201017-0117 NETWORK

I recently migrated all Zimbra Mailboxes from the source mailstore to a new couple of mailstores using zxsuite HSM doMailboxMove in several steps (about 900 mailboxes, about 2 TB total). The new infrastructure works very well and no issues were experienced by users.
During the migration, there were no errors while transferring BLOB/Index/DB Items, but there were some errors while transferring backup items: logs showed some errors (like File does not exist) for almost every mailbox, ranging from no or few errors to 30-40 errors for largest mailboxes. Errors are related only to backup items, so I assume that all mailbox contents were safely transferred to the new mailstores.

Now I would like to check the real consistency of the backup and fix possible inconsistencies. What is the correct way to do this? I know that doSmartScan performs such checks, but only on items created since last SmartScan. Instead I would like to do a check on ALL items, to ensure that every message in every mailbox has a corresponding entry in the backup store, regardless of any error possibly occurred during the backup stage in doMailboxMove. I also know that the option deep true on doSmartScan performs a more accurate check, but If I correctly undesrtood, it seems that this check is also done only on items modified since last SmartScan, so I cannot rely only on doSmartScan to ensure a complete consistency of the backup store.

The right way to achieve my purpose seems to be the command doCoherencyCheck with fixBackup true that detects and corrects any inconsistencies on the backup store. Now my question: is this the correct command to ensure that, after a full execution on all mailboxes, all BLOBS in the mailstore have one or more corresponding entries in the backup store, even if such backup entries were missing just after moving the mailbox? For example, if doCoherencyCheck (with fixBackup) detects a BLOB without a corresponding backup item, does it create its backup?

Thank you very much in advance

Massimo

zxbackup doFixShares : Unable to retrieve map file from server

owc — Wed, 05 Aug 2020 20:19:04 +0000

Hi,

I migrated an old 8.7 server with zxbackup.
I used an NFS storage that I mounted on /opt/zmig in a fresh installed zimbra with zextras suite. No backup path initialized on destination.
I followed this incremental migration doc using smartscan: https://docs.zextras.com/zextras-suite-documentation/latest/backup.html#_step_8_post_migration_checks

Now, I have to fix shares. On the first restore zxbackup created a map_file in /opt/zimbra/backup/zextras/map_eb57ba7b-86d5-47d9-b1c0-ba38e9ffe20f

But no way to get it works:
zxsuite backup doFixShares map_eb57ba7b-86d5-47d9-b1c0-ba38e9ffe20f zxsuite backup doFixShares /opt/zimbra/backup/zextras/map_eb57ba7b-86d5-47d9-b1c0-ba38e9ffe20f always says: Unable to retrieve map file from server actualserver.com And notification says: Operation Shares Fix failed. Operation Id: f0512a71-feb9-4951-b68e-002e73dad88c Operation Host: actualserver.com Operation requested by: zimbra ZeXtras Suite Version: 3.1.0 commit: 89033d55018868806462c5e9771057b3a9be8afa Zal Version: 2.15.1 Zal commit: 5f37b3a8386fd0a572de50732e05bb218d4a4975 Zimbra version: 8.8.15_GA_3959 20200714235021 20200715-0023 FOSS - exception - com.zextras.lib.Error.EmptyMergedMapError: Merged map is empty, check logs at com.zextras.modules.backup.operations.ZEFixShares.doOperation (ZEFixShares.java:291) at com.zextras.lib.operations.ZEOperation.exec (ZEOperation.java:827) at com.zextras.lib.operations.LegacyOperationProxy.exec (LegacyOperationProxy.java:84) at com.zextras.lib.operations.ModifiableStatefulOperation.exec (ModifiableStatefulOperation.java:123) at com.zextras.lib.operations.OperationStarterActivity.run (OperationStarterActivity.java:46) at com.zextras.lib.activities.ActivityThread.run (ActivityThread.java:144) What can I do :/? Thanks in advance ! Robin

zxsuite backup doFixShares map_eb57ba7b-86d5-47d9-b1c0-ba38e9ffe20f
zxsuite backup doFixShares /opt/zimbra/backup/zextras/map_eb57ba7b-86d5-47d9-b1c0-ba38e9ffe20f

always says:
Unable to retrieve map file from server actualserver.com

And notification says:
Operation Shares Fix failed.

Operation Id: f0512a71-feb9-4951-b68e-002e73dad88c
Operation Host: actualserver.com

Operation requested by: zimbra

ZeXtras Suite Version: 3.1.0
commit: 89033d55018868806462c5e9771057b3a9be8afa

Zal Version: 2.15.1
Zal commit: 5f37b3a8386fd0a572de50732e05bb218d4a4975
Zimbra version: 8.8.15_GA_3959 20200714235021 20200715-0023 FOSS

- exception -
com.zextras.lib.Error.EmptyMergedMapError: Merged map is empty, check logs
at com.zextras.modules.backup.operations.ZEFixShares.doOperation (ZEFixShares.java:291)
at com.zextras.lib.operations.ZEOperation.exec (ZEOperation.java:827)
at com.zextras.lib.operations.LegacyOperationProxy.exec (LegacyOperationProxy.java:84)
at com.zextras.lib.operations.ModifiableStatefulOperation.exec (ModifiableStatefulOperation.java:123)
at com.zextras.lib.operations.OperationStarterActivity.run (OperationStarterActivity.java:46)
at com.zextras.lib.activities.ActivityThread.run (ActivityThread.java:144)

What can I do ?

Thanks in advance !
Robin

Restore On New Account failed

In_The_Ville — Mon, 15 Jun 2020 16:48:28 +0000

I inadvertently overwrote a very important mail subfolder, so tried to restore the account to the day before I did the overwrite, but I get an error:

This is an automated notification from ZxBackup about Restore On New Account.

Operation Restore On New Account failed.

Operation Id: 0de28cdd-52dc-4942-bf9e-88f44e05ab88
Operation Host: li326-169.members.linode.com

Operation requested by: rbestany@allegiansystems.com

ZeXtras Suite Version: 3.0.1
commit: fb8179ab3198b786bd4ef200bb48fccb35142b0e

Zal Version: 2.8.0
Zal commit: 5192098722ef193e4a5f22d77179dcf143aadfa5
Zimbra version: 8.7.11_GA_3808 20190606234217 20190606-2358 NETWORK(OSE patched)

Source account: rbestany@allegiansystems.com
Destination account: restored_rbestany@allegiansystems.com
Additional notifications: rbestany@allegiansystems.com

- exception -
com.zextras.lib.Error.RestoringAccountError: Exception when restoring account informations: restored_rbestany@allegiansystems.com
at com.zextras.modules.backup.ZEBAccount.restoreAccountInfo (ZEBAccount.java:1067)
at com.zextras.modules.backup.operations.ZERestoreOnNewOperation.restoreOnNewAccount (ZERestoreOnNewOperation.java:350)
at com.zextras.modules.backup.operations.ZERestoreOnNewOperation.doOperation (ZERestoreOnNewOperation.java:302)
at com.zextras.lib.operations.ZEOperation.exec (ZEOperation.java:804)
at com.zextras.lib.operations.LegacyOperationProxy.exec (LegacyOperationProxy.java:84)
at com.zextras.lib.operations.ModifiableStatefulOperation.exec (ModifiableStatefulOperation.java:123)
at com.zextras.lib.operations.OperationStarterActivity.run (OperationStarterActivity.java:48)
at com.zextras.lib.activities.ActivityThread.run (ActivityThread.java:144)
Caused by: org.openzal.zal.exceptions.InvalidRequestException: com.zimbra.common.service.ServiceException: invalid request: cos id 4a9e7ae6-0095-4d1f-a97e-e2870f72506f does not point to a valid cos
ExceptionId:Restore On New Account:1592239424626:3e50f959434be944
Code:service.INVALID_REQUEST
at org.openzal.zal.exceptions.ExceptionWrapper$13.create (ExceptionWrapper.java:166)
at org.openzal.zal.exceptions.ExceptionWrapper.wrap (ExceptionWrapper.java:407)
at org.openzal.zal.ProvisioningImp.createAccount (ProvisioningImp.java:1348)
at com.zextras.modules.backup.ZEBAccount.restoreAccountInfo (ZEBAccount.java:482)
at com.zextras.modules.backup.operations.ZERestoreOnNewOperation.restoreOnNewAccount (ZERestoreOnNewOperation.java:350)
at com.zextras.modules.backup.operations.ZERestoreOnNewOperation.doOperation (ZERestoreOnNewOperation.java:302)
at com.zextras.lib.operations.ZEOperation.exec (ZEOperation.java:804)
at com.zextras.lib.operations.LegacyOperationProxy.exec (LegacyOperationProxy.java:84)
at com.zextras.lib.operations.ModifiableStatefulOperation.exec (ModifiableStatefulOperation.java:123)
at com.zextras.lib.operations.OperationStarterActivity.run (OperationStarterActivity.java:48)
at com.zextras.lib.activities.ActivityThread.run (ActivityThread.java:144)
Caused by: com.zimbra.common.service.ServiceException: invalid request: cos id 4a9e7ae6-0095-4d1f-a97e-e2870f72506f does not point to a valid cos
ExceptionId:Restore On New Account:1592239424626:3e50f959434be944
Code:service.INVALID_REQUEST
at com.zimbra.common.service.ServiceException.INVALID_REQUEST (ServiceException.java:293)
at com.zimbra.cs.account.callback.CosId.validateCosId (CosId.java:54)
at com.zimbra.cs.account.callback.CosId.preModify (CosId.java:35)
at com.zimbra.cs.account.AttributeManager.preModify (AttributeManager.java:1339)
at com.zimbra.cs.account.AttributeManager.preModify (AttributeManager.java:1311)
at com.zimbra.cs.account.ldap.LdapProvisioning.createAccount (LdapProvisioning.java:1270)
at com.zimbra.cs.account.ldap.LdapProvisioning.createAccount (LdapProvisioning.java:1218)
at org.openzal.zal.ProvisioningImp.createAccount (ProvisioningImp.java:1336)
at com.zextras.modules.backup.ZEBAccount.restoreAccountInfo (ZEBAccount.java:482)
at com.zextras.modules.backup.operations.ZERestoreOnNewOperation.restoreOnNewAccount (ZERestoreOnNewOperation.java:350)
at com.zextras.modules.backup.operations.ZERestoreOnNewOperation.doOperation (ZERestoreOnNewOperation.java:302)
at com.zextras.lib.operations.ZEOperation.exec (ZEOperation.java:804)
at com.zextras.lib.operations.LegacyOperationProxy.exec (LegacyOperationProxy.java:84)
at com.zextras.lib.operations.ModifiableStatefulOperation.exec (ModifiableStatefulOperation.java:123)
at com.zextras.lib.operations.OperationStarterActivity.run (OperationStarterActivity.java:48)
at com.zextras.lib.activities.ActivityThread.run (ActivityThread.java:144)

Any ideas?

2nd restore option?

glennbtn — Fri, 10 Apr 2020 10:39:22 +0000

Hi All

Ok looks like all my date did not rsync between server and the data is 7 days out. Anyway can I do a 2nd restore with it just restoring the missing data after another rsync so it does not duplicate mail?

Thanks

Glenn

zxBackup missing userPassword after restore deleted account

laragio — Mon, 30 Mar 2020 09:54:32 +0000

Hi,

i deleted an account. I do the Restore on new account. I change the name of the account to the old one, but if i try to login on the audit.log i see

missing userPassword

If i setup the password on the webcli i can login and the mail are there. What is the problem?

Regards
--
Laragio

Case sensitive filesystem

fmazzi — Wed, 11 Mar 2020 16:12:47 +0000

Hi, I have a alert message in zextras admin which says that backup path is on a case-sensitive filesystem, but it's false, it's on a xfs disk. We recently increased disk size.
How can I fix it?
Thank you

Backup failed

fmazzi — Tue, 10 Mar 2020 10:48:44 +0000

Hi, in the last nights I got two errors in the ZxBackup.
These are the logs:

/var/log/zimbra.log:

Mar 10 04:15:29 vm-lxzmailbox1 zmmailboxdmgr: manager woke up from wait on mailboxd/JVM with pid 16103
Mar 10 04:15:29 vm-lxzmailbox1 zmmailboxdmgr: manager started mailboxd/JVM with pid 1847
Mar 10 04:15:29 vm-lxzmailbox1 zmmailboxdmgr: wrote java pid 1847 to /opt/zimbra/log/zmmailboxd_java.pid

/opt/zimbra/log/mailbox.log

2020-03-10 04:15:28,753 FATAL system - handler exception
java.lang.OutOfMemoryError: Java heap space
2020-03-10 04:15:28,753 ERROR [] mailbox - Exception: java.lang.OutOfMemoryError: Java heap space

/opt/zimbra/log/zmmailboxd.out

Mar 10, 2020 4:15:28 AM org.jgroups.blocks.cs.NioBaseServer$Acceptor doSelect
WARNING: acceptor failure
java.lang.OutOfMemoryError: Java heap space

Exception in thread "qtp1525409936-5695" java.lang.OutOfMemoryError: Java heap space
2020-03-10 04:15:28.749:WARN:oejs.AbstractConnector:qtp1525409936-18-acceptor-0@31df0ce3-ServerConnector@156b88f5{HTTP/1.1,}{0.0.0.0:8080}:
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space

Release 8.8.15_GA_3869.RHEL7_64_20190917004220 RHEL7_64 FOSS edition, Patch 8.8.15_P4
Zextras 3.0.4
Centos 7

We have two mailbox servers, the first with proxy; these errors appears in the second mailbox server

Any ideas?
Thank you.

Can't log in

iomari — Sat, 29 Feb 2020 12:52:05 +0000

Greetings,
I just imported a backup that I exported recently.
After a 17 hour import, I can see all accounts and can see the total mail from each account is accurate.
However, I can't log in to any account except admin. Even after a successful password change, I still can't log in.
The export came from A SLES server using ZCS 8.6 and the import went to an Ubuntu bionic server running ZCS 8.8.15.

Is there some step I'm missing to be able to log in to the imported mail accounts?

Thanks in advance
iomari

domain $name: cannot resolve multiple GAL Account Id: disabled

lyfenwebos — Fri, 07 Feb 2020 22:48:38 +0000

Hello! We are migrating from our previous zimbra server to the newest one. We've done a backup and started Importing it on our new instance. For now we have restored only 1 mailbox and we had an error which to my surprise didn't break anything or at least I haven't found the problem yet.

The problem is domain $name: cannot resolve multiple GAL Account Id: disabled, where $name - domain name.

Log contains sensitive information, can I send it to you somehow?

Migration from VERY old Ubuntu 12.04/Zimbra 8.0.7 to Ubuntu 18.04/Zimbra 8.8.15

JoeAshley — Fri, 24 Jan 2020 00:18:52 +0000

As you can tell from the title I have been using Zimbra and Zextra a long time. I currently am using Zextra 2.14 and have already re-licensed Zextra 3.0.5.

This is a personal email server with less than 10 boxes and all I want to do is move email, contacts, calendars and aliases. The email isn't as important as the other stuff. Seems pretty straight-forward. The fact is this machine has been running so smoothly for over 8 years and now I am behind the 8-ball.

There must be some simple steps to get this done.

Any help will be greatly appreciated of course and I apologize since I am sure this is redundant. I document well so I will be glad to create a STEP-BY-STEP document.

Thanks.