Unbearably slow imp...
 
Notifications
Clear all

Unbearably slow import times

1 Posts
1 Users
0 Likes
243 Views
 mozg
(@mozg)
Posts: 1
Topic starter
 

Hello guys,

I am doing a trial of Zextras bundle and currently have a great deal of problems with the time it takes to import data from an exported backup. As an example, we have a test domain with 11 users containing just under 500k messages with the total exported size of around 25GB. It took around 2 hours to export the data.

I've started importing the data over night on the same spec-ed virtual machine as the original Zimbra server which was used for exporting data. The specs are: 8vCPU and 8GB of ram. It has only done one account so far after about 8 hours of importing. Looking at the server, there are practically no disk activity, the utilisation of disks is 0% most of the time. I do see mysqld using somewhere between 60 and 80% of a single CPU. Overall the server's load is averaging 1.1 and iowait is around 0-5%.

I did notice that /opt/zimbra/log/myslow.log is rather large - over 2GB in size.

As a comparison, we have initiated a recovery procedure of one the accounts which is currently being imported on the original server. The recovery was done from the Zimbra NE backup. On the original Zimbra NE server it took just over an hour to recover the same mailbox, which was around 9.5gb and just over 100k messages.

How do I speed up the import process? I've got a bunch of domains that I was planning to move across, containing over 1TB of data and over 200 users. My estimations show that at this pace it will take about half a year to perform, which is not feasible and not practical.

The server specs are: Ubuntu 12.04 with latest updates + zimbra open source 8.0.7 + latest zextras bundle in trial mode.

Many thanks

Andrei

 
Posted : 08/06/2014 10:37