Forums
ZeXtras Migration T...
Import failing OutO...
 
Notifications
Clear all

Import failing OutOfMemoryError: Java heap space

 
ZeXtras Migration Tool
Last Post by flickerfly 11 years ago
1 Posts
1 Users
0 Reactions
849 Views
RSS
 flickerfly
(@flickerfly)
Posts: 1
Topic starter
 

I'm trying to do an import of a Zimbra 6.0.7 physical server to a virtualized Zimbra 8 server. The accounts have been created successfully, but no mail is in the boxes and I'm getting a host of warnings, and then a fatal error. It doesn't email me or put a notification up that it failed. It just silently stops until I go digging in the logs.

This appears to be a heap issue, but I've already increased it days ago. I included samples of the warnings I'm getting and the Fatal error below.

Any idea how to get the this to run completely? Also, when I do run an actual import (not a test), will I need to remove all this data or will it replace everything?

I've only got 6 days left on the trial so I'm getting a bit antsy. :-)

2014-03-17 04:01:00,002 WARN [ZeXtras Cron Task Thread] [] extensions - Scheduled SmartScan skipped because the backup path is no
t initialized.
2014-03-17 11:13:13,773 WARN [qtp310912546-4399: https://10.0.0.13:7071/service/admin/soap/GetInfoRequest ] [ip=10.0.0.60;ua=Zimbra
WebClient - FF27 (Linux);] SoapEngine - no valid authtoken present: cannot dispatch request
....
2014-03-17 11:17:22,446 WARN [ZxBackup Thread] [] extensions - Unrestorable attribute zimbraId, removed.
2014-03-17 11:17:22,447 WARN [ZxBackup Thread] [] extensions - Unrestorable attribute zimbraDomainName, removed.
2014-03-17 11:17:22,447 WARN [ZxBackup Thread] [] extensions - Unrestorable attribute zimbraDomainType, removed.
2014-03-17 11:17:22,447 WARN [ZxBackup Thread] [] extensions - Unrestorable attribute zimbraCreateTimestamp, removed.
....
2014-03-17 11:17:22,447 WARN [ZxBackup Thread] [] misc - checkValue: no attribute info for: dc
2014-03-17 11:17:32,709 WARN [ZxBackup Thread] [] misc - SpamHandler called on unhandled item type=folder account=ca11031@domain.com id=4
....
2014-03-17 11:19:32,672 FATAL [Index-9] [name=us5850@domain.com;mid=24;] system - out of memory
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:2694)
at java.lang.String.(String.java:203)
at java.lang.String.substring(String.java:1913)
at java.lang.String.trim(String.java:2732)
at com.zimbra.cs.index.Fragment.skipFragmentHeader(Fragment.java:60)
at com.zimbra.cs.index.Fragment.getFragment(Fragment.java:187)
at com.zimbra.cs.index.Fragment.getFragment(Fragment.java:173)
at com.zimbra.cs.mime.ParsedMessage.analyzeBodyParts(ParsedMessage.java:398)
at com.zimbra.cs.mime.ParsedMessage.analyzeNonBodyParts(ParsedMessage.java:419)
at com.zimbra.cs.mime.ParsedMessage.analyzeFully(ParsedMessage.java:461)
at com.zimbra.cs.mailbox.CalendarItem.getIndexDocuments(CalendarItem.java:382)
at com.zimbra.cs.mailbox.CalendarItem.generateIndexData(CalendarItem.java:257)
at com.zimbra.cs.mailbox.MailboxIndex.indexItemList(MailboxIndex.java:736)
at com.zimbra.cs.mailbox.MailboxIndex.indexDeferredItems(MailboxIndex.java:373)
at com.zimbra.cs.mailbox.MailboxIndex.access$600(MailboxIndex.java:83)
at com.zimbra.cs.mailbox.MailboxIndex$BatchIndexTask.exec(MailboxIndex.java:1404)
at com.zimbra.cs.mailbox.MailboxIndex$IndexTask.run(MailboxIndex.java:1383)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-03-17 11:21:02,764 ERROR [qtp679447471-150: https://10.0.0.13:7071/service/admin/soap/zextras ] [name=admin@mail.domain.com;mid=2;ip=10.0.0.60;ua=ZimbraWebClient - FF27 (Linux);] extensions - Could not find backup statistics of account 797e4dd6-5fe8-41d4-a678-5d27a078f8fd
2014-03-17 11:56:33,227 FATAL [Index-9] [name=us5850@domain.com;mid=24;] system - out of memory
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:2694)
at java.lang.String.(String.java:203)
at java.lang.String.substring(String.java:1877)
at com.zimbra.cs.index.Fragment.skipFragmentHeader(Fragment.java:78)
at com.zimbra.cs.index.Fragment.getFragment(Fragment.java:187)
at com.zimbra.cs.index.Fragment.getFragment(Fragment.java:173)
at com.zimbra.cs.mime.ParsedMessage.analyzeBodyParts(ParsedMessage.java:398)
at com.zimbra.cs.mime.ParsedMessage.analyzeNonBodyParts(ParsedMessage.java:419)
at com.zimbra.cs.mime.ParsedMessage.analyzeFully(ParsedMessage.java:461)
at com.zimbra.cs.mailbox.CalendarItem.getIndexDocuments(CalendarItem.java:382)
at com.zimbra.cs.mailbox.CalendarItem.generateIndexData(CalendarItem.java:257)
at com.zimbra.cs.mailbox.MailboxIndex.indexItemList(MailboxIndex.java:736)
at com.zimbra.cs.mailbox.MailboxIndex.indexDeferredItems(MailboxIndex.java:373)
at com.zimbra.cs.mailbox.MailboxIndex.access$600(MailboxIndex.java:83)
at com.zimbra.cs.mailbox.MailboxIndex$BatchIndexTask.exec(MailboxIndex.java:1404)
at com.zimbra.cs.mailbox.MailboxIndex$IndexTask.run(MailboxIndex.java:1383)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)

Here are some diagnostic info:

mail:~$ sudo /opt/zimbra/bin/zmlocalconfig mailboxd_java_options mailboxd_java_heap_size mailboxd_java_heap_memory_percent
Warning: null valued key 'mailboxd_java_heap_memory_percent'
mailboxd_java_options = -server -Djava.awt.headless=true -Dsun.net.inetaddr.ttl=${networkaddress_cache_ttl} -Dorg.apache.jasper.compiler.disablejsr199=true -XX:+UseConcMarkSweepGC -XX:PermSize=128m -XX:MaxPermSize=350m -XX:SoftRefLRUPolicyMSPerMB=1 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCApplicationStoppedTime -XX:-OmitStackTraceInFastThrow -Djava.net.preferIPv4Stack=true
mailboxd_java_heap_size = 1024
mail:~$ free -m
             total       used       free     shared    buffers     cached
Mem:          3952       3580        371          0         80       1374
-/+ buffers/cache:       2125       1826
Swap:         1019        464        555


2014-03-17 04:01:00,002 WARN  [ZeXtras Cron Task Thread] [] extensions - Scheduled SmartScan skipped because the backup path is no
t initialized.
2014-03-17 11:13:13,773 WARN  [qtp310912546-4399: https://10.0.0.13:7071/service/admin/soap/GetInfoRequest ] [ip=10.0.0.60;ua=Zimbra
WebClient - FF27 (Linux);] SoapEngine - no valid authtoken present: cannot dispatch request
....
2014-03-17 11:17:22,446 WARN  [ZxBackup Thread] [] extensions - Unrestorable attribute zimbraId, removed.
2014-03-17 11:17:22,447 WARN  [ZxBackup Thread] [] extensions - Unrestorable attribute zimbraDomainName, removed.
2014-03-17 11:17:22,447 WARN  [ZxBackup Thread] [] extensions - Unrestorable attribute zimbraDomainType, removed.
2014-03-17 11:17:22,447 WARN  [ZxBackup Thread] [] extensions - Unrestorable attribute zimbraCreateTimestamp, removed.
....
2014-03-17 11:17:22,447 WARN  [ZxBackup Thread] [] misc - checkValue: no attribute info for: dc
2014-03-17 11:17:32,709 WARN  [ZxBackup Thread] [] misc - SpamHandler called on unhandled item type=folder account=ca11031@domain.com id=4
....
2014-03-17 11:19:32,672 FATAL [Index-9] [name=us5850@domain.com;mid=24;] system - out of memory
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:2694)
at java.lang.String.(String.java:203)
at java.lang.String.substring(String.java:1913)
at java.lang.String.trim(String.java:2732)
at com.zimbra.cs.index.Fragment.skipFragmentHeader(Fragment.java:60)
at com.zimbra.cs.index.Fragment.getFragment(Fragment.java:187)
at com.zimbra.cs.index.Fragment.getFragment(Fragment.java:173)
at com.zimbra.cs.mime.ParsedMessage.analyzeBodyParts(ParsedMessage.java:398)
at com.zimbra.cs.mime.ParsedMessage.analyzeNonBodyParts(ParsedMessage.java:419)
at com.zimbra.cs.mime.ParsedMessage.analyzeFully(ParsedMessage.java:461)
at com.zimbra.cs.mailbox.CalendarItem.getIndexDocuments(CalendarItem.java:382)
at com.zimbra.cs.mailbox.CalendarItem.generateIndexData(CalendarItem.java:257)
at com.zimbra.cs.mailbox.MailboxIndex.indexItemList(MailboxIndex.java:736)
at com.zimbra.cs.mailbox.MailboxIndex.indexDeferredItems(MailboxIndex.java:373)
at com.zimbra.cs.mailbox.MailboxIndex.access$600(MailboxIndex.java:83)
at com.zimbra.cs.mailbox.MailboxIndex$BatchIndexTask.exec(MailboxIndex.java:1404)
at com.zimbra.cs.mailbox.MailboxIndex$IndexTask.run(MailboxIndex.java:1383)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-03-17 11:21:02,764 ERROR [qtp679447471-150: https://10.0.0.13:7071/service/admin/soap/zextras ] [name=admin@mail.domain.com;mid=2;ip=10.0.0.60;ua=ZimbraWebClient - FF27 (Linux);] extensions - Could not find backup statistics of account 797e4dd6-5fe8-41d4-a678-5d27a078f8fd
2014-03-17 11:56:33,227 FATAL [Index-9] [name=us5850@domain.com;mid=24;] system - out of memory
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Arrays.java:2694)
at java.lang.String.(String.java:203)
at java.lang.String.substring(String.java:1877)
at com.zimbra.cs.index.Fragment.skipFragmentHeader(Fragment.java:78)
at com.zimbra.cs.index.Fragment.getFragment(Fragment.java:187)
at com.zimbra.cs.index.Fragment.getFragment(Fragment.java:173)
at com.zimbra.cs.mime.ParsedMessage.analyzeBodyParts(ParsedMessage.java:398)
at com.zimbra.cs.mime.ParsedMessage.analyzeNonBodyParts(ParsedMessage.java:419)
at com.zimbra.cs.mime.ParsedMessage.analyzeFully(ParsedMessage.java:461)
at com.zimbra.cs.mailbox.CalendarItem.getIndexDocuments(CalendarItem.java:382)
at com.zimbra.cs.mailbox.CalendarItem.generateIndexData(CalendarItem.java:257)
at com.zimbra.cs.mailbox.MailboxIndex.indexItemList(MailboxIndex.java:736)
at com.zimbra.cs.mailbox.MailboxIndex.indexDeferredItems(MailboxIndex.java:373)
at com.zimbra.cs.mailbox.MailboxIndex.access$600(MailboxIndex.java:83)
at com.zimbra.cs.mailbox.MailboxIndex$BatchIndexTask.exec(MailboxIndex.java:1404)
at com.zimbra.cs.mailbox.MailboxIndex$IndexTask.run(MailboxIndex.java:1383)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)

Here are some diagnostic info:
mail:~$ sudo /opt/zimbra/bin/zmlocalconfig mailboxd_java_options mailboxd_java_heap_size mailboxd_java_heap_memory_percent
Warning: null valued key 'mailboxd_java_heap_memory_percent'
mailboxd_java_options = -server -Djava.awt.headless=true -Dsun.net.inetaddr.ttl=${networkaddress_cache_ttl} -Dorg.apache.jasper.compiler.disablejsr199=true -XX:+UseConcMarkSweepGC -XX:PermSize=128m -XX:MaxPermSize=350m -XX:SoftRefLRUPolicyMSPerMB=1 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCApplicationStoppedTime -XX:-OmitStackTraceInFastThrow -Djava.net.preferIPv4Stack=true
mailboxd_java_heap_size = 1024
mail:~$ free -m
total used free shared buffers cached
Mem: 3952 3580 371 0 80 1374
-/+ buffers/cache: 2125 1826
Swap: 1019 464 555

mail:~$ sudo /opt/zimbra/bin/zmlocalconfig mailboxd_java_options mailboxd_java_heap_size mailboxd_java_heap_memory_percent
Warning: null valued key 'mailboxd_java_heap_memory_percent'
mailboxd_java_options = -server -Djava.awt.headless=true -Dsun.net.inetaddr.ttl=${networkaddress_cache_ttl} -Dorg.apache.jasper.compiler.disablejsr199=true -XX:+UseConcMarkSweepGC -XX:PermSize=128m -XX:MaxPermSize=350m -XX:SoftRefLRUPolicyMSPerMB=1 -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCApplicationStoppedTime -XX:-OmitStackTraceInFastThrow -Djava.net.preferIPv4Stack=true
mailboxd_java_heap_size = 1024
mail:~$ free -m
total used free shared buffers cached
Mem: 3952 3580 371 0 80 1374
-/+ buffers/cache: 2125 1826
Swap: 1019 464 555

 
Posted : 03/17/2014 20:50
Forum Jump:
  Previous Topic
Next Topic