Hi guys,
I have this problem with my carbonio. zextras@mail:~$ zmcontrol status
Host
amavis Running
running antispam
running antivirus
directory-server Running
Stopped logger
mailbox Stopped
mysql.server is not running.
memcached Running
mta Running
opendkim Running
Proxy Running
service webapp Stopped
mysql.server is not running.
service-discover Running
stats Stopped
config service Running
Hi,
Sorry to hear about the trouble.
Is it a new installation?
What procedures you followed and what is the OS of the system?
Regards,
Sharif
Hi @sharif
About your questions.
1.- It is not a new installation, the server was restarted due to an electrical failure and after that the problem with the services remains.
2.- The OS version is Ubuntu 20.04.6 LTS.
I appreciate your time and attention in solving my problem.
send my log.
Apr 25 22:19:27 mail zmconfigd[3737]: Watchdog: service antivirus status is OK.
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/common/lib/jylibs/state.py", line 793, in rewriteConfig (fh, tmpfile) = tempfile.mkstemp(dir="/tmp")
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/lib/jars/jython-standalone-2.5.2.jar/Lib/tempfile.py", line 302, in mkstemp return _mkstemp_inner(dir, prefix, suffix, flags)
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/lib/jars/jython-standalone-2.5.2.jar/Lib/tempfile.py", line 236, in _mkstemp_inner fd = _os.open(file, flags, 0600)
Apr 25 22:19:27 mail zmconfigd[3737]: Rewrite failed: No such file or directory (No such file or directory)
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/common/lib/jylibs/state.py", line 793, in rewriteConfig (fh, tmpfile) = tempfile.mkstemp(dir="/tmp")
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/lib/jars/jython-standalone-2.5.2.jar/Lib/tempfile.py", line 302, in mkstemp return _mkstemp_inner(dir, prefix, suffix, flags)
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/lib/jars/jython-standalone-2.5.2.jar/Lib/tempfile.py", line 236, in _mkstemp_inner fd = _os.open(file, flags, 0600)
Apr 25 22:19:27 mail zmconfigd[3737]: Rewrite failed: No such file or directory (No such file or directory)
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/common/lib/jylibs/state.py", line 793, in rewriteConfig (fh, tmpfile) = tempfile.mkstemp(dir="/tmp")
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/lib/jars/jython-standalone-2.5.2.jar/Lib/tempfile.py", line 302, in mkstemp return _mkstemp_inner(dir, prefix, suffix, flags)
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/lib/jars/jython-standalone-2.5.2.jar/Lib/tempfile.py", line 236, in _mkstemp_inner fd = _os.open(file, flags, 0600)
Apr 25 22:19:27 mail zmconfigd[3737]: Rewrite failed: No such file or directory (No such file or directory)
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/common/lib/jylibs/state.py", line 793, in rewriteConfig (fh, tmpfile) = tempfile.mkstemp(dir="/tmp")
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/lib/jars/jython-standalone-2.5.2.jar/Lib/tempfile.py", line 302, in mkstemp return _mkstemp_inner(dir, prefix, suffix, flags)
Apr 25 22:19:27 mail zmconfigd[3737]: File "/opt/zextras/lib/jars/jython-standalone-2.5.2.jar/Lib/tempfile.py", line 236, in _mkstemp_inner fd = _os.open(file, flags, 0600)
Apr 25 22:19:27 mail zmconfigd[3737]: Rewrite failed: No such file or directory (No such file or directory)
Apr 25 22:19:27 mail zmconfigd[3737]: All rewrite threads completed in 0.01 sec
Apr 25 22:19:27 mail zmconfigd[3737]: All restarts completed in 0.00 sec
Apr 25 22:19:29 mail postfix/postscreen[8228]: CONNECT from [127.0.0.1]:35650 to [127.0.0.1]:25
Apr 25 22:19:29 mail postfix/postscreen[8228]: ALLOWLISTED [127.0.0.1]:35650
Apr 25 22:19:29 mail postfix/smtpd[342050]: connect from localhost[127.0.0.1]
Apr 25 22:19:29 mail postfix/smtpd[342050]: lost connection after CONNECT from localhost[127.0.0.1]
Apr 25 22:19:29 mail postfix/smtpd[342050]: disconnect from localhost[127.0.0.1] commands=0/0
Apr 25 22:19:33 mail postfix/smtps/smtpd[233667]: connect from unknown[194.169.175.10]
Apr 25 22:19:39 mail postfix/postscreen[8228]: CONNECT from [127.0.0.1]:48766 to [127.0.0.1]:25
Apr 25 22:19:39 mail postfix/postscreen[8228]: ALLOWLISTED [127.0.0.1]:48766
Apr 25 22:19:39 mail postfix/smtpd[342050]: connect from localhost[127.0.0.1]
Apr 25 22:19:39 mail postfix/smtpd[342050]: lost connection after CONNECT from localhost[127.0.0.1]
Apr 25 22:19:39 mail postfix/smtpd[342050]: disconnect from localhost[127.0.0.1] commands=0/0
Apr 25 22:19:43 mail postfix/postscreen[8228]: CONNECT from [127.0.0.1]:37060 to [127.0.0.1]:25
Apr 25 22:19:43 mail postfix/postscreen[8228]: ALLOWLISTED [127.0.0.1]:37060
Apr 25 22:19:43 mail postfix/smtpd[342050]: connect from localhost[127.0.0.1]
Apr 25 22:19:43 mail postfix/smtpd[342050]: lost connection after CONNECT from localhost[127.0.0.1]
Apr 25 22:19:43 mail postfix/smtpd[342050]: disconnect from localhost[127.0.0.1] commands=0/0
Apr 25 22:19:46 mail postfix/smtps/smtpd[233667]: Anonymous TLS connection established from unknown[194.169.175.10]: TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)
Apr 25 22:19:49 mail postfix/postscreen[8228]: CONNECT from [127.0.0.1]:37068 to [127.0.0.1]:25
Apr 25 22:19:49 mail postfix/postscreen[8228]: ALLOWLISTED [127.0.0.1]:37068
Apr 25 22:19:49 mail postfix/smtpd[342050]: connect from localhost[127.0.0.1]
Apr 25 22:19:49 mail postfix/smtpd[342050]: lost connection after CONNECT from localhost[127.0.0.1]
Apr 25 22:19:49 mail postfix/smtpd[342050]: disconnect from localhost[127.0.0.1] commands=0/0
Apr 25 22:19:59 mail postfix/postscreen[8228]: CONNECT from [127.0.0.1]:40750 to [127.0.0.1]:25
Apr 25 22:19:59 mail postfix/postscreen[8228]: ALLOWLISTED [127.0.0.1]:40750
Apr 25 22:19:59 mail postfix/smtpd[342050]: connect from localhost[127.0.0.1]
Apr 25 22:19:59 mail postfix/smtpd[342050]: lost connection after CONNECT from localhost[127.0.0.1]
Apr 25 22:19:59 mail postfix/smtpd[342050]: disconnect from localhost[127.0.0.1] commands=0/0
Apr 25 22:20:01 mail zimbramon[346894]: 346894:info: 2024-04-25 22:20:01, QUEUE: 22819 248
Apr 25 22:20:06 mail /postfix-script[347299]: the Postfix mail system is running: PID: 8112
Apr 25 22:20:09 mail postfix/postscreen[8228]: CONNECT from [127.0.0.1]:49600 to [127.0.0.1]:25
Apr 25 22:20:09 mail postfix/postscreen[8228]: ALLOWLISTED [127.0.0.1]:49600
Apr 25 22:20:09 mail postfix/smtpd[342050]: connect from localhost[127.0.0.1]
Apr 25 22:20:09 mail postfix/smtpd[342050]: lost connection after CONNECT from localhost[127.0.0.1]
Apr 25 22:20:09 mail postfix/smtpd[342050]: disconnect from localhost[127.0.0.1] commands=0/0
Apr 25 22:20:19 mail postfix/postscreen[8228]: CONNECT from [127.0.0.1]:48534 to [127.0.0.1]:25
Apr 25 22:20:19 mail postfix/postscreen[8228]: ALLOWLISTED [127.0.0.1]:48534
Apr 25 22:20:19 mail postfix/smtpd[342050]: connect from localhost[127.0.0.1]
Apr 25 22:20:19 mail postfix/smtpd[342050]: lost connection after CONNECT from localhost[127.0.0.1]
Apr 25 22:20:19 mail postfix/smtpd[342050]: disconnect from localhost[127.0.0.1] commands=0/0
2. Now
tail -f /opt/zextras/log/mailbox.log
2024-04-25 22:25:17,416 WARN [main] [] misc - Could not establish a connection to the database. Retrying in 5 seconds.
com.zimbra.common.service.ServiceException: system failure: getting database connection
ExceptionId:main:1714101917416:0dc5835fea309571
Code:service.FAILURE
at com.zimbra.common.service.ServiceException.FAILURE(ServiceException.java:286)
at com.zimbra.cs.db.DbPool.getConnection(DbPool.java:349)
at com.zimbra.cs.db.DbPool.getConnection(DbPool.java:311)
at com.zimbra.cs.db.DbPool.waitForDatabase(DbPool.java:232)
at com.zimbra.cs.db.DbPool.startup(DbPool.java:223)
at com.zimbra.cs.util.Zimbra.startup(Zimbra.java:216)
at com.zimbra.cs.util.Zimbra.startup(Zimbra.java:176)
at com.zimbra.soap.SoapServlet.init(SoapServlet.java:118)
at javax.servlet.GenericServlet.init(GenericServlet.java:244)
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:632)
at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:415)
at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:750)
at java.base/java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:357)
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:485)
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
at java.base/java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312)
at java.base/java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:735)
at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:658)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:774)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1449)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1414)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:426)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.handler.DebugHandler.doStart(DebugHandler.java:140)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.server.Server.start(Server.java:423)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.Server.doStart(Server.java:387)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.xml.XmlConfiguration.lambda$main$3(XmlConfiguration.java:1907)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:554)
at org.eclipse.jetty.xml.XmlConfiguration.main(XmlConfiguration.java:1857)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at org.eclipse.jetty.start.Main.invokeMain(Main.java:218)
at org.eclipse.jetty.start.Main.start(Main.java:491)
at org.eclipse.jetty.start.Main.main(Main.java:77)
Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to address=(host=127.0.0.1)(port=7306)(type=master) : Socket fail to connect to host:127.0.0.1, port:7306. Connection refused
at org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:73)
at org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:194)
at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1394)
at org.mariadb.jdbc.internal.util.Utils.retrieveProxy(Utils.java:635)
at org.mariadb.jdbc.MariaDbConnection.newConnection(MariaDbConnection.java:150)
at org.mariadb.jdbc.Driver.connect(Driver.java:89)
at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:78)
at com.zimbra.cs.db.ZimbraConnectionFactory.createConnection(ZimbraConnectionFactory.java:56)
at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)
at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1148)
at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106)
at com.zimbra.cs.db.DbPool.getConnection(DbPool.java:330)
... 62 more
Caused by: java.sql.SQLNonTransientConnectionException: Socket fail to connect to host:127.0.0.1, port:7306. Connection refused
at org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:73)
at org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:185)
at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:257)
at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:521)
at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1389)
... 73 more
Caused by: java.net.ConnectException: Connection refused
at java.base/sun.nio.ch.Net.pollConnect(Native Method)
at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:579)
at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:542)
at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597)
at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:339)
at java.base/java.net.Socket.connect(Socket.java:603)
at org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:252)
... 75 more
Hi @crackdj,
Could you please share the status of the postgresql DB in your server?
root@mail:~# systemctl status postgresql*
A sudden server shutdown (e.g., due to power failure, hardware failure, etc.) often corrupts the database. As we can see from your first post in this thread, your mailbox service is not running.
Regards,
Sharif
2024-04-25 22:25:17,416 WARN [main] [] misc - Could not establish a connection to the database. Retrying in 5 seconds.
com.zimbra.common.service.ServiceException: system failure: getting database connection
ExceptionId:main:1714101917416:0dc5835fea309571
Hi @sharif.
I send you what you requested.
su - zextras
zextras@mail:~$ systemctl status postgresql*
● postgresql.service - PostgreSQL RDBMS
Loaded: loaded (/lib/systemd/system/postgresql.service; enabled; vendor preset: enabled)
Active: active (exited) since Mon 2024-04-29 10:53:41 -05; 21h ago
Main PID: 1364 (code=exited, status=0/SUCCESS)
Tasks: 0 (limit: 9425)
Memory: 0B
CGroup: /system.slice/postgresql.service
● postgresql@12-main.service - PostgreSQL Cluster 12-main
Loaded: loaded (/lib/systemd/system/postgresql@.service; enabled-runtime; vendor preset: enabled)
Active: active (running) since Mon 2024-04-29 10:53:41 -05; 21h ago
Main PID: 1138 (postgres)
Tasks: 7 (limit: 9425)
Memory: 23.9M
CGroup: /system.slice/system-postgresql.slice/postgresql@12-main.service
├─1138 /usr/lib/postgresql/12/bin/postgres -D /var/lib/postgresql/12/main -c config_file=/etc/postgresql/12/main/postgresql.conf
├─1247 postgres: 12/main: checkpointer
├─1248 postgres: 12/main: background writer
├─1249 postgres: 12/main: walwriter
├─1250 postgres: 12/main: autovacuum launcher
├─1251 postgres: 12/main: stats collector
└─1252 postgres: 12/main: logical replication launcher
zextras@mail:~$
Hi,
Please check the mysql_error.log and let us know if you have any questions regarding this incident.
Regards,
Sharif