[Solved] Problems upgrading to Ubuntu 22.04 and Carbonio from 24.1 to 24.3.0

@max_s

Hi,

Sorry to hear about your trouble.

Could you please restart the service-discover and try again?

systemctl restart service-discover

Regards,

Sharif

#systemctl restart service-discover

Job for service-discover.service failed because the control process exited with error code.
See "systemctl status service-discover.service" and "journalctl -xeu service-discover.service" for details.

systemctl status service-discover.service result:

● service-discover.service - Service discover agent for Zextras
Loaded: loaded (/lib/systemd/system/service-discover.service; enabled; vendor preset: enabled)
Active: activating (auto-restart) (Result: exit-code) since Thu 2024-03-21 13:21:31 CET; 9s ago
Docs: https://docs.zextras.com/
Process: 150360 ExecStart=/usr/bin/service-discoverd agent (code=exited, status=2)
Main PID: 150360 (code=exited, status=2)
CPU: 4ms

Mar 21 13:21:31 xxx.xxxxxx.nl systemd[1]: Failed to start Service discover agent for Zextras.

After upgrading my Ubuntu to 22.04 (phase 3 in https://docs.zextras.com/carbonio-ce/html/release/upgrade-ubuntu.html) I executed 

su - zextras -c "zmcontrol stop"
# apt update && apt upgrade

as describer in phase 4.

Then I got the following.

Performing actions...
Setting up carbonio-directory-server (4.14.0-1jammy) ...
*Starting LDAP upgrade...
slapd not running
Looking for LDAP installation...succeeded
Installing core schema...
Installing cosine schema...
Installing inetOrgPerson schema...
Installing zimbra schema...
Installing amavis schema...
Installing dyngroup schema...
Installing OpenDKIM schema...
Connection refused at /opt/zextras/libexec/zmldapupdateldif line 45, <DATA> line 960.
Connection refused at /opt/zextras/libexec/ldapattributeupdate line 56, <DATA> line 960.
slapd not running
Failed to start slapd. Attempting debug start to determine error.
65fc2833 daemon: bind(7) failed errno=13 (Permission denied)
65fc2833 slap_open_listener: failed on ldap://xxxxx.xxxxxxxx.nl:389

dpkg: error processing package carbonio-directory-server (--configure):
installed carbonio-directory-server package post-installation script subprocess returned error exit status 1
Errors were encountered while processing:
carbonio-directory-server
E: Sub-process /usr/bin/dpkg returned an error code (1)
Setting up carbonio-directory-server (4.14.0-1jammy) ...
*Starting LDAP upgrade...
slapd not running
Looking for LDAP installation...succeeded
Installing core schema...
Installing cosine schema...
Installing inetOrgPerson schema...
Installing zimbra schema...
Installing amavis schema...
Installing dyngroup schema...
Installing OpenDKIM schema...
Connection refused at /opt/zextras/libexec/zmldapupdateldif line 45, <DATA> line 960.
Connection refused at /opt/zextras/libexec/ldapattributeupdate line 56, <DATA> line 960.
slapd not running
Failed to start slapd. Attempting debug start to determine error.
65fc289d daemon: bind(7) failed errno=13 (Permission denied)
65fc289d slap_open_listener: failed on ldap://xxxxx.xxxxxxxxx.nl:389
dpkg: error processing package carbonio-directory-server (--configure):
installed carbonio-directory-server package post-installation script subprocess returned error exit status 1
Errors were encountered while processing:
carbonio-directory-server

@sharif

Hi Sharif,

Can you please help me out?

So I restored a backup and started all over again. So I used this.

https://docs.zextras.com/carbonio-ce/html/release/upgrade.html#pg-upgrade

When I got to the Upgrade Nodes I got stuck on

# pending-setups -a

with the following message.

# pending-setups -a
Insert the cluster credential password:

Executing all setup scripts...

--------------------------------------------------------------------------------
Executing /etc/zextras/pending-setups.d/set-carbonio-prometheus-mysqld-exporter.sh
Setup successful, moving set-carbonio-prometheus-mysqld-exporter.sh to /etc/zextras/pending-setups.d/done/
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Executing /etc/zextras/pending-setups.d/set-carbonio-prometheus-openldap-exporter.sh
Setup successful, moving set-carbonio-prometheus-openldap-exporter.sh to /etc/zextras/pending-setups.d/done/
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Executing /etc/zextras/pending-setups.d/carbonio-message-dispatcher.sh
Insert the cluster credential password:
Error determining policy ID: Get "http://127.0.0.1:8500/v1/acl/policies": dial tcp 127.0.0.1:8500: connect: connection refused
Setup failed: Cannot update policy for carbonio-message-dispatcher-policy
Setup script failed, keeping it
--------------------------------------------------------------------------------

So after that I tried

# systemctl restart service-discover

but I got 

Job for service-discover.service failed because the control process exited with error code.
See "systemctl status service-discover.service" and "journalctl -xe" for details.

thanks in advance

@max_s 

Hi,

can you dump the output of:

systemctl status service-discover.service

and 

journalctl -u service-discover

Regards,

Sharif

Hi !

I have a diferent problem ...

I successfully managed Phase 1, then Phase2 and Phase3 without errors.

After reboot I check file /etc/apt/sources.list.d/zextras.list and remove # infront line: deb https://repo.zextras.io/release/ubuntu jammy main

execute this line as root

su - zextras -c "zmcontrol stop"

and get this error: Socket.c: loadable library and perl binaries are mismatched (got handshake key 0xcd00080, needed 0xeb00080)

so I can't stop carbonio services ...

Then I try execute this line as root

apt update && apt upgrade

The following package was automatically installed and is no longer required:
libjson-c4
Use 'apt autoremove' to remove it.
The following packages will be upgraded:
carbonio-amavisd carbonio-appserver-conf carbonio-appserver-db carbonio-appserver-service carbonio-appserver-store-libs
carbonio-appserver-war carbonio-certbot carbonio-clamav carbonio-common-appserver-conf
carbonio-common-appserver-native-lib carbonio-common-core-jar carbonio-common-core-libs carbonio-curl
carbonio-cyrus-sasl carbonio-directory-server carbonio-docs-editor carbonio-icu carbonio-krb5 carbonio-libsodium
carbonio-libxml2 carbonio-mariadb carbonio-memcached carbonio-nginx carbonio-opendkim carbonio-openjdk
carbonio-openjdk-cacerts carbonio-openldap carbonio-openssl carbonio-perl-dbd-mysql carbonio-perl-mail-spamassassin
carbonio-perl-net-libidn2 carbonio-postfix carbonio-preview-ce carbonio-prometheus carbonio-prometheus-consul-exporter
carbonio-prometheus-mysqld-exporter carbonio-prometheus-nginx-exporter carbonio-prometheus-node-exporter
carbonio-prometheus-openldap-exporter service-discover-base service-discover-daemon service-discover-server
42 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

I got one warning: W: https://repo.zextras.io/release/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.

and on the end: Setting up carbonio-perl-dbd-mysql (4.050-3jammy) ...
Errors were encountered while processing:
carbonio-directory-server
needrestart is being skipped since dpkg has failed
E: Sub-process /usr/bin/dpkg returned an error code (1)

Why this error? I restored from backup now, but I can't upgrade to Ubuntu 22.04, because I got the same result.

Regards, Marko

Hi @sharif ,

Thanks for helping me out. What I have done is restored my server with the working copy of Carbonio 24.1. I had to because my 24.3 was not working anymore...

It seems that there is already a problem with 24.1. 

# systemctl status service-discover.service

● service-discover.service - Service discover agent for Zextras
Loaded: loaded (/lib/systemd/system/service-discover.service; enabled; vendor preset: enabled)
Active: activating (auto-restart) (Result: exit-code) since Fri 2024-03-22 09:36:15 CET; 11s ago
Docs: https://docs.zextras.com/
Process: 35111 ExecStart=/usr/bin/service-discoverd agent (code=exited, status=236/SMACK_PROCESS_LABEL)
Main PID: 35111 (code=exited, status=236/SMACK_PROCESS_LABEL)

# journalctl -u service-discover

Mar 22 09:39:18 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Scheduled restart job, restart counter is at 64.
Mar 22 09:39:18 mail1.bureaurotterdam.nl systemd[1]: Stopped Service discover agent for Zextras.
Mar 22 09:39:18 mail1.bureaurotterdam.nl systemd[1]: Starting Service discover agent for Zextras...
Mar 22 09:39:18 mail1.bureaurotterdam.nl service-discoverd[41558]: local service-discover agent must NOT be present in ldap/zimbraServiceEnabled attribute mail1.bureaurotterdam.nl
Mar 22 09:39:18 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Main process exited, code=exited, status=236/SMACK_PROCESS_LABEL
Mar 22 09:39:18 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Failed with result 'exit-code'.
Mar 22 09:39:18 mail1.bureaurotterdam.nl systemd[1]: Failed to start Service discover agent for Zextras.
Mar 22 09:39:33 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Scheduled restart job, restart counter is at 65.
Mar 22 09:39:33 mail1.bureaurotterdam.nl systemd[1]: Stopped Service discover agent for Zextras.
Mar 22 09:39:33 mail1.bureaurotterdam.nl systemd[1]: Starting Service discover agent for Zextras...
Mar 22 09:39:33 mail1.bureaurotterdam.nl service-discoverd[42031]: local service-discover agent must NOT be present in ldap/zimbraServiceEnabled attribute mail1.bureaurotterdam.nl
Mar 22 09:39:33 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Main process exited, code=exited, status=236/SMACK_PROCESS_LABEL
Mar 22 09:39:33 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Failed with result 'exit-code'.
Mar 22 09:39:33 mail1.bureaurotterdam.nl systemd[1]: Failed to start Service discover agent for Zextras.
Mar 22 09:39:49 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Scheduled restart job, restart counter is at 66.
Mar 22 09:39:49 mail1.bureaurotterdam.nl systemd[1]: Stopped Service discover agent for Zextras.
Mar 22 09:39:49 mail1.bureaurotterdam.nl systemd[1]: Starting Service discover agent for Zextras...
Mar 22 09:39:49 mail1.bureaurotterdam.nl service-discoverd[42702]: local service-discover agent must NOT be present in ldap/zimbraServiceEnabled attribute mail1.bureaurotterdam.nl
Mar 22 09:39:49 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Main process exited, code=exited, status=236/SMACK_PROCESS_LABEL
Mar 22 09:39:49 mail1.bureaurotterdam.nl systemd[1]: service-discover.service: Failed with result 'exit-code'.
Mar 22 09:39:49 mail1.bureaurotterdam.nl systemd[1]: Failed to start Service discover agent for Zextras.

These errors occur every 15 seconds....

Also in the syslog I see every several seconds.

Mar 22 09:46:02 mail1 java[56244]: _____ _ _
Mar 22 09:46:02 mail1 java[56244]: / ____| | | (_)
Mar 22 09:46:02 mail1 java[56244]: | | __ _ _ __| |__ ___ _ __ _ ___
Mar 22 09:46:02 mail1 java[56244]: | | / _` | '__| '_ \ / _ \| '_ \| |/ _ \
Mar 22 09:46:02 mail1 java[56244]: | |___| (_| | | | |_) | (_) | | | | | (_) |
Mar 22 09:46:02 mail1 java[56244]: \_____\__,_|_| |_.__/ \___/|_| |_|_|\___/
Mar 22 09:46:02 mail1 java[56244]: __ _______ _____ _ _ _ _ _ _____ ______
Mar 22 09:46:02 mail1 java[56244]: \ \ / / ____| / ____| | | | | | | | (_) / ____| ____|
Mar 22 09:46:02 mail1 java[56244]: \ \ /\ / / (___ | | ___ | | | __ _| |__ ___ _ __ __ _| |_ _ ___ _ __ | | | |__
Mar 22 09:46:02 mail1 java[56244]: \ \/ \/ / \___ \ | | / _ \| | |/ _` | '_ \ / _ \| '__/ _` | __| |/ _ \| '_ \ | | | __|
Mar 22 09:46:02 mail1 java[56244]: \ /\ / ____) | | |___| (_) | | | (_| | |_) | (_) | | | (_| | |_| | (_) | | | | | |____| |____
Mar 22 09:46:02 mail1 java[56244]: \/ \/ |_____/ \_____\___/|_|_|\__,_|_.__/ \___/|_| \__,_|\__|_|\___/|_| |_| \_____|______|
Mar 22 09:46:03 mail1 java[56244]: 22-03-2024 09:46:03.079 WARN c.z.c.c.c.logging.ChatsLogger : Unable to connect to Consul
Mar 22 09:46:03 mail1 java[56244]: com.orbitz.consul.ConsulException: Error connecting to Consul
Mar 22 09:46:03 mail1 java[56244]: #011at com.orbitz.consul.AgentClient.ping(AgentClient.java:70)
Mar 22 09:46:03 mail1 java[56244]: #011at com.orbitz.consul.Consul$Builder.build(Consul.java:734)
Mar 22 09:46:03 mail1 java[56244]: #011at com.zextras.carbonio.chats.core.config.impl.ConsulAppConfig.create(ConsulAppConfig.java:136)
Mar 22 09:46:03 mail1 java[56244]: #011at com.zextras.carbonio.chats.core.config.CoreModule.getAppConfig(CoreModule.java:220)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/java.lang.reflect.Method.invoke(Method.java:568)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod$ReflectionProviderMethod.doProvision(ProviderMethod.java:284)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod.doProvision(ProviderMethod.java:171)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.provision(InternalProviderInstanceBindingImpl.java:185)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.get(InternalProviderInstanceBindingImpl.java:162)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:45)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:40)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:60)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod.doProvision(ProviderMethod.java:171)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.provision(InternalProviderInstanceBindingImpl.java:185)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.get(InternalProviderInstanceBindingImpl.java:162)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:45)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:40)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:60)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod.doProvision(ProviderMethod.java:171)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.provision(InternalProviderInstanceBindingImpl.java:185)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.get(InternalProviderInstanceBindingImpl.java:162)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:45)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:40)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:60)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:113)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:296)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InjectorImpl$1.get(InjectorImpl.java:1100)
Mar 22 09:46:03 mail1 java[56244]: #011at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1138)
Mar 22 09:46:03 mail1 java[56244]: #011at com.zextras.carbonio.chats.boot.Chats.main(Chats.java:29)
Mar 22 09:46:03 mail1 java[56244]: Caused by: java.net.ConnectException: Failed to connect to localhost/127.0.0.1:8500
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.kt:297)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.RealConnection.connect(RealConnection.kt:207)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.ExchangeFinder.findConnection(ExchangeFinder.kt:226)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.ExchangeFinder.findHealthyConnection(ExchangeFinder.kt:106)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.ExchangeFinder.find(ExchangeFinder.kt:74)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.RealCall.initExchange$okhttp(RealCall.kt:255)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.kt:32)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.kt:95)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.kt:83)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.kt:76)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
Mar 22 09:46:03 mail1 java[56244]: #011at com.orbitz.consul.cache.TimeoutInterceptor.intercept(TimeoutInterceptor.java:53)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.kt:109)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.RealCall.getResponseWithInterceptorChain$okhttp(RealCall.kt:201)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.RealCall.execute(RealCall.kt:154)
Mar 22 09:46:03 mail1 java[56244]: #011at retrofit2.OkHttpCall.execute(OkHttpCall.java:204)
Mar 22 09:46:03 mail1 java[56244]: #011at com.orbitz.consul.AgentClient.ping(AgentClient.java:63)
Mar 22 09:46:03 mail1 java[56244]: #011... 38 common frames omitted
Mar 22 09:46:03 mail1 java[56244]: Caused by: java.net.ConnectException: Connection refused
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/sun.nio.ch.Net.pollConnect(Native Method)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:547)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:602)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)
Mar 22 09:46:03 mail1 java[56244]: #011at java.base/java.net.Socket.connect(Socket.java:633)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.platform.Platform.connectSocket(Platform.kt:120)
Mar 22 09:46:03 mail1 java[56244]: #011at okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.kt:295)
Mar 22 09:46:03 mail1 java[56244]: #011... 57 common frames omitted
Mar 22 09:46:03 mail1 java[56244]: 22-03-2024 09:46:03.092 INFO c.z.hikari.HikariDataSource : ws-collaboration-db-pool - Starting...
Mar 22 09:46:03 mail1 systemd[1]: carbonio-files.service: Scheduled restart job, restart counter is at 82.
Mar 22 09:46:03 mail1 systemd[1]: Stopped Carbonio Files daemon.
Mar 22 09:46:03 mail1 systemd[1]: Started Carbonio Files daemon.
Mar 22 09:46:04 mail1 java[56244]: 22-03-2024 09:46:04.128 ERROR c.z.hikari.pool.HikariPool : ws-collaboration-db-pool - Exception during pool initialization.
Mar 22 09:46:04 mail1 java[56244]: org.postgresql.util.PSQLException: Connection to 127.78.0.4:20003 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:301)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:225)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.Driver.makeConnection(Driver.java:466)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.Driver.connect(Driver.java:265)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:138)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:359)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:201)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:470)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.HikariPool.checkFailFast(HikariPool.java:561)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:100)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.HikariDataSource.<init>(HikariDataSource.java:81)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zextras.carbonio.chats.core.config.CoreModule.getHikariDataSource(CoreModule.java:297)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zextras.carbonio.chats.core.config.CoreModule$$FastClassByGuice$$384857.GUICE$TRAMPOLINE(<generated>)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zextras.carbonio.chats.core.config.CoreModule$$FastClassByGuice$$384857.apply(<generated>)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMethod.java:260)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod.doProvision(ProviderMethod.java:171)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.provision(InternalProviderInstanceBindingImpl.java:185)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.get(InternalProviderInstanceBindingImpl.java:162)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:45)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:40)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:60)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod.doProvision(ProviderMethod.java:171)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.provision(InternalProviderInstanceBindingImpl.java:185)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.get(InternalProviderInstanceBindingImpl.java:162)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:45)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:40)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:60)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:113)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:296)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InjectorImpl$1.get(InjectorImpl.java:1100)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1138)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zextras.carbonio.chats.boot.Chats.main(Chats.java:29)
Mar 22 09:46:04 mail1 java[56244]: Caused by: java.net.ConnectException: Connection refused
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/sun.nio.ch.Net.pollConnect(Native Method)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:547)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:602)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/java.net.Socket.connect(Socket.java:633)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.PGStream.createSocket(PGStream.java:238)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.PGStream.<init>(PGStream.java:98)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:100)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:215)
Mar 22 09:46:04 mail1 java[56244]: #011... 37 common frames omitted
Mar 22 09:46:04 mail1 java[56244]: Exception in thread "main" com.google.inject.ProvisionException: Unable to provision, see the following errors:
Mar 22 09:46:04 mail1 java[56244]: 1) [Guice/ErrorInCustomProvider]: HikariPool$PoolInitializationException: Failed to initialize pool: Connection to 127.78.0.4:20003 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Mar 22 09:46:04 mail1 java[56244]: at CoreModule.getHikariDataSource(CoreModule.java:285)
Mar 22 09:46:04 mail1 java[56244]: \_ installed by: BootModule -> CoreModule
Mar 22 09:46:04 mail1 java[56244]: at CoreModule.getFlywayInstance(CoreModule.java:275)
Mar 22 09:46:04 mail1 java[56244]: \_ for 1st parameter
Mar 22 09:46:04 mail1 java[56244]: at CoreModule.getFlywayInstance(CoreModule.java:275)
Mar 22 09:46:04 mail1 java[56244]: \_ installed by: BootModule -> CoreModule
Mar 22 09:46:04 mail1 java[56244]: at Boot.<init>(Boot.java:49)
Mar 22 09:46:04 mail1 java[56244]: \_ for 2nd parameter
Mar 22 09:46:04 mail1 java[56244]: while locating Boot
Mar 22 09:46:04 mail1 java[56244]: Learn more:
Mar 22 09:46:04 mail1 java[56244]: https://github.com/google/guice/wiki/ERROR_IN_CUSTOM_PROVIDER
Mar 22 09:46:04 mail1 java[56244]: 1 error
Mar 22 09:46:04 mail1 java[56244]: ======================
Mar 22 09:46:04 mail1 java[56244]: Full classname legend:
Mar 22 09:46:04 mail1 java[56244]: ======================
Mar 22 09:46:04 mail1 java[56244]: Boot: "com.zextras.carbonio.chats.boot.Boot"
Mar 22 09:46:04 mail1 java[56244]: BootModule: "com.zextras.carbonio.chats.boot.config.BootModule"
Mar 22 09:46:04 mail1 java[56244]: CoreModule: "com.zextras.carbonio.chats.core.config.CoreModule"
Mar 22 09:46:04 mail1 java[56244]: HikariPool$PoolInitializationException: "com.zaxxer.hikari.pool.HikariPool$PoolInitializationException"
Mar 22 09:46:04 mail1 java[56244]: ========================
Mar 22 09:46:04 mail1 java[56244]: End of classname legend:
Mar 22 09:46:04 mail1 java[56244]: ========================
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProvisionException.toProvisionException(InternalProvisionException.java:251)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InjectorImpl$1.get(InjectorImpl.java:1103)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1138)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zextras.carbonio.chats.boot.Chats.main(Chats.java:29)
Mar 22 09:46:04 mail1 java[56244]: Caused by: com.zaxxer.hikari.pool.HikariPool$PoolInitializationException: Failed to initialize pool: Connection to 127.78.0.4:20003 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.HikariPool.throwPoolInitializationException(HikariPool.java:596)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.HikariPool.checkFailFast(HikariPool.java:582)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:100)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.HikariDataSource.<init>(HikariDataSource.java:81)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zextras.carbonio.chats.core.config.CoreModule.getHikariDataSource(CoreModule.java:297)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zextras.carbonio.chats.core.config.CoreModule$$FastClassByGuice$$384857.GUICE$TRAMPOLINE(<generated>)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zextras.carbonio.chats.core.config.CoreModule$$FastClassByGuice$$384857.apply(<generated>)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMethod.java:260)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod.doProvision(ProviderMethod.java:171)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.provision(InternalProviderInstanceBindingImpl.java:185)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.get(InternalProviderInstanceBindingImpl.java:162)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:45)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:40)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:60)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderMethod.doProvision(ProviderMethod.java:171)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.provision(InternalProviderInstanceBindingImpl.java:185)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.get(InternalProviderInstanceBindingImpl.java:162)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:45)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:40)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:60)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:113)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:296)
Mar 22 09:46:04 mail1 java[56244]: #011at com.google.inject.internal.InjectorImpl$1.get(InjectorImpl.java:1100)
Mar 22 09:46:04 mail1 java[56244]: #011... 2 more
Mar 22 09:46:04 mail1 java[56244]: Caused by: org.postgresql.util.PSQLException: Connection to 127.78.0.4:20003 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:301)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:225)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.Driver.makeConnection(Driver.java:466)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.Driver.connect(Driver.java:265)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:138)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:359)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:201)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:470)
Mar 22 09:46:04 mail1 java[56244]: #011at com.zaxxer.hikari.pool.HikariPool.checkFailFast(HikariPool.java:561)
Mar 22 09:46:04 mail1 java[56244]: #011... 28 more
Mar 22 09:46:04 mail1 java[56244]: Caused by: java.net.ConnectException: Connection refused
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/sun.nio.ch.Net.pollConnect(Native Method)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:547)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:602)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)
Mar 22 09:46:04 mail1 java[56244]: #011at java.base/java.net.Socket.connect(Socket.java:633)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.PGStream.createSocket(PGStream.java:238)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.PGStream.<init>(PGStream.java:98)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:100)
Mar 22 09:46:04 mail1 java[56244]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:215)
Mar 22 09:46:04 mail1 java[56244]: #011... 37 more
Mar 22 09:46:04 mail1 systemd[1]: carbonio-message-dispatcher.service: Scheduled restart job, restart counter is at 61.
Mar 22 09:46:04 mail1 systemd[1]: carbonio-ws-collaboration.service: Main process exited, code=exited, status=1/FAILURE
Mar 22 09:46:04 mail1 systemd[1]: carbonio-ws-collaboration.service: Failed with result 'exit-code'.
Mar 22 09:46:04 mail1 systemd[1]: Stopped Carbonio Message Dispatcher daemon.
Mar 22 09:46:04 mail1 systemd[1]: Started Carbonio Message Dispatcher daemon.
Mar 22 09:46:04 mail1 mongooseimctl[56531]: Root: /opt/zextras/common/lib/mongooseim
Mar 22 09:46:04 mail1 mongooseim[56531]: Starting up
Mar 22 09:46:04 mail1 mongooseimctl[56531]: Exec: /opt/zextras/common/lib/mongooseim/erts-12.3/bin/erlexec -noshell -noinput +Bd -boot /opt/zextras/common/lib/mongooseim/releases/6.1.0/start -embedded -config /etc/carbonio/message-dispatcher/app.config -args_file /etc/carbonio/message-dispatcher/vm.args -args_file /etc/carbonio/message-dispatcher/vm.dist.args -- foreground
Mar 22 09:46:04 mail1 mongooseimctl[56531]: 09:46:04.419 [error] Failed to open log file /opt/zextras/common/lib/mongooseim/log/error.log with error permission denied
Mar 22 09:46:04 mail1 mongooseimctl[56531]: 09:46:04.419 [error] Failed to open log file /opt/zextras/common/lib/mongooseim/log/console.log with error permission denied
Mar 22 09:46:04 mail1 mongooseimctl[56531]: 09:46:04.719 [info] Application mnesia exited with reason: stopped
Mar 22 09:46:04 mail1 mongooseimctl[56531]: when=2024-03-22T08:46:04.713974+00:00 level=notice pid=<0.44.0> at=application_controller:info_exited/3:2119 report=[{application,mnesia},{exited,stopped},{type,permanent}] label={application_controller,exit}
Mar 22 09:46:04 mail1 mongooseimctl[56531]: 09:46:04.906 [error] Failed to open crash log file /opt/zextras/common/lib/mongooseim/log/crash.log with error: permission denied
Mar 22 09:46:05 mail1 mongooseimctl[56531]: when=2024-03-22T08:46:05.182605+00:00 level=error what=rdbms_connection_attempt_error pid=<0.479.0> at=mongoose_rdbms:connect/4:899 sleep_for=1 error={error,econnrefused} backend=pgsql
Mar 22 09:46:05 mail1 mongooseimctl[56531]: when=2024-03-22T08:46:05.184453+00:00 level=error reason=econnrefused pid=<0.480.0> at=gen_server:error_info/7:949 state={state,undefined,undefined,<<>>,undefined,on_message,undefined,{[],[]},undefined,undefined,undefined,undefined,[],information_redacted,[],undefined,undefined,undefined,undefined,undefined} name=<0.480.0> log= last_message="{command,epgsql_cmd_connect,#{codecs => [{mongoose_rdbms_pgsql_codec_boolean,[]}],database => \"carbonio-message-dispatcher-db\",host => \"127.78.0.10\",password => #Fun<epgsql_cmd_connect.0.29916615>,port => 20000,username => \"carbonio-message-dispatcher-db\"}}" label={gen_server,terminate} client_info="{<0.479.0>,{'wpool_pool-mongoose_wpool$rdbms$global$default-1',[{timer,sleep,1,[{file,\"timer.erl\"},{line,152}]},{mongoose_rdbms,connect,4,[{file,\"/tmp/package/src/MongooseIM-6.1.0/src/rdbms/mongoose_rdbms.erl\"},{line,901}]},{mongoose_rdbms,init,1,[{file,\"/tmp/package/src/MongooseIM-6.1.0/src/rdbms/mongoose_rdbms.erl\"},{line,623}]},{wpool_process,init,1,[{file,\"/tmp/package/src/MongooseIM-6.1.0/_build/default/lib/worker_pool/src/wpool_process.erl\"},{line,80}]},{gen_server,init_it,2,[{file,\"gen_server.erl\"},{line,423}]},{gen_server,init_it,6,[{file,\"gen_server.erl\"},{line,390}]},{proc_lib,init_p_do_apply,3,[{file,\"proc_lib.erl\"},{line,226}]}]}}"
Mar 22 09:46:05 mail1 mongooseimctl[56531]: 09:46:05.184 [error] gen_server <0.480.0> terminated with reason: econnrefused
Mar 22 09:46:05 mail1 mongooseimctl[56531]: when=2024-03-22T08:46:05.185176+00:00 level=error pid=<0.480.0> at=proc_lib:crash_report/4:525 report="[[{initial_call,{epgsql_sock,init,['Argument__1']}},{pid,<0.480.0>},{registered_name,[]},{error_info,{exit,econnrefused,[{gen_server,handle_common_reply,8,[{file,\"gen_server.erl\"},{line,811}]},{proc_lib,init_p_do_apply,3,[{file,\"proc_lib.erl\"},{line,226}]}]}},{ancestors,['wpool_pool-mongoose_wpool$rdbms$global$default-1','wpool_pool-mongoose_wpool$rdbms$global$default-process-sup','mongoose_wpool$rdbms$global$default',mongoose_wpool_rdbms_sup,mongoose_wpool_sup,ejabberd_sup,<0.329.0>]},{message_queue_len,0},{messages,[]},{links,[<0.479.0>]},{dictionary,[]},{trap_exit,false},{status,running},{heap_size,6772},{stack_size,29},{reductions,28426}],[]]" label={proc_lib,crash}
Mar 22 09:46:05 mail1 mongooseimctl[56531]: 09:46:05.185 [error] CRASH REPORT Process <0.480.0> with 0 neighbours exited with reason: econnrefused in gen_server:handle_common_reply/8 line 811
Mar 22 09:46:05 mail1 carbonio-files[56450]: 09:46:05.369 [main] ERROR com.zaxxer.hikari.pool.HikariPool - HikariPool-1 - Exception during pool initialization.
Mar 22 09:46:05 mail1 carbonio-files[56450]: org.postgresql.util.PSQLException: Connection to 127.78.0.2:20000 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:342)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:54)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:263)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.Driver.makeConnection(Driver.java:443)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.Driver.connect(Driver.java:297)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:138)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:359)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:201)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:470)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.HikariPool.checkFailFast(HikariPool.java:561)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:100)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:112)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebeaninternal.server.core.DefaultContainer.checkDataSource(DefaultContainer.java:252)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebeaninternal.server.core.DefaultContainer.createServer(DefaultContainer.java:89)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebeaninternal.server.core.DefaultContainer.createServer(DefaultContainer.java:29)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebean.DatabaseFactory.createInternal(DatabaseFactory.java:136)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebean.DatabaseFactory.create(DatabaseFactory.java:85)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebean.DatabaseFactory.createWithContextClassLoader(DatabaseFactory.java:111)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zextras.carbonio.files.dal.EbeanDatabaseManager.start(EbeanDatabaseManager.java:266)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zextras.carbonio.files.Boot.boot(Boot.java:52)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zextras.carbonio.files.Boot.main(Boot.java:33)
Mar 22 09:46:05 mail1 carbonio-files[56450]: Caused by: java.net.ConnectException: Connection refused
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/sun.nio.ch.Net.pollConnect(Native Method)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:547)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:602)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/java.net.Socket.connect(Socket.java:633)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.PGStream.createSocket(PGStream.java:243)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.PGStream.<init>(PGStream.java:98)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:132)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:258)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011... 20 common frames omitted
Mar 22 09:46:05 mail1 carbonio-files[56450]: 09:46:05.373 [main] ERROR com.zextras.carbonio.files.Boot - Service stopped unexpectedly:
Mar 22 09:46:05 mail1 carbonio-files[56450]: javax.persistence.PersistenceException: org.postgresql.util.PSQLException: Connection to 127.78.0.2:20000 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebeaninternal.server.core.DefaultContainer.checkDataSource(DefaultContainer.java:258)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebeaninternal.server.core.DefaultContainer.createServer(DefaultContainer.java:89)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebeaninternal.server.core.DefaultContainer.createServer(DefaultContainer.java:29)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebean.DatabaseFactory.createInternal(DatabaseFactory.java:136)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebean.DatabaseFactory.create(DatabaseFactory.java:85)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebean.DatabaseFactory.createWithContextClassLoader(DatabaseFactory.java:111)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zextras.carbonio.files.dal.EbeanDatabaseManager.start(EbeanDatabaseManager.java:266)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zextras.carbonio.files.Boot.boot(Boot.java:52)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zextras.carbonio.files.Boot.main(Boot.java:33)
Mar 22 09:46:05 mail1 carbonio-files[56450]: Caused by: org.postgresql.util.PSQLException: Connection to 127.78.0.2:20000 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:342)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:54)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:263)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.Driver.makeConnection(Driver.java:443)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.Driver.connect(Driver.java:297)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:138)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:359)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:201)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:470)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.HikariPool.checkFailFast(HikariPool.java:561)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.pool.HikariPool.<init>(HikariPool.java:100)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:112)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at io.ebeaninternal.server.core.DefaultContainer.checkDataSource(DefaultContainer.java:252)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011... 8 common frames omitted
Mar 22 09:46:05 mail1 carbonio-files[56450]: Caused by: java.net.ConnectException: Connection refused
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/sun.nio.ch.Net.pollConnect(Native Method)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:547)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:602)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at java.base/java.net.Socket.connect(Socket.java:633)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.PGStream.createSocket(PGStream.java:243)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.PGStream.<init>(PGStream.java:98)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:132)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:258)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011... 20 common frames omitted
Mar 22 09:46:05 mail1 carbonio-files[56450]: Exception in thread "main" java.lang.NullPointerException: Cannot invoke "com.zextras.carbonio.files.tasks.PurgeService.stop()" because "this.purgeService" is null
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zextras.carbonio.files.Boot.boot(Boot.java:64)
Mar 22 09:46:05 mail1 carbonio-files[56450]: #011at com.zextras.carbonio.files.Boot.main(Boot.java:33)
Mar 22 09:46:05 mail1 systemd[1]: carbonio-files.service: Main process exited, code=exited, status=1/FAILURE
Mar 22 09:46:05 mail1 systemd[1]: carbonio-files.service: Failed with result 'exit-code'.

Posted by: @max_s

↑

Thanks for helping me out. What I have done is restored my server with the working copy of Carbonio 24.1. I had to because my 24.3 was not working anymore...

It seems that there is already a problem with 24.1. 

# systemctl status service-discover.service

● service-discover.service - Service discover agent for Zextras
Loaded: loaded (/lib/systemd/system/service-discover.service; enabled; vendor preset: enabled)
Active: activating (auto-restart) (Result: exit-code) since Fri 2024-03-22 09:36:15 CET; 11s ago
Docs: https://docs.zextras.com/
Process: 35111 ExecStart=/usr/bin/service-discoverd agent (code=exited, status=236/SMACK_PROCESS_LABEL)
Main PID: 35111 (code=exited, status=236/SMACK_PROCESS_LABEL)

The problem is the same as in your previous post, service-discover not running. have you tried the advice at the end of the previous message?

See "systemctl status service-discover.service" and "journalctl -xe" for details.

This should give  you more precise error messages, because the extra-large log doesn't help much, since these are almost all errors caused by service discover not running

So from the many failed upgrade attempts on these forums, it seems like this upgrade path is NOT the way to go. IMHO, the safest method would be to create a new VM and import your data from the previous version of Ubuntu, no? Carbonio needs to spend some time on streamlining their upgrade process in general as this upgrade seems to involve some serious downtime.

@stefanodavid 

I executed the upgrade description described in https://docs.zextras.com/carbonio/html/release/upgrade.html

So I installed PostgreSQL 16 on ubuntu 20.04 then I upgraded ubuntu and then I upgraded carbonio. When I upgraded carbonio I got stuck at the "pending-setups -a" step.

Insert the cluster credential password:

Executing all setup scripts...

--------------------------------------------------------------------------------
Executing /etc/zextras/pending-setups.d/carbonio-message-dispatcher.sh
Insert the cluster credential password:
Error determining policy ID: Get "http://127.0.0.1:8500/v1/acl/policies": dial tcp 127.0.0.1:8500: connect: connection refused
Setup failed: Cannot update policy for carbonio-message-dispatcher-policy
Setup script failed, keeping it
--------------------------------------------------------------------------------

So as you asked here are my output for systemctl status service-discover.service and journalctl -xe

systemctl status service-discover.service
● service-discover.service - Service discover agent for Zextras
Loaded: loaded (/lib/systemd/system/service-discover.service; enabled; vendor preset: enabled)
Active: activating (auto-restart) (Result: exit-code) since Mon 2024-04-01 08:32:19 CEST; 5s ago
Docs: https://docs.zextras.com/
Process: 19593 ExecStart=/usr/bin/service-discoverd agent (code=exited, status=236/SMACK_PROCESS_LABEL)
Main PID: 19593 (code=exited, status=236/SMACK_PROCESS_LABEL)

root@mail1:~# journalctl -xe
Apr 01 08:33:08 mail1.bureaurotterdam.nl carbonio-files[21086]: at com.zextras.carbonio.files.Boot.boot(Boot.java:64)
Apr 01 08:33:08 mail1.bureaurotterdam.nl carbonio-files[21086]: at com.zextras.carbonio.files.Boot.main(Boot.java:33)
Apr 01 08:33:08 mail1.bureaurotterdam.nl systemd[1]: carbonio-files.service: Main process exited, code=exited, status=1/FAILURE
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ An ExecStart= process belonging to unit carbonio-files.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 1.
Apr 01 08:33:08 mail1.bureaurotterdam.nl systemd[1]: carbonio-files.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit carbonio-files.service has entered the 'failed' state with result 'exit-code'.
Apr 01 08:33:08 mail1.bureaurotterdam.nl systemd[1]: carbonio-files.service: Consumed 1.336s CPU time.
░░ Subject: Resources consumed by unit runtime
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit carbonio-files.service completed and consumed the indicated resources.
Apr 01 08:33:10 mail1.bureaurotterdam.nl mongooseimctl[21340]: when=2024-04-01T06:33:10.254638+00:00 level=error what=rdbms_connection_attempt_error pid=<0.505.0> at=mongoose_rdbms:connect/4:899 sleep_for=2 backend=pgsql error={error,ec>
Apr 01 08:33:10 mail1.bureaurotterdam.nl mongooseimctl[21340]: when=2024-04-01T06:33:10.254827+00:00 level=error reason=econnrefused pid=<0.514.0> at=gen_server:error_info/8:1373 last_message="{command,epgsql_cmd_connect,#{port => 20000>
Apr 01 08:33:10 mail1.bureaurotterdam.nl mongooseimctl[21340]: 08:33:10.255 [error] gen_server <0.514.0> terminated with reason: econnrefused
Apr 01 08:33:10 mail1.bureaurotterdam.nl mongooseimctl[21340]: when=2024-04-01T06:33:10.255325+00:00 level=error pid=<0.514.0> at=proc_lib:crash_report/4:584 report="[[{initial_call,{epgsql_sock,init,['Argument__1']}},{pid,<0.514.0>},{r>
Apr 01 08:33:10 mail1.bureaurotterdam.nl mongooseimctl[21340]: 08:33:10.255 [error] CRASH REPORT Process <0.514.0> with 0 neighbours exited with reason: econnrefused in gen_server:handle_common_reply/8 line 1208
Apr 01 08:33:10 mail1.bureaurotterdam.nl rabbitmq-server[12772]: 2024-04-01 08:33:10.577296+02:00 [error] <0.701.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}"
Apr 01 08:33:12 mail1.bureaurotterdam.nl mongooseimctl[21340]: when=2024-04-01T06:33:12.255602+00:00 level=error what=rdbms_connection_attempt_error pid=<0.505.0> at=mongoose_rdbms:connect/4:899 sleep_for=15 backend=pgsql error={error,e>
Apr 01 08:33:12 mail1.bureaurotterdam.nl mongooseimctl[21340]: when=2024-04-01T06:33:12.255769+00:00 level=error reason=econnrefused pid=<0.519.0> at=gen_server:error_info/8:1373 last_message="{command,epgsql_cmd_connect,#{port => 20000>
Apr 01 08:33:12 mail1.bureaurotterdam.nl mongooseimctl[21340]: when=2024-04-01T06:33:12.256157+00:00 level=error pid=<0.519.0> at=proc_lib:crash_report/4:584 report="[[{initial_call,{epgsql_sock,init,['Argument__1']}},{pid,<0.519.0>},{r>
Apr 01 08:33:12 mail1.bureaurotterdam.nl mongooseimctl[21340]: 08:33:12.255 [error] gen_server <0.519.0> terminated with reason: econnrefused
Apr 01 08:33:12 mail1.bureaurotterdam.nl mongooseimctl[21340]: 08:33:12.256 [error] CRASH REPORT Process <0.519.0> with 0 neighbours exited with reason: econnrefused in gen_server:handle_common_reply/8 line 1208
Apr 01 08:33:12 mail1.bureaurotterdam.nl systemd[1]: carbonio-ws-collaboration.service: Scheduled restart job, restart counter is at 27.
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ Automatic restarting of the unit carbonio-ws-collaboration.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Apr 01 08:33:12 mail1.bureaurotterdam.nl systemd[1]: Stopped Carbonio Workstream Collaboration daemon.
░░ Subject: A stop job for unit carbonio-ws-collaboration.service has finished
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A stop job for unit carbonio-ws-collaboration.service has finished.
░░
░░ The job identifier is 73690 and the job result is done.
Apr 01 08:33:12 mail1.bureaurotterdam.nl systemd[1]: carbonio-ws-collaboration.service: Consumed 1.737s CPU time.
░░ Subject: Resources consumed by unit runtime
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit carbonio-ws-collaboration.service completed and consumed the indicated resources.
Apr 01 08:33:12 mail1.bureaurotterdam.nl systemd[1]: Started Carbonio Workstream Collaboration daemon.
░░ Subject: A start job for unit carbonio-ws-collaboration.service has finished successfully
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A start job for unit carbonio-ws-collaboration.service has finished successfully.
░░
░░ The job identifier is 73690.
lines 2852-2913/2913 (END)

@myriad 

Absolutely True,

I am trying to migrate my old zimbra server to carbonio since december. After lots of hickups I had it finally working on ubuntu 20.04. So I copied all data with imapsync. created the users etc. Just before I wanted to go live I got an email from zextras that there is a new version 24.3 working on ubuntu 22.04.

So I thought lets upgrade. Trying to solve problems for two weeks now.

@stefanodavid 

Every time I try to fix a problem I get new errors so I am struggling for more then 2 weeks now.

I read lots of people are having more or less the same problem.

So this weekend I spent some time to install a fresh ubuntu 22.04 and Carbonio CE 24.3.0. version but I got lots of new problems.

I wrote a small tutorial myself.... take a look:

https://www.anahuac.eu/carbonio-upgrade-ubuntu-from-20-04-to-22-04/

thanks @anahuac.

Meanwhile my problem was solved by Sharif, but your tutorial is very clear and helpful !

I think that is also one of the problems now in documentation. There is a lot of contradictory and unclear information. 

So I hope the Carbonio guys from Zextras, who btw have done a very good job in building the Carbonio software, take a good look in the update and upgrade routines and documentation.