Hi friends
Today we present the following problem, I was reported that the mail had fallen and when trying to connect to the server was not possible, I had to restart it directly in console because it was inhibited.
After starting the server it has not been possible to start the carbonio services again
Host my.domain.com Stopping config service...Done. Stopping service webapp...Done. Stopping stats...Done. Stopping mta...Done. Stopping cbpolicyd...Done. Stopping opendkim...Done. Stopping amavis...Done. Stopping antivirus...Done. Stopping antispam...Done. Stopping proxy...Done. Stopping memcached...Done. Stopping mailbox...Done. Stopping directory-server...Done. Host my.domain.com Starting directory server...Done. Failed. Starting openldap...failed.
I was looking the logs while trying to start the services with zmcontrol start and this is what it shows:
Oct 15 19:57:22 myserver zimbramon[2810]: 2810:info: Starting services initiated by zmcontrol Oct 15 19:57:22 myserver slapd[2883]: @(#) $OpenLDAP: slapd 2.5.18 (Aug 27 2024 11:01:58) $#012#011root@96c4948bc304:/tmp/openldap/src/openldap-2.5.18/servers/slapd Oct 15 19:57:22 myserver slapd[2883]: sql_select option missing Oct 15 19:57:22 myserver slapd[2883]: auxpropfunc error no mechanism available Oct 15 19:57:22 myserver slapd[2883]: _sasl_plugin_load failed on sasl_auxprop_plug_init for plugin: sql Oct 15 19:57:22 myserver slapd[2884]: mdb_db_open: database "": mdb_dbi_open(/opt/zextras/data/ldap/mdb/db/ad2i) failed: MDB_CORRUPTED: Located page was wrong type (-30796). Oct 15 19:57:22 myserver slapd[2884]: backend_startup_one (type=mdb, suffix=""): bi_db_open failed! (-30796) Oct 15 19:57:22 myserver slapd[2884]: DIGEST-MD5 common mech free Oct 15 19:57:22 myserver slapd[2884]: slapd stopped. Oct 15 19:57:22 myserver slapd[2884]: DIGEST-MD5 common mech free Oct 15 19:57:22 myserver ldapsearch: DIGEST-MD5 common mech free Oct 15 19:57:23 myserver ldapsearch: DIGEST-MD5 common mech free Oct 15 19:57:25 myserver ldapsearch: DIGEST-MD5 common mech free Oct 15 19:57:26 myserver ldapsearch: DIGEST-MD5 common mech free Oct 15 19:57:30 myserver ldapsearch: message repeated 4 times: [ DIGEST-MD5 common mech free] Oct 15 19:57:31 myserver ldapsearch: DIGEST-MD5 common mech free Oct 15 19:57:32 myserver ldapsearch: DIGEST-MD5 common mech free Oct 15 19:58:03 myserver /postfix-script[3880]: the Postfix mail system is not running
The versions are these:
Carbonio
Carbonio Release 24.9.0
Ubuntu
Ubuntu 20.04.6 LTS
Can anyone help me please! I have a lot of mailboxes there and now everyone wants to shut my head off..
root@myserver:/tmp# systemctl status carbonio-* ● carbonio-docs-editor-sidecar.service - Carbonio Docs server sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-docs-editor-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:42 -04; 8s ago Docs: https://docs.zextras.com/zextras-suite-documentation/latest/ Process: 1125872 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/docs-editor/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-docs-editor (code=exited, status=1/FAILURE) Main PID: 1125872 (code=exited, status=1/FAILURE) ● carbonio-prometheus-openldap-exporter.service - Carbonio Prometheus OpenLDAP exporter Loaded: loaded (/lib/systemd/system/carbonio-prometheus-openldap-exporter.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2024-10-15 19:54:46 -04; 14h ago Main PID: 588 (carbonio-promet) Tasks: 12 (limit: 19123) Memory: 14.4M CGroup: /system.slice/carbonio-prometheus-openldap-exporter.service └─588 /usr/bin/carbonio-prometheus-openldap-exporter --config /etc/carbonio/carbonio-prometheus-openldap-exporter/carbonio-prometheus-openldap-exporter.yml Oct 16 09:53:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T09:53:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 09:54:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T09:54:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 09:55:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T09:55:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 09:56:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T09:56:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 09:57:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T09:57:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 09:58:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T09:58:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 09:59:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T09:59:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 10:00:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T10:00:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 10:01:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T10:01:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" Oct 16 10:02:46 myserver.contaboserver.net carbonio-prometheus-openldap-exporter[588]: time="2024-10-16T10:02:46-04:00" level=error msg="dial failed" component=scraper error="LDAP Result Code 200 \"Network Error\": dial tcp 127.0.0.1:389: connect: connection refused" ● carbonio-prometheus-consul-exporter.service - Carbonio Prometheus Consul exporter Loaded: loaded (/lib/systemd/system/carbonio-prometheus-consul-exporter.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2024-10-15 19:54:46 -04; 14h ago Main PID: 575 (carbonio-promet) Tasks: 5 (limit: 19123) Memory: 10.1M CGroup: /system.slice/carbonio-prometheus-consul-exporter.service └─575 /usr/bin/carbonio-prometheus-consul-exporter Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-prometheus-nginx-exporter.service - Carbonio Prometheus NGINX exporter Loaded: loaded (/lib/systemd/system/carbonio-prometheus-nginx-exporter.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2024-10-15 19:54:46 -04; 14h ago Main PID: 578 (carbonio-promet) Tasks: 7 (limit: 19123) Memory: 9.1M CGroup: /system.slice/carbonio-prometheus-nginx-exporter.service └─578 /usr/bin/carbonio-prometheus-nginx-exporter --nginx.scrape-uri= https://localhost/nginx_status --no-nginx.ssl-verify Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-docs-connector-sidecar.service - Carbonio docs connector sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-docs-connector-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:40 -04; 9s ago Docs: https://docs.zextras.com/zextras-suite-documentation/latest/ Process: 1125817 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/docs-connector/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-docs-connector (code=exited, status=1/FAILURE) Main PID: 1125817 (code=exited, status=1/FAILURE) Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-docs-connector-sidecar.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-docs-connector-sidecar.service: Failed with result 'exit-code'. ● carbonio-user-management-sidecar.service - Carbonio User Management sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-user-management-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:46 -04; 3s ago Docs: https://docs.zextras.com/zextras-suite-documentation/latest/ Process: 1126004 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/user-management/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-user-management (code=exited, status=1/FAILURE) Main PID: 1126004 (code=exited, status=1/FAILURE) ● carbonio-message-dispatcher-auth-sidecar.service - Carbonio Message Dispatcher auth sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-message-dispatcher-auth-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:40 -04; 9s ago Docs: https://docs.zextras.com/ Process: 1125818 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/message-dispatcher/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-message-dispatcher-auth (code=exited, status=1/FAILURE) Main PID: 1125818 (code=exited, status=1/FAILURE) ● carbonio-proxy-sidecar.service - NGINX carbonio proxy sidecar Loaded: loaded (/lib/systemd/system/carbonio-proxy-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:43 -04; 6s ago Docs: https://docs.zextras.com/ Process: 1125973 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/proxy/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-proxy (code=exited, status=1/FAILURE) Main PID: 1125973 (code=exited, status=1/FAILURE) Oct 16 10:02:43 myserver.contaboserver.net systemd[1]: carbonio-proxy-sidecar.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:43 myserver.contaboserver.net systemd[1]: carbonio-proxy-sidecar.service: Failed with result 'exit-code'. ● carbonio-preview-sidecar.service - Carbonio Preview sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-preview-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:40 -04; 9s ago Docs: https://docs.zextras.com/zextras-suite-documentation/latest/ Process: 1125820 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/preview/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-preview (code=exited, status=1/FAILURE) Main PID: 1125820 (code=exited, status=1/FAILURE) ● carbonio-prometheus-node-exporter.service - Carbonio Prometheus Node Exporter Loaded: loaded (/lib/systemd/system/carbonio-prometheus-node-exporter.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2024-10-15 19:54:46 -04; 14h ago Main PID: 582 (carbonio-promet) Tasks: 5 (limit: 19123) Memory: 11.8M CGroup: /system.slice/carbonio-prometheus-node-exporter.service └─582 /usr/bin/carbonio-prometheus-node-exporter --collector.textfile.directory /opt/zextras/zmstat/prometheus/ Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-files-sidecar.service - Carbonio Files sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-files-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:46 -04; 3s ago Docs: https://docs.zextras.com/zextras-suite-documentation/latest/ Process: 1125999 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/files/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-files (code=exited, status=1/FAILURE) Main PID: 1125999 (code=exited, status=1/FAILURE) ● carbonio-ws-collaboration-sidecar.service - Carbonio Workstream Collaboration sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-ws-collaboration-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:46 -04; 3s ago Docs: https://docs.zextras.com/ Process: 1126005 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/ws-collaboration/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-ws-collaboration (code=exited, status=1/FAILURE) Main PID: 1126005 (code=exited, status=1/FAILURE) ● carbonio-preview.service - Carbonio Preview daemon Loaded: loaded (/lib/systemd/system/carbonio-preview.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/carbonio-preview.service.d └─override.conf Active: active (running) since Tue 2024-10-15 19:56:44 -04; 14h ago Docs: https://docs.zextras.com/zextras-suite-documentation/latest/ Main PID: 1690 (carbonio-previe) Tasks: 5 (limit: 19123) Memory: 123.8M CGroup: /system.slice/carbonio-preview.service ├─1690 /bin/bash /usr/bin/carbonio-preview-start.sh ├─1716 /usr/bin/python3 /opt/zextras/common/bin/gunicorn app.controller:app --config /opt/zextras/common/lib/python3.8/site-packages/app/gunicorn.conf.py ├─2059 /usr/bin/python3 /opt/zextras/common/bin/gunicorn app.controller:app --config /opt/zextras/common/lib/python3.8/site-packages/app/gunicorn.conf.py └─2060 /usr/bin/python3 /opt/zextras/common/bin/gunicorn app.controller:app --config /opt/zextras/common/lib/python3.8/site-packages/app/gunicorn.conf.py Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-prometheus-mysqld-exporter.service - Carbonio Prometheus MySQL exporter Loaded: loaded (/lib/systemd/system/carbonio-prometheus-mysqld-exporter.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2024-10-15 19:54:46 -04; 14h ago Main PID: 576 (carbonio-promet) Tasks: 5 (limit: 19123) Memory: 9.7M CGroup: /system.slice/carbonio-prometheus-mysqld-exporter.service └─576 /usr/bin/carbonio-prometheus-mysqld-exporter --config.my-cnf /etc/carbonio/carbonio-prometheus-mysqld-exporter/carbonio-prometheus-mysqld-exporter.cnf Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-clamav-sidecar.service - Carbonio clamav sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-clamav-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:40 -04; 9s ago Docs: https://docs.zextras.com/ Process: 1125815 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/clamav/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-clamav (code=exited, status=1/FAILURE) Main PID: 1125815 (code=exited, status=1/FAILURE) Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-clamav-sidecar.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-clamav-sidecar.service: Failed with result 'exit-code'. ● carbonio-message-dispatcher-xmpp-sidecar.service - Carbonio Message Dispatcher XMPP sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-message-dispatcher-xmpp-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:42 -04; 8s ago Docs: https://docs.zextras.com/ Process: 1125875 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/message-dispatcher/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-message-dispatcher-xmpp (code=exited, status=1/FAILURE) Main PID: 1125875 (code=exited, status=1/FAILURE) ● carbonio-message-dispatcher-db-sidecar.service - Carbonio Message Dispatcher database sidecar Loaded: loaded (/lib/systemd/system/carbonio-message-dispatcher-db-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:45 -04; 4s ago Docs: https://docs.zextras.com/ Process: 1125987 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/message-dispatcher-db/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-message-dispatcher-db (code=exited, status=1/FAILURE) Main PID: 1125987 (code=exited, status=1/FAILURE) ● carbonio-storages-sidecar.service - Storages-CE sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-storages-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:40 -04; 9s ago Docs: https://docs.zextras.com/zextras-suite-documentation/latest/ Process: 1125821 ExecStart=/usr/bin/consul connect envoy -token-file /etc/zextras/carbonio-storages/token -admin-bind localhost:0 -sidecar-for carbonio-storages (code=exited, status=1/FAILURE) Main PID: 1125821 (code=exited, status=1/FAILURE) Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-storages-sidecar.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-storages-sidecar.service: Failed with result 'exit-code'. ● carbonio-docs-connector.service - Carbonio docs connector daemon Loaded: loaded (/lib/systemd/system/carbonio-docs-connector.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/carbonio-docs-connector.service.d └─override.conf Active: active (running) since Tue 2024-10-15 19:56:44 -04; 14h ago Main PID: 1673 (carbonio-docs-c) Tasks: 32 (limit: 19123) Memory: 89.5M CGroup: /system.slice/carbonio-docs-connector.service ├─1673 /bin/bash /usr/bin/carbonio-docs-connector └─1711 /opt/zextras/common/bin/java -Djava.net.preferIPv4Stack=true -Xmx128m -DLOG_LEVEL=warn -jar /usr/share/carbonio/carbonio-docs-connector.jar Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-mailbox-sidecar.service - Mailbox carbonio proxy sidecar Loaded: loaded (/lib/systemd/system/carbonio-mailbox-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:46 -04; 3s ago Docs: https://docs.zextras.com/ Process: 1126001 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/mailbox/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-mailbox (code=exited, status=1/FAILURE) Main PID: 1126001 (code=exited, status=1/FAILURE) ● carbonio-prometheus.service - Carbonio Prometheus service Loaded: loaded (/lib/systemd/system/carbonio-prometheus.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2024-10-15 19:56:44 -04; 14h ago Main PID: 1698 (prometheus) Tasks: 12 (limit: 19123) Memory: 145.3M CGroup: /system.slice/carbonio-prometheus.service └─1698 /usr/bin/prometheus --config.file=/etc/carbonio/carbonio-prometheus/prometheus.yml --storage.tsdb.path=/var/lib/prometheus/data --storage.tsdb.retention.time=30d --enable-feature=memory-snapshot-on-shutdown --web.enable-lifecycle --web.enable-admin-api --log.level=info --storage.tsdb.max-block-duration=2h --storage.tsdb.min-block-duration=2h --web.console.templates=/etc/carbonio/carbonio-prometheus/consoles --web.console.libraries=/etc/carbonio/carbonio-prometheus/console_libraries Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.279Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=postgres msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.279Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=process msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.281Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=consul msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.281Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=ldap msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.281Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=pgpool msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.281Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=clamav msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.281Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=nginx msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.281Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=mysql msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.285Z caller=consul.go:385 level=error component="discovery manager scrape" discovery=consul config=node msg="Error refreshing service list" err="Get \"http://localhost:8500/v1/catalog/services?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" Oct 16 10:02:47 myserver.contaboserver.net prometheus[1698]: ts=2024-10-16T14:02:47.286Z caller=consul.go:516 level=error component="discovery manager scrape" discovery=consul config=advanced-powerstore msg="Error refreshing service" service=carbonio-mailbox tags= err="Get \"http://localhost:8500/v1/health/service/carbonio-mailbox?dc=dc1&stale=&wait=120000ms\": dial tcp 127.0.0.1:8500: connect: connection refused" ● carbonio-message-broker-sidecar.service - Carbonio message broker sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-message-broker-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:46 -04; 3s ago Docs: https://docs.zextras.com/ Process: 1126002 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/message-broker/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-message-broker (code=exited, status=1/FAILURE) Main PID: 1126002 (code=exited, status=1/FAILURE) ● carbonio-message-broker.service - Carbonio message broker daemon Loaded: loaded (/lib/systemd/system/carbonio-message-broker.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2024-10-15 19:54:56 -04; 14h ago Main PID: 574 (beam.smp) Tasks: 36 (limit: 19123) Memory: 129.2M CGroup: /system.slice/carbonio-message-broker.service ├─574 /opt/zextras/common/lib/erlang/erts-14.2.5.2/bin/beam.smp -W w -MBas ageffcbf -MHas ageffcbf -MBlmbcs 512 -MHlmbcs 512 -MMmcs 30 -pc unicode -P 1048576 -t 5000000 -stbt db -zdbbl 128000 -sbwt none -sbwtdcpu none -sbwtdio none -- -root /opt/zextras/common/lib/erlang -bindir /opt/zextras/common/lib/erlang/erts-14.2.5.2/bin -progname erl -- -home /var/lib/carbonio-message-broker -- -pa -noshell -noinput -s rabbit boot -boot start_sasl -syslog logger [] -syslog syslog_error_logger false -kernel prevent_overlapping_partitions false ├─682 erl_child_setup 32768 ├─808 sh -s disksup ├─810 /opt/zextras/common/lib/erlang/lib/os_mon-2.9.1/priv/bin/memsup ├─811 /opt/zextras/common/lib/erlang/lib/os_mon-2.9.1/priv/bin/cpu_sup ├─841 /opt/zextras/common/lib/erlang/erts-14.2.5.2/bin/inet_gethost 4 ├─842 /opt/zextras/common/lib/erlang/erts-14.2.5.2/bin/inet_gethost 4 ├─852 /opt/zextras/common/lib/erlang/erts-14.2.5.2/bin/epmd -daemon └─917 /bin/sh -s rabbit_disk_monitor Oct 16 10:00:25 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:00:25.701836-04:00 [error] <0.10122.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:00:40 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:00:40.701645-04:00 [error] <0.10124.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:00:55 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:00:55.701658-04:00 [error] <0.10132.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:01:10 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:01:10.703097-04:00 [error] <0.10134.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:01:25 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:01:25.707235-04:00 [error] <0.10136.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:01:40 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:01:40.702276-04:00 [error] <0.10138.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:01:55 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:01:55.702466-04:00 [error] <0.10140.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:02:10 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:02:10.701733-04:00 [error] <0.10142.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:02:25 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:02:25.702836-04:00 [error] <0.10145.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" Oct 16 10:02:40 myserver.contaboserver.net rabbitmq-server[574]: 2024-10-16 10:02:40.701572-04:00 [error] <0.10147.0> Error running Consul health check: "{failed_connect,[{to_address,{\"127.0.0.1\",8500}},{inet,[inet],econnrefused}]}" ● carbonio-mta-sidecar.service - Carbonio mta sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-mta-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:46 -04; 3s ago Docs: https://docs.zextras.com/ Process: 1126003 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/mta/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-mta (code=exited, status=1/FAILURE) Main PID: 1126003 (code=exited, status=1/FAILURE) Oct 16 10:02:46 myserver.contaboserver.net systemd[1]: carbonio-mta-sidecar.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:46 myserver.contaboserver.net systemd[1]: carbonio-mta-sidecar.service: Failed with result 'exit-code'. ● carbonio-storages.service - Carbonio Storages-CE daemon Loaded: loaded (/lib/systemd/system/carbonio-storages.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/carbonio-storages.service.d └─override.conf Active: active (running) since Tue 2024-10-15 19:56:44 -04; 14h ago Main PID: 1700 (carbonio-storag) Tasks: 10 (limit: 19123) Memory: 67.1M CGroup: /system.slice/carbonio-storages.service └─1700 /opt/zextras/common/bin/carbonio-storages Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-message-dispatcher-http-sidecar.service - Carbonio Message Dispatcher HTTP sidecar proxy Loaded: loaded (/lib/systemd/system/carbonio-message-dispatcher-http-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:40 -04; 9s ago Docs: https://docs.zextras.com/ Process: 1125819 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/message-dispatcher/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-message-dispatcher-http (code=exited, status=1/FAILURE) Main PID: 1125819 (code=exited, status=1/FAILURE) Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-message-dispatcher-http-sidecar.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-message-dispatcher-http-sidecar.service: Failed with result 'exit-code'. ● carbonio-files-db-sidecar.service - Carbonio Files database sidecar Loaded: loaded (/lib/systemd/system/carbonio-files-db-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:42 -04; 8s ago Docs: https://docs.zextras.com/ Process: 1125873 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/files-db/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-files-db (code=exited, status=1/FAILURE) Main PID: 1125873 (code=exited, status=1/FAILURE) ● carbonio-ws-collaboration.service - Carbonio Workstream Collaboration daemon Loaded: loaded (/lib/systemd/system/carbonio-ws-collaboration.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:38 -04; 11s ago Docs: https://docs.zextras.com/ Process: 1125750 ExecStart=/usr/bin/carbonio-ws-collaboration (code=exited, status=1/FAILURE) Main PID: 1125750 (code=exited, status=1/FAILURE) Oct 16 10:02:38 myserver.contaboserver.net systemd[1]: carbonio-ws-collaboration.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:38 myserver.contaboserver.net systemd[1]: carbonio-ws-collaboration.service: Failed with result 'exit-code'. ● carbonio-message-dispatcher.service - Carbonio Message Dispatcher daemon Loaded: loaded (/lib/systemd/system/carbonio-message-dispatcher.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/carbonio-message-dispatcher.service.d └─override.conf Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:49 -04; 1s ago Docs: https://docs.zextras.com/ Process: 1125907 ExecStart=/opt/zextras/common/bin/mongooseimctl foreground (code=exited, status=1/FAILURE) Main PID: 1125907 (code=exited, status=1/FAILURE) ● carbonio-mailbox-admin-sidecar.service - Carbonio Mailbox Admin proxy sidecar Loaded: loaded (/lib/systemd/system/carbonio-mailbox-admin-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:46 -04; 3s ago Docs: https://docs.zextras.com/ Process: 1126000 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/mailbox-admin/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-mailbox-admin (code=exited, status=1/FAILURE) Main PID: 1126000 (code=exited, status=1/FAILURE) Oct 16 10:02:46 myserver.contaboserver.net systemd[1]: carbonio-mailbox-admin-sidecar.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:46 myserver.contaboserver.net systemd[1]: carbonio-mailbox-admin-sidecar.service: Failed with result 'exit-code'. ● carbonio-mailbox-nslookup-sidecar.service - Carbonio Mailbox NSLookup proxy sidecar Loaded: loaded (/lib/systemd/system/carbonio-mailbox-nslookup-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:42 -04; 8s ago Docs: https://docs.zextras.com/ Process: 1125874 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/mailbox-nslookup/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-mailbox-nslookup (code=exited, status=1/FAILURE) Main PID: 1125874 (code=exited, status=1/FAILURE) ● carbonio-message-dispatcher-auth.service - Carbonio Message Dispatcher auth daemon Loaded: loaded (/lib/systemd/system/carbonio-message-dispatcher-auth.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2024-10-15 19:56:44 -04; 14h ago Docs: https://docs.zextras.com/ Main PID: 1683 (java) Tasks: 27 (limit: 19123) Memory: 49.5M CGroup: /system.slice/carbonio-message-dispatcher-auth.service └─1683 /opt/zextras/common/bin/java -Djava.net.preferIPv4Stack=true -jar /opt/zextras/lib/jars/carbonio-message-dispatcher-auth.jar Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-files.service - Carbonio Files daemon Loaded: loaded (/lib/systemd/system/carbonio-files.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/carbonio-files.service.d └─override.conf Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:38 -04; 11s ago Process: 1125780 ExecStart=/usr/bin/carbonio-files (code=exited, status=1/FAILURE) Main PID: 1125780 (code=exited, status=1/FAILURE) Oct 16 10:02:38 myserver.contaboserver.net systemd[1]: carbonio-files.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:38 myserver.contaboserver.net systemd[1]: carbonio-files.service: Failed with result 'exit-code'. ● carbonio-user-management.service - Carbonio User Management daemon Loaded: loaded (/lib/systemd/system/carbonio-user-management.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/carbonio-user-management.service.d └─override.conf Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:36 -04; 14s ago Process: 1125728 ExecStart=/usr/bin/carbonio-user-management (code=exited, status=1/FAILURE) Main PID: 1125728 (code=exited, status=1/FAILURE) Oct 16 10:02:36 myserver.contaboserver.net systemd[1]: carbonio-user-management.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:36 myserver.contaboserver.net systemd[1]: carbonio-user-management.service: Failed with result 'exit-code'. ● carbonio-docs-editor.service - Carbonio Docs Server Loaded: loaded (/lib/systemd/system/carbonio-docs-editor.service; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/carbonio-docs-editor.service.d └─override.conf Active: failed (Result: exit-code) since Tue 2024-10-15 19:54:51 -04; 14h ago Process: 890 ExecStart=/opt/zextras/docs/bin/coolwsd --version --o:sys_template_path=/opt/zextras/docs/generated/systemplate --o:child_root_path=/opt/zextras/docs/generated/child-roots --o:file_server_root_path=/opt/zextras/docs/share/coolwsd --port=10000 (code=exited, status=78) Main PID: 890 (code=exited, status=78) Warning: journal has been rotated since unit was started, output may be incomplete. ● carbonio-clamav-signature-provider-sidecar.service - NGINX Carbonio ClamAV signature provider sidecar Loaded: loaded (/lib/systemd/system/carbonio-clamav-signature-provider-sidecar.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2024-10-16 10:02:40 -04; 9s ago Docs: https://docs.zextras.com/ Process: 1125816 ExecStart=/usr/bin/consul connect envoy -token-file /etc/carbonio/clamav-signature-provider/service-discover/token -admin-bind localhost:0 -sidecar-for carbonio-clamav-signature-provider (code=exited, status=1/FAILURE) Main PID: 1125816 (code=exited, status=1/FAILURE) Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-clamav-signature-provider-sidecar.service: Main process exited, code=exited, status=1/FAILURE Oct 16 10:02:40 myserver.contaboserver.net systemd[1]: carbonio-clamav-signature-provider-sidecar.service: Failed with result 'exit-code'.
did you figure it out?
maybe you want to join us on Telegram so we can get into some basic diagnostics? @CarbonioMail
what it looks like from here is that your LDAP database somehow crashed and that's not good at all... =(