Helle,
Since the last release I can not login anymore, I did ot get any help on the forum.
Today I find that a service is failing:
systemctl status carbonio-user-management.service
● carbonio-user-management.service - Carbonio User Management daemon
Loaded: loaded (/lib/systemd/system/carbonio-user-management.service; enabled; vendor preset: enabled)
Drop-In: /etc/systemd/system/carbonio-user-management.service.d
└─override.conf
Active: activating (auto-restart) (Result: exit-code) since Sat 2024-08-24 16:35:11 CEST; 1s ago
Process: 60818 ExecStart=/opt/zextras/common/bin/java -Djava.net.preferIPv4Stack=true -Xmx1024m -Xms1024m -jar /usr/bin/carbonio/user-management/carbonio>
Main PID: 60818 (code=exited, status=1/FAILURE)
Regards
JP P
Hello,
I never get a response to submitted problems?
Regards
JP P
What is the outcome of:
su - zextras -c "zmcontrol -v && zmcontrol status"
consul members
systemctl list-units carbonio*
curl -s -v http://127.78.0.4:10000/health | jq
journalctl -u carbonio-user-management.service
Regards,
Sharif
Hello,
Here is the results of the five commands :
==============================================================================================================================
1) ------------------------------------------------------
su - zextras -c "zmcontrol -v && zmcontrol status"
Carbonio Release 24.7.1
Host mail.jpp.fr
amavis Running
antispam Running
antivirus Running
directory-server Running
mailbox Stopped
mysql.server is not running.
memcached Running
mta Running
opendkim Running
proxy Running
service webapp Stopped
mysql.server is not running.
service-discover Running
stats Stopped
config service Running
2) -----------------------------------------------------------------------------
consul members
Node Address Status Type Build Protocol DC Segment
mail-jpp-fr 192.168.2.21:8301 alive server 1.10.12 2 dc1 <all>
3) -----------------------------------------------------------------------------
systemctl list-units carbonio* 2>&1 | tee /root/toto
UNIT LOAD ACTIVE SUB DESCRIPTION
carbonio-clamav-sidecar.service loaded active running Carbonio clamav sidecar proxy
carbonio-clamav-signature-provider-sidecar.service loaded active running NGINX Carbonio ClamAV signature provider sidecar
carbonio-docs-connector-sidecar.service loaded active running Carbonio docs connector sidecar proxy
carbonio-docs-connector.service loaded active running Carbonio docs connector daemon
carbonio-docs-editor-sidecar.service loaded active running Carbonio Docs server sidecar proxy
carbonio-docs-editor.service loaded active running Carbonio Docs Server
carbonio-files-db-sidecar.service loaded active running Carbonio Files database sidecar
carbonio-files-sidecar.service loaded active running Carbonio Files sidecar proxy
carbonio-files.service loaded active running Carbonio Files daemon
carbonio-mailbox-admin-sidecar.service loaded activating auto-restart Carbonio Mailbox Admin proxy sidecar
carbonio-mailbox-nslookup-sidecar.service loaded activating auto-restart Carbonio Mailbox NSLookup proxy sidecar
carbonio-mailbox-sidecar.service loaded active running Mailbox carbonio proxy sidecar
carbonio-mta-sidecar.service loaded active running Carbonio mta sidecar proxy
carbonio-preview-sidecar.service loaded active running Carbonio Preview sidecar proxy
carbonio-preview.service loaded active running Carbonio Preview daemon
carbonio-prometheus-consul-exporter.service loaded active running Carbonio Prometheus Consul exporter
carbonio-prometheus-mysqld-exporter.service loaded active running Carbonio Prometheus MySQL exporter
carbonio-prometheus-nginx-exporter.service loaded active running Carbonio Prometheus NGINX exporter
carbonio-prometheus-node-exporter.service loaded active running Carbonio Prometheus Node Exporter
carbonio-prometheus-openldap-exporter.service loaded active running Carbonio Prometheus OpenLDAP exporter
carbonio-prometheus.service loaded active running Carbonio Prometheus service
carbonio-proxy-sidecar.service loaded active running NGINX carbonio proxy sidecar
carbonio-storages-sidecar.service loaded active running Storages-CE sidecar proxy
carbonio-storages.service loaded active running Carbonio Storages-CE daemon
carbonio-user-management-sidecar.service loaded active running Carbonio User Management sidecar proxy
carbonio-user-management.service loaded activating auto-restart Carbonio User Management daemon
carbonio.service loaded active exited LSB: Carbonio Services
carbonio-certbot.timer loaded active waiting Run Carbonio Certbot twice daily
LOAD = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB = The low-level unit activation state, values depend on unit type.
4) --------------------------------------------------------------------------
curl -s -v http://127.78.0.4:10000/health | jq
* Trying 127.78.0.4:10000...
* TCP_NODELAY set
* connect to 127.78.0.4 port 10000 failed: Connection refused
* Failed to connect to 127.78.0.4 port 10000: Connection refused
* Closing connection 0
5) -----------------------------------------------------------------------------------------
journalctl -u carbonio-user-management.service -b
sept. 04 18:24:53 mail.jpp.fr systemd[1]: Started Carbonio User Management daemon.
sept. 04 18:24:53 mail.jpp.fr java[9423]: Exception in thread "main" com.google.inject.ProvisionException: Unable to provision, see the follo>
sept. 04 18:24:53 mail.jpp.fr java[9423]: 1) [Guice/ErrorInCustomProvider]: InaccessibleWSDLException: 2 counts of InaccessibleWSDLException.
sept. 04 18:24:53 mail.jpp.fr java[9423]: IOException: Server returned HTTP response code: 503 for URL: http://127.78.0.5:20000/service/wsdl/>
sept. 04 18:24:53 mail.jpp.fr java[9423]: IOException: Server returned HTTP response code: 503 for URL: http://127.78.0.5:20000/service/wsdl/>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at UserManagementModule.provideServiceClient(UserManagementModule.java:54)
sept. 04 18:24:53 mail.jpp.fr java[9423]: while locating ServiceClient
sept. 04 18:24:53 mail.jpp.fr java[9423]: Learn more:
sept. 04 18:24:53 mail.jpp.fr java[9423]: https://github.com/google/guice/wiki/ERROR_IN_CUSTOM_PROVIDER
sept. 04 18:24:53 mail.jpp.fr java[9423]: 1 error
sept. 04 18:24:53 mail.jpp.fr java[9423]: ======================
sept. 04 18:24:53 mail.jpp.fr java[9423]: Full classname legend:
sept. 04 18:24:53 mail.jpp.fr java[9423]: ======================
sept. 04 18:24:53 mail.jpp.fr java[9423]: IOException: "java.io.IOException"
sept. 04 18:24:53 mail.jpp.fr java[9423]: InaccessibleWSDLException: "com.sun.xml.ws.wsdl.parser.InaccessibleWSDLException"
sept. 04 18:24:53 mail.jpp.fr java[9423]: ServiceClient: "com.zextras.mailbox.client.service.ServiceClient"
sept. 04 18:24:53 mail.jpp.fr java[9423]: UserManagementModule: "com.zextras.carbonio.user_management.config.UserManagementModule"
sept. 04 18:24:53 mail.jpp.fr java[9423]: ========================
sept. 04 18:24:53 mail.jpp.fr java[9423]: End of classname legend:
sept. 04 18:24:53 mail.jpp.fr java[9423]: ========================
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.InternalProvisionException.toProvisionException(InternalProvi>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.InjectorImpl$1.get(InjectorImpl.java:1151)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1186)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.zextras.carbonio.user_management.Boot.main(Boot.java:31)
sept. 04 18:24:53 mail.jpp.fr java[9423]: Caused by: com.sun.xml.ws.wsdl.parser.InaccessibleWSDLException: 2 counts of InaccessibleWSDLExcept>
sept. 04 18:24:53 mail.jpp.fr java[9423]: java.io.IOException: Server returned HTTP response code: 503 for URL: http://127.78.0.5:20000/servi>
sept. 04 18:24:53 mail.jpp.fr java[9423]: java.io.IOException: Server returned HTTP response code: 503 for URL: http://127.78.0.5:20000/servi>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.wsdl.parser.RuntimeWSDLParser.tryWithMex(RuntimeWSDLParser.java:242)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.wsdl.parser.RuntimeWSDLParser.parse(RuntimeWSDLParser.java:216)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.wsdl.parser.RuntimeWSDLParser.parse(RuntimeWSDLParser.java:179)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.wsdl.parser.RuntimeWSDLParser.parse(RuntimeWSDLParser.java:148)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.client.WSServiceDelegate.parseWSDL(WSServiceDelegate.java:336)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.client.WSServiceDelegate.<init>(WSServiceDelegate.java:293)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.client.WSServiceDelegate.<init>(WSServiceDelegate.java:201)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.client.WSServiceDelegate.<init>(WSServiceDelegate.java:182)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.client.WSServiceDelegate.<init>(WSServiceDelegate.java:178)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.sun.xml.ws.spi.ProviderImpl.createServiceDelegate(ProviderImpl.java:89)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at jakarta.xml.ws.Service.<init>(Service.java:82)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at https.www_zextras_com.wsdl.zimbraservice.ZcsService.<init>(ZcsService.java:50)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.zextras.mailbox.client.service.ServiceClientBuilderImpl.createService(ServiceClientB>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.zextras.mailbox.client.service.ServiceClientBuilderImpl.lambda$createServices$0(Serv>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at java.base/java.util.stream.IntPipeline$1$1.accept(IntPipeline.java:180)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at java.base/java.util.stream.Streams$RangeIntSpliterator.forEachRemaining(Streams.java:104)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at java.base/java.util.Spliterator$OfInt.forEachRemaining(Spliterator.java:711)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.zextras.mailbox.client.service.ServiceClientBuilderImpl.createServices(ServiceClient>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.zextras.mailbox.client.service.ServiceClientBuilderImpl.build(ServiceClientBuilderIm>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.zextras.carbonio.user_management.config.UserManagementModule.provideServiceClient(Us>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.zextras.carbonio.user_management.config.UserManagementModule$$FastClassByGuice$$700e>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.zextras.carbonio.user_management.config.UserManagementModule$$FastClassByGuice$$700e>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.ProviderMethod$FastClassProviderMethod.doProvision(ProviderMe>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.ProviderMethod.doProvision(ProviderMethod.java:171)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.provision(I>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.InternalProviderInstanceBindingImpl$CyclicFactory.get(Interna>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactor>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:169)
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProvide>
sept. 04 18:24:53 mail.jpp.fr java[9423]: at com.google.inject.internal.InjectorImpl$1.get(InjectorImpl.java:1148)
sept. 04 18:24:53 mail.jpp.fr java[9423]: ... 2 more
sept. 04 18:24:53 mail.jpp.fr systemd[1]: carbonio-user-management.service: Main process exited, code=exited, status=1/FAILURE
sept. 04 18:24:53 mail.jpp.fr systemd[1]: carbonio-user-management.service: Failed with result 'exit-code'.
===========================================
Hope this helps ...
Regards
JP P
Hi,
Your system is running current version which is 24.7.1. But I do not see following services in the service list:
carbonio-tasks-db-sidecar.service loaded active running Carbonio Tasks database sidecar carbonio-tasks-sidecar.service loaded active running Carbonio Tasks sidecar proxy carbonio-tasks.service loaded active running Carbonio Tasks daemon carbonio-videoserver-sidecar.service loaded active running Carbonio Videoserver sidecar proxy carbonio-videoserver.service loaded active running Zextras Videoserver carbonio-ws-collaboration-db-sidecar.service loaded active running Carbonio Workstream Collaboration database sidecar carbonio-ws-collaboration-sidecar.service loaded active running Carbonio Workstream Collaboration sidecar proxy carbonio-ws-collaboration.service loaded active running Carbonio Workstream Collaboration daemon
And if everything went properly, then curl -s -v http://127.78.0.4:10000/health | jq should show the critical service health related to WSC:
Something like this:
root@mail:~# curl -s -v http://127.78.0.4:10000/health | jq
* Trying 127.78.0.4:10000...
* TCP_NODELAY set
* Connected to 127.78.0.4 (127.78.0.4) port 10000 (#0)
> GET /health HTTP/1.1
> Host: 127.78.0.4:10000
> User-Agent: curl/7.68.0
> Accept: */*
>
* Mark bundle as not supporting multiuse
< HTTP/1.1 200 OK
< Server: Jetty(12.0.8)
< Date: Fri, 06 Sep 2024 08:30:53 GMT
< Content-Type: application/json
< Content-Length: 403
<
{ [403 bytes data]
* Connection #0 to host 127.78.0.4 left intact
{
"isLive": true,
"status": "ok",
"dependencies": [
{
"name": "database",
"isHealthy": true
},
{
"name": "authentication_service",
"isHealthy": true
},
{
"name": "profiling_service",
"isHealthy": true
},
{
"name": "xmpp_server",
"isHealthy": true
},
{
"name": "event_dispatcher",
"isHealthy": true
},
{
"name": "storage_service",
"isHealthy": true
},
{
"name": "previewer_service",
"isHealthy": true
},
{
"name": "videoserver_service",
"isHealthy": true
}
]
}
root@mail:~#
sept. 04 18:24:53 mail.jpp.fr java[9423]: java.io.IOException: Server returned HTTP response code: 503 for URL: http://127.78.0.5:20000/servi>
127.78.0.5 is not running but it could be vice-versa as it is related to carbonio-user-management
Could you please check, there is no pending-setups?
Regards,
Sharif
Hello,
I am on vacation ... until 12/09, so I will see more after returning.
Regards
JP P
Since the latest update i have the same trouble, web interface (both for users and admins) is not working anymore, it's stuck at the login page...
Carbonio CE version is "Carbonio Release 24.7.1", zmcontrol status report "zmmailboxdctl is not running" so "mailbox" and "service webapp" are not running; "curl -s -v http://127.78.0.4:10000/health | jq" report:
{
"isLive": true,
"status": "error",
"dependencies": [
{
"name": "database",
"isHealthy": true
},
{
"name": "authentication_service",
"isHealthy": false
},
{
"name": "profiling_service",
"isHealthy": false
},
{
"name": "xmpp_server",
"isHealthy": true
},
{
"name": "event_dispatcher",
"isHealthy": true
},
{
"name": "storage_service",
"isHealthy": true
},
{
"name": "previewer_service",
"isHealthy": true
},
{
"name": "videoserver_service",
"isHealthy": true
}
So, i see that two services are not healty ("authentication_service" and "profiling_service").
Restarting all services (zmcontrol restart) or rebooting doesn't help, what to do then?
Thank you in advance
Max
@sharif This one:
carbonio-clamav-sidecar.service loaded active running Carbonio clamav sidecar proxy carbonio-clamav-signature-provider-sidecar.service loaded active running NGINX Carbonio ClamAV signature provider sidecar carbonio-docs-connector-db-sidecar.service loaded active running Carbonio Docs Connector database sidecar carbonio-docs-connector-sidecar.service loaded active running Carbonio docs connector sidecar proxy carbonio-docs-connector.service loaded active running Carbonio docs connector daemon carbonio-docs-editor-sidecar.service loaded active running Carbonio Docs server sidecar proxy carbonio-docs-editor.service loaded active running Carbonio Docs Server carbonio-files-db-sidecar.service loaded active running Carbonio Files database sidecar carbonio-files-sidecar.service loaded active running Carbonio Files sidecar proxy carbonio-files.service loaded active running Carbonio Files daemon carbonio-mailbox-admin-sidecar.service loaded active running Carbonio Mailbox Admin proxy sidecar carbonio-mailbox-db-sidecar.service loaded active running Carbonio Mailbox database sidecar carbonio-mailbox-nslookup-sidecar.service loaded active running Carbonio Mailbox NSLookup proxy sidecar carbonio-mailbox-sidecar.service loaded active running Mailbox carbonio proxy sidecar carbonio-message-broker-sidecar.service loaded active running Carbonio message broker sidecar proxy carbonio-message-broker.service loaded active running Carbonio message broker daemon carbonio-message-dispatcher-auth-sidecar.service loaded active running Carbonio Message Dispatcher auth sidecar proxy carbonio-message-dispatcher-auth.service loaded active running Carbonio Message Dispatcher auth daemon carbonio-message-dispatcher-db-sidecar.service loaded active running Carbonio Message Dispatcher database sidecar carbonio-message-dispatcher-http-sidecar.service loaded active running Carbonio Message Dispatcher HTTP sidecar proxy carbonio-message-dispatcher-xmpp-sidecar.service loaded active running Carbonio Message Dispatcher XMPP sidecar proxy carbonio-message-dispatcher.service loaded active running Carbonio Message Dispatcher daemon carbonio-mta-sidecar.service loaded active running Carbonio mta sidecar proxy carbonio-preview-sidecar.service loaded active running Carbonio Preview sidecar proxy carbonio-preview.service loaded active running Carbonio Preview daemon carbonio-prometheus-consul-exporter.service loaded active running Carbonio Prometheus Consul exporter carbonio-prometheus-mysqld-exporter.service loaded active running Carbonio Prometheus MySQL exporter carbonio-prometheus-nginx-exporter.service loaded active running Carbonio Prometheus NGINX exporter carbonio-prometheus-node-exporter.service loaded active running Carbonio Prometheus Node Exporter carbonio-prometheus-openldap-exporter.service loaded active running Carbonio Prometheus OpenLDAP exporter carbonio-proxy-sidecar.service loaded active running NGINX carbonio proxy sidecar carbonio-storages-sidecar.service loaded active running Storages-CE sidecar proxy carbonio-storages.service loaded active running Carbonio Storages-CE daemon carbonio-tasks-db-sidecar.service loaded active running Carbonio Tasks database sidecar carbonio-tasks-sidecar.service loaded active running Carbonio Tasks sidecar proxy carbonio-tasks.service loaded active running Carbonio Tasks daemon carbonio-user-management-sidecar.service loaded active running Carbonio User Management sidecar proxy carbonio-user-management.service loaded activating auto-restart Carbonio User Management daemon carbonio-videoserver-sidecar.service loaded active running Carbonio Videoserver sidecar proxy carbonio-videoserver.service loaded active running Zextras Videoserver carbonio-ws-collaboration-db-sidecar.service loaded active running Carbonio Workstream Collaboration database sidecar carbonio-ws-collaboration-sidecar.service loaded active running Carbonio Workstream Collaboration sidecar proxy carbonio-ws-collaboration.service loaded active running Carbonio Workstream Collaboration daemon carbonio.service loaded active exited LSB: Carbonio Services
Any news? Carbonio CE is unusable to me at the moment...
Hello,
I saw many services that are not "active", there are 48 services in /lib/systemd/system like carbonio*, I made a list of not zero return code from "systemctl status ..." .
Here are the results :
carbonio-altermime-config.service inactive (dead) return-code=3
carbonio-antivirus.service inactive (dead) return-code=3
carbonio-appserver-db.service inactive (dead) return-code=3
carbonio-appserver.service inactive (dead) return-code=3
carbonio-appserver.target inactive (dead) return-code=3
carbonio-certbot.service inactive (dead) return-code=3
carbonio-configd.service inactive (dead) return-code=3
carbonio-directory-server.target inactive (dead) return-code=3
carbonio-freshclam.service inactive (dead) return-code=3
carbonio-mailbox-admin-sidecar.service activating (auto-restart) (Result: exit-code) since Fri 2024-09-13 16:59:00 CEST; 10s ago return-code=3
carbonio-mailbox-nslookup-sidecar.service activating (auto-restart) (Result: exit-code) since Fri 2024-09-13 16:59:07 CEST; 3s ago return-code=3
carbonio-mailthreat.service inactive (dead) return-code=3
carbonio-memcached.service inactive (dead) return-code=3
carbonio-milter.service inactive (dead) return-code=3
carbonio-mta.target inactive (dead) return-code=3
carbonio-nginx.service inactive (dead) return-code=3
carbonio-opendkim.service inactive (dead) return-code=3
carbonio-openldap.service inactive (dead) return-code=3
carbonio-policyd.service inactive (dead) return-code=3
carbonio-postfix.service inactive (dead) return-code=3
carbonio-proxy.target inactive (dead) return-code=3
carbonio-saslauthd.service inactive (dead) return-code=3
carbonio-stats.service inactive (dead) return-code=3
Don't what to do .. some services listed in the VMax mail are not known on my system :
systemctl start carbonio-docs-connector-db-sidecar
Failed to start carbonio-docs-connector-db-sidecar.service: Unit carbonio-docs-connector-db-sidecar.service not found.
systemctl status carbonio-mailbox-db-sidecar.service
Unit carbonio-mailbox-db-sidecar.service could not be found.
systemctl enable carbonio-message-broker.service
Failed to enable unit: Unit file carbonio-message-broker.service does not exist.
Regards
JP P