Notifications
Clear all

Carbonio Docs - storage problem

11 Posts
2 Users
1 Reactions
319 Views
(@aljosa-spanger)
Joined: 1 year ago
Posts: 7
Topic starter  

Hi,
first of all thanks for developing the Carbonio CE open source platform, creating related documentation, ...

I run into a problem during a test phase.

It is related to Carbonio Documents while creating office documents.

Every time I create a document (odt, docx, xlsx, ...) and want to open it I encounter a problem with accessing the document.

Error output in the browser: carbonio docs failed to read document from storage

After several page refreshes, the document opens correctly.

The base system is Ubuntu 22.04 LTS server.
Carbonio is on version 24.7.0.

It is a multi-server installation.

There are three storage servers, one office server, one proxy server, ...

Other related information (configurations, errors in logs,...).

 

On files (office) server:

# cat /etc/carbonio/preview/config.ini

nginx_lookup_server_full_path_urls = https://address1:7072,https://address2:7072,https://address3:7072
memcached_server_full_path_urls = https://address4:11211

 

# cat /var/log/carbonio/files/files.log | grep -A 20 ERROR

08:08:38.934 [nioEventLoopGroup-3-5] ERROR c.z.c.files.netty.ExceptionsHandler - Failed to execute the request. 500 Internal Server Error
com.zextras.storages.api.exception.StoragesHTTPException: {"statusCode":404,"error":"Not found","message":"File '8c2a3982-dd24-4ce9-871a-8d703df14543-1' does not exist"}
at com.zextras.storages.internal.client.StoragesClientImp.wrap(StoragesClientImp.java:138)
at com.zextras.storages.internal.client.StoragesClientImp.download(StoragesClientImp.java:63)
at com.zextras.carbonio.files.rest.services.BlobService.lambda$downloadFile$91691587$1(BlobService.java:420)
at io.vavr.control.Try.of(Try.java:75)

 

On storage server document exists:

# find /opt/zextras/carbonio-storages/blobs/ -name 8c2a3982-dd24-4ce9-871a-8d703df14543-1
/opt/zextras/carbonio-storages/blobs/8c/8c2a3982-dd24-4ce9-871a-8d703df14543-1

# ls -la /opt/zextras/carbonio-storages/blobs/8c/8c2a3982-dd24-4ce9-871a-8d703df14543-1
-rw-r--r-- 1 carbonio-storages zextras 7634 Aug 23 08:08 /opt/zextras/carbonio-storages/blobs/8c/8c2a3982-dd24-4ce9-871a-8d703df14543-1

 

Any help would be much appreciated. 😀 


   
Quote
(@aljosa-spanger)
Joined: 1 year ago
Posts: 7
Topic starter  

Some more errors on On files (office) server:

Aug 26 12:03:57 systemd[1]: Stopping Carbonio Files sidecar proxy...
Aug 26 12:03:57 systemd[1]: carbonio-files-sidecar.service: Main process exited, code=killed, status=9/KILL
Aug 26 12:03:57 systemd[1]: carbonio-files-sidecar.service: Failed with result 'signal'.
Aug 26 12:03:57 systemd[1]: Stopped Carbonio Files sidecar proxy.
Aug 26 12:03:57 systemd[1]: carbonio-files-sidecar.service: Consumed 2min 12.303s CPU time.
Aug 26 12:03:57 systemd[1]: Started Carbonio Files sidecar proxy.

Aug 26 12:03:57 consul[21222]: Error connecting to Consul agent: Unexpected response code: 403 (Permission denied)

Aug 26 12:03:57 consul[21222]: [2024-08-26 12:03:57.683][21222][info][main] [source/server/server.cc:330] initializing epoch 0 (base id=0, hot restart version=disabled)
Aug 26 12:03:57 consul[21222]: [2024-08-26 12:03:57.683][21222][info][main] [source/server/server.cc:332] statically linked extensions:
Aug 26 12:03:57 consul[21222]: [2024-08-26 12:03:57.683][21222][info][main] [source/server/server.cc:334] envoy.stats_sinks: envoy.dog_statsd, envoy.metrics_service, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.hystrix, envoy.sta>
Aug 26 12:03:57 consul[21222]: [2024-08-26 12:03:57.683][21222][info][main] [source/server/server.cc:334] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor
Aug 26 12:03:57 consul[21222]: [2024-08-26 12:03:57.683][21222][info][main] [source/server/server.cc:334] envoy.retry_priorities: envoy.retry_priorities.previous_priorities


   
ReplyQuote
(@sharif)
Admin
Joined: 3 years ago
Posts: 593
 

Hi,

Thanks for your interest.

I think there is an issue with the composition of packages installed on different nodes/servers:

Could you please tell us more about your setup:

For example: installed packages list -

Node-1/Server - 1

service-discover-server 
carbonio-directory-server

Node-2/Server - 2

carbonio-proxy 
carbonio-webui
carbonio-files-ui
carbonio-user-management
carbonio-tasks-ui 
carbonio-ws-collaboration-ui
carbonio-files-public-folder-ui 
service-discover-agent

 

.

.

. and so on.

 

Posted by: @aljosa-spanger

It is a multi-server installation.

There are three storage servers, one office server, one proxy server, ...

Other related information (configurations, errors in logs,...).

 

Regards,

Sharif

 


   
ReplyQuote
(@aljosa-spanger)
Joined: 1 year ago
Posts: 7
Topic starter  

Hi,

this is list of servers with carbonio packages installed.

 

Node1:

database server

  • - postgresql-16
  • - service-discover-agent
  • - carbonio-files-db
  • - carbonio-mailbox-db
  • - carbonio-docs-connector-db
  • - carbonio-tasks-db
  • - carbonio-message-dispatcher-db
  • - carbonio-ws-collaboration-db
  • - carbonio-prometheus-process-exporter
  • - carbonio-prometheus-postgres-exporter

 

directory server

  • - service-discover-server
  • - carbonio-directory-server
  • - carbonio-prometheus-process-exporter

 

proxy server

  • - carbonio-proxy
  • - carbonio-webui
  • - carbonio-files-ui
  • - carbonio-user-management
  • - carbonio-tasks-ui
  • - carbonio-ws-collaboration-ui
  • - carbonio-files-public-folder-ui
  • - service-discover-agent
  • - carbonio-prometheus-process-exporter

 

mta server

  • - carbonio-mta
  • - service-discover-agent
  • - carbonio-prometheus-clamav-exporter

 

application servers (mailstore, tasks, provisioning) / 3 servers

  • - carbonio-appserver
  • - carbonio-storages-ce
  • - carbonio-tasks-ce
  • - carbonio-zal
  • - service-discover-agent
  • - carbonio-prometheus-process-exporter

 

files, docs, editor, preview server

  • - carbonio-files-ce
  • - carbonio-docs-editor
  • - carbonio-docs-connector-ce
  • - carbonio-preview-ce
  • - service-discover-agent
  • - carbonio-ws-collaboration-ce
  • - carbonio-prometheus-process-exporter

 

grafana server

  • - carbonio-prometheus
  • - service-discover-agent
  • - grafana

 

dns server

 

Regards

Aljosa

 


   
ReplyQuote
(@aljosa-spanger)
Joined: 1 year ago
Posts: 7
Topic starter  

Hi,

I realized I forgot to install the package carbonio-message-dispatcher on

files, docs, editor, preview server server.

But I have one sub-question.

Do I need to install carbonio-ws-* packages if I don't need the chat functionality?

Regards,

Aljosa


   
ReplyQuote
(@sharif)
Admin
Joined: 3 years ago
Posts: 593
 

@aljosa-spanger 

I think you would get a very good idea about multi node installation from here:

https://docs.zextras.com/carbonio-ce/html/install/scenarios/scenario-a.html

Regards,

Sharif


   
ReplyQuote
(@aljosa-spanger)
Joined: 1 year ago
Posts: 7
Topic starter  

@sharif

Thanks for the recommendation.

However, I have read the recommended documentation you have sent (link).

I thought that maybe some other service indirectly also needs the carbonio-ws* packages (errors in logs).

I am also wondering if you have any idea why the Carbonio Docs (office) is not responding well (I need to reload multiple times to open created documents).

I need to sort this out if I want to get the carbonio suite up and running.

 

 

 

 


   
ReplyQuote
(@aljosa-spanger)
Joined: 1 year ago
Posts: 7
Topic starter  

I found the source of the problem. 😀 

I had 3 servers to store emails, documents, ... (Node 3 in multiserver scenario https://docs.zextras.com/carbonio-ce/html/install/scenarios/scenario-a.html).
After I turned off the second and third server and recreated the documents, they now open nicely. The preview of pdf documents also works correctly.

So far everything works with one mailstore server.

However, I would like to add additional mail storage servers in the future.


   
ReplyQuote
(@sharif)
Admin
Joined: 3 years ago
Posts: 593
 

@aljosa-spanger

Glad to know the progress. But by sensing your plan, I would recommend you to consider Carbonio Enterprise which has many architectural advantages (i.e scaling, robust system etc). 

Regards,

Sharif

 


   
ReplyQuote
(@aljosa-spanger)
Joined: 1 year ago
Posts: 7
Topic starter  

@sharif

Unfortunately, Carbonio Enterprise cannot be selected for the project in question.

Maybe for some other project in the future.

Regards,

Aljosa


   
ReplyQuote
(@sharif)
Admin
Joined: 3 years ago
Posts: 593
 

@aljosa-spanger 

Hi,

Okay. I can understand.

Regards,

Sharif


   
ReplyQuote