Hi:
I started performing massive deletion (during the day) in my repository. Every night a massive content ingestion is performed.
Index size was growing in about 1 to 1.5 GB daily after ingestion and now that I am deleting (almost the same quantity of documents) the growth rate remain the same. I see and increasing deleted docs number but size used is increasing at the same pace before deleting.
What should I do in order to free up index space?
Thanks a lot for your advice.
Hi:
Probably, you are leaving your content in Thrash when deleting.
If it is not the case, you may optimize index, for cleaning those deleting docs. This is in fact a recommended maintainance task for SOLR.
When a document is deleted in SOLR, the index of this document is flagged as deleted, but it still occupies size in disk. A big number of deleted docs in SOLR indices may impact in search performance.
Regards.
--C.
Deletion process is performed using REST API with permanent=True parameter.
A couple of question regarding Optimization. Can you run optimization during normal operation (indexation/searching)?
Do you have an estimation of how long this process take? We have a dedicated solr server (16 core - 32 GB)
I also read that double the size used is needed in the file system where indexes are stored.
Thanks a lot for your guidance
Hi:
Can you run optimization during normal operation (indexation/searching)?
- No. Manteinance normally means out of office hours.
Do you have an estimation of how long this process take? We have a dedicated solr server (16 core - 32 GB)
- Can't say. Not so much comparing with a full reindex for example. It depends on the resources for SOLR, also how fast are your indices disks, how big are your indices...
I also read that double the size used is needed in the file system where indexes are stored.
- Yes, this refers for the (SSD) disk where indices are stored. When SOLR is doing merges internally needs extra space.
Regards.
--C.
Ask for and offer help to other Alfresco Content Services Users and members of the Alfresco team.
Related links:
By using this site, you are agreeing to allow us to collect and use cookies as outlined in Alfresco’s Cookie Statement and Terms of Use (and you have a legitimate interest in Alfresco and our products, authorizing us to contact you in such methods). If you are not ok with these terms, please do not use this website.