fix(adminmanual): Document data retention and possible issues by ChristophWurst · Pull Request #11626 · nextcloud/documentation

ChristophWurst · 2024-03-08T13:26:02Z

☑️ Resolves

Backstory: found an instance where entries were deleted from calendarchanges before connected clients had a chance to read the latest changes.

Fix Document dav app setting totalNumberOfSyncTokensToKeep #11624

🖼️ Screenshots

tcitworld · 2024-03-08T13:30:37Z

admin_manual/groupware/contacts.rst

+
+  php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000
+
+The default is keeping 10,000 entries. This option should be set adequate to the number of users. E.g. on an installation with 5000 active contacts users the system would only keep an average of 10 changes per user. This will lead to premature data deletion and synchronization problems.


Suggested change

The default is keeping 10,000 entries. This option should be set adequate to the number of users. E.g. on an installation with 5000 active contacts users the system would only keep an average of 10 changes per user. This will lead to premature data deletion and synchronization problems.

The default is keeping 10,000 entries. This option should be set adequate to the number of users. E.g. on an installation with 5000 active synced addressbooks the system would only keep an average of 10 changes per sync. This will lead to premature data deletion and synchronization problems.

For clarity

tcitworld · 2024-03-08T13:31:50Z

admin_manual/groupware/calendar.rst

+
+  php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000
+
+The default is keeping 10,000 entries. This option should be set adequate to the number of users. E.g. on an installation with 5000 active calendar users the system would only keep an average of 10 changes per user. This will lead to premature data deletion and synchronization problems.


Suggested change

The default is keeping 10,000 entries. This option should be set adequate to the number of users. E.g. on an installation with 5000 active calendar users the system would only keep an average of 10 changes per user. This will lead to premature data deletion and synchronization problems.

The default is keeping 10,000 entries. This option should be set adequate to the number of users. E.g. on an installation with 5000 active synced calendars the system would only keep an average of 10 changes per calendar. This will lead to premature data deletion and synchronization problems.

tcitworld

Deleting data makes it scary

tcitworld · 2024-03-08T20:36:26Z

admin_manual/groupware/calendar.rst

+
+.. versionadded:: 26.0.0
+
+You can configure how long Nextcloud keeps some of the calendar data.


Suggested change

You can configure how long Nextcloud keeps some of the calendar data.

You can configure how long Nextcloud keeps some of the calendar sync tokens.

tcitworld · 2024-03-08T20:36:44Z

admin_manual/groupware/contacts.rst

+
+.. versionadded:: 26.0.0
+
+You can configure how long Nextcloud keeps some of the contacts data.


Suggested change

You can configure how long Nextcloud keeps some of the contacts data.

You can configure how long Nextcloud keeps some of the contacts sync tokens.

tcitworld · 2024-03-08T20:36:56Z

admin_manual/release_notes/upgrade_to_26.rst


 See for more information: :ref:`email-smtp-config`.

+DAV data retention


Suggested change

DAV data retention

DAV sync tokens retention

tcitworld · 2024-03-08T20:37:11Z

admin_manual/release_notes/upgrade_to_26.rst

+DAV data retention
+------------------
+
+A mechanism to clean up old CalDAV and CardDAV data has been added. See :ref:`CalDAV retention <caldav-data-retention>` and :ref:`CardDAV retention <carddav-data-retention>` and make sure it fits your installation size.


Suggested change

A mechanism to clean up old CalDAV and CardDAV data has been added. See :ref:`CalDAV retention <caldav-data-retention>` and :ref:`CardDAV retention <carddav-data-retention>` and make sure it fits your installation size.

A mechanism to clean up old CalDAV and CardDAV sync tokens has been added. See :ref:`CalDAV retention <caldav-data-retention>` and :ref:`CardDAV retention <carddav-data-retention>` and make sure it fits your installation size.

AndyScherzinger · 2025-09-11T15:45:59Z

/backport to stable30

AndyScherzinger · 2025-09-11T15:46:03Z

/backport to stable31

AndyScherzinger · 2025-09-11T15:46:07Z

/backport to stable32

admin_manual/groupware/calendar.rst

st3iny

To fix CI.

st3iny · 2025-09-22T08:14:54Z

admin_manual/groupware/calendar.rst

+
+The CalDAV backend keeps track of any modifications of calendars. That is anything added, modified or removed. The data is used for differential synchronization of offline clients like Thunderbird. At a certain point in time, the data can be considered outdated assuming there will be no more client needing it. This can help keep the database table `calendarchanges` small::
+
+  php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000


Suggested change

php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000

sudo -E -u www-data php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000

st3iny · 2025-09-22T08:15:00Z

admin_manual/groupware/contacts.rst

+
+The CardDAV backend keeps track of any modifications of address books. That is anything added, modified or removed. The data is used for differential synchronization of offline clients like Thunderbird. At a certain point in time, the data can be considered outdated assuming there will be no more client needing it. This can help keep the database table `addressbookchanges` small::
+
+  php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000


Suggested change

php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000

sudo -E -u www-data php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000

Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>

ChristophWurst added enhancement 3. to review manual: admin labels Mar 8, 2024

ChristophWurst added this to the Nextcloud 29 milestone Mar 8, 2024

ChristophWurst requested a review from tcitworld March 8, 2024 13:26

ChristophWurst self-assigned this Mar 8, 2024

ChristophWurst requested review from hamza221 and miaulalala as code owners March 8, 2024 13:26

backportbot bot added the backport-request label Mar 8, 2024

tcitworld approved these changes Mar 8, 2024

View reviewed changes

ChristophWurst force-pushed the feat/adminmanual/dav-data-retention branch from fe59317 to bb03c7f Compare March 8, 2024 14:19

tcitworld requested changes Mar 8, 2024

View reviewed changes

susnux modified the milestones: Nextcloud 29, Nextcloud 30 Mar 29, 2024

Altahrim modified the milestones: Nextcloud 30, Nextcloud 30.0.1 Sep 17, 2024

blizzz modified the milestones: Nextcloud 30.0.1, Nextcloud 30.0.2 Oct 17, 2024

Altahrim modified the milestones: Nextcloud 30.0.2, Nextcloud 30.0.3 Nov 7, 2024

blizzz modified the milestones: Nextcloud 30.0.3, Nextcloud 30.0.4, Nextcloud 30.0.5 Dec 5, 2024

blizzz modified the milestones: Nextcloud 30.0.5, Nextcloud 30.0.6 Jan 9, 2025

Altahrim modified the milestones: Nextcloud 30.0.6, Nextcloud 30.0.7 Feb 13, 2025

blizzz modified the milestones: Nextcloud 30.0.7, Nextcloud 30.0.8 Mar 13, 2025

AndyScherzinger modified the milestones: Nextcloud 30.0.15, Nextcloud 33 Sep 11, 2025

ChristophWurst force-pushed the feat/adminmanual/dav-data-retention branch from bb03c7f to 034c75a Compare September 19, 2025 13:59

ChristophWurst requested review from GVodyanov, SebastianKrupinski and st3iny as code owners September 19, 2025 13:59

ChristophWurst force-pushed the feat/adminmanual/dav-data-retention branch from 034c75a to 14ceadd Compare September 19, 2025 14:01

ChristophWurst requested a review from tcitworld September 19, 2025 14:02

tcitworld approved these changes Sep 19, 2025

View reviewed changes

admin_manual/groupware/calendar.rst Outdated Show resolved Hide resolved

SebastianKrupinski approved these changes Sep 21, 2025

View reviewed changes

ChristophWurst force-pushed the feat/adminmanual/dav-data-retention branch from 14ceadd to 92f1b8e Compare September 22, 2025 07:51

ChristophWurst added 4. to release and removed 3. to review labels Sep 22, 2025

nextcloud deleted a comment from susnux Sep 22, 2025

ChristophWurst force-pushed the feat/adminmanual/dav-data-retention branch from 92f1b8e to 0f00b77 Compare September 22, 2025 07:52

st3iny reviewed Sep 22, 2025

View reviewed changes

fix(adminmanual): Document data retention and possible issues

6443a41

Signed-off-by: Christoph Wurst <christoph@winzerhof-wurst.at>

ChristophWurst force-pushed the feat/adminmanual/dav-data-retention branch from 0f00b77 to 6443a41 Compare September 24, 2025 12:36

tcitworld approved these changes Sep 24, 2025

View reviewed changes

tcitworld merged commit b185c75 into master Sep 24, 2025
13 checks passed

tcitworld deleted the feat/adminmanual/dav-data-retention branch September 24, 2025 18:57

This was referenced Sep 24, 2025

[stable32] fix(adminmanual): Document data retention and possible issues #13703

Merged

[stable31] fix(adminmanual): Document data retention and possible issues #13704

Draft

[stable30] fix(adminmanual): Document data retention and possible issues #13705

Closed

backportbot bot removed the backport-request label Sep 24, 2025

skjnldsv modified the milestones: Nextcloud 33, Nextcloud 32 Oct 2, 2025


		php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000

		The default is keeping 10,000 entries. This option should be set adequate to the number of users. E.g. on an installation with 5000 active contacts users the system would only keep an average of 10 changes per user. This will lead to premature data deletion and synchronization problems.


		.. versionadded:: 26.0.0

		You can configure how long Nextcloud keeps some of the calendar data.


		See for more information: :ref:`email-smtp-config`.

		DAV data retention

	A mechanism to clean up old CalDAV and CardDAV data has been added. See :ref:`CalDAV retention <caldav-data-retention>` and :ref:`CardDAV retention <carddav-data-retention>` and make sure it fits your installation size.
	A mechanism to clean up old CalDAV and CardDAV sync tokens has been added. See :ref:`CalDAV retention <caldav-data-retention>` and :ref:`CardDAV retention <carddav-data-retention>` and make sure it fits your installation size.


		The CalDAV backend keeps track of any modifications of calendars. That is anything added, modified or removed. The data is used for differential synchronization of offline clients like Thunderbird. At a certain point in time, the data can be considered outdated assuming there will be no more client needing it. This can help keep the database table `calendarchanges` small::

		php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000

	php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000
	sudo -E -u www-data php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000


		The CardDAV backend keeps track of any modifications of address books. That is anything added, modified or removed. The data is used for differential synchronization of offline clients like Thunderbird. At a certain point in time, the data can be considered outdated assuming there will be no more client needing it. This can help keep the database table `addressbookchanges` small::

		php occ config:app:set totalNumberOfSyncTokensToKeep --value=30000

Conversation

ChristophWurst commented Mar 8, 2024

☑️ Resolves

🖼️ Screenshots

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

tcitworld left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

AndyScherzinger commented Sep 11, 2025

Uh oh!

AndyScherzinger commented Sep 11, 2025

Uh oh!

AndyScherzinger commented Sep 11, 2025

Uh oh!

Uh oh!

st3iny left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants