zfs zsys rpool/USERDATA/<username>_*@* snapshots destroyed Deactivated /home/<username> losing data

[JakFrost]

Describe the bug

It appears that ZFS zsys have destroyed and Deactivated rpool/USERDATA/<username>_*@* snapshots causing the complete loss of /home/<username> files and data for my users 'mona' and 'paladin' but not other users.

To Reproduce

No idea how to reproduce. Noticed one home drive for user 'paladin' missing files and empty and the folder owned by 'root:root' and the other one for user 'mona' same thing.

Deleted the 'mona' user on 2025-01-27 19:51:97 and recreated 'mona' user fresh for that user but noticed 3-days later that it was gone again completely. Empty folder and owned by 'root:root'. Checked the /home/<username>/.zfs/snapshot/* folders and they were present but all empty! All data gone from all folders, not a single snapshot folder showed any files present when doing ls -lRa, so I checked again today and for user 'mona' and also all the 'autozsys_*' show as completely empty.

The 'paladin' user was created on 2024-08-20 19:36:55 and wasn't deleted and recreated, only the '/etc/skel' files were re-copied again and re-owned. The /home/paladin/.zfs/snapshot/autozsys_*/ folders were all empty also, no trace of the original skel files nor of the generated SSH folder or keys. Just gone!

Had to create a 'autozsys_manual' and then destroy it and then created another 'manual' snapshot for both since I think the home folders will get deleted again during the next autozsys snapshot creation after package upgrades or new kernel version installation.

Expected behavior

Stop deleting user's home folder data and deactivating rpool/USERDATA/<username>_*@* snapshots that might have data in them.

For ubuntu users, please run and copy the following:

1. ubuntu-bug zsys --save=/tmp/report
2. Copy paste below /tmp/report content:

[report.txt](https://github.com/user-attachments/files/18602045/report.txt)

Screenshots
If applicable, add screenshots to help explain your problem.

Installed versions:

• OS: (/etc/os-release)

PRETTY_NAME="Ubuntu 24.04.1 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04.1 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo

• Zsysd running version: (zsysctl version output)

zsysctl 0.5.11.3ubuntu0.24.04.2
zsysd   0.5.11.3ubuntu0.24.04.2

Additional context

I uninstalled and re-installed 'zsys' package manually in case it was some kind of a weird mis-configuration problem today before I took the bug-report hoping that it would be fixed and re-configured on reinstall.

I looked at the other bug reports here in regards to the USERDATA being deleted and ran some additional commands to get more debug output.

Might be related to the other bugs with similiar issues for USERDATA snapshots.

#103
#196
#218

Stat - User: Paladin

stat /home/paladin/

  File: /home/paladin/
  Size: 12              Blocks: 18         IO Block: 1024   directory
Device: 0,44    Inode: 34          Links: 3
Access: (0755/drwxr-xr-x)  Uid: ( 1006/ paladin)   Gid: ( 1006/ paladin)
Access: 2025-01-30 03:35:08.024310243 -0600
Modify: 2025-01-30 03:35:07.304315371 -0600
Change: 2025-01-30 03:35:07.304315371 -0600
 Birth: 2024-08-20 19:36:55.561703260 -0500

Stat - User: Mona

stat /home/mona/

  File: /home/mona/
  Size: 12              Blocks: 18         IO Block: 1024   directory
Device: 0,40    Inode: 34          Links: 3
Access: (0755/drwxr-xr-x)  Uid: ( 1007/    mona)   Gid: ( 1007/    mona)
Access: 2025-01-30 04:09:33.179295028 -0600
Modify: 2025-01-30 04:09:32.549299124 -0600
Change: 2025-01-30 04:09:32.549299124 -0600
 Birth: 2025-01-27 19:52:01.906752449 -0600

ZPool History - User: Paladin | Destroy or Deactivate

zpool history -il rpool | grep -iE 'destroy.*paladin' | Destroy or Deactivate

2024-09-06.23:14:16 [txg:55484454] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_64odwy (45969)   [on htpc]
2024-09-06.23:14:17 [txg:55484455] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_v5g1np (45698)   [on htpc]
2024-09-12.04:10:56 [txg:55572491] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_nmbeaa (46066)   [on htpc]
2024-09-14.04:11:19 [txg:55606332] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_trqsbq (47283)   [on htpc]
2024-09-18.04:11:00 [txg:55673968] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_h4lrur (2516)   [on htpc]
2024-09-21.04:12:46 [txg:55724686] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_nyo9uf (12578)   [on htpc]
2024-09-25.04:14:14 [txg:55792305] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_175ula (7713)   [on htpc]
2024-09-27.04:14:12 [txg:55826097] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_65z8th (937)   [on htpc]
2024-09-29.04:15:39 [txg:55859958] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_2db577 (16378)   [on htpc]
2024-10-02.21:41:04 [txg:55922903] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_ik61yp (1837)   [on htpc]
2024-10-04.21:41:31 [txg:55956700] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_1o8gkm (13508)   [on htpc]
2024-10-10.21:58:39 [txg:56058252] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_699xje (23696)   [on htpc]
2024-10-11.21:59:03 [txg:56075185] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_qzheag (33503)   [on htpc]
2024-10-16.01:58:52 [txg:56145876] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_9sitr1 (43335)   [on htpc]
2024-10-17.01:59:07 [txg:56162829] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_3onh8h (49365)   [on htpc]
2024-10-18.01:59:52 [txg:56179801] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_4g29py (77642)   [on htpc]
2024-10-18.01:59:53 [txg:56179802] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_qolad8 (50076)   [on htpc]
2024-10-19.02:00:03 [txg:56196725] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_mg841u (94662)   [on htpc]
2024-10-23.02:01:58 [txg:56264342] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_v66wm1 (104309)   [on htpc]
2024-10-24.02:02:30 [txg:56281275] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_ebkil3 (106683)   [on htpc]
2024-10-27.02:03:33 [txg:56331982] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_n2ip87 (111672)   [on htpc]
2024-11-01.00:21:10 [txg:56415271] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_j7kzno (114403)   [on htpc]
2024-11-02.04:11:25 [txg:56434917] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_yn4c4n (162146)   [on htpc]
2024-11-04.03:11:52 [txg:56468725] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_eva82p (1306)   [on htpc]
2024-11-07.03:12:37 [txg:56519429] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_5a0rom (11080)   [on htpc]
2024-11-08.03:12:57 [txg:56536358] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_mfud56 (31928)   [on htpc]
2024-11-09.03:13:14 [txg:56553287] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_7cure7 (21079)   [on htpc]
2024-11-12.03:13:58 [txg:56603981] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_cel8kf (49750)   [on htpc]
2024-11-15.03:15:15 [txg:56654681] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_93iovn (54345)   [on htpc]
2024-11-17.03:15:51 [txg:56688504] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_t04pv6 (60900)   [on htpc]
2024-11-20.03:16:33 [txg:56739251] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_tzv2ab (80376)   [on htpc]
2024-11-21.04:11:31 [txg:56756885] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_3bgfin (13034)   [on htpc]
2024-11-27.04:13:26 [txg:56858202] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_mjk1it (3029)   [on htpc]
2024-11-28.04:14:18 [txg:56875134] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_oboael (7120)   [on htpc]
2024-11-29.04:14:34 [txg:56892072] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_ui1ro2 (31548)   [on htpc]
2024-12-05.04:16:39 [txg:56993519] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_b4t217 (1027)   [on htpc]
2024-12-06.04:17:13 [txg:57010491] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_4yubw6 (5891)   [on htpc]
2024-12-08.04:17:44 [txg:57044341] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_y7ntkz (10727)   [on htpc]
2024-12-11.02:28:52 [txg:57093899] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_lzzlyv (25173)   [on htpc]
2024-12-12.02:29:22 [txg:57111074] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_d7xe2m (27941)   [on htpc]
2024-12-14.02:30:29 [txg:57144883] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_d3czev (35829)   [on htpc]
2024-12-18.02:31:40 [txg:57212560] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_9sgrim (2038)   [on htpc]
2024-12-19.00:37:52 [txg:57228200] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_1lg52m (337)   [on htpc]
2024-12-21.00:37:56 [txg:57262007] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_22ypdf (11314)   [on htpc]
2024-12-26.00:38:47 [txg:57346538] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_0ip2wq (19953)   [on htpc]
2024-12-29.22:08:24 [txg:57412533] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_cjhtzy (38807)   [on htpc]
2024-12-29.22:08:25 [txg:57412534] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_dvj6ca (25762)   [on htpc]
2024-12-29.22:08:26 [txg:57412535] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_0z91o9 (22848)   [on htpc]
2025-01-08.22:10:12 [txg:57581566] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_76t9wa (47353)   [on htpc]
2025-01-09.22:10:29 [txg:57598516] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_rq8yw9 (52981)   [on htpc]
2025-01-16.22:12:16 [txg:57716736] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_z25siu (62099)   [on htpc]
2025-01-17.22:12:25 [txg:57733663] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_tp9tzv (1176)   [on htpc]
2025-01-19.22:13:21 [txg:57767486] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_8eqfm8 (25361)   [on htpc]
2025-01-21.22:14:11 [txg:57803652] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_afjftb (32848)   [on htpc]
2025-01-21.22:14:12 [txg:57803653] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_mn942k (29717)   [on htpc]
2025-01-22.22:14:11 [txg:57820587] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_0ke5sl (55341)   [on htpc]
2025-01-23.22:14:38 [txg:57837624] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_ppuqix (59337)   [on htpc]
2025-01-24.22:14:46 [txg:57854547] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_6dkjty (65227)   [on htpc]
2025-01-29.02:16:38 [txg:57925821] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_9aunx1 (20687)   [on htpc]
2025-01-30.04:18:11 [txg:57944533] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_trq980 (1247)   [on htpc]
2025-01-30.04:18:12 [txg:57944534] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_m6zhhz (61379)   [on htpc]
2025-01-30.04:18:13 [txg:57944535] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_6yv91c (22587)   [on htpc]
2025-01-30.04:18:14 [txg:57944536] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_vwawi1 (2485)   [on htpc]
2025-01-30.04:51:47 [txg:57945222] destroy rpool/USERDATA/paladin_5iuxrn@autozsys_manual (179)   [on htpc]
2025-01-30.04:51:47 zfs destroy rpool/USERDATA/paladin_5iuxrn@autozsys_manual [user 0 (root) on htpc:linux]

Complete

[zpool-history-il-rpool-paladin.txt](https://github.com/user-attachments/files/18601673/zpool-history-il-rpool-paladin.txt)

ZPool History - User: Mona | Destroy or Deactivate

zpool history -il rpool | grep -iE 'destroy.*mona'

2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_fvurga (130032)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_uruyq4 (35652)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_fr8zao (69055)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_kuoqg5 (68957)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_j9b9dj (96844)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_xsqbb5 (133340)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_p24iex (14879)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_veyz8p (81059)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_25xwzq (80212)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_alh3cs (28771)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_le79e8 (14564)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_j61q06 (158501)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_usobyh (69698)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_n5wain (162330)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_jtatbo (15000)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_6aaf2g (81648)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_nkt9xp (79030)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_pb540x (7549)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_gcmhbx (32324)   [on htpc]
2025-01-27.19:51:07 [txg:57903523] destroy rpool/USERDATA/mona_u4qt3t@autozsys_x0leju (96502)   [on htpc]
2025-01-27.19:51:07 [txg:57903525] destroy rpool/USERDATA/mona_u4qt3t (68662) (bptree, mintxg=1) [on htpc]
2025-01-27.19:51:07 zfs destroy -r rpool/USERDATA/mona_u4qt3t [user 0 (root) on htpc:linux]

Complete

[zpool-history-il-rpool-mona.txt](https://github.com/user-attachments/files/18601675/zpool-history-il-rpool-mona.txt)

Zsysctl Show --Full

[zsysctl-show--full.txt](https://github.com/user-attachments/files/18601679/zsysctl-show--full.txt)

Zfs List

zfs list

NAME                                               USED  AVAIL  REFER  MOUNTPOINT
bpool                                              427M  1.33G    96K  /boot
bpool/BOOT                                         424M  1.33G    96K  none
bpool/BOOT/ubuntu_r3ij8n                           424M  1.33G   183M  /boot
data                                              6.48T   674G  6.48T  /data
rpool                                              134G   312G    96K  /
rpool/ROOT                                         107G   312G    96K  none
rpool/ROOT/ubuntu_r3ij8n                           107G   312G   102G  /
rpool/ROOT/ubuntu_r3ij8n/srv                        96K   312G    96K  /srv
rpool/ROOT/ubuntu_r3ij8n/usr                      1.45G   312G    96K  /usr
rpool/ROOT/ubuntu_r3ij8n/usr/local                1.45G   312G   884M  /usr/local
rpool/ROOT/ubuntu_r3ij8n/var                       999M   312G    96K  /var
rpool/ROOT/ubuntu_r3ij8n/var/games                  96K   312G    96K  /var/games
rpool/ROOT/ubuntu_r3ij8n/var/lib                   521M   312G  18.2M  /var/lib
rpool/ROOT/ubuntu_r3ij8n/var/lib/AccountsService   120K   312G    96K  /var/lib/AccountsService
rpool/ROOT/ubuntu_r3ij8n/var/lib/NetworkManager    164K   312G   140K  /var/lib/NetworkManager
rpool/ROOT/ubuntu_r3ij8n/var/lib/apt               230M   312G  92.1M  /var/lib/apt
rpool/ROOT/ubuntu_r3ij8n/var/lib/dpkg              199M   312G  44.8M  /var/lib/dpkg
rpool/ROOT/ubuntu_r3ij8n/var/log                   477M   312G   180M  /var/log
rpool/ROOT/ubuntu_r3ij8n/var/mail                   96K   312G    96K  /var/mail
rpool/ROOT/ubuntu_r3ij8n/var/snap                   96K   312G    96K  /var/snap
rpool/ROOT/ubuntu_r3ij8n/var/spool                1.01M   312G   124K  /var/spool
rpool/ROOT/ubuntu_r3ij8n/var/www                    96K   312G    96K  /var/www
rpool/USERDATA                                    26.1G   312G    96K  /
rpool/USERDATA/guero_dowopj                        580K   312G   148K  /home/guero
rpool/USERDATA/hex7bb_ciei4g                       348K   312G   156K  /home/hex7bb
rpool/USERDATA/huggy_d0up5w                        300K   312G   140K  /home/huggy
rpool/USERDATA/mona_5wxxjp                         308K   312G   172K  /home/mona
rpool/USERDATA/mrweather_bcdefg                    492K   312G   148K  /home/mrweather
rpool/USERDATA/nastyfly_abcdef                     264K   312G   136K  /home/nastyfly
rpool/USERDATA/paladin_5iuxrn                      288K   312G   152K  /home/paladin
rpool/USERDATA/root_su0yhp                        17.2G   312G  4.10G  /root
rpool/USERDATA/user_su0yhp                        8.91G   312G  7.73G  /home/user

Zpool Status

zpool status
  pool: bpool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:02 with 0 errors on Mon Jan 13 11:00:03 2025
config:

        NAME                                    STATE     READ WRITE CKSUM
        bpool                                   ONLINE       0     0     0
          e848d0d3-d1a1-d94a-aa5f-6140f05eb381  ONLINE       0     0     0

errors: No known data errors

  pool: data
 state: ONLINE
  scan: scrub repaired 0B in 14:45:44 with 0 errors on Tue Jan 14 01:45:46 2025
config:

        NAME        STATE     READ WRITE CKSUM
        data        ONLINE       0     0     0
          mirror-0  ONLINE       0     0     0
            sdb     ONLINE       0     0     0
            sdc     ONLINE       0     0     0

errors: No known data errors

  pool: rpool
 state: ONLINE
  scan: scrub repaired 0B in 00:04:51 with 0 errors on Mon Jan 13 11:04:55 2025
config:

        NAME                                    STATE     READ WRITE CKSUM
        rpool                                   ONLINE       0     0     0
          71aeb358-0a54-c745-8f7f-fbba06c7cd85  ONLINE       0     0     0

Syslog - User: Paladin

cat /var/log/syslog* | grep -iE 'zsys|zfs' | grep -iE 'paladin'

2025-01-30T03:34:38.928227-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_xsqbb5.mount: Deactivated successfully.
2025-01-30T03:34:38.929959-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_gcmhbx.mount: Deactivated successfully.
2025-01-30T03:34:38.930092-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_fvurga.mount: Deactivated successfully.
2025-01-30T03:34:38.930188-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_y6792y.mount: Deactivated successfully.
2025-01-30T03:34:38.940509-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_953b65.mount: Deactivated successfully.
2025-01-30T03:34:38.940668-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_6yv91c.mount: Deactivated successfully.
2025-01-30T03:34:38.950866-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_j61q06.mount: Deactivated successfully.
2025-01-30T03:34:38.951049-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T03:34:38.951112-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_debi1h.mount: Deactivated successfully.
2025-01-30T03:34:38.951210-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_alh3cs.mount: Deactivated successfully.
2025-01-30T03:34:38.957125-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_pb540x.mount: Deactivated successfully.
2025-01-30T03:34:38.958965-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_n5wain.mount: Deactivated successfully.
2025-01-30T03:34:38.959044-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_m6zhhz.mount: Deactivated successfully.
2025-01-30T03:34:38.959109-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_le79e8.mount: Deactivated successfully.
2025-01-30T03:34:38.959193-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_jtatbo.mount: Deactivated successfully.
2025-01-30T03:34:38.965692-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T03:34:38.965836-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_rz5r3l.mount: Deactivated successfully.
2025-01-30T03:34:38.965902-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_pv5yay.mount: Deactivated successfully.
2025-01-30T03:34:39.926836-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T03:34:39.927008-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_vwawi1.mount: Deactivated successfully.
2025-01-30T03:34:39.927075-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T03:34:39.927161-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_uruyq4.mount: Deactivated successfully.
2025-01-30T03:34:39.927468-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_trq980.mount: Deactivated successfully.
2025-01-30T04:07:25.009587-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T04:07:25.009812-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_debi1h.mount: Deactivated successfully.
2025-01-30T04:07:25.009873-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_alh3cs.mount: Deactivated successfully.
2025-01-30T04:07:25.014286-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_gcmhbx.mount: Deactivated successfully.
2025-01-30T04:07:25.014428-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_fvurga.mount: Deactivated successfully.
2025-01-30T04:07:25.018655-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_953b65.mount: Deactivated successfully.
2025-01-30T04:07:25.018786-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_6yv91c.mount: Deactivated successfully.
2025-01-30T04:07:25.018852-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_2f9t0b.mount: Deactivated successfully.
2025-01-30T04:07:25.024372-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_le79e8.mount: Deactivated successfully.
2025-01-30T04:07:25.024512-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_j61q06.mount: Deactivated successfully.
2025-01-30T04:07:25.027529-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_m6zhhz.mount: Deactivated successfully.
2025-01-30T04:07:25.027885-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_jtatbo.mount: Deactivated successfully.
2025-01-30T04:07:25.031620-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_pb540x.mount: Deactivated successfully.
2025-01-30T04:07:26.006656-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T04:07:26.006806-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_y6792y.mount: Deactivated successfully.
2025-01-30T04:07:26.006867-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_xsqbb5.mount: Deactivated successfully.
2025-01-30T04:07:26.006930-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_vwawi1.mount: Deactivated successfully.
2025-01-30T04:07:26.007063-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T04:07:26.007125-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_uruyq4.mount: Deactivated successfully.
2025-01-30T04:07:26.007225-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_trq980.mount: Deactivated successfully.
2025-01-30T04:07:26.007352-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T04:07:26.007483-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_rz5r3l.mount: Deactivated successfully.
2025-01-30T04:07:26.007546-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_pv5yay.mount: Deactivated successfully.
2025-01-30T04:07:26.007635-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_n5wain.mount: Deactivated successfully.
2025-01-30T04:42:22.159355-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_rz5r3l.mount: Deactivated successfully.
2025-01-30T04:42:22.159583-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_j61q06.mount: Deactivated successfully.
2025-01-30T04:42:22.166788-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_xsqbb5.mount: Deactivated successfully.
2025-01-30T04:42:22.166938-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_pb540x.mount: Deactivated successfully.
2025-01-30T04:42:22.167000-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_jtatbo.mount: Deactivated successfully.
2025-01-30T04:42:22.167059-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_gcmhbx.mount: Deactivated successfully.
2025-01-30T04:42:22.173668-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_le79e8.mount: Deactivated successfully.
2025-01-30T04:42:22.174055-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_debi1h.mount: Deactivated successfully.
2025-01-30T04:42:22.183202-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_y6792y.mount: Deactivated successfully.
2025-01-30T04:42:22.183519-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_uruyq4.mount: Deactivated successfully.
2025-01-30T04:42:22.183677-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_pv5yay.mount: Deactivated successfully.
2025-01-30T04:42:22.183811-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T04:42:22.188078-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T04:42:22.188613-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T04:42:22.188743-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T04:42:22.188898-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_n5wain.mount: Deactivated successfully.
2025-01-30T04:42:22.190017-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_alh3cs.mount: Deactivated successfully.
2025-01-30T04:42:22.190138-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_953b65.mount: Deactivated successfully.
2025-01-30T04:42:22.190232-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_2f9t0b.mount: Deactivated successfully.
2025-01-30T04:42:23.158578-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_fvurga.mount: Deactivated successfully.
2025-01-30T04:51:47.803537-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_manual.mount: Deactivated successfully.
2025-01-30T04:55:29.194676-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_2f9t0b.mount: Deactivated successfully.
2025-01-30T05:08:35.629617-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_debi1h.mount: Deactivated successfully.
2025-01-30T05:08:35.630343-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_alh3cs.mount: Deactivated successfully.
2025-01-30T05:08:35.630421-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_953b65.mount: Deactivated successfully.
2025-01-30T05:08:35.634825-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_2f9t0b.mount: Deactivated successfully.
2025-01-30T05:08:35.640119-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_jtatbo.mount: Deactivated successfully.
2025-01-30T05:08:35.640419-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_j61q06.mount: Deactivated successfully.
2025-01-30T05:08:35.640546-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T05:08:35.640659-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_gcmhbx.mount: Deactivated successfully.
2025-01-30T05:08:35.640770-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_fvurga.mount: Deactivated successfully.
2025-01-30T05:08:35.648054-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_n5wain.mount: Deactivated successfully.
2025-01-30T05:08:35.648526-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_le79e8.mount: Deactivated successfully.
2025-01-30T05:08:35.651391-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_rz5r3l.mount: Deactivated successfully.
2025-01-30T05:08:35.651739-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_pv5yay.mount: Deactivated successfully.
2025-01-30T05:08:35.651812-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_pb540x.mount: Deactivated successfully.
2025-01-30T05:08:35.657141-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_y6792y.mount: Deactivated successfully.
2025-01-30T05:08:35.657306-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_uruyq4.mount: Deactivated successfully.
2025-01-30T05:08:35.657420-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T05:08:36.629303-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T05:08:36.629680-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_xsqbb5.mount: Deactivated successfully.
2025-01-30T05:08:36.629747-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T05:09:41.161075-06:00 htpc systemd[1]: home-paladin-.zfs-snapshot-manual.mount: Deactivated successfully.

Syslog - User: Mona

cat /var/log/syslog* | grep -iE 'zsys|zfs' | grep -iE 'mona'

2025-01-30T03:41:12.141728-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_9dns6y.mount: Deactivated successfully.
2025-01-30T03:41:12.142550-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_7a89pb.mount: Deactivated successfully.
2025-01-30T03:41:12.142618-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_5nmrme.mount: Deactivated successfully.
2025-01-30T03:41:12.142702-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_1txp5g.mount: Deactivated successfully.
2025-01-30T03:41:12.148753-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_bpygpt.mount: Deactivated successfully.
2025-01-30T03:41:12.155491-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T03:41:12.155678-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_nki6oj.mount: Deactivated successfully.
2025-01-30T03:41:12.155754-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T03:41:12.155822-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_h3f0q3.mount: Deactivated successfully.
2025-01-30T03:41:12.160799-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T03:41:12.160935-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T04:06:52.240188-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_7a89pb.mount: Deactivated successfully.
2025-01-30T04:06:52.240397-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_5nmrme.mount: Deactivated successfully.
2025-01-30T04:06:52.240490-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_2f9t0b.mount: Deactivated successfully.
2025-01-30T04:06:52.240552-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_1txp5g.mount: Deactivated successfully.
2025-01-30T04:06:52.252355-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_bpygpt.mount: Deactivated successfully.
2025-01-30T04:06:52.252487-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_9dns6y.mount: Deactivated successfully.
2025-01-30T04:06:52.253703-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_nki6oj.mount: Deactivated successfully.
2025-01-30T04:06:52.254552-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T04:06:52.254678-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_h3f0q3.mount: Deactivated successfully.
2025-01-30T04:06:52.258969-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T04:06:52.259128-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T04:06:52.259184-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T04:39:38.320452-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_7a89pb.mount: Deactivated successfully.
2025-01-30T04:39:38.320625-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_5nmrme.mount: Deactivated successfully.
2025-01-30T04:39:38.320699-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_2f9t0b.mount: Deactivated successfully.
2025-01-30T04:39:38.320767-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_1txp5g.mount: Deactivated successfully.
2025-01-30T04:39:38.328785-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_h3f0q3.mount: Deactivated successfully.
2025-01-30T04:39:38.328924-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_bpygpt.mount: Deactivated successfully.
2025-01-30T04:39:38.328981-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_9dns6y.mount: Deactivated successfully.
2025-01-30T04:39:38.338099-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T04:39:38.340275-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T04:39:38.340411-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T04:39:38.340510-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_nki6oj.mount: Deactivated successfully.
2025-01-30T04:39:38.345287-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T05:08:36.628215-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T05:08:36.628361-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T05:08:36.628423-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T05:08:36.628486-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_nki6oj.mount: Deactivated successfully.
2025-01-30T05:08:36.628549-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T05:08:36.628642-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_h3f0q3.mount: Deactivated successfully.
2025-01-30T05:08:36.628793-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_bpygpt.mount: Deactivated successfully.
2025-01-30T05:08:36.628863-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_9dns6y.mount: Deactivated successfully.
2025-01-30T05:08:36.628927-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_7a89pb.mount: Deactivated successfully.
2025-01-30T05:08:36.629056-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_5nmrme.mount: Deactivated successfully.
2025-01-30T05:08:36.629122-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_2f9t0b.mount: Deactivated successfully.
2025-01-30T05:08:36.629202-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_1txp5g.mount: Deactivated successfully.
2025-01-30T05:09:08.394736-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-manual.mount: Deactivated successfully.
2025-01-30T05:21:42.057326-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_bpygpt.mount: Deactivated successfully.
2025-01-30T05:21:42.058848-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_9dns6y.mount: Deactivated successfully.
2025-01-30T05:21:42.059001-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_2f9t0b.mount: Deactivated successfully.
2025-01-30T05:21:42.062512-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_1txp5g.mount: Deactivated successfully.
2025-01-30T05:21:42.066667-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_i51u6s.mount: Deactivated successfully.
2025-01-30T05:21:42.066800-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_h3f0q3.mount: Deactivated successfully.
2025-01-30T05:21:42.066869-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_7a89pb.mount: Deactivated successfully.
2025-01-30T05:21:42.066923-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_5nmrme.mount: Deactivated successfully.
2025-01-30T05:21:42.075323-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_za6p8h.mount: Deactivated successfully.
2025-01-30T05:21:42.075869-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_t5k3bw.mount: Deactivated successfully.
2025-01-30T05:21:42.076014-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_nki6oj.mount: Deactivated successfully.
2025-01-30T05:21:42.078834-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-autozsys_uycxom.mount: Deactivated successfully.
2025-01-30T05:21:43.057375-06:00 htpc systemd[1]: home-mona-.zfs-snapshot-manual.mount: Deactivated successfully.

I looked through the older /var/log/syslog.*.gz files with zcat and couldn't find any records for zfs or zsys messing with the USERDATA snapshots for the two users, but those logs only go back a few weeks and these accounts were created months and years ago so I don't have a record of destruction or deactivation from back in the days.

[JakFrost]

Home - User: Paladin

/home/paladin# ll
total 40K
drwxr-xr-x  3 paladin paladin   12 Jan 30 03:35 ./
drwxr-xr-x 10 root    root      10 Jan 27 19:52 ../
-rw-------  1 paladin paladin  100 Jan 30 03:35 .bash_history
-rw-r--r--  1 paladin paladin  220 Jan 30 03:32 .bash_logout
-rw-r--r--  1 paladin paladin 3.7K Jan 30 03:32 .bashrc
-rw-r--r--  1 paladin paladin  807 Jan 30 03:32 .profile
drwx------  2 paladin paladin    5 Jan 30 03:34 .ssh/

Home - User: Paladin - .zfs/*

/home/paladin/.zfs# ll -R
.:
total 9.0K
drwxrwxrwx  1 root    root     0 Jan 30 04:43 ./
drwxr-xr-x  3 paladin paladin 12 Jan 30 03:35 ../
drwxrwxrwx  2 root    root     2 Jan 30 04:50 shares/
drwxrwxrwx 23 root    root     2 Jan 30 05:04 snapshot/

./shares:
total 0
drwxrwxrwx 2 root root 2 Jan 30 04:50 ./
drwxrwxrwx 1 root root 0 Jan 30 04:43 ../

./snapshot:
total 0
drwxrwxrwx 23 root root 2 Jan 30 05:04 ./
drwxrwxrwx  1 root root 0 Jan 30 04:43 ../
drwxrwxrwx  1 root root 0 Jan 30 03:58 autozsys_2f9t0b/
drwxrwxrwx  1 root root 0 Dec 29 01:14 autozsys_953b65/
drwxrwxrwx  1 root root 0 Jan 22 06:36 autozsys_alh3cs/
drwxrwxrwx  1 root root 0 Dec 20 06:52 autozsys_debi1h/
drwxrwxrwx  1 root root 0 Jan  8 06:37 autozsys_fvurga/
drwxrwxrwx  1 root root 0 Jan 23 02:43 autozsys_gcmhbx/
drwxrwxrwx  1 root root 0 Jan 29 06:31 autozsys_i51u6s/
drwxrwxrwx  1 root root 0 Jan 16 06:27 autozsys_j61q06/
drwxrwxrwx  1 root root 0 Jan 20 22:51 autozsys_jtatbo/
drwxrwxrwx  1 root root 0 Jan 20 22:37 autozsys_le79e8/
drwxrwxrwx  1 root root 0 Jan 17 06:50 autozsys_n5wain/
drwxrwxrwx  1 root root 0 Jan 19 22:01 autozsys_pb540x/
drwxrwxrwx  1 root root 0 Dec 25 14:27 autozsys_pv5yay/
drwxrwxrwx  1 root root 0 Dec 29 04:21 autozsys_rz5r3l/
drwxrwxrwx  1 root root 0 Jan 30 01:25 autozsys_t5k3bw/
drwxrwxrwx  1 root root 0 Jan 24 06:24 autozsys_uruyq4/
drwxrwxrwx  1 root root 0 Jan 29 02:01 autozsys_uycxom/
drwxrwxrwx  1 root root 0 Jan  9 06:19 autozsys_xsqbb5/
drwxrwxrwx  1 root root 0 Dec 29 01:06 autozsys_y6792y/
drwxrwxrwx  1 root root 0 Jan 30 03:25 autozsys_za6p8h/
drwxrwxrwx  1 root root 0 Jan 30 05:04 manual/

./snapshot/autozsys_2f9t0b:
total 31K
drwxr-xr-x  3 paladin paladin   12 Jan 30 03:35 ./
drwxrwxrwx 23 root    root       2 Jan 30 05:04 ../
-rw-------  1 paladin paladin  100 Jan 30 03:35 .bash_history
-rw-r--r--  1 paladin paladin  220 Jan 30 03:32 .bash_logout
-rw-r--r--  1 paladin paladin 3.7K Jan 30 03:32 .bashrc
-rw-r--r--  1 paladin paladin  807 Jan 30 03:32 .profile
drwx------  2 paladin paladin    5 Jan 30 03:34 .ssh/

./snapshot/autozsys_2f9t0b/.ssh:
total 25K
drwx------ 2 paladin paladin    5 Jan 30 03:34 ./
drwxr-xr-x 3 paladin paladin   12 Jan 30 03:35 ../
-rw-r--r-- 1 paladin paladin  566 Jan 30 03:34 authorized_keys
-rw------- 1 paladin paladin 2.6K Jan 30 03:34 id_rsa
-rw-r--r-- 1 paladin paladin  566 Jan 30 03:34 id_rsa.pub

./snapshot/autozsys_953b65:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_alh3cs:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_debi1h:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_fvurga:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_gcmhbx:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_i51u6s:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_j61q06:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_jtatbo:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_le79e8:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_n5wain:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_pb540x:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_pv5yay:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_rz5r3l:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_t5k3bw:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_uruyq4:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_uycxom:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_xsqbb5:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_y6792y:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/autozsys_za6p8h:
total 1.0K
drwxr-xr-x  2 root root 2 Aug 20 19:36 ./
drwxrwxrwx 23 root root 2 Jan 30 05:04 ../

./snapshot/manual:
total 31K
drwxr-xr-x  3 paladin paladin   12 Jan 30 03:35 ./
drwxrwxrwx 23 root    root       2 Jan 30 05:04 ../
-rw-------  1 paladin paladin  100 Jan 30 03:35 .bash_history
-rw-r--r--  1 paladin paladin  220 Jan 30 03:32 .bash_logout
-rw-r--r--  1 paladin paladin 3.7K Jan 30 03:32 .bashrc
-rw-r--r--  1 paladin paladin  807 Jan 30 03:32 .profile
drwx------  2 paladin paladin    5 Jan 30 03:34 .ssh/

./snapshot/manual/.ssh:
total 25K
drwx------ 2 paladin paladin    5 Jan 30 03:34 ./
drwxr-xr-x 3 paladin paladin   12 Jan 30 03:35 ../
-rw-r--r-- 1 paladin paladin  566 Jan 30 03:34 authorized_keys
-rw------- 1 paladin paladin 2.6K Jan 30 03:34 id_rsa
-rw-r--r-- 1 paladin paladin  566 Jan 30 03:34 id_rsa.pub

Home - User: Mona

/home/mona# ll
total 52K
drwxr-xr-x  3 mona mona   12 Jan 30 04:09 ./
drwxr-xr-x 10 root root   10 Jan 27 19:52 ../
-rw-------  1 mona mona  399 Jan 30 04:07 .bash_history
-rw-r--r--  1 mona mona  220 Feb 25  2020 .bash_logout
-rw-r--r--  1 mona mona 3.7K Jan 28  2021 .bashrc
-rw-r--r--  1 mona mona  807 Feb 25  2020 .profile
drwx------  2 mona mona    7 Jan 30 04:07 .ssh/

Home - User: Mona - .zfs/*

/home/mona/.zfs# ll -R
.:
total 9.0K
drwxrwxrwx  1 root root  0 Jan 30 04:43 ./
drwxr-xr-x  3 mona mona 12 Jan 30 04:09 ../
drwxrwxrwx  2 root root  2 Jan 30 05:03 shares/
drwxrwxrwx 15 root root  2 Jan 30 05:03 snapshot/

./shares:
total 0
drwxrwxrwx 2 root root 2 Jan 30 05:03 ./
drwxrwxrwx 1 root root 0 Jan 30 04:43 ../

./snapshot:
total 0
drwxrwxrwx 15 root root 2 Jan 30 05:03 ./
drwxrwxrwx  1 root root 0 Jan 30 04:43 ../
drwxrwxrwx  1 root root 0 Jan 28 02:01 autozsys_1txp5g/
drwxrwxrwx  1 root root 0 Jan 30 03:58 autozsys_2f9t0b/
drwxrwxrwx  1 root root 0 Jan 27 22:59 autozsys_5nmrme/
drwxrwxrwx  1 root root 0 Jan 27 21:58 autozsys_7a89pb/
drwxrwxrwx  1 root root 0 Jan 28 01:00 autozsys_9dns6y/
drwxrwxrwx  1 root root 0 Jan 27 20:57 autozsys_bpygpt/
drwxrwxrwx  1 root root 0 Jan 27 23:59 autozsys_h3f0q3/
drwxrwxrwx  1 root root 0 Jan 29 06:31 autozsys_i51u6s/
drwxrwxrwx  1 root root 0 Jan 27 19:56 autozsys_nki6oj/
drwxrwxrwx  1 root root 0 Jan 30 01:25 autozsys_t5k3bw/
drwxrwxrwx  1 root root 0 Jan 29 02:01 autozsys_uycxom/
drwxrwxrwx  1 root root 0 Jan 30 03:25 autozsys_za6p8h/
drwxrwxrwx  1 root root 0 Jan 30 05:03 manual/

./snapshot/autozsys_1txp5g:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_2f9t0b:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_5nmrme:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_7a89pb:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_9dns6y:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_bpygpt:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_h3f0q3:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_i51u6s:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_nki6oj:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_t5k3bw:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_uycxom:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/autozsys_za6p8h:
total 1.0K
drwxr-xr-x  2 root root 2 Jan 27 19:52 ./
drwxrwxrwx 15 root root 2 Jan 30 05:03 ../

./snapshot/manual:
total 43K
drwxr-xr-x  3 mona mona   12 Jan 30 04:09 ./
drwxrwxrwx 15 root root    2 Jan 30 05:03 ../
-rw-------  1 mona mona  399 Jan 30 04:07 .bash_history
-rw-r--r--  1 mona mona  220 Feb 25  2020 .bash_logout
-rw-r--r--  1 mona mona 3.7K Jan 28  2021 .bashrc
-rw-r--r--  1 mona mona  807 Feb 25  2020 .profile
drwx------  2 mona mona    7 Jan 30 04:07 .ssh/

./snapshot/manual/.ssh:
total 43K
drwx------ 2 mona mona    7 Jan 30 04:07 ./
drwxr-xr-x 3 mona mona   12 Jan 30 04:09 ../
-rw-r--r-- 1 mona mona 1.2K Jan 30 04:07 authorized_keys
-rw------- 1 mona mona 2.6K Jan 30 04:03 id_rsa.iphone
-rw-r--r-- 1 mona mona  563 Jan 30 04:03 id_rsa.iphone.pub
-rw------- 1 mona mona 2.6K Jan 30 04:06 id_rsa.itablet
-rw-r--r-- 1 mona mona  563 Jan 30 04:06 id_rsa.itablet.pub

[JakFrost]

Uploaded Files

It appears that the previous comment's uploads failed.

zsysctl-show--full.txt
zpool-history-il-rpool-paladin.txt
zpool-history-il-rpool-mona.txt
report.txt

[TheGrave]

Same here, I was just about to open the same ticket. I imported an old ZFS pool from an external drive and BAM - this piece'o'garbage decides to treat them as managed and its gc algorithm destroy all my datasets in USERDATA!!! I've heard some horror stories about zsys but didn't quite get to the bottom of them. This thing needs to be purged from Ubuntu repos once and forever!

2025-02-23.19:26:48 zpool import -d /dev/disk/by-id/usb-SSK_SSK_Storage_DD564198838B8-0:0-part7 rpool_old rpool_old1 -N -f
2025-02-23.19:29:55 [txg:21985104] set rpool_old1/ROOT/ubuntu_g7v3dq (4483) mountpoint=legacy
2025-02-23.19:29:55 zfs set mountpoint=legacy rpool_old1/ROOT/ubuntu_g7v3dq
2025-02-23.19:31:08 [txg:21985119] destroy rpool_old1/USERDATA/guest_c928nz (5136) (bptree, mintxg=21609809)
2025-02-23.19:31:11 [txg:21985120] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_kutdos (171)  
2025-02-23.19:31:11 (210ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_kutdos

2025-02-23.19:31:12 [txg:21985121] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_au63by (1904)  
2025-02-23.19:31:12 (134ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_au63by

2025-02-23.19:31:13 [txg:21985122] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_wwhn9s (1067)  
2025-02-23.19:31:13 (124ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_wwhn9s

2025-02-23.19:31:14 [txg:21985123] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_ff4mfm (2180)  
2025-02-23.19:31:14 (126ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_ff4mfm

2025-02-23.19:31:15 [txg:21985124] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_f2w433 (628)  
2025-02-23.19:31:15 (118ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_f2w433

2025-02-23.19:31:16 [txg:21985125] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_u6wjpd (3020)  
2025-02-23.19:31:16 (110ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_u6wjpd

2025-02-23.19:31:17 [txg:21985126] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_x6j31q (2633)  
2025-02-23.19:31:17 (136ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_x6j31q

2025-02-23.19:31:18 [txg:21985127] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_x2bb7j (928)  
2025-02-23.19:31:18 (183ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_x2bb7j

2025-02-23.19:31:19 [txg:21985128] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_4es1k0 (1813)  
2025-02-23.19:31:19 (116ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_4es1k0

2025-02-23.19:31:20 [txg:21985129] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_cdescq (2573)  
2025-02-23.19:31:21 (151ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_cdescq

2025-02-23.19:31:21 [txg:21985130] destroy rpool_old1/USERDATA/guest_vctto2@autozsys_ad6vpw (714)  
2025-02-23.19:31:21 (120ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/guest_vctto2@autozsys_ad6vpw

2025-02-23.19:31:22 [txg:21985131] destroy rpool_old1/USERDATA/guest_vctto2 (1920) (bptree, mintxg=1)
2025-02-23.19:31:26 [txg:21985132] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_48tyid (245)  
2025-02-23.19:31:26 (314ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_48tyid

2025-02-23.19:31:27 [txg:21985133] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_cdescq (2576)  
2025-02-23.19:31:27 (189ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_cdescq

2025-02-23.19:31:28 [txg:21985134] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_x2bb7j (137)  
2025-02-23.19:31:29 (377ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_x2bb7j

2025-02-23.19:31:30 [txg:21985135] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_kjzmv1 (1386)  
2025-02-23.19:31:30 (286ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_kjzmv1

2025-02-23.19:31:31 [txg:21985136] destroy rpool_old1/USERDATA/<username>_c928nz (5514) (bptree, mintxg=21609810)
2025-02-23.19:31:33 [txg:21985138] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_wwhn9s (1082)  
2025-02-23.19:31:34 (1589ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_wwhn9s

2025-02-23.19:31:36 [txg:21985140] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_kutdos (1153)  
2025-02-23.19:31:37 (1887ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_kutdos

2025-02-23.19:31:38 [txg:21985142] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_hqjvi4 (1740)  
2025-02-23.19:31:40 (1571ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_hqjvi4

2025-02-23.19:31:41 [txg:21985144] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_xbv6iv (127)  
2025-02-23.19:31:42 (1465ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_xbv6iv

2025-02-23.19:31:43 [txg:21985146] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_20nzuv (1573)  
2025-02-23.19:31:43 (258ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_20nzuv

2025-02-23.19:31:44 [txg:21985147] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_f2w433 (994)  
2025-02-23.19:31:45 (758ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_f2w433

2025-02-23.19:31:46 [txg:21985148] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_y267qe (1866)  
2025-02-23.19:31:46 (253ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_y267qe

2025-02-23.19:31:47 [txg:21985149] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_4es1k0 (2237)  
2025-02-23.19:31:47 (322ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_4es1k0

2025-02-23.19:31:48 [txg:21985150] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_ad6vpw (1051)  
2025-02-23.19:31:49 (238ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_ad6vpw

2025-02-23.19:31:50 [txg:21985151] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_89j473 (858)  
2025-02-23.19:31:50 (279ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_89j473

2025-02-23.19:31:51 [txg:21985152] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_gfi5ls (1764)  
2025-02-23.19:31:51 (223ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_gfi5ls

2025-02-23.19:31:52 [txg:21985153] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_brqln7 (176)  
2025-02-23.19:31:52 (210ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_brqln7

2025-02-23.19:31:53 [txg:21985154] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_he46el (1790)  
2025-02-23.19:31:53 (232ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_he46el

2025-02-23.19:31:54 [txg:21985155] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_x6j31q (1360)  
2025-02-23.19:31:55 (198ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_x6j31q

2025-02-23.19:31:56 [txg:21985156] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_po2ud7 (235)  
2025-02-23.19:31:56 (272ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_po2ud7

2025-02-23.19:31:57 [txg:21985157] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_bwpjtj (2350)  
2025-02-23.19:31:57 (215ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_bwpjtj

2025-02-23.19:31:58 [txg:21985158] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_mhkemi (2239)  
2025-02-23.19:31:58 (246ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_mhkemi

2025-02-23.19:31:59 [txg:21985159] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_uvip5d (613)  
2025-02-23.19:31:59 (259ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_uvip5d

2025-02-23.19:32:00 [txg:21985160] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_eunnn8 (2071)  
2025-02-23.19:32:00 (195ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_eunnn8

2025-02-23.19:32:01 [txg:21985161] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_to5suw (2175)  
2025-02-23.19:32:01 (352ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_to5suw

2025-02-23.19:32:02 [txg:21985162] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_n6birn (391)  
2025-02-23.19:32:03 (293ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_n6birn

2025-02-23.19:32:04 [txg:21985163] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_4fj123 (251)  
2025-02-23.19:32:04 (389ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_4fj123

2025-02-23.19:32:05 [txg:21985164] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_kaw3uz (848)  
2025-02-23.19:32:05 (421ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_kaw3uz

2025-02-23.19:32:06 [txg:21985165] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_au63by (1938)  
2025-02-23.19:32:07 (893ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_au63by

2025-02-23.19:32:08 [txg:21985166] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_u6wjpd (3017)  
2025-02-23.19:32:09 (867ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_u6wjpd

2025-02-23.19:32:10 [txg:21985167] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_j6vt6t (621)  
2025-02-23.19:32:10 (710ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_j6vt6t

2025-02-23.19:32:11 [txg:21985168] destroy rpool_old1/USERDATA/<username>_vctto2@autozsys_ff4mfm (2183)  
2025-02-23.19:32:13 (1492ms) ioctl destroy_snaps
    input:
        snaps:
            rpool_old1/USERDATA/<username>_vctto2@autozsys_ff4mfm

2025-02-23.19:32:14 [txg:21985170] destroy rpool_old1/USERDATA/<username>_vctto2 (1912) (bptree, mintxg=1)

[almereyda]

Full Ack to the last sentence.

[JakFrost]

zsys destroyed another newly created user home folder for a new user masada.

This time I realized that it might be related to the auto snapshot feature that ran after APT updates of packages since Ubuntu did an auto update and install of new security patches for packages.

So I've had enough of this zsys garbage and uninstalled the entire package. Can't keep losing my friend's home drives every time there is an update.

This garbage service is plain broken and now I'm going to have to manually maintain my zfs snapshots and clean up the garbage that it created.

APT - zsys system autosnapshot

cat /etc/apt/apt.conf.d/90_zsys_system_autosnapshot

// Takes a snapshot of the system before package changes.
DPkg::Pre-Invoke {"[ -x /usr/libexec/zsys-system-autosnapshot ] && /usr/libexec/zsys-system-autosnapshot snapshot || true";};
// Update our bootloader to list the new snapshot after the update is done to not block the critical path
DPkg::Post-Invoke {"[ -x /usr/libexec/zsys-system-autosnapshot ] && /usr/libexec/zsys-system-autosnapshot update-menu || true";};

Date

date -Isec

2025-05-30T01:53:49-05:00

Uptime

uptime

01:51:55 up 8 days,  3:53,  2 users,  load average: 0.89, 1.02, 1.12

Ubuntu Linux Release

cat /etc/os-release

PRETTY_NAME="Ubuntu 24.04.2 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04.2 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo

Syslog

cat /var/log/syslog* | grep -iE 'zsys|zfs' | grep -iE 'masada'

2025-05-29T21:11:24.454726-05:00 htpc systemd[1]: home-masada-.zfs-snapshot-autozsys_fzedbm.mount: Deactivated successfully.

Zpool History - Destroy Masada

zpool history -il rpool | grep -iE 'destroy.*masada'

2025-05-14.21:10:35 [txg:59723734] destroy rpool/USERDATA/masada_20r3j2@autozsys_6qsis3 (98215)   [on htpc]
2025-05-14.21:10:35 [txg:59723734] destroy rpool/USERDATA/masada_20r3j2@autozsys_vrnhj3 (108446)   [on htpc]
2025-05-14.21:10:35 [txg:59723734] destroy rpool/USERDATA/masada_20r3j2@autozsys_tnqpmc (102936)   [on htpc]
2025-05-14.21:10:35 [txg:59723735] destroy rpool/USERDATA/masada_20r3j2 (98319) (bptree, mintxg=1) [on htpc]
2025-05-14.21:10:35 zfs destroy -r rpool/USERDATA/masada_20r3j2 [user 0 (root) on htpc:linux]
2025-05-29.21:14:27 [txg:59977064] destroy rpool/USERDATA/masada_anrmxw@autozsys_fzedbm (108619)   [on htpc]
2025-05-29.21:14:27 [txg:59977066] destroy rpool/USERDATA/masada_anrmxw (108605) (bptree, mintxg=1) [on htpc]
2025-05-29.21:14:27 zfs destroy -r rpool/USERDATA/masada_anrmxw [user 0 (root) on htpc:linux]

ZPool History - Masada with Context +-5 Lines

zpool history -il rpool | grep -B5 -A5 -iE 'masada'

2025-05-13.18:04:21 [txg:59704632] create rpool/USERDATA/masada_20r3j2 (98319)   [on htpc]
2025-05-13.18:04:21 [txg:59704633] set rpool/USERDATA/masada_20r3j2 (98319) mountpoint=/home/masada [on htpc]
2025-05-13.18:04:21 [txg:59704633] set rpool/USERDATA/masada_20r3j2 (98319) canmount=1 [on htpc]
2025-05-13.18:04:21 (34ms) ioctl create
    input:
        type: 2
        props:
            mountpoint: '/home/masada'
            canmount: 1
 [user 0 (root) on htpc:linux]
2025-05-13.18:04:21 [txg:59704634] set rpool/USERDATA/masada_20r3j2 (98319) com.ubuntu.zsys:bootfs-datasets=rpool/ROOT/ubuntu_r3ij8n [on htpc]
2025-05-13.18:04:21 [txg:59704635] set rpool/USERDATA/masada_20r3j2 (98319) com.ubuntu.zsys:last-used=1747177461 [on htpc]
2025-05-13.18:13:09 [txg:59704739] snapshot rpool/USERDATA/masada_20r3j2@autozsys_6qsis3 (98215)   [on htpc]
2025-05-13.18:13:09 [txg:59704739] set rpool/USERDATA/masada_20r3j2@autozsys_6qsis3 (98215) com.ubuntu.zsys:mountpoint=/home/masada:local [on htpc]
2025-05-13.18:13:09 [txg:59704739] set rpool/USERDATA/masada_20r3j2@autozsys_6qsis3 (98215) com.ubuntu.zsys:canmount=on:local [on htpc]
2025-05-13.18:13:09 (16ms) ioctl snapshot
    input:
        snaps:
            rpool/USERDATA/masada_20r3j2@autozsys_6qsis3
        props:
            com.ubuntu.zsys:mountpoint: '/home/masada:local'
            com.ubuntu.zsys:canmount: 'on:local'
 [user 0 (root) on htpc:linux]
2025-05-14.06:10:15 [txg:59713173] snapshot rpool/USERDATA/masada_20r3j2@autozsys_tnqpmc (102936)   [on htpc]
2025-05-14.06:10:15 [txg:59713173] set rpool/USERDATA/masada_20r3j2@autozsys_tnqpmc (102936) com.ubuntu.zsys:mountpoint=/home/masada:local [on htpc]
2025-05-14.06:10:15 [txg:59713173] set rpool/USERDATA/masada_20r3j2@autozsys_tnqpmc (102936) com.ubuntu.zsys:canmount=on:local [on htpc]
2025-05-14.06:10:15 (12ms) ioctl snapshot
    input:
        snaps:
            rpool/USERDATA/masada_20r3j2@autozsys_tnqpmc
        props:
            com.ubuntu.zsys:mountpoint: '/home/masada:local'
            com.ubuntu.zsys:canmount: 'on:local'
 [user 0 (root) on htpc:linux]
2025-05-14.20:54:09 [txg:59723541] snapshot rpool/USERDATA/masada_20r3j2@autozsys_vrnhj3 (108446)   [on htpc]
2025-05-14.20:54:09 [txg:59723541] set rpool/USERDATA/masada_20r3j2@autozsys_vrnhj3 (108446) com.ubuntu.zsys:canmount=on:local [on htpc]
2025-05-14.20:54:09 [txg:59723541] set rpool/USERDATA/masada_20r3j2@autozsys_vrnhj3 (108446) com.ubuntu.zsys:mountpoint=/home/masada:local [on htpc]
2025-05-14.20:54:09 (15ms) ioctl snapshot
    input:
        snaps:
            rpool/USERDATA/masada_20r3j2@autozsys_vrnhj3
        props:
            com.ubuntu.zsys:canmount: 'on:local'
            com.ubuntu.zsys:mountpoint: '/home/masada:local'
 [user 0 (root) on htpc:linux]
2025-05-14.21:10:35 [txg:59723734] destroy rpool/USERDATA/masada_20r3j2@autozsys_6qsis3 (98215)   [on htpc]
2025-05-14.21:10:35 [txg:59723734] destroy rpool/USERDATA/masada_20r3j2@autozsys_vrnhj3 (108446)   [on htpc]
2025-05-14.21:10:35 [txg:59723734] destroy rpool/USERDATA/masada_20r3j2@autozsys_tnqpmc (102936)   [on htpc]
2025-05-14.21:10:35 (21ms) ioctl destroy_snaps
    input:
        snaps:
            rpool/USERDATA/masada_20r3j2@autozsys_6qsis3
            rpool/USERDATA/masada_20r3j2@autozsys_vrnhj3
            rpool/USERDATA/masada_20r3j2@autozsys_tnqpmc
 [user 0 (root) on htpc:linux]
2025-05-14.21:10:35 [txg:59723735] destroy rpool/USERDATA/masada_20r3j2 (98319) (bptree, mintxg=1) [on htpc]
2025-05-14.21:10:35 zfs destroy -r rpool/USERDATA/masada_20r3j2 [user 0 (root) on htpc:linux]
2025-05-14.21:15:16 [txg:59723791] create rpool/USERDATA/masada_anrmxw (108605)   [on htpc]
2025-05-14.21:15:16 [txg:59723792] set rpool/USERDATA/masada_anrmxw (108605) canmount=1 [on htpc]
2025-05-14.21:15:16 [txg:59723792] set rpool/USERDATA/masada_anrmxw (108605) mountpoint=/home/masada [on htpc]
2025-05-14.21:15:16 (50ms) ioctl create
    input:
        type: 2
        props:
            canmount: 1
            mountpoint: '/home/masada'
 [user 0 (root) on htpc:linux]
2025-05-14.21:15:16 [txg:59723793] set rpool/USERDATA/masada_anrmxw (108605) com.ubuntu.zsys:bootfs-datasets=rpool/ROOT/ubuntu_r3ij8n [on htpc]
2025-05-14.21:15:16 [txg:59723794] set rpool/USERDATA/masada_anrmxw (108605) com.ubuntu.zsys:last-used=1747275316 [on htpc]
2025-05-14.21:20:09 [txg:59723852] snapshot rpool/USERDATA/masada_anrmxw@autozsys_fzedbm (108619)   [on htpc]
2025-05-14.21:20:09 [txg:59723852] set rpool/USERDATA/masada_anrmxw@autozsys_fzedbm (108619) com.ubuntu.zsys:mountpoint=/home/masada:local [on htpc]
2025-05-14.21:20:09 [txg:59723852] set rpool/USERDATA/masada_anrmxw@autozsys_fzedbm (108619) com.ubuntu.zsys:canmount=on:local [on htpc]
2025-05-14.21:20:09 (15ms) ioctl snapshot
    input:
        snaps:
            rpool/USERDATA/masada_anrmxw@autozsys_fzedbm
        props:
            com.ubuntu.zsys:mountpoint: '/home/masada:local'
            com.ubuntu.zsys:canmount: 'on:local'
 [user 0 (root) on htpc:linux]

2025-05-17.04:00:33 [txg:59762364] open pool version 5000; software version zfs-2.2.2-0-g494aaaed8-dist; uts htpc 6.8.0-60-generic #63-Ubuntu SMP PREEMPT_DYNAMIC Tue Apr 15 19:04:15 UTC 2025 x86_64 [on htpc]
2025-05-17.04:00:34 [txg:59762366] import pool version 5000; software version zfs-2.2.2-0-g494aaaed8-dist; uts htpc 6.8.0-60-generic #63-Ubuntu SMP PREEMPT_DYNAMIC Tue Apr 15 19:04:15 UTC 2025 x86_64 [on htpc]
2025-05-17.04:00:34 zpool import -N rpool [user 0 (root) on htpc:linux]
--
2025-05-19.21:33:02 [txg:59808465] import pool version 5000; software version zfs-2.2.2-0-g494aaaed8-dist; uts htpc 6.8.0-60-generic #63-Ubuntu SMP PREEMPT_DYNAMIC Tue Apr 15 19:04:15 UTC 2025 x86_64 [on htpc]
2025-05-19.21:33:02 zpool import -N rpool [user 0 (root) on htpc:linux]
2025-05-21.21:58:15 [txg:59842528] open pool version 5000; software version zfs-2.2.2-0-g494aaaed8-dist; uts htpc 6.8.0-60-generic #63-Ubuntu SMP PREEMPT_DYNAMIC Tue Apr 15 19:04:15 UTC 2025 x86_64 [on htpc]
2025-05-21.21:58:15 [txg:59842530] import pool version 5000; software version zfs-2.2.2-0-g494aaaed8-dist; uts htpc 6.8.0-60-generic #63-Ubuntu SMP PREEMPT_DYNAMIC Tue Apr 15 19:04:15 UTC 2025 x86_64 [on htpc]
2025-05-21.21:58:15 zpool import -N rpool [user 0 (root) on htpc:linux]

2025-05-29.21:14:27 [txg:59977064] destroy rpool/USERDATA/masada_anrmxw@autozsys_fzedbm (108619)   [on htpc]
2025-05-29.21:14:27 (13ms) ioctl destroy_snaps
    input:
        snaps:
            rpool/USERDATA/masada_anrmxw@autozsys_fzedbm
 [user 0 (root) on htpc:linux]
2025-05-29.21:14:27 [txg:59977066] destroy rpool/USERDATA/masada_anrmxw (108605) (bptree, mintxg=1) [on htpc]
2025-05-29.21:14:27 zfs destroy -r rpool/USERDATA/masada_anrmxw [user 0 (root) on htpc:linux]
2025-05-29.21:16:42 [txg:59977093] create rpool/USERDATA/masada_abcdef (67706)   [on htpc]
2025-05-29.21:16:42 (16ms) ioctl create
    input:
        type: 2
        props:
 [user 0 (root) on htpc:linux]
2025-05-29.21:16:42 zfs create rpool/USERDATA/masada_abcdef [user 0 (root) on htpc:linux]
2025-05-29.21:19:22 [txg:59977126] set rpool/USERDATA/masada_abcdef (67706) mountpoint=/home/masada [on htpc]
2025-05-29.21:19:22 zfs set mountpoint=/home/masada rpool/USERDATA/masada_abcdef [user 0 (root) on htpc:linux]

APT History

grep -A3 -iE 'Start-Date: 2025-05-(14|29)' /var/log/apt/history.log

Start-Date: 2025-05-14  06:10:15
Commandline: /usr/bin/unattended-upgrade
Upgrade: open-vm-tools:amd64 (2:12.4.5-1~ubuntu0.24.04.1, 2:12.4.5-1~ubuntu0.24.04.2)
End-Date: 2025-05-14  06:10:22
--
Start-Date: 2025-05-29  06:38:27
Commandline: /usr/bin/unattended-upgrade
Upgrade: libinput-dev:amd64 (1.25.0-1ubuntu3, 1.25.0-1ubuntu3.1), libinput10:amd64 (1.25.0-1ubuntu3, 1.25.0-1ubuntu3.1), libinput-bin:amd64 (1.25.0-1ubuntu3, 1.25.0-1ubuntu3.1)
End-Date: 2025-05-29  06:38:29
--
Start-Date: 2025-05-29  06:38:40
Commandline: /usr/bin/unattended-upgrade
Upgrade: net-tools:amd64 (2.10-0.1ubuntu4, 2.10-0.1ubuntu4.4)
End-Date: 2025-05-29  06:38:42
--
Start-Date: 2025-05-29  06:38:50
Commandline: /usr/bin/unattended-upgrade
Upgrade: krb5-locales:amd64 (1.20.1-6ubuntu2.5, 1.20.1-6ubuntu2.6), libgssapi-krb5-2:amd64 (1.20.1-6ubuntu2.5, 1.20.1-6ubuntu2.6), libkrb5support0:amd64 (1.20.1-6ubuntu2.5, 1.20.1-6ubuntu2.6), libkrb5-3:amd64 (1.20.1-6ubuntu2.5, 1.20.1-6ubuntu2.6), libk5crypto3:amd64 (1.20.1-6ubuntu2.5, 1.20.1-6ubuntu2.6)
End-Date: 2025-05-29  06:38:51
--
Start-Date: 2025-05-29  06:39:10
Commandline: /usr/bin/unattended-upgrade
Upgrade: cifs-utils:amd64 (2:7.0-2build1, 2:7.0-2ubuntu0.1)
End-Date: 2025-05-29  06:39:14
--
Start-Date: 2025-05-29  06:39:21
Commandline: /usr/bin/unattended-upgrade
Upgrade: apt:amd64 (2.7.14build2, 2.8.3), libapt-pkg6.0t64:amd64 (2.7.14build2, 2.8.3), apt-utils:amd64 (2.7.14build2, 2.8.3)
End-Date: 2025-05-29  06:39:28
--
Start-Date: 2025-05-29  06:39:43
Commandline: /usr/bin/unattended-upgrade
Upgrade: update-manager-core:amd64 (1:24.04.9, 1:24.04.12), python3-update-manager:amd64 (1:24.04.9, 1:24.04.12)
End-Date: 2025-05-29  06:39:44
--
Start-Date: 2025-05-29  06:40:01
Commandline: /usr/bin/unattended-upgrade
Upgrade: python3-pkg-resources:amd64 (68.1.2-2ubuntu1.1, 68.1.2-2ubuntu1.2), python3-setuptools:amd64 (68.1.2-2ubuntu1.1, 68.1.2-2ubuntu1.2)
End-Date: 2025-05-29  06:40:04
--
Start-Date: 2025-05-29  06:40:21
Commandline: /usr/bin/unattended-upgrade
Upgrade: libsoup-3.0-0:amd64 (3.4.4-5ubuntu0.3, 3.4.4-5ubuntu0.4), libsoup-3.0-common:amd64 (3.4.4-5ubuntu0.3, 3.4.4-5ubuntu0.4)
End-Date: 2025-05-29  06:40:22
--
Start-Date: 2025-05-29  06:40:39
Commandline: /usr/bin/unattended-upgrade
Upgrade: intel-microcode:amd64 (3.20250211.0ubuntu0.24.04.1, 3.20250512.0ubuntu0.24.04.1)
End-Date: 2025-05-29  06:40:57
--
Start-Date: 2025-05-29  06:41:15
Commandline: /usr/bin/unattended-upgrade
Upgrade: tzdata:amd64 (2025b-0ubuntu0.24.04, 2025b-0ubuntu0.24.04.1)
End-Date: 2025-05-29  06:41:16
--
Start-Date: 2025-05-29  06:41:32
Commandline: /usr/bin/unattended-upgrade
Upgrade: linux-firmware:amd64 (20240318.git3b128b60-0ubuntu2.11, 20240318.git3b128b60-0ubuntu2.12)
End-Date: 2025-05-29  06:41:55
--
Start-Date: 2025-05-29  21:11:11
Purge: zsys:amd64 (0.5.11.3ubuntu0.24.04.2)
End-Date: 2025-05-29  21:11:15

[JakFrost]

Seems like I lost some diagnostic information when I uninstalled and purged the zsys package.

I forgot to get the list of systemctl list-timers output to see if zsys-gc.timer matched the 2025-05-14 dates and times for the ZFS destruction of the masada user's home folder.

I also came across this Blog post for the Ubuntu developer who wrote about zsys userdata garbage collection and mentioned a little gem like this. Which would explain other people's loss of rpool/USERDATA or anything else with the word 'USERDATA' in the name.

ZFS focus on Ubuntu 20.04 LTS: ZSys state collection

by Didier Roche - Ubuntu contributor - Open source developer - @canonical

https://didrocks.fr/2020/06/04/zfs-focus-on-ubuntu-20.04-lts-zsys-state-collection/

What do we collect?

By default, we only collect automated generated states, as we think those are less meaningful to you than the one you created manually by a zsysctl save command.

In practice, only unassociated filesystem states or snapshot states starting by @autozsys_ prefix will be collected.

In addition, any user dataset clones, untagged - not attached to any system states by a com.ubuntu.zsys:bootfs-datasets, we will come back to the precise mechanism in a future article - will be cleaned up as well.

...

Valid state candidates for garbage collection are any states that don’t have a dependencies over them, we should thus just quickly recheck what dependencies are.

Final note on states

We hope this syntax is readable, it was quite a journey to find some way to define precisely our garbage collection policy and organize this. The principle is really built on keeping as many recent states as possible (with our default rules for current and previous day + the keeplast parameter for the system and each users, independently), while purging more and more states as time goes by (through the bucket definitions). We are trying to evenly space the states we are keeping based on dependencies and other constraints.

As you can think, all of this is backed up with a very extensive test suite as this is playing with system and user data. However, we may be tweaking this over time based on your feedback and pressure on disk over the rpool and bpool. You are always on the driver’s seat either by forcing taking into account all states in the gc (--all flag), by manually removing states and dependencies zsysctl state remove <your_state> or by tweaking the GC policy manually with zsys.conf.

But that’s not the end story on our journey through the ZFS integration in Ubuntu 20.04 LTS! In the next blog post, we will list some remaining ZSys user-facing features we didn’t mention yet. We will try to highlight some more tweaking you can do on your system and how all those pieces are fitting together. See you there :)

[46cv8]

I remember reading about this issue 3 years back from #218 and hoping it would never happen to me before I migrated away from zsys.
We'll I'm here to sadly say it happened to me before I could get off zsys, and my last full backup was 6 months ago so yeah...
I have somewhat of an idea of why it happened to me, I had reset my cmos battery and lost my EFI boot entries so I needed to boot up a live CD and mount my zfs then chroot to rebuild grub/EFI entries.
During this process, something must have triggered zsys to run somehow, and it must have seen that my users weren't on the active system, so it just deleted all there datasets.
I made afew more changes before I noticed they were removed, mainly copying my bpool directly into rpool/ROOT/ubuntu_XXXXX/boot so that I could use zfsbootmenu going forward.
Then when I tried to start zfsbootmenu it through up errors about all the missing user folders /home/XXXX and /root/.
I thought perhaps zfsbootmenu is just broken then when I went to look all the USERDATA data sets were gone...
I went and ran "sudo zpool history -il rpool | grep -B 1 -iE 'destroy.*'" and confirmed they were all destroyed 3 hours prior in a row along with all the snapshots right around the time I was rebuilding grub using chroot.

I'm not 100% sure how or why it did what it did, but if you need to run chroot to recover your system under chroot I highly recommend you make a disk backup and/or kill zsys to make sure it doesn't blow away all your userdata.....