Reply 120 of 206, by DosFreak
- Rank
- l33t++
Dedup on home server done. The below deduped data is from all free and purchased games from online:
root@freenas:~ # zdb -U /data/zfs/zpool.cache -DD FreeNAS
DDT-sha256-zap-duplicate: 89663715 entries, size 577 on disk, 186 in core
DDT-sha256-zap-unique: 110825983 entries, size 545 on disk, 176 in core
DDT histogram (aggregated over all DDTs):
bucket allocated referenced
______ ______________________________ ______________________________
refcnt blocks LSIZE PSIZE DSIZE blocks LSIZE PSIZE DSIZE
------ ------ ----- ----- ----- ------ ----- ----- -----
1 106M 13.1T 11.4T 11.6T 106M 13.1T 11.4T 11.6T
2 61.9M 7.59T 6.65T 6.74T 136M 16.6T 14.5T 14.7T
4 19.9M 2.44T 2.17T 2.19T 94.5M 11.6T 10.3T 10.4T
8 3.31M 408G 332G 340G 31.4M 3.78T 3.09T 3.15T
16 293K 31.0G 22.6G 23.7G 6.12M 659G 482G 507G
32 107K 9.71G 7.20G 7.70G 4.67M 420G 306G 330G
64 16.1K 1.70G 1.18G 1.25G 1.28M 138G 94.8G 100G
128 2.31K 226M 86.1M 101M 388K 37.2G 13.1G 15.6G
256 1.57K 189M 117M 123M 618K 73.1G 48.1G 50.1G
512 310 29.0M 1.94M 4.43M 219K 20.1G 1.35G 3.11G
1K 122 13.4M 452K 1.40M 172K 18.9G 634M 1.97G
2K 64 7.25M 235K 744K 181K 20.7G 670M 2.05G
4K 41 4.01M 136K 477K 222K 21.8G 735M 2.52G
8K 10 770K 26.5K 116K 114K 9.23G 321M 1.30G
16K 4 512K 16K 46.5K 74.0K 9.24G 296M 860M
32K 4 512K 16K 45.5K 156K 19.5G 623M 1.77G
Total 191M 23.6T 20.6T 20.9T 381M 46.5T 40.2T 40.8T
dedup = 1.96, compress = 1.16, copies = 1.01, dedup * compress / copies = 2.23
105GB used by my dedupe special vdev
Recovered 22.9TB thanks to dedupe. Free space before 5TB, Free space now 16TB. I've also now moved my game VM games from a seperate SSD to the raidz3. (6.4 TB) and setup my Linux VM and game drive for that (1.5TB). Steam on the Linux VM is updating now and catching up since I haven't been able to do for months since downloading Steam games on Linux over samba has been broken for months.
Working on getting my Synology NAS synced with these changes now.