[Dovecot] On-delivery deduplication?
delphij at delphij.net
Fri Jun 10 00:32:47 EEST 2011
-----BEGIN PGP SIGNED MESSAGE-----
On 06/09/11 05:36, Allan Cassaro wrote:
> would you try the OpenDedup File System? (http://www.opendedup.org)
> If your problem is (only) the message size, this will works like a charm to
Well, for me it's not a matter of size (I use FreeBSD ZFS which can do
dedup by the way), but simply same message showing up on same inbox for
twice, for IMAP, this can be quite annoying.
Also I don't think filesystem level dedup would work well for mail
servers even using a filesystem that is capable for doing dedup (not to
mention it's sometimes slow), because we store the message header
together with the bodies, and they are likely to differ slightly
(someone@ vs someoneelse at domainname), causing an offset in the message
and thus make block-level dedup useless, so in order to efficiently use
dedup (for speed and space), one have to migrate to a new storage format.
I'll take a look at the code and see if I can do that myself when I have
some spare time, and thanks for everyone who replied.
Xin LI <delphij at delphij.net> http://www.delphij.net/
FreeBSD - The Power to Serve! Live free or die
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (FreeBSD)
-----END PGP SIGNATURE-----
More information about the dovecot