[Dovecot] Duplicate Attachments....

Bill Boebel bill at webmail.us
Fri Jun 2 04:31:26 EEST 2006


On Thu, June 1, 2006 8:37, Timo Sirainen said:
> On Thu, 2006-06-01 at 07:45 -0400, Charles Marcus wrote:
> > Our business model (advertising industry) is such that our users
> > exchange a lot of emails with attachments - most less than a megabyte,
> > but some considerably larger. Consequently, I have been looking for a
> > good, open source imap server that doesn't store multiple copies of the
> > same attachment - but instead, stores a checksum, and whenever a message
> > is stored with a duplicate attachment, the attachment is stored only
> > once, and simply referenced by some kind of link to other emails.
> >
> > This would *drastically* reduce the storage requirements for our company
> > - imagine a message with a 10MB attachment, sent to 40 of our users,
> > sometimes more than once. Now multiply this by 3 times per day, for 5
> > years...
> >
> > Are there any plans for Dovecot to support this type of storage in the
> > future? Does this require the use of an SQL DB for storing the message
> > components?
>
> This is planned for dbox format in maybe a couple of months. I think the
> plan was to do this in deliver agent so that the delivered mail's
> attachment is shared between the mail's recipients.

How would you know when all users have deleted an email that has a shared
attachment so that you can safely delete the shared attachment file?

[As I was typing this question I thought of this]...  Perhaps an integer
associated with the file that represents the number of people pointing to
the shared attachment.  Decrement the integer when each user deletes the
related email.  Delete the shared attachment file when the integer reaches
0.

I like this concept.  Is dbox ready for production in its current state? 
(obviously without this proposed feature)

Bill




More information about the dovecot mailing list