[Dovecot] dovecot and maillists problem
Hello there!
I have a little trouble with using dovecot as lmtp and maillists. I use dovecot 2.0.13 with exim 4.72 on Debian 6.0. (All stuff at one host).
info of maillists is store in mysql table, for example: +---------+-------------------------------------------------------------------------------------------------+ | name | recipients | +---------+-------------------------------------------------------------------------------------------------+ | Hab_Tax | 2504000067-253601001.253809737993@25.example.org,2721097514-272101001.271300057673@.example.org | +---------+-------------------------------------------------------------------------------------------------+
The problem is: When I send a letter to short maillist (as above) it get the same ID and stored only once in the maildir of one user who is the member of that maillist - that's ok, but When I send a letter to maillist with a large number of recipients it occurred that it's saved more than one, because of the headers added by dovecot lmtp (I've changed host name):
diff letter_in_one_user/1314238006.M841940P6916.pink\,S\=12778136\,W\=12953189 letler_in_second_user/new/1314237993.M460165P6916.pink\,S\=12778136\,W\=12953189 3,4c3,4 < by pink.atlas-2.ru (Dovecot) with LMTP id 6UiGJBWuVU4EGwAA1nFjLA < ; Thu, 25 Aug 2011 13:06:46 +1100
by pink.atlas-2.ru (Dovecot) with LMTP id VUeGJBWuVU4EGwAA1nFjLA ; Thu, 25 Aug 2011 13:06:29 +1100
It's the same letter accept the date and id.
What I get in logs is:
I see that exim send letters in maillist with one and the same id: ...skipped... 13:06:46 1QwPKe-0001nU-U5 <2502@example.org> ... 13:06:47 1QwPKe-0001nU-U5 <2502@example.org> ... But in logs of dovecot I see: 13:06:14 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: wUWGJBWuVU4EGwAA1nFjLA: 13:06:18 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: wEWGJBWuVU4EGwAA1nFjLA: 13:06:22 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: JkaGJBWuVU4EGwAA1nFjLA: 13:06:26 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: i0aGJBWuVU4EGwAA1nFjLA: 13:06:30 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: 8EaGJBWuVU4EGwAA1nFjLA: 13:06:34 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: VUeGJBWuVU4EGwAA1nFjLA: 13:06:37 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: ukeGJBWuVU4EGwAA1nFjLA: 13:06:42 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: H0iGJBWuVU4EGwAA1nFjLA: 13:06:46 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: hEiGJBWuVU4EGwAA1nFjLA: 13:06:47 msgid=<E1QwPKe-0001nU-U5@pink.example.org>: 6UiGJBWuVU4EGwAA1nFjLA:
Also in dovecot log I've noticed that: at first auth is searching info in sql for 200 users then log continues with lmtp's info then auth is searching info in sql for another portion of users and this loop in log continues.
Dovecot.conf: http://pastebin.com/ueCBU3bP
dovecot.sql: http://pastebin.com/kqCq52mC
dovecot.log http://pastebin.com/YiyMWpx1
exim.conf: http://pastebin.com/F4MNQkAx
exim.log: http://pastebin.com/wn83TZpX
On 25.8.2011, at 8.17, Костырев Александр Алексеевич wrote:
Try capturing the LMTP traffic between Dovecot and Exim? I'm not sure if there's a good way to capture traffic from UNIX sockets, but at least if Exim and Dovecot talk via TCP there are many ways.
The different LMTP ids and dates are added only when there are different DATA commands, which would mean that Exim has sent separate RCPT TO + DATA commands for each of these mails. But that kind of conflicts on your logs that show tons of SQL lookups one after another..
But that kind of conflicts on your logs that show tons of SQL lookups one after another..
I'm not sure that these are conflicts. As I see it, it's legitimate lookups for the users who are the members of maillist I thought that's correct behavior, am I wrong?
-----Original Message----- From: Timo Sirainen [mailto:tss@iki.fi] Sent: Thursday, August 25, 2011 4:36 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem
On 25.8.2011, at 8.17, Костырев Александр Алексеевич wrote:
Try capturing the LMTP traffic between Dovecot and Exim? I'm not sure if there's a good way to capture traffic from UNIX sockets, but at least if Exim and Dovecot talk via TCP there are many ways.
The different LMTP ids and dates are added only when there are different DATA commands, which would mean that Exim has sent separate RCPT TO + DATA commands for each of these mails. But that kind of conflicts on your logs that show tons of SQL lookups one after another..
I've sniffed traffic between exim and lmtp
In log of dovecot I have: 17:17:46 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: G48FNNjoVU63IwAA1nFjLA: 17:17:51 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: HI8FNNjoVU63IwAA1nFjLA: 17:17:56 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: gY8FNNjoVU63IwAA1nFjLA: 17:18:01 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: 5o8FNNjoVU63IwAA1nFjLA: 17:18:08 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: S5AFNNjoVU63IwAA1nFjLA: 17:18:13 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: sJAFNNjoVU63IwAA1nFjLA: 17:18:18 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: FZEFNNjoVU63IwAA1nFjLA: 17:18:23 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: epEFNNjoVU63IwAA1nFjLA: 17:18:29 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: 35EFNNjoVU63IwAA1nFjLA: 17:18:31 msgid=<E1QwTG6-0002O6-0W@pink.example.com>: RJIFNNjoVU63IwAA1nFjLA: Totally 10 different lmtp ids.
According to wireshark while sending I've got 2 tcp streams with 5 different ids in each
Log of one the streams (I've truncated DATA part - it's the same for both streams): http://pastebin.com/w4qJqZMG
*note I've send message in maillist with mailx -s 'g' 2502@atlas-2.ru < /boot/initrd.img-686
-----Original Message----- From: Timo Sirainen [mailto:tss@iki.fi] Sent: Thursday, August 25, 2011 5:01 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem
I mean, my point of view of what is happening is is disagreement with the logs you showed. So something's weird here and only the LMTP traffic logs can lead to more clarity.
On 25.8.2011, at 8.49, Костырев Александр Алексеевич wrote:
Right, so it looks like Exim is configured to send DATA after each 100 RCPT TOs, which means Dovecot links each message 100 times. If you want it linked those ~500 times, I guess you'll need to increase some limit in Exim.
On 25.8.2011, at 10.14, Костырев Александр Алексеевич wrote:
Yes, Timo, you were absolutely right!
if someone stucks at this: read http://exim.org/exim-html-current/doc/html/spec_html/ch30.html
I had to tune max_rcpt parameter in transport section.
Thank you very much!
-----Original Message----- From: Timo Sirainen [mailto:tss@iki.fi] Sent: Thursday, August 25, 2011 6:19 PM To: Костырев Александр Алексеевич Cc: dovecot@dovecot.org Subject: Re: [Dovecot] dovecot and maillists problem
Right, so it looks like Exim is configured to send DATA after each 100 RCPT TOs, which means Dovecot links each message 100 times. If you want it linked those ~500 times, I guess you'll need to increase some limit in Exim.
On 25.8.2011, at 10.14, Костырев Александр Алексеевич wrote:
participants (2)
-
Timo Sirainen
-
Костырев Александр Алексеевич