From robert at schetterer.org Wed Aug 1 00:29:52 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 31 Jul 2012 23:29:52 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected Message-ID: <50184E50.7030907@schetterer.org> Hi Timo, by having errors like Cached message size smaller than expected and Maildir filename has wrong S value and Corrupted index cache file in dove 2.1.8 i can reproduce the problem with tb 14 with 2 nat machines connected to the same server the problem relates with create new folder then copy some uncompressed and compressed mail to it, the i.e open it by other client sometime this happens at once , sometime after a few copy actions however thunderbird ,then errors above apear, sometimes no mail is shown, sometimes only uncompressed or only compressed so funktion read both formats gets lost somehow any idea, you need a better debug ? -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 00:44:43 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 00:44:43 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50184E50.7030907@schetterer.org> References: <50184E50.7030907@schetterer.org> Message-ID: On 1.8.2012, at 0.29, Robert Schetterer wrote: > Cached message size smaller than expected > and > Maildir filename has wrong S value > and > Corrupted index cache file > > in dove 2.1.8 > > i can reproduce the problem with tb 14 > with 2 nat machines connected to the same server > > the problem relates with create new folder then copy > some uncompressed and compressed mail to it, the i.e > open it by other client > > sometime this happens at once , sometime after a few copy actions I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? It would help to know how to reproduce this on an entirely empty mail account. From hendy at soluvas.com Wed Aug 1 01:12:50 2012 From: hendy at soluvas.com (Hendy Irawan) Date: Tue, 31 Jul 2012 15:12:50 -0700 (PDT) Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: References: <34226738.post@talk.nabble.com> Message-ID: <34238207.post@talk.nabble.com> Dear Timo, Thank you very much for your kind work. I apologize, my previous statement were wrong. At least on ApacheDS 1.5.7, it doesn't search entries using the '' base DN (it doesn't give error though, just cannot return results, ApacheDS requires the search base to be in a partition). However, your patch would be great for servers who support the '' search base DN. If I may ask, would you improve it further to accept multiple bases? I'm not sure what the proper character separator would be, but I think something like this would work : base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com The proposed configuration above asks to try the two search bases in succession, whichever first succeeds get logged in, else fails like usual. I hope it's okay with you. I'll definitely help with the testing. Hendy Timo Sirainen wrote: > > On 29.7.2012, at 15.00, Hendy Irawan wrote: > >> We have several context entries and want to authenticate a user against >> the >> whole LDAP server. >> >> However when setting "base = " Dovecot LDAP fails with following message: >> >> Jul 29 10:50:59 nitik1 dovecot: auth: Error: >> ldap(hendy at staging.member.berbatik.com,127.0.0.1): >> ldap_search((virtualMail=hendy at staging.member.berbatik.com)) failed: >> Other >> (e.g., implementation specific) error > > Does the attached patch help? If yes, I'll add it to next version. > > > > ----- http://www.Soluvas.com/ Soluvas - Making eCommerce Work for You -- View this message in context: http://old.nabble.com/BUG%3A-LDAP-extension-failed-to-authenticate-if-%27base%27-DN-configuration-is-empty-%27%27-tp34226738p34238207.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Wed Aug 1 01:51:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 01:51:08 +0300 Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: <34238207.post@talk.nabble.com> References: <34226738.post@talk.nabble.com> <34238207.post@talk.nabble.com> Message-ID: <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> On 1.8.2012, at 1.12, Hendy Irawan wrote: > I apologize, my previous statement were wrong. At least on ApacheDS 1.5.7, > it doesn't search entries using the '' base DN (it doesn't give error > though, just cannot return results, ApacheDS requires the search base to be > in a partition). > > However, your patch would be great for servers who support the '' search > base DN. But does my patch actually make it work in some such servers? I did it only as a guess. If it doesn't fix anything I'd rather just drop the patch. > If I may ask, would you improve it further to accept multiple bases? I'm not > sure what the proper character separator would be, but I think something > like this would work : > > base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com > > The proposed configuration above asks to try the two search bases in > succession, whichever first succeeds get logged in, else fails like usual. You can already do this by creating multiple passdb/userdb ldap sections with different config files. Searching multiple bases requires doing multiple LDAP lookups anyway. From hendy at soluvas.com Wed Aug 1 06:53:42 2012 From: hendy at soluvas.com (Hendy Irawan) Date: Tue, 31 Jul 2012 20:53:42 -0700 (PDT) Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> References: <34226738.post@talk.nabble.com> <34238207.post@talk.nabble.com> <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> Message-ID: <34238917.post@talk.nabble.com> Dear Timo, Thank you for your information about multiple sections! I didn't realize that was possible. Yes, your patch will work on at least ApacheDS 2.0.0-M7 (see https://issues.apache.org/jira/browse/DIRSERVER-1742 ) and I would appreciate it very much ! Hendy Timo Sirainen wrote: > > On 1.8.2012, at 1.12, Hendy Irawan wrote: > >> I apologize, my previous statement were wrong. At least on ApacheDS >> 1.5.7, >> it doesn't search entries using the '' base DN (it doesn't give error >> though, just cannot return results, ApacheDS requires the search base to >> be >> in a partition). >> >> However, your patch would be great for servers who support the '' search >> base DN. > > But does my patch actually make it work in some such servers? I did it > only as a guess. If it doesn't fix anything I'd rather just drop the > patch. > >> If I may ask, would you improve it further to accept multiple bases? I'm >> not >> sure what the proper character separator would be, but I think something >> like this would work : >> >> base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com >> >> The proposed configuration above asks to try the two search bases in >> succession, whichever first succeeds get logged in, else fails like >> usual. > > You can already do this by creating multiple passdb/userdb ldap sections > with different config files. Searching multiple bases requires doing > multiple LDAP lookups anyway. > ----- http://www.Soluvas.com/ Soluvas - Making eCommerce Work for You -- View this message in context: http://old.nabble.com/BUG%3A-LDAP-extension-failed-to-authenticate-if-%27base%27-DN-configuration-is-empty-%27%27-tp34226738p34238917.html Sent from the Dovecot mailing list archive at Nabble.com. From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 07:32:58 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 01 Aug 2012 06:32:58 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> Message-ID: <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> Timo Sirainen schrieb: >On 12.7.2012, at 14.14, Angel L. Mateo wrote: > >> So I have used doveadm director move to move >them to its "hashed" server. Although a doveadm director status >now shows me that this user is directed to the new server, doveadm who >in the temporal server shows me that the user is actually connected to >it, although messages are delivered to it through is correct server. So >I have had to manually kick that users in the temporal servers. >> >> Is this the expected behaviour of the move command for director? >> >> Is there any way to also force the kick of the imap/pop user's >connection in the temporal server? > >Do you see any errors in logs? Especially: > >director: Error: connect(ipc) failed: Permission denied Looks very familiar to me. I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. Regards Daniel From robert at schetterer.org Wed Aug 1 08:36:56 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 07:36:56 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: References: <50184E50.7030907@schetterer.org> Message-ID: <5018C078.9090503@schetterer.org> Am 31.07.2012 23:44, schrieb Timo Sirainen: > On 1.8.2012, at 0.29, Robert Schetterer wrote: > >> Cached message size smaller than expected >> and >> Maildir filename has wrong S value >> and >> Corrupted index cache file >> >> in dove 2.1.8 >> >> i can reproduce the problem with tb 14 >> with 2 nat machines connected to the same server >> >> the problem relates with create new folder then copy >> some uncompressed and compressed mail to it, the i.e >> open it by other client >> >> sometime this happens at once , sometime after a few copy actions > > I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? at my recent onwledge mixing compressed new mails from my sent folder, and older uncompressed ones ( which are shown nice both in tb ), with some copy action in a new folder from another client leads to wrong S and tb does not display them any longer sometime, perhaps a double zip happens? It would help to know how to reproduce this on an entirely empty mail account. > i will try to test, but first i have to deal with now broken maildirs i try disable zlip plugin now ,as workaround hopefully this does not lead to more problems on old maildirs , and fix the problem with new mail -- Best Regards MfG Robert Schetterer From ml-dovecot at zu-con.org Wed Aug 1 09:09:43 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 08:09:43 +0200 Subject: [Dovecot] virtual folder - crash while searching Message-ID: <5018C827.80406@zu-con.org> Hi, I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in a virtual folder dovecot crashes. Here's the stacktrace: http://pastebin.com/urSDDzku Regards, Matthias From f.bonnet at esiee.fr Wed Aug 1 10:19:32 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 09:19:32 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory Message-ID: <5018D884.7000103@esiee.fr> hello I see this message in the dovecot error log every time a user connect to IMAP service. imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In the server's config I've this mail_location = mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u As we can see INDEX files are not living in user's home directories but in /var/spool/dovecot/index/%u so why this error message ? BTW : users access normally to their IMAP folders , I'm just curious about this message which is not marked as warning but error Thank you From nikolai at net24.co.nz Wed Aug 1 11:13:48 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Wed, 1 Aug 2012 20:13:48 +1200 Subject: [Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox Message-ID: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> I'm seeing the following error in our logs when removing mailboxes (we are using mdbox and dovecot 2.1.8): Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Error: stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation not permitted Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Mailbox deleted: Spam When I run truss against the process it appears the error relates to attempted unlink of a directory, not a stat of it, as reported by the log. However the mailbox does appear to be deleted fine, so it appears to be an erroneous error. Here is the truss output from the "3 DELETE INBOX.Spam" IMAP command: gettimeofday({1343808204.962165 },0x0) = 0 (0x0) gettimeofday({1343808204.962351 },0x0) = 0 (0x0) kevent(9,0x0,0,{0xb,EVFILT_READ,0x0,0,0x15,0x21c17a40},6,{1786.679649000 }) = 1 (0x1) gettimeofday({1343808216.031493 },0x0) = 0 (0x0) gettimeofday({1343808216.031676 },0x0) = 0 (0x0) read(11,"3 DELETE INBOX.Spam\r\n",8179) = 21 (0x15) getpid() = 6293 (0x1895) __sysctl(0x7fffffffd850,0x4,0x0,0x0,0x21c8f000,0x2a) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam",{ mode=drwx------ ,inode=28760,size=3,blksize=131072 }) = 0 (0x0) open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",O_RDWR,037777753160) = 10 (0xa) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) pread(0xa,0x21c30000,0x90,0x0,0x1000,0x0) = 144 (0x90) open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index",O_RDWR,037777731760) ERR#2 'No such file or directory' open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2",O_RDWR,037777731520) ERR#2 'No such file or directory' fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) unlink("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam") ERR#1 'Operation not permitted' stat("/usr/share/nls/C/libc.cat",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/share/nls/libc/C",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/local/share/nls/C/libc.cat",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/local/share/nls/libc/C",0x7fffffffd0a0) ERR#2 'No such file or directory' write(2,"\^A\b6293 prefix=imap(test at test."...,36) = 36 (0x24) write(2,"\^A\^D6293 stat(/mailstore/domai"...,99) = 99 (0x63) access("/etc/localtime",4) = 0 (0x0) open("/etc/localtime",O_RDONLY,04160026530) = 12 (0xc) fstat(12,{ mode=-r--r--r-- ,inode=16454,size=2434,blksize=4096 }) = 0 (0x0) read(12,"TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0"...,41448) = 2434 (0x982) close(12) = 0 (0x0) issetugid(0x20ee7fd1,0x21e72000,0x0,0xa7,0x4e,0xc) = 1 (0x1) open("/usr/share/zoneinfo/posixrules",O_RDONLY,056) = 12 (0xc) fstat(12,{ mode=-r--r--r-- ,inode=545,size=3519,blksize=4096 }) = 0 (0x0) read(12,"TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0"...,41448) = 3519 (0xdbf) close(12) = 0 (0x0) madvise(0x21eba000,0xb000,0x5,0x2b9,0x17,0x1) = 0 (0x0) madvise(0x21e72000,0x5000,0x5,0x271,0x17,0x1) = 0 (0x0) madvise(0x21e63000,0xc000,0x5,0x262,0x7fffffffcbf0,0x7fffffffcbf0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) gettimeofday({1343808216.048607 },0x0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2",0x7fffffffd600) ERR#2 'No such file or directory' setitimer(0,{0.000000, 180.000000 },{0.000000, 0.000000 }) = 0 (0x0) fcntl(10,F_SETLKW,0x7fffffffd520) = 0 (0x0) setitimer(0,{0.000000, 0.000000 },{0.000000, 180.000000 }) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) pwrite(0xa,0x21c09000,0xc,0x90,0x10ab6b8,0x2) = 12 (0xc) pwrite(0xa,0x7fffffffd69c,0x4,0x90,0x10ab6b8,0x2) = 4 (0x4) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) fcntl(10,F_SETLK,0x7fffffffd5e0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) setitimer(0,{0.000000, 180.000000 },{0.000000, 0.000000 }) = 0 (0x0) fcntl(10,F_SETLKW,0x7fffffffd1f0) = 0 (0x0) setitimer(0,{0.000000, 0.000000 },{0.000000, 180.000000 }) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) pwrite(0xa,0x21c09400,0x1c,0x9c,0xffff800021c0bea4,0x7fffffffa9f0) = 28 (0x1c) pwrite(0xa,0x7fffffffd57c,0x4,0x9c,0xffff800021c0bea4,0x7fffffffa9f0) = 4 (0x4) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) fcntl(10,F_SETLK,0x7fffffffd610) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=184,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=184,blksize=4096 }) = 0 (0x0) rename("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails","/mailstore/domains/test.com/test/mdbox/..DOVECOT-TrasH") = 0 (0x0) open(".",O_RDONLY,00) = 12 (0xc) open("/mailstore/domains/test.com/test/mdbox/..DOVECOT-TrasH",O_NOFOLLOW,00) = 13 (0xd) fchdir(0xd,0x100,0x0,0x7b30,0x101010101010101,0x8080808080808080) = 0 (0x0) stat(".",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) open(".",O_NONBLOCK|0x20000,00) = 14 (0xe) fstat(14,{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) fcntl(14,F_SETFD,FD_CLOEXEC) = 0 (0x0) fstatfs(0xe,0x7fffffffd3a0,0x21c00400,0x29,0x61ff20,0x0) = 0 (0x0) getdirentries(0xe,0x21c31000,0x1000,0x21c284e8,0x61ff20,0x0) = 52 (0x34) unlink("dovecot.index.log") = 0 (0x0) getdirentries(0xe,0x21c31000,0x1000,0x21c284e8,0x61ff20,0x0) = 0 (0x0) close(13) = 0 (0x0) lseek(14,0x0,SEEK_SET) = 0 (0x0) close(14) = 0 (0x0) fchdir(0xc,0x0,0x21c07400,0x28,0x61ff20,0x0) = 0 (0x0) close(12) = 0 (0x0) rmdir(0x21c18470,0x0,0x21c07400,0x28,0x61ff20,0x0) = 0 (0x0) rmdir(0x21c184f0,0x4,0x21c18000,0x7af8,0xffffffffffdd6669,0x21c8c298) = 0 (0x0) open("/mailstore/domains/test.com/test/mdbox/dovecot.mailbox.log",O_RDWR|O_APPEND,0125337603) = 12 (0xc) write(12,"\^A\0\0\0\M^L\M-M%\^E\M^F\M-b\^X"...,24) = 24 (0x18) fstat(12,{ mode=-rw------- ,inode=28751,size=144,blksize=4096 }) = 0 (0x0) rmdir(0x21c186d0,0x21e41eb8,0x21c186d0,0x7918,0xffffffffffdd6849,0x21c8c298) ERR#2 'No such file or directory' write(12,"\^B\0\0\0\M-Xb\M^JRY\M-I{x\M--C"...,24) = 24 (0x18) fstat(12,{ mode=-rw------- ,inode=28751,size=168,blksize=4096 }) = 0 (0x0) write(2,"\^A\^B6293 Mailbox deleted: Spam"...,29) = 29 (0x1d) gettimeofday({1343808216.058749 },0x0) = 0 (0x0) madvise(0x21e65000,0x1000,0x5,0x264,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21e63000,0x1000,0x5,0x262,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21e41000,0x2000,0x5,0x240,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21d8d000,0x4000,0x5,0x18c,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21c91000,0x2000,0x5,0x90,0x7fffffffcfa0,0xffffffff) = 0 (0x0) gettimeofday({1343808216.059531 },0x0) = 0 (0x0) getpid() = 6293 (0x1895) __sysctl(0x7fffffffd830,0x4,0x0,0x0,0x21c8f000,0x23) = 0 (0x0) write(11,"3 OK Delete completed.\r\n",24) = 24 (0x18) gettimeofday({1343808216.060105 },0x0) = 0 (0x0) Regard, Nikolai. From matthias.lay at securepoint.de Wed Aug 1 12:45:38 2012 From: matthias.lay at securepoint.de (Matthias Lay) Date: Wed, 01 Aug 2012 11:45:38 +0200 Subject: [Dovecot] ntlm auth / usernames with white spaces In-Reply-To: References: <1343399579.3072.19.camel@hermann.potsdam.securepoint.local> Message-ID: <1343814338.3072.31.camel@hermann.potsdam.securepoint.local> works the same way! at least for ntlm but should do the same for spnego. thx. didnt see your strarray join function. On Tue, 2012-07-31 at 22:10 +0300, Timo Sirainen wrote: > On 27.7.2012, at 17.32, Matthias Lay wrote: > > > we experienced some problems with white spaces in usernames (this was > > NOT our idea) authenticated bei dovecots ntlmhelper > > > > I wrote a little patch fixing this, if you would like. > > > > patch applies on 2.1.7 and 2.1.8 (tested those) > > Does this simpler patch also work? From CMarcus at Media-Brokers.com Wed Aug 1 13:53:04 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 06:53:04 -0400 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5018C827.80406@zu-con.org> References: <5018C827.80406@zu-con.org> Message-ID: <50190A90.7090109@Media-Brokers.com> On 2012-08-01 2:09 AM, Matthias Rieber wrote: > I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in > a virtual folder dovecot crashes. Sorry, our crystal ball is broken, although Timo can sometimes get his to work, how I don't know... ;) doveconf -n output? Logs (untrimmed) showing the events leading to the crash? > Here's the stacktrace: > > http://pastebin.com/urSDDzku Stack trace *may* be useful to Timo, but first, please provide bare minimum details of your system/config/errors as requested above - as you should do *always* when asking for support for any software on any mail support list... -- Best regards, Charles From CMarcus at Media-Brokers.com Wed Aug 1 13:56:47 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 06:56:47 -0400 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <5018D884.7000103@esiee.fr> References: <5018D884.7000103@esiee.fr> Message-ID: <50190B6F.7020600@Media-Brokers.com> Please help us help you. Always provide bare minimum system/config/error details, like: Full doveconf -n output (don't 'describe' your config with a one line copy/paste from some random config file) Full (untrimmed) logs exhibiting the problem On 2012-08-01 3:19 AM, Frank Bonnet wrote: > hello > > I see this message in the dovecot error log every time > a user connect to IMAP service. > > imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such > file or directory > > In the server's config I've this > > mail_location = > mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u > > As we can see INDEX files are not living in user's home directories but > in /var/spool/dovecot/index/%u > so why this error message ? > > BTW : users access normally to their IMAP folders , I'm just curious > about this message > which is not marked as warning but error -- Best regards, Charles From tss at iki.fi Wed Aug 1 13:58:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 13:58:01 +0300 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> Message-ID: <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> On 1.8.2012, at 7.32, Daniel Parthey wrote: >> Do you see any errors in logs? Especially: >> >> director: Error: connect(ipc) failed: Permission denied > > Looks very familiar to me. > > I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. I added a note about it to http://wiki2.dovecot.org/Director#Other_settings From f.bonnet at esiee.fr Wed Aug 1 14:03:50 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:03:50 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190B6F.7020600@Media-Brokers.com> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> Message-ID: <50190D16.1090901@esiee.fr> Yes sorry I forgot :-( See attached the doveconf -n output Thanks On 08/01/2012 12:56 PM, Charles Marcus wrote: > Please help us help you. > > Always provide bare minimum system/config/error details, like: > > Full doveconf -n output > (don't 'describe' your config with a one line copy/paste from some > random config file) > > Full (untrimmed) logs exhibiting the problem > > On 2012-08-01 3:19 AM, Frank Bonnet wrote: >> hello >> >> I see this message in the dovecot error log every time >> a user connect to IMAP service. >> >> imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such >> file or directory >> >> In the server's config I've this >> >> mail_location = >> mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u >> >> As we can see INDEX files are not living in user's home directories but >> in /var/spool/dovecot/index/%u >> so why this error message ? >> >> BTW : users access normally to their IMAP folders , I'm just curious >> about this message >> which is not marked as warning but error > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr -------------- next part -------------- # 2.1.8: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.0-RELEASE-p3 amd64 auth_verbose = yes auth_verbose_passwords = plain auth_worker_max_count = 100 debug_log_path = /var/log/dovecot/debug.log default_client_limit = 6144 default_process_limit = 1024 default_vsz_limit = 1 G disable_plaintext_auth = no info_log_path = /var/log/dovecot/info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_fsync = always mail_location = mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u mail_temp_dir = /var/tmp managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_lock_timeout = 3 mins mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = prefix = separator = / subscriptions = yes type = private } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at esiee.fr protocols = imap pop3 sendmail_path = /usr/local/sbin/sendmail service auth { client_limit = 7169 } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 10 service_count = 1 vsz_limit = 3 G } service imap { process_limit = 2048 vsz_limit = 3 G } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = [REMOVED INTENTIONALLY] ssl_cert = [REMOVED INTENTIONALLY] ssl_key = [REMOVED INTENTIONALLY] userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lda { info_log_path = /var/log/dovecot/dovecot-lda.log log_path = /var/log/dovecot/dovecot-lda-errors.log mail_plugins = sieve $mail_plugins } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 } protocol sieve { mail_max_userip_connections = 30 managesieve_implementation_string = Dovecot Pigeonhole } From CMarcus at Media-Brokers.com Wed Aug 1 14:16:13 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 07:16:13 -0400 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190D16.1090901@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> Message-ID: <50190FFD.5060406@Media-Brokers.com> On 2012-08-01 7:03 AM, Frank Bonnet wrote: > Yes sorry I forgot :-( > > See attached the doveconf -n output Logs? > On 08/01/2012 12:56 PM, Charles Marcus wrote: >> Please help us help you. >> >> Always provide bare minimum system/config/error details, like: >> >> Full doveconf -n output >> (don't 'describe' your config with a one line copy/paste from some >> random config file) >> >> Full (untrimmed) logs exhibiting the problem -- Best regards, Charles From rafinathan25 at gmail.com Wed Aug 1 14:18:01 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Wed, 1 Aug 2012 16:48:01 +0530 Subject: [Dovecot] can't recieve emails to inbox Message-ID: Hi, I am unable to send emails to virtual users I created. Here is my output for dovecot -n # 1.0.7: /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log ssl_disable: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:~/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: verbose: yes passdb: driver: passwd-file args: /etc/dovecot/passwd passdb: driver: pam userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/home/vmail/%u == Contents of my passwd file located at /etc/dovecot/passwd user1 at mydomain.com user2 at mydomain.com I sent an email to user1 at mydomain.com from gmail.com but can view it anywhere. Please suggest. Where am I going wrong? From robert at schetterer.org Wed Aug 1 14:19:15 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 13:19:15 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <5018C078.9090503@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> Message-ID: <501910B3.2030306@schetterer.org> Am 01.08.2012 07:36, schrieb Robert Schetterer: > Am 31.07.2012 23:44, schrieb Timo Sirainen: >> On 1.8.2012, at 0.29, Robert Schetterer wrote: >> >>> Cached message size smaller than expected >>> and >>> Maildir filename has wrong S value >>> and >>> Corrupted index cache file >>> >>> in dove 2.1.8 >>> >>> i can reproduce the problem with tb 14 >>> with 2 nat machines connected to the same server >>> >>> the problem relates with create new folder then copy >>> some uncompressed and compressed mail to it, the i.e >>> open it by other client >>> >>> sometime this happens at once , sometime after a few copy actions >> >> I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? > > at my recent onwledge > mixing compressed new mails from my sent folder, and older uncompressed > ones ( which are shown nice both in tb ), with some copy action in a new > folder from another client leads to wrong S > and tb does not display them any longer sometime, perhaps a double zip > happens? > > It would help to know how to reproduce this on an entirely empty mail > account. >> > > i will try to test, but first i have to deal with now broken maildirs > i try disable zlip plugin now ,as workaround hopefully this does not > lead to more problems on old maildirs , and fix the problem with new mail > hi Timo, rolled back all stuff you recommended offlist so situation is a bit better now, however why, i had to handle cause more mailldirs get broken i guess iam dealing with equal Problems described here http://www.mail-archive.com/dovecot at dovecot.org/msg43986.html conversation with ralf, looks like your patch wasnt enough i have a few mailboxes and folders now i cant fix compressed files stay unreadable after move copy by Maildir filename has wrong S value i need some kind of mass repair actions etc , or some new patch -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 14:21:31 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:21:31 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190FFD.5060406@Media-Brokers.com> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> Message-ID: <5019113B.7030509@esiee.fr> On 08/01/2012 01:16 PM, Charles Marcus wrote: > On 2012-08-01 7:03 AM, Frank Bonnet wrote: >> Yes sorry I forgot :-( >> >> See attached the doveconf -n output > > Logs? > All lines are IDENTICALS except the user id I put MY login but it happen for ALL users when they connect Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory BTW : I use real unix users thru nss_ldap & pam_ldap auth, no virtual user >> On 08/01/2012 12:56 PM, Charles Marcus wrote: >>> Please help us help you. >>> >>> Always provide bare minimum system/config/error details, like: >>> >>> Full doveconf -n output >>> (don't 'describe' your config with a one line copy/paste from some >>> random config file) >>> >>> Full (untrimmed) logs exhibiting the problem > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr From tss at iki.fi Wed Aug 1 14:22:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 14:22:03 +0300 Subject: [Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox In-Reply-To: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> References: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> Message-ID: On 1.8.2012, at 11.13, Nikolai Schupbach wrote: > I'm seeing the following error in our logs when removing mailboxes (we are using mdbox and dovecot 2.1.8): > > Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Error: stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation not permitted > Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Mailbox deleted: Spam > > When I run truss against the process it appears the error relates to attempted unlink of a directory, not a stat of it, as reported by the log. However the mailbox does appear to be deleted fine, so it appears to be an erroneous error. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/8029f1b4afd0 From tss at iki.fi Wed Aug 1 14:27:31 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 14:27:31 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <5019113B.7030509@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: On 1.8.2012, at 14.21, Frank Bonnet wrote: > Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: chmod a+rw /var/run/dovecot/config gdb /usr/local/lib/dovecot/imap b i_error run bt full where the will probably work if you do something like: a list "" * b lsub "" * c select inbox if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog From f.bonnet at esiee.fr Wed Aug 1 14:56:03 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:56:03 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: <50191953.2010501@esiee.fr> On 08/01/2012 01:27 PM, Timo Sirainen wrote: > On 1.8.2012, at 14.21, Frank Bonnet wrote: > >> Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory > I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: > > chmod a+rw /var/run/dovecot/config > gdb /usr/local/lib/dovecot/imap it starts badly mail# gdb /usr/local/libexec/dovecot/imap GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... (gdb) b i_error Function "i_error" not defined. > b i_error > run > > bt full > > where the will probably work if you do something like: > > a list "" * > b lsub "" * > c select inbox > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr From f.bonnet at esiee.fr Wed Aug 1 15:00:24 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:00:24 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: <50191A58.8030404@esiee.fr> On 08/01/2012 01:27 PM, Timo Sirainen wrote: > On 1.8.2012, at 14.21, Frank Bonnet wrote: > >> Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory > I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: > > chmod a+rw /var/run/dovecot/config > gdb /usr/local/lib/dovecot/imap > b i_error > run > > bt full > > where the will probably work if you do something like: > > a list "" * > b lsub "" * > c select inbox > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog I ran it anyway , the output is below %gdb /usr/local/libexec/dovecot/imap GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... (gdb) (gdb) b i_error Function "i_error" not defined. Make breakpoint pending on future shared library load? (y or [n]) y Breakpoint 1 (i_error) pending. (gdb) run Starting program: /usr/local/libexec/dovecot/imap (no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...[New LWP 102225] (no debugging symbols found)...Breakpoint 2 at 0x800ba4430 Pending breakpoint "i_error" resolved [New Thread 801c07400 (LWP 102225/imap)] Debug: Effective uid=3003, gid=3010, home=/user/bonnetf Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:/user/bonnetf/:INBOX=/var/mail/bonnetf:INDEX=/var/spool/dovecot/index/bonnetf Debug: fs: root=/user/bonnetf, index=/var/spool/dovecot/index/bonnetf, control=, inbox=/var/mail/bonnetf, alt= * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as bonnetf a list "" * * LIST (\NoInferiors \UnMarked) "/" ".dovecot.sieve" * LIST (\NoInferiors \UnMarked) "/" "NetAPP" * LIST (\NoInferiors \Marked) "/" "Admin" * LIST (\NoInferiors \UnMarked) "/" "CCIP" * LIST (\NoInferiors \UnMarked) "/" "Clement" * LIST (\Noselect \HasChildren) "/" "sieve" * LIST (\Noselect \HasChildren) "/" "sieve/tmp" * LIST (\NoInferiors \UnMarked) "/" "sieve/roundcube.sieve" * LIST (\NoInferiors \UnMarked) "/" "Drafts" * LIST (\NoInferiors \UnMarked) "/" "ESIEE" * LIST (\NoInferiors \UnMarked) "/" ".dovecot.sieve.log" * LIST (\NoInferiors \UnMarked) "/" ".dovecot.svbin" * LIST (\NoInferiors \UnMarked) "/" "FPS" * LIST (\NoInferiors \Marked) "/" "PRIVE" * LIST (\NoInferiors \UnMarked) "/" "Sent" * LIST (\NoInferiors \UnMarked) "/" ".vacation.msg" * LIST (\NoInferiors \UnMarked) "/" "Templates" * LIST (\NoInferiors \UnMarked) "/" "Trash" * LIST (\NoInferiors \UnMarked) "/" "UMLV" * LIST (\NoInferiors \UnMarked) "/" "Caille" * LIST (\NoInferiors \UnMarked) "/" "Postmaster" * LIST (\NoInferiors \UnMarked) "/" "Junk" * LIST (\NoInferiors \UnMarked) "/" "Archives" * LIST (\NoInferiors \UnMarked) "/" "bkup-ldap" * LIST (\NoInferiors \UnMarked) "/" "Deleted Messages" * LIST (\NoInferiors \UnMarked) "/" "Apple" * LIST (\NoInferiors \UnMarked) "/" "Notes" * LIST (\NoInferiors \UnMarked) "/" "EmailStuff" * LIST (\NoInferiors \UnMarked) "/" "LISTSERV" * LIST (\NoInferiors \UnMarked) "/" "RENATER" * LIST (\NoInferiors \UnMarked) "/" "Free" * LIST (\NoInferiors \UnMarked) "/" "filers" * LIST (\NoInferiors \UnMarked) "/" "PRIVE2" * LIST (\NoInferiors \UnMarked) "/" "SUSE-NOVELL" * LIST (\NoInferiors \UnMarked) "/" "SYBASE" * LIST (\NoInferiors \UnMarked) "/" "Nono" * LIST (\NoInferiors \UnMarked) "/" "NGINX" * LIST (\NoInferiors \UnMarked) "/" "DIFFGEN" * LIST (\NoInferiors \UnMarked) "/" "ADESOFT" * LIST (\NoInferiors \UnMarked) "/" "RENATER-TCS" * LIST (\NoInferiors \UnMarked) "/" "Forensic" * LIST (\NoInferiors \UnMarked) "/" "EnCours" * LIST (\NoInferiors \UnMarked) "/" "BSD" * LIST (\NoInferiors \UnMarked) "/" "NYP" * LIST (\NoInferiors \UnMarked) "/" "Sent Messages" * LIST (\NoInferiors \UnMarked) "/" ".forward" * LIST (\HasNoChildren) "/" "INBOX" a OK List completed. b lsub "" * * LSUB () "/" "Admin" * LSUB () "/" "CCIP" * LSUB () "/" "Clement" * LSUB () "/" "Drafts" * LSUB () "/" "ESIEE" * LSUB () "/" "FPS" * LSUB () "/" "PRIVE" * LSUB () "/" "Sent" * LSUB () "/" "Templates" * LSUB () "/" "Trash" * LSUB () "/" "UMLV" * LSUB () "/" "Caille" * LSUB () "/" "Postmaster" * LSUB () "/" "Junk" * LSUB () "/" "Archives" * LSUB () "/" "bkup-ldap" * LSUB () "/" "Apple" * LSUB () "/" "Deleted Messages" * LSUB () "/" "Sent Messages" * LSUB () "/" "Notes" * LSUB () "/" "EmailStuff" * LSUB () "/" "LISTSERV" * LSUB () "/" "RENATER" * LSUB () "/" "Free" * LSUB () "/" "filers" * LSUB () "/" "PRIVE2" * LSUB () "/" "INBOX" * LSUB () "/" "SUSE-NOVELL" * LSUB () "/" "SYBASE" * LSUB () "/" "Nono" * LSUB () "/" "NGINX" * LSUB () "/" "DIFFGEN" * LSUB () "/" "ADESOFT" * LSUB () "/" "RENATER-TCS" * LSUB () "/" "Forensic" * LSUB () "/" "EnCours" * LSUB () "/" "BSD" * LSUB () "/" "NYP" * LSUB () "/" "NetAPP" b OK Lsub completed. c select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk $Forwarded $MDNSent $label1 $label4) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk $Forwarded $MDNSent $label1 $label4 \*)] Flags permitted. * 564 EXISTS * 0 RECENT * OK [UNSEEN 557] First unseen. * OK [UIDVALIDITY 1219087912] UIDs valid * OK [UIDNEXT 1049549] Predicted next UID * OK [NOMODSEQ] No permanent modsequences c OK [READ-WRITE] Select completed. From tss at iki.fi Wed Aug 1 15:06:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 15:06:07 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <501910B3.2030306@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> Message-ID: <1343822767.19913.81.camel@hurina> See what you get by running the maildir through: http://dovecot.org/tools/maildir-size-check.sh From tss at iki.fi Wed Aug 1 15:07:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 15:07:49 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50191A58.8030404@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> Message-ID: <1343822869.19913.82.camel@hurina> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: > > where the will probably work if you do something like: > > > > a list "" * > > b lsub "" * > > c select inbox > > > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > > > I ran it anyway , the output is below All good, except the error didn't happen. So you'd need to look at the IMAP traffic to see which command generates the error. From f.bonnet at esiee.fr Wed Aug 1 15:10:59 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:10:59 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <1343822869.19913.82.camel@hurina> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> Message-ID: <50191CD3.7010902@esiee.fr> On 08/01/2012 02:07 PM, Timo Sirainen wrote: > On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>> where the will probably work if you do something like: >>> >>> a list "" * >>> b lsub "" * >>> c select inbox >>> >>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >> >> I ran it anyway , the output is below > All good, except the error didn't happen. So you'd need to look at the > IMAP traffic to see which command generates the error. > > we use thunderbird, maybe trying with evolution give some way ? From robert at schetterer.org Wed Aug 1 15:12:40 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:12:40 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <1343822767.19913.81.camel@hurina> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> Message-ID: <50191D38.4010908@schetterer.org> Am 01.08.2012 14:06, schrieb Timo Sirainen: > See what you get by running the maildir through: > http://dovecot.org/tools/maildir-size-check.sh > > tons of i.e Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong S=2647728 value, should be S=3838835 -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 15:17:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:17:49 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50191D38.4010908@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> Message-ID: <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> On 1.8.2012, at 15.12, Robert Schetterer wrote: > Am 01.08.2012 14:06, schrieb Timo Sirainen: >> See what you get by running the maildir through: >> http://dovecot.org/tools/maildir-size-check.sh >> >> > > tons of i.e > > Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong > S=2647728 value, should be S=3838835 If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails and do those other checks, since it updates the uidlists and doesn't cause UIDs to change.) From tss at iki.fi Wed Aug 1 15:19:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:19:20 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50191CD3.7010902@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: On 1.8.2012, at 15.10, Frank Bonnet wrote: > On 08/01/2012 02:07 PM, Timo Sirainen wrote: >> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>> where the will probably work if you do something like: >>>> >>>> a list "" * >>>> b lsub "" * >>>> c select inbox >>>> >>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>> >>> I ran it anyway , the output is below >> All good, except the error didn't happen. So you'd need to look at the >> IMAP traffic to see which command generates the error. >> >> > we use thunderbird, maybe trying with evolution give some way ? Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. From robert at schetterer.org Wed Aug 1 15:25:00 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:25:00 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> Message-ID: <5019201C.3000106@schetterer.org> Am 01.08.2012 14:17, schrieb Timo Sirainen: > On 1.8.2012, at 15.12, Robert Schetterer wrote: > >> Am 01.08.2012 14:06, schrieb Timo Sirainen: >>> See what you get by running the maildir through: >>> http://dovecot.org/tools/maildir-size-check.sh >>> >>> >> >> tons of i.e >> >> Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong >> S=2647728 value, should be S=3838835 > > If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. i will try things couldn not get more worst > > (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails jep compressed is a must have and do those other checks, since it updates the uidlists and doesn't cause UIDs to change.) > i will report next using script -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 15:29:27 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:29:27 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: <50192127.3060803@esiee.fr> On 08/01/2012 02:19 PM, Timo Sirainen wrote: > On 1.8.2012, at 15.10, Frank Bonnet wrote: > >> On 08/01/2012 02:07 PM, Timo Sirainen wrote: >>> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>>> where the will probably work if you do something like: >>>>> >>>>> a list "" * >>>>> b lsub "" * >>>>> c select inbox >>>>> >>>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>>> I ran it anyway , the output is below >>> All good, except the error didn't happen. So you'd need to look at the >>> IMAP traffic to see which command generates the error. >>> >>> >> we use thunderbird, maybe trying with evolution give some way ? > Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. > ok understood , I have looked carrefully in logs , it *seems* to happen ONLY at the first connection of the day ... would it be possible ? would it be a caching problem ? From robert at schetterer.org Wed Aug 1 15:43:17 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:43:17 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <5019201C.3000106@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> Message-ID: <50192465.7080805@schetterer.org> Am 01.08.2012 14:25, schrieb Robert Schetterer: > Am 01.08.2012 14:17, schrieb Timo Sirainen: >> On 1.8.2012, at 15.12, Robert Schetterer wrote: >> >>> Am 01.08.2012 14:06, schrieb Timo Sirainen: >>>> See what you get by running the maildir through: >>>> http://dovecot.org/tools/maildir-size-check.sh >>>> >>>> >>> >>> tons of i.e >>> >>> Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong >>> S=2647728 value, should be S=3838835 >> >> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. > > i will try things couldn not get more worst >> >> (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails > > jep compressed is a must have > > and do those other checks, since it updates the uidlists and doesn't > cause UIDs to change.) >> > > i will report next using script > ./maildir-size-check.sh -f maildir is an unknown option...? -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 15:58:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:58:38 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50192465.7080805@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> Message-ID: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> On 1.8.2012, at 15.43, Robert Schetterer wrote: >>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >> >> i will try things couldn not get more worst > > ./maildir-size-check.sh -f maildir is an unknown option...? Oh, looks like I forgot to re-upload it after adding that option. It's there now. From tlx at leuxner.net Wed Aug 1 16:31:30 2012 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 1 Aug 2012 15:31:30 +0200 Subject: [Dovecot] can't recieve emails to inbox In-Reply-To: References: Message-ID: <20120801133130.GA6049@nihlus.leuxner.net> On Wed, Aug 01, 2012 at 04:48:01PM +0530, Rafael Nathan wrote: > I am unable to send emails to virtual users I created. Here is my output > for dovecot -n > > I sent an email to user1 at mydomain.com from gmail.com but can view it > anywhere. Your MTA logs will most likely show. Anyway this version is ages old and you should update to a current supported branch. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From robert at schetterer.org Wed Aug 1 16:39:17 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 15:39:17 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> Message-ID: <50193185.4050309@schetterer.org> Am 01.08.2012 14:58, schrieb Timo Sirainen: > On 1.8.2012, at 15.43, Robert Schetterer wrote: > >>>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >>> >>> i will try things couldn not get more worst >> >> ./maildir-size-check.sh -f maildir is an unknown option...? > > Oh, looks like I forgot to re-upload it after adding that option. It's there now. > looks like working fine, but it has some problems with pathnames with special char and spaces -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 16:43:35 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 15:43:35 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: <50193287.10903@esiee.fr> On 08/01/2012 02:19 PM, Timo Sirainen wrote: > On 1.8.2012, at 15.10, Frank Bonnet wrote: > >> On 08/01/2012 02:07 PM, Timo Sirainen wrote: >>> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>>> where the will probably work if you do something like: >>>>> >>>>> a list "" * >>>>> b lsub "" * >>>>> c select inbox >>>>> >>>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>>> I ran it anyway , the output is below >>> All good, except the error didn't happen. So you'd need to look at the >>> IMAP traffic to see which command generates the error. >>> >>> >> we use thunderbird, maybe trying with evolution give some way ? > Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. > do you think imaptest could help ? From tss at iki.fi Wed Aug 1 20:24:36 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 20:24:36 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5018C827.80406@zu-con.org> References: <5018C827.80406@zu-con.org> Message-ID: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> On 1.8.2012, at 9.09, Matthias Rieber wrote: > I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in > a virtual folder dovecot crashes. > > Here's the stacktrace: > > http://pastebin.com/urSDDzku Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad From tss at iki.fi Wed Aug 1 20:58:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 20:58:39 +0300 Subject: [Dovecot] v2.1.9 released Message-ID: <1343843919.18782.22.camel@innu> http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig I've again mostly finished reading and answering most of the mails in Dovecot mailing list. There are a couple annoyingly difficult / time consuming bugreport mails that I haven't replied to yet, but if anyone thinks I should have replied to something already feel free to resend the mail. For the new Redis/memcached dict stuff see http://master.wiki2.dovecot.org/AuthDatabase/Dict and http://master.wiki2.dovecot.org/Quota/Dict I'm thinking about removing the new quota_ignore_save_errors=yes setting in v2.2 and just forcing it enabled always. Thoughts? (I didn't want to change v2.1 behavior by doing this.) The most important changes since v2.1.8: * mail-log plugin: Log mailbox names with UTF-8 everywhere (instead of mUTF-7 in some places and UTF-8 in other places) * director: Changed director_username_hash setting's default from %u to %Lu (= lowercase usernames). This doesn't break any existing installations, but might fix some of them. + doveadm: Added "auth cache flush []" command. + Implemented dict passdb/userdb + Implemented Redis and memcached dict backends, which can be used as auth backends. Redis can also be used as dict-quota backend. + Added plugin { quota_ignore_save_errors=yes } setting to allow saving a mail when quota lookup fails with temporary failure. - Full text search indexing might have failed for some messages, always causing indexer-worker process to run out of memory. - fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC when the header wasn't lowercased. - fts-squat: Fixed crash when searching a virtual mailbox. - pop3: Fixed assert crash when doing UIDL on empty mailbox on some setups. - auth: GSSAPI RFC compliancy and error handling fixes. - Various fixes related to handling shared namespaces From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 21:09:29 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 20:09:29 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> Message-ID: <20120801180929.GA7779@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 7.32, Daniel Parthey wrote: > > >> Do you see any errors in logs? Especially: > >> > >> director: Error: connect(ipc) failed: Permission denied > > > > Looks very familiar to me. > > > > I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. > > I added a note about it to http://wiki2.dovecot.org/Director#Other_settings > > doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. > > service ipc { > unix_listener ipc { > user = dovecot > } > } Thanks, Timo. Does this apply to the mailbox config or the director config? Which instance needs to access the ipc socket of which instance? Regards Daniel -- https://plus.google.com/103021802792276734820 From tss at iki.fi Wed Aug 1 21:10:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:10:40 +0300 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <20120801180929.GA7779@daniel.localdomain> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: On 1.8.2012, at 21.09, Daniel Parthey wrote: >> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >> >> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >> >> service ipc { >> unix_listener ipc { >> user = dovecot >> } >> } > > Thanks, Timo. > > Does this apply to the mailbox config or the director config? > Which instance needs to access the ipc socket of which instance? director instance needs access to director instance. From ml at smtp.fakessh.eu Wed Aug 1 21:12:58 2012 From: ml at smtp.fakessh.eu (ml) Date: Wed, 01 Aug 2012 20:12:58 +0200 Subject: [Dovecot] v2.1.9 released In-Reply-To: <1343843919.18782.22.camel@innu> References: <1343843919.18782.22.camel@innu> Message-ID: <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> the recurring problems of these minor errors that often appear timesmap. I almost successful make them disappear with an ultra clean install. they appearing more generally for L INBOX Trash Le 2012-08-01 19:58, Timo Sirainen a ?crit?: > http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz > http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig > > I've again mostly finished reading and answering most of the mails in > Dovecot mailing list. There are a couple annoyingly difficult / time > consuming bugreport mails that I haven't replied to yet, but if > anyone > thinks I should have replied to something already feel free to resend > the mail. > > For the new Redis/memcached dict stuff see > http://master.wiki2.dovecot.org/AuthDatabase/Dict and > http://master.wiki2.dovecot.org/Quota/Dict > > I'm thinking about removing the new quota_ignore_save_errors=yes > setting > in v2.2 and just forcing it enabled always. Thoughts? (I didn't want > to > change v2.1 behavior by doing this.) > > The most important changes since v2.1.8: > > * mail-log plugin: Log mailbox names with UTF-8 everywhere > (instead of mUTF-7 in some places and UTF-8 in other places) > * director: Changed director_username_hash setting's default from %u > to %Lu (= lowercase usernames). This doesn't break any existing > installations, but might fix some of them. > > + doveadm: Added "auth cache flush []" command. > + Implemented dict passdb/userdb > + Implemented Redis and memcached dict backends, which can be used > as > auth backends. Redis can also be used as dict-quota backend. > + Added plugin { quota_ignore_save_errors=yes } setting to allow > saving > a mail when quota lookup fails with temporary failure. > - Full text search indexing might have failed for some messages, > always causing indexer-worker process to run out of memory. > - fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC > when > the header wasn't lowercased. > - fts-squat: Fixed crash when searching a virtual mailbox. > - pop3: Fixed assert crash when doing UIDL on empty mailbox on some > setups. > - auth: GSSAPI RFC compliancy and error handling fixes. > - Various fixes related to handling shared namespaces -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xC2626742 gpg --keyserver pgp.mit.edu --recv-key C2626742 http://about.me/fakessh http://urlshort.eu fakessh @ http://gplus.to/sshfake http://gplus.to/sshswilting http://gplus.to/john.swilting https://lists.fakessh.eu/mailman/ This list is moderated by me, but all applications will be accepted provided they receive a note of presentation From ml-dovecot at zu-con.org Wed Aug 1 21:13:55 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 20:13:55 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> Message-ID: <501971E3.80206@zu-con.org> Hello, Am 01.08.2012 19:24, schrieb Timo Sirainen: > On 1.8.2012, at 9.09, Matthias Rieber wrote: > >> I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in >> a virtual folder dovecot crashes. >> >> Here's the stacktrace: >> >> http://pastebin.com/urSDDzku > > Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: > http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad thanks, but in the meanwhile I moved to Solr, but I've still some, maybe different, crashes. I'll send a report later after upgrading to v2.1.9 (with config and log). Is lucence the better choice? According to the wiki Solr seems to be the most preferred solution. Regards, Matthias From tss at iki.fi Wed Aug 1 21:16:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:16:08 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <501971E3.80206@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501971E3.80206@zu-con.org> Message-ID: <96BC9767-9121-4745-B82D-8A426A94DD53@iki.fi> On 1.8.2012, at 21.13, Matthias Rieber wrote: > Is lucence the better choice? According to the wiki Solr seems to be the most preferred solution. Solr and Lucene both work. Solr has a newer Lucene version, but it requires running a Solr server. From tss at iki.fi Wed Aug 1 21:17:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:17:40 +0300 Subject: [Dovecot] v2.1.9 released In-Reply-To: <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> References: <1343843919.18782.22.camel@innu> <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> Message-ID: On 1.8.2012, at 21.12, ml wrote: > the recurring problems of these minor errors that often appear timesmap. I almost successful make them disappear with an ultra clean install. they appearing more generally for L INBOX Trash Sorry, but that doesn't make any sense. What errors? From ml-dovecot at zu-con.org Wed Aug 1 22:21:47 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 21:21:47 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> Message-ID: <501981CB.3030709@zu-con.org> Hi, Am 01.08.2012 19:24, schrieb Timo Sirainen: > On 1.8.2012, at 9.09, Matthias Rieber wrote: > >> I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in >> a virtual folder dovecot crashes. >> >> Here's the stacktrace: >> >> http://pastebin.com/urSDDzku > > Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: > http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad here are the crashes with fts_solr: Configuration ------------- # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-vserver-amd64 x86_64 Debian 5.0.10 auth_master_user_separator = * disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = virtual fts fts_solr zlib acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = yes inbox = no list = no location = prefix = mail separator = type = private } namespace { hidden = no inbox = yes location = prefix = separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace { location = maildir:/home/sharedbox/Maildir prefix = shared. separator = . type = public } namespace { list = yes location = maildir:/home/%%n/Maildir prefix = common.%%u. separator = . subscriptions = no type = shared } namespace { hidden = no list = yes location = virtual:~/Maildir/virtual prefix = virtual. separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=7200 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db fts = solr fts_solr = url=http://localhost:8983/solr/ sieve_dir = ~/Maildir/sieve } protocols = imap pop3 sieve service imap { executable = imap vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = , method=PLAIN, rip=10.0.1.3, lip=10.0.1.3, mpid=18561, TLS, session= Aug 1 21:05:37 smtp dovecot: imap(matthias): Disconnected: Logged out in=689 out=239091 Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head Aug 1 21:05:45 smtp dovecot: imap(matthias): Panic: Leaked t_pop() call Aug 1 21:05:45 smtp dovecot: imap(matthias): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636d71] -> /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] -> /usr/local/lib/dov] Aug 1 21:05:45 smtp dovecot: imap(matthias): Fatal: master: service(imap): child 18507 killed with signal 6 (core dumped) Backtrace: Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. [New process 18507] #0 0xf74d6556 in raise () from /lib/libc.so.6 #0 0xf74d6556 in raise () from /lib/libc.so.6 No symbol table info available. #1 0xf74d7d78 in abort () from /lib/libc.so.6 No symbol table info available. #2 0xf7636d85 in default_fatal_finish (type=, status=0) at failures.c:191 backtrace = 0x961f2b0 "/usr/local/lib/dovecot/libdovecot.so.0 [0xf7636d71] -> /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] -> /usr/local/lib/dovecot/l"... #3 0xf7636def in i_internal_fatal_handler (ctx=0xffb97268, format=0xf76620b1 "Leaked t_pop() call", args=0xffb97284 "\024") at failures.c:649 status = 0 #4 0xf76370c4 in i_panic (format=0xf76620b1 "Leaked t_pop() call") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} #5 0xf76348e1 in t_pop_check (id=0xffb972c8) at data-stack.c:271 No locals. #6 0x08056c6a in client_handle_input (client=0x9670768) at imap-client.c:787 _data_stack_cur_id = 3 ret = true remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #7 0x0805765f in client_input (client=0x9670768) at imap-client.c:825 cmd = output = (struct ostream *) 0x9671094 bytes = __FUNCTION__ = "client_input" #8 0xf7644f12 in io_loop_call_io (io=0x96710f8) at ioloop.c:379 ioloop = (struct ioloop *) 0x96273f8 t_id = 2 #9 0xf76460d0 in io_loop_handler_run (ioloop=0x96273f8) at ioloop-epoll.c:213 ctx = (struct ioloop_handler_context *) 0x96275e0 event = (const struct epoll_event *) 0x9627620 list = (struct io_list *) 0x9671128 io = (struct io_file *) 0x6 tv = {tv_sec = 1799, tv_usec = 998952} msecs = ret = 1 i = 0 j = 0 call = false #10 0xf7644ea0 in io_loop_run (ioloop=0x96273f8) at ioloop.c:398 No locals. #11 0xf762d87d in master_service_run (service=0x9627328, callback=0x80607c0 ) at master-service.c:543 No locals. #12 0x08060684 in main (argc=1329791025, argv=0x4749464e) at main.c:389 login_set = {auth_socket_path = 0x961f068 "/usr/local/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x8060960 , failure_callback = 0x8060900 } service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = set_roots = {0x8063340, 0x0} Crash 2 ------- What I did: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. a LOGIN matthias XXXX a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE SEARCH=FUZZY COMPRESS=DEFLATE ACL RIGHTS=texk] Logged in a SELECT virtual.spam.disagree.spamassassin * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 198 EXISTS * 6 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1343840294] UIDs valid * OK [UIDNEXT 417] Predicted next UID * OK [NOMODSEQ] No permanent modsequences a OK [READ-WRITE] Select completed. a SEARCH OR HEADER FROM foobar HEADER SUBJECT barfoos (server disconnects) Log: Aug 1 21:10:01 smtp dovecot: imap-login: Login: user=, method=PLAIN, rip=10.0.1.3, lip=10.0.1.3, mpid=20709, TLS, session= Aug 1 21:10:15 smtp dovecot: imap(matthias): Fatal: master: service(imap): child 20642 killed with signal 11 (core dumped) Backtrace: Core was generated by `dovecot/imap'. Program terminated with signal 11, Segmentation fault. [New process 20642] #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 125 for (i = 0; result->box_results[i].box != NULL; i++) { #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 _data_stack_cur_id = 4 #1 0xf734447b in fts_search_lookup (fctx=0x897cfc8) at fts-search.c:350 last_uid = 409 seq1 = 192 seq2 = 198 __FUNCTION__ = "fts_search_lookup" #2 0xf7345dc7 in fts_mailbox_search_init (t=0x897d910, args=0x8995518, sort_program=0x0, wanted_fields=0, wanted_headers=0x0) at fts-storage.c:199 flist = (struct fts_mailbox_list *) 0x8949898 ctx = (struct mail_search_context *) 0x8953068 fctx = (struct fts_search_context *) 0x897cfc8 #3 0xf776cf47 in mailbox_search_init (t=0x897d910, args=0x8995518, sort_program=0x0, wanted_fields=0, wanted_headers=0x0) at mail-storage.c:1402 No locals. #4 0x0805d741 in imap_search_start (ctx=0x894c238, sargs=0x8995518, sort_program=0x0) at imap-search.c:550 cmd = (struct client_command_context *) 0x894c180 #5 0x08053ac6 in cmd_search (cmd=0x894c180) at cmd-search.c:45 ctx = sargs = (struct mail_search_args *) 0x8995518 args = (const struct imap_arg *) 0x894ea88 charset = 0x8061738 "UTF-8" ret = #6 0x08057b03 in command_exec (cmd=0x894c180) at imap-commands.c:148 hook = (const struct command_hook *) 0x8903260 ret = false #7 0x08056a3f in client_command_input (cmd=0x894c180) at imap-client.c:682 client = (struct client *) 0x894b768 command = __FUNCTION__ = "client_command_input" #8 0x08056ae1 in client_command_input (cmd=0x894c180) at imap-client.c:733 client = (struct client *) 0x894b768 command = (struct command *) 0x0 __FUNCTION__ = "client_command_input" #9 0x08056c5d in client_handle_input (client=0x894b768) at imap-client.c:774 _data_stack_cur_id = 3 ret = false remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #10 0x0805765f in client_input (client=0x894b768) at imap-client.c:825 cmd = output = (struct ostream *) 0x894c094 bytes = __FUNCTION__ = "client_input" #11 0xf76c7f12 in io_loop_call_io (io=0x894c0f8) at ioloop.c:379 ioloop = (struct ioloop *) 0x89023f8 t_id = 2 #12 0xf76c90d0 in io_loop_handler_run (ioloop=0x89023f8) at ioloop-epoll.c:213 ctx = (struct ioloop_handler_context *) 0x89025e0 event = (const struct epoll_event *) 0x8902620 list = (struct io_list *) 0x894c128 io = (struct io_file *) 0x0 tv = {tv_sec = 1789, tv_usec = 618880} msecs = ret = 1 i = 0 j = 0 call = 16 #13 0xf76c7ea0 in io_loop_run (ioloop=0x89023f8) at ioloop.c:398 No locals. #14 0xf76b087d in master_service_run (service=0x8902328, callback=0x80607c0 ) at master-service.c:543 No locals. #15 0x08060684 in main (argc=1329791025, argv=0x4749464e) at main.c:389 login_set = {auth_socket_path = 0x88fa068 "/usr/local/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x8060960 , failure_callback = 0x8060900 } service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = set_roots = {0x8063340, 0x0} Regards, Matthias From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 22:32:09 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 21:32:09 +0200 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: <20120710224947.GA10641@daniel.localdomain> References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> Message-ID: <20120801193209.GA9069@daniel.localdomain> Daniel Parthey wrote: > Timo Sirainen wrote: > > On 29.6.2012, at 19.21, Daniel Parthey wrote: > > > > > Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): > > > Error: user user31 at domain1.example.org: Error reading configuration: > > > net_connect_unix(/var/run/dovecot/config) failed: Permission denied > > > > I've noticed a similar problem happening somewhat randomly, but I still > > haven't looked into why exactly it happens. Anyway the attached patch should > > fix this specific error, but I'm not sure if there isn't another one. Try and > > let me know? :) > > Unfortunately, the problem still persists with dovecot 2.1.8, > which already contains the following code: > > enum master_service_flags service_flags = > MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN; > const char *error; > master_service = master_service_init("doveadm", service_flags, > &argc, &argv, NULL); > if (master_getopt(master_service) > 0) > return FATAL_DEFAULT; > > The command > /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A > still generates the following errors after iterating some dozen users: > > doveadm(nagios at metaways.de): Error: doveadm server failure > doveadm: Error: Failed to iterate through some users > > Which information should I provide to help debugging the problem? The change in 2.1.8 didn't fix it and still does not iterate *all* users. My current workaround is to list all users, run a for-loop over the userlist and flush one mailbox after another via the director. Any hints how to solve this? Regards Daniel -- https://plus.google.com/103021802792276734820 From tss at iki.fi Wed Aug 1 22:45:56 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 22:45:56 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <501981CB.3030709@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> Message-ID: <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> On 1.8.2012, at 22.21, Matthias Rieber wrote: > here are the crashes with fts_solr: .. > Crash 1 > Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 > Crash 2 > #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 > 125 for (i = 0; result->box_results[i].box != NULL; i++) { Fixed: http://hg.dovecot.org/dovecot-2.1/rev/323d6ce62567 From tss at iki.fi Wed Aug 1 22:56:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 22:56:39 +0300 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: <20120801193209.GA9069@daniel.localdomain> References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: On 1.8.2012, at 22.32, Daniel Parthey wrote: >>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): >>>> Error: user user31 at domain1.example.org: Error reading configuration: >>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied > The change in 2.1.8 didn't fix it and still does not iterate *all* users. > My current workaround is to list all users, run a for-loop over the userlist > and flush one mailbox after another via the director. > > Any hints how to solve this? The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 464 bytes Desc: not available URL: -------------- next part -------------- From ml-dovecot at zu-con.org Wed Aug 1 23:06:09 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 22:06:09 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> Message-ID: <50198C31.5070902@zu-con.org> Hi, Am 01.08.2012 21:45, schrieb Timo Sirainen: > On 1.8.2012, at 22.21, Matthias Rieber wrote: > >> here are the crashes with fts_solr: > .. >> Crash 1 >> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head > > The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 I thought non-fulltext searches were done by dovecot itself? Matthias From tss at iki.fi Wed Aug 1 23:14:53 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 23:14:53 +0300 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: On 1.8.2012, at 22.56, Timo Sirainen wrote: > On 1.8.2012, at 22.32, Daniel Parthey wrote: > >>>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): >>>>> Error: user user31 at domain1.example.org: Error reading configuration: >>>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied >> The change in 2.1.8 didn't fix it and still does not iterate *all* users. >> My current workaround is to list all users, run a for-loop over the userlist >> and flush one mailbox after another via the director. >> >> Any hints how to solve this? > > The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) Also I wonder if this helps (at least it fixes a crash I managed to cause): http://hg.dovecot.org/dovecot-2.1/rev/476381017ec7 From tss at iki.fi Wed Aug 1 23:16:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 23:16:57 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <50198C31.5070902@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> Message-ID: <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> On 1.8.2012, at 23.06, Matthias Rieber wrote: >>> here are the crashes with fts_solr: >> .. >>> Crash 1 >>> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head >> >> The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 > > I thought non-fulltext searches were done by dovecot itself? They are, but header searches are part of full text search. From peter at grimmond.org Wed Aug 1 23:22:35 2012 From: peter at grimmond.org (Peter Grimmond) Date: Wed, 1 Aug 2012 20:22:35 +0000 Subject: [Dovecot] Problem with preserving MIME format with Dovecot IMAP and Outlook Message-ID: From ml-dovecot at zu-con.org Wed Aug 1 23:23:59 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 22:23:59 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> Message-ID: <5019905F.3010102@zu-con.org> Am 01.08.2012 22:16, schrieb Timo Sirainen: > On 1.8.2012, at 23.06, Matthias Rieber wrote: > >>>> here are the crashes with fts_solr: >>> .. >>>> Crash 1 >>>> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head >>> >>> The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 >> >> I thought non-fulltext searches were done by dovecot itself? > > They are, but header searches are part of full text search. alright. Some resources say that "413 FULL head" means request too large. Maybe that's caused by the pretty big folder virtual.all which contains more than 360000 mails. Matthias From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 23:25:02 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 22:25:02 +0200 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: <20120801202502.GA9951@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 22.32, Daniel Parthey wrote: > > >>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): > >>>> Error: user user31 at domain1.example.org: Error reading configuration: > >>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied > > The change in 2.1.8 didn't fix it and still does not iterate *all* users. > > My current workaround is to list all users, run a for-loop over the userlist > > and flush one mailbox after another via the director. > > > > Any hints how to solve this? > > The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) Running command on a four host setup with mailbox+director instance each: /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A Output is: doveadm(username at example.org): Error: doveadm server failure doveadm: Error: Failed to iterate through some users Log says: dovecot: doveadm(username at example.org): Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied (euid=501(vmail) egid=123(vmail) missing +r perm: /var/run/dovecot/auth-userdb, we're not in group 122(dovecot), dir owned by 0:0 mode=0755) dovecot: doveadm(username at example.org): Error: purge: User lookup failed: Internal error occurred. Refer to server log for more information. Here are the directory permissions: mail01:~# id vmail uid=501(vmail) gid=123(vmail) groups=123(vmail) mail01:~# id dovecot uid=120(dovecot) gid=122(dovecot) groups=122(dovecot) mail01:~# ls -ld /var/run/dovecot drwxr-xr-x 4 root root 660 2012-07-11 18:35 /var/run/dovecot mail01:~# ls -l /var/run/dovecot total 8 srw------- 1 root root 0 2012-07-10 18:29 anvil srw------- 1 root root 0 2012-07-10 18:29 anvil-auth-penalty srw------- 1 root root 0 2012-07-11 18:35 auth-client srw------- 1 dovecot root 0 2012-07-11 18:35 auth-login srw------- 1 root root 0 2012-07-11 18:35 auth-master srw-rw---- 1 dovecot dovecot 0 2012-07-11 18:35 auth-userdb srw------- 1 dovecot root 0 2012-07-11 18:35 auth-worker srw------- 1 root root 0 2012-07-11 18:35 config srw-rw---- 1 root vmail 0 2012-07-11 18:35 dict srw------- 1 root root 0 2012-07-11 18:35 director-admin srw------- 1 root root 0 2012-07-10 10:19 director-userdb srw-rw-rw- 1 root root 0 2012-07-11 18:35 dns-client srw------- 1 root root 0 2012-07-11 18:35 doveadm-server lrwxrwxrwx 1 root root 25 2012-07-10 18:29 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 40 2012-07-10 10:19 empty srw------- 1 root root 0 2012-07-11 18:35 imap-postlogin srw-rw-rw- 1 root root 0 2012-07-11 18:35 indexer srw------- 1 dovecot root 0 2012-07-11 18:35 indexer-worker srw------- 1 root root 0 2012-07-11 18:35 ipc srw-rw-rw- 1 root root 0 2012-07-11 18:35 lmtp srw------- 1 root root 0 2012-07-11 18:35 log-errors drwxr-x--- 2 root nogroup 180 2012-07-11 18:35 login -rw------- 1 root root 5 2012-07-10 18:29 master.pid -rw-r--r-- 1 root root 71 2012-07-10 18:29 mounts srw------- 1 root root 0 2012-07-11 18:35 pop3-postlogin srw------- 1 vmail root 0 2012-07-11 18:35 quota-warning srw------- 1 root root 0 2012-07-11 18:35 replication-notify prw------- 1 root root 0 2012-07-11 18:35 replication-notify-fifo srw------- 1 dovecot root 0 2012-07-11 18:35 replicator srw------- 1 root root 0 2012-07-11 18:35 stats prw------- 1 vmail root 0 2012-08-01 22:20 stats-mail Please see mailbox and director config attached. Any help is appreciated. Regards Daniel -- https://plus.google.com/103021802792276734820 -------------- next part -------------- # 2.1.8: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_verbose = yes auth_verbose_passwords = sha1 deliver_log_format = mailbox: deliver: msgid=%m from=%f: %$ dict { quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = xxx imapc_features = rfc822.size imapc_host = local-mailbox imapc_port = 18143 instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Mailbox login_log_format = mailbox: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "mailbox: mail: %s(%u): " mail_plugins = quota stats mail_privileged_group = vmail mail_uid = vmail managesieve_implementation_string = Sieve managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 50 M mmap_disable = yes passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = dovecot mode = 0660 user = dovecot } } service dict { unix_listener dict { group = vmail mode = 0660 } } service doveadm { inet_listener doveadm-server { port = 19000 } } service imap-login { inet_listener imap { port = 19143 } } service imap-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { address = * port = 19024 } } service managesieve-login { inet_listener sieve { port = 19200 } } service pop3-login { inet_listener pop3 { port = 19110 } } service pop3-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script /usr/local/bin/quota-warning extra_groups = dovecot unix_listener quota-warning { user = vmail } user = vmail } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = quota stats imap_quota imap_stats } protocol lmtp { mail_plugins = quota stats sieve } -------------- next part -------------- # 2.1.8: /etc/dovecot-director/dovecot-director.conf # OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS auth_verbose = yes auth_verbose_passwords = sha1 base_dir = /var/run/dovecot-director deliver_log_format = director: deliver: msgid=%m from=%f: %$ director_doveadm_port = 20000 director_mail_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_user_expire = 2 days disable_plaintext_auth = no doveadm_password = xxx doveadm_proxy_port = 19000 instance_name = dovecot-director lmtp_proxy = yes login_greeting = Mail Balancer login_log_format = director: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "director: mail: %s(%u): " mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes passdb { args = /etc/dovecot-director/conf.d/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { executable = doveadm-server director inet_listener doveadm-server { port = 20000 } } service imap-login { executable = imap-login director inet_listener imap { port = 20143 } inet_listener imaps { port = 20993 ssl = yes } } service lmtp { inet_listener lmtp { address = * port = 20024 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 20200 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 20110 } inet_listener pop3s { port = 20995 ssl = yes } } ssl_cert = References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> <20120801202502.GA9951@daniel.localdomain> Message-ID: <98D34C84-B1F4-47B3-9145-06E262FC11D7@iki.fi> On 1.8.2012, at 23.25, Daniel Parthey wrote: >> The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) > > Running command on a four host setup with mailbox+director instance each: > /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A > > dovecot: doveadm(username at example.org): Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied (euid=501(vmail) egid=123(vmail) missing +r perm: /var/run/dovecot/auth-userdb, we're not in group 122(dovecot), dir owned by 0:0 mode=0755) Ah, so the original patch helped! This is a different error. > srw-rw---- 1 dovecot dovecot 0 2012-07-11 18:35 auth-userdb Simplest solution now would be to make this world-rw, see the auth-userdb socket configuration in http://wiki2.dovecot.org/LDA#Virtual_users But I guess this should also be fixed by doveadm-server. Although I don't think this should be happening by default anyway. Maybe this is also solved by the http://hg.dovecot.org/dovecot-2.1/rev/476381017ec7 patch? From peter at grimmond.org Wed Aug 1 23:53:00 2012 From: peter at grimmond.org (Peter Grimmond) Date: Wed, 1 Aug 2012 20:53:00 +0000 Subject: [Dovecot] Problem with preserving MIME format with Dovecot IMAP and MS Outlook client Message-ID: Hello all, Apologies for the repost, but I am really struggling to solve this problem... I have installed Dovecot 2.0.19 on Ubuntu 12.04 LTS. I have set up a very basic IMAP configuration. I have two different laptops running MS Outlook (one MacOS, one Windows 7) and I have configured both to connect to the Dovecot service. My problem is, emails in MIME format that I synchronise from one MS Outlook client are not being correctly decoded as MIME messages on the other client. Instead, the message is rendered in plaintext, starting with the lines: This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. --B_3426360453_22814Content-type: multipart/alternative; boundary="B_3426360453_4099" --B_3426360453_4099Content-type: text/plain; charset="ISO-8859-1"Content-transfer-encoding: quoted-printable Can anyone help me understand why this might be happening? The output from dovecot -n is: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-26-generic-pae i686 Ubuntu 12.04 LTS auth_debug = yes auth_verbose = yes disable_plaintext_auth = no mail_location = maildir:~/Maildir passdb { driver = pam } protocols = " imap" ssl_cert = References: Message-ID: <60F3895B-5FE9-4A8A-9273-4FE661C75285@iki.fi> On 1.8.2012, at 23.53, Peter Grimmond wrote: > have installed Dovecot 2.0.19 on Ubuntu 12.04 LTS. I have set up a > very basic IMAP configuration. I have two different laptops running MS > Outlook (one MacOS, one Windows 7) and I have configured both to connect > to the Dovecot service. My problem is, emails in MIME format that I > synchronise from one MS Outlook client are not being correctly decoded > as MIME messages on the other client. Instead, the message is rendered > in plaintext, starting with the lines: Have you tried other clients? Maybe the mails are actually broken? In any case it doesn't really look like a Dovecot problem. From daniel.parthey at informatik.tu-chemnitz.de Thu Aug 2 01:04:46 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Thu, 2 Aug 2012 00:04:46 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <1343822869.19913.82.camel@hurina> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> Message-ID: <20120801220446.GA12171@daniel.localdomain> Timo Sirainen wrote: > On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: > > > where the will probably work if you do something like: > > > > > > a list "" * > > > b lsub "" * > > > c select inbox > > > > > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > > > > I ran it anyway , the output is below > > All good, except the error didn't happen. So you'd need to look at the > IMAP traffic to see which command generates the error. Frank, please do a plaintext connect on IMAP port 143 from your mail client to dovecot with a changed test password and record your traffic using tcpdump or wireshark, something like this: tcpdump -n -s 0 -w /tmp/pcap.dat -i eth0 tcp port 143 Then view the file pcap.dat with wireshark[1], right click on the TCP connection and select "Follow TCP Stream" from the context menu. Then you'll get the IMAP commands and responses spoken between Thunderbird and Dovecot. Regards Daniel [1] http://www.wireshark.org/ -- https://plus.google.com/103021802792276734820 From robert at schetterer.org Thu Aug 2 10:09:24 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 02 Aug 2012 09:09:24 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> Message-ID: <501A27A4.7000303@schetterer.org> Am 01.08.2012 14:58, schrieb Timo Sirainen: > On 1.8.2012, at 15.43, Robert Schetterer wrote: > >>>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >>> >>> i will try things couldn not get more worst >> >> ./maildir-size-check.sh -f maildir is an unknown option...? > > Oh, looks like I forgot to re-upload it after adding that option. It's there now. > Hi Timo, most of the Problems are fixed now many thx for your script , but how to avoid that in future ( Maildir filename has wrong S value ) with Ralf you released a patch diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 @@ -20,6 +20,7 @@ struct mail *mail = mstream->mail; enum mail_lookup_abort orig_lookup_abort; + return FALSE; if (mstream->expected_size != (uoff_t)-1) return TRUE; would it be a good idea to include it in 2.1.9 for me ? as it looks like its not in the public code ? -- Best Regards MfG Robert Schetterer From brad at comstyle.com Thu Aug 2 10:58:45 2012 From: brad at comstyle.com (Brad Smith) Date: Thu, 2 Aug 2012 03:58:45 -0400 Subject: [Dovecot] LZMA2 (xz) support for Dovecot? Message-ID: <20120802075845.GF18868@rox.home.comstyle.com> Timo, Thoughts on adding LZMA2 (xz) support via liblzma to Dovecot? -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. From f.bonnet at esiee.fr Thu Aug 2 11:24:13 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Thu, 02 Aug 2012 10:24:13 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <20120801220446.GA12171@daniel.localdomain> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <20120801220446.GA12171@daniel.localdomain> Message-ID: <501A392D.3070705@esiee.fr> On 08/02/2012 12:04 AM, Daniel Parthey wrote: > Timo Sirainen wrote: >> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>> where the will probably work if you do something like: >>>> >>>> a list "" * >>>> b lsub "" * >>>> c select inbox >>>> >>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>> I ran it anyway , the output is below >> All good, except the error didn't happen. So you'd need to look at the >> IMAP traffic to see which command generates the error. > Frank, please do a plaintext connect on IMAP port 143 from your mail client > to dovecot with a changed test password and record your traffic using tcpdump > or wireshark, something like this: > > tcpdump -n -s 0 -w /tmp/pcap.dat -i eth0 tcp port 143 > > Then view the file pcap.dat with wireshark[1], right click on the TCP connection > and select "Follow TCP Stream" from the context menu. Then you'll get the IMAP > commands and responses spoken between Thunderbird and Dovecot. > > Regards > Daniel > > [1] http://www.wireshark.org/ Hello Thanks for your help. well I did but haven't found anything interrestiing in tcpdump log ... and the problem did not happened this morning since I have mail_debug=no in 10-logging.conf file then restart dovecot ... BTW if it matter the users's home directories is a link than point to the real directory. From rrosenfeld at netcologne.de Thu Aug 2 11:42:57 2012 From: rrosenfeld at netcologne.de (Roland Rosenfeld) Date: Thu, 2 Aug 2012 10:42:57 +0200 Subject: [Dovecot] ACL with MySQL dict => full table scans (was: v2.1.9 released) In-Reply-To: <1343843919.18782.22.camel@innu> References: <1343843919.18782.22.camel@innu> Message-ID: <20120802084257.GB23882@sys-241.netcologne.de> On Wed, 01 Aug 2012, Timo Sirainen wrote: > I've again mostly finished reading and answering most of the mails in > Dovecot mailing list. There are a couple annoyingly difficult / time > consuming bugreport mails that I haven't replied to yet, but if anyone > thinks I should have replied to something already feel free to resend > the mail. I'm not sure where my request was annoying or difficult, but I didn't read an answer to it ;-) http://www.dovecot.org/list/dovecot/2012-July/067130.html Maybe you could have a look at it... Tschoeeee Roland -- Roland Rosenfeld - Content Delivery - NED - Technik NetCologne Gesellschaft f?r Telekommunikation mbH - HRB 25580, AG K?ln Am Coloneum 9 50829 K?ln Tel.: +49 221 2222-373 Fax: +49 221 2222-7373 Gesch?ftsf?hrer: Dr. Hans Konle (Sprecher), Karl-Heinz Zankel From tss at iki.fi Thu Aug 2 16:46:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 2 Aug 2012 16:46:13 +0300 Subject: [Dovecot] LZMA2 (xz) support for Dovecot? In-Reply-To: <20120802075845.GF18868@rox.home.comstyle.com> References: <20120802075845.GF18868@rox.home.comstyle.com> Message-ID: On 2.8.2012, at 10.58, Brad Smith wrote: > Thoughts on adding LZMA2 (xz) support via liblzma to Dovecot? If someone sends a patch I'll add it. Apparently its API should be similar to zlib so probably it's just a matter of renaming some functions and such. From bam at miranda.org Thu Aug 2 19:10:17 2012 From: bam at miranda.org (Bret Martin) Date: Thu, 2 Aug 2012 12:10:17 -0400 Subject: [Dovecot] Overriding inbox= in userdb extra fields Message-ID: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Hello, I'm trying to set up an alternate user with a different inbox using passwd-file and userdb extra fields and the extra field settings don't seem to be taking effect. I've used auth_debug and mail_debug and I'm unclear how I can further troubleshoot this. Is it possible to have inbox=yes in one namespace globally and then override this for one user by setting inbox=no for that namespace and then inbox=yes for another? My doveconf -n is below. I would like to have inbox=yes for the inbox namespace, inbox=no for the virtual namespace, and then be able to invert these for selected users using userdb extra fields. My attempt at doing this so far looks like bam-ios:[REDACTED]:500:500::/home/bam::user=bam namespace/inbox/inbox=no namespace/virtual/inbox=yes Changing the user with user= seems to work fine, but the inbox= changes don't. Here is some relevant log data. Aug 2 11:37:29 new-miranda dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file /etc/dovecot/users: Read 1 users in 0 secs Aug 2 11:37:29 new-miranda dovecot: auth: Debug: auth client connected (pid=14967) Aug 2 11:37:29 new-miranda dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=Rgx2MErG4wBAd51y#011lip=216.93.241.245#011rip=64.119.157.114#011lport=993#011rport=38115#011resp= Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file(bam-ios,64.119.157.114,): lookup: user=bam-ios file=/etc/dovecot/users Aug 2 11:37:29 new-miranda dovecot: auth: Debug: auth(bam-ios,64.119.157.114,): username changed bam-ios -> bam Aug 2 11:37:29 new-miranda dovecot: auth: Debug: client out: OK#0111#011user=bam#011namespace/inbox/inbox=no#011namespace/virtual/inbox=yes Aug 2 11:37:29 new-miranda dovecot: auth: Debug: master in: REQUEST#[REDACTED] Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file(bam,64.119.157.114,): lookup: user=bam file=/etc/dovecot/users Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup Aug 2 11:37:29 new-miranda dovecot: auth: Debug: master out: USER#0111425670145#011bam#011system_groups_user=bam#011uid=500#011gid=500#011home=/home/bam Aug 2 11:37:29 new-miranda dovecot: imap-login: Login: user=, method=PLAIN, rip=64.119.157.114, lip=216.93.241.245, mpid=14970, TLS, session= Aug 2 11:37:29 new-miranda dovecot: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 2 11:37:29 new-miranda dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_virtual_plugin.so Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Effective uid=500, gid=500, home=/home/bam Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/bam/mdbox Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/mdbox, index=, control=, inbox=, alt= Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace : Using permissions from /srv/mail/bam/mdbox: mode=0700 gid=-1 Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace virtual: type=private, prefix=virtual/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=virtual:/srv/mail/bam/virtual Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/virtual, index=, control=, inbox=, alt= Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace mdbox: type=private, prefix=mdbox/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:/srv/mail/bam/mdbox Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/mdbox, index=, control=, inbox=, alt= I also tried not having inbox=yes anywhere in the global configurations, but then I get Aug 2 11:52:22 new-miranda dovecot: imap(bam): Error: user bam: Initialization failed: namespace configuration error: inbox=yes namespace missing I'm having great luck with the virtual plugin, but I only want to use it for the inbox on some clients. Any ideas on why my inbox=yes/no overrides aren't taking effect? Thanks, --Bret # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 ext4 mail_location = mdbox:/srv/mail/%u/mdbox mail_plugins = " virtual" namespace inbox { inbox = no location = prefix = } namespace mdbox { hidden = yes list = no location = prefix = mdbox/ separator = / } namespace virtual { hidden = yes inbox = yes list = no location = virtual:/srv/mail/%u/virtual prefix = virtual/ separator = / } passdb { args = scheme=SSHA512 username_format=%u /etc/dovecot/users driver = passwd-file } passdb { driver = pam } protocols = " imap" service imap-login { inet_listener imap { port = 0 } } ssl_cert = References: Message-ID: 2012/7/31 Timo Sirainen : > On 18.7.2012, at 4.33, Lazy wrote: > >> I wan't it to stay that way. The problem is that it dosn't update the >> quota rules in Maildir when quota is changed in userdb. >> I have the rules avaiable in qmail-lda's environment, but I need an >> idea on how to feed the quota rule string to quota plugin without >> doing userdb lookup. >> >> What whould be the best way to do this, maybe in >> plugins/quota/quota.c:quota_root_add_rules() ? > > dovecot-lda -o plugin/quota_rule=*:storage=1G > thank You ! This is simple and elegant. Sill I need this to be taken from environment, I produced a simple patch adding one '-o' from an environment variable. If You consider this useful I can try and make it more generic, enable multiple option overriding. Regards, Michal Grzedzicki From tss at iki.fi Fri Aug 3 02:27:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 02:27:01 +0300 Subject: [Dovecot] dovecot-lda setting quota rules In-Reply-To: References: Message-ID: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> On 3.8.2012, at 2.13, Lazy wrote: >> dovecot-lda -o plugin/quota_rule=*:storage=1G >> > > thank You ! > > This is simple and elegant. > > Sill I need this to be taken from environment, I produced a simple > patch adding one '-o' from an environment variable. You can also set environment: PLUGIN/QUOTA_RULE=*:storage=1G and then use dovecot-lda -k parameter. And if even that doesn't work, you could simply create a wrapper script. > If You consider this useful I can try and make it more generic, enable > multiple option overriding. You can also give -o parameter multiple times. From ml-dovecot at zu-con.org Fri Aug 3 09:49:52 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Fri, 03 Aug 2012 08:49:52 +0200 Subject: [Dovecot] Mail deletion and Solr index update Message-ID: <501B7490.1020108@zu-con.org> Hi, I've deleted 10000s emails and it seems that every mail is removed with a single request from Solrs index. This works, but it's quite slow. Is it possible/plans to improve that? Matthias From nikolai at net24.co.nz Fri Aug 3 10:04:36 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Fri, 3 Aug 2012 19:04:36 +1200 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout Message-ID: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> Timo, There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 15: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 16: Disconnected ... dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14492: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14493: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14494: Disconnected Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, or it should simply reconnect if sees the connection is lost. At the moment the only work around is to increase the POP3 server's idle timeout to a multi hour value, which isn't a good work around as it causes a lot of inactive POP sessions to bank up. Regards, Nikolai. From stephan at rename-it.nl Fri Aug 3 12:28:36 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 03 Aug 2012 11:28:36 +0200 Subject: [Dovecot] managesieve segfault with gold linker In-Reply-To: <5016A0A3.1020201@caf.com.tr> References: <4FFF3326.9060802@caf.com.tr> <4FFFF01A.9020402@rename-it.nl> <500024B8.2020500@caf.com.tr> <5016A0A3.1020201@caf.com.tr> Message-ID: <501B99C4.2070909@rename-it.nl> On 7/30/2012 4:56 PM, Eray Aslan wrote: > On 07/13/2012 04:38 PM, Eray Aslan wrote: >> I'll try to find out more but I will be on vacation for a few days >> so it might not be quick. > Recap: > When linked with gold, pigeonhole-0.3.1 make check fails with: > dovecot-2.1-pigeonhole-0.3.1/src/testsuite/.libs/lt-testsuite: > symbol lookup error: > dovecot-2.1-pigeonhole-0.3.1/src/lib-sieve/.libs/libdovecot-sieve.so.0: > undefined symbol: mail_deliver_get_log_var_expand_table > > Well, /usr/lib64/dovecot/libdovecot-lda.so provides the > mail_deliver_get_log_var_expand_table symbol, but > /usr/lib64/dovecot/libdovecot-sieve.so doesn't link against it. The > following patch works for me: I applied this patch a while back, but I forgot to mail about it after I tested it. It works also for the normal linker, so I guess it is ok. I cannot produce a URL for the commit right now, because the hg server is down for some unexpected maintenance. Regards, Stephan. From lazy404 at gmail.com Fri Aug 3 12:33:27 2012 From: lazy404 at gmail.com (Lazy) Date: Fri, 3 Aug 2012 11:33:27 +0200 Subject: [Dovecot] dovecot-lda setting quota rules In-Reply-To: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> References: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> Message-ID: it works great. thank You again Regards, Michal Grzedzicki 2012/8/3, Timo Sirainen : > On 3.8.2012, at 2.13, Lazy wrote: > >>> dovecot-lda -o plugin/quota_rule=*:storage=1G >>> >> >> thank You ! >> >> This is simple and elegant. >> >> Sill I need this to be taken from environment, I produced a simple >> patch adding one '-o' from an environment variable. > > You can also set environment: > > PLUGIN/QUOTA_RULE=*:storage=1G > > and then use dovecot-lda -k parameter. > > And if even that doesn't work, you could simply create a wrapper script. > >> If You consider this useful I can try and make it more generic, enable >> multiple option overriding. > > You can also give -o parameter multiple times. > From dgp-dove at corefiling.co.uk Fri Aug 3 14:30:34 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Fri, 03 Aug 2012 12:30:34 +0100 Subject: [Dovecot] Pigeonhole sieve include namespace regression Message-ID: <501BB65A.2090601@corefiling.co.uk> Hi, We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. We provide a selection of global sieve scripts to make users' lives easier and one noticed that some of these have stopped working. I tracked it down to them having personal scripts with the same name. Using a really simple sieve script: require "include"; include :personal "svn"; include :global "svn"; sievec debug output for sieve 0.1.18 (trimmed a bit): * Required extensions: 0: include (16) 1: fileinto (5) * Included personal script 'svn' (block: 3): [script code here] * Included global script 'svn' (block: 4): [script code here] * Main program (block: 1): 00000000: EXTENSIONS [1]: 00000001: include 00000002: INCLUDE: 00000004: script: svn.sieve [ID: 1, BLOCK: 3] 00000006: INCLUDE: 00000008: script: svn.sieve [ID: 2, BLOCK: 4] 0000000a: [End of code] sievec debug output for Pigeonhole 0.3.1: * Required extensions (block: 1): 0: include (id: 16; block: 4) 1: fileinto (id: 5) * Included personal script 'svn' (block: 5): [script code here] * Main program (block: 2): Address Line Code 00000000: DEBUG BLOCK: 3 00000001: EXTENSIONS [1]: 00000002: include 00000003: 2: INCLUDE: 00000005: script: `svn' from /home/notroot/sieve/svn.sieve [ID: 1, BLOCK: 5] 00000007: 3: INCLUDE: 00000009: script: `svn' from /home/notroot/sieve/svn.sieve [ID: 1, BLOCK: 5] 0000000b: 3: [End of code] As can be seen the personal script is included twice. Obvious work around is to rename the personal script. However it'd be nice if namespacing came back. Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From sandro.tosi at dada.eu Fri Aug 3 15:03:28 2012 From: sandro.tosi at dada.eu (Sandro Tosi) Date: Fri, 03 Aug 2012 14:03:28 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages Message-ID: <501BBE10.5040209@dada.eu> Hello, we're setting up a weird platform where every incoming email is passed from the MTA directly to a tool that then uses dovecot LMTP to deliver the message into the user mailbox. We are legally *not* allowed to run antispam on all the incoming messages, but only on some of them, as they are recognized by the aforementioned tool; but given that tool directly uses LMTP to delivers the mail we need to find a way to parse the messages passing thru LMTP and run spamassassin only on those matching some regex on subject and mail body. Is is possible to do that with some dovecot LMTP feature? i've read a lot of documentation about how to possibly implement it and it *seems* there would be a way using pigeonhole sieve and extprograms - what do you think? The idea I have in mind is something like: 1. identify the mails we want to scan with spamassassin (using regex or whatever else to precisely pin-point them) 2. run SA on those 3. in case it's spam, rewrite the subject (or similar) Do you think it's something doable with dovecot? Thanks in advance, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi at register.it From h.reindl at thelounge.net Fri Aug 3 15:09:44 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Aug 2012 14:09:44 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBE10.5040209@dada.eu> References: <501BBE10.5040209@dada.eu> Message-ID: <501BBF88.7080403@thelounge.net> Am 03.08.2012 14:03, schrieb Sandro Tosi: > We are legally *not* allowed to run antispam on all the incoming messages you ARE allowed if you are doing it right right in this context means you have to run the filter pre-queue and REJECT blocked messages, so the sending server knows that you did NOT accept the message and can send a bounce to his user wrong in this context means you accept the message, filter it after that and throw it away while the sender has a confirmed delivery - this is a legal problem in the first front and technically wrong because you risk to become a backscatter by starting active bounes on your server if you are not 100% sure how all the pieces work togehter and how the whole system acts in each situation bringing LMTP and Dovecot in the context of spam-filtering is automatically doing it completly wrong -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From sandro.tosi at dada.eu Fri Aug 3 15:17:57 2012 From: sandro.tosi at dada.eu (Sandro Tosi) Date: Fri, 03 Aug 2012 14:17:57 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBF88.7080403@thelounge.net> References: <501BBE10.5040209@dada.eu> <501BBF88.7080403@thelounge.net> Message-ID: <501BC175.9050005@dada.eu> Hello, thanks for you reply. On 08/03/2012 02:09 PM, Reindl Harald wrote: > > > Am 03.08.2012 14:03, schrieb Sandro Tosi: >> We are legally *not* allowed to run antispam on all the incoming messages > > you ARE allowed if you are doing it right please.. don't consider everyone that writes a junior with no experience, I know what i'm doing :) In a classic mail setup, i'd have done as you described, but the introduction of my email makes it clear this is a particular situation. as I said, we *cannot* do it the "standard way"! we are forced to accept messages if they come in a particular format (yes even spam ones), and we can only run SA on a subset if the incoming mails, as decided by the tool we're passing all the messages to. Now, getting back on topic, is it possible to do what I have in mind? is there some other solutions to achieve my goal? Regards, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi at register.it From robert at schetterer.org Fri Aug 3 15:45:33 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 14:45:33 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBE10.5040209@dada.eu> References: <501BBE10.5040209@dada.eu> Message-ID: <501BC7ED.1090003@schetterer.org> Am 03.08.2012 14:03, schrieb Sandro Tosi: > Hello, > we're setting up a weird platform where every incoming email is passed > from the MTA directly to a tool that then uses dovecot LMTP to deliver > the message into the user mailbox. > > We are legally *not* allowed to run antispam on all the incoming > messages, but only on some of them, as they are recognized by the > aforementioned tool; but given that tool directly uses LMTP to delivers > the mail we need to find a way to parse the messages passing thru LMTP > and run spamassassin only on those matching some regex on subject and > mail body. > > Is is possible to do that with some dovecot LMTP feature? > > i've read a lot of documentation about how to possibly implement it and > it *seems* there would be a way using pigeonhole sieve and extprograms - > what do you think? > > The idea I have in mind is something like: > > 1. identify the mails we want to scan with spamassassin (using regex or > whatever else to precisely pin-point them) > 2. run SA on those > 3. in case it's spam, rewrite the subject (or similar) > > Do you think it's something doable with dovecot? > > Thanks in advance, you may use global sieve rules perhaps look here for ideas http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples#Spam.2BAC8-Virus_rules -- Best Regards MfG Robert Schetterer From voytek at sbt.net.au Fri Aug 3 16:09:47 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:09:47 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <4FFC1340.6060607@schetterer.org> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: On Tue, July 10, 2012 9:34 pm, Robert Schetterer wrote: > perhaps use daily cron with something like this > > doveadm expunge -A mailbox Junk savedbefore 7d; where am I going wrong ? nothing gets removed: # pwd /var/mail/vhosts/sbt.net.au/spam at sbt.net.au/.spam/cur # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7day # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 5d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 4d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 3d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 2d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1w # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox .spam savedbefore 1w # ls | wc 532 532 30884 ------------- ls -al -rw------- 1 vmail vmail 5921 Jul 9 21:55 1341834948.M445074P17475.geko.sbt.net.au,S=5921,W=6003:2, -rw------- 1 vmail vmail 3021 Jul 9 22:06 1341835577.M701903P17756.geko.sbt.net.au,S=3021,W=3125:2, .... -- Voytek From robert at schetterer.org Fri Aug 3 16:14:05 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 15:14:05 +0200 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: <501BCE9D.5050303@schetterer.org> Am 03.08.2012 15:09, schrieb Voytek Eymont: > > On Tue, July 10, 2012 9:34 pm, Robert Schetterer wrote: > >> perhaps use daily cron with something like this >> >> doveadm expunge -A mailbox Junk savedbefore 7d; > > where am I going wrong ? > > nothing gets removed: > > # pwd > /var/mail/vhosts/sbt.net.au/spam at sbt.net.au/.spam/cur > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7day > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 5d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 4d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 3d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 2d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1w > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox .spam savedbefore 1w > # ls | wc > 532 532 30884 > > ------------- > ls -al > -rw------- 1 vmail vmail 5921 Jul 9 21:55 > 1341834948.M445074P17475.geko.sbt.net.au,S=5921,W=6003:2, > -rw------- 1 vmail vmail 3021 Jul 9 22:06 > 1341835577.M701903P17756.geko.sbt.net.au,S=3021,W=3125:2, > .... > do you use expire plugin ? http://wiki2.dovecot.org/Plugins/Expire -- Best Regards MfG Robert Schetterer From voytek at sbt.net.au Fri Aug 3 16:24:49 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:24:49 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <501BCE9D.5050303@schetterer.org> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <501BCE9D.5050303@schetterer.org> Message-ID: <6cb5d27e683ddfa9532a8dc0d79aa301.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:14 pm, Robert Schetterer wrote: > do you use expire plugin ? > > http://wiki2.dovecot.org/Plugins/Expire no... I saw this part: "Note that: This command runs fine even without expire plugin loaded." and assumed I didn't have to.... OK, back to drawing board, thanks for your help -- Voytek Eymont From voytek at sbt.net.au Fri Aug 3 16:32:37 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:32:37 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? Message-ID: looking through logs I noticed this today: grep mysql /var/log/maillog | grep fail Aug 3 17:35:25 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:35:57 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:02 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:23 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:40 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:50 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:40:04 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:04 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:19 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:38 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist looking at mysqld.log, all i see is: 120721 17:58:44 InnoDB: Shutdown completed; log sequence number 0 76814 120721 17:58:44 [Note] /usr/libexec/mysqld: Shutdown complete 120721 17:58:44 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended 120721 17:59:53 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 120721 17:59:54 InnoDB: Initializing buffer pool, size = 8.0M 120721 17:59:54 InnoDB: Completed initialization of buffer pool 120721 17:59:54 InnoDB: Started; log sequence number 0 76814 120721 17:59:54 [Note] Event Scheduler: Loaded 0 events 120721 17:59:54 [Note] /usr/libexec/mysqld: ready for connections. Version: '5.1.61' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution no failure were noticed or reported, except for log items any thoughts ? I might have been importing (phpmyadmin) some 3 or 4 databases around that time, surely that wouldn't cause such issue ? -- Voytek Eymont From h.reindl at thelounge.net Fri Aug 3 16:36:19 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Aug 2012 15:36:19 +0200 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: References: Message-ID: <501BD3D3.7010208@thelounge.net> Am 03.08.2012 15:32, schrieb Voytek Eymont: > grep mysql /var/log/maillog | grep fail > Aug 3 17:35:25 dovecot: auth-worker(28335): Error: mysql: Query failed, > retrying: Table 'postfix.users' doesn't exist states clearly that a table is missing > looking at mysqld.log, all i see is: > no failure were noticed or reported, except for log items > > any thoughts ? why should mysqld report a error if a nonsystem table is mising > I might have been importing (phpmyadmin) some 3 or 4 databases around that > time, surely that wouldn't cause such issue ? what about connect directly to mysqld and look if the table exists and review your import dump-files if they did drop tables? however, this is not a dovecot issue -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Fri Aug 3 16:42:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:42:38 +0300 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: On 3.8.2012, at 16.09, Voytek Eymont wrote: >> doveadm expunge -A mailbox Junk savedbefore 7d; > > where am I going wrong ? > > nothing gets removed: Find out what Dovecot thinks the save dates are: doveadm fetch -u user at domain date.saved mailbox spam I'm pretty sure the problem is simply that the saved date isn't what you expect it to be. With maildir it's initially taken from the file's ctime and added to cache. From voytek at sbt.net.au Fri Aug 3 16:47:55 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:47:55 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:42 pm, Timo Sirainen wrote: > On 3.8.2012, at 16.09, Voytek Eymont wrote: > >>> doveadm expunge -A mailbox Junk savedbefore 7d; >> where am I going wrong ? >> nothing gets removed: > Find out what Dovecot thinks the save dates are: > doveadm fetch -u user at domain date.saved mailbox spam Timo, thanks I see... date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 > I'm pretty sure the problem is simply that the saved date isn't what you > expect it to be. With maildir it's initially taken from the file's ctime > and added to cache. so... what do I need ? -- Voytek Eymont From tss at iki.fi Fri Aug 3 16:51:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:51:49 +0300 Subject: [Dovecot] ACL with MySQL dict => full table scans (was: v2.1.9 released) In-Reply-To: <20120802084257.GB23882@sys-241.netcologne.de> References: <1343843919.18782.22.camel@innu> <20120802084257.GB23882@sys-241.netcologne.de> Message-ID: <1F8B6836-9873-4BA8-A2FF-C9EDCE306895@iki.fi> On 2.8.2012, at 11.42, Roland Rosenfeld wrote: > On Wed, 01 Aug 2012, Timo Sirainen wrote: > >> I've again mostly finished reading and answering most of the mails in >> Dovecot mailing list. There are a couple annoyingly difficult / time >> consuming bugreport mails that I haven't replied to yet, but if anyone >> thinks I should have replied to something already feel free to resend >> the mail. > > I'm not sure where my request was annoying or difficult, but I didn't > read an answer to it ;-) > http://www.dovecot.org/list/dovecot/2012-July/067130.html Yes, it was one of the "annoying" mails. :) The problem is this I think: http://hg.dovecot.org/dovecot-2.1/file/476381017ec7/src/plugins/acl/acl-backend-vfile-acllist.c#l296 I think it does the rebuild simply because the rebuild code was needed to be written anyway, and doing anything else requires adding more code to handle only the specific necessary additions/removals. A nice side effect of this rebuild is also that it makes sure that the dict is fully up to date even if you had manually changed the dovecot-acl files. But I guess a better solution for that would be a "doveadm acl rebuild" command. So .. yes, this definitely should be fixed, but it's not really a high priority right now.. From tss at iki.fi Fri Aug 3 16:53:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:53:38 +0300 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> Message-ID: On 3.8.2012, at 16.47, Voytek Eymont wrote: >> Find out what Dovecot thinks the save dates are: >> doveadm fetch -u user at domain date.saved mailbox spam > > Timo, thanks > > I see... > > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > >> I'm pretty sure the problem is simply that the saved date isn't what you >> expect it to be. With maildir it's initially taken from the file's ctime >> and added to cache. > > so... what do I need ? Are those dates changed all the time? The problem should get fixed eventually by itself, unless something else weird is going on. From tss at iki.fi Fri Aug 3 16:56:42 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:56:42 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: <501A27A4.7000303@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> <501A27A4.7000303@schetterer.org> Message-ID: On 2.8.2012, at 10.09, Robert Schetterer wrote: > Hi Timo, most of the Problems are fixed now > many thx for your script > > , but how to avoid that in future ( Maildir filename has wrong S value ) You'd need to find out why it started happening in the first place. What software wrote those filenames? Are new filenames still creating with wrong S value? Does your dovecot.conf use zlib plugin globally (instead of only in some protocol sections, which might cause this kind of trouble)? > you released a patch > > diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c > --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 > +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 > @@ -20,6 +20,7 @@ > struct mail *mail = mstream->mail; > enum mail_lookup_abort orig_lookup_abort; > > + return FALSE; > if (mstream->expected_size != (uoff_t)-1) > return TRUE; > > would it be a good idea to include it in 2.1.9 for me ? > as it looks like its not in the public code ? It's an ugly workaround for the wrong S=size problem when zlib is used. Preferably you wouldn't ever need to use it. From tss at iki.fi Fri Aug 3 16:59:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:59:58 +0300 Subject: [Dovecot] Overriding inbox= in userdb extra fields In-Reply-To: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> References: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Message-ID: On 2.8.2012, at 19.10, Bret Martin wrote: > I'm trying to set up an alternate user with a different inbox using passwd-file and userdb extra fields and the extra field settings don't seem to be taking effect. I've used auth_debug and mail_debug and I'm unclear how I can further troubleshoot this. > > Is it possible to have inbox=yes in one namespace globally and then override this for one user by setting inbox=no for that namespace and then inbox=yes for another? Yes. > My doveconf -n is below. I would like to have inbox=yes for the inbox namespace, inbox=no for the virtual namespace, and then be able to invert these for selected users using userdb extra fields. My attempt at doing this so far looks like > > bam-ios:[REDACTED]:500:500::/home/bam::user=bam namespace/inbox/inbox=no namespace/virtual/inbox=yes Problem 1: The userdb fields need to be prefixed in passwd-file with "userdb_" prefix, so "userdb_namespace/inbox/inbox=no". Problem 2: You change the username from bam-ios to bam, which results in: > Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user > Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup So the userdb fields aren't looked up from passwd-file anyway. From voytek at sbt.net.au Fri Aug 3 17:08:18 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 00:08:18 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <501BD3D3.7010208@thelounge.net> References: <501BD3D3.7010208@thelounge.net> Message-ID: <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:36 pm, Reindl Harald wrote: > states clearly that a table is missing > what about connect directly to mysqld and look if the table exists and > review your import dump-files if they did drop tables? auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Reindl , thanks oops, I clearly mis-interpreted what happened... looking at mysql tables, I don't have such table, and, it seems I'm not using it in my sql: grep users dovecot-sql.conf grep users dovecot* conf.d]# grep users auth-sql* auth-sql.conf:# Authentication for SQL users. Included from auth.conf. auth-sql.conf.ext:# Authentication for SQL users. Included from auth.conf. conf.d]# grep users 10-auth.conf # If you want to allow master users to log in by specifying the master # Username to use for users logging in with ANONYMOUS SASL mechanism # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. where could that be called from ? -- Voytek Eymont From tss at iki.fi Fri Aug 3 17:10:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:10:14 +0300 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <501B7490.1020108@zu-con.org> References: <501B7490.1020108@zu-con.org> Message-ID: <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> On 3.8.2012, at 9.49, Matthias Rieber wrote: > I've deleted 10000s emails and it seems that every mail is removed with > a single request from Solrs index. This works, but it's quite slow. Is > it possible/plans to improve that? Could you try if the attached patch works? It compiles, but didn't test it. -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 2727 bytes Desc: not available URL: -------------- next part -------------- From tss at iki.fi Fri Aug 3 17:12:35 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:12:35 +0300 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> Message-ID: <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> On 3.8.2012, at 17.08, Voytek Eymont wrote: >> states clearly that a table is missing >> what about connect directly to mysqld and look if the table exists and >> review your import dump-files if they did drop tables? > > auth-worker(28335): Error: mysql: Query failed, retrying: Table > 'postfix.users' doesn't exist > > Reindl , thanks > > oops, I clearly mis-interpreted what happened... > looking at mysql tables, I don't have such table, and, it seems I'm not > using it in my sql: .. > where could that be called from ? From the default passdb/userdb sql settings. You haven't set one of password_query, user_query or iterate_query and it's trying to use the default which doesn't of course work with your database. From bam at miranda.org Fri Aug 3 17:13:15 2012 From: bam at miranda.org (Bret Martin) Date: Fri, 3 Aug 2012 10:13:15 -0400 Subject: [Dovecot] Overriding inbox= in userdb extra fields In-Reply-To: References: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Message-ID: <696C86DB-367F-4F93-AA1C-B231D5730A8A@miranda.org> On Aug 3, 2012, at 9:59 AM, Timo Sirainen wrote: [...] > Problem 1: The userdb fields need to be prefixed in passwd-file with "userdb_" prefix, so "userdb_namespace/inbox/inbox=no". Aha! This is what I was missing. The documentation on userdb extra fields even says this, but I missed it even on multiple readings. > Problem 2: You change the username from bam-ios to bam, which results in: > >> Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user >> Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup > > So the userdb fields aren't looked up from passwd-file anyway. I discovered this as well after sending my mail. My goal in changing the username was to point at bam's mail storage without having a symlink or something like that. But I solved this instead by adding more userdb extra fields to override namespace/{inbox,mdbox,virtual}/location. Thanks so much! I've now got exactly what I want: a full view of my many folders from desktop IMAP clients, and a collapsed hierarchy using virtual folders for mobile IMAP clients where navigating a huge folder tree can be cumbersome. --Bret From tss at iki.fi Fri Aug 3 17:14:55 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:14:55 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5019905F.3010102@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> <5019905F.3010102@zu-con.org> Message-ID: <381E6606-D4BA-4F8C-8A78-3B78CAA031BA@iki.fi> On 1.8.2012, at 23.23, Matthias Rieber wrote: > alright. Some resources say that "413 FULL head" means request too large. Maybe that's caused by the pretty big folder virtual.all which contains more than 360000 mails. Probably it means that the virtual folder consists of too many real folders. Dovecot's Solr query adds each real folder's GUID to the query. I guess there should be some limit and it would have to send more than one query and merge the results. From tss at iki.fi Fri Aug 3 17:40:27 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:40:27 +0300 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> Message-ID: <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> On 3.8.2012, at 10.04, Nikolai Schupbach wrote: > There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. What should happen is: 1. pop3c connects to server 2. issues LIST and UIDL commands 3. IMAP server issues fetch 1:* RFC822.SIZE (or I guess it does this with a ton of separate commands) 4. pop3c attempts to do some TOP commands. > When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): > > dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly > dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected It looks like the 3 step takes a long time. Do you have imapc_features=rfc822.size? Also setting mail_prefetch_count to something between 10..100 should help a lot. And this should also fix it by moving 3 step to 1: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d > Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. Yes, looks like dsync simply continues without assigning POP3 UIDL. Hmm. Perhaps it shouldn't do that on temporary failures.. > Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, This isn't easily possible. > or it should simply reconnect if sees the connection is lost. It should probably do that, yes. From robert at schetterer.org Fri Aug 3 20:17:46 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 19:17:46 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> <501A27A4.7000303@schetterer.org> Message-ID: <501C07BA.80004@schetterer.org> Am 03.08.2012 15:56, schrieb Timo Sirainen: > On 2.8.2012, at 10.09, Robert Schetterer wrote: > >> Hi Timo, most of the Problems are fixed now >> many thx for your script >> >> , but how to avoid that in future ( Maildir filename has wrong S value ) > > You'd need to find out why it started happening in the first place. the problem is/was getting maildirs fixed, no time to debug on production system in deed i have no idea why this happend, i found out some broken were old maildirs, so for them i bet coruption by migration 2.0 -2.1 other cuted out attachments imap online with serveral clients on = user fault in my meaning left the cases which i reproduced myself, or some brand new mailboxes it was about compressed mail and nocompressed with wrong message size in one folder What software wrote those filenames? Are new filenames still creating with wrong S value? Does your dovecot.conf use zlib plugin globally (instead of only in some protocol sections, which might cause this kind of trouble)? 10-mail.conf:mail_plugins = $mail_plugins zlib expire virtual fts fts_lucene mail_log autocreate notify acl listescape 20-imap.conf: mail_plugins = imap_acl acl fts fts_lucene mail_log autocreate notify expire virtual quota imap_quota zlib imap_zlib listescape 90-plugin.conf:zlib_save_level = 6 90-plugin.conf:zlib_save = gz should be ok ? > >> you released a patch >> >> diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c >> --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 >> +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 >> @@ -20,6 +20,7 @@ >> struct mail *mail = mstream->mail; >> enum mail_lookup_abort orig_lookup_abort; >> >> + return FALSE; >> if (mstream->expected_size != (uoff_t)-1) >> return TRUE; >> >> would it be a good idea to include it in 2.1.9 for me ? >> as it looks like its not in the public code ? > > It's an ugly workaround for the wrong S=size problem when zlib is used. Preferably you wouldn't ever need to use it. ok , i fixed all mailboxes with your script and one from ralf with compressed maildirs, updated to 2.1.9, using lucene now, disabled stats ( for kernel bugs ), and for now all problems are gone if i cant find any better reason, i go for shit happens, and learned how to fix it, however it were only 6 maildirs from 200 which got broken going trough lot of updates in years , so this is ok in my mind good time for users learn to build some mail archive from time to time however no mail got lost > -- Best Regards MfG Robert Schetterer From stephan at rename-it.nl Fri Aug 3 21:02:28 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 03 Aug 2012 20:02:28 +0200 Subject: [Dovecot] Pigeonhole sieve include namespace regression In-Reply-To: <501BB65A.2090601@corefiling.co.uk> References: <501BB65A.2090601@corefiling.co.uk> Message-ID: <501C1234.20504@rename-it.nl> On 8/3/2012 1:30 PM, Daniel Piddock wrote: > Hi, > > We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian > Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. > > We provide a selection of global sieve scripts to make users' lives > easier and one noticed that some of these have stopped working. I > tracked it down to them having personal scripts with the same name. > > Using a really simple sieve script: Nice bug report. > As can be seen the personal script is included twice. Obvious work > around is to rename the personal script. However it'd be nice if > namespacing came back. This should fix it: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/6a34eda7924e I also extended the test suite to prevent this situation from occurring again, for file-based scripts anyway. Regards, Stephan. From voytek at sbt.net.au Sat Aug 4 01:33:55 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 08:33:55 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> Message-ID: <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:53 pm, Timo Sirainen wrote: > On 3.8.2012, at 16.47, Voytek Eymont wrote: >>> Find out what Dovecot thinks the save dates are: >>> doveadm fetch -u user at domain date.saved mailbox spam >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> >>> I'm pretty sure the problem is simply that the saved date isn't what >>> you expect it to be. With maildir it's initially taken from the file's >>> ctime and added to cache. >> >> so... what do I need ? > > Are those dates changed all the time? The problem should get fixed > eventually by itself, unless something else weird is going on. thanks. don't know, looking this morning it shows like below, the 00:05:05 is probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to see what gets removed from 'spam' box, before and after each attempt to expunge : date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 06:45:33 date.saved: 2012-08-03 06:45:33 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 18:37:25 date.saved: 2012-08-03 18:55:34 date.saved: 2012-08-03 19:51:02 date.saved: 2012-08-04 02:45:21 date.saved: 2012-08-04 06:33:16 -- Voytek From voytek at sbt.net.au Sat Aug 4 01:55:01 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 08:55:01 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> Message-ID: <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> >> where could that be called from ? > > From the default passdb/userdb sql settings. You haven't set one of > password_query, user_query or iterate_query and it's trying to use the > default which doesn't of course work with your database. thanks cd /etc/dovecot grep password_query * dovecot-sql.conf:password_query = SELECT username as user, password, '/var/mail/vhosts/%d/%n@%d' as userdb_home, **TRIM** # grep user_query * dovecot-sql.conf:user_query = SELECT concat('/var/mail/vhosts/', maildir) as home, concat('maildir:/var/mail/vhosts/', maildir) as mail, **TRIM** dovecot-sql.conf:user_query = SELECT '/var/mail/vhosts/%d/%n@%d' as home, 'maildir:/var/mail/vhosts/%d/%n@%d' as mail, **TRIM** OOPS, I seem to have duplicate user_query with my two 'user_query', it's the last one in the file that wins, yes ? so, I should remove the 1st one # grep iterate_query * # none. so, I need some 'iterate_query' inserted in my dovecot-sql.conf ? -- Voytek From ml-dovecot at zu-con.org Sat Aug 4 10:11:24 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Sat, 04 Aug 2012 09:11:24 +0200 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> Message-ID: <501CCB1C.80908@zu-con.org> Hello, Am 03.08.2012 16:10, schrieb Timo Sirainen: > On 3.8.2012, at 9.49, Matthias Rieber wrote: > >> I've deleted 10000s emails and it seems that every mail is removed with >> a single request from Solrs index. This works, but it's quite slow. Is >> it possible/plans to improve that? > > Could you try if the attached patch works? It compiles, but didn't test it. it segfaults: Aug 4 08:55:58 smtp dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for matthias Aug 4 08:55:58 smtp dovecot: indexer-worker(matthias): Fatal: master: service(indexer-worker): child 32503 killed with signal 11 (core not dumped) But I didn't managed to get a core dump. I start dovecot with ulimit -c unlimited and I also set /proc/sys/kernel/core_pattern to world writeable directory. Matthias From teopro at gmail.com Sat Aug 4 16:05:12 2012 From: teopro at gmail.com (Gmail-teopro) Date: Sat, 4 Aug 2012 16:05:12 +0300 Subject: [Dovecot] disable auth-worker logging Message-ID: <1809306900.20120804160512@gmail.com> Hello all, Can someone please give me a hint about how can I disable such messages to be inserted into log file(maillog this case as syslog_facility = mail)? >> dovecot: auth-worker(13377): mysql(localhost): Connected to database postfix All the '_debug' and '_verbose' statements bear the 'no' value. Thank you. -- Best regards, Gmail-teopro mailto:teopro at gmail.com From matthew at atom.net Sat Aug 4 16:30:03 2012 From: matthew at atom.net (Matthew Powell) Date: Sat, 4 Aug 2012 09:30:03 -0400 Subject: [Dovecot] authenticate plain and utf-8 with special chars In-Reply-To: <1343727740.3072.28.camel@hermann.potsdam.securepoint.local> References: <1343727740.3072.28.camel@hermann.potsdam.securepoint.local> Message-ID: <9424CEA0-4105-44BA-80D1-FA28E6950581@atom.net> On 2012-07-31, at 5.42, Matthias Lay wrote: > seems like the mail clients like thunderbird send their base64 string in > ISO- encoding, which doesnt work on my dovecot setup if there are some > Umlauts > > I am not able to login as > "?mer" for example > > If I authenticate from telnet with an base64 encoded utf-8 string like > 'echo -en "\0?mer\0Start12" |base64' > everything works fine This looks like a Thunderbird bug. SASL PLAIN uses UTF-8, not ISO-8859; see RFC 4616. Thunderbird's bug #312593 relates to password handling, but it sounds like there's a similar issue affecting usernames. See https://bugzilla.mozilla.org/show_bug.cgi?id=312593. It might be worth adding a comment there. -- Matthew Powell matthew at atom.net From e-frog at gmx.de Sat Aug 4 16:45:51 2012 From: e-frog at gmx.de (e-frog) Date: Sat, 04 Aug 2012 15:45:51 +0200 Subject: [Dovecot] disable auth-worker logging In-Reply-To: <1809306900.20120804160512@gmail.com> References: <1809306900.20120804160512@gmail.com> Message-ID: <501D278F.2020606@gmx.de> On 04.08.2012 15:05, wrote Gmail-teopro: > Hello all, > > Can someone please give me a hint about how can I disable such messages to > be inserted into log file(maillog this case as syslog_facility = mail)? > >>> dovecot: auth-worker(13377): mysql(localhost): Connected to database postfix > > All the '_debug' and '_verbose' statements bear the 'no' value. > > Thank you. > Hello, I don't think this message can be disabled in dovecot. You can however configure your syslog daemon to ignore the message. The following works for me using rsyslog: $: cat /etc/rsyslog.d/40-dovecot.conf :msg, contains, "mysql(localhost): Connected to database" ~ -- e-frog From daniel.parthey at informatik.tu-chemnitz.de Sun Aug 5 04:08:41 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sun, 5 Aug 2012 03:08:41 +0200 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> Message-ID: <20120805010841.GA13639@daniel.localdomain> Voytek Eymont wrote: > I need some 'iterate_query' inserted in my dovecot-sql.conf ? You only need it if you need to run some doveadm -A command over all users. Regards Daniel -- https://plus.google.com/103021802792276734820 From voytek at sbt.net.au Sun Aug 5 04:21:41 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sun, 5 Aug 2012 11:21:41 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <20120805010841.GA13639@daniel.localdomain> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> <20120805010841.GA13639@daniel.localdomain> Message-ID: <20d4d5457e4f22ef3d71210867e962ed.squirrel@geko.sbt.net.au> On Sun, August 5, 2012 11:08 am, Daniel Parthey wrote: > Voytek Eymont wrote: >> I need some 'iterate_query' inserted in my dovecot-sql.conf ? > You only need it if you need to run some doveadm -A command > over all users. Daniel, thanks for explanation, so I got these when I tried my expunge, I was trying also all 'local' users I only have virtual users in mysql, there is no *nix users on this system, so, if I had a properly constructed 'iterate_query' I could use that '-A' option to go against all mysql virtual users, and, not try and fail on '/home/whatevr' as valid users ? -- Voytek From peter at snowweb.co.uk Sun Aug 5 08:22:23 2012 From: peter at snowweb.co.uk (Peter Snow) Date: Sun, 05 Aug 2012 13:22:23 +0800 Subject: [Dovecot] Just trying to make dovecot work. Message-ID: <501E030F.5090209@snowweb.co.uk> Hi, I have to say that Dovecot is certainly the most challenging piece of software I've ever had the pleasure of setting up (due mainly to the reams of largely unhelpful documentation). After 36 almost non-stop hours reading and trying, I finally end up here. :-) I really would appreciate your help - and many thanks in advance! *************************************************************** /var/log/dovecot.info.log (showing unsuccessful login) *************************************************************** Aug 04 21:32:36 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 04 21:32:36 auth: Debug: passwd-file /usr/local/etc/dovecot.passdb: Read 1 users Aug 04 21:32:36 auth: Debug: auth client connected (pid=24769) Aug 04 21:32:41 auth: Debug: client in: AUTH 1 PLAIN service=imap securedlip=::1 rip=::1 lport=143 rport=52551 resp=AHBldGVyAGZ1YXNpbjU0MTRz Aug 04 21:32:41 auth: Debug: passwd-file(peter,::1): lookup: user=peter file=/usr/local/etc/dovecot.passdb Aug 04 21:32:41 auth: Debug: client out: OK 1 user=peter Aug 04 21:32:41 auth: Debug: master in: REQUEST 1417805825 24769 1 44a3aec60ec6eaec6eff0efb99971eee Aug 04 21:32:41 auth: Debug: master out: USER 1417805825 peter Aug 04 21:32:41 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=24772, secured *************************************************************** END *************************************************************** *************************************************************** /var/log/dovecot.log (showing unsuccessful login) *************************************************************** Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop privileges: User is missing UID (see mail_uid setting) Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to server log for more information. *************************************************************** END *************************************************************** *************************************************************** dovecot -n *************************************************************** # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) ext4 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 1000 info_log_path = /var/log/dovecot.info.log last_valid_uid = 5000 log_path = /var/log/dovecot.log login_trusted_networks = 127.0.0.1 mail_debug = yes mail_location = maildir:/var/mail/%u/Maildir mail_log_prefix = "%Us(%u): " passdb { args = /usr/local/etc/dovecot.passdb driver = passwd-file } protocols = imap ssl = no verbose_proctitle = yes *************************************************************** END *************************************************************** *************************************************************** /usr/local/etc/dovecot.passdb *************************************************************** peter:{CRYPT}BrtgyyOEX33w6:1000:500:Peter Snow:/var/mail/peter:: *************************************************************** END *************************************************************** *************************************************************** cat /etc/passwd | grep peter *************************************************************** peter:x:1000:500::/home/peter:/sbin/nologin *************************************************************** END *************************************************************** Notes: 'peter' does not yet have a system password, since I'm testing this for users which will only be virtual users. I made the password for 'peter' in the dovecot.passdb using "doveadm pw -s crypt" although once I've got it working I'd like to change the encryption to something as strong as possible - any suggestions please? Hope you can help and many thanks. Kind regards, Peter From lists at wildgooses.com Sun Aug 5 12:38:49 2012 From: lists at wildgooses.com (Ed W) Date: Sun, 05 Aug 2012 10:38:49 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501E030F.5090209@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> Message-ID: <501E3F29.9090401@wildgooses.com> On 05/08/2012 06:22, Peter Snow wrote: > Hi, > > I have to say that Dovecot is certainly the most challenging piece of > software I've ever had the pleasure of setting up (due mainly to the > reams of largely unhelpful documentation). After 36 almost non-stop > hours reading and trying, I finally end up here. :-) > > I really would appreciate your help - and many thanks in advance! Phew, haven't you set yourself up for a hostile response..? It's only an opinion, but I would say that the Dovecot docs are rather helpful and thorough? Also dovecot ships with an almost working config out of the box, really you only need to adjust a couple of settings to achieve most setups. OK, reading your log files, I think this is probably the clue? > /var/log/dovecot.log > (showing unsuccessful login) > > *************************************************************** > Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop > privileges: User is missing UID (see mail_uid setting) > Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to > server log for more information. > *************************************************************** I don't use that auth method so I don't want to give you a definitive suggestion, but we can certainly use google to get some ideas: http://lmgtfy.com/?q=dovecot+mail_uid+ Third link down seems to cover your question. Basically says you need to define the setting listed above, but also why. Note, I think it's easy to level critique against dovecot auth, but if you look for a few moments longer you will see that you are probably just criticising flexibility. You can use a very wide array of database types to store your auth information and with that flexibility comes the requirement to actually define your specific choice. Some people run a multi-tennanted system and like to be able to run each user under their own uid, hence that being flexible. Others want to use LDAP or a database to store auth info (I think you can even use both at the same time). It's even possible to use both at the same time I believe, or to lookup users in one db, and passwords in another. Note, I don't know your requirements, but you might want to look at some kind of database for your user storage if you have more than a fairly simple installation? Either LDAP or sql is likely to give you more flexibility than a flat file pwdb, but I don't know your requirements, so just a thought Finally note that there are literally dozens of "how to install dovecot" guides on the internet that will help you get a working setup with various auth db choices. Once you understand the big picture using one of those guides you will be able to customise things to a very specific situation Good luck Ed W From CMarcus at Media-Brokers.com Sun Aug 5 19:23:30 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 05 Aug 2012 12:23:30 -0400 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> Message-ID: <501E9E02.5000203@Media-Brokers.com> On 2012-08-03 6:33 PM, Voytek Eymont wrote: > don't know, looking this morning it shows like below, the 00:05:05 is > probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to > see what gets removed from 'spam' box, before and after each attempt to > expunge : > > date.saved: 2012-08-03 00:05:05 The 'date.saved:' is the date/time that the message was moved into that folder. The clock for these messages is based on the time it was moved into that folder, NOT the date/time the message was received in the message header. Maybe this is what is confusing you? So, if you have issue the command to remove messages older than 7 days, that would be 7 days *since they were moved into the folder*. -- Best regards, Charles From voytek at sbt.net.au Mon Aug 6 01:47:19 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Mon, 6 Aug 2012 08:47:19 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <501E9E02.5000203@Media-Brokers.com> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> Message-ID: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > The 'date.saved:' is the date/time that the message was moved into that > folder. > > The clock for these messages is based on the time it was moved into that > folder, NOT the date/time the message was received in the message header. > Maybe this is what is confusing you? > So, if you have issue the command to remove messages older than 7 days, > that would be 7 days *since they were moved into the folder*. Charles, thanks these are a user+spam spam basket, the actual messages are either in 'new' or 'cur', depending if a particular user logged to 'spam' basket or not does that mean that say 7 days would clear new messages after 7 days, and, any message that is not 'new' after 7 more days, assuming I run the command daily ? all I want is an auto way to clear +spam baskets after x days -- Voytek Eymont From CMarcus at Media-Brokers.com Mon Aug 6 02:24:54 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 05 Aug 2012 19:24:54 -0400 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> Message-ID: <501F00C6.6030908@Media-Brokers.com> On 2012-08-05 6:47 PM, Voytek Eymont wrote: > > On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > >> The 'date.saved:' is the date/time that the message was moved into that >> folder. >> >> The clock for these messages is based on the time it was moved into that >> folder, NOT the date/time the message was received in the message header. >> Maybe this is what is confusing you? > >> So, if you have issue the command to remove messages older than 7 days, >> that would be 7 days *since they were moved into the folder*. > > Charles, > > thanks > > these are a user+spam spam basket, the actual messages are either in 'new' > or 'cur', depending if a particular user logged to 'spam' basket or not > > does that mean that say 7 days would clear new messages after 7 days, and, > any message that is not 'new' after 7 more days, assuming I run the > command daily ? > > all I want is an auto way to clear +spam baskets after x days I'm not sure I understand your question... Again, the date.saved is the date/tome the message was moved into the folder, and has nothing to do with the date the message was received or the date/time in the message header. So, as long as the date.saved date/time is not older than the date/time you are searching on, then they will not be deleted. -- Best regards, Charles From peter at snowweb.co.uk Mon Aug 6 04:35:49 2012 From: peter at snowweb.co.uk (Peter Snow) Date: Mon, 06 Aug 2012 09:35:49 +0800 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501E3F29.9090401@wildgooses.com> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> Message-ID: <501F1F75.5040906@snowweb.co.uk> Well you can continue to kid yourselves that the documentation is good if you like. The facts say differently. For example, I visit http://wiki.dovecot.org/MainConfig for help with the main config and at the top of the page it tells me that this page is for version 1.x, so I click the link to view the page for 2.x, which takes me to a page saying that the page I want has yet to be created. I therefore have no option but to refer to the version 1.x documentation. I copy "mechanisms = plain" from it but when I restart dovecot, it fails, telling me that it is not recognized! > Finally note that there are literally dozens of "how to install > dovecot" guides on the internet I noticed that also and did indeed follow many of them. Many of them though are for version 1.x but don't say so. Other's just leave you hanging. I could and probably will carry on digging on Google and probably will find a bunch of erroneous documents among the good ones and will have no easy way to tell the difference, but one might expect the official website to have the right information to save me this hassle. By the way, I've now got it running. It wasn't failing due to the user being used to run the processes. It was due to misconfiguration of the way that the virtual users were setup, which in the end I managed to fix by interrogating a server with a working implementation (albeit ver 1.x) which was similar to what I needed and copying parts of it's config. Although mutt now connects to it fine, roundcube doesn't, but don't worry. I'm not planning to bother you further. Kind regards, Peter On 08/05/2012 05:38 PM, Ed W wrote: > On 05/08/2012 06:22, Peter Snow wrote: >> Hi, >> >> I have to say that Dovecot is certainly the most challenging piece of >> software I've ever had the pleasure of setting up (due mainly to the >> reams of largely unhelpful documentation). After 36 almost non-stop >> hours reading and trying, I finally end up here. :-) >> >> I really would appreciate your help - and many thanks in advance! > > Phew, haven't you set yourself up for a hostile response..? > > It's only an opinion, but I would say that the Dovecot docs are rather > helpful and thorough? Also dovecot ships with an almost working > config out of the box, really you only need to adjust a couple of > settings to achieve most setups. > > OK, reading your log files, I think this is probably the clue? > > > >> /var/log/dovecot.log >> (showing unsuccessful login) >> >> *************************************************************** >> Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop >> privileges: User is missing UID (see mail_uid setting) >> Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to >> server log for more information. >> *************************************************************** > > > I don't use that auth method so I don't want to give you a definitive > suggestion, but we can certainly use google to get some ideas: > http://lmgtfy.com/?q=dovecot+mail_uid+ > > Third link down seems to cover your question. Basically says you need > to define the setting listed above, but also why. > > > Note, I think it's easy to level critique against dovecot auth, but if > you look for a few moments longer you will see that you are probably > just criticising flexibility. You can use a very wide array of > database types to store your auth information and with that > flexibility comes the requirement to actually define your specific > choice. > > Some people run a multi-tennanted system and like to be able to run > each user under their own uid, hence that being flexible. Others want > to use LDAP or a database to store auth info (I think you can even use > both at the same time). It's even possible to use both at the same > time I believe, or to lookup users in one db, and passwords in another. > > Note, I don't know your requirements, but you might want to look at > some kind of database for your user storage if you have more than a > fairly simple installation? Either LDAP or sql is likely to give you > more flexibility than a flat file pwdb, but I don't know your > requirements, so just a thought > > Finally note that there are literally dozens of "how to install > dovecot" guides on the internet that will help you get a working setup > with various auth db choices. Once you understand the big picture > using one of those guides you will be able to customise things to a > very specific situation > > Good luck > > Ed W From robert at schetterer.org Mon Aug 6 09:30:00 2012 From: robert at schetterer.org (Robert Schetterer) Date: Mon, 06 Aug 2012 08:30:00 +0200 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> Message-ID: <501F6468.2050409@schetterer.org> Am 06.08.2012 00:47, schrieb Voytek Eymont: > > On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > >> The 'date.saved:' is the date/time that the message was moved into that >> folder. >> >> The clock for these messages is based on the time it was moved into that >> folder, NOT the date/time the message was received in the message header. >> Maybe this is what is confusing you? > >> So, if you have issue the command to remove messages older than 7 days, >> that would be 7 days *since they were moved into the folder*. > > Charles, > > thanks > > these are a user+spam spam basket, the actual messages are either in 'new' > or 'cur', depending if a particular user logged to 'spam' basket or not > > does that mean that say 7 days would clear new messages after 7 days, and, > any message that is not 'new' after 7 more days, assuming I run the > command daily ? > > all I want is an auto way to clear +spam baskets after x days > > an ugly workaround maybe is ,thing like this, if using maidir v1.0 cronjob equivalent For Dovecot v1.0, this can be accomplished by running a daily shell script: # delete 30 day old mails find /var/virtualmail/ -regex '.*/\.\(Trash\|Junk\)\(/.*\)?\/\(cur\|new\)/.*' -type f -ctime +30 -delete # or -exec rm '{}' \; instead of -delete Using ctime means that messages are deleted 30 days after they've been moved to Trash. If mtime was used instead, it would mean the message is deleted 30 days after its original creation, which could be immediately. but i recommend expire plugin, also Timos advices should work for sure -- Best Regards MfG Robert Schetterer From acrow at integrafin.co.uk Mon Aug 6 09:30:59 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Mon, 06 Aug 2012 07:30:59 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F1F75.5040906@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> Message-ID: <501F64A3.8090202@integrafin.co.uk> On 06/08/12 02:35, Peter Snow wrote: > Well you can continue to kid yourselves that the documentation is good > if you like. The facts say differently. It would be easier if you started at the correct wiki for the version you have: http://wiki2.dovecot.org/FrontPage I have always found the documentation superb. I think you must have standards to which most other can merely aspire. Alex From jtam.home at gmail.com Mon Aug 6 10:46:45 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 6 Aug 2012 00:46:45 -0700 (PDT) Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: Message-ID: Charles Marcus writes: > On 2012-08-03 6:33 PM, Voytek Eymont wrote: >> don't know, looking this morning it shows like below, the 00:05:05 is >> probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to >> see what gets removed from 'spam' box, before and after each attempt to >> expunge : >> >> date.saved: 2012-08-03 00:05:05 > > The 'date.saved:' is the date/time that the message was moved into that > folder. Perhaps this related thread starting at http://dovecot.org/list/dovecot/2012-July/067199.html and ending with the patch by Timo http://dovecot.org/list/dovecot/2012-July/067423.html may be of interest to the OP. Joseph Tam From lists at wildgooses.com Mon Aug 6 10:48:25 2012 From: lists at wildgooses.com (Ed W) Date: Mon, 06 Aug 2012 08:48:25 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F1F75.5040906@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> Message-ID: <501F76C9.2080202@wildgooses.com> On 06/08/2012 02:35, Peter Snow wrote: > Well you can continue to kid yourselves that the documentation is good > if you like. The facts say differently. For example, I visit > http://wiki.dovecot.org/MainConfig for help with the main config and > at the top of the page it tells me that this page is for version 1.x, > so I click the link to view the page for 2.x, which takes me to a page > saying that the page I want has yet to be created. I therefore have no > option but to refer to the version 1.x documentation. I copy > "mechanisms = plain" from it Google is *such* a useful tool.. http://lmgtfy.com/?q=dovecot+%22mechanisms+plain%22 > but when I restart dovecot, it fails, telling me that it is not > recognized! No, probably it says something different. Please quote the error message, not your interpretation of the error message? > I noticed that also and did indeed follow many of them. Many of them > though are for version 1.x but don't say so. There are many useful differences between 1.x and 2.x, but its a gradual evolution, not a big change. As such the configuration changed a "large amount" between 1.x and 2.x, in that it's now stored in multiple files rather than a few big files, but for your concern such a change is relatively minor and the configuration options are largely the same. > By the way, I've now got it running. It wasn't failing due to the user > being used to run the processes. It was due to misconfiguration of the > way that the virtual users were setup, which in the end I managed to > fix by interrogating a server with a working implementation (albeit > ver 1.x) which was similar to what I needed and copying parts of it's > config. Please always post details of your problem and solution - us technical folks learn from people's mistakes, but it's not possible to learn and make things better without knowing what your problem and eventual solution were? Additionally note that this is an opensource project and the documentation is written by people like yourself. Please consider clarifying whatever original document put you on the wrong track? > Although mutt now connects to it fine, roundcube doesn't, but don't > worry. I'm not planning to bother you further. Well, IMAP is just IMAP no matter which server you are using, so don't treat this as some big black box that you can't open up and inspect. IMAP is a plain text protocol and it shouldn't scare a technical person to debug things. roundcube is also an extremely flexible beast and you will need to get certain key settings correct before it connects correctly, it likely also feels very "brittle" in that there aren't that many settings to get right, but if any are wrong you will get major breakage Good luck Ed W P.S. You came here with all guns blazing and seems like you are going to leave the same way? Why not try a more softly softly approach? From ngoonee.talk at gmail.com Mon Aug 6 10:57:42 2012 From: ngoonee.talk at gmail.com (Oon-Ee Ng) Date: Mon, 6 Aug 2012 15:57:42 +0800 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F76C9.2080202@wildgooses.com> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> <501F76C9.2080202@wildgooses.com> Message-ID: On Mon, Aug 6, 2012 at 3:48 PM, Ed W wrote: > > P.S. You came here with all guns blazing and seems like you are going to > leave the same way? Why not try a more softly softly approach? Because the 'customer' has right to throw his weight around =). Especially after paying such a large amount of money for the product..... From rafinathan25 at gmail.com Mon Aug 6 11:09:51 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Mon, 6 Aug 2012 13:39:51 +0530 Subject: [Dovecot] find virtual users Message-ID: Hi, Can sendmail find virtual users in /etc/dovecot/passwd ? If yes, what are the necesary changes I have to make ? Urgent help needed. Thanks in advance. Regards, Rafael From lists at wildgooses.com Mon Aug 6 11:49:19 2012 From: lists at wildgooses.com (Ed W) Date: Mon, 06 Aug 2012 09:49:19 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> <501F76C9.2080202@wildgooses.com> Message-ID: <501F850F.2090306@wildgooses.com> On 06/08/2012 08:57, Oon-Ee Ng wrote: > On Mon, Aug 6, 2012 at 3:48 PM, Ed W wrote: >> P.S. You came here with all guns blazing and seems like you are going to >> leave the same way? Why not try a more softly softly approach? > Because the 'customer' has right to throw his weight around =). > Especially after paying such a large amount of money for the > product..... Lets and avoid chasing folks away. Ed From CMarcus at Media-Brokers.com Mon Aug 6 14:09:10 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 06 Aug 2012 07:09:10 -0400 Subject: [Dovecot] find virtual users In-Reply-To: References: Message-ID: <501FA5D6.1040000@Media-Brokers.com> On 2012-08-06 4:09 AM, Rafael Nathan wrote: > Hi, > > Can sendmail find virtual users in /etc/dovecot/passwd ? > If yes, what are the necesary changes I have to make ? > > Urgent help needed. Thanks in advance. This is the dovecot support list. For sendmail support, you should seek an appropriate venue... -- Best regards, Charles From andrzej.filip at gmail.com Mon Aug 6 21:33:27 2012 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Mon, 06 Aug 2012 20:33:27 +0200 Subject: [Dovecot] find virtual users [sendmail] In-Reply-To: References: Message-ID: <50200DF7.9060000@gmail.com> On 08/06/2012 10:09 AM, Rafael Nathan wrote: > Can sendmail find virtual users in /etc/dovecot/passwd ? > If yes, what are the necesary changes I have to make ? > > Urgent help needed. Thanks in advance. Sendmail/sendmail.cf can do lookups in passwd like files => It should be possible to check recipient existence before "RCPT TO:" reply. SMTP AUTH is another story. There are a few+ ways to integrate sendmail and dovecot. Which one do you use? From mikeg at rockisland.com Mon Aug 6 21:34:22 2012 From: mikeg at rockisland.com (Mike Greene) Date: Mon, 6 Aug 2012 18:34:22 +0000 Subject: [Dovecot] redirect actions exceeds policy limit Message-ID: <07A08B628EAA1D4F8ADAE2C68D980A9F019B50@mercury.office.rockisland.com> Hello, We have a vacation/mail forwarder plugin in squirrel mail that allows customers to forward email. It has come to my attention that there is a limit (appears to be 5) on the number of addresses that can be specified. I'm now trying to track down where this policy limit is set. This is the error we see in the customers .dovecot.sieve.log file: main_script: line 26: error: number of redirect actions exceeds policy limit. sieve: info: started log at Jul 25 07:02:54. I checked the following for possible settings: /usr/local/etc/dovecot/dovecot.conf /usr/local/etc/sieve/dovecot.sieve /usr/local/etc/sieve/global.sieve I didn't see anything specific to limiting the number of redirects. I'm wondering where else I can look to find where this limit is coming from and adjust it upwards. We are using the following dovecot / pigeonhole versions. dovecot-2.0.7 dovecot-pigeonhole-0.2.1 athena# dovecot -n # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.1-RELEASE amd64 auth_default_realm = rockisland.com auth_mechanisms = plain login cram-md5 auth_username_format = %Lu disable_plaintext_auth = no dotlock_use_excl = yes first_valid_gid = 1000 first_valid_uid = 1000 listen = * mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { quota = maildir quota_rule = *:storage=2G quota_warning = storage=90%% /usr/local/sbin/quota-warning.sh 90 quota_warning2 = storage=80%% /usr/local/sbin/quota-warning.sh 80 sieve = ~/.dovecot.sieve sieve_dir = ~/ sieve_global_dir = /usr/local/etc/sieve/ } protocols = imap pop3 service auth { unix_listener auth-client { mode = 0660 } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service imap-login { service_count = 0 } service pop3-login { service_count = 0 } ssl_cert = References: <07A08B628EAA1D4F8ADAE2C68D980A9F019B50@mercury.office.rockisland.com> Message-ID: In conf.d/90-sieve.conf we have: # The maximum number of redirect actions that can be performed during # a single script execution. #sieve_max_redirects = 4 sieve_max_redirects = 25 I think that's the setting you're looking for. -David Warden On 2012-08-06 14:34, Mike Greene wrote: > Hello, We have a vacation/mail forwarder plugin in squirrel mail that allows customers to forward email. It has come to my attention that there is a limit (appears to be 5) on the number of addresses that can be specified. I'm now trying to track down where this policy limit is set. > > This is the error we see in the customers .dovecot.sieve.log file: > > main_script: line 26: error: number of redirect actions exceeds policy limit. > sieve: info: started log at Jul 25 07:02:54. > > I checked the following for possible settings: > > /usr/local/etc/dovecot/dovecot.conf > /usr/local/etc/sieve/dovecot.sieve > /usr/local/etc/sieve/global.sieve > > I didn't see anything specific to limiting the number of redirects. I'm wondering where else I can look to find where this limit is coming from and adjust it upwards. > > We are using the following dovecot / pigeonhole versions. > > dovecot-2.0.7 > dovecot-pigeonhole-0.2.1 > > athena# dovecot -n > # 2.0.7: /usr/local/etc/dovecot/dovecot.conf > # OS: FreeBSD 8.1-RELEASE amd64 > auth_default_realm = rockisland.com > auth_mechanisms = plain login cram-md5 > auth_username_format = %Lu > disable_plaintext_auth = no > dotlock_use_excl = yes > first_valid_gid = 1000 > first_valid_uid = 1000 > listen = * > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_privileged_group = mail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date > passdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > plugin { > quota = maildir > quota_rule = *:storage=2G > quota_warning = storage=90%% /usr/local/sbin/quota-warning.sh 90 > quota_warning2 = storage=80%% /usr/local/sbin/quota-warning.sh 80 > sieve = ~/.dovecot.sieve > sieve_dir = ~/ > sieve_global_dir = /usr/local/etc/sieve/ > } > protocols = imap pop3 > service auth { > unix_listener auth-client { > mode = 0660 > } > unix_listener auth-master { > group = vmail > mode = 0600 > user = vmail > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > user = root > } > service imap-login { > service_count = 0 > } > service pop3-login { > service_count = 0 > } > ssl_cert = ssl_key = userdb { > driver = prefetch > } > userdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > verbose_proctitle = yes > protocol imap { > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep > mail_plugins = quota imap_quota > } > protocol pop3 { > mail_plugins = quota > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } > protocol lda { > auth_socket_path = /var/run/dovecot/auth-master > info_log_path = > lda_mailbox_autocreate = no > lda_mailbox_autosubscribe = yes > log_path = > mail_plugins = quota sieve > postmaster_address = postmaster at rockisland.com > sendmail_path = /usr/sbin/sendmail > } > > Mike Greene > Rock Island Technology Solutions, Inc. > San Juan Islands, WA. 360-378-5884 x201 From chris.visser at rtt.co.za Tue Aug 7 10:03:53 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 7 Aug 2012 07:03:53 +0000 Subject: [Dovecot] LDAP auth with AD Message-ID: <1B5F61B24A54E54397345A133BD0A48D07D73EEA@RTTGMBX02.thefuelgroup.com> Hi, I'm struggling to setup LDAP authentication with dovecot against an AD server. When I attempt to bind using the same DN I use to do address lookups in exim and to do searches using ldap search on the command line I get the following in my logs: Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: auth client connected (pid=1523) Aug 7 08:55:58 mail-dev dovecot: auth: Error: LDAP: binding failed (dn CN=Linux Sync,CN=Users,DC=RTT,DC=co,DC=za): Invalid credentials, 80090308: LdapErr: DSID-0C0903A9, comment: AcceptSecurityContext error, data 52e, v1db1? I'm running CentOS 6 and connect to a Windows 2008 R2 domain. The output from dovecot -n: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_verbose = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } ssl_cert = Hello, i have a user who is able to do pop3 on port 110 without problems and without limits. There are ~10 real users using same public IP. When switching to port 995 to use pop3s he is limited at connection count. Some people can reach pop3s-server successful, some getting a timeout. I cant find any errors or limits within my config or in my log, there are no differences between using plain text and using tls. Are there some special loglines to grep for at this situation? Maybe i missed some lines... At the moment i dont see server-side problems. Somebody knows some typical clientside problems when this problem occurs? dovecot version is 1.2.11 Thanks, Hajo From robert at schetterer.org Tue Aug 7 10:32:37 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 07 Aug 2012 09:32:37 +0200 Subject: [Dovecot] connectionlimit for pop3s? In-Reply-To: <6FB9BD6F1FC54ADEB52F690E1321ADCA@ai.local> References: <6FB9BD6F1FC54ADEB52F690E1321ADCA@ai.local> Message-ID: <5020C495.5010309@schetterer.org> Am 07.08.2012 09:19, schrieb Hajo Locke: > Hello, > > i have a user who is able to do pop3 on port 110 without problems and without limits. There are ~10 real users using same public IP. > When switching to port 995 to use pop3s he is limited at connection count. Some people can reach pop3s-server successful, some getting a timeout. > I cant find any errors or limits within my config or in my log, there are no differences between using plain text and using tls. > Are there some special loglines to grep for at this situation? Maybe i missed some lines... > At the moment i dont see server-side problems. Somebody knows some typical clientside problems when this problem occurs? > > dovecot version is 1.2.11 > > Thanks, > Hajo > any firewalls involved , some ugly ones have problems with tls ? -- Best Regards MfG Robert Schetterer From stsiol at yahoo.co.uk Tue Aug 7 12:40:34 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Tue, 7 Aug 2012 10:40:34 +0100 (BST) Subject: [Dovecot] error message. Some help please Message-ID: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> Hello all : dovecot -n : # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3 base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-info.log ssl_parameters_regenerate: 48 verbose_ssl: yes login_dir: /var/run/dovecot//login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login login_greeting: * Dovecot ready * login_max_processes_count: 64 mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir mail_plugins: zlib auth default: ? verbose: yes ? debug: yes ? debug_passwords: yes ? passdb: ??? driver: passwd-file ??? args: /etc/dovecot/passwd ? passdb: ??? driver: pam ? userdb: ??? driver: static ??? args: uid=vmail gid=vmail home=/home/vmail/%u ? userdb: ??? driver: passwd From the logs : tail -100 /var/log/dovecot/dovecot | more : ......... Jul 06 13:51:20 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count Jul 18 15:20:32 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count Jul 19 09:16:40 dovecot: Warning: Killed with signal 15 (by pid=3062 uid=0 code=kill) ......... Should I just go ahead and increase login_max_processes_count ? Is it that simple ? Just asking for your feedback and experience chaps. Thank you in advance, Spyros ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From Wiethoff at tfh-bochum.de Tue Aug 7 13:30:15 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Tue, 7 Aug 2012 10:30:15 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue Message-ID: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> Hello everybody, i have a problem with dovecot+Active Directory as Authentication-Service. I am not able to use special characters (???? (german umlaut)) within a password. Normally I would suggest that the ldap-query is done in UTF-8 but as I debugged the auth-process, I have seen that the password is ISO-8859-1 encoded. The "original" query (from roundcube for example) is UTF-8 encoded (I dumped the POST-Query). So far I wasn't able to find my error by myself or by searching the web. Maybe someone of you can give me a hint :-) Thanks and greetings from Germany, Helge ---- dovecot --version 2.0.16 ---- D-AS01:/etc/dovecot # grep -v '^ *\(#.*\)\?$' dovecot-ldap.conf.ext uris = ldap://10.37.5.90 dn = CN=ldap-d-as01,CN=Users,DC=tfh-bochum,DC=de dnpass = xxxx auth_bind = yes ldap_version = 3 base = ou=Benutzer, ou=Lehre, dc=tfh-bochum, dc=de user_attrs = =uid=10000,=gid=10000,=home=/srv/mail/%Ld/%Ln user_filter = mail=%u pass_attrs = =uid=10000,=gid=10000,=home=/srv/mail/%Ld/%Ln pass_filter = (&(mail=%u)(!(extensionAttribute3=*))) ---- dovecot -n # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.37.6-0.11-default x86_64 openSUSE 11.4 (x86_64) auth_debug = yes auth_mechanisms = plain login auth_username_translation = %Lu auth_verbose = yes mail_location = maildir:~/Maildir mail_max_userip_connections = 1000 mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes list = yes location = prefix = INBOX/ separator = / subscriptions = yes type = private } namespace { list = yes location = maildir:%%h/Maildir:INDEX=%h/Maildir/shared/%%u:CONTROL=%h/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/srv/mail/shared-mailboxes quota = maildir:Quota quota_rule = *:storage=1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 10 } protocols = imap pop3 sieve lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0770 user = root } } service imap-login { process_min_avail = 4 service_count = 0 } service managesieve-login { inet_listener sieve { address = * port = 4190 } inet_listener sieve_deprecated { address = * port = 2000 } process_min_avail = 2 service_count = 0 } ssl_ca = References: <501BB65A.2090601@corefiling.co.uk> <501C1234.20504@rename-it.nl> Message-ID: <5020F52B.9060005@corefiling.co.uk> On 03/08/12 19:02, Stephan Bosch wrote: > On 8/3/2012 1:30 PM, Daniel Piddock wrote: >> Hi, >> >> We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian >> Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. >> >> We provide a selection of global sieve scripts to make users' lives >> easier and one noticed that some of these have stopped working. I >> tracked it down to them having personal scripts with the same name. >> >> Using a really simple sieve script: > > Nice bug report. > >> As can be seen the personal script is included twice. Obvious work >> around is to rename the personal script. However it'd be nice if >> namespacing came back. > > This should fix it: > > http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/6a34eda7924e > > I also extended the test suite to prevent this situation from > occurring again, for file-based scripts anyway. Hi Stephan, Thank you for the quick patch! Fixes the problem perfectly. Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From tonio at starbridge.org Tue Aug 7 14:47:50 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 13:47:50 +0200 Subject: [Dovecot] pop3 proxying error Message-ID: <50210066.8040205@starbridge.org> Hi Timo, I've got some errors with pop3 proxying and dovecot 2.1.9 I's occured on the proxy side: Aug 7 13:16:47 dev1 dovecot: pop3-login: Fatal: master: service(pop3-login): child 23046 killed with signal 11 (core dumped) Server side shows no error, and runs the same dovecot version. Thanks for your help. Best regards Tonio Buonaguidi Core dump: GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/pop3-login...done. [New LWP 23046] warning: Can't read pathname for load map: Erreur d'entr?e/sortie. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". Core was generated by `dovecot/pop3-login -D'. Program terminated with signal 11, Segmentation fault. #0 settings_parser_dup (old_ctx=0x8783480, new_pool=0x632e6465) at settings-parser.c:1742 1742 pool_ref(new_pool); doveconf -n # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.2-xxxx-std-ipv6-32 i686 Debian wheezy/sid auth_cache_size = 4 k auth_mechanisms = plain login director_mail_servers = bb.bb.bb.bb cc.cc.cc.cc director_servers = dd.dd.dd.dd aa.aa.aa.aa log_timestamp = %Y-%m-%d %H:%M:%S mail_debug = yes managesieve_notify_capability = mailto managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date spamtest spamtestplus virustest passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0660 user = postfix } unix_listener auth-master { mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0660 user = vmail } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = aa.aa.aa.aa port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 143 } inet_listener imaps { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 993 } process_limit = 256 process_min_avail = 2 service_count = 0 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 4190 } vsz_limit = 64 M } service pop3-login { executable = pop3-login -D inet_listener pop3 { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 110 } inet_listener pop3s { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 995 } service_count = 0 } ssl_ca = good day! I wonder if it is possible to make a chain of replication in dovecot 2.1.9. Now I'm using two way replication(I use proxy to redirect users) and it's working just fine but is it possible to setup replication like this: serverA ---> serverB --> server C <--- I've added additional mail_replica2 on serverB and after restart dovecot didn't complain about errors, with doveconf -n I am able to see two replica's settings but user's mails aren't replicating to server C. no errors in logs. I want to use server C as backup server with lvm snapshots. From Jost.Krieger+dovecot at rub.de Tue Aug 7 15:43:08 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 7 Aug 2012 14:43:08 +0200 Subject: [Dovecot] For the wishlist Message-ID: <20120807124305.GA13644@ruhr-uni-bochum.de> I would like very much to have a "doveadm copy", which probably could be made out of "doveadm move" by removing ca. 2 lines (and changing a few strings from "move" to "copy"). This would make it a lot easier to script quite a few things without using a real imap client. I can run around this by doing an import followed by a move but this will duplicate the mails (even when using mdbox). Mit freundlichen Gr??en Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From tonio at starbridge.org Tue Aug 7 15:54:05 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 14:54:05 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50210066.8040205@starbridge.org> References: <50210066.8040205@starbridge.org> Message-ID: <50210FED.5020508@starbridge.org> Le 07/08/2012 13:47, tonio at starbridge.org a ?crit : > > Hi Timo, > I've got some errors with pop3 proxying and dovecot 2.1.9 > > I's occured on the proxy side: > > Aug 7 13:16:47 dev1 dovecot: pop3-login: Fatal: master: > service(pop3-login): child 23046 killed with signal 11 (core dumped) > > Server side shows no error, and runs the same dovecot version. > > Thanks for your help. > Best regards > Tonio Buonaguidi > > Core dump: > > > GNU gdb (GDB) 7.4.1-debian > Copyright (C) 2012 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show > copying" > and "show warranty" for details. > This GDB was configured as "i486-linux-gnu". > For bug reporting instructions, please see: > ... > Reading symbols from /usr/lib/dovecot/pop3-login...done. > [New LWP 23046] > > warning: Can't read pathname for load map: Erreur d'entr?e/sortie. > [Thread debugging using libthread_db enabled] > Using host libthread_db library > "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". > Core was generated by `dovecot/pop3-login -D'. > Program terminated with signal 11, Segmentation fault. > #0 settings_parser_dup (old_ctx=0x8783480, new_pool=0x632e6465) at > settings-parser.c:1742 > 1742 pool_ref(new_pool); > > sorry I've forgot bt full ! (gdb) bt full #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 new_ctx = iter = new_link = links = key = value = i = parser_pool = __FUNCTION__ = "settings_parser_dup" #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) at master-service-settings-cache.c:221 entry = 0xe98b90 pool = 0xe98b70 pool_size = entry_local_name = 0xe98b90 "pop.te.com" #2 master_service_settings_cache_read (cache=0x60ea50, input=, dyn_parsers=, parser_r=0x7ffffe4558b8, error_r=) at master-service-settings-cache.c:297 output = {specific_services = 0x0, service_uses_local = 1, service_uses_remote = 0, used_local = 1, used_remote = 0} new_input = {roots = 0x604500, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x403640 "pop3-login", service = 0x40363b "pop3", username = 0x0, local_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = ".iHb", '\000' , __u6_addr16 = {26926, 25160, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1648912686, 0, 0, 0}}}, ip4 = {s_addr = 1648912686}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = "ZT\220]", '\000' , __u6_addr16 = {21594, 23952, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1569739866, 0, 0, 0}}}, ip4 = {s_addr = 1569739866}}}, local_name = 0x9fa1d0 "pop.te.com"} set = __FUNCTION__ = "master_service_settings_cache_read" #3 0x00007fc7a7a25a1b in login_settings_read (pool=0xbc54e0, local_ip=, remote_ip=, local_name=, other_settings_r=0x7ffffe455908) at login-settings.c:226 input = {roots = 0x604500, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x403640 "pop3-login", service = 0x40363b "pop3", username = 0x0, local_ip = {family = 2, u = {ip6 = { ---Type to continue, or q to quit--- __in6_u = {__u6_addr8 = ".iHb", '\000' , __u6_addr16 = {26926, 25160, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1648912686, 0, 0, 0}}}, ip4 = {s_addr = 1648912686}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = "ZT\220]", '\000' , __u6_addr16 = {21594, 23952, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1569739866, 0, 0, 0}}}, ip4 = {s_addr = 1569739866}}}, local_name = 0x9fa1d0 "pop.te.com"} error = parser = cache_sets = sets = i = count = __FUNCTION__ = "login_settings_read" #4 0x00007fc7a7a28278 in ssl_servername_callback (ssl=0xa0d6e0, al=, context=) at ssl-proxy-openssl.c:1144 ctx = proxy = client = 0xe95b98 host = other_sets = 0x0 #5 0x00007fc7a71c6162 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #6 0x00007fc7a71b2205 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #7 0x00007fc7a71b68c5 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #8 0x00007fc7a71c3103 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #9 0x00007fc7a7a289b9 in ssl_handshake (proxy=0xa185e0) at ssl-proxy-openssl.c:465 ret = #10 ssl_step (proxy=0xa185e0) at ssl-proxy-openssl.c:528 No locals. #11 0x00007fc7a77d6566 in io_loop_call_io (io=0xa15080) at ioloop.c:379 ioloop = 0x60d6e0 t_id = 2 #12 0x00007fc7a77d7237 in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0x9e6470 events = 0x0 event = 0x9e8030 list = 0x9f8ae0 io = tv = {tv_sec = 179, tv_usec = 999811} msecs = ret = 1 i = call = #13 0x00007fc7a77d5f78 in io_loop_run (ioloop=0x60d6e0) at ioloop.c:398 No locals. #14 0x00007fc7a77c1ee3 in master_service_run (service=0x60d590, callback=) at master-service.c:543 No locals. #15 0x00007fc7a7a266be in login_binary_run (binary=, argc=2, argv=0x60d370) at main.c:406 set_pool = 0x60da20 allow_core_dumps = login_socket = c = #16 0x00007fc7a7419ead in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #17 0x0000000000401fd9 in _start () No symbol table info available. From tss at iki.fi Tue Aug 7 17:57:43 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 7 Aug 2012 17:57:43 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50210FED.5020508@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> Message-ID: <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> On 7.8.2012, at 15.54, tonio at starbridge.org wrote: > #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 > new_ctx = > iter = > new_link = > links = > key = > value = > i = > parser_pool = > __FUNCTION__ = "settings_parser_dup" > #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) > at master-service-settings-cache.c:221 > entry = 0xe98b90 > pool = 0xe98b70 > pool_size = > entry_local_name = 0xe98b90 "pop.te.com" I guess nobody had tried to run Dovecot with many local / remote {} blocks previously. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/2815175a0ffc From tonio at starbridge.org Tue Aug 7 18:16:58 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 17:16:58 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> Message-ID: <5021316A.4020105@starbridge.org> Le 07/08/2012 16:57, Timo Sirainen a ?crit : > On 7.8.2012, at 15.54, tonio at starbridge.org wrote: > >> #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 >> new_ctx = >> iter = >> new_link = >> links = >> key = >> value = >> i = >> parser_pool = >> __FUNCTION__ = "settings_parser_dup" >> #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) >> at master-service-settings-cache.c:221 >> entry = 0xe98b90 >> pool = 0xe98b70 >> pool_size = >> entry_local_name = 0xe98b90 "pop.te.com" > I guess nobody had tried to run Dovecot with many local / remote {} blocks previously. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/2815175a0ffc > Thanks Timo I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? Thanks again for your work ! Regards Tonio From kavish.karkera at yahoo.com Tue Aug 7 18:17:43 2012 From: kavish.karkera at yahoo.com (Kavish Karkera) Date: Tue, 7 Aug 2012 23:17:43 +0800 (SGT) Subject: [Dovecot] Dovecot with Company - level Quota Message-ID: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> Hi Timo, We are using maildir as quota-backend , and performing user level quota, which is working fine.? (using dovecot 2.x ). Now the requirement is to , restrict the quota to client / company level along with user level quota. ?For. eg. We have a mailbox path like /mail/mailstore/10001/kavish.karkera at linoquery.com/Maildir/ where 10001 is Client code (unique number given to very client) instead of domain name. So there would be two quota's one at company level and other user level. Such as 10001(linoquery.com) = 5GB ---> Company Quota kavish.karkera at linoquery.com = 0 ? ---> User Quota If the sum of the user quota under 10001/*? exceeds the 5GB limit then the mails for that particular domain should get bounced. Please Help , if this is possible. Regards, Kavish Karkera From tss at iki.fi Tue Aug 7 18:21:12 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 7 Aug 2012 18:21:12 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <5021316A.4020105@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> Message-ID: On 7.8.2012, at 18.16, tonio at starbridge.org wrote: > I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? Not a bad thing, but it uses up somewhat more memory. From hmoreno at gmv.com Tue Aug 7 18:40:59 2012 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Tue, 7 Aug 2012 15:40:59 +0000 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> References: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> Message-ID: Hello everybody, We have the same problem with the vacation response. Why dovecot leaves the from empty? Does it something to do with this NULL field? src/deliver/mail-send.c: smtp_client = smtp_client_open(return_addr, NULL, &f); We have tried changing that line for this one, with no success: src/deliver/mail-send.c: smtp_client = smtp_client_open(return_addr, src->fromaddr, &f); We also have tried different versions of dovecot an pigeonhole, but the error persists. Any help would be much appreciated. Thank you very much in advanced. Kind regards- H?ctor Moreno Blanco Divisi?n de Seguridad e Infraestructuras / Security and Infrastructures Division GMV Isaac Newton, 11 P.T.M. Tres Cantos E-28760 Madrid Tel. +34 91 807 21 00 Fax +34 91 807 21 99 www.gmv.com ? ? ? -----Mensaje original----- De: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] En nombre de asier.cidon at externo.uam.es Enviado el: lunes, 30 de julio de 2012 9:06 Para: dovecot at dovecot.org Asunto: [Dovecot] sieve vacation messages trouble FROM:mailman-bounces at dovecot.org DATE:27. hein?kuuta 2012 16.58.35 UTC+3.00 TO:dovecot-owner at dovecot.org SUBJECT:CONTENT FILTERED MESSAGE NOTIFICATION The attached message matched the dovecot mailing list's content filtering rules and was prevented from being forwarded on to the list membership. ?You are receiving the only remaining copy of the discarded message. FROM:Asier Cidon Peria?ez DATE:27. hein?kuuta 2012 16.01.59 UTC+3.00 TO:dovecot at dovecot.org SUBJECT:RE: [DOVECOT] SIEVE VACATION MESSAGES TROUBLE Hi, I have a problem when I define a? Filter SIEVE vacation with Horde, Qmail and Dovecot. When I sent the message vacation for domains external, the log of postfix show <"<>"@mymachine>. I am writing you because I saw the post http://www.dovecot.org/list/dovecot/2009-June/040811.html Can you explain me whqt is the solution? Many Thanks. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From admin at sagredo.eu Tue Aug 7 19:20:39 2012 From: admin at sagredo.eu (Roberto Puzzanghera) Date: Tue, 07 Aug 2012 18:20:39 +0200 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> References: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> Message-ID: <7ed42f758c282216bb4ac454314acb8a@sagredo.eu> Il 30.07.2012 09:06 asier.cidon at externo.uam.es ha scritto: > FROM:mailman-bounces at dovecot.org > DATE:27. hein?kuuta 2012 16.58.35 UTC+3.00 > TO:dovecot-owner at dovecot.org > SUBJECT:CONTENT FILTERED MESSAGE NOTIFICATION > > The attached message matched the dovecot mailing list's content > filtering rules and was prevented from being forwarded on to the list > membership. ?You are receiving the only remaining copy of the > discarded message. > > FROM:Asier Cidon Peria?ez > DATE:27. hein?kuuta 2012 16.01.59 UTC+3.00 > TO:dovecot at dovecot.org > SUBJECT:RE: [DOVECOT] SIEVE VACATION MESSAGES TROUBLE > > Hi, > > I have a problem when I define a? Filter SIEVE vacation with Horde, > Qmail > and Dovecot. > > When I sent the message vacation for domains external, the log of > postfix > show <"<>"@mymachine>. > > I am writing you because I saw the post > http://www.dovecot.org/list/dovecot/2009-June/040811.html > > Can you explain me whqt is the solution? > > Many Thanks. Hi, this is a qmail-inject issue. You have to patch qmail-inject. See here for more info http://notes.sagredo.eu/node/133 regards Roberto From mikeg at rockisland.com Tue Aug 7 19:32:12 2012 From: mikeg at rockisland.com (Mike Greene) Date: Tue, 7 Aug 2012 16:32:12 +0000 Subject: [Dovecot] redirect actions exceeds policy limit In-Reply-To: References: Message-ID: <07A08B628EAA1D4F8ADAE2C68D980A9F01A74D@mercury.office.rockisland.com> Thank you David, I saw that in the share/docs but we didn't have the /conf.d/ folder or any of the extra conf files in place. I created that directory, copied the file over, made my changes and all is well again. Not sure why things were setup the way they were, after looking at the other files in conf.d it would appear the previous sysadmin had merged a lot of those bits and pieces into the main dovecot.conf file. Perhaps leftovers from v1.x days. Will likely address that down the road when we update that server. Mike Greene Rock Island Technology Solutions, Inc. San Juan Islands, WA. 360-378-5884 x201 > -----Original Message----- > > Date: Mon, 06 Aug 2012 14:46:22 -0400 > From: David Webmailbeta Warden > To: > Subject: Re: [Dovecot] redirect actions exceeds policy limit > Message-ID: > Content-Type: text/plain; charset="utf-8" > > > > In conf.d/90-sieve.conf we have: > > # The maximum number of redirect > actions that can be performed during > # a single script execution. > > #sieve_max_redirects = 4 > sieve_max_redirects = 25 > > I think that's the > setting you're looking for. > > -David Warden From voytek at sbt.net.au Wed Aug 8 00:06:52 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Wed, 8 Aug 2012 07:06:52 +1000 Subject: [Dovecot] how to duplicate users emails to allow deleted recovery? Message-ID: <7865bbafeaadafa7c712b61d4022c029.squirrel@geko.sbt.net.au> I have a situation where a user deleted emails using iphone, then, wants he sees messages are gone from desktop client, wants them recovered from server, happened several times now is there a way to have all deletes to go to server trash for potential recovery ? off topic: is there a way on iphone to force deletions to server's trash is there a way to have dovecot duplicate all emails to say user_backup at dom.tld mail box ? or should I duplicate emails in postfix ? using dovecot 2 with lmpt and virtual domains thanks -- Voytek From tss at iki.fi Wed Aug 8 00:45:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 08 Aug 2012 00:45:38 +0300 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <501CCB1C.80908@zu-con.org> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> <501CCB1C.80908@zu-con.org> Message-ID: <1344375938.19913.85.camel@hurina> On Sat, 2012-08-04 at 09:11 +0200, Matthias Rieber wrote: > >> I've deleted 10000s emails and it seems that every mail is removed with > >> a single request from Solrs index. This works, but it's quite slow. Is > >> it possible/plans to improve that? > > > > Could you try if the attached patch works? It compiles, but didn't test it. > > it segfaults: This should work: http://hg.dovecot.org/dovecot-2.1/rev/82f59d2139a9 From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 8 01:22:26 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 8 Aug 2012 00:22:26 +0200 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> Message-ID: <20120807222226.GA8406@daniel.localdomain> Wiethoff, Helge wrote: > Hello everybody, > > i have a problem with dovecot+Active Directory as Authentication-Service. I am not able to use special characters (???? (german umlaut)) within a password. Normally I would suggest that the ldap-query is done in UTF-8 but as I debugged the auth-process, I have seen that the password is ISO-8859-1 encoded. > The "original" query (from roundcube for example) is UTF-8 encoded (I dumped the POST-Query). > So far I wasn't able to find my error by myself or by searching the web. Maybe someone of you can give me a hint :-) > > Thanks and greetings from Germany, > Helge Hello Helge, In order to make it work with LDAP, the password transmitted over the IMAP connection needs to be encoded with the same character set as the password used to generate the hash. IMAP does not specify how the mail client should encode the password during the login process. So some older clients use Latin1 and some newer use UTF-8. Probably you are interested in reading the discussion from 2008: http://www.dovecot.org/list/dovecot/2008-November/035263.html Possibly you could reencode your passwords with some IMAP proxy like nginx and the mail and mail_auth modules and detect german umlauts, but such a setup will quickly get complex. I think, a simple and robust solution would be to limit the allowed characters for user passwords in your password management system to 7-bit ASCII characters (only) and reset passwords of all users having any login problems. Greetings, Daniel -- https://plus.google.com/103021802792276734820 From jtam.home at gmail.com Wed Aug 8 01:55:59 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 7 Aug 2012 15:55:59 -0700 (PDT) Subject: [Dovecot] connectionlimit for pop3s? In-Reply-To: References: Message-ID: On Tue, 7 Aug 2012, dovecot-request at dovecot.org wrote: > When switching to port 995 to use pop3s he is limited at connection > count. Some people can reach pop3s-server successful, some getting a > timeout. > ... > Somebody knows some typical clientside problems when this problem > occurs? Do the same user(s) have this problem and/or do each user have their own mail configuration for their mail readers? If yes, I would also check that the port and security protocol matches (i.e. clear/TLS/SSL on ports 110/110/995 respectively). Mismatched configurations could cause what you describe. Log messages could also be helpful here. Joseph Tam From tonio at starbridge.org Wed Aug 8 09:42:06 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Wed, 08 Aug 2012 08:42:06 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> Message-ID: <50220A3E.407@starbridge.org> Le 07/08/2012 17:21, Timo Sirainen a ?crit : > On 7.8.2012, at 18.16, tonio at starbridge.org wrote: > >> I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? > Not a bad thing, but it uses up somewhat more memory. > Timo, I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) Director is configured in my dovecot.conf, but I dont use it here. Proxying is made by sql request with static host. (gdb) bt full #0 0xffffe424 in __kernel_vsyscall () No symbol table info available. #1 0xb760d941 in raise () from /lib/i386-linux-gnu/i686/cmov/libc.so.6 No symbol table info available. #2 0xb7610d72 in abort () from /lib/i386-linux-gnu/i686/cmov/libc.so.6 No symbol table info available. #3 0xb77912c0 in default_fatal_finish (type=, status=status at entry=0) at failures.c:191 backtrace = 0xb77de600 "<$\t" #4 0xb7791321 in i_internal_fatal_handler (ctx=0xbfd20944, format=0xb77bd4de "key not found from hash", args=0xbfd20964 "\204\n??Hv\005\b?ey?Wb?m\230v\005\b?\232x?") at failures.c:649 status = 0 #5 0xb7760edd in i_panic ( format=format at entry=0xb77bd4de "key not found from hash") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = 0xbfd20964 "\204\n??Hv\005\b?ey?Wb?m\230v\005\b?\232x?" #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) at hash.c:317 node = hash = 1839751767 #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) at master-service-settings-cache.c:167 No locals. #8 cache_add (parser=0x8b2f388, output=0xbfd209c0, input=0xbfd209c8, cache=0x8057648) at master-service-settings-cache.c:203 entry = pool = 0x8833fc0 pool_size = entry_local_name = #9 master_service_settings_cache_read (cache=0x8057648, input=input at entry=0xbfd20a68, dyn_parsers=dyn_parsers at entry=0x0, parser_r=parser_r at entry=0xbfd20a64, error_r=error_r at entry=0xbfd20a60) at master-service-settings-cache.c:297 output = {specific_services = 0x0, service_uses_local = 1, service_uses_remote = 0, used_local = 1, used_remote = 0} new_input = {roots = 0x804dba0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x804bc38 "imap-login", service = 0x804bc33 "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = {25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = { s_addr = 1839751767}}}, remote_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, local_name = 0x0} set = __FUNCTION__ = "master_service_settings_cache_read" #10 0xb77ef48d in login_settings_read (pool=0x9801dc8, local_ip=local_ip at entry=0xbfd20b1c, remote_ip=remote_ip at entry=0xbfd20b84, local_name=local_name at entry=0x0, other_settings_r=other_settings_r at entry=0xbfd20b18) at login-settings.c:226 input = {roots = 0x804dba0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x804bc38 "imap-login", service = 0x804bc33 "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = {25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = { s_addr = 1839751767}}}, remote_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, local_name = 0x0} error = parser = cache_sets = sets = i = count = __FUNCTION__ = "login_settings_read" #11 0xb77ef833 in client_connected_finish (conn=0xbfd20b78) at main.c:119 client = proxy = local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = { 25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = {s_addr = 1839751767}}} set = local_port = 993 pool = 0x9801dc8 fd_ssl = other_sets = #12 0xb778929c in master_service_listen (l=0x834d308) at master-service.c:803 service = 0x8056398 conn = {fd = 155, listen_fd = 11, name = 0x8056585 "imaps", remote_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, remote_port = 55451, fifo = 0, ssl = 1, accepted = 1} #13 0xb77a0054 in io_loop_call_io (io=0x834d438) at ioloop.c:379 ioloop = 0x8056468 t_id = 2 #14 0xb77a0ebe in io_loop_handler_run (ioloop=ioloop at entry=0x8056468) at ioloop-epoll.c:213 ctx = 0x834c488 events = 0x0 event = 0x96af618 list = 0x834d468 io = tv = {tv_sec = 45, tv_usec = 831525} events_count = 0 msecs = ret = 1 i = j = call = #15 0xb779f9f0 in io_loop_run (ioloop=0x8056468) at ioloop.c:398 No locals. #16 0xb7788aae in master_service_run (service=0x8056398, callback=callback at entry=0xb77efb60 ) at master-service.c:543 No locals. #17 0xb77f0300 in login_binary_run (binary=0x804bec0, argc=argc at entry=3, argv=0x80561c0, argv at entry=0xbfd20e14) at main.c:406 set_pool = 0x8056630 allow_core_dumps = login_socket = 0x80561e6 "director" c = #18 0x08049b63 in main (argc=3, argv=0xbfd20e14) at client.c:530 No locals. From Juergen.Obermann at hrz.uni-giessen.de Wed Aug 8 09:55:05 2012 From: Juergen.Obermann at hrz.uni-giessen.de (=?UTF-8?Q?J=C3=BCrgen_Obermann?=) Date: Wed, 08 Aug 2012 08:55:05 +0200 Subject: [Dovecot] doveadm import is always verbose Message-ID: Hello, with dovecot versions up to 2.1.9, when I use: doveadm import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all it always sends out info messages for every mail copied like that: doveadm(guser): Info: copy from mymail: box=restore_2012-05-08/mymail, uid=5, msgid=<######>, size=6999462 I had expected to see these info messages only if I add the verbose option to doveadm. And using the option -v with: doveadm -v import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all makes no difference at all, the same messages appear. The verbose option seems to be always on. Is this a bug or intended behaviour? Greetings, J?rgen -- J?rgen Obermann Hochschulrechenzentrum der Justus-Liebig-Universit?t Gie?en Heinrich-Buff-Ring 44 Tel. 0641-9913054 From madduck at madduck.net Wed Aug 8 12:08:10 2012 From: madduck at madduck.net (martin f krafft) Date: Wed, 8 Aug 2012 11:08:10 +0200 Subject: [Dovecot] Running spamc during LMTP delivery Message-ID: <20120808090810.GA9152@fishbowl.rw.madduck.net> Hello list, we are using dovecot-lmtp for delivery to virtual users, and vmm[1] to manage them. 1. http://vmm.localdomain.org/ One nice feature of vmm is that every virtual user has their own UID/GID on the UNIX filesystem. There is no passwd entry, so no shell login, but each user effectively has a home directory and can run commands in isolation and with lowered privileges. This requires dovecot-lmtp because only the LMTP LDA runs with root rights and can drop privileges to become the specific user for which it is delivering mail. We would now like to run SpamAssassin with the possibility of using the antispam plugin to enable virtual users to train their databases. Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an external command as a filter, to be run by the final user? Thanks, -- martin | http://madduck.net/ | http://two.sentenc.es/ "truth is stranger than fiction, but it is because fiction is obliged to stick to possibilities; truth isnt." -- mark twain spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From dgp-dove at corefiling.co.uk Wed Aug 8 13:01:30 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Wed, 08 Aug 2012 11:01:30 +0100 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120808090810.GA9152@fishbowl.rw.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> Message-ID: <502238FA.6040901@corefiling.co.uk> On 08/08/12 10:08, martin f krafft wrote: > Hello list, > > we are using dovecot-lmtp for delivery to virtual users, and vmm[1] > to manage them. > > 1. http://vmm.localdomain.org/ > > One nice feature of vmm is that every virtual user has their own > UID/GID on the UNIX filesystem. There is no passwd entry, so no > shell login, but each user effectively has a home directory and can > run commands in isolation and with lowered privileges. > > This requires dovecot-lmtp because only the LMTP LDA runs with root > rights and can drop privileges to become the specific user for which > it is delivering mail. > > We would now like to run SpamAssassin with the possibility of using > the antispam plugin to enable virtual users to train their > databases. > > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > external command as a filter, to be run by the final user? > > Thanks, Hi Martin, Have you taken a look at Pigeonhole and Sieve? There's experimental support for running spam filters and external commands. You'll need at least 0.3.0 which requires Dovecot 2.1. http://wiki2.dovecot.org/Pigeonhole/Sieve HTH, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From madduck at madduck.net Wed Aug 8 13:46:22 2012 From: madduck at madduck.net (martin f krafft) Date: Wed, 8 Aug 2012 12:46:22 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <502238FA.6040901@corefiling.co.uk> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> Message-ID: <20120808104622.GA16169@albatross.gern.madduck.net> also sprach Daniel Piddock [2012.08.08.1201 +0200]: > Have you taken a look at Pigeonhole and Sieve? There's experimental > support for running spam filters and external commands. You'll need at > least 0.3.0 which requires Dovecot 2.1. > > http://wiki2.dovecot.org/Pigeonhole/Sieve I have found this since and am working on it. Thanks! This looks like the ticket, and I will post back when I know more? -- martin | http://madduck.net/ | http://two.sentenc.es/ "we all know linux is great... it does infinite loops in 5 seconds." -- linus torvalds spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From Wiethoff at tfh-bochum.de Wed Aug 8 14:56:01 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Wed, 8 Aug 2012 11:56:01 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <20120807222226.GA8406@daniel.localdomain> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> Message-ID: <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> Hello Daniel, Daniel Parthey wrote: > Probably you are interested in reading the discussion from 2008: > http://www.dovecot.org/list/dovecot/2008-November/035263.html > > I think, a simple and robust solution would be to limit the > allowed characters for user passwords in your password > management system to 7-bit ASCII characters (only) and > reset passwords of all users having any login problems. Thanks for the link! I think I understood the major problem. But there is one point I couldn?t find out: From the dovecot auth-log I traced a password (T?st1234) with Umlaut: D-AS01:/var/log # grep st1234\) mail | cut -c 127-134 | hexdump -C 00000000 54 e4 73 74 31 32 33 34 0a |T.st1234.| 00000009 As you can see this is ISO-8859-1: e4 --> ? But the first incoming String from the client was UTF-8 encoded!? [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 Anyway... I guess I have to force our users to 7-bit Characters :-( Greetings, Helge ________________________________ Helge Wiethoff Medienzentrum Telefon: +49 (234) 968 8717 Fax: +49 (234) 968 3453 E-Mail: Wiethoff at tfh-bochum.de Technische Fachhochschule Georg Agricola f?r Rohstoff, Energie und Umwelt zu Bochum Staatlich anerkannte Fachhochschule der DMT-Gesellschaft f?r Lehre und Bildung mbH Herner Stra?e 45 44787 Bochum http://www.tfh-bochum.de ________________________________ Tr?ger: DMT-Gesellschaft f?r Lehre und Bildung mbH Sitz der Gesellschaft: Bochum Registergericht: Amtsgericht Bochum Handelsregister: B 4052 Gesch?ftsf?hrung: Prof. Dr. J?rgen Kretschmann (Vorsitzender) Manfred Freitag From andre.groebe at fun.de Wed Aug 8 15:23:00 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Wed, 08 Aug 2012 14:23:00 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict Message-ID: <50225A24.4010109@fun.de> Hi, I am using dovecot (see dovecot -n output below) with metadata plugin in my own plugin. I want to insert and delete some large metadata (>4KiB). It seems, that the delete in a second call of my plugin smashes the file dovecot.dict in users dir: 1st call: *dovecot.dict is empty -delete metadata 1 -delete metadata 2 -insert metadata 1 ~8KiB -insert metadata 2 <1KiB *dovecot.dict contains two entries 2nd call: -delete metadata 1 -delete metadata 2 -insert metadata 1 ~8KiB -insert metadata 2 <1KiB *dovecot.dict contains the two entries + some waste If all eight steps are called together (in the same plugin context) the file dovecot.dict seems to be ok. I have created a test plugin to reproduce this behaviour: . It needs the notify and (patched) metadata plugin to run. To get it work i copy an email from one IMAP folder to another (to trigger the copy notifier). It seems, that there is an issue on writing metadata/dict, can anybody reproduce it or knows what is wrong? TIA -- Andre From andre.groebe at fun.de Wed Aug 8 15:33:03 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Wed, 08 Aug 2012 14:33:03 +0200 Subject: [Dovecot] [bulk]: Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <50225C7F.2070300@fun.de> missing patch and info: metadata patch ============== --- a/src/metadata-backend.c +++ b/src/metadata-backend.c @@ -130,7 +130,8 @@ metadata_set_entry(struct metadata_entry *entry, struct mail_user *user) { if (!metadata_entry_is_valid(entry)) return -METADATA_ERROR_INVALID; - if (strlen(metadata_entry_get_value(entry)) > muser->set->maxsize) + if (metadata_entry_get_value(entry) != NULL + && strlen(metadata_entry_get_value(entry)) > muser->set->maxsize) return -METADATA_ERROR_TOOLARGE; if (count_entries(muser) > muser->set->maxentries) return -METADATA_ERROR_TOOMANY; --- a/Makefile.am +++ b/Makefile.am @@ -1,3 +1,6 @@ ACLOCAL_AMFLAGS = -I m4 SUBDIRS = src + +pkginc_libdir=$(dovecot_pkgincludedir)/metadata +nodist_pkginc_lib_HEADERS = metadata-config.h --- a/src/Makefile.am +++ b/src/Makefile.am @@ -42,7 +42,7 @@ lib90_imap_annotatemore_plugin_la_LIBADD = \ lib80_metadata_plugin.la endif -noinst_HEADERS = \ +headers = \ metadata-backend.h \ metadata-entry.h \ metadata-entry-private.h \ @@ -55,3 +55,6 @@ noinst_HEADERS = \ imap-arg-ext.h \ mailbox-ext.h \ str-ext.h + +pkginc_libdir=$(dovecot_pkgincludedir)/metadata +pkginc_lib_HEADERS = $(headers) dovecot -n ========== # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35-1exp2-intern-k8-kvm x86_64 Debian 6.0.5 ext3 debug_log_path = /var/opt/dovecot/log/dovecot.log default_vsz_limit = 512 M disable_plaintext_auth = no first_valid_uid = 0 info_log_path = /var/opt/dovecot/log/dovecot.log lmtp_check_rcpt = yes lmtp_rcpt_to_parameters { * = i: ignorequota = b:plugin/quota_ignore xtolain = s:plugin/lain xtomsgtype = s:plugin/mailtype_xtomsgtype xtospam = b:plugin/spamflag_xtospam xtovacation = B:plugin/sieve_xtovacation } log_path = /var/opt/dovecot/log/dovecot.log log_timestamp = "%y%m%H%M%S " mail_gid = mail mail_home = /var/spool/dovecot/%2.256Hu/%3.4096Hu/%u mail_location = mdbox:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u mail_plugin_dir = /opt/app/dovecot/lib/dovecot mail_plugins = notify metadata test mail_uid = mail namespace inbox { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = nocache=y /var/spool/dovecot/deny deny = yes driver = passwd-file } passdb { args = nopassword=y driver = static } plugin { acl = vfile autocreate = INBOX.Drafts autocreate2 = INBOX.Sent autocreate3 = INBOX.Trash metadata_dict = file:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u/dovecot.dict metadata_maxsize = 10240 quota = dict:User quota::file:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u/dovecot.dict quota_rule = *:bytes=999999 quota_rule2 = *:messages=999 quota_rule3 = *:mailboxes=99 quota_rule4 = *:levels=9 quota_rule5 = INBOX.Voicebox:ignore } service anvil { unix_listener anvil { group = dovecot mode = 0660 } } service auth-worker { user = $default_internal_user } service auth { unix_listener auth-userdb { group = dovecot mode = 0660 } } service config { unix_listener config { group = dovecot mode = 0660 } } service dict { unix_listener dict { mode = 0600 user = mail } } service lmtp { inet_listener lmtp { port = 2003 } } ssl = no userdb { args = /opt/app/dovecot/etc/dovecot/dovecot-tdbfcall.conf.ext driver = tdbfcall } protocol imap { mail_plugins = notify metadata test autocreate imap_metadata imap_annotatemore } protocol pop3 { pop3_uidl_format = %v.%u } -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Wed Aug 8 16:09:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:09:09 +0300 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120808090810.GA9152@fishbowl.rw.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> Message-ID: <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> On 8.8.2012, at 12.08, martin f krafft wrote: > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > external command as a filter, to be run by the final user? Use spampd LMTP proxy? From tss at iki.fi Wed Aug 8 16:14:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:14:13 +0300 Subject: [Dovecot] error message. Some help please In-Reply-To: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> References: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> Message-ID: <3B1B423B-AAD3-405A-86EE-31063DD914E0@iki.fi> On 7.8.2012, at 12.40, Spyros Tsiolis wrote: > Jul 06 13:51:20 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count > Jul 18 15:20:32 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count > Jul 19 09:16:40 dovecot: Warning: Killed with signal 15 (by pid=3062 uid=0 code=kill) > ......... > > Should I just go ahead and increase login_max_processes_count ? > Is it that simple ? Yes, you probably should just increase it. http://wiki1.dovecot.org/LoginProcess has more info. From tss at iki.fi Wed Aug 8 16:16:17 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:16:17 +0300 Subject: [Dovecot] replication chain In-Reply-To: <213B51F00051AE48A9F0E11288017717B84099@Delta.sc.local> References: <213B51F00051AE48A9F0E11288017717B84099@Delta.sc.local> Message-ID: On 7.8.2012, at 15.04, ???????? ????????? ?????????? wrote: > good day! > > I wonder if it is possible to make a chain of replication in dovecot 2.1.9. > Now I'm using two way replication(I use proxy to redirect users) and it's working just fine but > is it possible to setup replication like this: > > serverA ---> serverB --> server C > <--- > > I've added additional mail_replica2 on serverB > and after restart dovecot didn't complain about errors, > with doveconf -n I am able to see two replica's settings but > user's mails aren't replicating to server C. > no errors in logs. > I want to use server C as backup server with lvm snapshots. The automatic replication currently can replicate to only one other server. And the replication doesn't trigger again when dsync is run. You could do this if you manually run dsync e.g. in a cronjob. From tss at iki.fi Wed Aug 8 16:20:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:20:15 +0300 Subject: [Dovecot] Dovecot with Company - level Quota In-Reply-To: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> References: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> Message-ID: <5F1A3083-7354-44DA-BBA1-CD7DCE80115C@iki.fi> On 7.8.2012, at 18.17, Kavish Karkera wrote: > We are using maildir as quota-backend , and performing user level quota, which is working fine. (using dovecot 2.x ). > > Now the requirement is to , restrict the quota to client / company level along with user level quota. http://www.dovecot.org/list/dovecot/2010-May/049168.html http://wiki2.dovecot.org/Quota/Dict The quota recalculation (also means setting the initial quota) is still a problem. I guess it could be possible to fix nowadays since you can also script it by doing something like: doveadm quota get -u '*@example.com' and sum up the quota values and update the domain quota. From tss at iki.fi Wed Aug 8 16:21:50 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:21:50 +0300 Subject: [Dovecot] doveadm import is always verbose In-Reply-To: References: Message-ID: <5D3FA231-0235-478B-A375-320FE798844F@iki.fi> On 8.8.2012, at 9.55, J?rgen Obermann wrote: > doveadm(guser): Info: copy from mymail: box=restore_2012-05-08/mymail, uid=5, msgid=<######>, size=6999462 > I had expected to see these info messages only if I add the verbose option to doveadm. And using the option -v with: > doveadm -v import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all > makes no difference at all, the same messages appear. The verbose option seems to be always on. Is this a bug or intended behaviour? Those messages are coming from mail_log plugin. You could do something like: protocol doveadm { plugin { mail_log_events = } } From tss at iki.fi Wed Aug 8 16:41:06 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:41:06 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50220A3E.407@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> Message-ID: <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> On 8.8.2012, at 9.42, tonio at starbridge.org wrote: > I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) > > Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) .. > #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) > at hash.c:317 > node = > hash = 1839751767 > #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) > at master-service-settings-cache.c:167 I don't see how this could happen by looking at the code. I also can't reproduce this myself. Can you easily reproduce this? Could you run imap-login via valgrind (it slows things down): service imap-login { executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login } (you may not have/need --vgdb=no, depends on your valgrind version) From asier.cidon at externo.uam.es Wed Aug 8 17:12:52 2012 From: asier.cidon at externo.uam.es (asier.cidon at externo.uam.es) Date: Wed, 08 Aug 2012 16:12:52 +0200 Subject: [Dovecot] sieve vacation messages trouble Message-ID: <20120808161252.79072gldxhycsphc@webmail.uam.es> The problem is solved!!!! In the library "src/lib-sieve/plugins/vacation/cmd-vacation.c", in the package "dovecot-sieve" or "dovecot-pigeonhole" modify: smtp_handle = sieve_smtp_open(senv, reply_to, NULL, &f); smtp_handle = sieve_smtp_open(senv, reply_to, reply_from, &f); You can check the correct operation in your logs. /var/log/maillog postfix/smtpd[27112]: connect from smtp.mydomain.com postfix/smtpd[27112]: A95D2168456: client=smtp.mydomain.com postfix/cleanup[27114]: A95D2168456: message-id= postfix/smtpd[27112]: disconnect from smtp.mydomain.com postfix/qmgr[17010]: A95D2168456: from=, size=7274, nrcpt=1 (queue active) postfix/pipe[27115]: A95D2168456: to=, relay=dovecot, delay=0.09, delays=0.01/0/0/0.08, dsn=2.0.0, status=sent (delivered via dovecot service) postfix/qmgr[17010]: A95D2168456: removed /var/log/dovecot.log dovecot: auth(default): master out: USER 1 asier.cidon at mydomain.com uid=xxx gid=xxx quota_rule=*:bytes=524288000 home=/buzon/asier.cidon dovecot: deliver(asier.cidon at mydomain.com): sieve: msgid=: sent vacation response to dovecot: deliver(asier.cidon at mydomain.com): sieve: msgid=: stored mail into mailbox 'INBOX' /var/log/maillog postfix/pickup[17009]: B221D168458: uid=xxx from= postfix/cleanup[27114]: B221D168458: message-id= postfix/qmgr[17010]: B221D168458: from=, size=661, nrcpt=1 (queue active) postfix/smtp[27195]: B221D168458: to=, relay=smtpinterno.mydomain.com, delay=0.04, delays=0.01/0/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as A3A092280B3) postfix/qmgr[17010]: B221D168458: removed From stephan at rename-it.nl Wed Aug 8 17:32:48 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 08 Aug 2012 16:32:48 +0200 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120808161252.79072gldxhycsphc@webmail.uam.es> References: <20120808161252.79072gldxhycsphc@webmail.uam.es> Message-ID: <50227890.7040107@rename-it.nl> Op 8/8/2012 4:12 PM, asier.cidon at externo.uam.es schreef: > The problem is solved!!!! > > > In the library "src/lib-sieve/plugins/vacation/cmd-vacation.c", in the > package "dovecot-sieve" or "dovecot-pigeonhole" modify: > > smtp_handle = sieve_smtp_open(senv, reply_to, NULL, &f); > smtp_handle = sieve_smtp_open(senv, reply_to, reply_from, &f); As pointed out earlier in this thread, this is a qmail issue. The SMTP MAIL FROM is set to <> on purpose: http://tools.ietf.org/html/rfc3834#section-3.3 http://tools.ietf.org/html/rfc5230#section-5.1 This prevents other automated responders from replying to this message, e.g. an MTA sending a delivery failure. This (among other safeguards) prevents mail loops. The above change is therefore not recommended. Regards, Stephan. From nikolai at net24.co.nz Wed Aug 8 18:28:27 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Thu, 9 Aug 2012 03:28:27 +1200 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> Message-ID: <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> Hi Timo, Thanks for your fix! Just want to confirm that the re-order of connections has fixed the issue. We still have occasional issues with the POP3 server (locking issues and busy timeouts etc). Because dsync reports sync ok, we have parse to output looking for 'Error: pop3_migration' to determine if it was in-fact ok or if we need to do a re-sync. We have seen some IMAP 'Server dsconnected unexpectedly' errors also (on large mailboxes again), but it doesn't appear to cause any issues. Does dsync reconnect if the IMAP connection is lost? Thank you. Regards, Nikolai. On 4/08/2012, at 2:40 AM, Timo Sirainen wrote: > On 3.8.2012, at 10.04, Nikolai Schupbach wrote: > >> There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. > > What should happen is: > > 1. pop3c connects to server > 2. issues LIST and UIDL commands > 3. IMAP server issues fetch 1:* RFC822.SIZE (or I guess it does this with a ton of separate commands) > 4. pop3c attempts to do some TOP commands. > >> When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): >> >> dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly >> dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected > > It looks like the 3 step takes a long time. Do you have imapc_features=rfc822.size? Also setting mail_prefetch_count to something between 10..100 should help a lot. And this should also fix it by moving 3 step to 1: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d > >> Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. > > Yes, looks like dsync simply continues without assigning POP3 UIDL. Hmm. Perhaps it shouldn't do that on temporary failures.. > >> Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, > > This isn't easily possible. > >> or it should simply reconnect if sees the connection is lost. > > It should probably do that, yes. From tss at iki.fi Wed Aug 8 18:59:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 18:59:07 +0300 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> Message-ID: <8D9C4418-B83E-403C-9669-2A3F0278795A@iki.fi> On 8.8.2012, at 18.28, Nikolai Schupbach wrote: > Hi Timo, > > Thanks for your fix! Just want to confirm that the re-order of connections has fixed the issue. We still have occasional issues with the POP3 server (locking issues and busy timeouts etc). Because dsync reports sync ok, we have parse to output looking for 'Error: pop3_migration' to determine if it was in-fact ok or if we need to do a re-sync. v2.2 dsync gives a real error instead of ignoring the problem. > We have seen some IMAP 'Server dsconnected unexpectedly' errors also (on large mailboxes again), but it doesn't appear to cause any issues. Does dsync reconnect if the IMAP connection is lost? Yes, the imapc backend code does automatic reconnections. From kind at it.uib.no Wed Aug 8 19:13:21 2012 From: kind at it.uib.no (Hans Morten Kind) Date: Wed, 8 Aug 2012 18:13:21 +0200 Subject: [Dovecot] Statistics scripts In-Reply-To: <42DEDB45-6B9A-47BB-BFB1-B82ECC086839@iki.fi> References: <42DEDB45-6B9A-47BB-BFB1-B82ECC086839@iki.fi> Message-ID: <20120808161320.GA1497@alf.uib.no> I guess everybody has spent their holiday looking into the stats features of dovecot-2.1! This is as far as I have got, it is a perl-script using Curses to smooth the screen and capture keystrokes while running. Mostly tested on Solaris but should probably run everywhere setting $base_dir, it does not make use of temporary files. http://half.uib.no/dovtop/dovtop.txt Our site has app 20k users with 4-5k concurrent. We have been using dovecot since 2006 with great success - though a lot of the staff are prefering exhcange to get the calendar ... When running for a while with a sleeptime of 10 or more 'dovtop' should give a reasonable status of current usage? hmk From uros.gruber at gmail.com Wed Aug 8 19:13:42 2012 From: uros.gruber at gmail.com (Uros) Date: Wed, 8 Aug 2012 18:13:42 +0200 Subject: [Dovecot] Quota dict configuration Message-ID: Hi, I have enabled quota dict with mysql following wiki http://wiki2.dovecot.org/Quota/Dict Everything work as expected. I just have a question about query used for updating quota usage. I already check the source file dict-sql.c but i still can't figure it out. I store user info in a mysql table where only left (user) part of an email address is stored with foreign id for domain conected to domain table. The problem is administration because quota table have primary key whole email. Is there even possible to configure quota dict settings to use separate variables %n and %d like in user and password query? -- lp Uro? From acrow at integrafin.co.uk Wed Aug 8 21:19:55 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Wed, 08 Aug 2012 19:19:55 +0100 Subject: [Dovecot] Dsync and SIS Message-ID: <5022ADCB.8060805@integrafin.co.uk> Hi all, Just to clarify, if we back up a dovecot 2 server with SIS for attachments and ALT storage by rsyncing it (including the SIS and ALT storage) to a remote server when it's idle (or at least almost entirely so), and run dovecot on that machine, would it seem feasible to restore backups from that server by using dysnc - specifically for the scenario where someone accidentally deletes emails/folders etc.? I've seen queries about SIS before but nothing specifically about this scenario. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From elias.tamas at vagyok.eu Thu Aug 9 03:34:13 2012 From: elias.tamas at vagyok.eu (_ET_) Date: Wed, 8 Aug 2012 17:34:13 -0700 (PDT) Subject: [Dovecot] maildir to sdbox offline conversion Message-ID: <34274589.post@talk.nabble.com> Hi all. I've just installed dovecot v2.1 in a multihomed, multiinstance setup, It took me two days to convert the old v1.1 configs, now everything works like charm! But. :) I have several maildir mailboxes, I decided to use the sdbox storage type instead. I ran into difficoulties using the dsync util. My virtual users are in an OpenLDAP DB on a differnet machine, and I do not have access to the database (I can authenticate the users from ldap, but cannot change or see anything) So it's not easy to do an "online" conversion and follow the instructions at dsync's wiki. Do you know a way how to simply tell dsync or a similar util the following dsync convert maildir:/data/vmail/domain/user sdbox:/newdata/vmail/domain/user without touching the ldap database, only the files on the disk. I can run this command as root on this mail server, if it is needed, I can run the command for each and every maildir. That's not a problem. any ideas, how this woul?d be the simpliest? -- View this message in context: http://old.nabble.com/maildir-to-sdbox-offline-conversion-tp34274589p34274589.html Sent from the Dovecot mailing list archive at Nabble.com. From matthew at atom.net Thu Aug 9 05:10:30 2012 From: matthew at atom.net (Matthew Powell) Date: Wed, 8 Aug 2012 22:10:30 -0400 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> Message-ID: <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> On 2012-08-08, at 7.56, "Wiethoff, Helge" wrote: > As you can see this is ISO-8859-1: e4 --> ? > But the first incoming String from the client was UTF-8 encoded!? > > [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 > > Anyway... I guess I have to force our users to 7-bit Characters :-( You mentioned Roundcube earlier. I notice this in Roundcube's default main.inc.php: // Password charset. // Use it if your authentication backend doesn't support UTF-8. // Defaults to ISO-8859-1 for backward compatibility $rcmail_config['password_charset'] = 'ISO-8859-1'; ...so changing that to UTF-8 may fix the problem so far as Roundcube is concerned. But you may still face a problem with other clients. We just discussed Thunderbird's behaviour a few days back... -- Matthew Powell matthew at atom.net From ml-dovecot at zu-con.org Thu Aug 9 09:20:17 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Thu, 09 Aug 2012 08:20:17 +0200 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <1344375938.19913.85.camel@hurina> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> <501CCB1C.80908@zu-con.org> <1344375938.19913.85.camel@hurina> Message-ID: Hi, Am 07.08.2012 23:45, schrieb Timo Sirainen: > On Sat, 2012-08-04 at 09:11 +0200, Matthias Rieber wrote: >> >> I've deleted 10000s emails and it seems that every mail is >> removed with >> >> a single request from Solrs index. This works, but it's quite >> slow. Is >> >> it possible/plans to improve that? >> > >> > Could you try if the attached patch works? It compiles, but didn't >> test it. >> >> it segfaults: > > This should work: http://hg.dovecot.org/dovecot-2.1/rev/82f59d2139a9 perfect. I deleted the content of a folder with ~50000 mails, the speed was good. Matthias From stsiol at yahoo.co.uk Thu Aug 9 09:31:26 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Thu, 9 Aug 2012 07:31:26 +0100 (BST) Subject: [Dovecot] dovecot rpm packages for CentOS ? Message-ID: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Hello all again, Has anyone any idea how to get the latest dovecot version for CentOS 5.8 or 6.2 32-bit OS ? I did a quick search and found out that the official version of dovecot for CentOS v5.8 is 1.0.2 (!!). Any repos ? Any ideas :-) ? Thank you all, spyros ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From bmalik at ihlas.net.tr Thu Aug 9 09:10:20 2012 From: bmalik at ihlas.net.tr (Bulend Mali) Date: Wed, 8 Aug 2012 23:10:20 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 Message-ID: <34275123.post@talk.nabble.com> Hello I use dovecot2 on vpopmail,qmail. i want to use login-intranet-imap.sh in order to restrict by emailaddress and ip address. i read it at http://wiki2.dovecot.org/PostLoginScripting. But there is an expression "mail_executable" in conf. but there is no such thing in dovecot2. what is equivalent of it for dovecot2 ? -- View this message in context: http://old.nabble.com/about-postlogin-in-dovecot2-tp34275123p34275123.html Sent from the Dovecot mailing list archive at Nabble.com. From voytek at sbt.net.au Thu Aug 9 09:42:12 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Thu, 9 Aug 2012 16:42:12 +1000 Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> References: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Message-ID: <445039c8e7186d42c3750792f42bd3b5.squirrel@geko.sbt.net.au> On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > Hello all again, > Has anyone any idea how to get the latest dovecot version for CentOS > 5.8 or 6.2 32-bit OS ? > I did a quick search and found out that the official version of dovecot > for CentOS v5.8 is 1.0.2 (!!). > > Any repos ? Any ideas :-) ? I've followed/used the link on dovecot main page, and, ended up with: # dovecot --version 2.1.1 dovecot-2.1.1-2_132.el6.i686.rpm dovecot-2.1.1-2_132.el6.x86_64.rpm -- Voytek Eymont From tonio at starbridge.org Thu Aug 9 10:15:12 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Thu, 09 Aug 2012 09:15:12 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> Message-ID: <50236380.1070703@starbridge.org> Le 08/08/2012 15:41, Timo Sirainen a ?crit : > On 8.8.2012, at 9.42, tonio at starbridge.org wrote: > >> I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) >> >> Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) > .. >> #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) >> at hash.c:317 >> node = >> hash = 1839751767 >> #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) >> at master-service-settings-cache.c:167 > I don't see how this could happen by looking at the code. I also can't reproduce this myself. Can you easily reproduce this? Could you run imap-login via valgrind (it slows things down): > > service imap-login { > executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login > } > > (you may not have/need --vgdb=no, depends on your valgrind version) > Timo, I can'f find what trigger this error, and it seems only happenig under some load here the error log in mail.log: (by the way, this is not the same server than before, this one running a Debian Wheezy on a 2.6.32.2 linux kernel and 64 bits architecture.) Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EE3D: client_connected_finish (main.c:139) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508C3E4: master_service_listen (master-service.c:803) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA6A: login_settings_read (login-settings.c:226) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x509FC87: io_loop_run (ioloop.c:398) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BB3: settings_parser_get_list (settings-parser.c:255) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EE3D: client_connected_finish (main.c:139) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508C3E4: master_service_listen (master-service.c:803) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA6A: login_settings_read (login-settings.c:226) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x509FC87: io_loop_run (ioloop.c:398) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Aug 9 09:01:37 smtp dovecot: imap-login: Panic: file login-settings.c: line 232 (login_settings_read): assertion failed: (cache_sets[count] == NULL) backtrace on vgcore: gdb /usr/lib/dovecot/imap-login /root/vgcore.27313 GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/imap-login...done. warning: core file may not match specified executable file. [New LWP 27313] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `'. Program terminated with signal 6, Aborted. #0 0x0000000005311475 in *__GI_raise (sig=) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 ../nptl/sysdeps/unix/sysv/linux/raise.c: Aucun fichier ou dossier de ce type. (gdb) bt full #0 0x0000000005311475 in *__GI_raise (sig=) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 pid = selftid = #1 0x00000000053146f0 in *__GI_abort () at abort.c:92 act = {__sigaction_handler = {sa_handler = 0x4e45130, sa_sigaction = 0x4e45130}, sa_mask = {__val = {34342962424, 84234600, 67249360, 84246240, 4294967295, 86924192, 67250608, 2684328, 4294967295, 34342962672, 1, 2679208, 0, 34342962672, 113514016, 84197376}}, sa_flags = 67164658, sa_restorer = 0x1} sigs = {__val = {32, 0 }} #2 0x0000000005093538 in default_fatal_finish (type=, status=status at entry=0) at failures.c:191 backtrace = 0x76d2364 "\003\003P#`P1" #3 0x000000000509356e in i_internal_fatal_handler (ctx=0x7ff0004e0, format=, args=) at failures.c:649 status = 0 #4 0x0000000005067efa in i_panic (format=format at entry=0x4e45130 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ff0005d0, reg_save_area = 0x7ff000510}} #5 0x0000000004e3ecd4 in login_settings_read (pool=0x8783670, local_ip=local_ip at entry=0xafce3e4, remote_ip=remote_ip at entry=0xafce3f8, local_name=, other_settings_r=other_settings_r at entry=0x7ff000698) at login-settings.c:232 input = {roots = 0x6056c0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x4043b4 "imap-login", service = 0x4043af "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "Wb?e", '\000' , __u6_addr16 = {25175, 26023, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1705468503, 0, 0, 0}}}, ip4 = {s_addr = 1705468503}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = ".il?", '\000' , __u6_addr16 = {26926, 53868, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {3530320174, 0, 0, 0}}}, ip4 = {s_addr = 3530320174}}}, local_name = 0x75f1b00 "imap.spamguard.fr"} error = parser = 0x65fc1c0 cache_sets = 0x6c41628 sets = i = count = ---Type to continue, or q to quit--- __FUNCTION__ = "login_settings_read" #6 0x0000000004e41348 in ssl_servername_callback (ssl=0x6cf8c70, al=, context=) at ssl-proxy-openssl.c:1144 ctx = proxy = client = 0xafce360 host = other_sets = 0x1 #7 0x000000000568f162 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #8 0x000000000567b205 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #9 0x000000000567f8c5 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #10 0x000000000568c103 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #11 0x0000000004e41af1 in ssl_handshake (proxy=0x7010e10) at ssl-proxy-openssl.c:465 ret = #12 ssl_step (proxy=0x7010e10) at ssl-proxy-openssl.c:528 No locals. #13 0x0000000004e420c5 in ssl_proxy_start (proxy=) at ssl-proxy-openssl.c:658 No locals. #14 0x0000000004e3ee3e in client_connected_finish (conn=0x7ff000880) at main.c:139 client = 0xafce360 proxy = 0x7010e10 local_ip = {family = 2, u = {ip6 = {__in6_u = {__u6_addr8 = "Wb?e", '\000' , __u6_addr16 = { 25175, 26023, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1705468503, 0, 0, 0}}}, ip4 = {s_addr = 1705468503}}} set = 0x87836a8 local_port = 993 pool = 0x8783670 fd_ssl = other_sets = 0x8783698 #15 0x000000000508c3e5 in master_service_listen (l=0x7187990) at master-service.c:803 service = 0x64ef820 ---Type to continue, or q to quit--- conn = {fd = 141, listen_fd = 9, name = 0x64efd3a "imaps", remote_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = ".il?", '\000' , __u6_addr16 = {26926, 53868, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {3530320174, 0, 0, 0}}}, ip4 = {s_addr = 3530320174}}}, remote_port = 34589, fifo = 0, ssl = 1, accepted = 1} #16 0x00000000050a0276 in io_loop_call_io (io=0x7187bd0) at ioloop.c:379 ioloop = 0x64efa10 t_id = 2 #17 0x00000000050a0f07 in io_loop_handler_run (ioloop=ioloop at entry=0x64efa10) at ioloop-epoll.c:213 ctx = 0x7185c80 events = 0x0 event = 0xae5d410 list = 0x7187c50 io = tv = {tv_sec = 54, tv_usec = 854242} events_count = msecs = ret = 1 i = call = #18 0x000000000509fc88 in io_loop_run (ioloop=0x64efa10) at ioloop.c:398 No locals. #19 0x000000000508bd23 in master_service_run (service=0x64ef820, callback=callback at entry=0x4e3f060 ) at master-service.c:543 No locals. #20 0x0000000004e3f6fe in login_binary_run (binary=, argc=2, argv=0x64ef450) at main.c:406 set_pool = 0x64eff90 allow_core_dumps = login_socket = c = #21 0x00000000052fdead in __libc_start_main (main=, argc=, ubp_av=, init=, fini=, rtld_fini=, stack_end=0x7ff000b38) at libc-start.c:228 result = unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 4734455784457788985, 4203696, 34342964032, 0, 0, 4736613026474909241, 4734444482055265849}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x4041a0, ---Type to continue, or q to quit--- 0x7ff000b48}, data = {prev = 0x0, cleanup = 0x0, canceltype = 4211104}}} not_first_call = #22 0x00000000004024d9 in _start () No symbol table info available. From tss at iki.fi Thu Aug 9 10:27:06 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 10:27:06 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50236380.1070703@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> Message-ID: <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> On 9.8.2012, at 10.15, tonio at starbridge.org wrote: >> Could you run imap-login via valgrind (it slows things down): >> >> service imap-login { >> executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login >> } >> >> (you may not have/need --vgdb=no, depends on your valgrind version) >> > > Timo, > I can'f find what trigger this error, and it seems only happenig under some load > here the error log in mail.log: .. > Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) .. > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Thanks. Obviously I shouldn't free cached settings while they're still being used. :) I'll get it fixed tomorrow. For now you could work around it by increasing config_cache_size setting (default is 1M). From c at roessner-network-solutions.com Thu Aug 9 11:14:13 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 9 Aug 2012 10:14:13 +0200 Subject: [Dovecot] some mdbox mails get lost each day Message-ID: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> Hi, I have a strange problem here. I had installed Dovecot-2.1.6 on a customers setup. They have 102 mail accounts on the server. The started using this dovecot version on the 20th June. One mailbox suddenly started expunging mails. Not from the current day, but one week back in the past. First I thought about an Outlook issue. Some filter or archieving thing, but we did a test and on one day, the curstomer did not start Outlook first; instead he checked his mails with the SOGo-webinterface. We saw that mails got deleted again. I checked for sieve filters. None. I upgraded dovecot to 2.1.7, as I have not done any newer packages yet for Ubuntu (using my own PPA). Same problem one day later. I tested with telnet locally. Same result as in the client. I also did doveadm dump -t log and index and saw that there had been expunged mails. Yesterday I asked the customer to backup all his mails in Outlook. After that I renamed the whole mdbox folder of this account on the server and sent one test mail to recreate the mailbox. After that her restored his mail in Outlook. This morning her contacted me and said that all mails are ok right now and no mails have been erased anymore. Coud this been a corrupted index? I also chekced the storage/-folder and see that all mails are still on disk. Now he asked me if there is any way to get all the lost messaged back? It would be okay for him, if all mails since June are sent again, as he can clean his mailbox afterwards. So does somebody have an idea on how to solve this? Maybe scripting something in python and using local sendmail command? Or is there some doveadm voodoo to repair the index or unexpunge all mails? Thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From tss at iki.fi Thu Aug 9 11:20:42 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 11:20:42 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> Message-ID: <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> On 9.8.2012, at 11.14, Christian R??ner wrote: > I have a strange problem here. I had installed Dovecot-2.1.6 on a customers setup. They have 102 mail accounts on the server. The started using this dovecot version on the 20th June. One mailbox suddenly started expunging mails. Not from the current day, but one week back in the past. First I thought about an Outlook issue. Some filter or archieving thing, but we did a test and on one day, the curstomer did not start Outlook first; instead he checked his mails with the SOGo-webinterface. We saw that mails got deleted again. A wrongly used doveadm expunge in a cronjob? mail_log plugin is very helpful when trying to figure out what deletes messages. http://wiki2.dovecot.org/Plugins/MailLog > Yesterday I asked the customer to backup all his mails in Outlook. After that I renamed the whole mdbox folder of this account on the server and sent one test mail to recreate the mailbox. After that her restored his mail in Outlook. This morning her contacted me and said that all mails are ok right now and no mails have been erased anymore. > > Coud this been a corrupted index? Corrupted indexes would log errors in log file. Do you see any errors/warning? > I also chekced the storage/-folder and see that all mails are still on disk. Now he asked me if there is any way to get all the lost messaged back? It would be okay for him, if all mails since June are sent again, as he can clean his mailbox afterwards. So does somebody have an idea on how to solve this? Maybe scripting something in python and using local sendmail command? > > Or is there some doveadm voodoo to repair the index or unexpunge all mails? cp mdbox ~/mdbox-backup rm -rf ~/mdbox-backup/storage/dovecot.map* ~/mdbox-backup/mailboxes/ doveadm import mdbox:~/mdbox-backup all-mails all Now all the mails in m.* files are under all-mails folder. From nikolai at net24.co.nz Thu Aug 9 11:20:56 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Thu, 9 Aug 2012 20:20:56 +1200 Subject: [Dovecot] dsync \noselect on INBOX.INBOX skips sync of INBOX Message-ID: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> Hi Timo, We have encountered an issue today with a number of migrations. Some customers have mailboxes on the source IMAP server that look like this: 3 LIST "" * * LIST () "." "INBOX" * LIST () "." "INBOX.Statements" * LIST () "." "INBOX.Draft" * LIST () "." "INBOX.Drafts" * LIST () "." "INBOX.Invoices" * LIST (\Noselect) "." "INBOX.INBOX" * LIST () "." "INBOX.Jokes" * LIST () "." "INBOX.Payslips" * LIST () "." "INBOX.Personal" When we run dsync it skips the INBOX presumably because of the Noselect on INBOX.INBOX. and the "imapc_list_prefix = INBOX" setting. Regards, Nikolai. From tss at iki.fi Thu Aug 9 11:30:11 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 11:30:11 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <7AEA5CEE-0738-4723-B7E4-E1D39C72ED8F@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <7AEA5CEE-0738-4723-B7E4-E1D39C72ED8F@roessner-network-solutions.com> Message-ID: On 9.8.2012, at 11.24, Christian R??ner wrote: > I had enabled mail_log and search for any kind of errors. None. Only expunge messages from a imap process. Which I thought was Outlook. But isn't. So there is an imap expunge entry for all of the mails that get lost? You should be able to match that with the IMAP client's IP address by using session IDs, for example: mail_log_prefix = "%s(%u) <%{session}>: " Also you may be able to find out what client is doing it by setting: imap_id_log = * From vlb at isks.ru Thu Aug 9 11:33:39 2012 From: vlb at isks.ru (Vladimir Bukov) Date: Thu, 09 Aug 2012 12:33:39 +0400 Subject: [Dovecot] dovecot rpm packages for CentOS ? Message-ID: <502375E3.7030104@isks.ru> On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > > Hello all again, > > Has anyone any idea how to get the latest dovecot version for CentOS > > 5.8 or 6.2 32-bit OS ? > > I did a quick search and found out that the official version of dovecot > > for CentOS v5.8 is 1.0.2 (!!). > > > > Any repos ? Any ideas :-) ? > http://www.city-fan.org/ftp/contrib/mail/ From Wiethoff at tfh-bochum.de Thu Aug 9 11:47:47 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Thu, 9 Aug 2012 08:47:47 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> Message-ID: <194290040642FB4D952083D79F7F7D1D31A129@BOHEMSX2010.rbbk.de> Hi Matthew, > You mentioned Roundcube earlier. I notice this in Roundcube's default > main.inc.php: > > // Password charset. > // Use it if your authentication backend doesn't support UTF-8. > // Defaults to ISO-8859-1 for backward compatibility > $rcmail_config['password_charset'] = 'ISO-8859-1'; > > ...so changing that to UTF-8 may fix the problem so far as Roundcube is > concerned. > > But you may still face a problem with other clients. We just discussed > Thunderbird's behaviour a few days back... D'oh... This fixed it. I haven't taken this into account yet because of the dumpio log, which told me this is already an UTF-8 encoded string... > > [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 Now the authentication works within Roundcube... Thanks for the hint. Greetings, Helge ________________________________ Helge Wiethoff Medienzentrum Telefon: +49 (234) 968 8717 Fax: +49 (234) 968 3453 E-Mail: Wiethoff at tfh-bochum.de Technische Fachhochschule Georg Agricola f?r Rohstoff, Energie und Umwelt zu Bochum Staatlich anerkannte Fachhochschule der DMT-Gesellschaft f?r Lehre und Bildung mbH Herner Stra?e 45 44787 Bochum http://www.tfh-bochum.de ________________________________ Tr?ger: DMT-Gesellschaft f?r Lehre und Bildung mbH Sitz der Gesellschaft: Bochum Registergericht: Amtsgericht Bochum Handelsregister: B 4052 Gesch?ftsf?hrung: Prof. Dr. J?rgen Kretschmann (Vorsitzender) Manfred Freitag From madduck at madduck.net Thu Aug 9 11:57:34 2012 From: madduck at madduck.net (martin f krafft) Date: Thu, 9 Aug 2012 10:57:34 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> Message-ID: <20120809085734.GB3929@albatross.gern.madduck.net> also sprach Timo Sirainen [2012.08.08.1509 +0200]: > > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > > external command as a filter, to be run by the final user? > > Use spampd LMTP proxy? That's a system-wide filtering daemon, it does not run per-user. Since spam is a subjective classification, especially as soon as you add training to the mix, we require per-user configuration. -- martin | http://madduck.net/ | http://two.sentenc.es/ warning: dates in calendar are closer than they appear. spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From giles at coochey.net Thu Aug 9 12:27:53 2012 From: giles at coochey.net (Giles Coochey) Date: Thu, 09 Aug 2012 10:27:53 +0100 Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <502375E3.7030104@isks.ru> References: <502375E3.7030104@isks.ru> Message-ID: <50238299.5030404@coochey.net> On 09/08/2012 09:33, Vladimir Bukov wrote: > On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > >> > Hello all again, >> > Has anyone any idea how to get the latest dovecot version for CentOS >> > 5.8 or 6.2 32-bit OS ? >> > I did a quick search and found out that the official version of >> dovecot >> > for CentOS v5.8 is 1.0.2 (!!). >> > >> > Any repos ? Any ideas :-) ? > > http://www.city-fan.org/ftp/contrib/mail/ I use the city-fan repo, it's great for a whole variety of Mail related packages. The dovecot rpm's are generally updated within 24-48hours of a new release by Timo. -- Regards, Giles Coochey, CCNA, CCNAS NetSecSpec Ltd +44 (0) 7983 877438 http://www.coochey.net http://www.netsecspec.co.uk giles at coochey.net -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4968 bytes Desc: S/MIME Cryptographic Signature URL: From dgp-dove at corefiling.co.uk Thu Aug 9 13:26:58 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Thu, 09 Aug 2012 11:26:58 +0100 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness Message-ID: <50239072.10607@corefiling.co.uk> Hi, I'm not sure if this is a deliberate design decision or a technical limitation that I've missed. Please briefly explain if so :). Or a bug or feature request? When LMTP receives a mail with a single recipient it adds a Delivered-To header. However if the message is delivered in a batch that header isn't added. At first I thought maybe the LMTP was doing something with hardlinks but that doesn't appear to be the case (for rather obvious reasons.) Sample headers (single recipient): Return-Path: Delivered-To: Received: from mx.domain.test ([127.0.0.1]) by domain.test (Dovecot) with LMTP id ZNTPFX2NI1CcCwAAVMeomg for ; Thu, 09 Aug 2012 11:14:21 +0100 Envelope-to: user at domain.test Delivery-date: Thu, 09 Aug 2012 11:14:21 +0100 Received: from host.domain.test ([172.16.252.1]:44058) by relay.domain.test ([172.16.252.120]:25) with esmtp id 1SzPkz-0000lz-7v (Exim 4.80) for user at domain.test (return-path ); Thu, 09 Aug 2012 11:14:21 +0100 Message-ID: <50238D7D.2000707 at domain.test> Date: Thu, 09 Aug 2012 11:14:21 +0100 From: User To: User Subject: test And an expansion list: Return-Path: Received: from mx.domain.test ([127.0.0.1]) by domain.test (Dovecot) with LMTP id Gf+yBmiNI1CECwAAVMeomg ; Thu, 09 Aug 2012 11:14:00 +0100 Envelope-to: expansion at domain.test Delivery-date: Thu, 09 Aug 2012 11:14:00 +0100 Received: from host.domain.test ([172.16.252.1]:44053) by relay.domain.test ([172.16.252.120]:25) with esmtp id 1SzPkd-0000ls-Qr (Exim 4.80) for expansion at domain.test (return-path ); Thu, 09 Aug 2012 11:13:59 +0100 Message-ID: <50238D67.3090802 at domain.test> Date: Thu, 09 Aug 2012 11:13:59 +0100 From: User To: Expansion Subject: test At the moment we've turned off batch delivery in the exim smtp transport (max_rcpt=1). Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From robert at schetterer.org Thu Aug 9 14:04:50 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 09 Aug 2012 13:04:50 +0200 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239072.10607@corefiling.co.uk> References: <50239072.10607@corefiling.co.uk> Message-ID: <50239952.8030206@schetterer.org> Am 09.08.2012 12:26, schrieb Daniel Piddock: > I'm not sure if this is a deliberate design decision or a technical > limitation that I've missed. Please briefly explain if so :). Or a bug > or feature request? as far i remember its a design decide dont know exim but it looks like max_rcpt=1 is the same then i.e postfix lmtp_destination_recipient_limit = 1 guess its the best solution for now, if you strongly need that header there were posts in the postfix and dovecot lists search archives -- Best Regards MfG Robert Schetterer From stsiol at yahoo.co.uk Thu Aug 9 14:08:13 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Thu, 9 Aug 2012 12:08:13 +0100 (BST) Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> References: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Message-ID: <1344510493.32546.YahooMailNeo@web132204.mail.ird.yahoo.com> ----- Original Message ----- > Hello all again, > > Has anyone any idea how to get the latest dovecot version for CentOS > 5.8 or 6.2 32-bit OS ? > > I did a quick search and found out that the official version of dovecot > for CentOS v5.8 is 1.0.2 (!!). > > Any repos ? Any ideas :-) ? > > Thank you all, > > spyros Oh "Duh" ! Here I go again :-) http://www.dovecot.org/download.html In front of my eyes, all this time. Thank you all though. s. ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From CMarcus at Media-Brokers.com Thu Aug 9 14:40:54 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 09 Aug 2012 07:40:54 -0400 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239952.8030206@schetterer.org> References: <50239072.10607@corefiling.co.uk> <50239952.8030206@schetterer.org> Message-ID: <5023A1C6.2050706@Media-Brokers.com> On 2012-08-09 7:04 AM, Robert Schetterer wrote: > Am 09.08.2012 12:26, schrieb Daniel Piddock: >> I'm not sure if this is a deliberate design decision or a technical >> limitation that I've missed. Please briefly explain if so :). Or a bug >> or feature request? > as far i remember its a design decide > > dont know exim > > but it looks like max_rcpt=1 > > is the same then i.e postfix > > lmtp_destination_recipient_limit = 1 > > guess its the best solution for now, if you strongly need that header > > there were posts in the postfix and dovecot lists search archives I wonder if this is related or the same problem as the lack of the x-original-to header that was discussed, and that Timo said would be relatively easy to fix in dovecot's LMTP client. If so, it is on his ToDo, he just hasn't gotten to it yet. -- Best regards, Charles From madduck at madduck.net Thu Aug 9 15:23:51 2012 From: madduck at madduck.net (martin f krafft) Date: Thu, 9 Aug 2012 14:23:51 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <502238FA.6040901@corefiling.co.uk> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> Message-ID: <20120809122351.GA26800@albatross.gern.madduck.net> also sprach Daniel Piddock [2012.08.08.1201 +0200]: > Have you taken a look at Pigeonhole and Sieve? There's > experimental support for running spam filters and external > commands. You'll need at least 0.3.0 which requires Dovecot 2.1. Dear list, here is an update. Indeed, the pigeonhole filters suggested by Daniel were the ticket. It took me a while to figure it all out though. Therefore, for posterity, at least for those running Debian systems: First, I compiled the extprograms plugin, running into a segfault, which Stephan helped me solve. Essentially, the extprograms are not in Debian, but everything else is (install dovecot-dev!), so I checked out revision 058de395713a [1], ran ./configure --with-dovecot=/usr/lib/dovecot --with-pigeonhole=/usr/include/dovecot/sieve --with-prefix=/usr/local/stow/pigeonhole-extprograms make make install cd /usr/local/stow/ stow pigeonhole-extprograms 1. http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=684271#10 Since dovecot only allows a single plugin dir to be specified, I had to hack around this by creating a symlink: ln -s /usr/local/lib/dovecot/sieve /usr/lib/dovecot/modules Now, after enabling the following in /etc/dovecot/conf.d/90-sieve: sieve_extensions = +vnd.dovecot.filter sieve_plugins = sieve_extprograms you should see 'vnd.dovecot.filter' in the dovecot -n output: dovecot -n | grep vnd.dovecot managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.filter ^^^^^^^^^^^^^^^^^^ I used sieve_global_extensions instead, because I wanted to enable spamc globally for all users using the dovecot LDA, which includes all virtual users on this machine. I also set (in 90-sieve.conf) sieve_before = /etc/dovecot/sieve.before.d and then put the following sieve script into /etc/dovecot/sieve.before.d/spamassassin.sieve: require [ "vnd.dovecot.filter" ]; filter "spamc" [ "--no-safe-fallback" ]; and then ran sievec spamassassin.sieve && chmod 444 spamassassin.svbin To tell the LDA where to find the spamc filter, I added (to 90-sieve.conf): sieve_filter_bin_dir = /etc/dovecot/sieve-filter and symlinked spamc there ln -s /usr/bin/spamc /etc/dovecot/sieve-filter/spamc So far so good, this now works for real system users, but it would not work for virtual users. The reason for that is that while vmm uses UIDs/GIDs above 70000 to tighten permissions per-virtual-user, spamc and spamd were unable to deal with the lack of libnss integration. Stephan suggested simply to let libnss know about the virtual mail accounts, and I did. After installing libnss-pgsql2 and extending /etc/nsswitch.conf to read passwd: compat pgsql group: compat pgsql I wrote the attached configuration file (/etc/nss-pgsql.conf), which I will submit to the vmm project. The advantage is that now, while the users cannot log in, their UIDs/GIDs on the filesystems are properly mapped, and root *can* /bin/su to them (using -s to override the shell). After a restart of spamd and dovecot, spamc is now run for every user as part of the LDA process before the user's sieve script runs. Thanks to Stephan for his help. Comments welcome. I hope I did not forget anything. PS: I know there are good reasons against running a spamfilter post-queue. There are also several reasons for that. The most important for me is that spam is subjective, especially in combination with training, and I never want to reject spam for fear of false positives, and since I do not want to overload the queues of mail servers (like debian.org) that forward to my account. -- martin | http://madduck.net/ | http://two.sentenc.es/ "the unexamined life is not worth living" -- platon spamtraps: madduck.bogus at madduck.net -------------- next part -------------- connectionstring = hostaddr=127.0.0.1 dbname=vmm user=nss password=5ecr41 connect_timeout=1 getgroupmembersbygid = SELECT local_part||'@'||domainname AS name FROM users JOIN domain_name USING (gid) WHERE gid = $1 AND is_primary = 't' getpwnam = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE local_part = split_part($1, '@', 1) AND domainname = split_part($1, '@', 2) AND is_primary = 't' getpwuid = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE uid = $1 AND is_primary = 't' allusers = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE is_primary = 't' getgrnam = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE domainname = $1 getgrgid = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE gid = $1 groups_dyn = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE is_primary = 't' allgroups = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE is_primary = 't' -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From dgp-dove at corefiling.co.uk Thu Aug 9 15:42:32 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Thu, 09 Aug 2012 13:42:32 +0100 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239952.8030206@schetterer.org> References: <50239072.10607@corefiling.co.uk> <50239952.8030206@schetterer.org> Message-ID: <5023B038.40308@corefiling.co.uk> On 09/08/12 12:04, Robert Schetterer wrote: > Am 09.08.2012 12:26, schrieb Daniel Piddock: >> I'm not sure if this is a deliberate design decision or a technical >> limitation that I've missed. Please briefly explain if so :). Or a bug >> or feature request? > as far i remember its a design decide > > dont know exim > > but it looks like max_rcpt=1 > > is the same then i.e postfix > > lmtp_destination_recipient_limit = 1 > > guess its the best solution for now, if you strongly need that header > > there were posts in the postfix and dovecot lists search archives You're right, I should have search a bit harder. I found the thread from Feb 2010 discussing Return-Path and Delivered-To headers http://www.dovecot.org/list/dovecot/2010-February/046401.html . The conclusion there appears to be the suggested addition of an lmtp_headers option. This got me thinking. With the latest versions of Pigeonhole and Dovecot this header can be added using a global sieve script: require ["envelope", "editheader", "variables"]; if allof (not exists "Delivered-To", envelope :matches :all "To" "*") { addheader "Delivered-To" "${1}"; } Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From c at roessner-network-solutions.com Thu Aug 9 16:10:22 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 9 Aug 2012 15:10:22 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> Message-ID: <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> Hi, > cp mdbox ~/mdbox-backup done > rm -rf ~/mdbox-backup/storage/dovecot.map* ~/mdbox-backup/mailboxes/ done > doveadm import mdbox:~/mdbox-backup all-mails all problem I tried so, but this does not work here: doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(root): Debug: Effective uid=0, gid=0, home=/root doveadm(root): Debug: fs: root=/srv/mail/foo.bar at example.com-backup, index=, control=, inbox=, alt= doveadm(root): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com-backup: mode=0700 gid=-1 doveadm(foo.bar at example.com): Debug: Effective uid=5000, gid=5000, home=/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: fs: root=/srv/mail/foo.bar at example.com, index=, control=, inbox=, alt= doveadm(foo.bar at example.com): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com: mode=0700 gid=-1 The mail box is under: /srv/mail/foo.bar at example.com The backup is under: /srv/mail/foo.bar at example.com-backup It does nothing. The command directly returns. No copied mails. So what am I missing here? Current version here is Dovecot 2.1.7. Thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From nmilas at noa.gr Thu Aug 9 17:58:10 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Thu, 09 Aug 2012 17:58:10 +0300 Subject: [Dovecot] HA Mailbox Design Message-ID: <5023D002.6040101@noa.gr> Hi, We would like to implement a Highly Available Mail Server and would like to ask advice on how to architect this. Some details on our setup: Currently we have only one internal mail server (Postfix/Dovecot 2.0 - planning to move to 2.1), receiving mail from a gateway server (filtering spam/viruses) - a Cisco Ironport - which we are considering to replace with one (or a set of) cloud-based Postfix/Amavis-new/SpamAssassin/ClamAV VMs (currently in testing mode). Delivery uses Dovecot LDA. User accounts are LDAP-based. We use Maildir and the load is low (aside spam). Only about 250 users/mailboxes (4G each). All servers are CentOS 5.8 (planning move to 6.3) KVM VMs (on a cloud where we don't have control on the host, but on highly reliable hardware/networks). We can have VMs on two different clouds and we also have at least two different connections (routes) to the cloud(s) (to support HA). Any directions will be appreciated. Hoping to design an HA architecture but aiming to keep it simple and (as much as possible) easily maintainable one. Thanks for your response and help, Nick From lists at luigirosa.com Thu Aug 9 19:16:08 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 18:16:08 +0200 Subject: [Dovecot] Server side Sieve with virtual users Message-ID: <5023E248.3030408@luigirosa.com> Is there a way to implement server-side filters with Dovecot configured with virtual users (userbase in mysql, a single *NIX user account that owns /var/spool/mail and its content)? Thanks Ciao, luigi -- / +--[Luigi Rosa]-- \ A generation which ignores history has no past... and no future. From adrian.minta at gmail.com Thu Aug 9 19:33:34 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 19:33:34 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023E248.3030408@luigirosa.com> References: <5023E248.3030408@luigirosa.com> Message-ID: <5023E65E.8010608@gmail.com> On 08/09/12 19:16, Luigi Rosa wrote: > Is there a way to implement server-side filters with Dovecot > configured with virtual users (userbase in mysql, a single *NIX user > account that owns /var/spool/mail and its content)? > > Thanks > > > Ciao, > luigi > Yes ! From rob at fantinibakery.com Thu Aug 9 20:08:25 2012 From: rob at fantinibakery.com (rob) Date: Thu, 09 Aug 2012 13:08:25 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply Message-ID: <5023EE89.9050904@fantinibakery.com> Hello We are looking for information on how to use Vacation auto-reply . I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few other pages, but have not found how to set it up. We use sogo and thunderbird . Is there a how to or document for this somewhere? This is our configuration information: dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid auth_mechanisms = plain login auth_username_format = %Ln lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:%h/Maildir mail_plugins = " quota" maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_plugins = quota sieve quota = fs:user quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=60%% quota-warning 60 %u quota_warning4 = storage=40%% quota-warning 40 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ } postmaster_address = fbcadmin at fantinibakery.com protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service imap-login { service_count = 0 vsz_limit = 128 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 vsz_limit = 256 M } service quota-warning { executable = script /fbc/bin/mail/quota-warning.sh user = dovecot } ssl = required ssl_ca = References: <5023E248.3030408@luigirosa.com> Message-ID: <5023F070.8090001@luigirosa.com> Luigi Rosa said the following on 09/08/2012 18:16: > Is there a way to implement server-side filters with Dovecot configured with > virtual users (userbase in mysql, a single *NIX user account that owns > /var/spool/mail and its content)? :) And the webpage/wikipage with documentation about this is.... ? Ciao, luigi -- / +--[Luigi Rosa]-- \ Error in operator: add beer. From adrian.minta at gmail.com Thu Aug 9 20:25:17 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 20:25:17 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023EF1B.5030101@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> Message-ID: <5023F27D.10508@gmail.com> On 08/09/12 20:10, Luigi Rosa wrote: > Adrian Minta said the following on 09/08/2012 18:33: > >>> Is there a way to implement server-side filters with Dovecot >>> configured with >>> virtual users (userbase in mysql, a single *NIX user account that owns >>> /var/spool/mail and its content)? > >> Yes ! > > :) > > And the webpage/wikipage with documentation about this is.... ? > > > Ciao, > luigi > First step is to have a mail system that works without sieve. This is the hard part. Depending on your preferred distro here are two nice webpages for this: http://wiki.mediatemple.net/w/(ve):Install_Postfix_with_Dovecot_on_CentOS http://workaround.org/ispmail Second step is to enable sieve, for witch you only need to uncomment the specific lines from dovecot.conf. For dovecot 1.2, you will have something like: protocols = pop3 pop3s imap imaps managesieve protocol lda { ... mail_plugins: quota sieve } protocol managesieve { } plugin { ... sieve=~/.dovecot.sieve sieve_dir=~/sieve } -- Best regards, Adrian Minta From lists at luigirosa.com Thu Aug 9 20:37:00 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 19:37:00 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F27D.10508@gmail.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> Message-ID: <5023F53C.7000509@luigirosa.com> Adrian Minta said the following on 09/08/2012 19:25: > First step is to have a mail system that works without sieve. This is the hard > part. Not for me. I have more than 20 customers with their own Centos Linux with Postfix and Dovecot compiled by me, and Mysql, apache, php from the distribution source and RoundCube. > protocols = pop3 pop3s imap imaps managesieve > protocol lda { > ... > mail_plugins: quota sieve > } > protocol managesieve { > } > plugin { > ... > sieve=~/.dovecot.sieve > sieve_dir=~/sieve > } That's the point: sieve_dir can be the 'root' of the maildir structure? Virtual users do not have their own home (~) directory. If the sieve file is store in the 'root' maildir of each user, Dovecot uses the same single virtual (linux) user to access the maildir? Ciao, luigi -- / +--[Luigi Rosa]-- \ To define recursion, we must first define recursion. From adrian.minta at gmail.com Thu Aug 9 20:46:43 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 20:46:43 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F53C.7000509@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> Message-ID: <5023F783.6090907@gmail.com> On 08/09/12 20:37, Luigi Rosa wrote: >> plugin { >> ... >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> } > > That's the point: sieve_dir can be the 'root' of the maildir > structure? Virtual users do not have their own home (~) directory. > > If the sieve file is store in the 'root' maildir of each user, Dovecot > uses the same single virtual (linux) user to access the maildir? (~) is the account maildir, not the homedir of linux user. -- Best regards, Adrian Minta From lists at luigirosa.com Thu Aug 9 20:47:45 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 19:47:45 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F783.6090907@gmail.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> <5023F783.6090907@gmail.com> Message-ID: <5023F7C1.6050405@luigirosa.com> Adrian Minta said the following on 09/08/2012 19:46: > (~) is the account maildir, not the homedir of linux user. Ok, thanks! Ciao, luigi -- / +--[Luigi Rosa]-- \ I went to the airport, with my ticket to Los Angeles. I brought three bags and told the Skycap "I want this on to go to Seattle, this one to St. Louis and this one to Chicago." He said "I'm sorry sir, but we can't do that." I said "Why not? You did it last time." --Henny Youngman From robert at schetterer.org Thu Aug 9 21:17:54 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 09 Aug 2012 20:17:54 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F53C.7000509@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> Message-ID: <5023FED2.3060609@schetterer.org> Am 09.08.2012 19:37, schrieb Luigi Rosa: > Adrian Minta said the following on 09/08/2012 19:25: > >> First step is to have a mail system that works without sieve. This is >> the hard >> part. > > Not for me. I have more than 20 customers with their own Centos Linux > with Postfix and Dovecot compiled by me, and Mysql, apache, php from the > distribution source and RoundCube. > >> protocols = pop3 pop3s imap imaps managesieve >> protocol lda { >> ... >> mail_plugins: quota sieve >> } >> protocol managesieve { >> } >> plugin { >> ... >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> } > > That's the point: sieve_dir can be the 'root' of the maildir structure? > Virtual users do not have their own home (~) directory. however they have a dovecot "home", with virtual users all mailboxes belong to i.e system user vmail, and their dovecot "home/mailbox" is taken out of the dovecot config > > If the sieve file is store in the 'root' maildir of each user, Dovecot > uses the same single virtual (linux) user to access the maildir? > > > > > Ciao, > luigi > as far i remember , reading changelog, you can now store sieve rules in mysql too, this should solve any of such problems -- Best Regards MfG Robert Schetterer From stephan at rename-it.nl Thu Aug 9 22:19:03 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 09 Aug 2012 21:19:03 +0200 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5023EE89.9050904@fantinibakery.com> References: <5023EE89.9050904@fantinibakery.com> Message-ID: <50240D27.5080102@rename-it.nl> On 8/9/2012 7:08 PM, rob wrote: > Hello > We are looking for information on how to use Vacation auto-reply . > > I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few > other pages, but have not found how to set it up. > > We use sogo and thunderbird . > > Is there a how to or document for this somewhere? What exactly do you want to know? Regards, Stephan. From rob at fantinibakery.com Thu Aug 9 22:32:05 2012 From: rob at fantinibakery.com (rob) Date: Thu, 09 Aug 2012 15:32:05 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <50240D27.5080102@rename-it.nl> Message-ID: <24a9-50241000-13-11050340@19539233> On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: > On 8/9/2012 7:08 PM, rob wrote: > > Hello > > We are looking for information on how to use Vacation auto-reply . > > > > I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few > > other pages, but have not found how to set it up. > > > > We use sogo and thunderbird . > > > > Is there a how to or document for this somewhere? > > What exactly do you want to know? > > Regards, > > Stephan. > I'd like to know : - If we have Dovecot configured OK for vacation sieve. - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? From tss at iki.fi Fri Aug 10 02:34:56 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 02:34:56 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> Message-ID: On 9.8.2012, at 10.27, Timo Sirainen wrote: >> Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) > .. >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) > > Thanks. Obviously I shouldn't free cached settings while they're still being used. :) Actually it wasn't that obvious: http://hg.dovecot.org/dovecot-2.1/rev/b082b8260782 plus http://hg.dovecot.org/dovecot-2.1/rev/9d0873cefa08 From tss at iki.fi Fri Aug 10 02:38:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 02:38:18 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> Message-ID: <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> On 9.8.2012, at 16.10, Christian R??ner wrote: >> doveadm import mdbox:~/mdbox-backup all-mails all > > problem > > I tried so, but this does not work here: I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX From stan at hardwarefreak.com Fri Aug 10 04:47:50 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 09 Aug 2012 20:47:50 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <5023D002.6040101@noa.gr> References: <5023D002.6040101@noa.gr> Message-ID: <50246846.6020606@hardwarefreak.com> On 8/9/2012 9:58 AM, Nikolaos Milas wrote: > Hi, > > We would like to implement a Highly Available Mail Server and would like > to ask advice on how to architect this. > > Some details on our setup: > > Currently we have only one internal mail server (Postfix/Dovecot 2.0 - > planning to move to 2.1), receiving mail from a gateway server > (filtering spam/viruses) - a Cisco Ironport - which we are considering > to replace with one (or a set of) cloud-based > Postfix/Amavis-new/SpamAssassin/ClamAV VMs (currently in testing mode). First, please don't use the term "cloud". That's a marketing buzzword that variously covers many actual network computing architectures. This is a technical mailing list. We use technical terms here, and precise detail of the architecture matters greatly, buzzwords are irrelevant. > Delivery uses Dovecot LDA. User accounts are LDAP-based. > We use Maildir and the load is low (aside spam). Only about 250 > users/mailboxes (4G each). All servers are CentOS 5.8 (planning move to > 6.3) KVM VMs (on a cloud where we don't have control on the host, but on > highly reliable hardware/networks). If you don't control the host you don't control the storage (disks), thus making a traditional "HA" mail server system difficult. You state the "cloud" infrastructure is highly reliable. That begs the question, what is your definition of a "Highly Available Mail Server"? What is it that you actually want to accomplish? In some detail please. Do you mean "POP/IMAP service is always available to clients even when something fails"? > We can have VMs on two different clouds and we also have at least two > different connections (routes) to the cloud(s) (to support HA). Again, please stop talking about "clouds". None of what you just stated above means anything without actual architectural details. When designing/implementing an HA setup, details are absolutely critical, required to make it work. Details, details, details. Also, you've mentioned absolutely nothing about storage. Storage is the pivot pin in an HA setup, the central consideration. HA is built around the storage architecture, not around applications and servers (hosts or VMs). > Any directions will be appreciated. Hoping to design an HA architecture > but aiming to keep it simple and (as much as possible) easily > maintainable one. HA architectures are never simple. That's the nature of the beast. And they're typically not cheap to implement as they absolutely require fault tolerant shared storage of one kind or another, either a disk array with dual active/active controllers and PSUs with a cluster filesystem on Dovecot nodes, or storage appliance that offers full redundancy and NFS protocol for Dovecot node access. This prevents single point of failure, which is what HA is all about. To be quite frank, based upon the level of technical acumen you've demonstrated here, and the general financial position Greece finds itself in, and the fact you're a public institution, it seems you're a much better candidate for a Gmail hosted infrastructure than a VPS infrastructure with some manner of ad hoc software only HA measures bolted on, which is all you can do with VPS servers--you don't control the storage. Gmail hosted mail instantly gives you a high availability email infrastructure for "free". Cost is negligible for your number of mailboxes. Antispam and all the standard stuff is built in and fairly decent. You get both POP and IMAP connectivity options, allowing access with desktop/mobile MUAs. If you prefer a different web interface you can setup a Horde or Roundcube VM at your "cloud" provider and access the Gmail accounts. You'll have less "control" of the system, but it will save far more money than a VPS "cloud" solution, be far easier to administer, and the setup can be done in a day, with almost zero administration required afterward. If you have many users with personal Gmail accounts they'll take to it like a duck to water. If you're looking for a "cloud" based HA email infrastructure at very low cost, you simply can't beat hosted Gmail. Or Google Apps, whatever they call it these days. The downside is it may eliminate your job if you're strictly a dedicated email system administrator. -- Stan From daniel.parthey at informatik.tu-chemnitz.de Fri Aug 10 05:35:25 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 10 Aug 2012 04:35:25 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <34275123.post@talk.nabble.com> References: <34275123.post@talk.nabble.com> Message-ID: <20120810023525.GA14423@daniel.localdomain> Bulend Mali wrote: > i want to use login-intranet-imap.sh in order to restrict by emailaddress and ip address. > i read it at http://wiki2.dovecot.org/PostLoginScripting. > But there is an expression "mail_executable" in [dovecot1] conf. > but there is no such thing in dovecot2. > What is equivalent of it for dovecot2 ? service imap { executable = imap imap-postlogin } or service pop3 { executable = pop3 pop3-postlogin } I assume the exec "$@" in your login-intranet-imap.sh is there to execute the imap binary (or call it "mail executable") which handles the protocol traffic after your post-login script has done its work and granted access to the user. If you would like to deny access, you should not execute the protocol handler, but simply exit 0, see "Denying connection from some IP/User" at http://wiki2.dovecot.org/PostLoginScripting Regards Daniel -- https://plus.google.com/103021802792276734820 From dovecot at noboost.org Fri Aug 10 05:44:44 2012 From: dovecot at noboost.org (dovecot at noboost.org) Date: Fri, 10 Aug 2012 12:44:44 +1000 Subject: [Dovecot] IMAP IDLE - iPhone? Message-ID: <20120810024444.GA16856@noboost.org> Hi All, Probably a very common question now days. I'd like to configure our iPhones at work to go directly to my dovecot server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE (push email) protocol. Has anyone successfully deployed this? If yes, did you have to use an app from the Apple store? For me the IMAP process works, however it's clearly not notifying the client when new email is detected on the server. cya Craig From tss at iki.fi Fri Aug 10 05:48:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 05:48:57 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> Related question that came to my mind: Does anyone know if XAPPLEPUSHSERVICE feature can be implemented by any server, or does it require cooperation between the server and the mobile network operator? I'm guessing the latter.. From lists at luigirosa.com Fri Aug 10 09:26:02 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Fri, 10 Aug 2012 08:26:02 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <5024A97A.8050204@luigirosa.com> dovecot at noboost.org said the following on 10/08/2012 04:44: > Probably a very common question now days. > I'd like to configure our iPhones at work to go directly to my dovecot > server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE > (push email) protocol. I used K-9 client on Android for one year with push, but I had to remove it and go back to integrated email client because it drained the battery. Ciao, luigi -- / +--[Luigi Rosa]-- \ Why do we want intelligent terminals when there are so many stupid users? From robert at schetterer.org Fri Aug 10 09:26:08 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 08:26:08 +0200 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <24a9-50241000-13-11050340@19539233> References: <24a9-50241000-13-11050340@19539233> Message-ID: <5024A980.1080207@schetterer.org> Am 09.08.2012 21:32, schrieb rob: > > On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: > >> On 8/9/2012 7:08 PM, rob wrote: >>> Hello >>> We are looking for information on how to use Vacation auto-reply . >>> >>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few >>> other pages, but have not found how to set it up. >>> >>> We use sogo and thunderbird . >>> >>> Is there a how to or document for this somewhere? >> >> What exactly do you want to know? >> >> Regards, >> >> Stephan. >> > > > > I'd like to know : > - If we have Dovecot configured OK for vacation sieve. > > - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? > sieve in dovecot acts like a server where you can feed sieve rules i.e vacation, some software mostly webmailsers have guis for this, like sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin if you setup dovecot sieve server rightly , you might see in the dovecot logs , and/or send dovecot config to the list, look for manuals on the dovecot site and in www for setup instructions -- Best Regards MfG Robert Schetterer From dovecot at r.paypc.com Fri Aug 10 09:31:46 2012 From: dovecot at r.paypc.com (Robin) Date: Thu, 09 Aug 2012 23:31:46 -0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024A97A.8050204@luigirosa.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> Message-ID: <5024AAD2.3040909@r.paypc.com> On 8/9/2012 11:26 PM, Luigi Rosa wrote: > I used K-9 client on Android for one year with push, but I had to remove > it and go back to integrated email client because it drained the battery. It sounds like "push" was really implemented as a poll. =R= From robert at schetterer.org Fri Aug 10 09:54:41 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 08:54:41 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024A97A.8050204@luigirosa.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> Message-ID: <5024B031.5010707@schetterer.org> Am 10.08.2012 08:26, schrieb Luigi Rosa: > dovecot at noboost.org said the following on 10/08/2012 04:44: > >> Probably a very common question now days. >> I'd like to configure our iPhones at work to go directly to my dovecot >> server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE >> (push email) protocol. so simply do it > > I used K-9 client on Android for one year with push, but I had to remove > it and go back to integrated email client because it drained the battery. > > > > > > Ciao, > luigi > imap idle is often promoted as push mail but tec side it isnt "exactly" the same, in users eyes the result looks nearly equal yes every service which let stay you online, robs power from battery but you can sync only manuall etc ( for sure then push makes no sense anymore ) however its a human related question, if i need mails always and everywhere and in "real time" in my eyes , if its really urgent people should phone together *g -- Best Regards MfG Robert Schetterer From xray at randoman.ru Fri Aug 10 10:08:47 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 14:08:47 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <5024B37F.2040709@randoman.ru> 10.08.2012 09:44, dovecot at noboost.org ?????: > Hi All, > > Probably a very common question now days. > I'd like to configure our iPhones at work to go directly to my dovecot > server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE > (push email) protocol. > > Has anyone successfully deployed this? If yes, did you have to use an > app from the Apple store? For me the IMAP process works, however it's > clearly not notifying the client when new email is detected on the > server. > > cya > > Craig iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. IMAP IDLE monitor only one selected folder. If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. Sergey S. Kovalev From robert at schetterer.org Fri Aug 10 10:12:09 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 09:12:09 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024B37F.2040709@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> Message-ID: <5024B449.7000005@schetterer.org> Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: > On small mailboxes it's z-push and tine20 for example - they can use > IMAP server as backend. z-push works nice here with android, also the new horde beta has now calender, abook, notes, mail sync -- Best Regards MfG Robert Schetterer From tss at iki.fi Fri Aug 10 09:39:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 09:39:00 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024AAD2.3040909@r.paypc.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> <5024AAD2.3040909@r.paypc.com> Message-ID: <77C53D85-F8E9-49CC-99EC-2904BEA24E4D@iki.fi> On 10.8.2012, at 9.31, Robin wrote: > On 8/9/2012 11:26 PM, Luigi Rosa wrote: >> I used K-9 client on Android for one year with push, but I had to remove >> it and go back to integrated email client because it drained the battery. > > It sounds like "push" was really implemented as a poll. Dovecot has by default: imap_idle_notify_interval = 2 mins So the phone needs to receive and send data every 2 minutes. Increasing this / disabling it entirely should help with power usage. But even then active TCP connections do eat up battery. From c at roessner-network-solutions.com Fri Aug 10 10:29:39 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Fri, 10 Aug 2012 09:29:39 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> Message-ID: <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Hi, > >>> doveadm import mdbox:~/mdbox-backup all-mails all >> >> problem >> >> I tried so, but this does not work here: > > I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: > > doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX > done And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From h.reindl at thelounge.net Fri Aug 10 11:16:17 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 10:16:17 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024B37F.2040709@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> Message-ID: <5024C351.7030101@thelounge.net> Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: > iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. > IMAP IDLE monitor only one selected folder. > If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. > On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. this may be a IPHONE limitation as all the apple clients are buggy like hell since years i have a Android with K9, a lot of folders where messages are stored by sieve-scirpts and on my phone i can actively select which folders should be used for push -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From xray at randoman.ru Fri Aug 10 11:46:50 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 15:46:50 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024C351.7030101@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> Message-ID: <5024CA7A.80006@randoman.ru> 10.08.2012 15:16, Reindl Harald ?????: > > Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: >> iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. >> IMAP IDLE monitor only one selected folder. >> If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. >> On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. > this may be a IPHONE limitation as all the apple > clients are buggy like hell since years > > i have a Android with K9, a lot of folders where messages are stored > by sieve-scirpts and on my phone i can actively select which folders > should be used for push > Sure, it can do it in two ways: open several connections to imap server (one per folder) or periodically change current directory and get changes. But any of this solution will eat battery very fast, proportionally to count of folders to check. I think that battery life is the reason, why this feature is not implemented in iPhone. It will use only one IMAP connection. Sergey S. Kovalev From arne at drlinux.no Fri Aug 10 11:57:55 2012 From: arne at drlinux.no (Arne K. Haaje) Date: Fri, 10 Aug 2012 10:57:55 +0200 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50246846.6020606@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> Message-ID: <1528826.6G1CvjlpWE@marvin> Torsdag 9. august 2012 20.47.50 skrev Stan Hoeppner: [snip] > To be quite frank, based upon the level of technical acumen you've > demonstrated here, and the general financial position Greece finds > itself in, and the fact you're a public institution, it seems you're a > much better candidate for a Gmail hosted infrastructure than a VPS > infrastructure with some manner of ad hoc software only HA measures > bolted on, which is all you can do with VPS servers--you don't control > the storage. If they are a public institution, then they may be prohibited from hosting on Google, simply because possibly sensitive data would then be hosted in another country. As for HA I agree with Stan in that it is both very expensive and difficult to do right, but I would also ask if do you *really* need it? Arne -- Arne K. Haaje http://www.drlinux.no/ Twitter: drlinuxno LinkedIn: http://no.linkedin.com/pub/arne-haaje/27/189/bb From h.reindl at thelounge.net Fri Aug 10 11:59:49 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 10:59:49 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024CA7A.80006@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> Message-ID: <5024CD85.4020705@thelounge.net> Am 10.08.2012 10:46, schrieb Sergey S. Kovalev: > 10.08.2012 15:16, Reindl Harald ?????: >> i have a Android with K9, a lot of folders where messages are stored >> by sieve-scirpts and on my phone i can actively select which folders >> should be used for push >> > Sure, it can do it in two ways: open several connections to imap server > (one per folder) or periodically change current directory and get changes. typically the client opens a connecton for each folder to check > But any of this solution will eat battery very fast, proportionally > to count of folders to check. and that is why K9 on android let you select which folders are relevant for you on the mobile and which should be completly ignored and display the selected in "common inbox" > I think that battery life is the reason, why this feature is not implemented > in iPhone. It will use only one IMAP connection so it is not "it's IMAP limitation" how does help me "save battery" if i have a folder-structure maintained by sieve if i do not get my new mails? it's a limitation from Apple because they have not the knowledge to implement relieable mail-clients see below the removed posting on apple-support (first paragraphs german but posting and answer from Apple below in english) http://www.rhsoft.net/ -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From xray at randoman.ru Fri Aug 10 12:21:34 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 16:21:34 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024CD85.4020705@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> Message-ID: <5024D29E.5040400@randoman.ru> 10.08.2012 15:59, Reindl Harald ?????: > Am 10.08.2012 10:46, schrieb Sergey S. Kovalev: >> 10.08.2012 15:16, Reindl Harald ?????: >>> i have a Android with K9, a lot of folders where messages are stored >>> by sieve-scirpts and on my phone i can actively select which folders >>> should be used for push >>> >> Sure, it can do it in two ways: open several connections to imap server >> (one per folder) or periodically change current directory and get changes. > typically the client opens a connecton for each folder to check Sure, it's better. > >> But any of this solution will eat battery very fast, proportionally >> to count of folders to check. > and that is why K9 on android let you select which folders > are relevant for you on the mobile and which should be > completly ignored and display the selected in "common inbox" This is not an argument. You can have hundred of folders sorted by sieve and really need to know if there new mail in any of it. >> I think that battery life is the reason, why this feature is not implemented >> in iPhone. It will use only one IMAP connection > so it is not "it's IMAP limitation" As I told - IMAP limitation is to control only one folder. > how does help me "save battery" if i have a folder-structure > maintained by sieve if i do not get my new mails? If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. Imagine if there will 100 folders? Therefore IMAP really have limitation to use it on mobile devices. > it's a limitation from Apple because they have not the > knowledge to implement relieable mail-clients see below > the removed posting on apple-support (first paragraphs > german but posting and answer from Apple below in english) > http://www.rhsoft.net/ I'm not fan of apple anyway, so do not interested in this discussion at all. Sergey S. Kovalev. From tss at iki.fi Fri Aug 10 12:25:35 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 12:25:35 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024D29E.5040400@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> Message-ID: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> On 10.8.2012, at 12.21, Sergey S. Kovalev wrote: >>> I think that battery life is the reason, why this feature is not implemented >>> in iPhone. It will use only one IMAP connection >> so it is not "it's IMAP limitation" > As I told - IMAP limitation is to control only one folder. Assuming NOTIFY extension isn't implemented by both. (Dovecot v2.2 hopefully will have it, and K-9 apparently is interested in adding it too after that.) >> how does help me "save battery" if i have a folder-structure >> maintained by sieve if i do not get my new mails? > If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. > Imagine if there will 100 folders? Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. From ms at mike2k.de Fri Aug 10 12:29:42 2012 From: ms at mike2k.de (Michael Stilkerich) Date: Fri, 10 Aug 2012 11:29:42 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> References: <20120810024444.GA16856@noboost.org> <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> Message-ID: <5024D486.40703@mike2k.de> Hi, On 10-Aug-12 4:48, Timo Sirainen wrote: > Related question that came to my mind: Does anyone know if XAPPLEPUSHSERVICE feature can be implemented by any server, or does it require cooperation between the server and the mobile network operator? I'm guessing the latter.. the Apple push service for Mail.app uses the same push notification service as all other push notifications for iOS (APNS, Apple Push Notification Service). The Device retains a persistent connection to Apple's APNS Gateway. To transmit a push notification via APNS, the sender needs a certificate issued by Apple for the receiving application (Mail.app in this case). One can get such a certificate by purchasing Lion Server, which includes such a certificate (I presume Mountain Lion Server does as well). The Lion Server uses dovecot, and Apple's patch for the XAPPLEPUSHSERVICE extension is available on http://www.opensource.apple.com/source/dovecot/dovecot-239/dovecot/src/plugins/push-notify/ It basically works as following: 1) Dovecot advertises the XAPPLEPUSHSERVICE Capability 2) When the device logs in to the IMAP server and sees that it supports this capability, it registers with the server for push notifications and provides its device id and the id of the corresponding mail account on the device. These two ids are required to route a push notification to the device. 3) The server records all registered devices for an account. Upon an incoming mail for the account, it transmits a push notification. 4) The device does not directly unregister; this is done using the feedback mechanism of APNS, which tells a service provider that a device does not wish to receive push notifications any longer. The actual transmission of the push notifications to the APNS server is not part of the dovecot patch but a separate program. One can use the Net::APNS perl module (found on cpan) to fairly easily replicate that program. Apple's original is also available: http://www.opensource.apple.com/source/dovecot/dovecot-239/dovecot.push-notify/daemon -Mike P.S.: I'm not sure if one is allowed to do this, though. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4493 bytes Desc: S/MIME Cryptographic Signature URL: From xray at randoman.ru Fri Aug 10 12:45:15 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 16:45:15 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> Message-ID: <5024D82B.5040007@randoman.ru> 10.08.2012 16:25, Timo Sirainen ?????: >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? > Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. > I guess, there is no trick, that will change the linear complexity by traffic and by CPU usage. If you can change settings in dovecot - you can set up ActiveSync there. It's more suitable for mobile mailing. From h.reindl at thelounge.net Fri Aug 10 12:57:43 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 11:57:43 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024D29E.5040400@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> Message-ID: <5024DB17.2080600@thelounge.net> Am 10.08.2012 11:21, schrieb Sergey S. Kovalev: >> and that is why K9 on android let you select which folders >> are relevant for you on the mobile and which should be >> completly ignored and display the selected in "common inbox" > This is not an argument. You can have hundred of folders sorted by > sieve and really need to know if there new mail > in any of it surely IT IS an argument on a non-iPhone you can chosse what is important your agrumentation is even one argument more against iPhone >>> I think that battery life is the reason, why this feature is not implemented >>> in iPhone. It will use only one IMAP connection >> so it is not "it's IMAP limitation" > As I told - IMAP limitation is to control only one folder as proven by other devices there is no limitation >> how does help me "save battery" if i have a folder-structure >> maintained by sieve if i do not get my new mails? > If you open 10 connections to IMAP server and will IDLE on them - your phone > will wake up to reply for ping in every of that 10 connections. > Imagine if there will 100 folders? > Therefore IMAP really have limitation to use it on mobile devices again: how does it help me if I NEED to check them? and no, IMAP has no limitations proven by Android-client my Samsung Galaxy S3 has around 25 push folders no problem with K9 mail to have them in my "common inbox" including my own sent messages while on the desktop i use the folder structure and my battery has a average lifetime of 1.5 days -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From me at junc.org Fri Aug 10 14:03:36 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 13:03:36 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql Message-ID: currently dovecot dict is CREATE TABLE IF NOT EXISTS `quota` ( `username` varchar(100) COLLATE latin1_general_ci NOT NULL, `bytes` bigint(20) NOT NULL DEFAULT '0', `messages` int(11) NOT NULL DEFAULT '0', PRIMARY KEY (`username`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; there is not field that says how much quota each user have, so one cant make a query on how much its left pr user how can i resolve this in dovecot dict ? i like to do an postfix mysql map to temp reject if quota is out of limit -- Benny Pedersen From me at junc.org Fri Aug 10 14:29:21 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 13:29:21 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023E248.3030408@luigirosa.com> References: <5023E248.3030408@luigirosa.com> Message-ID: <760112e9985c43c2ff1bedb08a8444ed@junc.org> Den 2012-08-09 18:16, Luigi Rosa skrev: > Is there a way to implement server-side filters with Dovecot > configured with virtual users (userbase in mysql, a single *NIX user > account that owns /var/spool/mail and its content)? http://wiki1.dovecot.org/ManageSieve if using dovecot 2.x.x there is a seperate wiki From robert at schetterer.org Fri Aug 10 14:44:18 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 13:44:18 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: <5024F412.8090501@schetterer.org> Am 10.08.2012 13:03, schrieb Benny Pedersen: > > currently dovecot dict is > > > CREATE TABLE IF NOT EXISTS `quota` ( > `username` varchar(100) COLLATE latin1_general_ci NOT NULL, > `bytes` bigint(20) NOT NULL DEFAULT '0', > `messages` int(11) NOT NULL DEFAULT '0', > PRIMARY KEY (`username`) > ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; > > > there is not field that says how much quota each user have, so one cant > make a query on how much its left pr user > > how can i resolve this in dovecot dict ? > > i like to do an postfix mysql map to temp reject if quota is out of limit > you may use ideas out of postfixadmin mysql layout -- Best Regards MfG Robert Schetterer From me at junc.org Fri Aug 10 18:18:07 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 17:18:07 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: Den 2012-08-10 13:03, Benny Pedersen skrev: if others need something like this: CREATE TABLE IF NOT EXISTS `quota` ( `username` varchar(100) COLLATE latin1_general_ci NOT NULL, `bytes` bigint(20) NOT NULL DEFAULT '0', `messages` int(11) NOT NULL DEFAULT '0', `quotamax` bigint(20) NOT NULL DEFAULT '0', PRIMARY KEY (`username`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; # /etc/postfix/dovecot_quota_maps.cf user = user password = password hosts = localhost dbname = database query = SELECT CONCAT('DEFER_IF_PERMIT Quotas Excceded') FROM quota WHERE username='%s' AND bytes>=quotamax # /etc/postfix/main.cf smtpd_recipient_restrictions = check_recipient_access mysql:/etc/postfix/dovecot_quota_maps.cf enjoy add to wiki if one could do this From duihi77 at gmail.com Fri Aug 10 19:25:43 2012 From: duihi77 at gmail.com (Duane Hill) Date: Fri, 10 Aug 2012 16:25:43 +0000 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: <1712023239.20120810162543@gmail.com> On Friday, August 10, 2012 at 15:18:07 UTC, me at junc.org confabulated: > Den 2012-08-10 13:03, Benny Pedersen skrev: > if others need something like this: > CREATE TABLE IF NOT EXISTS `quota` ( > `username` varchar(100) COLLATE latin1_general_ci NOT NULL, > `bytes` bigint(20) NOT NULL DEFAULT '0', > `messages` int(11) NOT NULL DEFAULT '0', > `quotamax` bigint(20) NOT NULL DEFAULT '0', > PRIMARY KEY (`username`) > ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; > # /etc/postfix/dovecot_quota_maps.cf > user = user > password = password > hosts = localhost > dbname = database > query = SELECT CONCAT('DEFER_IF_PERMIT Quotas Excceded') FROM quota > WHERE username='%s' AND bytes>=quotamax No need to CONCAT when you are not concatenating anything. Just: SELECT 'DEFER_IF_PERMIT Quotas Exceeded' FROM quota ... > # /etc/postfix/main.cf > smtpd_recipient_restrictions = > check_recipient_access mysql:/etc/postfix/dovecot_quota_maps.cf > enjoy > add to wiki if one could do this -- If at first you don't succeed... ...so much for skydiving. From me at junc.org Fri Aug 10 19:48:32 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 18:48:32 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: <1712023239.20120810162543@gmail.com> References: <1712023239.20120810162543@gmail.com> Message-ID: <48ed8ad322ebb709ac8c37a1d70af271@junc.org> Den 2012-08-10 18:25, Duane Hill skrev: > SELECT 'DEFER_IF_PERMIT Quotas Exceeded' FROM quota ... query = SELECT 'DEFER_IF_PERMIT Quotas Excceded' FROM quota WHERE username='%s' AND bytes>=quotamax AND quotamax>'0' so postfixadmin unlimted is supported thanks for suggesting to make to even better From djonas at vitalwerks.com Fri Aug 10 20:05:08 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:05:08 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory Message-ID: <50253F44.9040203@vitalwerks.com> Hello, I have a mailbox with an ungodly number of small messages in it. When new messages are delivered lmtp kicks up an error like the one below. I tried raising the vsz_limit for lmtp but that didn't see to help. Any ideas (besides deleting 400k messages)? Thanks! dovecot: lmtp(6068, user at example.com): Error: mmap() failed with file /home/vmail/domains/example.com/user/Maildir/dovecot.index.cache: Cannot allocate memory # ls -lah dovecot.index.cache -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache # doveadm mailbox status -u user at example.com all inbox INBOX messages=434118 recent=59848 uidnext=434119 uidvalidity=1293568548 unseen=432625 highestmodseq=14023 vsize=1329486283 guid=f8d48232244a1a4dfe2e0000cb0ad7e0 # doveconf -n ... default_vsz_limit = 256 M service lmtp { inet_listener lmtp { port = 24 } vsz_limit = 256 M } -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Fri Aug 10 20:10:21 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 20:10:21 +0300 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <50253F44.9040203@vitalwerks.com> References: <50253F44.9040203@vitalwerks.com> Message-ID: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> On 10.8.2012, at 20.05, David Jonas wrote: > I have a mailbox with an ungodly number of small messages in it. When > new messages are delivered lmtp kicks up an error like the one below. I > tried raising the vsz_limit for lmtp but that didn't see to help. That should help. > # ls -lah dovecot.index.cache > -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache > > default_vsz_limit = 256 M > service lmtp { > inet_listener lmtp { > port = 24 > } > vsz_limit = 256 M > } Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. From djonas at vitalwerks.com Fri Aug 10 20:13:20 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:13:20 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> References: <50253F44.9040203@vitalwerks.com> <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> Message-ID: <50254130.3040209@vitalwerks.com> On Fri Aug 10 10:10:21 2012, Timo Sirainen wrote: > On 10.8.2012, at 20.05, David Jonas wrote: > >> I have a mailbox with an ungodly number of small messages in it. When >> new messages are delivered lmtp kicks up an error like the one below. I >> tried raising the vsz_limit for lmtp but that didn't see to help. > > That should help. > >> # ls -lah dovecot.index.cache >> -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache >> >> default_vsz_limit = 256 M >> service lmtp { >> inet_listener lmtp { >> port = 24 >> } >> vsz_limit = 256 M >> } > > Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. > I haven't tried higher. I'll make the change now though. Is there a way to test it besides delivering a new message? -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From djonas at vitalwerks.com Fri Aug 10 20:19:59 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:19:59 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> References: <50253F44.9040203@vitalwerks.com> <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> Message-ID: <502542BF.5040907@vitalwerks.com> On 8/10/12 10:10 AM, Timo Sirainen wrote: > On 10.8.2012, at 20.05, David Jonas wrote: > >> I have a mailbox with an ungodly number of small messages in it. When >> new messages are delivered lmtp kicks up an error like the one below. I >> tried raising the vsz_limit for lmtp but that didn't see to help. > That should help. > >> # ls -lah dovecot.index.cache >> -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache >> >> default_vsz_limit = 256 M >> service lmtp { >> inet_listener lmtp { >> port = 24 >> } >> vsz_limit = 256 M >> } > Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. > service lmtp { vsz_limit = 320 M } Yep. That seems to cover it. Delivered a message with lmtp and no error in the logs. dovecot.index.cache timestamp updated too. Thanks! Guess I should have tried something absurdly high before emailing, just to see if that was it. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From rob at fantinibakery.com Fri Aug 10 20:32:13 2012 From: rob at fantinibakery.com (rob) Date: Fri, 10 Aug 2012 13:32:13 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5024A980.1080207@schetterer.org> References: <24a9-50241000-13-11050340@19539233> <5024A980.1080207@schetterer.org> Message-ID: <5025459D.1070403@fantinibakery.com> On 08/10/2012 02:26 AM, Robert Schetterer wrote: > Am 09.08.2012 21:32, schrieb rob: >> >> On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: >> >>> On 8/9/2012 7:08 PM, rob wrote: >>>> Hello >>>> We are looking for information on how to use Vacation auto-reply . >>>> >>>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few >>>> other pages, but have not found how to set it up. >>>> >>>> We use sogo and thunderbird . >>>> >>>> Is there a how to or document for this somewhere? >>> What exactly do you want to know? >>> >>> Regards, >>> >>> Stephan. >>> >> >> >> >> I'd like to know : >> - If we have Dovecot configured OK for vacation sieve. >> >> - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? >> > sieve in dovecot acts like a server where you can feed sieve rules i.e > vacation, some software mostly webmailsers have guis for this, like > sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin > > if you setup dovecot sieve server rightly , you might see in the dovecot > logs , and/or send dovecot config to the list, look for manuals on the > dovecot site and in www for setup instructions What I need to know is if we have enabled siege and managesieve correctly in dovecot. The following is out config. : root at mail ~ # dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid auth_mechanisms = plain login auth_username_format = %Ln lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:%h/Maildir mail_plugins = " quota" maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_plugins = quota sieve quota = fs:user quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=60%% quota-warning 60 %u quota_warning4 = storage=40%% quota-warning 40 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ } postmaster_address = fbcadmin at fantinibakery.com protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service imap-login { service_count = 0 vsz_limit = 128 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 vsz_limit = 256 M } service quota-warning { executable = script /fbc/bin/mail/quota-warning.sh user = dovecot } ssl = required ssl_ca = References: <34275123.post@talk.nabble.com> <20120810023525.GA14423@daniel.localdomain> Message-ID: <34284058.post@talk.nabble.com> my 10-master.conf; service pop3-login { inet_listener pop3 { } service pop3 { executable = pop3 pop3-postlogin } service pop3-postlogin { executable = script-login /usr/local/bin/postlogin_pop3.sh user = root unix_listener pop3-postlogin { } } when i restart dovecot service. i get an error; Aug 11 00:48:27 pop3y dovecot: pop3-postlogin: Error: read: Illegal option -d Aug 11 00:39:56 pop3y dovecot: pop3-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=99386, secured, session= Aug 11 00:39:56 pop3y dovecot: pop3(test at test.com): Post-login script denied access to user test at test.com Aug 11 00:39:56 pop3y dovecot: pop3-postlogin: Fatal: master: service(pop3-postlogin): child 99387 returned error 10 pop3y# ll /usr/local/bin/postlogin_pop3.sh -rwxr-xr-x 1 root wheel 5449 Aug 11 00:46 /usr/local/bin/postlogin_pop3.sh i use freebsd8.2 -- View this message in context: http://old.nabble.com/about-postlogin-in-dovecot2-tp34275123p34284058.html Sent from the Dovecot mailing list archive at Nabble.com. From ncjeffgus at zimage.com Sat Aug 11 00:54:02 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Fri, 10 Aug 2012 14:54:02 -0700 Subject: [Dovecot] dsync backup gets stuck... fails Message-ID: <1344635642.23239.8.camel@maclinux> More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same problem with both versions. I'm getting an error 75 on about 40 boxes out of 1800. It is the same list of boxes every time we use 'dsync backup' to backup the server. dsync seems to stop communicating to the backup box (over ssh). strace just shows it sitting at a epoll_wait. Once the program quits (times out?), a 'du' shows the destination is smaller (200kbyte in one case). Has anyone else seen an exit code of 75? Nothing in the documentation mentions what exit code 75 could mean. What can I do to help the developers locate the bug? ...Jeff From xray at randoman.ru Sat Aug 11 00:55:49 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Sat, 11 Aug 2012 04:55:49 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024DB17.2080600@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <5024DB17.2080600@thelounge.net> Message-ID: <50258365.4060504@randoman.ru> 10.08.2012 16:57, Reindl Harald ?????: > surely IT IS an argument > > on a non-iPhone you can chosse what is important > your agrumentation is even one argument more against iPhone If we now talking about android vs iPhone now... Imagine Android default email client. It have no many features, that iPhone's default have (Note: i do not use iPhone, i'm not fan of Apple). Then return to thing I wanna tell in previous letter - the situation, when you really NEED to follow ALL of hundred of mail dirs. >>>> I think that battery life is the reason, why this feature is not implemented >>>> in iPhone. It will use only one IMAP connection >>> so it is not "it's IMAP limitation" >> As I told - IMAP limitation is to control only one folder > as proven by other devices there is no limitation Can't you distinguish the protocol itself with limitation to follow only one dir and the realization with workaround to create many connections to follow all required dirs? Just imagine that ActiveSync have no that limitation - it use only one connection for any count of mail dirs and therefore it's scalability is very good! >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone >> will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? >> Therefore IMAP really have limitation to use it on mobile devices > again: how does it help me if I NEED to check them? Sure! If you NEED to check them - I guess you can find some app in Apple Store. > and no, IMAP has no limitations proven by Android-client > my Samsung Galaxy S3 has around 25 push folders Yes, it has. The workaround is something else, that limitation itself. > no problem with K9 mail to have them in my "common inbox" > including my own sent messages while on the desktop i > use the folder structure and my battery has a average > lifetime of 1.5 days Android's power consumption is a result of very many factors. Spherical 1.5 days is something that have no any sense. From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 00:58:02 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 10 Aug 2012 23:58:02 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <34284058.post@talk.nabble.com> References: <34275123.post@talk.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> Message-ID: <20120810215802.GA11509@daniel.localdomain> Bulend Mali wrote: > service pop3-postlogin { > executable = script-login /usr/local/bin/postlogin_pop3.sh > } > > when i restart dovecot service. i get an error; > Aug 11 00:48:27 pop3y dovecot: pop3-postlogin: Error: read: Illegal option -d Seems like you are calling a command with argument -d in your script while the command does not recognize any argument -d. Can you post your script "postlogin_pop3.sh" for review please? Regards Daniel -- https://plus.google.com/103021802792276734820 From bmalik at ihlas.net.tr Sat Aug 11 01:14:12 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Fri, 10 Aug 2012 15:14:12 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810215802.GA11509@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> Message-ID: <1344636852565-7786.post@n4.nabble.com> i can manage read -d problem changing -p what should be user rights of the postlogin_pop3.sh ? i use vpopmail the pop3script; #!/bin/sh # 30-jul-2007 # # Author: # Oliver Schulze L. # Contact: http://tinymailto.com/oliver # Paraguay INTRANET_NETS="127.0.0.1 10." # users that can login from the Internet INTERNET_USERS="user1 user2 user3 user4 test at test.com" DEBUG=0 # variables setup by dovecot: IP USER # configure the dovecot binary to run based on the name of the script, so # this script can be used for imap and pop3 just by making a link SCRIPT_BASE="postlogin" DOVECOT_EXEC="" if [ "$(basename $0)" = "${SCRIPT_BASE}_imap.sh" ] ; then DOVECOT_EXEC="/usr/local/libexec/dovecot/imap" elif [ "$(basename $0)" = "${SCRIPT_BASE}_pop3.sh" ] ; then DOVECOT_EXEC="/usr/local/libexec/dovecot/pop3" else MSG="Please edit the file $(basename $0) and change the SCRIPT_BASE variable" /usr/bin/logger "$MSG" # display a message to the user echo "* OK [ALERT] $MSG" # cancel the current imap request echo "* NO $MSG" exit 1 fi # debug if [ $DEBUG -eq 1 ] ; then # TEST data DEBUG=1 # intranet test, any user can login #IP=192.168.1.23 #USER=user222 # internet test, only user user2 can login #IP=200.85.32.2 #USER=user2 fi if [ -z "$IP" ] ; then echo "$(basename $0): IP variable is empty" exit 2 fi if [ -z "$USER" ] ; then echo "$(basename $0): USER variable is empty" exit 3 fi # FLAGS IN_INTRANET=0 INTERNET_ALLOWED=0 DOVECOT_ALLOW=0 # Create this file in a RAM based directory in order to gain performance FILE_TMP=$(mktemp /tmp/login-intranet-dovecot.tmp.XXXXXX) # ------------------------------------------------------------------------------ # check if the IP is from the Intranet # always use a tmp file in while in order to modify this script variables echo "$INTRANET_NETS " > $FILE_TMP # cicle all intranets while read -p ' ' net_intranet ; do net_grep=$(echo $net_intranet | sed -e 's/\./\\\./g') echo $IP | grep $net_grep 2>/dev/null 1>/dev/null RES=$? if [ $DEBUG -eq 1 ] ; then echo " net_intranet: $net_intranet -> RES: $RES" fi if [ $RES -eq 0 ] ; then # the IP is from the intranet, stop processing and allow login IN_INTRANET=1 break fi done < $FILE_TMP # ------------------------------------------------------------------------------ # if the user is connecting from outside the intranet, check if it is allowed # to do so if [ $IN_INTRANET -eq 0 ] ; then # always use a tmp file in while echo "$INTERNET_USERS " > $FILE_TMP # cicle all allowed internet users while read -p ' ' user_inet ; do if [ $DEBUG -eq 1 ] ; then echo " $USER == $user_inet" fi if [ "$USER" = "$user_inet" ] ; then # the user is conecting from the Internet and is allowed, stop # processing and allow login INTERNET_ALLOWED=1 break fi done < $FILE_TMP fi if [ $DEBUG -eq 1 ] ; then echo "IN_INTRANET : $IN_INTRANET" echo "INTERNET_ALLOWED: $INTERNET_ALLOWED" fi # delete temp file rm -f $FILE_TMP if [ $IN_INTRANET -eq 1 ] ; then # the user is conecting from the intranet DOVECOT_ALLOW=1 elif [ $IN_INTRANET -eq 0 ] && [ $INTERNET_ALLOWED -eq 1 ] ; then # the user is conecting from the internet and is an allowed internet user DOVECOT_ALLOW=1 fi # check if the user can login if [ $DOVECOT_ALLOW -eq 1 ] ; then # the user can login, run the imap or pop3 server if [ $DEBUG -eq 1 ] ; then echo "exec $DOVECOT_EXEC" else # this script ends here exec $DOVECOT_EXEC fi else # user is not allowed to login, inform the user and system log #MSG="El usuario '$USER' no puede conectarse desde Internet" MSG="User '$USER' not allowed to connect from the Internet [$IP]" /usr/bin/logger "$(basename $0): $MSG" # display a message to the user echo "* OK [ALERT] $MSG" # cancel the current imap request echo "* NO $MSG" exit 10 fi exec $@ -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p7786.html Sent from the Dovecot mailing list archive at Nabble.com. From rob at fantinibakery.com Sat Aug 11 01:15:23 2012 From: rob at fantinibakery.com (rob) Date: Fri, 10 Aug 2012 18:15:23 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5025459D.1070403@fantinibakery.com> References: <24a9-50241000-13-11050340@19539233> <5024A980.1080207@schetterer.org> <5025459D.1070403@fantinibakery.com> Message-ID: <502587FB.6090300@fantinibakery.com> On 08/10/2012 01:32 PM, rob wrote: > On 08/10/2012 02:26 AM, Robert Schetterer wrote: >> Am 09.08.2012 21:32, schrieb rob: >>> >>> On Thursday, August 9, 2012 15:19 EDT, Stephan >>> Bosch wrote: >>> >>>> On 8/9/2012 7:08 PM, rob wrote: >>>>> Hello >>>>> We are looking for information on how to use Vacation auto-reply . >>>>> >>>>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a >>>>> few >>>>> other pages, but have not found how to set it up. >>>>> >>>>> We use sogo and thunderbird . >>>>> >>>>> Is there a how to or document for this somewhere? >>>> What exactly do you want to know? >>>> >>>> Regards, >>>> >>>> Stephan. >>>> >>> >>> >>> >>> I'd like to know : >>> - If we have Dovecot configured OK for vacation sieve. >>> >>> - It looks like we should try to manage the vacation sieve filters >>> using sogo or thunderbird . Is that the normal way to do so? >>> >> sieve in dovecot acts like a server where you can feed sieve rules i.e >> vacation, some software mostly webmailsers have guis for this, like >> sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin >> >> if you setup dovecot sieve server rightly , you might see in the dovecot >> logs , and/or send dovecot config to the list, look for manuals on the >> dovecot site and in www for setup instructions > > What I need to know is if we have enabled siege and managesieve > correctly in dovecot. The following is out config. : > > root at mail ~ # dovecot -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid > auth_mechanisms = plain login > auth_username_format = %Ln > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > mail_location = maildir:%h/Maildir > mail_plugins = " quota" > maildir_very_dirty_syncs = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > namespace { > inbox = yes > location = > prefix = INBOX. > separator = . > type = private > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > mail_plugins = quota sieve > quota = fs:user > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > quota_warning3 = storage=60%% quota-warning 60 %u > quota_warning4 = storage=40%% quota-warning 40 %u > sieve = ~/.dovecot.sieve > sieve_before = /etc/dovecot/sieve/spam.sieve > sieve_dir = ~/sieve > sieve_global_dir = /etc/dovecot/sieve/ > } > postmaster_address = fbcadmin at fantinibakery.com > protocols = " imap lmtp sieve" > quota_full_tempfail = yes > service auth-worker { > user = $default_internal_user > } > service auth { > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = postfix > mode = 0600 > user = postfix > } > } > service imap-login { > service_count = 0 > vsz_limit = 128 M > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0660 > user = postfix > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > process_min_avail = 1 > service_count = 0 > vsz_limit = 256 M > } > service quota-warning { > executable = script /fbc/bin/mail/quota-warning.sh > user = dovecot > } > ssl = required > ssl_ca = ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol lmtp { > mail_plugins = quota sieve > } > protocol imap { > mail_max_userip_connections = 30 > mail_plugins = " quota imap_quota" > plugin { > antispam_backend = spool2dir > antispam_signature = X-DSPAM-Signature > antispam_spam = Junk > antispam_spool2dir_notspam = /var/spamtrain/not-spam/%%020lu-%u-%%05 > antispam_spool2dir_spam = /var/spamtrain/spam/%%020lu-%u-%%05 > antispam_trash = Trash > antispam_verbose_debug = 1 > } > } > protocol sieve { > mail_debug = yes > managesieve_implementation_string = Dovecot Pigeonhole > } > > Best regards and thank you for the help! > Rob > OK It looks like our dovecot setup is ok: gnutls-cli --starttls -p 4190 127.0.0.1 Processed 152 CA certificate(s). Resolving '127.0.0.1'... Connecting to '127.0.0.1:4190'... |<1>| Note that the security level of the Diffie-Hellman key exchange has been lowered to 512 bits and this may allow decryption of the session data - Simple Client Mode: "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 01:46:38 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 00:46:38 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344636852565-7786.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> Message-ID: <20120810224638.GA11918@daniel.localdomain> bmalik wrote: > i can manage read -d problem changing -p You should not do that, since the semantics of -d and -p are completely different. Argument -d ' ' sets the delimiter for reading words to space, while -p enables password mode in order to disable input echo. By simply replacing -d with -p you will most probably break the functionality of the original script. On freeBSD you're using a different default shell (sh) than the original author, so your "read" command provided by the shell behaves differently. Install bash or some other compatible shell which supports read -d and try to replace the first line of the script with #!/bin/bash or the corresponding shell executable to use another shell for the execution of the script. > what should be user rights of the postlogin_pop3.sh? The flags r (read) and x (execute) should be allowed for dovecot group, so that the mailserver can read and execute the script. Others do not need access to the script. I've set permissions for the "post-login" script as follows: -rwxr-x--- root dovecot Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 01:56:22 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 00:56:22 +0200 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <20120810225621.GA12297@daniel.localdomain> Hi Jeff, Jeff Gustafson wrote: > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > problem with both versions. > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > list of boxes every time we use 'dsync backup' to backup the server. > dsync seems to stop communicating to the backup box (over ssh). strace > just shows it sitting at a epoll_wait. Once the program quits (times > out?), a 'du' shows the destination is smaller (200kbyte in one case). > What can I do to help the developers locate the bug? Please start by following the instructions at http://dovecot.org/bugreport.html and post your 'doveconf -n' output in order to provide possibly important information about your system and configs. Regards Daniel -- https://plus.google.com/103021802792276734820 From bmalik at ihlas.net.tr Sat Aug 11 04:33:51 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Fri, 10 Aug 2012 18:33:51 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810224638.GA11918@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> Message-ID: <1344648831922-25969.post@n4.nabble.com> I started to use bash in the script and changed read -d instead of -p. Also I get the script 's rights root:dovecot I get an error; -ERR pop3 binary must not be started from inetd, use pop3-login instead. Connection closed by foreign host. Aug 11 04:30:05 pop3y dovecot: pop3(test at test.com): Post-login script denied access to user test at test.com Aug 11 04:30:05 pop3y dovecot: pop3-postlogin: Fatal: master: service(pop3-postlogin): child 15837 returned error 1 -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p25969.html Sent from the Dovecot mailing list archive at Nabble.com. From ncjeffgus at zimage.com Sat Aug 11 04:50:16 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Fri, 10 Aug 2012 18:50:16 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <20120810225621.GA12297@daniel.localdomain> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> Message-ID: <1344649816.23239.13.camel@maclinux> On Sat, 2012-08-11 at 00:56 +0200, Daniel Parthey wrote: > Hi Jeff, > Please start by following the instructions at > http://dovecot.org/bugreport.html > and post your 'doveconf -n' output in order to provide > possibly important information about your system and configs. Storage is local hardware-based RAID (SATA drives). FS is ext4. No core dump that I know of. Command used (mailbox is over 2GB): # su vmail -c "dsync -u user at domain.com backup ssh vmail at bk05 dsync -c /etc/dovecot/dovecot.conf -u user at domain.com" Config file: # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 CentOS release 6.2 (Final) auth_mechanisms = plain login default_client_limit = 15000 default_process_limit = 10000 disable_plaintext_auth = no listen = * mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib quota stats mail_uid = vmail mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User noenforcing quota::file:%h/dovecot-quota stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz } protocols = imap pop3 service auth { client_limit = 10000 unix_listener auth-userdb { mode = 0666 } } service imap-postlogin { executable = script-login /usr/bin/postlogin-imap.sh user = $default_internal_user } service imap { drop_priv_before_exec = yes executable = imap process_limit = 10000 } service pop3-postlogin { executable = script-login /usr/bin/postlogin-pop.sh user = $default_internal_user } service pop3 { drop_priv_before_exec = yes executable = pop3 process_limit = 2500 } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = Hello, is it possible to use the Solr full text search plugin for indexing mail attachments? I found a very old patch and some hints regarding a fts_decoder script that I don't understand. Making Solr indexing PDF or Office files shouldn't be that difficult, but how can I enable the plugin to transfer the attachments to Solr? Best regards, Sebastian From bmalik at ihlas.net.tr Sat Aug 11 12:36:21 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Sat, 11 Aug 2012 02:36:21 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810224638.GA11918@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> Message-ID: <1344677781012-37034.post@n4.nabble.com> is there another post-login script that i can use on freebsd ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37034.html Sent from the Dovecot mailing list archive at Nabble.com. From rafinathan25 at gmail.com Sat Aug 11 13:11:55 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Sat, 11 Aug 2012 15:41:55 +0530 Subject: [Dovecot] Exim and Dovecot Message-ID: Hi, I am installing Exim and Dovecot through yum on my Centos 5 x86_64 machine. Exim is unable to find the virtual users. Is there a full-fledged guide to get the two working. Any help is highly appreciated. Regards, Rafael From nmilas at noa.gr Sat Aug 11 16:02:39 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Sat, 11 Aug 2012 16:02:39 +0300 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50246846.6020606@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> Message-ID: <502657EF.2090600@noa.gr> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: > That begs the question, > what is your definition of a "Highly Available Mail Server"? What is it > that you actually want to accomplish? In some detail please. OK, I'll make it as much as possible accurate. Let's skip all the network stuff and see a particular scenario (as we have drafted it). We have an incoming gateway server (gw.example.com) accepting mail and filtering viruses/spam. Then it relays all (clean) mail to mail1.example.com, which uses Postfix/Dovecot (2.0 or 2.1) and provides Maildir mailboxes (POP/IMAP) to users. Now, let us assume we are deploying another server, mail2.example.com (also Postfix/Dovecot), which we want to function as follows: 1. Under normal conditions, mail2.example.com is a full mirror of mail1.example.com; when any mail message is added/viewed/moved/removed etc. to any user's folder or any folder is added/viewed/moved/removed etc. at mail1.example.com, we want it to be automatically and directly (in real time) added/viewed/moved/removed etc. to mail2.example.com too. In other words, we need continuous, real-time sync. 2. If mail1.example.com for some reason is unavailable, then we will be able to manually redirect relaying (of incoming messages) to mail2.example.com. Then, users will be able to use mail2.example.com to access their mail. Now, when mail1.example.com becomes available again, we want to: a. inform users (by sending them a mail on mail2.example.com) that mail1.example.com is available again, b. stop relaying to mail2.example.com c. sync once mailboxes on mail1.example.com to mail2.example.com (because mail2.example.com is now more current) d. redirect relaying to mail1.example.com e. switch to normal operation (see ?1 above) Can I do this and how? I would call this pseudo-HA, since users have to switch servers in case of failures. To use the above as "true" HA (as I view it), there could be a mail.example.com functioning as a proxy and automatically redirecting users to mail1 or mail2, depending on admins' choice. Can I do this too? (How?) [Google mail is not an option, we don't want external hosting. We can have as many high-performance, highly-reliable VMs as we want for free on our ISP's network - it's a service to the Greek educational/research community. They use two different specialized high-end enterprise-grade dedicated virtualization clusters of host hardware (which I -not being very accurate- called clouds) on their networks, each of which uses dedicated high-end enterprise-grade SAN-based storage. Practically we have never had VM outages due to hardware failures, only due to software (rarely) or network (mainly) ones. mail1.example.com would be deployed on the main virtualization cluster and mail2.example.com would be on the the other cluster. KVM is used as host virtualization software.] Alternative suggestions on design approaches would be welcome. Thanks and regards, Nick From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 16:50:13 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 15:50:13 +0200 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344649816.23239.13.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> <1344649816.23239.13.camel@maclinux> Message-ID: <20120811135012.GA18601@daniel.localdomain> Jeff Gustafson wrote: > On Sat, 2012-08-11 at 00:56 +0200, Daniel Parthey wrote: > > Hi Jeff, > > Please start by following the instructions at > > http://dovecot.org/bugreport.html > > and post your 'doveconf -n' output in order to provide > > possibly important information about your system and configs. > > Storage is local hardware-based RAID (SATA drives). FS is ext4. > No core dump that I know of. > Command used (mailbox is over 2GB): > > # su vmail -c "dsync -u user at domain.com backup ssh vmail at bk05 dsync -c /etc/dovecot/dovecot.conf -u user at domain.com" > > Config file: > # 2.1.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 CentOS release 6.2 > (Final) Maybe you have run into the epoll kernel bug under RHEL/CentOS: http://dovecot.org/oldnews.html Thu Mar 22 14:38:53 EET 2012 Red Hat/CentOS users: A recent kernel update causes Dovecot to start failing after it has reached 1000 child processes. To fix this, downgrade your kernel until Red Hat releases a fixed kernel. See also: https://bugzilla.redhat.com/show_bug.cgi?id=681578 You should try another kernel: https://rhn.redhat.com/errata/RHSA-2012-1129.html Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 18:19:20 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 17:19:20 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344677781012-37034.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> Message-ID: <20120811151920.GA19891@daniel.localdomain> bmalik wrote: > is there another post-login script that i can use on freebsd ? You can use virtually any executable for post-login if they communicate as expected. First you should start simple and create a post-login script consisting of just a few lines which just covers the case of "access always granted to any user". Once you got this working, you will be able to extend your script with the required denial features. Why are you executing any $DOVECOT_EXEC anyways? The example scripts at http://wiki2.dovecot.org/PostLoginScripting are just doing a exec "$@" to exec chained scripts. It seems that dovecot already executes the service binary, which then communicates with the script-login process from "imap-postlogin" service via its "imap-postlogin" socket: service imap { # tell imap to do post-login lookup using a socket called "imap-postlogin" executable = imap imap-postlogin } # The service name below doesn't actually matter. service imap-postlogin { # all post-login scripts are executed via script-login binary executable = script-login /usr/local/bin/postlogin.sh # the script process runs as the user specified here (v2.0.14+): user = $default_internal_user # this UNIX socket listener must use the same name as given to imap executable unix_listener imap-postlogin { } } Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 19:52:45 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 18:52:45 +0200 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502657EF.2090600@noa.gr> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> Message-ID: <20120811165245.GA21206@daniel.localdomain> Nikolaos Milas wrote: > On 10/8/2012 4:47 ??, Stan Hoeppner wrote: > > >That begs the question, > >what is your definition of a "Highly Available Mail Server"? What is it > >that you actually want to accomplish? In some detail please. > > 1. Under normal conditions, mail2.example.com is a full mirror of > mail1.example.com; when any mail message is > added/viewed/moved/removed etc. to any user's folder or any folder > is added/viewed/moved/removed etc. at mail1.example.com, we want it > to be automatically and directly (in real time) > added/viewed/moved/removed etc. to mail2.example.com too. In other > words, we need continuous, real-time sync. > > Can I do this and how? You might have a look at DRBD (distributed replicated block device) which provides a high available block device with fully synchronous mirroring: http://www.drbd.org/home/mirroring Dovecot can then simply work with the filesystem residing on the highly avilable DRBD volume. Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Sat Aug 11 20:11:46 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 11 Aug 2012 12:11:46 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502657EF.2090600@noa.gr> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> Message-ID: <50269252.8060508@hardwarefreak.com> On 8/11/2012 8:02 AM, Nikolaos Milas wrote: > 1. Under normal conditions, mail2.example.com is a full mirror of > mail1.example.com; when any mail message is added/viewed/moved/removed > etc. to any user's folder or any folder is added/viewed/moved/removed > etc. at mail1.example.com, we want it to be automatically and directly > (in real time) added/viewed/moved/removed etc. to mail2.example.com too. > In other words, we need continuous, real-time sync. There are 3 ways to do this, all require a form of shared storage: 1. A cluster filesystem atop shared storage 2. DRBD mirroring with a cluster filesystem atop 3. NFS #1 won't work in a VPS "cloud" unless the provider gives you direct access to an iSCSI SAN LUN. #2 might but you'll be in uncharted waters. #3 will work in a VPS cloud, but the host serving NFS is a single point of failure. DRBD mirroring is typically done with an X-over cable between the two nodes. If the packets must traverse a WAN link, or an internal network that experiences any packet loss, DRBD will have problems. You'll need to make sure fencing is working properly which entails lots of testing before going into production. http://www.drbd.org/ Pick DRBD expert's brains to determine if doing it over a VPS LAN is possible/feasible. > 2. If mail1.example.com for some reason is unavailable, then we will be > able to manually redirect relaying (of incoming messages) to > mail2.example.com. When setup properly no manual intervention is necessary. Everything is automatic. If one of the two Dovecot/DRBD nodes is down mail is automatically relayed to the other. This is done by putting putting a Postfix instance on each cluster node with equal priority MX records for both. So instead of having two MX relay/AS/AV servers and two Dovecot mailbox servers, you have once instance of everything on each of two nodes. I.e. Postfix+amavisd+SA+Dovecot+etc on each node. Equal priority MX will route inbound mail fairly evenly between both nodes. If one MX is unreachable, remote SMTP clients will retry the other MX. It's fully automatic. You may want to install Dovecot director on one of the nodes so IMAP connections are spread evenly and to avoid mailbox locking/delay issues. > Then, users will be able to use mail2.example.com to > access their mail. Now, when mail1.example.com becomes available again, > we want to: > a. inform users (by sending them a mail on mail2.example.com) that > mail1.example.com is available again, > b. stop relaying to mail2.example.com > c. sync once mailboxes on mail1.example.com to mail2.example.com > (because mail2.example.com is now more current) > d. redirect relaying to mail1.example.com > e. switch to normal operation (see ?1 above) Again, all of this is unnecessary, as it's fully automatic when done properly. > Can I do this and how? Writing you a complete design document for doing this is beyond the scope of a mailing list thread. There exists plenty of documentation on the web. You will have to do your own research, but I've pointed you in the right direction. There are people on this list using a configuration almost identical to this, but not with VPS, though I am not one of them. When you are far enough along in the process and have specific questions I'm sure others will be glad to help. > I would call this pseudo-HA, since users have to switch servers in case > of failures. To use the above as "true" HA (as I view it), there could > be a mail.example.com functioning as a proxy and automatically > redirecting users to mail1 or mail2, depending on admins' choice. Can I > do this too? (How?) See Dovecot director: http://wiki2.dovecot.org/Director > [Google mail is not an option, we don't want external hosting. We can > have as many high-performance, highly-reliable VMs as we want for free > on our ISP's network - it's a service to the Greek educational/research > community. They use two different specialized high-end enterprise-grade > dedicated virtualization clusters of host hardware (which I -not being > very accurate- called clouds) on their networks, each of which uses > dedicated high-end enterprise-grade SAN-based storage. Practically we > have never had VM outages due to hardware failures, only due to software > (rarely) or network (mainly) ones. mail1.example.com would be deployed > on the main virtualization cluster and mail2.example.com would be on the > the other cluster. KVM is used as host virtualization software.] The approach I outlined above may work, as long as the network is reliable enough to keep DRBD happy. Once built you will obviously want to test the setup with a simulated real world workload for a few weeks to a month in order to confirm the network is reliable enough to support DRBD, before attempting full live deployment. But this is true of any new back end services deployment. I dunno if Eric Rostetter is still around. He's got a very similar setup running at UT Austin, but on two dedicated servers, not VPS. He could probably give you some pointers if you run into design/config trouble: http://www.ph.utexas.edu/person/rostetter_eric I'm sure there are others with a very similar setup on this list. -- Stan From stan at hardwarefreak.com Sat Aug 11 20:18:18 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 11 Aug 2012 12:18:18 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <20120811165245.GA21206@daniel.localdomain> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <20120811165245.GA21206@daniel.localdomain> Message-ID: <502693DA.7020202@hardwarefreak.com> On 8/11/2012 11:52 AM, Daniel Parthey wrote: > Nikolaos Milas wrote: >> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: >> >>> That begs the question, >>> what is your definition of a "Highly Available Mail Server"? What is it >>> that you actually want to accomplish? In some detail please. >> >> 1. Under normal conditions, mail2.example.com is a full mirror of >> mail1.example.com; when any mail message is >> added/viewed/moved/removed etc. to any user's folder or any folder >> is added/viewed/moved/removed etc. at mail1.example.com, we want it >> to be automatically and directly (in real time) >> added/viewed/moved/removed etc. to mail2.example.com too. In other >> words, we need continuous, real-time sync. >> >> Can I do this and how? > > You might have a look at DRBD (distributed replicated block device) > which provides a high available block device with fully synchronous > mirroring: > > http://www.drbd.org/home/mirroring > > Dovecot can then simply work with the filesystem residing on > the highly avilable DRBD volume. But to be clear, for a true HA setup with full active/active nodes, this must be a cluster filesystem (GFS2/OCFS2). -- Stan From rob at fantinibakery.com Sat Aug 11 20:43:52 2012 From: rob at fantinibakery.com (rob) Date: Sat, 11 Aug 2012 13:43:52 -0400 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502693DA.7020202@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <20120811165245.GA21206@daniel.localdomain> <502693DA.7020202@hardwarefreak.com> Message-ID: <502699D8.3050306@fantinibakery.com> On 08/11/2012 01:18 PM, Stan Hoeppner wrote: > On 8/11/2012 11:52 AM, Daniel Parthey wrote: >> Nikolaos Milas wrote: >>> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: >>> >>>> That begs the question, >>>> what is your definition of a "Highly Available Mail Server"? What is it >>>> that you actually want to accomplish? In some detail please. >>> 1. Under normal conditions, mail2.example.com is a full mirror of >>> mail1.example.com; when any mail message is >>> added/viewed/moved/removed etc. to any user's folder or any folder >>> is added/viewed/moved/removed etc. at mail1.example.com, we want it >>> to be automatically and directly (in real time) >>> added/viewed/moved/removed etc. to mail2.example.com too. In other >>> words, we need continuous, real-time sync. >>> >>> Can I do this and how? >> You might have a look at DRBD (distributed replicated block device) >> which provides a high available block device with fully synchronous >> mirroring: >> >> http://www.drbd.org/home/mirroring >> >> Dovecot can then simply work with the filesystem residing on >> the highly avilable DRBD volume. > But to be clear, for a true HA setup with full active/active nodes, this > must be a cluster filesystem (GFS2/OCFS2). > A good solution for kvm + drbd is this: http://pve.proxmox.com/wiki/Two-Node_High_Availability_Cluster From bmalik at ihlas.net.tr Sun Aug 12 16:44:43 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Sun, 12 Aug 2012 06:44:43 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120811151920.GA19891@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> Message-ID: <1344779083953-37043.post@n4.nabble.com> Thank you I wrote a loginscript in bash. it works well. I can restrict a user by IP. Well , how can i restrict a particular email address by tcp port ? I want a particular mail address to be forced to use pop3s/imaps. I use vpopmail / dovecot2 -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37043.html Sent from the Dovecot mailing list archive at Nabble.com. From madduck at debian.org Sun Aug 12 20:26:10 2012 From: madduck at debian.org (martin f krafft) Date: Sun, 12 Aug 2012 19:26:10 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120809122351.GA26800@albatross.gern.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> <20120809122351.GA26800@albatross.gern.madduck.net> Message-ID: <20120812172610.GA2741@fishbowl.rw.madduck.net> also sprach martin f krafft [2012.08.09.1423 +0200]: > and then put the following sieve script into /etc/dovecot/sieve.before.d/spamassassin.sieve: > > require [ "vnd.dovecot.filter" ]; > filter "spamc" [ "--no-safe-fallback" ]; > > and then ran > > sievec spamassassin.sieve && chmod 444 spamassassin.svbin > > To tell the LDA where to find the spamc filter, I added (to > 90-sieve.conf): > > sieve_filter_bin_dir = /etc/dovecot/sieve-filter > > and symlinked spamc there > > ln -s /usr/bin/spamc /etc/dovecot/sieve-filter/spamc Btw, this won't work reliably. The reason is that vnd.dovecot.filter currently requires the filter executable to soak up all of the input before it even bothers reading its output. Under certain conditions, however ? for instance when the input is larger than the SpamAssassin max_size setting, spamc just pipes input to output, without buffering. This would yield a deadlock because vnd.dovecot.filter would not be reading output yet but still be writing input, whereas spamc would no longer be willing to handle input while its output was not being read. Stephan Bosch has indicated a solution to this problem (asynchronous IO), but until that's in place, I simply put the following shell script in place: -----8<----8<----8<----- #!/bin/sh set -eu TMPFILE=$(tempfile -p spamc) cleanup() { rm -f $TMPFILE; trap - EXIT; } trap cleanup EXIT cat > $TMPFILE spamc -x < $TMPFILE cleanup -----8<----8<----8<----- This is ugly because Dovecot itself may already have spooled the mail message to disk (if it was too large for in-memory buffering), and now we're spooling it a second time. Asynchronous IO will alleviate this need for the second roundtrip via the filesystem. Hope this helps, -- .''`. martin f. krafft Related projects: : :' : proud Debian developer http://debiansystem.info `. `'` http://people.debian.org/~madduck http://vcs-pkg.org `- Debian - when you have better things to do than fixing systems -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From daniel.parthey at informatik.tu-chemnitz.de Mon Aug 13 02:13:07 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 13 Aug 2012 01:13:07 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344779083953-37043.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> Message-ID: <20120812231307.GA11093@daniel.localdomain> bmalik wrote: > I wrote a loginscript in bash. it works well. I can restrict a user by IP. > how can i restrict a particular email address by tcp port ? > I want a particular mail address to be forced to use pop3s/imaps. What's your doveconf -n output, please? Are you using SQL or LDAP for user lookup? You probably should do the filtering already in your userdb/authdb lookup queries, since Variable %a or %{lport} which contains the local port is only available in Dovecot-Auth according to http://wiki2.dovecot.org/Variables Regards Daniel -- https://plus.google.com/103021802792276734820 From ibrahim.harrani at gmail.com Mon Aug 13 11:24:57 2012 From: ibrahim.harrani at gmail.com (Ibrahim Harrani) Date: Mon, 13 Aug 2012 11:24:57 +0300 Subject: [Dovecot] master user auth problem Message-ID: Hi, I tried to setup a master auth authentication. I also use auth_pop3wrapper to authenticate from qmail-ldap. But I could not login with master user. Here is the config. auth_master_user_separator = * passdb { driver = passwd-file args = /usr/local/etc/dovecot/passwd.masterusers master = yes pass = yes } passdb { # Path for checkpassword binary driver = checkpassword args = /var/qmail/bin/auth_popwrapper } userdb { driver = prefetch } cat /opt/surmail/etc/dovecot/passwd.masterusers user:{SHA}W6ph5Mm5Pz8GgiULbPgzG37mj9g= The log: #telnet localhost 143 Trying 0.0.0.0... Connected to 0. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] SurGATE Messaging Suite POP3/IMAP ready. o login user at domain.com*user password o NO [AUTHORIZATIONFAILED] Authorization failed Aug 09 16:17:44 auth: Debug: auth(user,127.0.0.1,master,): Master user lookup for login: user at domain.com Aug 09 16:17:44 auth: Debug: passwd-file(user,127.0.0.1,master,): lookup: user=user file= /usr/local/etc/dovecot/passwd.masterusers Aug 09 16:17:44 auth: Info: passdb(user,127.0.0.1,master,): Master user logging in as user at domain.com Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): execute: /var/qmail/bin/auth_popwrapper /usr/local/dovecot/libexec/dovecot/checkpassword-reply Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): Received input: Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): exit_status=3 Aug 09 16:17:44 auth: Info: checkpassword(user at domain.com,127.0.0.1,): Login failed (status=3) Aug 09 16:17:46 auth: Debug: client out: FAIL 1 user=user at domain.com authz Aug 09 16:18:08 auth: Debug: client in: AUTH 2 PLAIN service=imap secured session=KmGNDdXGrwB/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=48047 resp= From bmalik at ihlas.net.tr Mon Aug 13 12:54:43 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 02:54:43 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <1344851683428-37047.post@n4.nabble.com> hello how can i do a login script by tcp port ? I use cdb database my dovecot.conf -n; # doveconf -n # 2.1.8: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.2-RELEASE amd64 auth_mechanisms = plain login digest-md5 cram-md5 apop disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 login_greeting = Dovecot ready2. mail_gid = 89 mail_plugin_dir = /usr/lib/dovecot mail_uid = 89 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = webmail=127.0.0.1 driver = vpopmail } protocols = imap pop3 service pop3-postlogin { executable = script-login /usr/local/bin/postlogin_pop3.sh user = root } service pop3 { executable = pop3 pop3-postlogin } ssl = no userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol imap { mail_max_userip_connections = 20 } protocol pop3 { mail_max_userip_connections = 20 } -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37047.html Sent from the Dovecot mailing list archive at Nabble.com. From CMarcus at Media-Brokers.com Mon Aug 13 13:27:25 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 13 Aug 2012 06:27:25 -0400 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <5028D68D.5090604@Media-Brokers.com> On 2012-08-12 7:13 PM, Daniel Parthey wrote: > bmalik wrote: >> I wrote a loginscript in bash. it works well. I can restrict a user by IP. >> how can i restrict a particular email address by tcp port ? >> I want a particular mail address to be forced to use pop3s/imaps. > What's your doveconf -n output, please? > Are you using SQL or LDAP for user lookup? > > You probably should do the filtering already in your > userdb/authdb lookup queries, since Variable %a or %{lport} > which contains the local port is only available in > Dovecot-Auth according to http://wiki2.dovecot.org/Variables Or you could use something like: http://wiki2.dovecot.org/Authentication/RestrictAccess -- Best regards, Charles From voytek at sbt.net.au Mon Aug 13 14:12:14 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Mon, 13 Aug 2012 21:12:14 +1000 Subject: [Dovecot] imap-login process_limit (100) reached, client connections are being dropped Message-ID: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> noticed this in the log today, after about 11 warning IMAP appears to have not worked, 'service dovecot reload' got it going again question: what to check/alter ? ---------------- # grep process_limit /var/log/maillog Aug 13 15:31:44 geko dovecot: master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped ''' Aug 13 20:45:35 geko dovecot: master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped # doveconf -n | grep limit # # dovecot --version 2.1.1 # ps ax | grep imap | wc 109 546 4693 # ps ax | grep imap-login | wc 57 286 2619 # doveadm who | wc 16 122 1531 centos 6, 20 virtual domains, 100 users -- Voytek Eymont From bmalik at ihlas.net.tr Mon Aug 13 14:34:44 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 04:34:44 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <5028D68D.5090604@Media-Brokers.com> References: <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> <5028D68D.5090604@Media-Brokers.com> Message-ID: <1344857684827-37050.post@n4.nabble.com> Ok where do i have to locate the passwd-file in dovecot2 i use vpopmail and dovecot2. -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37050.html Sent from the Dovecot mailing list archive at Nabble.com. From nmilas at noa.gr Mon Aug 13 15:08:14 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Mon, 13 Aug 2012 15:08:14 +0300 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50269252.8060508@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <50269252.8060508@hardwarefreak.com> Message-ID: <5028EE2E.9040305@noa.gr> On 11/8/2012 8:11 ??, Stan Hoeppner wrote: > Writing you a complete design document for doing this is beyond the > scope of a mailing list thread. There exists plenty of documentation on > the web. You will have to do your own research, but I've pointed you in > the right direction. Thank you Stan and everyone else who contributed on this subject. I'll research further. Your info has been very enlightening. Thanks again, Nick From tss at iki.fi Mon Aug 13 15:40:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 13 Aug 2012 15:40:58 +0300 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more Message-ID: <1344861658.13571.10.camel@hurina> v2.2 hg now has support for NOTIFY extension. The only thing missing is support for SubscriptionChange events. Now would be a good time for IMAP clients to start implementing and testing it. :) I remember K9 developers at least said they were just waiting for Dovecot to support it first. v2.2 implements some other extensions also: BINARY, CATENATE and MOVE. Stephan has also implemented URLAUTH pretty far. Hopefully it gets finished in time for v2.2.0. I'll also try to implement the rest of the LEMONADE extensions: CONVERT, CONTEXT=SORT and URLAUTH=BINARY. I'm also considering implementing an SMTP submission server, which works only as a proxy to the real SMTP server. The benefits of it would mainly be: * It could support BURL command and other extensions required by LEMONADE. The real SMTP server would see only regular DATA commands. * Would make SMTP AUTH easy to implement regardless of what the real SMTP server is. From tonio at starbridge.org Mon Aug 13 18:40:03 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Mon, 13 Aug 2012 17:40:03 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> Message-ID: <50291FD3.30908@starbridge.org> Le 10/08/2012 01:34, Timo Sirainen a ?crit : > Actually it wasn't that obvious: > http://hg.dovecot.org/dovecot-2.1/rev/b082b8260782 plus > http://hg.dovecot.org/dovecot-2.1/rev/9d0873cefa08 Thanks Timo, it's working fine now Best regards Tonio Buonaguidi From p.pridt at chello.at Mon Aug 13 18:18:05 2012 From: p.pridt at chello.at (ppridt) Date: Mon, 13 Aug 2012 08:18:05 -0700 (PDT) Subject: [Dovecot] Permission denied on dovecot.lda-dupes Message-ID: <1344871085776-37053.post@n4.nabble.com> Hi, I have converted my Imap Server from Courier to Dovecot in order to use sieve support. Everything works fine with the exception that the sender always gets the vacation msg since there is a permission error on writing of dovecot.lda-dupes. I've tried several version of permissions including 777 to both home and maildir - always the same result. I also googled for hours .. Any help will be appreciated. Paul This is the debug log: ----------------------------------------------------------------------------------------------------- Aug 13 14:51:26 Srv dovecot: deliver(pp): Loading modules from directory: /usr/lib/dovecot/modules/lda Aug 13 14:51:26 Srv dovecot: deliver(pp): Module loaded: /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so Aug 13 14:51:26 Srv dovecot: deliver(pp): Home dir not found: Aug 13 14:51:26 Srv dovecot: deliver(pp): maildir: data=/Daten/Vmail/pp/Maildir Aug 13 14:51:26 Srv dovecot: deliver(pp): maildir++: root=/Daten/Vmail/pp/Maildir, index=, control=, inbox=/Daten/Vmail/pp/Maildir Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: using sieve path for user's script: /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: opening script /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: executing compiled script /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): Namespace : Using permissions from /Daten/Vmail/pp/Maildir: mode=0700 gid=-1 Aug 13 14:51:26 Srv dovecot: deliver(pp): file_dotlock_create(/.dovecot.lda-dupes) failed: Permission denied ----------------------------------------------------------------------------------------------------- This ist my dovecot.conf: ----------------------------------------------------------------------------------------------------- protocols = imap imaps managesieve mail_debug = yes log_path = info_log_path = disable_plaintext_auth = no # Authentication configuration: mail_location = maildir:/Daten/Vmail/%u/Maildir auth_verbose = yes mail_nfs_storage = no mail_nfs_index = no nfs_check = no lock_method = dotlock mail_uid = vmail mail_gid = vmail auth default { mechanisms = plain login passdb pam { } userdb passwd { args = uid=vmail gid=vmail home=/home/%u mail=maildir:/Daten/Vmail/%u/Maildir } socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 user = vmail } } } protocol lda { postmaster_address = admin at ppridt.dnsalias.org mail_plugins = sieve auth_socket_path = /var/run/dovecot/auth-master } protocol managesieve { login_executable = /usr/lib/dovecot/managesieve-login mail_executable = /usr/lib/dovecot/managesieve managesieve_implementation_string = Cyrus timsieved v2.2.13 } plugin { sieve=/Daten/Vmail/%u/.dovecot.sieve sieve_dir=/Daten/Vmail/%u/.sieve } ----------------------------------------------------------------------------------------------------- This is the exim delivery transport: ----------------------------------------------------------------------------------------------------- dovecot_lda: driver = pipe command = /usr/lib/dovecot/deliver message_prefix = message_suffix = log_output delivery_date_add envelope_to_add return_path_add user = vmail group = vmail temp_errors = 64 : 69 : 70: 71 : 72 : 73 : 74 : 75 : 78 ----------------------------------------------------------------------------------------------------- -- View this message in context: http://dovecot.2317879.n4.nabble.com/Permission-denied-on-dovecot-lda-dupes-tp37053.html Sent from the Dovecot mailing list archive at Nabble.com. From c at roessner-network-solutions.com Mon Aug 13 21:15:45 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Mon, 13 Aug 2012 20:15:45 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Message-ID: Hi, >>>> doveadm import mdbox:~/mdbox-backup all-mails all >>> >>> problem >>> >>> I tried so, but this does not work here: >> >> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >> >> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >> > done > > And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? > I tested today with Dovecot 2.1.9. Still not getting mails imported :-( How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? Many thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From p at state-of-mind.de Mon Aug 13 21:27:37 2012 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Mon, 13 Aug 2012 20:27:37 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <1344861658.13571.10.camel@hurina> References: <1344861658.13571.10.camel@hurina> Message-ID: <20120813182736.GB11223@state-of-mind.de> * Timo Sirainen : > I'm also considering implementing an SMTP submission server, which works > only as a proxy to the real SMTP server. The benefits of it would mainly > be: > > * It could support BURL command and other extensions required by > LEMONADE. The real SMTP server would see only regular DATA commands. > * Would make SMTP AUTH easy to implement regardless of what the real > SMTP server is. Nice move! Especially since I recall Wietse being not very inclined to implement anything alike. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From CMarcus at Media-Brokers.com Mon Aug 13 21:52:11 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 13 Aug 2012 14:52:11 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <20120813182736.GB11223@state-of-mind.de> References: <1344861658.13571.10.camel@hurina> <20120813182736.GB11223@state-of-mind.de> Message-ID: <50294CDB.2010800@Media-Brokers.com> On 2012-08-13 2:27 PM, Patrick Ben Koetter

wrote: > * Timo Sirainen: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: >> >> * It could support BURL command and other extensions required by >> LEMONADE. The real SMTP server would see only regular DATA commands. >> * Would make SMTP AUTH easy to implement regardless of what the real >> SMTP server is. > > Nice move! Especially since I recall Wietse being not very inclined to > implement anything alike. Amen to that! This is a feature request I made a long time ago (I called it the dovecot LSA for Local Submission Agent), and I'm *very* glad that soon I'll be able to tell all my clients they can uncheck the 'Save copy of Sent messages' option for good... :) Thanks Timo!! -- Best regards, Charles From ncjeffgus at zimage.com Mon Aug 13 22:17:47 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Mon, 13 Aug 2012 12:17:47 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <20120811135012.GA18601@daniel.localdomain> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> <1344649816.23239.13.camel@maclinux> <20120811135012.GA18601@daniel.localdomain> Message-ID: <1344885467.19606.3.camel@maclinux> On Sat, 2012-08-11 at 15:50 +0200, Daniel Parthey wrote: > Maybe you have run into the epoll kernel bug under RHEL/CentOS: > :) Yeah... been there, done that. We found that bug within *minutes* of ksplice updating the kernel. I don't think this is an epoll thing because, if it was, customers wouldn't be able to connect to our services. I think there is something else going on. I think it is a bug, but I suppose it could be a setting somewhere. Something is timing out or getting stuck. ...Jeff From chris at arachsys.com Mon Aug 13 19:12:51 2012 From: chris at arachsys.com (Chris Webb) Date: Mon, 13 Aug 2012 17:12:51 +0100 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting Message-ID: <20120813161251.GB14149@arachsys.com> Sharing an installed copy of dovecot between several users each running a daemon within their own account (or using the same binaries for a system daemon and a user daemon) is difficult because the compile-time directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the location of things like the ssl-parameters.dat file and the replicator database. Replace all these uses of PKG_STATEDIR with a state_dir setting which defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the same way base_dir can be used to override PKG_RUNDIR. Signed-off-by: --- src/config/Makefile.am | 1 - src/doveadm/doveadm-instance.c | 10 ++++------ src/doveadm/doveadm-mount.c | 3 +-- src/doveadm/doveadm-settings.c | 2 -- src/doveadm/doveadm-settings.h | 1 - src/lib-master/master-instance.h | 2 ++ src/lib-master/master-service-settings.c | 2 -- src/lib-master/master-service-settings.h | 1 - src/lib-master/master-service.c | 6 ++---- src/login-common/ssl-proxy-openssl.c | 3 ++- src/master/main.c | 11 ++++------- src/master/master-settings.c | 6 ++---- src/master/master-settings.h | 1 - src/replication/replicator/replicator-settings.c | 2 -- src/replication/replicator/replicator-settings.h | 1 - src/replication/replicator/replicator.c | 16 +++++----------- src/ssl-params/main.c | 5 ++--- src/ssl-params/ssl-params-settings.c | 2 -- src/ssl-params/ssl-params-settings.h | 1 - 19 files changed, 24 insertions(+), 52 deletions(-) diff --git a/src/config/Makefile.am b/src/config/Makefile.am --- a/src/config/Makefile.am +++ b/src/config/Makefile.am @@ -9,6 +9,7 @@ -I$(top_srcdir)/src/lib-settings \ -I$(top_srcdir)/src/lib-master \ -DPKG_RUNDIR=\""$(rundir)"\" \ + -DPKG_STATEDIR=\""$(statedir)"\" \ -DPKG_LIBEXECDIR=\""$(pkglibexecdir)"\" \ -DEXAMPLE_CONFIG_DIR=\""$(exampledir)"\" \ -DMODULEDIR=\""$(moduledir)"\" \ diff --git a/src/doveadm/doveadm-instance.c b/src/doveadm/doveadm-instance.c --- a/src/doveadm/doveadm-instance.c +++ b/src/doveadm/doveadm-instance.c @@ -48,7 +48,7 @@ struct master_instance_list *list; struct master_instance_list_iter *iter; const struct master_instance *inst; - const char *pidfile_path; + const char *instance_path, *pidfile_path; bool show_config = FALSE; int c; @@ -71,7 +71,8 @@ doveadm_print_header_simple("running"); } - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(doveadm_settings->state_dir, "/instances", NULL); + list = master_instance_list_init(instance_path); iter = master_instance_list_iterate_init(list); while ((inst = master_instance_iterate_list_next(iter)) != NULL) { if (argv[0] != NULL && strcmp(argv[0], inst->name) != 0) @@ -99,13 +100,14 @@ { struct master_instance_list *list; const struct master_instance *inst; - const char *base_dir; + const char *base_dir, *instance_path; int ret; if (argc != 2) instance_cmd_help(cmd_instance_remove); - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(doveadm_settings->state_dir, "/instances", NULL); + list = master_instance_list_init(instance_path); inst = master_instance_list_find_by_name(list, argv[1]); base_dir = inst != NULL ? inst->base_dir : argv[1]; if ((ret = master_instance_list_remove(list, base_dir)) < 0) { diff --git a/src/doveadm/doveadm-mount.c b/src/doveadm/doveadm-mount.c --- a/src/doveadm/doveadm-mount.c +++ b/src/doveadm/doveadm-mount.c @@ -13,7 +13,8 @@ { const char *perm_path, *state_path; - perm_path = t_strconcat(PKG_STATEDIR"/"MOUNTPOINT_LIST_FNAME, NULL); + perm_path = t_strconcat(doveadm_settings->state_dir, + "/"MOUNTPOINT_LIST_FNAME, NULL); state_path = t_strconcat(doveadm_settings->base_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); return mountpoint_list_init(perm_path, state_path); diff --git a/src/doveadm/doveadm-settings.c b/src/doveadm/doveadm-settings.c --- a/src/doveadm/doveadm-settings.c +++ b/src/doveadm/doveadm-settings.c @@ -53,6 +53,7 @@ static const struct setting_define doveadm_setting_defines[] = { DEF(SET_STR, base_dir), + DEF(SET_STR, state_dir), DEF(SET_STR, mail_plugins), DEF(SET_STR, mail_plugin_dir), DEF(SET_STR, doveadm_socket_path), @@ -70,6 +71,7 @@ const struct doveadm_settings doveadm_default_settings = { .base_dir = PKG_RUNDIR, + .state_dir = PKG_STATEDIR, .mail_plugins = "", .mail_plugin_dir = MODULEDIR, .doveadm_socket_path = "doveadm-server", diff --git a/src/doveadm/doveadm-settings.h b/src/doveadm/doveadm-settings.h --- a/src/doveadm/doveadm-settings.h +++ b/src/doveadm/doveadm-settings.h @@ -3,6 +3,7 @@ struct doveadm_settings { const char *base_dir; + const char *state_dir; const char *mail_plugins; const char *mail_plugin_dir; const char *doveadm_socket_path; diff --git a/src/lib-master/master-instance.h b/src/lib-master/master-instance.h --- a/src/lib-master/master-instance.h +++ b/src/lib-master/master-instance.h @@ -1,8 +1,6 @@ #ifndef MASTER_INSTANCE_H #define MASTER_INSTANCE_H -#define MASTER_INSTANCE_PATH PKG_STATEDIR"/instances" - struct master_instance_list; struct master_instance { diff --git a/src/lib-master/master-service-settings.c b/src/lib-master/master-service-settings.c --- a/src/lib-master/master-service-settings.c +++ b/src/lib-master/master-service-settings.c @@ -33,6 +33,7 @@ master_service_settings_check(void *_set, pool_t pool, const char **error_r); static const struct setting_define master_service_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_STR, log_path), DEF(SET_STR, info_log_path), DEF(SET_STR, debug_log_path), @@ -47,6 +48,7 @@ }; static const struct master_service_settings master_service_default_settings = { + .state_dir = PKG_STATEDIR, .log_path = "syslog", .info_log_path = "", .debug_log_path = "", diff --git a/src/lib-master/master-service-settings.h b/src/lib-master/master-service-settings.h --- a/src/lib-master/master-service-settings.h +++ b/src/lib-master/master-service-settings.h @@ -7,6 +7,7 @@ struct master_service; struct master_service_settings { + const char *state_dir; const char *log_path; const char *info_log_path; const char *debug_log_path; diff --git a/src/lib-master/master-service.c b/src/lib-master/master-service.c --- a/src/lib-master/master-service.c +++ b/src/lib-master/master-service.c @@ -332,9 +332,11 @@ { struct master_instance_list *list; const struct master_instance *inst; - const char *path; + const char *instance_path, *path; - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(master_service->set->state_dir, + "/instances", NULL); + list = master_instance_list_init(instance_path); inst = master_instance_list_find_by_name(list, name); if (inst != NULL) { path = t_strdup_printf("%s/dovecot.conf", inst->base_dir); diff --git a/src/login-common/ssl-proxy-openssl.c b/src/login-common/ssl-proxy-openssl.c --- a/src/login-common/ssl-proxy-openssl.c +++ b/src/login-common/ssl-proxy-openssl.c @@ -152,8 +152,7 @@ static void ssl_params_corrupted(void) { - i_fatal("Corrupted SSL parameters file: " - PKG_STATEDIR"/ssl-parameters.dat"); + i_fatal("Corrupted SSL parameters file: ssl-parameters.dat"); } static void read_next(struct ssl_parameters *params, void *data, size_t size) diff --git a/src/master/main.c b/src/master/main.c --- a/src/master/main.c +++ b/src/master/main.c @@ -311,7 +311,7 @@ struct mountpoint_list *mountpoints; const char *perm_path, *state_path; - perm_path = t_strconcat(PKG_STATEDIR"/"MOUNTPOINT_LIST_FNAME, NULL); + perm_path = t_strconcat(set->state_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); state_path = t_strconcat(set->base_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); mountpoints = mountpoint_list_init(perm_path, state_path); @@ -340,9 +340,12 @@ instance_update_now, list); } -static void instance_update(void) +static void instance_update(const struct master_settings *set) { - instances = master_instance_list_init(MASTER_INSTANCE_PATH); + const char *path; + + path = t_strconcat(set->state_dir, "/instances", NULL); + instances = master_instance_list_init(path); instance_update_now(instances); } @@ -538,7 +541,7 @@ create_pid_file(pidfile_path); create_config_symlink(set); mountpoints_update(set); - instance_update(); + instance_update(set); services_monitor_start(services); } diff --git a/src/master/master-settings.c b/src/master/master-settings.c --- a/src/master/master-settings.c +++ b/src/master/master-settings.c @@ -171,6 +171,7 @@ static const struct setting_define master_setting_defines[] = { DEF(SET_STR, base_dir), + DEF(SET_STR, state_dir), DEF(SET_STR, libexec_dir), DEF(SET_STR, instance_name), DEF(SET_STR, import_environment), @@ -211,6 +212,7 @@ static const struct master_settings master_default_settings = { .base_dir = PKG_RUNDIR, + .state_dir = PKG_STATEDIR, .libexec_dir = PKG_LIBEXECDIR, .instance_name = PACKAGE, .import_environment = "TZ" ENV_SYSTEMD ENV_GDB, @@ -737,8 +739,8 @@ } /* Make sure our permanent state directory exists */ - if (mkdir_parents(PKG_STATEDIR, 0750) < 0 && errno != EEXIST) { - i_error("mkdir(%s) failed: %m", PKG_STATEDIR); + if (mkdir_parents(set->state_dir, 0750) < 0 && errno != EEXIST) { + i_error("mkdir(%s) failed: %m", set->state_dir); return FALSE; } diff --git a/src/master/master-settings.h b/src/master/master-settings.h --- a/src/master/master-settings.h +++ b/src/master/master-settings.h @@ -5,6 +5,7 @@ struct master_settings { const char *base_dir; + const char *state_dir; const char *libexec_dir; const char *instance_name; const char *import_environment; diff --git a/src/replication/replicator/replicator-settings.c b/src/replication/replicator/replicator-settings.c --- a/src/replication/replicator/replicator-settings.c +++ b/src/replication/replicator/replicator-settings.c @@ -49,6 +49,7 @@ { type, #name, offsetof(struct replicator_settings, name), NULL } static const struct setting_define replicator_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_STR, auth_socket_path), DEF(SET_STR, doveadm_socket_path), @@ -59,6 +60,7 @@ }; const struct replicator_settings replicator_default_settings = { + .state_dir = PKG_STATEDIR, .auth_socket_path = "auth-userdb", .doveadm_socket_path = "doveadm-server", diff --git a/src/replication/replicator/replicator-settings.h b/src/replication/replicator/replicator-settings.h --- a/src/replication/replicator/replicator-settings.h +++ b/src/replication/replicator/replicator-settings.h @@ -2,6 +2,7 @@ #define REPLICATOR_SETTINGS_H struct replicator_settings { + const char *state_dir; const char *auth_socket_path; const char *doveadm_socket_path; diff --git a/src/replication/replicator/replicator.c b/src/replication/replicator/replicator.c --- a/src/replication/replicator/replicator.c +++ b/src/replication/replicator/replicator.c @@ -13,7 +13,6 @@ #define REPLICATOR_AUTH_SERVICE_NAME "replicator" #define REPLICATOR_DB_DUMP_INTERVAL_MSECS (1000*60*15) -#define REPLICATOR_DB_PATH PKG_STATEDIR"/replicator.db" static struct replicator_queue *queue; static struct replicator_brain *brain; @@ -32,7 +31,7 @@ struct auth_master_user_list_ctx *ctx; struct auth_user_info user_info; struct replicator_user *user; - const char *username; + const char *db_path, *username; auth_conn = auth_master_init(set->auth_socket_path, AUTH_MASTER_FLAG_NO_IDLE_TIMEOUT); @@ -53,12 +52,16 @@ auth_master_deinit(&auth_conn); /* add updates from replicator db, if it exists */ - (void)replicator_queue_import(queue, REPLICATOR_DB_PATH); + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_import(queue, db_path); } static void replicator_dump_timeout(void *context ATTR_UNUSED) { - (void)replicator_queue_export(queue, REPLICATOR_DB_PATH); + const char *db_path; + + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_export(queue, db_path); } static void main_init(void) @@ -77,10 +80,13 @@ static void main_deinit(void) { + const char *db_path; + notify_connections_destroy_all(); replicator_brain_deinit(&brain); timeout_remove(&to_dump); - (void)replicator_queue_export(queue, REPLICATOR_DB_PATH); + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_export(queue, db_path); replicator_queue_deinit(&queue); } diff --git a/src/ssl-params/main.c b/src/ssl-params/main.c --- a/src/ssl-params/main.c +++ b/src/ssl-params/main.c @@ -112,11 +112,12 @@ static void main_init(const struct ssl_params_settings *set) { + const char *filename; lib_signals_set_handler(SIGCHLD, LIBSIG_FLAGS_SAFE, sig_chld, NULL); ssl_params = buffer_create_dynamic(default_pool, 1024); - param = ssl_params_init(PKG_STATEDIR"/"SSL_BUILD_PARAM_FNAME, - ssl_params_callback, set); + filename = t_strconcat(set->state_dir, "/"SSL_BUILD_PARAM_FNAME, NULL); + param = ssl_params_init(filename, ssl_params_callback, set); } static void main_deinit(void) diff --git a/src/ssl-params/ssl-params-settings.c b/src/ssl-params/ssl-params-settings.c --- a/src/ssl-params/ssl-params-settings.c +++ b/src/ssl-params/ssl-params-settings.c @@ -58,12 +58,14 @@ { type, #name, offsetof(struct ssl_params_settings, name), NULL } static const struct setting_define ssl_params_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_TIME, ssl_parameters_regenerate), SETTING_DEFINE_LIST_END }; static const struct ssl_params_settings ssl_params_default_settings = { + .state_dir = PKG_STATEDIR, .ssl_parameters_regenerate = 3600*24*7 }; diff --git a/src/ssl-params/ssl-params-settings.h b/src/ssl-params/ssl-params-settings.h --- a/src/ssl-params/ssl-params-settings.h +++ b/src/ssl-params/ssl-params-settings.h @@ -4,6 +4,7 @@ struct master_service; struct ssl_params_settings { + const char *state_dir; unsigned int ssl_parameters_regenerate; }; From chris at arachsys.com Mon Aug 13 19:14:25 2012 From: chris at arachsys.com (Chris Webb) Date: Mon, 13 Aug 2012 17:14:25 +0100 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting In-Reply-To: <20120813161251.GB14149@arachsys.com> References: <20120813161251.GB14149@arachsys.com> Message-ID: <20120813161425.GC14149@arachsys.com> Chris Webb writes: > Sharing an installed copy of dovecot between several users each running > a daemon within their own account (or using the same binaries for a > system daemon and a user daemon) is difficult because the compile-time > directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the > location of things like the ssl-parameters.dat file and the replicator > database. > > Replace all these uses of PKG_STATEDIR with a state_dir setting which > defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the > same way base_dir can be used to override PKG_RUNDIR. A little background to this patch: I run a shell account box on which a number of users want to do customized things with their own IMAP servers, and they previously ran their own copy of Dovecot 1.0, using the system installed copy of dovecot but with their own dovecot.conf overrode base_dir, used passwd-file, etc. I've been looking at upgrading this machine, and encouraging SSL imap at the same point, but replicating these users' setups with Dovecot 2.1.9 was harder than I expected because of hard-coded references to /var/lib/dovecot that their config files couldn't override. This patch fixes that problem: they just create a ~/dovecot/dovecot.conf with something like base_dir = /home/foo/dovecot/run state_dir = /home/foo/dovecot/state [...] run dovecot -c ~/dovecot/dovecot.conf as they did before, and they're away with a completely self-contained IMAP server without having to compile a complete separate copy of Dovecot each. Best wishes, Chris. From jtam.home at gmail.com Tue Aug 14 01:39:06 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 13 Aug 2012 15:39:06 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: References: Message-ID: writes: > where do i have to locate the passwd-file in dovecot2 For what purpose? Master user? Password/user lookup? passdb { driver = passwd-file master = yes args = /anywhere/you/want/master-users pass = yes } passdb { driver = passwd-file args = /anywhere/you/want/passwd } userdb { driver = passwd-file args = /anywhere/you/want/passwd } Joseph Tam From bmalik at ihlas.net.tr Tue Aug 14 09:11:00 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 23:11:00 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: References: <1344636852567-5993.post@n4.nabble.com> Message-ID: <1344924660889-37062.post@n4.nabble.com> My purpose is to restrict a particular email address 's reach for dovecot services such as pop3/imap. how can i restrict a particular email address by tcp port ? I want a particular mail address to be forced to use pop3s/imaps. I use vpopmail / dovecot2. How can i do a script for that ? cat auth-vpopmail.conf.ext passdb { driver = vpopmail args = webmail=127.0.0.1 } userdb { driver = vpopmail args = quota_template=quota_rule=*:backend=%q } -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37062.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Tue Aug 14 09:15:19 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 09:15:19 +0300 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344924660889-37062.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> Message-ID: <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> On 14.8.2012, at 9.11, bmalik wrote: > how can i restrict a particular email address by tcp port ? > I want a particular mail address to be forced to use pop3s/imaps. > I use vpopmail / dovecot2. > How can i do a script for that ? > > userdb { > driver = vpopmail > args = quota_template=quota_rule=*:backend=%q args = secured=%c quota... In post-login script see if $SECURED = secured. From bmalik at ihlas.net.tr Tue Aug 14 09:26:04 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 23:26:04 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> Message-ID: <1344925564701-37064.post@n4.nabble.com> But I 'll do that for only some email addresses. How can i do that ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37064.html Sent from the Dovecot mailing list archive at Nabble.com. From koshikov at gmail.com Tue Aug 14 09:49:38 2012 From: koshikov at gmail.com (Nikita Koshikov) Date: Tue, 14 Aug 2012 09:49:38 +0300 Subject: [Dovecot] Libdovecot-sieve segfaults Message-ID: <20120814094938.6977cc9d@jimbo> Hello Stephan, Preface - one of my users went to vacation and changed his sieve script to run autoreply vacation message, after that - I have noticed some annoying errors in system log, like: dovecot-lda[2400]: segfault at 3eb3333f ip b7446c7a sp bfaab050 error 4 in libdovecot-sieve.so.0.0.0[b7429000+5b000] Dovecot-error log is empty, but in exim log(exim runs dovecot-lda) I got: 2012-08-13 09:35:27 1T0oFK-0000aW-6j ** sr at domain.com (sr at domain.com, root at domain.com) F=<59942270813 at mymail.in.ua> R=ldap_accept T=local_delivery: Child process of local_delivery transport (running command "/usr/libexec/dovecot/dovecot-lda -e -d $local_part@$domain") was terminated by signal 11 (Segmentation fault) sr at domain.com - is the user, who created such sieve-script, which cause segfaults. I have tried run the same message over this script from sieve-test utility - but result is success. Can you please, take a look to this sieve script and check is it ok, I'll send it to you privately since it contains user's data. Also I'll attach message.eml which triggers segfault. Dovecot version - 2.0.21, Sieve version - 0.2.6. Relevant to sieve dovecot config section: plugin { sieve = ~/.dovecot.sieve sieve_after = /etc/dovecot/sieve/default-after.sieve sieve_dir = ~/sieve sieve_extensions = +notify +spamtest sieve_spamtest_max_value = 10 sieve_spamtest_status_header = X-Spam-Scan-Score sieve_spamtest_status_type = score } Hope you'll help. From lists at wildgooses.com Tue Aug 14 10:47:42 2012 From: lists at wildgooses.com (Ed W) Date: Tue, 14 Aug 2012 08:47:42 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <20120813182736.GB11223@state-of-mind.de> References: <1344861658.13571.10.camel@hurina> <20120813182736.GB11223@state-of-mind.de> Message-ID: <502A029E.9000309@wildgooses.com> On 13/08/2012 19:27, Patrick Ben Koetter wrote: > * Timo Sirainen : >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: >> >> * It could support BURL command and other extensions required by >> LEMONADE. The real SMTP server would see only regular DATA commands. >> * Would make SMTP AUTH easy to implement regardless of what the real >> SMTP server is. > Nice move! Especially since I recall Wietse being not very inclined to > implement anything alike. > Annoyingly Apple implemented burl for postfix, submitted the patch, but Wietse declined it (for reasons I would need to remind myself of - I think some implementation concerns, but mainly "who is using it, lets see the clients first") I would also be very interested to see BURL support appear. It appears to offer bandwidth reductions (my customers are all on slow dialup links), and at least some apple clients (IOS?) support it Cheers Ed W From lists at wildgooses.com Tue Aug 14 11:04:22 2012 From: lists at wildgooses.com (Ed W) Date: Tue, 14 Aug 2012 09:04:22 +0100 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> Message-ID: <502A0686.30309@wildgooses.com> On 10/08/2012 10:25, Timo Sirainen wrote: >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? > Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. The battery consumption problem seems common, but understanding of it is poor... The situation is simply: - Waking up a 3G radio is expensive on power - So prefer to do it less frequently and do a chunk of stuff, rather than doing a small amount of data quite frequently - Every 30 mins is only 48 times a day. Every 15 seconds is massively more - Different 3G networks have different parameters set which will dramatically affect battery life. ie they wait longer/shorter before allowing the radio to go idle once woken up. I don't know a good online resource to see these settings, my old Nokia had a utility to investigate things... - Firewalls impose challenges on being silent for 30 mins at a time and may drop any NAT mappings - The 3G network will almost certainly have a NAT in the way which guarantees you have a (probably very short) NAT timeout (perhaps 10 mins or perhaps less) - Then there is tcp keepalive. Does Dovecot enable these? (Sorry, I should look in the code...). However, applications which enable it (eg optional in SSH) will trigger a default (I think) 75 second network packet As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? But of course if your emails turn up every few seconds, then you will be triggering wakeups every few seconds also. I think if you tune things with that in mind, it's very possible to get very low battery usage. Using tcpdump on your mobile client to help tune things is a great help. Basically every stray packet is a killer for battery, hunt them down. Cheers Ed W From tss at iki.fi Tue Aug 14 11:18:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 11:18:18 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <502A0686.30309@wildgooses.com> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: On 14.8.2012, at 11.04, Ed W wrote: > - Then there is tcp keepalive. Does Dovecot enable these? (Sorry, I should look in the code...). Yes. > However, applications which enable it (eg optional in SSH) will trigger a default (I think) 75 second network packet It's something like 2 hours by default in Linux. > As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) > But of course if your emails turn up every few seconds, then you will be triggering wakeups every few seconds also. Maybe Dovecot could make this somehow smarter some day.. Or create a plugin that allows that. From ngoonee.talk at gmail.com Tue Aug 14 11:41:15 2012 From: ngoonee.talk at gmail.com (Oon-Ee Ng) Date: Tue, 14 Aug 2012 16:41:15 +0800 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: On Tue, Aug 14, 2012 at 4:18 PM, Timo Sirainen wrote: > Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) I for one welcome our new Dovecot overlords Sorry for the noise. From andre.groebe at fun.de Tue Aug 14 13:07:59 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 14 Aug 2012 12:07:59 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225C7F.2070300@fun.de> References: <50225A24.4010109@fun.de> <50225C7F.2070300@fun.de> Message-ID: <502A237F.4060308@fun.de> On reading 'big' metadata entries i got a similiar behaviour (metadata_maxsize = 10240). The command getmetadata returns no data. I have created a dovecot.dict with a single entry (key=priv/mailbox/fba9aa2cf41721501f340000d6254462/private/vendor/test/10458d10cf1f2a5023750000d6254462/2) to reproduce that. I expected to get the value with command: . getmetadata inbox /private/vendor/test/10458d10cf1f2a5023750000d6254462/2 . OK Completed. It seems to me that there is a bug in metadata plugin. Anyone any ideas? TIA Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot.dict.bz2 Type: application/x-bzip Size: 7405 bytes Desc: not available URL: From klimenko.n at theitidea.ru Tue Aug 14 15:23:55 2012 From: klimenko.n at theitidea.ru (=?UTF-8?B?0J3QuNC60L7Qu9Cw0Lkg0JrQu9C40LzQtdC90LrQvg==?=) Date: Tue, 14 Aug 2012 16:23:55 +0400 Subject: [Dovecot] vacation and field FROM Message-ID: <502A435B.7090909@theitidea.ru> Hi to all Here is the following scheme: Dovecot in a link with AD. For LDA and IMAP different views are used in a base. For example there is a user with such e-mail type - 1.name at domain.ltd with the name of authorization auth_1.name. Incoming male folds up in /var/mail/domain/auth_1.name When vacation is on, the letters from 1.name at domain.ltd are sent in a following way auth_1.name at domain.ltd I guess the problem is in two different data-base queries. Could you please tell me how to solve this problem and to make the answer to be sent from the same adress it is comes to. part of dovecot.conf protocol lda { mail_plugins = sieve acl hostname = domain.ltd postmaster_address = auth_socket_path = /var/run/dovecot/auth-master_lda log_path = /var/log/dovecot-deliver.log } auth default { verbose = no debug = no debug_passwords = no mechanisms = plain user = dovecot passdb passwd-file { args = /etc/dovecot/passwd.masterusers master = yes } passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb static { args = uid=20000 gid=20000 home=/opt/mail/user_mailbox/%Lu allow_all_users=yes } socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = vmail } client { path = /var/spool/postfix/private/dovecot-auth mode = 0660 user = postfix group = postfix } } } auth auth_lda { verbose = no debug = no debug_passwords = no mechanisms = plain user = dovecot passdb ldap { args = /etc/dovecot/dovecot-ldap_lda.conf } userdb ldap { args = /etc/dovecot/dovecot-ldap_lda.conf } socket listen { master { path = /var/run/dovecot/auth-master_lda mode = 0660 user = vmail group = vmail } part of dovecot-ldap.conf (filter options) pass_attrs = sAMAccountName=user pass_filter = (&(sAMAccountName=%u)(objectClass=user)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) part of dovecot-ldap_lda.conf user_attrs = sAMAccountName=user user_filter = (mail=%u) pass_attrs = sAMAccountName=user pass_filter = (mail=%u) -- From ncjeffgus at zimage.com Tue Aug 14 23:01:58 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 13:01:58 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <1344974518.25701.6.camel@maclinux> I ran a rsync on the mailboxes that I was having issues with. I re-ran rsync until I had a full sync with no further updates. Then I ran a dsync. dsync was able to run without issue. If I wipe out the target directory and re-run dsync, I'm back to dsync getting stuck. Running rsync on mdbox files is not optimal. What else can I do to track down the issue? I've contacted Timo's company about payed support so we can get a fix for this issue. I hope to hear from them soon. ...Jeff From tss at iki.fi Tue Aug 14 23:23:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 23:23:39 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> On 11.8.2012, at 0.54, Jeff Gustafson wrote: > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > problem with both versions. > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > list of boxes every time we use 'dsync backup' to backup the server. > dsync seems to stop communicating to the backup box (over ssh). strace > just shows it sitting at a epoll_wait. So you can easily reproduce this by running dsync for a specific user? > Once the program quits (times > out?), a 'du' shows the destination is smaller (200kbyte in one case). As in, some of the mails didn't get synced? (doveadm fetch could be used to do a better comparison, file sizes don't necessarily mean anything.) > Has anyone else seen an exit code of 75? Nothing in the documentation > mentions what exit code 75 could mean. "temporary failure". > What can I do to help the developers locate the bug? Those hangs are a little bit annoying to debug, and the whole code has been rewritten for v2.2 already in a way that should make the hangs pretty much impossible. Annoyingly v2.2 isn't ready yet.. From bmalik at ihlas.net.tr Wed Aug 15 01:01:40 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Tue, 14 Aug 2012 15:01:40 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <1344981700620-37074.post@n4.nabble.com> is there a solution ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37074.html Sent from the Dovecot mailing list archive at Nabble.com. From durket at highwire.stanford.edu Wed Aug 15 01:12:59 2012 From: durket at highwire.stanford.edu (Michael Durket) Date: Tue, 14 Aug 2012 15:12:59 -0700 Subject: [Dovecot] Listen on multiple ports possible using same protocol? Message-ID: Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: protocol imap { listen = *:143 listen = *:10143 ssl_listen = *:993 ssl_listen = *:10993 for example. Or is this more preferably done by pointing dovecot at different configuration files? From ncjeffgus at zimage.com Wed Aug 15 01:33:47 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 15:33:47 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> Message-ID: <1344983627.25701.10.camel@maclinux> On Tue, 2012-08-14 at 23:23 +0300, Timo Sirainen wrote: > On 11.8.2012, at 0.54, Jeff Gustafson wrote: > > > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > > problem with both versions. > > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > > list of boxes every time we use 'dsync backup' to backup the server. > > dsync seems to stop communicating to the backup box (over ssh). strace > > just shows it sitting at a epoll_wait. > > So you can easily reproduce this by running dsync for a specific user? Yes. There is a subset of mailboxes that always time out. > > Once the program quits (times > > out?), a 'du' shows the destination is smaller (200kbyte in one case). > > As in, some of the mails didn't get synced? (doveadm fetch could be > used to do a better comparison, file sizes don't necessarily mean > anything.) True, I will dump out the mailboxes and see if it truly was incomplete. > Those hangs are a little bit annoying to debug, and the whole code has > been rewritten for v2.2 already in a way that should make the hangs > pretty much impossible. Annoyingly v2.2 isn't ready yet.. I have found a manual work around. I use rsync to get the files over to the backup machines, then I let the backup script keep things up to date. It is not the best way to go, but at least I have backups. I suppose I can check the log and continue to rsync things over until 2.2 comes out. ...Jeff From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 15 02:04:03 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 15 Aug 2012 01:04:03 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344925564701-37064.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> <1344925564701-37064.post@n4.nabble.com> Message-ID: <20120814230403.GA11246@daniel.localdomain> bmalik wrote: > But I 'll do that for only some email addresses. I assume that by "email addresses" you mean "user names". > How can i do that ? The $SECURED variable contains "secured" if a user tries to log in via SSL/TLS, so if an insecure connection is found, the script should check whether the user is in the list if users which are forced to use encryption: ############################################################################## if [ "$SECURED" == "secure" ] then :# handle secure connections here else :# handle insecure connections here if grep -q "$USER" in /etc/users-with-forced-encryption then printf "* NO [ALERT] You are not allowed to connect without encryption\r\n" exit 0 fi fi ############################################################################## Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Wed Aug 15 02:56:10 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Tue, 14 Aug 2012 18:56:10 -0500 Subject: [Dovecot] Listen on multiple ports possible using same protocol? In-Reply-To: References: Message-ID: <502AE59A.2040504@hardwarefreak.com> On 8/14/2012 5:12 PM, Michael Durket wrote: > Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: > > protocol imap { > listen = *:143 > listen = *:10143 > ssl_listen = *:993 > ssl_listen = *:10993 > > > for example. Or is this more preferably done by pointing dovecot at different configuration files? Did you test it? -- Stan From ncjeffgus at zimage.com Wed Aug 15 05:41:58 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 19:41:58 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> Message-ID: <1344998518.25701.13.camel@maclinux> On Tue, 2012-08-14 at 23:23 +0300, Timo Sirainen wrote: > On 11.8.2012, at 0.54, Jeff Gustafson wrote: > > What can I do to help the developers locate the bug? > > Those hangs are a little bit annoying to debug, and the whole code has > been rewritten for v2.2 already in a way that should make the hangs > pretty much impossible. Annoyingly v2.2 isn't ready yet.. I have an issue related to this problem. dsync returns an error 75 when it detects the source mailbox is empty (client probably pop3'd all of their email). It also returns an error 75 when I get the timeout error. For not I am parsing the error to find out which is which and act accordingly. It would be much nicer if dsync returned a different error code for empty source mailboxes. ...Jeff From bmalik at ihlas.net.tr Wed Aug 15 09:24:59 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Tue, 14 Aug 2012 23:24:59 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120814230403.GA11246@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> <1344925564701-37064.post@n4.nabble.com> <20120814230403.GA11246@daniel.localdomain> Message-ID: <1345011899792-37080.post@n4.nabble.com> Thanks a lot. the script you gave works . -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37080.html Sent from the Dovecot mailing list archive at Nabble.com. From cpservicespb at gmail.com Wed Aug 15 09:51:09 2012 From: cpservicespb at gmail.com (CpServiceSPb) Date: Wed, 15 Aug 2012 10:51:09 +0400 Subject: [Dovecot] Thread sorting problem Message-ID: Hi. How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later cost ? Artyom. From tss at iki.fi Wed Aug 15 12:27:27 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:27:27 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344998518.25701.13.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> Message-ID: <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> On 15.8.2012, at 5.41, Jeff Gustafson wrote: > I have an issue related to this problem. dsync returns an error 75 when > it detects the source mailbox is empty (client probably pop3'd all of > their email). It also returns an error 75 when I get the timeout error. You mean this? dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run backup in wrong direction. Source is empty and destination is not. Maybe it needs a force setting, or change the detection somehow.. From tss at iki.fi Wed Aug 15 12:28:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:28:45 +0300 Subject: [Dovecot] Listen on multiple ports possible using same protocol? In-Reply-To: References: Message-ID: On 15.8.2012, at 1.12, Michael Durket wrote: > Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: > > protocol imap { > listen = *:143 > listen = *:10143 I think this works: listen = *:143, *:10143 I think dovecot-example.conf says something about it. From tss at iki.fi Wed Aug 15 12:30:33 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:30:33 +0300 Subject: [Dovecot] Thread sorting problem In-Reply-To: References: Message-ID: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> On 15.8.2012, at 9.51, CpServiceSPb wrote: > How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later > cost ? What do you need it for? There is THREAD=REFERENCES that is superior to it in most situations. From svoop at delirium.ch Wed Aug 15 13:14:39 2012 From: svoop at delirium.ch (Sven Schwyn) Date: Wed, 15 Aug 2012 12:14:39 +0200 Subject: [Dovecot] bcrypt again Message-ID: Hi I'd like Dovecot to consume a list of users exported from an external application which stores bcrypted passwords. This has been asked in the past, however, I'm not sure how to read the following reply: > If you are using Dovecot< 2.0 you can also use any of the algorithms > supported by your system's libc. But then you have to prefix the hashes > with {CRYPT} - not {{BLF,SHA256,SHA512}-CRYPT}. I'm on Dovecot 2.0.19. Does this mean that only the hashes listed with "doveadm pw -l" are supported and even if glibc can do bcrypt, the CRYPT scheme won't do the trick anymore? Thanks for your help! From tss at iki.fi Wed Aug 15 13:43:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 13:43:40 +0300 Subject: [Dovecot] Thread sorting problem In-Reply-To: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> References: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> Message-ID: <85B6A78B-DFB4-4775-A212-0530669DA84E@iki.fi> On 15.8.2012, at 12.30, Timo Sirainen wrote: > On 15.8.2012, at 9.51, CpServiceSPb wrote: > >> How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later >> cost ? > > What do you need it for? There is THREAD=REFERENCES that is superior to it in most situations. Well, anyway, here you go: http://hg.dovecot.org/dovecot-2.1/rev/670f467ff5c5 From tss at iki.fi Wed Aug 15 13:54:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 13:54:03 +0300 Subject: [Dovecot] bcrypt again In-Reply-To: References: Message-ID: <6750912E-4BBE-490E-9BAE-429468C20B7F@iki.fi> On 15.8.2012, at 13.14, Sven Schwyn wrote: > I'd like Dovecot to consume a list of users exported from an external application which stores bcrypted passwords. > > This has been asked in the past, however, I'm not sure how to read the following reply: > >> If you are using Dovecot< 2.0 you can also use any of the algorithms >> supported by your system's libc. But then you have to prefix the hashes >> with {CRYPT} - not {{BLF,SHA256,SHA512}-CRYPT}. > > I'm on Dovecot 2.0.19. Does this mean that only the hashes listed with "doveadm pw -l" are supported and even if glibc can do bcrypt, the CRYPT scheme won't do the trick anymore? {CRYPT} means that the password is put through libc's crypt() function. If your libc's crypt() supports bcrypt, then Dovecot supports bcrypt. I don't know why (whoever) said "<2.0". From ncjeffgus at zimage.com Wed Aug 15 22:23:34 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Wed, 15 Aug 2012 12:23:34 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> Message-ID: <1345058614.25701.20.camel@maclinux> On Wed, 2012-08-15 at 12:27 +0300, Timo Sirainen wrote: > On 15.8.2012, at 5.41, Jeff Gustafson wrote: > > > I have an issue related to this problem. dsync returns an error 75 when > > it detects the source mailbox is empty (client probably pop3'd all of > > their email). It also returns an error 75 when I get the timeout error. > > You mean this? > > dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run > backup in wrong direction. Source is empty and destination is not. That's the one! > Maybe it needs a force setting, or change the detection somehow.. That would be nice. A backup script is executing the command, so it should never do it in the wrong direction. A force setting might be the simplest way to go. ...Jeff From listas at adminlinux.com.br Wed Aug 15 23:01:16 2012 From: listas at adminlinux.com.br (3.listas@adminlinux.com.br) Date: Wed, 15 Aug 2012 17:01:16 -0300 Subject: [Dovecot] Mdbox corruption Message-ID: <502C000C.9060206@adminlinux.com.br> Hi, I have a "ubuntu10.04 + ext4-filesystem + dovecot-2.0.13 +mdbox" configuration in my server. It works fine with ~50k accounts. Recently happened a filesystem corruption in a device of StMailLocation and I fix with fsck.ext4. After this crash, one account began to show access timeout and errors like this on force-resync: # doveadm force-resync -u account INBOX doveadm(account): Warning: mdbox /path-to-mdbox/storage: rebuilding indexes doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) doveadm(account): Warning: dbox: Copy of the broken file saved to /path-to-mdbox/storage/m.83.broken doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) doveadm(account): Error: mdbox rebuild: Failed to fix file /path-to-mdbox/storage/m.83 doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.92 (around offset=7): Invalid dbox version ... Should I worry about the m.X.broken files ? How I fix these broken mdboxes ? Thanks. -- Thiago Henrique adminlinux.com.br From mailadmin at cubixys.com Thu Aug 16 03:52:40 2012 From: mailadmin at cubixys.com (Fasil) Date: Thu, 16 Aug 2012 03:52:40 +0300 Subject: [Dovecot] Dovecot: pipe() failed: Too many open files Message-ID: <502C4458.8090808@cubixys.com> Dear all, Thank you all for such a wonderful support. Hats off to all :) Few times I came across imap login issues where new users will not be allowed to login. /var/log/mail.err shows the error below Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 # ulimit -Hn 1024 # ulimit -Sn 1024 # cat /proc/sys/fs/file-max 1238548 # cat /proc/`pidof dovecot`/limits | grep 'Max open' Max open files 1024 1024 files Please advice how to get rid off this. Fasil. From manu at netbsd.org Thu Aug 16 04:07:20 2012 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Thu, 16 Aug 2012 03:07:20 +0200 Subject: [Dovecot] Auth worker max line size In-Reply-To: <20090624144545.GF13977@NetBSD.org> Message-ID: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> Hi 38 month ago, I submitted a patch to increase AUTH_WORKER_MAX_LINE_LENGTH to use exotic authentication scheme (see message below). The patch was accepted, but now I upgrade to dovecot 2.1.7, I face the same problem with MASTER_AUTH_MAX_DATA_SIZE. I had to increase it from 1024 to 4096. Is it safe to do so? Would such a change be accepted upstream? The patch is below. (please Cc: me, I'm not subscribed ot the list) --- src/lib-master/master-auth.h.orig +++ src/lib-master/master-auth.h @@ -13,9 +13,9 @@ /* Authentication client process's cookie size */ #define MASTER_AUTH_COOKIE_SIZE (128/8) /* LOGIN_MAX_INBUF_SIZE should be based on this.*/ -#define MASTER_AUTH_MAX_DATA_SIZE 1024 +#define MASTER_AUTH_MAX_DATA_SIZE 4096 #define MASTER_AUTH_ERRMSG_INTERNAL_FAILURE \ "Internal error occurred. Refer to server log for more information." Emmanuel Dreyfus wrote: > Hello > > I have been playing with some exotic authentication scheme with Dovecot > and PAM. That involves sending really large base64 encoded data as > the IMAP password, and I have hit a line limit in Dovecot, with > AUTH_WORKER_MAX_LINE_LENGTH set to 1024. > > This limit is especially frustrating since other parts of the software > use much larger limits: > MAX_INBUF_SIZE 4096 > MAX_IMAP_LINE 8192 > AUTH_CLIENT_MAX_LINE_LENGTH 8192 > > I had to make the patch attached below to get my authentication working. > I can live with this local patch, but given the much more liberal limits > of MAX_INBUF_SIZE at 4096 makes we wonder if this 1024 limit on > AUTH_WORKER_MAX_LINE_LENGTH could not be a bug. Or is there a security > concern at using more than 1kB? > > Opinions? (please Cc: me, I'm not subscribed ot the list) > > --- src/auth/auth-worker-client.h.orig 2009-06-23 18:32:15.000000000 +0200 > +++ src/auth/auth-worker-client.h 2009-06-23 18:32:33.000000000 +0200 > @@ -1,8 +1,8 @@ > #ifndef AUTH_WORKER_CLIENT_H > #define AUTH_WORKER_CLIENT_H > > -#define AUTH_WORKER_MAX_LINE_LENGTH 1024 > +#define AUTH_WORKER_MAX_LINE_LENGTH 4096 > > struct auth_worker_client *auth_worker_client_create(struct auth *auth, int fd); > void auth_worker_client_destroy(struct auth_worker_client **client); > void auth_worker_client_unref(struct auth_worker_client **client); -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From f.bonnet at esiee.fr Thu Aug 16 09:17:14 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Thu, 16 Aug 2012 08:17:14 +0200 Subject: [Dovecot] Dovecot: pipe() failed: Too many open files In-Reply-To: <502C4458.8090808@cubixys.com> References: <502C4458.8090808@cubixys.com> Message-ID: <5B19308C-D60C-4CBD-9CD2-519C98DFCC5B@esiee.fr> hello here some useful informations http://posidev.com/blog/2009/06/04/set-ulimit-parameters-on-ubuntu/ Envoy? de mon iPhone. Le 16 ao?t 2012 ? 02:52, Fasil a ?crit : > Dear all, > > Thank you all for such a wonderful support. Hats off to all :) > > Few times I came across imap login issues where new users will not be allowed to login. > /var/log/mail.err shows the error below > Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now > Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files > > I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 > > # ulimit -Hn > 1024 > > # ulimit -Sn > 1024 > > # cat /proc/sys/fs/file-max > 1238548 > > # cat /proc/`pidof dovecot`/limits | grep 'Max open' > Max open files 1024 1024 files > > Please advice how to get rid off this. > > Fasil. From cor at xs4all.nl Thu Aug 16 10:02:47 2012 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 16 Aug 2012 09:02:47 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <1344861658.13571.10.camel@hurina> References: <1344861658.13571.10.camel@hurina> Message-ID: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> > > I'm also considering implementing an SMTP submission server, which works > only as a proxy to the real SMTP server. The benefits of it would mainly > be: What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. Cor From lists at wildgooses.com Thu Aug 16 10:59:07 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 08:59:07 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> Message-ID: <502CA84B.6080500@wildgooses.com> On 16/08/2012 08:02, Cor Bosman wrote: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: > What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. > Postfix allows you to write policy agents very simply. I wrote a small perl utility which uses a database to count the number of emails a user has sent in the last 1 and 24 hours. Based on that we throttle users (I have some fudging for recipients per email also). If you like the idea then it's about 10 lines of perl (+ a decent chunk of boiler plate). Ed From tss at iki.fi Thu Aug 16 11:00:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:00:01 +0300 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> Message-ID: <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> On 16.8.2012, at 10.02, Cor Bosman wrote: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: > > What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) From cor at xs4all.nl Thu Aug 16 11:11:31 2012 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 16 Aug 2012 10:11:31 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> Message-ID: <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> >> What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. > > > The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) > > Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) They would indeed need to share the state, this is what the commercial system does (Cloudmark Gateway). The idea is to prevent senders to send email beyond certain limits that are configurable. Lets say, 200 emails in a minute, or 500 an hour, or whatever. Of course allowing for whitelists. With ever increasing speeds of residential connections (we have hundreds of fiber connections now, growing rapidly), these become very fast spam sources without something to keep them in check. It's easy on 1 server, not so easy if you have dozens of smtp servers. But yes, something for a distant future :) And CM has other features as well, so it may not be so easy to replace :) Cor From c at roessner-network-solutions.com Thu Aug 16 11:15:34 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 10:15:34 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Message-ID: <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> Hi, >>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>> >>>> problem >>>> >>>> I tried so, but this does not work here: >>> >>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>> >>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>> >> done >> >> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >> > I tested today with Dovecot 2.1.9. Still not getting mails imported :-( > > How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? > > Many thanks in advance sorry for bumping, but I am stuck at the moment. -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From amateo at um.es Thu Aug 16 11:20:13 2012 From: amateo at um.es (Angel L. Mateo) Date: Thu, 16 Aug 2012 10:20:13 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <502CAD3D.90004@um.es> El 01/08/12 20:10, Timo Sirainen escribi?: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > >>> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >>> >>> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >>> >>> service ipc { >>> unix_listener ipc { >>> user = dovecot >>> } >>> } >> >> Thanks, Timo. >> >> Does this apply to the mailbox config or the director config? >> Which instance needs to access the ipc socket of which instance? > > director instance needs access to director instance. > Hello, Sorry for the delay, I've been on vacation these days. I'm going to try it. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From tss at iki.fi Thu Aug 16 11:20:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:20:23 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> Message-ID: <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> On 16.8.2012, at 11.15, Christian R??ner wrote: >>>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>>> >>>>> problem >>>>> >>>>> I tried so, but this does not work here: >>>> >>>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>>> >>>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>>> >>> done >>> >>> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >>> >> I tested today with Dovecot 2.1.9. Still not getting mails imported :-( >> >> How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? >> >> Many thanks in advance > > > sorry for bumping, but I am stuck at the moment. 1) Can you read mails from the resynced mdbox? For example: doveadm -o mail=mdbox:/anothermdbox fetch uid all 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? From jeremy.jarry at admin.gmessaging.net Thu Aug 16 11:41:36 2012 From: jeremy.jarry at admin.gmessaging.net (=?iso-8859-1?B?IkpBUlJZIErpculteSI=?=) Date: Thu, 16 Aug 2012 10:41:36 +0200 Subject: [Dovecot] Postfix & Dovecot: Client certificate authentication Message-ID: <5af13c674a81dc56.502cce60@admin.gmessaging.net> Hello, I would like to set up an authentication using certificate with Dovecot: A user sends mail to Postfix and Dovecot authentication is valid only if certificate is trusted. So, I enable the parameter auth_ssl_require_client_cert in dovecot configuration but it is not running. Here are the postfix logs: Aug 16 09:51:48 myserver dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 16 09:51:48 myserver dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 16 09:51:48 myserver dovecot: auth: Debug: auth client connected (pid=6922) Aug 16 09:51:51 myserver dovecot: auth: Debug: client in: AUTH?????? 1?????? PLAIN?? service=smtp??? nologin lip=127.0.0.1?? rip=127.0.0.1?????? secured resp=xxx Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL PLAIN authentication failed: Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: PLAIN(?,127.0.0.1): Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client out: FAIL????? 1?????? reason=Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client in: AUTH?????? 2?????? LOGIN?? service=smtp??? nologin lip=127.0.0.1?? rip=127.0.0.1?????? secured Aug 16 09:51:51 myserver dovecot: auth: LOGIN(?,127.0.0.1): Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client out: FAIL????? 2?????? reason=Client didn't present valid SSL certificate Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL LOGIN authentication failed: Client didn't present valid SSL certificate It seems Postfix doesn't send the client certificat to Dovecot. What do you think ? What is wrong ? Below are some information about my configuration: OS: RHEL5 Postfix: 2.7.3 Dovecot: 2.0.14 Dovecot config: auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_ssl_require_client_cert = yes auth_ssl_username_from_cert = yes auth_verbose = yes mail_debug = yes passdb { ? args = /etc/dovecot/dovecot-ldap.conf ? driver = ldap } protocols = none service auth { ? unix_listener /data/postfix/private/auth { ??? group = postfix ??? mode = 0660 ??? user = postfix ? } ? user = root } ssl = required ssl_ca = URL: From tss at iki.fi Thu Aug 16 11:54:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:54:49 +0300 Subject: [Dovecot] Postfix & Dovecot: Client certificate authentication In-Reply-To: <5af13c674a81dc56.502cce60@admin.gmessaging.net> References: <5af13c674a81dc56.502cce60@admin.gmessaging.net> Message-ID: On 16.8.2012, at 11.41, JARRY J?r?my wrote: > I would like to set up an authentication using certificate with Dovecot: A user sends mail to Postfix and Dovecot authentication is valid only if certificate is trusted. > > So, I enable the parameter auth_ssl_require_client_cert in dovecot configuration but it is not running. Here are the postfix logs: .. > Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL LOGIN authentication failed: Client didn't present valid SSL certificate > > It seems Postfix doesn't send the client certificat to Dovecot. What do you think ? What is wrong ? Correct. Postfix doesn't send it to Dovecot, so you can't do this currently. I'm not sure if this would require about 2 lines of code or hundreds to Postfix. From lists at wildgooses.com Thu Aug 16 14:12:31 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 12:12:31 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> Message-ID: <502CD59F.9030705@wildgooses.com> On 16/08/2012 09:11, Cor Bosman wrote: >>> What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. >> >> The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) >> >> Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) > They would indeed need to share the state, this is what the commercial system does (Cloudmark Gateway). The idea is to prevent senders to send email beyond certain limits that are configurable. Lets say, 200 emails in a minute, or 500 an hour, or whatever. Of course allowing for whitelists. With ever increasing speeds of residential connections (we have hundreds of fiber connections now, growing rapidly), these become very fast spam sources without something to keep them in check. It's easy on 1 server, not so easy if you have dozens of smtp servers. > > But yes, something for a distant future :) And CM has other features as well, so it may not be so easy to replace :) > My opinion is that this is very easily to implement in at least Postfix and probably other servers, hence I would suggest this is a function for the MTA, not for the Dovecot relay? What MTA are you using? If Postfix then there are several off the shelf solutions which control sending rates. As I said in a previous email, I wanted the rate to be configurable per user, and so we store the rates in our user database. It's then fairly trivial to write a small "policy server" to enforce whatever policies you wish, eg as well as rate limiting we have some control over whether users can "forge" their FROM address, etc. This all gets implemented in a small Perl based policy server Effectively Postfix talks to a network socket for every email, passes a bunch of detail about the email and asks for a yes/no answer. Caveat the boiler plate to listen to a network socket the rest is just a couple of lines of code. Distributed, re-entrant, simple. Give it some consideration. I doubt the time to implement a complete prototype solution would be more than half a day for your IT guy and if that's attractive then perhaps you have grounds to look at replacing CM? Good luck Ed W From c at roessner-network-solutions.com Thu Aug 16 14:13:00 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 13:13:00 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> Message-ID: <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> Am 16.08.2012 um 10:20 schrieb Timo Sirainen: > On 16.8.2012, at 11.15, Christian R??ner wrote: > >>>>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>>>> >>>>>> problem >>>>>> >>>>>> I tried so, but this does not work here: >>>>> >>>>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>>>> >>>>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>>>> >>>> done >>>> >>>> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >>>> >>> I tested today with Dovecot 2.1.9. Still not getting mails imported :-( >>> >>> How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? >>> >>> Many thanks in advance >> >> >> sorry for bumping, but I am stuck at the moment. > > 1) Can you read mails from the resynced mdbox? For example: > > doveadm -o mail=mdbox:/anothermdbox fetch uid all > doveadm -o mail=mdbox:/srv/mail/foo.bar at example.com-backup fetch uid all | grep uid | wc -l 949 There seem to be mails. At least I get several lines with uid: > 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? It seems, it is just the import thing. doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(root): Debug: Effective uid=0, gid=0, home=/root doveadm(root): Debug: fs: root=/srv/mail/foo.bar at example.com-backup, index=, control=, inbox=, alt= doveadm(root): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com-backup: mode=0700 gid=-1 doveadm(foo.bar at example.com): Debug: Effective uid=5000, gid=5000, home=/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: fs: root=/srv/mail/foo.bar at example.com, index=, control=, inbox=, alt= doveadm(foo.bar at example.com): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com: mode=0700 gid=-1 Thanks in advance -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From CMarcus at Media-Brokers.com Thu Aug 16 14:24:09 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 16 Aug 2012 07:24:09 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CD59F.9030705@wildgooses.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> Message-ID: <502CD859.6030709@Media-Brokers.com> On 2012-08-16 7:12 AM, Ed W wrote: > My opinion is that this is very easily to implement in at least Postfix > and probably other servers, hence I would suggest this is a function for > the MTA, not for the Dovecot relay? Well, true enough for simpler installations, but integrating something like this in dovecot that can be applied across large dovecot director based farms might be a good thing. Actually, maybe (and maybe not, I honestly haven't thought this through at all, and this might be a really dumb idea), instead of specific support for this one feature, I wonder if it would make more sense to actually build in support for a policy server (ie, amavisd-new) like postfix has... -- Best regards, Charles From claus.rosenberger at rocnet.de Thu Aug 16 14:30:56 2012 From: claus.rosenberger at rocnet.de (Claus Rosenberger) Date: Thu, 16 Aug 2012 13:30:56 +0200 Subject: [Dovecot] Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators) In-Reply-To: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> References: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> Message-ID: <502CD9F0.1060801@rocnet.de> Could i send some more informations about this topic? I'm not sure whats happening here but i think it has something to do with the shared mailboxes. With cyrus i had following folder structure: user1 -> inbox -> subfolders -> user -> user1 -> user2 With dovecot the folder structure look like: user1 -> inbox -> subfolders -> shared -> user1 -> inbox -> user2 -> inbox is there any way to show inbox directly in user1/user2 folder without having an inbox subfolder? Am 22.07.2012 00:04, schrieb Claus Rosenberger: > Hi, > > with fetching the folder structure with the webclient Tine i can see following error messages inside of the logfiles: > > Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) > > Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x448fa) [0x7f70036db8fa] -> /usr/lib/dovecot/libdovecot.so.0(+0x44946) [0x7f70036db946] -> /usr/lib/dovecot/libdovecot.so.0(+0x1b8ca) [0x7f70036b28ca] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open_stream+0) [0x7f70039a1550] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f70039a156f] -> dovecot/imap(cmd_select_full+0x14a) [0x40db1a] -> dovecot/imap(command_exec+0x3d) [0x41160d] -> dovecot/imap() [0x41058e] -> dovecot/imap() [0x41066d] -> dovecot/imap(client_handle_input+0x135) [0x410895] -> dovecot/imap(client_input+0x5f) [0x4111bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f70036e7ea6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f70036e8f2f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f70036e7e48] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f70036d4103] -> dovecot/imap(main+0x2a5) [0x419695] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f7003353c8d] -> dovecot/imap() [0x408f49] > > Fatal: master: service(imap): child 21152 killed with signal 6 (core dumps disabled) > From lazy404 at gmail.com Thu Aug 16 14:58:35 2012 From: lazy404 at gmail.com (Lazy) Date: Thu, 16 Aug 2012 13:58:35 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: <1337453839.4384.141.camel@innu> References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: 2012/5/19 Timo Sirainen : > On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >> failed: Read-only file system > > Does the attached patch help? > >> maybe it will be easier to move all dovecot metadata to separate (non >> snapshot) location ? > > It could also be a bit problematic. At least message keywords (=custom > flags) wouldn't work because the dovecot-keywords file exists only in > the snapshot dir. Moving metadata helped, but now archived inbox is unsubscribed. Is there a way to make all folders in an namespace subscribed by default ? Regards, Michal Grzedzicki From lists at wildgooses.com Thu Aug 16 14:58:59 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 12:58:59 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CD859.6030709@Media-Brokers.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> <502CD859.6030709@Media-Brokers.com> Message-ID: <502CE083.3030103@wildgooses.com> On 16/08/2012 12:24, Charles Marcus wrote: > On 2012-08-16 7:12 AM, Ed W wrote: >> My opinion is that this is very easily to implement in at least Postfix >> and probably other servers, hence I would suggest this is a function for >> the MTA, not for the Dovecot relay? > > Well, true enough for simpler installations, but integrating something > like this in dovecot that can be applied across large dovecot director > based farms might be a good thing. > > Actually, maybe (and maybe not, I honestly haven't thought this > through at all, and this might be a really dumb idea), instead of > specific support for this one feature, I wonder if it would make more > sense to actually build in support for a policy server (ie, > amavisd-new) like postfix has... > I'm really missing the key point here? The proposal was (I think?): Have Dovecot accept emails and feed them to the MTA (eg Postfix) This means you have access to all the MTA features (hence why I was pointing out these features exist today). Further, by centralising this function you don't need to duplicate the functionality depending on whether an email was sent via Dovecot or SMTP. So I don't see that policy servers are necessary in Dovecot for this particular requirement - I think most ideas we can come up with would benefit from delegating policy to the MTA so that it's centralised? I might be missing the point, so see above for my understanding of the problem? Ed W From CMarcus at Media-Brokers.com Thu Aug 16 15:38:00 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 16 Aug 2012 08:38:00 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CE083.3030103@wildgooses.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> <502CD859.6030709@Media-Brokers.com> <502CE083.3030103@wildgooses.com> Message-ID: <502CE9A8.5060203@Media-Brokers.com> On 2012-08-16 7:58 AM, Ed W wrote: > On 16/08/2012 12:24, Charles Marcus wrote: >> Actually, maybe (and maybe not, I honestly haven't thought this >> through at all, and this might be a really dumb idea), instead of >> specific support for this one feature, I wonder if it would make more >> sense to actually build in support for a policy server (ie, >> amavisd-new) like postfix has... > I'm really missing the key point here? > > The proposal was (I think?): Have Dovecot accept emails and feed them to > the MTA (eg Postfix) > > This means you have access to all the MTA features (hence why I was > pointing out these features exist today). Further, by centralising this > function you don't need to duplicate the functionality depending on > whether an email was sent via Dovecot or SMTP. > > So I don't see that policy servers are necessary in Dovecot for this > particular requirement - I think most ideas we can come up with would > benefit from delegating policy to the MTA so that it's centralised? But doing it in dovecot would mean that it wouldn't matter what MTA you were using, or even what OS/platform said MTAs were running on, you would handle all said policies for your entire (dovecot-director) infrastructure in one place (dovecot)... Also, this would only be for *outbound* policies, so would provide a degree of separation with your *inbound* policies... which could be a good or bad thing I guess depending on your needs and requirements. Like I said, I haven't thought it completely through and it may indeed be a bad idea... -- Best regards, Charles From tomislav.mihalicek at gmail.com Thu Aug 16 16:27:52 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Thu, 16 Aug 2012 06:27:52 -0700 (PDT) Subject: [Dovecot] dovecot 2.1 Master account Error Message-ID: <1345123672440-37109.post@n4.nabble.com> HI I am running parallel dovecot 1.2 for main accounts and 2.1 for test accounts, and for some reason when i try to login with master user on dovecot 2.1 service errors. However the normal user logins and rest works flawlesly Here is the debug Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: auth client connected (pid=27557) Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=pop3#011secured#011no-penalty#011session=ZOcF2GHHdQAKVCKD#011lip=10.84.34.122#011rip=10.84.34.131#011lport=110#011rport=60021 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client out: CONT#0111#011 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client in: CONT Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: auth(migration at example.net,10.84.34.131,master,): Master user lookup for login: tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: passwd-file(migration at example.net,10.84.34.131,master,): lookup: user=migration at example.net file=/etc/dovecot/master-users Aug 16 15:15:56 mailstore-node-02 dovecot: auth: passdb(migration at example.net,10.84.34.131,master,): Master user logging in as tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): pass search: base=ou=accounts,dc=example,dc=net scope=subtree filter=(&(objectClass=mailUser)(accountService=mail)(accountService=pop3secured)(|(mail=tomislav.mihalicek at example.net)(mailAlternateAddress=tomislav.mihalicek at example.net))) fields=mail,userPassword Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): result: mail=tomislav.mihalicek at example.net userPassword= Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client out: OK#0111#011user=tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: master in: REQUEST#0113563585537#01127557#0111#0118ccf2bab093bd33a4b93958c99236471 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): user search: base=ou=accounts,dc=example,dc=net scope=subtree filter=(&(objectClass=mailUser)(accountService=mail)(accountService=pop3secured)(|(mail=tomislav.mihalicek at example.net)(mailAlternateAddress=tomislav.mihalicek at example.net))) fields=mail,homeDirectory,mailQuotaSize Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): result: mail=tomislav.mihalicek at example.net mailQuotaSize=4294967296 homeDirectory=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: master out: USER#0113563585537#011tomislav.mihalicek at example.net#011home=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek#011quota_rule=*:bytes=4294967296#011master_user=migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3-login: Login: user=, method=PLAIN, rip=10.84.34.131, lip=10.84.34.122, mpid=27558, secured, session= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_expire_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_virtual_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_stats_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Added userdb setting: plugin/master_user=migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Added userdb setting: plugin/quota_rule=*:bytes=4294967296 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Effective uid=10101, gid=10101, home=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota root: name=user backend=dict args=:proxy::quota Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota rule: root=user mailbox=* bytes=4294967296 messages=0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=4080218931 (95%) messages=0 reverse=no command=quota-warning 95 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=3650722201 (85%) messages=0 reverse=no command=quota-warning 85 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=3006477107 (70%) messages=0 reverse=no command=quota-warning 70 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: dict quota: user=tomislav.mihalicek at example.net, uri=proxy::quota, noenforcing=0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/sdbox:INDEX=~/index Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: fs: root=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox, index=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/index, control=, inbox=, alt= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: initializing backend with data: vfile:/etc/dovecot/global-acls:cache_secs=300 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: acl username = migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: owner = 0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: Global ACL directory: /etc/dovecot/global-acls Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Namespace : type=shared, prefix=X-Share/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%h/Maildir:INDEX=~/index/Shared/%u Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: shared: root=/var/run/dovecot, index=, control=, inbox=, alt= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: initializing backend with data: vfile:/etc/dovecot/global-acls:cache_secs=300 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: acl username = migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: owner = 0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: Global ACL directory: /etc/dovecot/global-acls Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /etc/dovecot/global-acls/INBOX not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /etc/dovecot/global-acls/ not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox/mailboxes/dovecot-acl not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Error: Failed to autocreate mailbox INBOX: Permission denied Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Error: Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2012-08-16 15:15:56] Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Couldn't open INBOX top=0/0, retr=0/0, del=0/0, size=0 -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-2-1-Master-account-Error-tp37109.html Sent from the Dovecot mailing list archive at Nabble.com. From merrickville at gmail.com Thu Aug 16 19:01:59 2012 From: merrickville at gmail.com (Merrickville) Date: Thu, 16 Aug 2012 09:01:59 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding Message-ID: <1345132919122-37110.post@n4.nabble.com> Trying to figure out hostname based IMAP proxy forwarding. I have two mail servers: mail.example.com mail.fakedomain.ca proxy server running dovecat/IMAPS, facing the Internet. *Both* names are DNS resolve(able), but.., both are the *same IP address.* For example: Joe configures his email client username: joe at example.com IMAP Addr: mail.example.com For example: Jane configures her email client username: jane at fakedomain.ca IMAP Addr: mail.fakedomain.ca So, now all clients must change their user-name in their email client to their full email address, because there is a Jane & Joe on "both" servers and..., dovecot proxies based on 'user name' Is there a way to proxy based on the host name the client has configured in his/her email client? (Like Apache VirtualHosts) This would be ideal, as the clients can then go back to using just their name as the username. Thanks Rick -- View this message in context: http://dovecot.2317879.n4.nabble.com/Hostname-Based-forwarding-tp37110.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Thu Aug 16 19:21:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 19:21:45 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> Message-ID: <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> On 16.8.2012, at 14.13, Christian R??ner wrote: >> 1) Can you read mails from the resynced mdbox? For example: >> >> doveadm -o mail=mdbox:/anothermdbox fetch uid all >> > doveadm -o mail=mdbox:/srv/mail/foo.bar at example.com-backup fetch uid all | grep uid | wc -l > 949 > > There seem to be mails. At least I get several lines with uid: > >> 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? > > > It seems, it is just the import thing. > > doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL I find this strange. Does the mdbox size on filesystem get increased at all? (You sure it's not just that they're not visible in your IMAP client?) From c at roessner-network-solutions.com Thu Aug 16 19:42:54 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 18:42:54 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> Message-ID: Hi, >> doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL > > I find this strange. Does the mdbox size on filesystem get increased at all? (You sure it's not just that they're not visible in your IMAP client?) > I find that strange, either :-) I have done: tree . ??? Drafts ? ??? dbox-Mails ? ??? dovecot.index.log ??? Gel&APY-schte Elemente ? ??? dbox-Mails ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? Gesendete Elemente ? ??? dbox-Mails ? ??? dovecot.index ? ??? dovecot.index.backup ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? INBOX ? ??? dbox-Mails ? ??? dovecot.index ? ??? dovecot.index.backup ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? Junk ? ??? dbox-Mails ? ??? dovecot.index.log ??? Junk-E-Mail ? ??? dbox-Mails ? ??? dovecot.index.log ??? Sent ? ??? dbox-Mails ? ??? dovecot.index.log ??? Trash ??? dbox-Mails ??? dovecot.index.log 16 directories, 15 files So at least I should see a folder called all-mail, don't I? If nothing helps, I create a new user called foo.bar at example.com-backup and ask the customer to include that account as well just for importing stuff, he still needs. On the perspective of being a developer, too, I am interested why this does not work. So if you like to dig deeper into this, I gonna help you as much as I can. -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From tss at iki.fi Fri Aug 17 09:18:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 17 Aug 2012 09:18:15 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1345058614.25701.20.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> <1345058614.25701.20.camel@maclinux> Message-ID: <01AB0F8C-CEA1-48F8-B197-E8E8137B427E@iki.fi> On 15.8.2012, at 22.23, Jeff Gustafson wrote: >> dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run >> backup in wrong direction. Source is empty and destination is not. > > That's the one! > >> Maybe it needs a force setting, or change the detection somehow.. > > That would be nice. A backup script is executing the command, so it > should never do it in the wrong direction. A force setting might be the > simplest way to go. This should do it: http://hg.dovecot.org/dovecot-2.1/rev/5f280c1ec9fd From dof at projektfabrik.com Fri Aug 17 13:06:38 2012 From: dof at projektfabrik.com (dof at projektfabrik.com) Date: Fri, 17 Aug 2012 12:06:38 +0200 Subject: [Dovecot] =?utf-8?q?antispam=5Fplugin_prevents_IMAP_login_=28erro?= =?utf-8?b?ciAzKSBbRG92ZWNvdCAyLjAuMTld?= Message-ID: <22a789efa29d55b6725759b7ee4b5bd0@webmail.projektfabrik.com> Hi everybody, trying to get the Dovecot antispam_plugin to work and I must be doing something wrong, because as soon as it is enabled with a certain backend, imap logins do not work anymore (the session is immediately closed after a successful login). Interestingly, pipe and spool2dir are working (that is, the session won't be closed), dspam-exec and crm114-exec are not. If this happens, mail_debug output is as follows: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10420, secured imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_antispam_plugin.so imap(dof): Debug: Effective uid=23244, gid=8, home=/var/spool/dovecot/userdata/dof imap(dof): Debug: Home dir not found: /var/spool/dovecot/userdata/dof master: Error: service(imap): child 10420 returned error 3 Without the plugin I get: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10469, secured imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so imap(dof): Debug: Effective uid=23244, gid=8, home=/var/spool/dovecot/userdata/dof imap(dof): Debug: Home dir not found: /var/spool/dovecot/userdata/dof imap(dof): Debug: fs: root=/var/spool/dovecot/mail/dof, index=, control=, inbox=/var/spool/dovecot/mail/dof/INBOX, alt= imap(dof): Debug: Namespace : Using permissions from /var/spool/dovecot/mail/dof: mode=0755 gid=-1 Hopefully this is just a configuration problem. I tried the plugin in the Ubuntu repository (I'm using LTS 12.04) and even checked out the source from git and compiled it myself, but to no avail. Thanks a lot in advance and best regards, Florian ------------------- dovecot -n output: auth_cache_size = 128 k auth_cache_ttl = 20 mins auth_failure_delay = 10 secs auth_mechanisms = plain login disable_plaintext_auth = no login_greeting = Projektfabrik IMAP ready. mail_gid = mail mail_home = /var/spool/dovecot/userdata/%u mail_location = maildir:/var/spool/dovecot/mail/%u:INBOX=/var/spool/dovecot/mail/%u/INBOX:LAYOUT=fs mail_uid = dovemail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { antispam_backend = dspam-exec antispam_dspam_binary = /usr/bin/dspam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam antispam_trash = trash;Trash;Deleted Items; Deleted Messages autocreate = INBOX/Sent Mail autocreate2 = INBOX/Spam autocreate3 = INBOX/Trash autosubscribe = INBOX/Sent Mail autosubscribe2 = INBOX/Spam autosubscribe3 = INBOX/Trash fts = squat sieve = /var/spool/dovecot/sieve/%u/defaultbc sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = /var/spool/dovecot/sieve/%u } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0600 user = postfix } unix_listener auth-userdb { mode = 0600 user = dovemail } user = dovenull } service imap-login { inet_listener imap { address = localhost port = 143 } inet_listener imaps { address = localhost XX.XXX.XX.XXX port = 993 } service_count = 1 user = dovenull } service managesieve-login { inet_listener sieve { address = localhost port = 2000 } service_count = 1 user = dovenull } service pop3-login { inet_listener pop3 { address = localhost port = 110 } inet_listener pop3s { address = XX.XXX.XX.XXX port = 995 } service_count = 1 user = dovenull } ssl_ca = Maybe it's fixed, but the last "interesting" text in the Changelog was before 2.1.6. Most of our users still have mboxes in the classical layout, so you can't have subfolders and messages in the same folder, *except for the INBOX*, as it is physically separate. Someone complained that he saw subfolders in roundcube he couldn't delete, because they didn't show up in the subscription view. Before hitting on roundcube, I mperformed a few checks and got the following: root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/*' root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/test1' INBOX/test1 messages=0 This is mysterious. It doesn't happen with my account, that is in a mdbox: root at cx-y-z qmail # doveadm mailbox status -u kriegjcb messages 'INBOX/*' INBOX/test1 messages=1 Our setup is a bit complicated, but most of it shouldn't be relevant to the problem. # 2.1.6: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-103.ELsmp i686 Red Hat Enterprise Linux AS release 4 (Nahant Update 9) auth_first_valid_uid = 100 auth_master_user_separator = * dict { quota = mysql:/usr/local/dovecot/etc/dovecot-dict-mysql.conf } disable_plaintext_auth = no first_valid_uid = 100 lda_mailbox_autocreate = yes log_path = /dev/stderr log_timestamp = mail_access_groups = nofiles mail_location = mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/Index mail_plugins = " quota zlib mail_log notify virtual stats" mdbox_rotate_size = 5 M namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes inbox = no list = children location = maildir:~/Maildir prefix = "#MD/" separator = / type = private } namespace { hidden = yes list = no location = virtual:~/Maildir/Virtual prefix = Virtual/ separator = / type = private } namespace { hidden = yes list = no location = virtual:/usr/local/dovecot/etc/virtuell:INDEX=~/Virtuell prefix = Virtuell/ separator = / subscriptions = no type = private } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { acl = vfile mail_log_events = undelete mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota quota2 = fs:Disk quota stats_refresh = 30 secs stats_track_cmds = yes } protocols = pop3 imap service auth { client_limit = 4300 user = root } service dict { unix_listener dict { group = nofiles mode = 0666 } } service doveadm { inet_listener { port = 542 } } service imap-login { inet_listener imap { address = 134.147.64.38 port = 143 } service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = 134.147.64.38 port = 110 } service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } service stats { fifo_listener stats-mail { mode = 0666 user = dovenull } } ssl = no stats_command_min_time = 5 mins stats_domain_min_time = 1 hours stats_ip_min_time = 1 hours stats_memory_limit = 64 M userdb { args = /usr/local/dovecot/etc/dovecot-mysql.conf driver = sql } userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota zlib mail_log notify virtual stats imap_quota imap_zlib imap_stats" } Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From kryol at bigmir.net Fri Aug 17 14:24:09 2012 From: kryol at bigmir.net (Oleksii Krykun) Date: Fri, 17 Aug 2012 14:24:09 +0300 Subject: [Dovecot] Expire-tool does not delete duplicate messages (dovecot-1.2.17) Message-ID: Trying to implement expire plugin. expire-tool works fine. This delete expunged messages but not all of them. I have duplicate messages in appropriate folder. These messages are from expanding postfix aliases (e.g. postmaster@, hostmaster@, abuse@ etc. points to same mailbox and spam often sent to all of them. If duplicate message is received only one entry in dovecot-uidlist is created and only first of duplicates is deleted with expire-tool. Rest of duolicates are not deleted. Any suggestions. Thanks, Kryol From tss at iki.fi Fri Aug 17 19:32:24 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 17 Aug 2012 19:32:24 +0300 Subject: [Dovecot] Expire-tool does not delete duplicate messages (dovecot-1.2.17) In-Reply-To: References: Message-ID: On 17.8.2012, at 14.24, Oleksii Krykun wrote: > Trying to implement expire plugin. > expire-tool works fine. This delete expunged messages but not all of them. > I have duplicate messages in appropriate folder. These messages are from > expanding postfix aliases (e.g. postmaster@, hostmaster@, abuse@ etc. > points to same mailbox and spam often sent to all of them. > If duplicate message is received only one entry in dovecot-uidlist is > created and only first of duplicates is deleted with expire-tool. Rest of > duolicates are not deleted. > > Any suggestions. No idea, but if it's a bug, it won't be fixed anymore in v1.2. The whole thing has been rewritten in v2.x. I suggest upgrade. From tresh_dovecot at lefoyer.ru Fri Aug 17 21:37:08 2012 From: tresh_dovecot at lefoyer.ru ((Dovecot) Sergey Sidlyarenko) Date: Fri, 17 Aug 2012 22:37:08 +0400 Subject: [Dovecot] Problem use localized prefix in namespace Message-ID: dovecot --version 2.1.7 uname -a Linux ns 3.2.0-2-amd64 #1 SMP Mon Jun 11 17:24:18 UTC 2012 x86_64 GNU/Linux Debian sid Problem with localized prefix in namespace. Create namespace namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/mail/%d%n/test1:LAYOUT=fs:DIRNAME=maildirfolder:UTF-8 mailbox next { auto = subscribe special_use = } prefix = ????1/ separator = / subscriptions = yes type = private } namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/mail/%d%n/test2:LAYOUT=fs:DIRNAME=maildirfolder:UTF-8 mailbox next { auto = subscribe special_use = } prefix = &BCIENQRBBEI-2/ separator = / subscriptions = yes type = private } result A0002 NAMESPACE * NAMESPACE (("" "/")("links/" "/")({10} ????1/ "/")("&BCIENQRBBEI-2/" "/")) NIL NIL A0002 OK Namespace completed. A0003 LIST "" "*" ... cut * LIST (\Noselect \HasChildren) "/" "&BCIENQRBBEI-1" * LIST (\HasNoChildren) "/" "&BCIENQRBBEI-1/next" * LIST (\Noselect \HasChildren) "/" "&-BCIENQRBBEI-2" * LIST (\HasNoChildren) "/" "&-BCIENQRBBEI-2/next" * LIST (\HasNoChildren) "/" "&BCIENQRBBEI-1/next" * LIST (\HasNoChildren) "/" "&-BCIENQRBBEI-2/next" A0002 OK List completed. A0003 LSUB "" "*" ... cut * LSUB () "/" "&-BCIENQRBBEI-2/next" * LSUB () "/" "&BCIENQRBBEI-1/next" * LSUB () "/" "&BCIENQRBBEI-1/next" * LSUB () "/" "&-BCIENQRBBEI-2/next" A0003 OK Lsub completed. A0004 SELECT "&BCIENQRBBEI-1/next" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1344240572] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [NOMODSEQ] No permanent modsequences A0004 OK [READ-WRITE] Select completed. A0005 SELECT "&BCIENQRBBEI-2/next" Connection closed by foreign host. in error log 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4413a) [0x7f8d6bcc613a] -> /usr/lib/dovecot/libdovecot.so.0(+0x4417e) [0x7f8d6bcc617e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8d6bc9d82a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x7e506) [0x7f8d6bf8e506] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0x18) [0x7f8d6bf8e538] -> dovecot/imap(cmd_select_full+0x13e) [0x40ddbe] -> dovecot/imap(command_exec+0x3c) [0x4118dc] -> dovecot/imap() [0x4109ae] -> dovecot/imap() [0x410a5a] -> dovecot/imap(client_handle_input+0x11d) [0x410cad] -> dovecot/imap(client_input+0x62) [0x411552] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f8d6bcd2ff6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f8d6bcd3ca7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f8d6bcd2a08] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8d6bcbf483] -> dovecot/imap(main+0x285) [0x409265] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f8d6b919ead] -> dovecot/imap() [0x4093d5] 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Fatal: master: service(imap): child 20040 killed with signal 6 (core dumps disabled) -- Best regards, Sidlyarenko Sergey Aleksandrovish +7(495)509-42-07 tresh_dovecot at lefoyer.ru mailto:tresh_dovecot at lefoyer.ru From Lutz.Pressler at SerNet.DE Sat Aug 18 00:12:14 2012 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Fri, 17 Aug 2012 23:12:14 +0200 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: <1291312192.5119.455.camel@kurkku.sapo.corppt.com> References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: Hello Timo, virtual file with "inthread/younger" (other dynamic searches?) in it and indexes leading to too many (or too few?) search results. On Do, 02 Dez 2010, Timo Sirainen wrote: > On Thu, 2010-12-02 at 11:08 +0100, Lutz Pre?ler wrote: > > > inthread refs younger 604800 > > > > This works as expected for the first time. But later on, also older messages/ > > threads are included until I delete the virtual/.week/dovecot.index*. > > I know there are problems related to this with INTHREAD, but they aren't > very easy to solve and for now I've more important things to do.. If it > seemed to work before, it was due to luck or due to some bug causing an > unnecessary index rebuild. You could set :INDEX=MEMORY to work around > this, but I don't know how much worse the performance would become. Or > you could just manually delete the virtual indexes once a week. Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ enhance now? Any estimate how much effort it would be? Thanks again for your work, Lutz From jtam.home at gmail.com Sat Aug 18 03:29:49 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Fri, 17 Aug 2012 17:29:49 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding In-Reply-To: References: Message-ID: Merrickville writes: > Is there a way to proxy based on the host name the client has configured in > his/her email client? (Like Apache VirtualHosts) I doubt it; the virtual name is not part of the IMAP protocol as it is in HTTP. The IMAP server is not told which hostname was mapped to its IP. You'll either have to add the @domain, or perhaps multi-home your host, remap one of your domains to the new IP, and add another running instance of dovecot to listen on that interface. Joseph Tam From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 18 04:16:01 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 18 Aug 2012 03:16:01 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <20120818011601.GA12947@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > > http://wiki2.dovecot.org/Director#Other_settings > > doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. > > service ipc { > unix_listener ipc { > user = dovecot > } > } > > director instance needs access to director instance. With the above configuration, ipc works correctly between our directors and kicks the moved users which had been connected via proxy. Thanks a lot! Regards Daniel -- https://plus.google.com/103021802792276734820 From me at junc.org Sat Aug 18 05:36:24 2012 From: me at junc.org (Benny Pedersen) Date: Sat, 18 Aug 2012 04:36:24 +0200 Subject: [Dovecot] =?utf-8?q?Listen_on_multiple_ports_possible_using_same_?= =?utf-8?q?protocol=3F?= In-Reply-To: References: Message-ID: <9d88e2853396bae613dc925a02f5dbb5@junc.org> Den 2012-08-15 00:12, Michael Durket skrev: > for example. Or is this more preferably done by pointing dovecot at > different configuration files? listen = wan-ip:143 listen = 127.0.0.2:143 ssl_listen = wan-ip:993 ssl_listen = 127.0.0.3:993 just examples since it dont understand what you like to test :) From tss at iki.fi Sun Aug 19 05:57:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 05:57:16 +0300 Subject: [Dovecot] Search extensions Message-ID: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": a search or x-anyheader application/pdf x-anyheader .pdf b fetch $ bodystructure The client can verify the results with the fetch. The "x-anyheader" can already be implemented without changes to full text search plugin, because all backends store message/MIME headers and body text separately. So, questions for the list, especially client developers: 1) What's a better name for x-anyheader? :) 2) Any other ideas about search extensions you'd want to see? Maybe I could get this standardized at some point. I think one other thing missing has been "show me messages that have attachments". I've thought about maybe creating a $hasattachments keyword for that, which the server could automatically set for new mails that it thinks has attachments (and clients can set/unset the keyword if wanted). From kamath at moltingpenguin.com Sun Aug 19 09:47:36 2012 From: kamath at moltingpenguin.com (Sean Kamath) Date: Sat, 18 Aug 2012 23:47:36 -0700 Subject: [Dovecot] Search extensions In-Reply-To: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: On Aug 18, 2012, at 7:57 PM, Timo Sirainen wrote: > I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": > > a search or x-anyheader application/pdf x-anyheader .pdf > b fetch $ bodystructure > > The client can verify the results with the fetch. The "x-anyheader" can already be implemented without changes to full text search plugin, because all backends store message/MIME headers and body text separately. > > So, questions for the list, especially client developers: > > 1) What's a better name for x-anyheader? :) > > 2) Any other ideas about search extensions you'd want to see? Maybe I could get this standardized at some point. > > I think one other thing missing has been "show me messages that have attachments". I've thought about maybe creating a $hasattachments keyword for that, which the server could automatically set for new mails that it thinks has attachments (and clients can set/unset the keyword if wanted). At work we've flipped to Google mail (I run Dovecot at home). 99.9% of the time I just cry. Once feature of their search capability that sometimes is nice is the ability to not only see if it has an attachment (has:attachment) but the ability to search for the attachments by a specific name (filename:). That can be, and has proven, useful. I suspect this could turn into a nightmare, however. Ditto something like "has N attachments" (sometime I dearly wish I had at times -- I want to find that damn message with like 10 attachments). Or math around number of attachments. My $0.02. Sean From trashcan at odo.in-berlin.de Sun Aug 19 12:51:08 2012 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Sun, 19 Aug 2012 11:51:08 +0200 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <1331206534.2081.101.camel@innu> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> Message-ID: <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> On 08.03.2012, at 12:35, Timo Sirainen wrote: > On Thu, 2012-03-08 at 11:26 +0100, Michael Grimm wrote: >> Now some observations regarding replicator: >> >> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >> >> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >> >> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >> >> JFTR: I do have mail_log plugin activated. > > Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? Regards, Michael From tss at iki.fi Sun Aug 19 14:10:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 14:10:09 +0300 Subject: [Dovecot] Search extensions In-Reply-To: References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: <66CC9348-E96F-48D9-9B56-25FF10E1F1E8@iki.fi> On 19.8.2012, at 9.47, Sean Kamath wrote: >> I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": >> >> a search or x-anyheader application/pdf x-anyheader .pdf >> b fetch $ bodystructure >> >> The client can verify the results with the fetch. > Once feature of their search capability that sometimes is nice is the ability to not only see if it has an attachment (has:attachment) but the ability to search for the attachments by a specific name (filename:). That can be, and has proven, useful. I suspect this could turn into a nightmare, however. Ditto something like "has N attachments" (sometime I dearly wish I had at times -- I want to find that damn message with like 10 attachments). Or math around number of attachments. Actually searching by attachment filename was also in my requirements list, but I forgot to mention it. It can anyway be done the same way as the pdf example above. The bodystructure reply includes attachment filenames. Of course you'll still need a client that can give a nice UI for those.. From tss at iki.fi Sun Aug 19 18:08:47 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:08:47 +0300 Subject: [Dovecot] Dsync and SIS In-Reply-To: <5022ADCB.8060805@integrafin.co.uk> References: <5022ADCB.8060805@integrafin.co.uk> Message-ID: <4F899205-CEF9-4C9F-8FAC-ADD59E566811@iki.fi> On 8.8.2012, at 21.19, Alex Crow wrote: > Just to clarify, if we back up a dovecot 2 server with SIS for attachments and ALT storage by rsyncing it (including the SIS and ALT storage) to a remote server when it's idle (or at least almost entirely so), and run dovecot on that machine, would it seem feasible to restore backups from that server by using dysnc - specifically for the scenario where someone accidentally deletes emails/folders etc.? dsync over ssh should work for that, yes. (Locally if you use doveadm import it's going to use the same SIS storage unless you override the settings.) From tss at iki.fi Sun Aug 19 18:09:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:09:57 +0300 Subject: [Dovecot] maildir to sdbox offline conversion In-Reply-To: <34274589.post@talk.nabble.com> References: <34274589.post@talk.nabble.com> Message-ID: On 9.8.2012, at 3.34, _ET_ wrote: > So it's not easy to do an "online" conversion and follow the instructions at > dsync's wiki. Do you know a way how to simply tell dsync or a similar util > the following > > dsync convert maildir:/data/vmail/domain/user > sdbox:/newdata/vmail/domain/user > > without touching the ldap database, only the files on the disk. I can run > this command as root on this mail server, if it is needed, I can run the > command for each and every maildir. That's not a problem. > > any ideas, how this woul?d be the simpliest? doveadm -o mail=maildir:/data/... sync sdbox:/newdata/... From tss at iki.fi Sun Aug 19 18:22:30 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:22:30 +0300 Subject: [Dovecot] dsync \noselect on INBOX.INBOX skips sync of INBOX In-Reply-To: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> References: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> Message-ID: <8C1B93D0-C743-4340-BFE7-160B17212002@iki.fi> On 9.8.2012, at 11.20, Nikolai Schupbach wrote: > We have encountered an issue today with a number of migrations. Some customers have mailboxes on the source IMAP server that look like this: > > 3 LIST "" * > * LIST () "." "INBOX" > * LIST () "." "INBOX.Statements" > * LIST () "." "INBOX.Draft" > * LIST () "." "INBOX.Drafts" > * LIST () "." "INBOX.Invoices" > * LIST (\Noselect) "." "INBOX.INBOX" > * LIST () "." "INBOX.Jokes" > * LIST () "." "INBOX.Payslips" > * LIST () "." "INBOX.Personal" > > When we run dsync it skips the INBOX presumably because of the Noselect on INBOX.INBOX. and the "imapc_list_prefix = INBOX" setting. Does the attached patch help? -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 968 bytes Desc: not available URL: From tss at iki.fi Sun Aug 19 18:26:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:26:10 +0300 Subject: [Dovecot] Full text search in attachments In-Reply-To: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> Message-ID: <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> On 11.8.2012, at 5.28, Mailing wrote: > is it possible to use the Solr full text search plugin for indexing mail attachments? I found a very old patch and some hints regarding a fts_decoder script that I don't understand. > > Making Solr indexing PDF or Office files shouldn't be that difficult, but how can I enable the plugin to transfer the attachments to Solr? I updated the wiki with: * See the decode2text.sh script included in Dovecot for how to use this. From tss at iki.fi Sun Aug 19 18:28:30 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:28:30 +0300 Subject: [Dovecot] imap-login process_limit (100) reached, client connections are being dropped In-Reply-To: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> References: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> Message-ID: On 13.8.2012, at 14.12, Voytek Eymont wrote: > noticed this in the log today, after about 11 warning IMAP appears to have > not worked, 'service dovecot reload' got it going again > > question: what to check/alter ? http://wiki2.dovecot.org/LoginProcess Easiest/safest is to just increase process_limit. From tss at iki.fi Sun Aug 19 18:33:34 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:33:34 +0300 Subject: [Dovecot] Permission denied on dovecot.lda-dupes In-Reply-To: <1344871085776-37053.post@n4.nabble.com> References: <1344871085776-37053.post@n4.nabble.com> Message-ID: <0098E449-2043-4CEB-B617-2F3C2D561F67@iki.fi> On 13.8.2012, at 18.18, ppridt wrote: > Hi, > I have converted my Imap Server from Courier to Dovecot in order to use > sieve support. > Everything works fine with the exception that the sender always gets the > vacation msg since there is a permission error on writing of > dovecot.lda-dupes. .. > Aug 13 14:51:26 Srv dovecot: deliver(pp): Home dir not found: The dupe file is written to home dir, but you have no home dir. > file_dotlock_create(/.dovecot.lda-dupes) failed: Permission denied So it's trying to write to the root directory. But I find these messages strange. They shouldn't happen at least newer Dovecots. What version are you using? From tss at iki.fi Sun Aug 19 18:36:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:36:39 +0300 Subject: [Dovecot] Mdbox corruption In-Reply-To: <502C000C.9060206@adminlinux.com.br> References: <502C000C.9060206@adminlinux.com.br> Message-ID: <8AB4531A-2EE3-4F6B-A3BF-9DBF79A2EC31@iki.fi> On 15.8.2012, at 23.01, 3.listas at adminlinux.com.br wrote: > I have a "ubuntu10.04 + ext4-filesystem + dovecot-2.0.13 +mdbox" configuration in my server. It works fine with ~50k accounts. > Recently happened a filesystem corruption in a device of StMailLocation and I fix with fsck.ext4. > After this crash, one account began to show access timeout and errors like this on force-resync: > > # doveadm force-resync -u account INBOX > doveadm(account): Warning: mdbox /path-to-mdbox/storage: rebuilding indexes > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) > doveadm(account): Warning: dbox: Copy of the broken file saved to /path-to-mdbox/storage/m.83.broken > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) > doveadm(account): Error: mdbox rebuild: Failed to fix file /path-to-mdbox/storage/m.83 > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.92 (around offset=7): Invalid dbox version > ... > > Should I worry about the m.X.broken files ? > How I fix these broken mdboxes ? Dovecot fixed the mdbox files automatically and wrote m.*.broken files that contain the originals, just in case the fixing didn't do something correctly so you could manually look at them. Now, if doveadm force-resync keeps finding errors all the time it's a bug. I'd first try the latest v2.1 though, may be fixed already. From tss at iki.fi Sun Aug 19 18:39:04 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:39:04 +0300 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: On 16.8.2012, at 14.58, Lazy wrote: > 2012/5/19 Timo Sirainen : >> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>> failed: Read-only file system >> >> Does the attached patch help? >> >>> maybe it will be easier to move all dovecot metadata to separate (non >>> snapshot) location ? >> >> It could also be a bit problematic. At least message keywords (=custom >> flags) wouldn't work because the dovecot-keywords file exists only in >> the snapshot dir. > > Moving metadata helped, but now archived inbox is unsubscribed. Is > there a way to make all folders in an namespace subscribed by default > ? Nope. I could try to get the snapshots fixed at some point when I have more time, but I'm not going to add a feature to subscribe everything by default. People might try to start using it. From tss at iki.fi Sun Aug 19 18:43:47 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:43:47 +0300 Subject: [Dovecot] dovecot 2.1 Master account Error In-Reply-To: <1345123672440-37109.post@n4.nabble.com> References: <1345123672440-37109.post@n4.nabble.com> Message-ID: <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> On 16.8.2012, at 16.27, tmihalicek wrote: > I am running parallel dovecot 1.2 for main accounts and 2.1 for test > accounts, and for some reason when i try to login with master user on > dovecot 2.1 service errors. http://wiki2.dovecot.org/Authentication/MasterUsers#ACLs From andre.rodier at gmail.com Sun Aug 19 19:03:39 2012 From: andre.rodier at gmail.com (Andre Rodier) Date: Sun, 19 Aug 2012 17:03:39 +0100 Subject: [Dovecot] case insensitive acl Message-ID: <50310E5B.9010908@gmail.com> Hello, I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. Because I use LDAP, the name of the users is case insensitive. Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? This would be useful with some ACL managers, like roundcube ACL plugin, that uses an LDAP query to autocomplete the user name for the ACL. Kind regards, Andr? From tss at iki.fi Sun Aug 19 19:25:22 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 19:25:22 +0300 Subject: [Dovecot] case insensitive acl In-Reply-To: <50310E5B.9010908@gmail.com> References: <50310E5B.9010908@gmail.com> Message-ID: <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> On 19.8.2012, at 19.03, Andre Rodier wrote: > I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. > > Because I use LDAP, the name of the users is case insensitive. Translate the username to lowercase. It's the default nowadays: auth_username_format = %Lu > Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? No. From andre.rodier at gmail.com Sun Aug 19 19:51:41 2012 From: andre.rodier at gmail.com (Andre Rodier) Date: Sun, 19 Aug 2012 17:51:41 +0100 Subject: [Dovecot] case insensitive acl In-Reply-To: <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> References: <50310E5B.9010908@gmail.com> <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> Message-ID: <5031199D.9010809@gmail.com> On 19/08/12 17:25, Timo Sirainen wrote: > On 19.8.2012, at 19.03, Andre Rodier wrote: > >> I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. >> >> Because I use LDAP, the name of the users is case insensitive. > Translate the username to lowercase. It's the default nowadays: > > auth_username_format = %Lu > >> Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? > No. > Thanks, Timo. Thanks for your huge work on Dovecot. From maillist at endfertig.de Sun Aug 19 21:57:51 2012 From: maillist at endfertig.de (Mailing) Date: Sun, 19 Aug 2012 20:57:51 +0200 Subject: [Dovecot] Full text search in attachments In-Reply-To: <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> Message-ID: <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> Hi Timo, Am 19.08.2012 17:26, schrieb Timo Sirainen: > On 11.8.2012, at 5.28, Mailing wrote: > I updated the wiki with: > > * See the decode2text.sh script included in Dovecot for how to use > this. I want to send the complete attachments (unparsed) to solr server and let solr do the parsing work. Is it maybe possible to use a decode2text like script together with curl to send the attachments to the sold server? But in this case I would have to know additional informations in the script like message id and the mailbox name. Best regards, Sebastian From tss at iki.fi Mon Aug 20 08:16:02 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 08:16:02 +0300 Subject: [Dovecot] Full text search in attachments In-Reply-To: <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> Message-ID: On 19.8.2012, at 21.57, Mailing wrote: > Am 19.08.2012 17:26, schrieb Timo Sirainen: >> On 11.8.2012, at 5.28, Mailing wrote: >> I updated the wiki with: >> >> * See the decode2text.sh script included in Dovecot for how to use this. > > I want to send the complete attachments (unparsed) to solr server and let solr do the parsing work. Is it maybe possible to use a decode2text like script together with curl to send the attachments to the sold server? > > But in this case I would have to know additional informations in the script like message id and the mailbox name. It can't work like that, because all the text from one message (text & all attachments) has to go to one document. From dof at projektfabrik.com Mon Aug 20 12:14:43 2012 From: dof at projektfabrik.com (dof at projektfabrik.com) Date: Mon, 20 Aug 2012 11:14:43 +0200 Subject: [Dovecot] =?utf-8?q?SOLVED_antispam=5Fplugin_prevents_IMAP_login_?= =?utf-8?b?KGVycm9yIDMpIFtEb3ZlY290IDIuMC4xOV0=?= Message-ID: <02e97d2e165b7b33b947c615d71724b7@webmail.projektfabrik.com> On 17.08.2012 12:06, dof at projektfabrik.com wrote: > Hi everybody, > > trying to get the Dovecot antispam_plugin to work and I must be doing > something wrong, because as soon as it is enabled with a certain > backend, imap logins do not work anymore (the session is immediately > closed after a successful login). Interestingly, pipe and spool2dir > are working (that is, the session won't be closed), dspam-exec and > crm114-exec are not. If this happens, mail_debug output is as > follows: > > [...] Hi again, how embarrassing. I should use the correct name for the backend type. :\ So everything works as expected, sorry for spamming the mailing list. Best regards, Florian From amateo at um.es Mon Aug 20 11:33:55 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 10:33:55 +0200 Subject: [Dovecot] userdb multiple databases Message-ID: <5031F673.8040702@um.es> Hello, I'm trying to configure per user plugins. My original passdb and userdb is in a ldap directory (using userdb with prefetch). To configure per user plugins (in fact, I want to enable quota plugin for some users) I need to configure mail_plugins attribute in the userdb. The problem is that I don't know any ldap attribute to store this information (is there any schema with includes an attribute for this). So I want to configure it in a passwd-file file. My problem is that I don't know if I can chain userdb databases. I know I can configure multiple databases, but as far as I know, they are looked in order, so if the user is found in the first one, then is no look for the user in the second one, so I have to configure all user's attributes in the passwd-file database. Is there any way to chain these lookups? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 11:38:26 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 10:38:26 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 Message-ID: <5031F782.9010802@um.es> Hello, I am configuring quota plugin per user, not for the whole system. As documentation says (http://wiki2.dovecot.org/Quota), I have to add "quota" to the global mail_plugins and "imap_quota" to mail_plugins for protocol imap, but I don't know how to configure this in a userdb. I'm using a passwd-file in the way: :{plain}password::::::userdb_mail_plugins=quota,imap_quota but this activate both plugins in the global mail_plugins option. The problem with this is that if the user tries to connect via pop3 instead of imap (a thing that I permit, although the user shouldn't do it) I have the error: Aug 20 10:04:18 myotis30 dovecot: pop3: Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline is there any way to solve this problem? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 13:56:48 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 12:56:48 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <5031F782.9010802@um.es> References: <5031F782.9010802@um.es> Message-ID: <503217F0.3090609@um.es> Hi again, Another problem I'm having with this is that quota (maildirsize) is not updated when mail is delivered. According to http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be sure that dovecot-lda is run with -d option, but in my configuration I'm receiving mail via lmtp and (I think) dovecot-lda is not running at all. So the problem (I think) is that quota plugin is not used in the lmtp process. Is there any way to configure that lmtp processes use the mail_plugins in the userdb database? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 14:07:57 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 13:07:57 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <503217F0.3090609@um.es> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> Message-ID: <50321A8D.5000702@um.es> El 20/08/12 12:56, Angel L. Mateo escribi?: > Hi again, > > Another problem I'm having with this is that quota (maildirsize) is > not updated when mail is delivered. > > According to > http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be > sure that dovecot-lda is run with -d option, but in my configuration I'm > receiving mail via lmtp and (I think) dovecot-lda is not running at all. > > So the problem (I think) is that quota plugin is not used in the > lmtp process. Is there any way to configure that lmtp processes use the > mail_plugins in the userdb database? > I forgot to attach doveconf -n -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.4.0-030400-generic x86_64 Ubuntu 12.04 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_verbose = yes default_process_limit = 1000 disable_plaintext_auth = no log_timestamp = %Y-%m-%d %H:%M:%S login_trusted_networks = 155.54.211.176/28 mail_debug = yes mail_fsync = always mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_nfs_storage = yes mail_privileged_group = mail maildir_stat_dirs = yes mdbox_rotate_size = 20 M passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = session=yes dovecot driver = pam } plugin { lazy_expunge = .EXPUNGED/ .DELETED/ .DELETED/.EXPUNGED/ quota = maildir:User quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at um.es service anvil { client_limit = 2003 } service auth { client_limit = 3000 unix_listener auth-userdb { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap { process_limit = 5120 process_min_avail = 2 vsz_limit = 512 M } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3 { process_min_avail = 2 } ssl = no ssl_cert = References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> Message-ID: <503223EE.3030801@um.es> El 20/08/12 12:56, Angel L. Mateo escribi?: > Hi again, > > Another problem I'm having with this is that quota (maildirsize) is > not updated when mail is delivered. > > According to > http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be > sure that dovecot-lda is run with -d option, but in my configuration I'm > receiving mail via lmtp and (I think) dovecot-lda is not running at all. > > So the problem (I think) is that quota plugin is not used in the > lmtp process. Is there any way to configure that lmtp processes use the > mail_plugins in the userdb database? > I have discovered the origin of my problem, but not the solution. The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. Any idea? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From Jost.Krieger+dovecot at rub.de Mon Aug 20 16:06:18 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 20 Aug 2012 15:06:18 +0200 Subject: [Dovecot] Is it possible to save only some messages compressed to mdbox? (2.1.6) Message-ID: <20120820130617.GT24203@ruhr-uni-bochum.de> I'm trying to save some messages as compressed (via zlib plugin) and it doesn't seem to work. Here's a log line (I'm logging to stderr): d k 1345467448.705591500 1345467448.705596500 1345467448.974808500 1650 local.jost.krieger+hirn at ruhr-uni-bochum.de 10909 80 Extra: -o plugin/zlib_save_level=9 -o plugin/zlib_save=bz2 lda(kriegjcb): Info: msgid=<20120820125728.58CC9172B6C at c2-4-7.noc.ruhr-uni-bochum.de>: saved mail to Hirn-2012-08 did 0+0+1 This probably doesn't make much sense to anyone except the last line but 1. It is a somewhat complicated qmail/maildrop/dovecot setup, which works for the standard cases. The Extra gets interpolated into the lda command and this works because an incorrect option blows up the delivery. The mails arrive uncompressed. So here's the questions: 1. Is it possible to have compressed/uncompressed mails mixed in an mdbox? 2. Will it work via "-o" in lda delivery? I tried to find out in the source but found it hard to see which options are pulled in when. Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From andre.groebe at fun.de Mon Aug 20 16:35:55 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Mon, 20 Aug 2012 15:35:55 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <50323D3B.1030701@fun.de> Hi it seems to me, that it depends on how dovecot handles line reading. Dovecot presumes that a line is of max length of IO_BLOCK_SIZE (=8192) Bytes. Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? Regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From acrow at integrafin.co.uk Mon Aug 20 18:21:30 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Mon, 20 Aug 2012 16:21:30 +0100 Subject: [Dovecot] Variables in LDAP userdb Message-ID: <503255FA.9080300@integrafin.co.uk> Hi Timo, Is it OK to have dovecot variables in entries in an LDAP userdb? Say I wanted to set the mail userdb parameter to override mail_location, would it work by having an entry in LDAP (eg for mailMessageStore attrib) like: mdbox:/home/email/%d/%n:INDEX=/home/indexes/%d/%1n/%n:ALT=/home/email_archive/%d/%1n/%n and those % variables will still be expanded by dovecot? Or would I be required to replace them in the LDAP directory with their actual values? Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From merrickville at gmail.com Mon Aug 20 19:22:59 2012 From: merrickville at gmail.com (Merrickville) Date: Mon, 20 Aug 2012 09:22:59 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding In-Reply-To: References: <1345132919122-37110.post@n4.nabble.com> Message-ID: <1345479779161-37150.post@n4.nabble.com> Thanks for the info. That unfortunately does not make it as flexible as name based hosting, too bad. -- View this message in context: http://dovecot.2317879.n4.nabble.com/Hostname-Based-forwarding-tp37110p37150.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Mon Aug 20 21:22:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 21:22:58 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50323D3B.1030701@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> Message-ID: On 20.8.2012, at 16.35, Andre Gr?be wrote: > it seems to me, that it depends on how dovecot handles line reading. Dovecot presumes that a line is of max length of IO_BLOCK_SIZE (=8192) Bytes. > > Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE with (size_t)-1. From tss at iki.fi Mon Aug 20 21:25:24 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 21:25:24 +0300 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: <503255FA.9080300@integrafin.co.uk> References: <503255FA.9080300@integrafin.co.uk> Message-ID: On 20.8.2012, at 18.21, Alex Crow wrote: > Is it OK to have dovecot variables in entries in an LDAP userdb? Say I wanted to set the mail userdb parameter to override mail_location, would it work by having an entry in LDAP (eg for mailMessageStore attrib) like: > > mdbox:/home/email/%d/%n:INDEX=/home/indexes/%d/%1n/%n:ALT=/home/email_archive/%d/%1n/%n > > and those % variables will still be expanded by dovecot? No. Otherwise it would break paths that actually contain % characters. > Or would I be required to replace them in the LDAP directory with their actual values? Yes. If you really wanted to avoid that and you have only a few different values, you could create some namespaces in dovecot.conf and enable/disable them as needed in the ldap fields. Although I guess that's not a whole lot better since there's currently no simple "enabled" setting for namespaces, maybe I should add one.. From tomislav.mihalicek at gmail.com Mon Aug 20 21:39:03 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Mon, 20 Aug 2012 11:39:03 -0700 (PDT) Subject: [Dovecot] dovecot 2.1 Master account Error In-Reply-To: <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> References: <1345123672440-37109.post@n4.nabble.com> <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> Message-ID: <1345487943866-37153.post@n4.nabble.com> Thanks Timo, after i read the ACL stuff i have another question. I would like to use a third solution which is assigning master_user=%u in userdb lookup. Should i use? userdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext # Default fields can be used to specify defaults that LDAP may override default_fields = uid=vmail gid=vmail allow_all_users=yes master_user=%u } -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-2-1-Master-account-Error-tp37109p37153.html Sent from the Dovecot mailing list archive at Nabble.com. From kavish.karkera at yahoo.com Tue Aug 21 08:42:39 2012 From: kavish.karkera at yahoo.com (Kavish Karkera) Date: Tue, 21 Aug 2012 13:42:39 +0800 (SGT) Subject: [Dovecot] Error: Couldn't open INBOX: Timeout while waiting for lock Message-ID: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> Hi , My users are frequetly getting the below error, Aug 21 00:04:18 blade6 dovecot: pop3-login: proxy(hgl_dipak): Login failed to 192.168.1.43:110: [IN-USE] Couldn't open INBOX: Timeout while waiting for lock. We are proxing pop connections from one pop server (dovecot version 1.1.20) i.e 192.168.1.39 to the other pop Server (Dovecot version 2.0.16 ) i.e 192.168.1.4. We have set? pop3_lock_session = yes and dont want to disable it. Please Help !! :) K.K From acrow at integrafin.co.uk Tue Aug 21 11:44:34 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Tue, 21 Aug 2012 09:44:34 +0100 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: References: <503255FA.9080300@integrafin.co.uk> Message-ID: <50334A72.2020908@integrafin.co.uk> Timo, Thanks, I scripted replacing the correct entries in LDAP. To clarify, what happens in these case with regard to the default mail_location set in the config files (ie is it used or overridden): 1. The LDAP attribute referenced in the userdb lookup exists but is empty 2. The LDAP attribute is not present for the user. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From andre.groebe at fun.de Tue Aug 21 13:10:17 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 21 Aug 2012 12:10:17 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> Message-ID: <50335E89.9010104@fun.de> Hi Timo, thx for reply. [tss at iki.fi; Mo 20 Aug 2012 20:22:58 CEST] >> Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? > > Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE > with (size_t)-1. Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. Best regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Aug 21 13:22:04 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 21 Aug 2012 13:22:04 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50335E89.9010104@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> Message-ID: On 21.8.2012, at 13.10, Andre Gr?be wrote: > [tss at iki.fi; Mo 20 Aug 2012 20:22:58 CEST] >>> Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? >> >> Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE > > with (size_t)-1. > > Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. Does the attached patch fix it? (not a very good fix) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 449 bytes Desc: not available URL: From andre.groebe at fun.de Tue Aug 21 14:16:17 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 21 Aug 2012 13:16:17 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> Message-ID: <50336E01.6000909@fun.de> Hi Timo, [tss at iki.fi; Di 21 Aug 2012 12:22:04 CEST] >> Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. > > Does the attached patch fix it? (not a very good fix) No, it doesn't. Still got no response on large metadata and writing destroys the dictionary. Best Regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From lazy404 at gmail.com Tue Aug 21 14:22:02 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 13:22:02 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: 2012/8/19, Timo Sirainen : > On 16.8.2012, at 14.58, Lazy wrote: > >> 2012/5/19 Timo Sirainen : >>> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>>> failed: Read-only file system >>> >>> Does the attached patch help? >>> >>>> maybe it will be easier to move all dovecot metadata to separate (non >>>> snapshot) location ? >>> >>> It could also be a bit problematic. At least message keywords (=custom >>> flags) wouldn't work because the dovecot-keywords file exists only in >>> the snapshot dir. >> >> Moving metadata helped, but now archived inbox is unsubscribed. Is >> there a way to make all folders in an namespace subscribed by default >> ? > > Nope. I could try to get the snapshots fixed at some point when I have more > time, but I'm not going to add a feature to subscribe everything by default. > People might try to start using it. If I enable per snapshot subscriptions i see all folders except INBOX, i have tried to subscribe it using mailbox_list_subscription_fill_one() or using imap as bellow without success http://dovecot.org/list/dovecot/2007-October/025965.html suggest that it isn't possible ./imap/.libs/imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as root a subscribe "test" a OK Subscribe completed. a lsub "" "*" imap(root): Warning: Subscriptions file /root/Maildir/subscriptions: Removing invalid entry: * LSUB () "." "Drafts" * LSUB () "." "Sent" * LSUB () "." "Junk" * LSUB () "." "Trash" * LSUB () "." "Deleted Messages" * LSUB () "." "test.Drafts" * LSUB () "." "test.Sent" * LSUB () "." "test.Junk" * LSUB () "." "test.Trash" * LSUB () "." "test.Deleted Messages" a OK Lsub completed. b list "" "*" * LIST (\HasNoChildren) "." "DUpa" * LIST (\HasNoChildren) "." "Deleted Messages" * LIST (\HasNoChildren) "." "Junk" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasNoChildren) "." "Drafts" * LIST (\HasNoChildren) "." "INBOX" * LIST (\HasChildren) "." "test" * LIST (\HasNoChildren) "." "test.TEst" * LIST (\HasNoChildren) "." "test.Deleted Messages" * LIST (\HasNoChildren) "." "test.Junk" * LIST (\HasNoChildren) "." "test.Trash" * LIST (\HasNoChildren) "." "test.Sent" * LIST (\HasNoChildren) "." "test.Drafts" b OK List completed. From lazy404 at gmail.com Tue Aug 21 15:36:15 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 14:36:15 +0200 Subject: [Dovecot] segfault in mail_user_get_home() Message-ID: gdb ./src/imap/.libs/imap Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. (gdb) run Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7ffff7ffa000 [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". process 1104 is executing new program: /usr/local/dovecot/bin/doveconf [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". process 1104 is executing new program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Program received signal SIGSEGV, Segmentation fault. 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, home_r=0x7fffffffe308) at mail-user.c:310 310 if (user->home_looked_up) { (gdb) bt #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, home_r=0x7fffffffe308) at mail-user.c:310 #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at mdbox-storage.c:90 #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, set=0x7fffffffe4d0) at mdbox-storage.c:113 #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, set=0x7fffffffe4d0) at mail-storage.c:105 #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:180 #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, ns_p=0x645380, error_r=0x7fffffffe6e8) at mail-namespace.c:126 #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, error_r=0x7fffffffe6e8) at mail-namespace.c:289 #8 0x00007ffff7b34a64 in mail_storage_service_init_post (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, mail_user_r=0x7fffffffe7b8, error_r=0x7fffffffe6e8) at mail-storage-service.c:641 #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, user=0x633e08, mail_user_r=0x7fffffffe7b8) at mail-storage-service.c:1114 #10 0x00007ffff7b35efa in mail_storage_service_lookup_next (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, mail_user_r=0x7fffffffe7b8, error_r=0x7fffffffe808) at mail-storage-service.c:1149 #11 0x000000000041f61c in client_create_from_input (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, input_buf=0x0, error_r=0x7fffffffe808) at main.c:202 #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 /usr/local/dovecot/bin/doveconf -n # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32 x86_64 Debian wheezy/sid namespace test { list = children location = maildir:/root/test prefix = test. subscriptions = yes type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = subscriptions = yes } passdb { driver = pam } ssl = no userdb { driver = passwd } without type = shared there is no segfault, I understand this config might not work (invoking imap directly) but it should't segfault. Regards, Michal Grzedzicki From lazy404 at gmail.com Tue Aug 21 15:45:07 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 14:45:07 +0200 Subject: [Dovecot] segfault in mail_user_get_home() In-Reply-To: References: Message-ID: it was shared namespace with empty location that produced the error so : namespace test { list = children location = prefix = test. subscriptions = yes type = shared } segfaults with location is fine 2012/8/21, Lazy : > gdb ./src/imap/.libs/imap > > Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. > (gdb) run > Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap > warning: no loadable sections found in added symbol-file > system-supplied DSO at 0x7ffff7ffa000 > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > process 1104 is executing new program: /usr/local/dovecot/bin/doveconf > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > process 1104 is executing new program: > /usr/src/dovecot-2.1.9/src/imap/.libs/imap > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > > Program received signal SIGSEGV, Segmentation fault. > 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, > home_r=0x7fffffffe308) at mail-user.c:310 > 310 if (user->home_looked_up) { > (gdb) bt > #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, > home_r=0x7fffffffe308) at mail-user.c:310 > #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at > mdbox-storage.c:90 > #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, > set=0x7fffffffe4d0) at mdbox-storage.c:113 > #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, > set=0x7fffffffe4d0) at mail-storage.c:105 > #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, > driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) > at mail-storage.c:180 > #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, > driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 > #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, > ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, > ns_p=0x645380, > error_r=0x7fffffffe6e8) at mail-namespace.c:126 > #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, > error_r=0x7fffffffe6e8) at mail-namespace.c:289 > #8 0x00007ffff7b34a64 in mail_storage_service_init_post > (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, > mail_user_r=0x7fffffffe7b8, > error_r=0x7fffffffe6e8) at mail-storage-service.c:641 > #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, > user=0x633e08, mail_user_r=0x7fffffffe7b8) at > mail-storage-service.c:1114 > #10 0x00007ffff7b35efa in mail_storage_service_lookup_next > (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, > mail_user_r=0x7fffffffe7b8, > error_r=0x7fffffffe808) at mail-storage-service.c:1149 > #11 0x000000000041f61c in client_create_from_input > (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, > input_buf=0x0, > error_r=0x7fffffffe808) at main.c:202 > #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 > #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 > > /usr/local/dovecot/bin/doveconf -n > # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf > # OS: Linux 2.6.32 x86_64 Debian wheezy/sid > namespace test { > list = children > location = maildir:/root/test > prefix = test. > subscriptions = yes > type = shared > } > namespace inbox { > inbox = yes > list = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > subscriptions = yes > } > passdb { > driver = pam > } > ssl = no > userdb { > driver = passwd > } > > without type = shared there is no segfault, > > I understand this config might not work (invoking imap directly) but > it should't segfault. > > Regards, > > Michal Grzedzicki > From chris.visser at rtt.co.za Tue Aug 21 15:47:42 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 21 Aug 2012 12:47:42 +0000 Subject: [Dovecot] Spaces in DN with AD auth Message-ID: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> Hi guys, I'm back to fiddling with my Dovecot and AD intergation and I've noticed that if a DN contains spaces, dovecot doesn't bind to the AD server. I'm running: dovecot-2.1.1 exim-4.72 on CentOS 6.3 Exim binds fine with the DNs containing spaces, it's just dovecot that exhibits the symptoms. Chris Visser Linux/Network Infrastructure? ================== Please read our Email Disclaimer : http://www.rtt.co.za/disclaimer.html From me at junc.org Tue Aug 21 15:52:31 2012 From: me at junc.org (Benny Pedersen) Date: Tue, 21 Aug 2012 14:52:31 +0200 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> Message-ID: <05ae0f05a73de2768e0afa089c28ccdf@junc.org> Den 2012-08-21 14:47, Chris Visser skrev: > I'm back to fiddling with my Dovecot and AD intergation and I've > noticed that if a DN contains spaces, dovecot doesn't bind to the AD > server. that means you like to fix this in dovecot since its not AD that make the error in first place ? From chris.visser at rtt.co.za Tue Aug 21 15:59:58 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 21 Aug 2012 12:59:58 +0000 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <05ae0f05a73de2768e0afa089c28ccdf@junc.org> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> Message-ID: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Yes. Is it possible? If I try bind with a dn like: CN=Chris Visser,OU=Users,DC=mydomain,DC=com then I can't make the bind to AD, even though I can do it using exim and ldapsearch. Dovecot however binds if I use a dn like: CN=Chris,OU=Users,DC=mydomain,DC=com Chris Visser Linux/Network Infrastructure? -----Original Message----- From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Benny Pedersen Sent: Tuesday, August 21, 2012 2:53 PM To: dovecot at dovecot.org Subject: Re: [Dovecot] Spaces in DN with AD auth Den 2012-08-21 14:47, Chris Visser skrev: > I'm back to fiddling with my Dovecot and AD intergation and I've > noticed that if a DN contains spaces, dovecot doesn't bind to the AD > server. that means you like to fix this in dovecot since its not AD that make the error in first place ? ================== Please read our Email Disclaimer : http://www.rtt.co.za/disclaimer.html From me at junc.org Tue Aug 21 16:15:17 2012 From: me at junc.org (Benny Pedersen) Date: Tue, 21 Aug 2012 15:15:17 +0200 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Message-ID: <7b11ec35394fe151755e6d7b1b42452c@junc.org> Den 2012-08-21 14:59, Chris Visser skrev: > Dovecot however binds if I use a dn like: > CN=Chris,OU=Users,DC=mydomain,DC=com why not use it so ? From lazy404 at gmail.com Tue Aug 21 16:28:08 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 15:28:08 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: I managed to get it working using a litle change in sources an extra mailbox_list_subscription_fill_one(dest_list, src_list, "" ); in src/lib-storage/list/mailbox-list-subscriptions.c:mailbox_list_subscriptions_refresh() --- src/lib-storage/list/mailbox-list-subscriptions.c (wersja 494) +++ src/lib-storage/list/mailbox-list-subscriptions.c (kopia robocza) @@ -142,6 +142,9 @@ subsfile_ctx = subsfile_list_init(dest_list, path); if (subsfile_list_fstat(subsfile_ctx, &st) == 0) dest_list->subscriptions_mtime = st.st_mtime; + + mailbox_list_subscription_fill_one(dest_list, src_list, "" ); + while ((name = subsfile_list_next(subsfile_ctx)) != NULL) T_BEGIN { T_BEGIN { ret = mailbox_list_subscription_fill_one(dest_list, now lsub works as expected, namespace root which is an INBOX from a snapshot is subscribed, all the subfolders are also subscribed (from original subscriptions file). It whould be great if one could specify in the namespace mailboxes that whould get autosubscribed or just to autosubscribe root whitch is what You need if You have a copy of Maildir with INBOX. If You think this can be usefull I will try to produce more general patch automagicly subscribing root or any other mailbox in an namespace. Regards, Michal Grzedzicki 2012/8/21, Lazy : > 2012/8/19, Timo Sirainen : >> On 16.8.2012, at 14.58, Lazy wrote: >> >>> 2012/5/19 Timo Sirainen : >>>> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>>>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>>>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>>>> failed: Read-only file system >>>> >>>> Does the attached patch help? >>>> >>>>> maybe it will be easier to move all dovecot metadata to separate (non >>>>> snapshot) location ? >>>> >>>> It could also be a bit problematic. At least message keywords (=custom >>>> flags) wouldn't work because the dovecot-keywords file exists only in >>>> the snapshot dir. >>> >>> Moving metadata helped, but now archived inbox is unsubscribed. Is >>> there a way to make all folders in an namespace subscribed by default >>> ? >> >> Nope. I could try to get the snapshots fixed at some point when I have >> more >> time, but I'm not going to add a feature to subscribe everything by >> default. >> People might try to start using it. > > If I enable per snapshot subscriptions i see all folders except INBOX, > i have tried to subscribe it using > mailbox_list_subscription_fill_one() or using imap as bellow without > success > > http://dovecot.org/list/dovecot/2007-October/025965.html suggest that > it isn't possible > > ./imap/.libs/imap > * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID > ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS > MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED > I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as root > a subscribe "test" > a OK Subscribe completed. > a lsub "" "*" > imap(root): Warning: Subscriptions file /root/Maildir/subscriptions: > Removing invalid entry: > * LSUB () "." "Drafts" > * LSUB () "." "Sent" > * LSUB () "." "Junk" > * LSUB () "." "Trash" > * LSUB () "." "Deleted Messages" > * LSUB () "." "test.Drafts" > * LSUB () "." "test.Sent" > * LSUB () "." "test.Junk" > * LSUB () "." "test.Trash" > * LSUB () "." "test.Deleted Messages" > a OK Lsub completed. > b list "" "*" > * LIST (\HasNoChildren) "." "DUpa" > * LIST (\HasNoChildren) "." "Deleted Messages" > * LIST (\HasNoChildren) "." "Junk" > * LIST (\HasNoChildren) "." "Trash" > * LIST (\HasNoChildren) "." "Sent" > * LIST (\HasNoChildren) "." "Drafts" > * LIST (\HasNoChildren) "." "INBOX" > * LIST (\HasChildren) "." "test" > * LIST (\HasNoChildren) "." "test.TEst" > * LIST (\HasNoChildren) "." "test.Deleted Messages" > * LIST (\HasNoChildren) "." "test.Junk" > * LIST (\HasNoChildren) "." "test.Trash" > * LIST (\HasNoChildren) "." "test.Sent" > * LIST (\HasNoChildren) "." "test.Drafts" > b OK List completed. > From tss at iki.fi Tue Aug 21 17:37:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 21 Aug 2012 17:37:37 +0300 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Message-ID: On 21.8.2012, at 15.59, Chris Visser wrote: > Yes. Is it possible? > > If I try bind with a dn like: CN=Chris Visser,OU=Users,DC=mydomain,DC=com > then I can't make the bind to AD, even though I can do it using exim and ldapsearch. > > Dovecot however binds if I use a dn like: CN=Chris,OU=Users,DC=mydomain,DC=com Maybe the problem is simply that space isn't in auth_username_chars? If not, show doveconf -n, dovecot-ldap.conf and log output when auth_debug_passwords=yes (with a test user/pass). From slusarz at curecanti.org Tue Aug 21 20:31:46 2012 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 21 Aug 2012 11:31:46 -0600 Subject: [Dovecot] Search extensions In-Reply-To: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: <20120821113146.Horde.yqEaGoF5lbhQM8YCyLWQ2pA@bigworm.curecanti.org> Quoting Timo Sirainen : > The client can verify the results with the fetch. The "x-anyheader" > can already be implemented without changes to full text search > plugin, because all backends store message/MIME headers and body > text separately. > > So, questions for the list, especially client developers: > > 1) What's a better name for x-anyheader? :) Maybe X-ALLHEADERS? X-ANYHEADER seems ok also. Either one, if properly documented, would be easy enough to implement (I know that I personally never implement any IMAP command without staring at the RFCs so if you wanted to name it X-FUZZYWUZZY, that would also be fine). > I think one other thing missing has been "show me messages that have > attachments". I've thought about maybe creating a $hasattachments > keyword for that, which the server could automatically set for new > mails that it thinks has attachments (and clients can set/unset the > keyword if wanted). I think you are entering a *very* slippery slope when it comes to this feature. Because I believe that determination of what is an "attachment" is necessarily a client (read: UI) question, not a server question. See, e.g.: http://markmail.org/message/q4mjgbcxks5j4ue6 michael From zinovik.igor at gmail.com Tue Aug 21 20:51:18 2012 From: zinovik.igor at gmail.com (Igor Zinovik) Date: Tue, 21 Aug 2012 21:51:18 +0400 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section Message-ID: <5033CA96.3080305@gmail.com> Hello. I read on upgrading page that one can use UTF8 mailbox names for plugins. As i understand i do not need to convert UTF8 names to mUTF-7 and can use raw UTF8 in plugins section, e.g.: /etc/dovecot/dovecot.conf ... plugin { ... # Autocreate \Spam folder autocreate = ???? autosubscribe = ???? ... But what about sieve scripts and other configuration sections: 1. Do i need to convert UTF8 mailbox names in `namespace' section? namespace inbox { ... mailbox &BCEEPwQwBDw- { special_use = \Junk } 2. Do i need to convert UTF8 mailbox names in sieve scripts? /etc/dovecot/dovecot_before.sieve ... require ["reject","fileinto"]; # Put all spam into separete IMAP folder if header :contains "X-Spam-Flag" "YES" { fileinto "&BCEEPwQwBDw-"; } From stephan at rename-it.nl Tue Aug 21 22:10:03 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 21 Aug 2012 21:10:03 +0200 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section In-Reply-To: <5033CA96.3080305@gmail.com> References: <5033CA96.3080305@gmail.com> Message-ID: <5033DD0B.90602@rename-it.nl> On 8/21/2012 7:51 PM, Igor Zinovik wrote: > 2. Do i need to convert UTF8 mailbox names in sieve scripts? > /etc/dovecot/dovecot_before.sieve > > require ["reject","fileinto"]; > > # Put all spam into separete IMAP folder > if header :contains "X-Spam-Flag" "YES" { > fileinto "&BCEEPwQwBDw-"; > } The Sieve language only accepts UTF-8, making the above example wrong. That is also what Pigeonhole Sieve requires. The much older cmusieve plugin did use mUTF7, but I'm hoping that very few people are still using that. Regards, Stephan From leamhall at gmail.com Tue Aug 21 22:16:31 2012 From: leamhall at gmail.com (leam hall) Date: Tue, 21 Aug 2012 15:16:31 -0400 Subject: [Dovecot] Ways to poke and prod Dovecot? Message-ID: I'm a newbie and want to learn more about Dovecot. I can install it in a test bed but am not sure how to run it so it shows me what it's doing but i'm not actually mailing stuff. Is there a doc somewhere? Thanks! Leam -- Mind on a Mission From tlx at leuxner.net Tue Aug 21 22:20:12 2012 From: tlx at leuxner.net (Thomas Leuxner) Date: Tue, 21 Aug 2012 21:20:12 +0200 Subject: [Dovecot] Ways to poke and prod Dovecot? In-Reply-To: References: Message-ID: m 21.08.2012 um 21:16 schrieb leam hall : > I'm a newbie and want to learn more about Dovecot. I can install it in a > test bed but am not sure how to run it so it shows me what it's doing but > i'm not actually mailing stuff. Is there a doc somewhere? The Wiki is a good starting point listing several typical configurations: http://wiki2.dovecot.org/HowTo Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4364 bytes Desc: not available URL: From svoop at delirium.ch Tue Aug 21 22:38:48 2012 From: svoop at delirium.ch (Sven Schwyn) Date: Tue, 21 Aug 2012 21:38:48 +0200 Subject: [Dovecot] blf-crypt Message-ID: Hi The blf-crypt password schema mentioned in the docs could be a solution to my auth problem. However, the docs state that actual support depends on the glibc. Mine apparently doesn't. Does support depend on the glibc's version (mine is 2.15-r2)? Maybe someone with access to a box with a good enough glibc could do the following and post the hash for the plain password "test"? doveadm pw -s BLF-CRYPT Enter new password: test With this I could verify whether the BLF-CRYPT scheme would solve my problem in the first place without going through the hassle of upping the glibc. Thanks a bunch! From zucca at systemschmiede.com Wed Aug 22 02:44:00 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 22 Aug 2012 01:44:00 +0200 Subject: [Dovecot] Imap Ghost folder Message-ID: <50341D40.9090001@systemschmiede.com> Hi list, i have a strange "ghost" folder in my subscription list and just can't find out how to get rid of it. It seems to be someones Inbox, but it doesn't tell me whose. Here's a screenshot of Open-Xchanges Web-GUI: /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg / As you can see there is an unamed folder just under Freigaben (Shares). In Thunderbird: /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ Now the Folder is "INBOX"...But it is noones Inbox, as the corresponding user (amazon e.g.) should be a prefix-folder right before the share. some output over Telnet: 1 lsub "" "*" * LSUB () "/" "INBOX" * LSUB () "/" "INBOX/Amazon" * LSUB () "/" "INBOX/Bestellung" * LSUB () "/" "Drafts" * LSUB () "/" "Sent Items" * LSUB () "/" "Spam" * LSUB () "/" "Trash" * LSUB () "/" "Freigaben/amazon/INBOX" 1 OK Lsub completed. 1 list "" "*" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Sent Items" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasNoChildren) "/" "INBOX/Amazon" * LIST (\HasNoChildren) "/" "INBOX/Bestellung" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Drafts" * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" 1 OK List completed. This looks a bit strange to me: * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" But i don't know really if that is the ghostfolder. finally here's the interesting part in my dovecot.conf: / namespace private { separator = / prefix = #location defaults to mail_location. inbox = yes } namespace shared { separator = / prefix = Freigaben/%%n/ location = maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ subscriptions = no list = children inbox = no } / Any idea how to banish the ghost in the machine? Thank you very much Sascha -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From amateo at um.es Wed Aug 22 11:01:08 2012 From: amateo at um.es (Angel L. Mateo) Date: Wed, 22 Aug 2012 10:01:08 +0200 Subject: [Dovecot] exclude a folder for lazy expunge (move to trash) Message-ID: <503491C4.7030208@um.es> Hello, I'm configuring lazy expunge plugin to act as a kind of backup of my user's emails. I'm getting a little problem because a lot of my users use "move to trash" behaviour in their email client (most of them are using thunderbird which has no option to hide deleted messages and is a hassle working with mark as deleted with it). The problem combining move to trash with lazy expunge is that messages are stored in the expunge namespace twice, first when it was deleted from the original folder and the second when is deleted from the trash. So... is there any way to exclude trash folder from lazy expunge plugin, so mails are stored in the expunge namespace only when they are deleted from their original folder and not from the trash? Another idea... We are purging trash folders with a cron running "doveadm purge" commands. Is there any way to run this command disabling lazy expunge plugin? Any other idea not to duplicate these emails? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From tss at iki.fi Wed Aug 22 16:56:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 16:56:20 +0300 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting In-Reply-To: <20120813161251.GB14149@arachsys.com> References: <20120813161251.GB14149@arachsys.com> Message-ID: <1345643780.13571.33.camel@hurina> On Mon, 2012-08-13 at 17:12 +0100, Chris Webb wrote: > Sharing an installed copy of dovecot between several users each running > a daemon within their own account (or using the same binaries for a > system daemon and a user daemon) is difficult because the compile-time > directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the > location of things like the ssl-parameters.dat file and the replicator > database. > > Replace all these uses of PKG_STATEDIR with a state_dir setting which > defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the > same way base_dir can be used to override PKG_RUNDIR. Committed to v2.2 with some changes: http://hg.dovecot.org/dovecot-2.2/rev/543852ebb327 From david at wordshell.net Wed Aug 22 09:56:04 2012 From: david at wordshell.net (David Anderson) Date: Wed, 22 Aug 2012 09:56:04 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users Message-ID: <50348284.8050609@wordshell.net> Self-explanatory, I hope (note the period on the end of the username); sieve/pigeonhole does not allow you to have senders which end with a period, which means that any UNIX users with such usernames who send mail have it rejected by sieve: # useradd testuser. # su - testuser. $ mail david at example.com -s 'testing' 123 . [testuser. at levi ~]$ logout # less /var/log/maillog Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: envelope sender address 'testuser. at myhost.example.com' is unparsable Versions: dovecot-pigeonhole-0.2.6-21.el5 dovecot-managesieve-0.2.6-21.el5 dovecot-2.0.18-1_134.el5 Why would anyone have a UNIX username ending in a period? For one, web hosting companies may use your domain name as your username - but be subject to a 32-character limit, so your domain name gets truncated. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From tss at iki.fi Wed Aug 22 17:36:34 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 17:36:34 +0300 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section In-Reply-To: <5033CA96.3080305@gmail.com> References: <5033CA96.3080305@gmail.com> Message-ID: <1345646194.13571.34.camel@hurina> On Tue, 2012-08-21 at 21:51 +0400, Igor Zinovik wrote: > I read on upgrading page that one can use UTF8 mailbox names for > plugins. As i understand i do not need to convert UTF8 names to mUTF-7 > and can use raw UTF8 in plugins section, e.g.: > /etc/dovecot/dovecot.conf You couldn't need to use mUTF7 anywhere at all anymore. If you do, it's a bug. From lgb at lgb.hu Wed Aug 22 18:16:25 2012 From: lgb at lgb.hu (=?iso-8859-1?B?R+Fib3IgTOlu4XJ0?=) Date: Wed, 22 Aug 2012 17:16:25 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: <20120822151624.GC22547@vega.lgb.hu> Hi, On Wed, Aug 22, 2012 at 09:56:04AM +0300, David Anderson wrote: > Self-explanatory, I hope (note the period on the end of the > username); sieve/pigeonhole does not allow you to have senders which > end with a period, which means that any UNIX users with such > usernames who send mail have it rejected by sieve: > > # useradd testuser. > # su - testuser. > $ mail david at example.com -s 'testing' > 123 > . > [testuser. at levi ~]$ logout > > # less /var/log/maillog > > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: > envelope sender address 'testuser. at myhost.example.com' is unparsable Afaik local-part can't have period as the first or the last character by RFC ... But correct me if I am wrong. At least according to wikipedia: The local-part of the email address may use any of these ASCII characters RFC 5322 Section 3.2.3, RFC 6531 permits Unicode beyond the ASCII range: [...] Character . (dot, period, full stop) (ASCII: 46) provided that it is not the first or last character, and provided also that it does not appear two or more times consecutively (e.g. John..Doe at example.com is not allowed.). http://en.wikipedia.org/wiki/Email_address#Local_part I think nowdays it's a bit outdated to have 1:1 mapping between UNIX users and email addresses anyway. Maybe it's OK, but it's surely problematic in case of mass hosting with many users with policies like you mentioned as well. Virtual users (in the sense of MTA/IMAP/etc servers) are much better idea, in my oppinion. It's OK for a small "server" used for own purposes for example. But it's only my opinion ... From david at wordshell.net Wed Aug 22 18:45:17 2012 From: david at wordshell.net (David Anderson) Date: Wed, 22 Aug 2012 18:45:17 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <20120822151624.GC22547@vega.lgb.hu> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> Message-ID: <5034FE8D.2030704@wordshell.net> On 22/08/12 18:16, G?bor L?n?rt wrote: > I think nowdays it's a bit outdated to have 1:1 mapping between UNIX > users and email addresses anyway. Maybe it's OK, but it's surely > problematic in case of mass hosting with many users with policies like > you mentioned as well. Virtual users (in the sense of MTA/IMAP/etc > servers) are much better idea, in my oppinion. It's OK for a small > "server" used for own purposes for example. But it's only my opinion ... There are no incoming mail accounts for those users. The server in question is a webserver. Every website has a unique UNIX user, for security when running scripts. You can't virtualise that. If you run all your scripts under the same UNIX user on a shared server, then it's less secure. Sieve was complaining about the envelope *sender* address being invalid, on a piece of outgoing mail (generated by the website). It wasn't about incoming mail or maintaining accounts. That's a bit academic, though. It think the main points are that: * Many Unixes allow you to set up usernames ending in periods * The MTAs also allow you to send and receive mail using those periods Strictly according to the RFC, the address is invalid. But if the MTA accepts it, why should sieve reject it? Sieve is deployed to apply filters to mail - not to make policy decisions on valid email addresses. That's a layering violation. If my MTA accepts the mail,and then the dovecot LDA does too, I don't want sieve to over-turn the decision. It's not sieve's job to enforce that part of the RFC and over-rule the MTA and LDA. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From lgb at lgb.hu Wed Aug 22 19:20:55 2012 From: lgb at lgb.hu (=?iso-8859-1?B?R+Fib3IgTOlu4XJ0?=) Date: Wed, 22 Aug 2012 18:20:55 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <5034FE8D.2030704@wordshell.net> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> <5034FE8D.2030704@wordshell.net> Message-ID: <20120822162055.GD22547@vega.lgb.hu> On Wed, Aug 22, 2012 at 06:45:17PM +0300, David Anderson wrote: > There are no incoming mail accounts for those users. The server in > question is a webserver. Every website has a unique UNIX user, for > security when running scripts. You can't virtualise that. If you run > all your scripts under the same UNIX user on a shared server, then > it's less secure. > > Sieve was complaining about the envelope *sender* address being > invalid, on a piece of outgoing mail (generated by the website). It > wasn't about incoming mail or maintaining accounts. I guess what an RFC says about "email address syntax" is valid rule for both sender _and_ recipient. Mails are usually filtered to check they are valid, for example a *sender* what you mentioned as an example would not be able to send mails to our ISP since syntax of sender address are checked on the MX MTAs as well. So I don't see too much point to send mails with invalid (by RFC) sender as most mail softwares and/or MTA admin's configuration will reject it, like with your example, check the subject out of your mail. I guess it's a valid decision to reject these. But _again_: I can be wrong here. > That's a bit academic, though. It think the main points are that: > > * Many Unixes allow you to set up usernames ending in periods > * The MTAs also allow you to send and receive mail using those periods > > Strictly according to the RFC, the address is invalid. But if the > MTA accepts it, why should sieve reject it? Sieve is deployed to Which MTA? Our ISP would reject those, for example. It's matter of the kind of the MTA, and also its configuration, but since according to the RFC which says that invalid, it's not so suprising that some people and/or mail related software decide not to accept. For sure, there can be softwares/configs which allows it. It clearly shows that it's better to avoid addresses which are often handled as invalid ("but not always", it depends, yes), especially if "standards" says they are invalid as well. > apply filters to mail - not to make policy decisions on valid email > addresses. That's a layering violation. Well, it's bit out of scope my intent, also I am not instered to start a flame war or so :) I just wanted to point out that it's anyway a very bad idea to use invalid addresses even if it can be said as true that sieve should not reject things if it's MTA's job ... The basic idea is the same: why do you want to use them, if there are problems with these anyway, and sooner or later you will hit a rejection, even if sieve is "fixed" not having this decision as well. Creating a system which use known to be invalid things (even if it works locally, or other similar examples) are a "good" sign to introduce "interesting" and hard-to-track-down problems later, maybe in the more far future only. I can't say anything about sieve itself, to be honest, anyway, and your suggestion that it must be fixed or not. Again, sorry if someone treated my mail as OT/flame/whatever. From zinovik.igor at gmail.com Wed Aug 22 23:01:15 2012 From: zinovik.igor at gmail.com (Igor Zinovik) Date: Thu, 23 Aug 2012 00:01:15 +0400 Subject: [Dovecot] difference between namespace auto=subscribe and autocreate plugin Message-ID: <50353A8B.8000904@gmail.com> Hello. I read docs, but still do not understand difference between following configuration options: namespace inbox { # Create and subscribe to folder mailbox Drafts { auto=subscribe } and `autocreate' plugin plugin { autocreate = inbox.Drafts autosubscribe = inbox.Drafts On wiki page that describes `autocreate' plugin i read: ... mailboxes that must always exist for all users. So even if user delete Drafts IMAP folder on next connection server will create it. Is `mailbox' undocumented feature? I see it only in configuration file, but wiki does not mention it. From tss at iki.fi Wed Aug 22 23:07:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 23:07:37 +0300 Subject: [Dovecot] difference between namespace auto=subscribe and autocreate plugin In-Reply-To: <50353A8B.8000904@gmail.com> References: <50353A8B.8000904@gmail.com> Message-ID: <732BA52B-944D-465E-8BF4-C851E2E1A8D1@iki.fi> On 22.8.2012, at 23.01, Igor Zinovik wrote: > I read docs, but still do not understand difference between following > configuration options: > > namespace inbox { > # Create and subscribe to folder > mailbox Drafts { auto=subscribe } > > and `autocreate' plugin > > plugin { > autocreate = inbox.Drafts > autosubscribe = inbox.Drafts Zero difference. autocreate plugin is deprecated, the auto=subscribe is the new way, the plugin is simply a small wrapper to it. Yeah, the wiki should be updated to say this. From zucca at systemschmiede.com Wed Aug 22 23:12:34 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 22 Aug 2012 22:12:34 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <50341D40.9090001@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> Message-ID: <50353D32.2080401@systemschmiede.com> If you should need any more info on this, just drop me a line. I am fully stuck! I think that my dovecot.conf is not put together well, only i can't find the problem... Thanx Sascha Am 22.08.2012 01:44, schrieb Sascha Zucca: > Hi list, > i have a strange "ghost" folder in my subscription list and just can't > find out how to get rid of it. > It seems to be someones Inbox, but it doesn't tell me whose. > > Here's a screenshot of Open-Xchanges Web-GUI: > /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg > / > As you can see there is an unamed folder just under Freigaben (Shares). > > > In Thunderbird: > /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ > > Now the Folder is "INBOX"...But it is noones Inbox, as the > corresponding user (amazon e.g.) should be a prefix-folder right > before the share. > > > some output over Telnet: > > 1 lsub "" "*" > * LSUB () "/" "INBOX" > * LSUB () "/" "INBOX/Amazon" > * LSUB () "/" "INBOX/Bestellung" > * LSUB () "/" "Drafts" > * LSUB () "/" "Sent Items" > * LSUB () "/" "Spam" > * LSUB () "/" "Trash" > * LSUB () "/" "Freigaben/amazon/INBOX" > 1 OK Lsub completed. > > > 1 list "" "*" > * LIST (\HasNoChildren) "/" "Trash" > * LIST (\HasNoChildren) "/" "Sent Items" > * LIST (\HasChildren) "/" "INBOX" > * LIST (\HasNoChildren) "/" "INBOX/Amazon" > * LIST (\HasNoChildren) "/" "INBOX/Bestellung" > * LIST (\HasNoChildren) "/" "Spam" > * LIST (\HasNoChildren) "/" "Drafts" > * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" > 1 OK List completed. > > > This looks a bit strange to me: > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > But i don't know really if that is the ghostfolder. > > > finally here's the interesting part in my dovecot.conf: > / > namespace private { > separator = / > prefix = > #location defaults to mail_location. > inbox = yes > } > > namespace shared { > separator = / > prefix = Freigaben/%%n/ > location = > maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ > subscriptions = no > list = children > inbox = no > } > / > > Any idea how to banish the ghost in the machine? > > Thank you very much > Sascha > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From patrickdk at patrickdk.com Thu Aug 23 03:47:54 2012 From: patrickdk at patrickdk.com (Patrick Domack) Date: Wed, 22 Aug 2012 20:47:54 -0400 Subject: [Dovecot] blf-crypt In-Reply-To: References: Message-ID: <20120822204754.Horde.-FZmPpLnE6FQNX26KBNk2GA@mail.patrickdk.com> BLF-CRYPT has been part of glibc for a very very long time. it uses the blowfish crypt version, that have been changed like 4 times now, do to issues with it. I'm not sure why CRYPT wouldn't work for you, seems to work fine in my dovecot installs. I'm not sure where the dovecot < 2.0 can use {CRYPT} came from. I'm using that, since 0.7x? or somewhere around there, all the way up through, and currently 2.1.7 without issue. Quoting Sven Schwyn : > Hi > > The blf-crypt password schema mentioned in the docs could be a > solution to my auth problem. However, the docs state that actual > support depends on the glibc. Mine apparently doesn't. > > Does support depend on the glibc's version (mine is 2.15-r2)? > > Maybe someone with access to a box with a good enough glibc could do > the following and post the hash for the plain password "test"? > > doveadm pw -s BLF-CRYPT > Enter new password: test > > With this I could verify whether the BLF-CRYPT scheme would solve my > problem in the first place without going through the hassle of > upping the glibc. > > Thanks a bunch! From ncjeffgus at zimage.com Thu Aug 23 05:02:36 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Wed, 22 Aug 2012 19:02:36 -0700 Subject: [Dovecot] more dsync issues Message-ID: <1345687356.3986.11.camel@maclinux> It hit another dsync snag. We have a script that executes a dsync backup command to a remote host. No write should be happening on the remote host (the backup host). The error is: dsync-local(anonymous at domain.com): Error: remote: dsync-remote(anonymous at domain.com): Error: Can't delete mailbox INBOX: INBOX can't be deleted. dsync-remote(anonymous at domain.com): Error: command MSG-SAVE failed dsync-local(anonymous at domain.com): Error: read() from worker server failed: EOF dsync-local(anonymous at domain.com): Error: Unexpected reply from server: dsync-local(anonymous at domain.com): Warning: Mailbox changes caused a desync. You may want to run dsync again. We're currently running 2.1.7 since > 2.1.8 causes a problem with our webmail software. ...Jeff From david at wordshell.net Thu Aug 23 09:46:36 2012 From: david at wordshell.net (David Anderson) Date: Thu, 23 Aug 2012 09:46:36 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <20120822162055.GD22547@vega.lgb.hu> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> <5034FE8D.2030704@wordshell.net> <20120822162055.GD22547@vega.lgb.hu> Message-ID: <5035D1CC.9060005@wordshell.net> On 22/08/12 19:20, G?bor L?n?rt wrote: > I guess what an RFC says about "email address syntax" is valid rule for both > sender _and_ recipient. Perhaps it would be best if dovecot applied a policy (whatever policy) consistently. It was a surprise to me to transition from CMU sieve to Pigeonhole sieve and find that Dovecot LDA now was happy to deliver the mail, but that Pigeonhole sieve was unhappy. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From dmalolepszy at optusnet.com.au Thu Aug 23 09:48:20 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Thu, 23 Aug 2012 16:48:20 +1000 Subject: [Dovecot] Dovecot generate file when over quota detected Message-ID: <5035D234.50306@optusnet.com.au> Hi, I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. This means that an MTA can efficiently check for the existence of this 'overquota' file and return a "user at domain.com Mailbox full" TEMPFAIL error early during the SMTP transaction prior to accepting any data. Dominic From amateo at um.es Thu Aug 23 11:38:48 2012 From: amateo at um.es (Angel L. Mateo) Date: Thu, 23 Aug 2012 10:38:48 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <5035EC18.3020807@um.es> El 01/08/12 20:10, Timo Sirainen escribi?: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > >>> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >>> >>> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >>> >>> service ipc { >>> unix_listener ipc { >>> user = dovecot >>> } >>> } >> >> Thanks, Timo. >> >> Does this apply to the mailbox config or the director config? >> Which instance needs to access the ipc socket of which instance? > > director instance needs access to director instance. > With this configuration, doveadm director move now works correctly, kicking user's connection in the old backend server. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From frank at celebrate.de Thu Aug 23 16:37:14 2012 From: frank at celebrate.de (Frank Kirschner) Date: Thu, 23 Aug 2012 15:37:14 +0200 Subject: [Dovecot] MailDir Issue Message-ID: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> Hello List, I'm still running dovecot in version 1.1.7 No I have setup a new installation with dovecot 2.0.9 and had running some tests with a testdomain. Everything is working well. The Maildir has exactly the same structure like ../domain/username/... Can I copy the whole maildir to the new server? Logical that I have also to move the SMTP network configuration to the new machine. best regards Frank From tth at rfa.cz Thu Aug 23 16:40:23 2012 From: tth at rfa.cz (TeTeHacko) Date: Thu, 23 Aug 2012 15:40:23 +0200 Subject: [Dovecot] pop3 migration Message-ID: <503632C7.2070008@rfa.cz> Hi, I have problems with pop3 migration, the server disconect the dovesync when fetching mails after 5 minutes with this error in server log: xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6548 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 47522 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6549 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 355289 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6550 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 9638 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6551 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 2188 octets xx.xx.xx.xx [28F4] 11:59:05 >>> -ERR Command unrecognized: "" xx.xx.xx.xx [28F4] 11:59:05 *** 6551 477693894 00:12:55 ERROR xx.xx.xx.xx [28F4] 11:59:05 Disconnected and this in dovecot log: dsync(info at istan.cz): Debug: imapc(mail.stable.cz:143): Authenticated successfully dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Looking up IP address dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Connecting to 88.86.120.212:110 dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Authenticating as info at istan.cz dsync(info at istan.cz): Error: pop3c(mail.stable.cz): Server disconnected unexpectedly dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 1: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 2: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 3: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 4: Disconnected is there any timeout in dovecot for 300s? can anybody point me where may be some problem? This error occurs everytime i test it and the mail box has cca 2GB, on small mailboxes is no problem, i try this patch: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d on dovecot version 2.1.7 but the problem isn't solved. Thanks for help Tomas Herceg From robert at schetterer.org Thu Aug 23 19:24:20 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 23 Aug 2012 18:24:20 +0200 Subject: [Dovecot] MailDir Issue In-Reply-To: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> References: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> Message-ID: <50365934.5030205@schetterer.org> Am 23.08.2012 15:37, schrieb Frank Kirschner: > Hello List, > > I'm still running dovecot in version 1.1.7 > No I have setup a new installation with dovecot 2.0.9 and had running some > tests with a testdomain. Everything is working well. The Maildir has exactly > the same structure like ../domain/username/... > > Can I copy the whole maildir to the new server? Logical that I have also to > move the SMTP network configuration to the new machine. > > best regards > Frank > you may try , but i would recommand use imapsync etc -- Best Regards MfG Robert Schetterer From adam at rosi-kessel.org Thu Aug 23 19:55:25 2012 From: adam at rosi-kessel.org (Adam Rosi-Kessel) Date: Thu, 23 Aug 2012 12:55:25 -0400 Subject: [Dovecot] Dovecot / Win8 Mail App Folder Subscription Issue Message-ID: <5036607D.8080100@rosi-kessel.org> Win8 RTM Mail App now supports IMAP. I am running Dovecot 1.2.15 on a Debian Stable server. The App works fine except the list of folders displayed seems to be a random subset of all my folders. I can't figure out how it's picking which folders to show, or how to change what's subscribed. Editing the "subscriptions" folder in ~/Maildir/ doesn't seem to have any impact. Any suggestions on how to troubleshoot or narrow done this issue? I posted to a Microsoft forum but was told the Mail App will only support official email providers. From tss at iki.fi Thu Aug 23 21:30:21 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 21:30:21 +0300 Subject: [Dovecot] For the wishlist In-Reply-To: <20120807124305.GA13644@ruhr-uni-bochum.de> References: <20120807124305.GA13644@ruhr-uni-bochum.de> Message-ID: On 7.8.2012, at 15.43, Jost Krieger wrote: > I would like very much to have a "doveadm copy", which probably could be > made out of "doveadm move" by removing ca. 2 lines (and changing a few > strings from "move" to "copy"). OK: http://hg.dovecot.org/dovecot-2.1/rev/9d35aca14c81 From tss at iki.fi Thu Aug 23 21:50:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 21:50:16 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> On 14.8.2012, at 11.18, Timo Sirainen wrote: >> As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? > > Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c From tss at iki.fi Thu Aug 23 22:00:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:00:10 +0300 Subject: [Dovecot] Auth worker max line size In-Reply-To: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> References: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> Message-ID: <19A4E62F-42A0-4FDD-AD68-31C1B26B9E65@iki.fi> On 16.8.2012, at 4.07, Emmanuel Dreyfus wrote: > 38 month ago, I submitted a patch to increase > AUTH_WORKER_MAX_LINE_LENGTH to use exotic authentication scheme (see > message below). The patch was accepted, but now I upgrade to dovecot > 2.1.7, I face the same problem with MASTER_AUTH_MAX_DATA_SIZE. I had to > increase it from 1024 to 4096. > > Is it safe to do so? Would such a change be accepted upstream? The patch > is below. Couldn't you change the client to use AUTHENTICATE PLAIN command instead? The buffer wouldn't be a problem then.. From tss at iki.fi Thu Aug 23 22:22:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:22:45 +0300 Subject: [Dovecot] No status for INBOX/* in mbox NS (2.1.6) In-Reply-To: <20120817094601.GB21534@ruhr-uni-bochum.de> References: <20120817094601.GB21534@ruhr-uni-bochum.de> Message-ID: On 17.8.2012, at 12.46, Jost Krieger wrote: > Most of our users still have mboxes in the classical layout, so you > can't have subfolders and messages in the same folder, *except for the > INBOX*, as it is physically separate. > > Someone complained that he saw subfolders in roundcube he couldn't > delete, because they didn't show up in the subscription view. > > Before hitting on roundcube, I mperformed a few checks and got the > following: > > root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/*' > root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/test1' > INBOX/test1 messages=0 Fixed & added to regression tests: http://hg.dovecot.org/dovecot-2.1/rev/b8173f8a1447 From tss at iki.fi Thu Aug 23 22:57:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:57:23 +0300 Subject: [Dovecot] Problem use localized prefix in namespace In-Reply-To: References: Message-ID: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> On 17.8.2012, at 21.37, (Dovecot) Sergey Sidlyarenko wrote: > Problem with localized prefix in namespace. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/ade94fde249e From tss at iki.fi Thu Aug 23 22:58:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:58:23 +0300 Subject: [Dovecot] Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators) In-Reply-To: <502CD9F0.1060801@rocnet.de> References: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> <502CD9F0.1060801@rocnet.de> Message-ID: The assert crash I think is fixed already in v2.1.9. The folder structure can be changed with mail_shared_explicit_inbox=no On 16.8.2012, at 14.30, Claus Rosenberger wrote: > Could i send some more informations about this topic? I'm not sure whats > happening here but i think it has something to do with the shared mailboxes. > With cyrus i had following folder structure: > > user1 -> inbox -> subfolders > -> user -> user1 > -> user2 > > > With dovecot the folder structure look like: > > user1 -> inbox -> subfolders > -> shared -> user1 -> inbox > -> user2 -> inbox > > is there any way to show inbox directly in user1/user2 folder without > having an inbox subfolder? > > > > Am 22.07.2012 00:04, schrieb Claus Rosenberger: >> Hi, >> >> with fetching the folder structure with the webclient Tine i can see following error messages inside of the logfiles: >> >> Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) >> >> Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x448fa) [0x7f70036db8fa] -> /usr/lib/dovecot/libdovecot.so.0(+0x44946) [0x7f70036db946] -> /usr/lib/dovecot/libdovecot.so.0(+0x1b8ca) [0x7f70036b28ca] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open_stream+0) [0x7f70039a1550] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f70039a156f] -> dovecot/imap(cmd_select_full+0x14a) [0x40db1a] -> dovecot/imap(command_exec+0x3d) [0x41160d] -> dovecot/imap() [0x41058e] -> dovecot/imap() [0x41066d] -> dovecot/imap(client_handle_input+0x135) [0x410895] -> dovecot/imap(client_input+0x5f) [0x4111bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f70036e7ea6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f70036e8f2f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f70036e7e48] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f70036d4103] -> dovecot/imap(main+0x2a5) [0x419695] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f7003353c8d] -> dovecot/imap() [0x408f49] >> >> Fatal: master: service(imap): child 21152 killed with signal 6 (core dumps disabled) >> > From tss at iki.fi Thu Aug 23 23:00:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:00:00 +0300 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: On 18.8.2012, at 0.12, Lutz Pre?ler wrote: >>> inthread refs younger 604800 >>> >>> This works as expected for the first time. But later on, also older messages/ >>> threads are included until I delete the virtual/.week/dovecot.index*. >> >> I know there are problems related to this with INTHREAD, but they aren't >> very easy to solve and for now I've more important things to do.. If it >> seemed to work before, it was due to luck or due to some bug causing an >> unnecessary index rebuild. You could set :INDEX=MEMORY to work around >> this, but I don't know how much worse the performance would become. Or >> you could just manually delete the virtual indexes once a week. > Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ > enhance now? Any estimate how much effort it would be? Just about the same amount of work I think. I haven't really looked at virtual plugin for a while, so I can't easily say how much work it would be. But my guess is that it wouldn't be easy. From tss at iki.fi Thu Aug 23 23:01:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:01:23 +0300 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> Message-ID: On 19.8.2012, at 12.51, Michael Grimm wrote: >>> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >>> >>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >>> >>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >>> >>> JFTR: I do have mail_log plugin activated. >> >> Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. > > > I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? Not enable mail_log for doveadm: protocol !doveadm { mail_plugins = $mail_plugins = mail_log } or alternatively override it only for the dsync command with doveadm -o mail_plugins=... From tss at iki.fi Thu Aug 23 23:03:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:03:00 +0300 Subject: [Dovecot] userdb multiple databases In-Reply-To: <5031F673.8040702@um.es> References: <5031F673.8040702@um.es> Message-ID: <7D274FA9-B3B7-49AB-B12A-7F6932ECA3A9@iki.fi> On 20.8.2012, at 11.33, Angel L. Mateo wrote: > I'm trying to configure per user plugins. My original passdb and userdb is in a ldap directory (using userdb with prefetch). > > To configure per user plugins (in fact, I want to enable quota plugin for some users) I need to configure mail_plugins attribute in the userdb. > > The problem is that I don't know any ldap attribute to store this information (is there any schema with includes an attribute for this). So I want to configure it in a passwd-file file. > > My problem is that I don't know if I can chain userdb databases. I know I can configure multiple databases, but as far as I know, they are looked in order, so if the user is found in the first one, then is no look for the user in the second one, so I have to configure all user's attributes in the passwd-file database. Correct. > Is there any way to chain these lookups? No. You could generate the passwd-file based on data in LDAP. From tss at iki.fi Thu Aug 23 23:05:33 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:05:33 +0300 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <503223EE.3030801@um.es> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> <503223EE.3030801@um.es> Message-ID: <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> On 20.8.2012, at 14.47, Angel L. Mateo wrote: > The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. > > But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error > > Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline > > and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. You can't do it with one passwd-file, you'd have to use multiple per-protocol passwd files.. For example: userdb passwd-file { args = /etc/dovecot/passwd.%s } Yeah, passwd-files aren't very flexible for things like these. Maybe you should look into using sqlite? It probably allows some if() or case() in the query (I haven't used sqlite). From tss at iki.fi Thu Aug 23 23:08:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:08:38 +0300 Subject: [Dovecot] Is it possible to save only some messages compressed to mdbox? (2.1.6) In-Reply-To: <20120820130617.GT24203@ruhr-uni-bochum.de> References: <20120820130617.GT24203@ruhr-uni-bochum.de> Message-ID: On 20.8.2012, at 16.06, Jost Krieger wrote: > So here's the questions: > > 1. Is it possible to have compressed/uncompressed mails mixed in an > mdbox? Yes. Compression is detected on a per-mail basis. > 2. Will it work via "-o" in lda delivery? > > I tried to find out in the source but found it hard to see which options > are pulled in when. -o can override all settings that are handled by the running process itself, so yes that includes compression stuff. From tss at iki.fi Thu Aug 23 23:11:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:11:38 +0300 Subject: [Dovecot] Error: Couldn't open INBOX: Timeout while waiting for lock In-Reply-To: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> References: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> Message-ID: <8572F459-1569-4FE2-87EA-A7A0C738A876@iki.fi> On 21.8.2012, at 8.42, Kavish Karkera wrote: > My users are frequetly getting the below error, > > Aug 21 00:04:18 blade6 dovecot: pop3-login: proxy(hgl_dipak): Login failed to 192.168.1.43:110: [IN-USE] Couldn't open INBOX: Timeout while waiting for lock. > > We are proxing pop connections from one pop server (dovecot version 1.1.20) i.e 192.168.1.39 to the other pop Server (Dovecot version 2.0.16 ) i.e 192.168.1.4. > > We have set pop3_lock_session = yes and dont want to disable it. Are your users behind bad internet connections that leave dead connections lying around? If so, maybe changing the kernel's TCP keepalive value to something very aggressive (e.g. 10 secs) would fix those. Of course that makes other traffic behave worse. From warren at decoy.co.za Thu Aug 23 23:26:59 2012 From: warren at decoy.co.za (Warren Baker) Date: Thu, 23 Aug 2012 22:26:59 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> Message-ID: On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: > On 14.8.2012, at 11.18, Timo Sirainen wrote: > > v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? -- .warren From tss at iki.fi Thu Aug 23 23:49:44 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:49:44 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> Message-ID: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> On 23.8.2012, at 23.26, Warren Baker wrote: > On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >> On 14.8.2012, at 11.18, Timo Sirainen wrote: >> >> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c > > Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). From daryl at isletech.net Thu Aug 23 23:57:40 2012 From: daryl at isletech.net (Daryl Richards) Date: Thu, 23 Aug 2012 16:57:40 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <50369944.4050107@isletech.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 12-08-23 4:49 PM, Timo Sirainen wrote: > On 23.8.2012, at 23.26, Warren Baker wrote: > >> On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >>> On 14.8.2012, at 11.18, Timo Sirainen wrote: >>> >>> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c >> >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). > Well, here's a "We use it" if you need it.. It probably just makes sense to block all out all RFC1918 addresses.. - -- Daryl Richards Isle Technical Services Inc. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlA2mUMACgkQbMWpShDgLrWMSQCfY9tBtDvgVuQDMjUbbNlyGkUb yNQAn2u1tHOZkZc7dugeXaLQ/mfmBFvP =lQb3 -----END PGP SIGNATURE----- From lists at luigirosa.com Fri Aug 24 07:56:41 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Fri, 24 Aug 2012 06:56:41 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <50370989.3010402@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Timo Sirainen said the following on 23/08/12 22:49: >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > Is it actually used? :) YES! I have a big customer (400 PCs) with 172.16.0.0/16 internal network and a subnet of 192.168.0.0 for DMZ I use it more than 192.168 when I create networks. Ciao, luigi - -- / +--[Luigi Rosa]-- \ Walk softly and carry a megawatt laser. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlA3CYkACgkQ3kWu7Tfl6ZSRaQCgy1YilsGEL7JXIDabKm+zSjZN cvEAoKYqE1ZjbR/g1XTiHUvlfpPuvWAE =RSAO -----END PGP SIGNATURE----- From voytek at sbt.net.au Fri Aug 24 08:18:56 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 24 Aug 2012 15:18:56 +1000 Subject: [Dovecot] Disable security for testing? Message-ID: <6fbbd67b-dc1e-4875-826f-e646751d6278@email.android.com> I want to offer 'plain' unsecure pop/imap access, just for temp. testing purpose, do I simply comment out ssl = required ? Voytek -- Swyped on Motrix with K-9 Mail. Please excuse my brevity. From Lutz.Pressler at SerNet.DE Fri Aug 24 10:28:10 2012 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Fri, 24 Aug 2012 09:28:10 +0200 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: On Thu, 23 Aug 2012, Timo Sirainen wrote: > On 18.8.2012, at 0.12, Lutz Pre?ler wrote: > > >>> inthread refs younger 604800 > >>> > >>> This works as expected for the first time. But later on, also older messages/ > >>> threads are included until I delete the virtual/.week/dovecot.index*. > >> [...] > > Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ > > enhance now? Any estimate how much effort it would be? > > Just about the same amount of work I think. I haven't really looked at virtual plugin for a while, so I can't easily say how much work it would be. But my guess is that it wouldn't be easy. > Thanks. To force MEMORY indexes only (with location option in namespace or forcibly - with warnings - by having empty index files for one mailbox chattr +i'ed (extended attributes immutable flag on Linux filesystems)) disables full text search indexing also. What about regular deletion of main index files. Is this a problem with FTS? "doveadm fts rescan" necessary, too? Btw, with 2.1 search results with or without fts indexes (solr,squat) differ in substring behaviour (http://wiki2.dovecot.org/Plugins/FTS/Squat). Namespaces with INDEX=MEMORY allow for a "slow search view". But then no attachment content is searched... Lutz From andre.groebe at fun.de Fri Aug 24 10:38:49 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Fri, 24 Aug 2012 09:38:49 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50336E01.6000909@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> <50336E01.6000909@fun.de> Message-ID: <50372F89.60301@fun.de> Hi Timo, > [Timo Sirainen; Di 21 Aug 2012 12:22:04 CEST] >>> Unfortunatly this can't be a fix because in file_set_size() dovecot >>> defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the >>> default block size is predestined for file ops. >> >> Does the attached patch fix it? (not a very good fix) > > No, it doesn't. Still got no response on large metadata and writing > destroys the dictionary. Sorry for bumping - is there a chance to get it work with dovecot 2.1.7? TIA Andre From warren at decoy.co.za Fri Aug 24 11:10:42 2012 From: warren at decoy.co.za (Warren Baker) Date: Fri, 24 Aug 2012 10:10:42 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: On Thu, Aug 23, 2012 at 10:49 PM, Timo Sirainen wrote: >> >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). Yeah as others have mentioned - also not sure whether it is worth the effort to support IPv6's 'private' network (fc00::/7)? I havent seen anyone making use of this for their v6 enabled sites but others may have input here. thanks -- .warren From amateo at um.es Fri Aug 24 13:23:57 2012 From: amateo at um.es (Angel L. Mateo) Date: Fri, 24 Aug 2012 12:23:57 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> <503223EE.3030801@um.es> <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> Message-ID: <5037563D.8080402@um.es> El 23/08/12 22:05, Timo Sirainen escribi?: > On 20.8.2012, at 14.47, Angel L. Mateo wrote: > >> The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. >> >> But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error >> >> Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline >> >> and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. > > You can't do it with one passwd-file, you'd have to use multiple per-protocol passwd files.. For example: > > userdb passwd-file { > args = /etc/dovecot/passwd.%s > } > I have tried this option. It works, although I have to duplicate this file. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From tcsmith1978 at googlemail.com Fri Aug 24 13:53:50 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 11:53:50 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? Message-ID: <50375D3E.50409@googlemail.com> Hi, I didn't know where to post this one so I'll start off with you guys and then try Postfix if I'm barking up the wrong tree! Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! Sorry this is a bit vague but any advice on trying to diagnose the problem would be appreciated. Thanks in advance! Tim From jerry at seibercom.net Fri Aug 24 14:01:40 2012 From: jerry at seibercom.net (Jerry) Date: Fri, 24 Aug 2012 07:01:40 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <20120824070140.09041498@scorpio> On Fri, 24 Aug 2012 10:10:42 +0200 Warren Baker articulated: > Yeah as others have mentioned - also not sure whether it is worth the > effort to support IPv6's 'private' network (fc00::/7)? > I havent seen anyone making use of this for their v6 enabled sites but > others may have input here. I would personally recommend supporting it. If history teaches us anything, it is that sooner or later, and usually sooner, someone will require that block. Being prepared for it in advance would seem like the prudent thing to do. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From robert at schetterer.org Fri Aug 24 14:06:06 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 13:06:06 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: <5037601E.5090401@schetterer.org> Am 24.08.2012 12:53, schrieb Tim Smith: > Hi, > > I didn't know where to post this one so I'll start off with you guys and > then try Postfix if I'm barking up the wrong tree! > > Having set up my mail server (Dovecot/Postfix), users are experiencing > long delays (a couple of minutes) when sending mail from mail client > such as Thunderbird - this increases with attachments. Having had a > brief discussion with someone, they mentioned that the reason that this > may be to do with the size of the mailbox. I couldn't see the rationale > behind this unless Dovecot is syncing the mailbox after every sent mail > (due to possibly saving the sent item?) The mail is being delivered > successfully but the amount of time it is taking to complete the action > is far too long! > > Sorry this is a bit vague but any advice on trying to diagnose the > problem would be appreciated. > > Thanks in advance! > > Tim sending mail ist usual smtp ( postfix ), not dovecot if no firewalls/proxies , slow lines , dns problems are involved, there may exist some policy or milter service which slows down smtp out from i.e tb, ask same question with logs and config in the postfix mail list size of mailbox should be not involved in this -- Best Regards MfG Robert Schetterer From tcsmith1978 at googlemail.com Fri Aug 24 14:14:50 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 12:14:50 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037601E.5090401@schetterer.org> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> Message-ID: <5037622A.30808@googlemail.com> Thanks Robert. That's what I thought. I couldn't make the connection. Will try the Postfix list! On 24/08/12 12:06, Robert Schetterer wrote: > Am 24.08.2012 12:53, schrieb Tim Smith: >> Hi, >> >> I didn't know where to post this one so I'll start off with you guys and >> then try Postfix if I'm barking up the wrong tree! >> >> Having set up my mail server (Dovecot/Postfix), users are experiencing >> long delays (a couple of minutes) when sending mail from mail client >> such as Thunderbird - this increases with attachments. Having had a >> brief discussion with someone, they mentioned that the reason that this >> may be to do with the size of the mailbox. I couldn't see the rationale >> behind this unless Dovecot is syncing the mailbox after every sent mail >> (due to possibly saving the sent item?) The mail is being delivered >> successfully but the amount of time it is taking to complete the action >> is far too long! >> >> Sorry this is a bit vague but any advice on trying to diagnose the >> problem would be appreciated. >> >> Thanks in advance! >> >> Tim > sending mail ist usual smtp ( postfix ), not dovecot > if no firewalls/proxies , slow lines , dns problems are involved, there > may exist some policy or milter service which slows down smtp out from > i.e tb, ask same question with logs and config in the postfix mail list > size of mailbox should be not involved in this From matthew at atom.net Fri Aug 24 14:18:41 2012 From: matthew at atom.net (Matthew Powell) Date: Fri, 24 Aug 2012 07:18:41 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120824070140.09041498@scorpio> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: On 2012-08-24, at 7.01, Jerry wrote: > I would personally recommend supporting it. If history teaches us > anything, it is that sooner or later, and usually sooner, someone will > require that block. Being prepared for it in advance would seem like > the prudent thing to do. I wonder whether it would be better to make the exclusion list configurable. As I understand it, the intention is to avoid treating connections through a load balancer or proxy as though they're the same client device. The assumption that private address = proxy is a fair default, but some sites will be using public addresses for their proxies. And that's only going to increase with IPv6. -- Matthew Powell matthew at atom.net From dirk.jahnke-zumbusch at desy.de Fri Aug 24 14:35:32 2012 From: dirk.jahnke-zumbusch at desy.de (Jahnke-Zumbusch, Dirk) Date: Fri, 24 Aug 2012 13:35:32 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037622A.30808@googlemail.com> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> <5037622A.30808@googlemail.com> Message-ID: <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> Hi all, >>> Having set up my mail server (Dovecot/Postfix), users are experiencing >>> long delays (a couple of minutes) when sending mail from mail client >>> such as Thunderbird - this increases with attachments. Having had a While in the first place sending e-mail has to do with SMTP and not IMAP, most mail client programs are configured to save a copy of an e-mail using FCC (file carbon copy) by putting this copy via IMAP into some "Sent" folder. And here you are: this may explain the long delays, esp. if on some asymmetric connection like DSL with low upstream bandwith. Just my 2c Cheers and have a nice weekend -- Dirk Jahnke-Zumbusch Deutsches Elektronen-Synchrotron DESY From h.reindl at thelounge.net Fri Aug 24 14:38:33 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 24 Aug 2012 13:38:33 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: <503767B9.3090002@thelounge.net> Am 24.08.2012 13:18, schrieb Matthew Powell: > On 2012-08-24, at 7.01, Jerry wrote: > >> I would personally recommend supporting it. If history teaches us >> anything, it is that sooner or later, and usually sooner, someone will >> require that block. Being prepared for it in advance would seem like >> the prudent thing to do. > > I wonder whether it would be better to make the exclusion list configurable. > > As I understand it, the intention is to avoid treating connections through a > load balancer or proxy as though they're the same client device i doubt the ip is generally the wrong value to define something is the same client device, there are millions of networks behind NAT out there with a lot of clients usually connecting to the same mailserver via the same public IP and many of them have a workstation beside a mobile device using the same IMAP account the same device = open connection, nothing else > The assumption that private address = proxy is a fair default in my opinion this is generally the wrong direction i do NOT like it when server software behaves different from my private LAN where services are tested than later after making the service public from the WAN -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From robert at schetterer.org Fri Aug 24 14:39:41 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 13:39:41 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> <5037622A.30808@googlemail.com> <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> Message-ID: <503767FD.3030709@schetterer.org> Am 24.08.2012 13:35, schrieb Jahnke-Zumbusch, Dirk: > Hi all, > >>>> Having set up my mail server (Dovecot/Postfix), users are experiencing >>>> long delays (a couple of minutes) when sending mail from mail client >>>> such as Thunderbird - this increases with attachments. Having had a > > While in the first place sending e-mail has to do with SMTP and not IMAP, > most mail client programs are configured to save a copy of an e-mail using > FCC (file carbon copy) by putting this copy via IMAP into some "Sent" > folder. And here you are: this may explain the long delays, esp. if on > some asymmetric connection like DSL with low upstream bandwith. > > Just my 2c > > Cheers and have a nice weekend > > > -- > Dirk Jahnke-Zumbusch Deutsches Elektronen-Synchrotron DESY > very true, but tb should show the copy action, unless its not configured not to do so -- Best Regards MfG Robert Schetterer From sven at svenhartge.de Fri Aug 24 15:02:05 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 14:02:05 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) Message-ID: <692aeic3nov8@mids.svenhartge.de> Hi! I am currently in the process of preparing a migration of our old Courier-based IMAP/POP server setup to a Dovecot-based one. During this process I came across the following problem with the difference Courier and Dovecot handle deleted messages and mail quota. Quote from http://www.courier-mta.org/imap/README.maildirquota.html: ,---- | The default application configuration that uses this maildirquota | library does not count deleted messages, and any contents of the Trash | folder, against the quota. Messages that are marked as deleted (but not | yet actually removed), or messages that are moved to the Trash folder | (which is subject to automatic purging) do not count towards the set | quota. `---- Ignoring the content (or increasing the quota) of the Trash folder is easy and no problem, but ignoring deleted messages seems impossible without changes to the code. While deleted messages are still stored on the server and still take up space until they are expunged, counting them against the quota is somewhat counter-intuitive because most clients don't show those mails and the normal user is unaware the mails he deleted are still there and take up space. Worse yet, if the client uses move-to-Trash, a user deleting mails will double the used space (until Expunge is used) and this may push him over his quota and thus cause any new mail delivery to fail. Unfortunately as our users are used to the courier way of handling the quota this will cause trouble after the migration. And this setup is run at a University, so I don't have any control over the clients a user uses and the behavior of said clients so I am not able to disable the move-to-Trash feature or force an immediate Expunge after a delete. So I propose an additional flag for the quota_rule config option to be able to enable a more lax interpretation of the quota enforcement: quota_rule = *:storage=1G:ignoredeleted quota_rule2 = Trash:storage=+100M Of course I would then have a nightly cronjob which force-expunges all deleted messages so that users can't store mails infinitely in their mailboxes. Thanks for your time and Gr??e, Sven. -- Sigmentation fault. Core dumped. From stan at hardwarefreak.com Fri Aug 24 15:50:39 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 24 Aug 2012 07:50:39 -0500 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: <5037789F.3070500@hardwarefreak.com> On 8/24/2012 5:53 AM, Tim Smith wrote: Hay Tim, > Having set up my mail server (Dovecot/Postfix), users are experiencing > long delays (a couple of minutes) when sending mail from mail client > such as Thunderbird - this increases with attachments. Having had a > brief discussion with someone, they mentioned that the reason that this > may be to do with the size of the mailbox. I couldn't see the rationale > behind this unless Dovecot is syncing the mailbox after every sent mail > (due to possibly saving the sent item?) The mail is being delivered > successfully but the amount of time it is taking to complete the action > is far too long! You probably have multiple factors involved in this mail sending delay issue. One may be that you're not bypassing your Postfix restrictions on your submission service. To fix this, disable your restrictions in the master.cf service definition of your submission service. For example: 587 inet n - n - - smtpd -o smtpd_enforce_tls=yes -o smtpd_sasl_auth_enable=yes -o content_filter= -o smtpd_client_restrictions= -o smtpd_helo_restrictions= -o smtpd_sender_restrictions= -o smtpd_recipient_restrictions=permit_mynetworks,\ permit_sasl_authenticated,reject -o receive_override_options=no_unknown_recipient_checks,\ no_address_mappings,no_header_body_checks This should squash any/all delays in Postfix submission. Another is the fact you're storing the users' Sent folders on the IMAP server. Typically there's nothing wrong with this. I do this and I see zero delay in Tbird. If a good portion of the delay you're seeing is Tbird copying messages to the Sent folder then I'd say you may have a duplex mismatch or some other network layer issue. What is the network topology between these client MUAs and the server? Full duplex fast ethernet? GbE? Or is the server at a remote location, say a colo/VPS server, and your clients are submitting over a shared ADSL/cable circuit to the server? If this is the case you'll always have substantial delays as the real outbound transmission rate of the best ADSL/cable circuits is only 500-1000 Kbps. Sending an attachment over such a pipe is always going to be slow, doubly so if you're copying to an IMAP Sent folder over the same connection, plus sharing it for web browsing, etc, amongst many users. If this is a SOHO environment with shared ADSL/cable the server needs to be on site, with clients connected via ethernet. This will allow instantaneous submission and Sent copying, while pushing the delay to the Postfix outbound queue, where it's invisible to your users. -- Stan From tss at iki.fi Fri Aug 24 16:05:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Aug 2012 16:05:37 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <692aeic3nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> Message-ID: <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> On 24.8.2012, at 15.02, Sven Hartge wrote: > Ignoring the content (or increasing the quota) of the Trash folder is > easy and no problem, but ignoring deleted messages seems impossible > without changes to the code. .. > So I propose an additional flag for the quota_rule config option to be > able to enable a more lax interpretation of the quota enforcement: > > quota_rule = *:storage=1G:ignoredeleted > quota_rule2 = Trash:storage=+100M This can't be implemented race-condition-free without huge changes to code. From sven at svenhartge.de Fri Aug 24 16:13:46 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:13:46 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> Message-ID: <892ajb13nov8@mids.svenhartge.de> Timo Sirainen wrote: > On 24.8.2012, at 15.02, Sven Hartge wrote: >> Ignoring the content (or increasing the quota) of the Trash folder is >> easy and no problem, but ignoring deleted messages seems impossible >> without changes to the code. > .. >> So I propose an additional flag for the quota_rule config option to be >> able to enable a more lax interpretation of the quota enforcement: >> >> quota_rule = *:storage=1G:ignoredeleted >> quota_rule2 = Trash:storage=+100M > This can't be implemented race-condition-free without huge changes to code. Damn, too bad. I know for sure either my users or my 1st level support team are going to kill me if I don't find a solution. Is is possible to forcibly expunge a message at once, directly after a client has marked it as deleted? Kind of the opposite of the lazy_expunge plugin? Gr??e, Sven. -- Sigmentation fault. Core dumped. From robert at schetterer.org Fri Aug 24 16:41:57 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 15:41:57 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <892ajb13nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <503784A5.8080606@schetterer.org> Am 24.08.2012 15:13, schrieb Sven Hartge: > Timo Sirainen wrote: >> On 24.8.2012, at 15.02, Sven Hartge wrote: > >>> Ignoring the content (or increasing the quota) of the Trash folder is >>> easy and no problem, but ignoring deleted messages seems impossible >>> without changes to the code. >> .. >>> So I propose an additional flag for the quota_rule config option to be >>> able to enable a more lax interpretation of the quota enforcement: >>> >>> quota_rule = *:storage=1G:ignoredeleted >>> quota_rule2 = Trash:storage=+100M > >> This can't be implemented race-condition-free without huge changes to code. > > Damn, too bad. > > I know for sure either my users or my 1st level support team are going > to kill me if I don't find a solution. > > Is is possible to forcibly expunge a message at once, directly after a > client has marked it as deleted? Kind of the opposite of the > lazy_expunge plugin? > > Gr??e, > Sven. > hm perhaps as workaround http://wiki2.dovecot.org/Plugins/deleted-to-trash and do often http://wiki2.dovecot.org/Plugins/Expire via cron i.e doveadm expunge -A mailbox Trash savedbefore 1h -- Best Regards MfG Robert Schetterer From haldir.junk at gmail.com Fri Aug 24 16:42:21 2012 From: haldir.junk at gmail.com (Eric Sisolak) Date: Fri, 24 Aug 2012 09:42:21 -0400 Subject: [Dovecot] Vpopmail Dynamic Authentication Module Message-ID: Hello, We currently use qmail with vpopmail for e-mail and are looking to switch from courier-imap to dovecot for IMAP on our RedHat EL 5 systems. Our goal is to use the dovecot RPM supplied by RH (v1.0.7) if at all possible. We can do this if we are able to dynamically load the vpopmail auth module. The wiki (http://wiki.dovecot.org/CompilingSource) notes that this should be possible: Dovecot can also dynamically load authentication modules from the $prefix/lib/dovecot/auth/ directory. Binary packages builders should use them for authentication modules which require external libraries (e. g. LDAP and vpopmail). There is no standard way to build them as modules currently, but something like this should work: gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL \-I../.. -I../lib userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so \-lvpopmail I had to modify the command to build the module, but was able to successfully build it: gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL -I../.. -I../lib -I/home/vpopmail/include -I/home/vpopmail/lib userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so -L/home/vpopmail/lib/libvpopmail.a I am unable to get the module to load properly. Dovecot built with --with-vpopmail works perfectly. When I start dovecot and it tries to load the module it reports: Aug 23 16:48:18 ctd-nix1 dovecot: Dovecot v1.0.7 starting up Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): dlopen(/usr/lib64/dovecot/auth/vpopmail.so) failed: /usr/lib64/dovecot/auth/vpopmail.so: undefined symbol: vclose Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): dlsym(passdb_vpopmail) failed: dovecot-auth: undefined symbol: passdb_vpopmail Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): Unknown passdb driver 'vpopmail' (typo, or Dovecot was built without support for it? Check with dovecot --build-options) Aug 23 16:48:18 ctd-nix1 dovecot: Auth process died too early - shutting down Sometimes instead the last line is replaced with: Aug 23 15:02:45 ctd-nix1 dovecot: child 5412 (auth) returned error 89 Thanks! Eric From tcsmith1978 at googlemail.com Fri Aug 24 16:49:38 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 14:49:38 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037789F.3070500@hardwarefreak.com> References: <50375D3E.50409@googlemail.com> <5037789F.3070500@hardwarefreak.com> Message-ID: <50378672.70208@googlemail.com> My next guess was the upstream data rate. My router states that the upstream is 10x slower than downstream so I guess this is the culprit. Time to move to a VPS methinks... On 24/08/12 13:50, Stan Hoeppner wrote: > On 8/24/2012 5:53 AM, Tim Smith wrote: > > Hay Tim, > >> Having set up my mail server (Dovecot/Postfix), users are experiencing >> long delays (a couple of minutes) when sending mail from mail client >> such as Thunderbird - this increases with attachments. Having had a >> brief discussion with someone, they mentioned that the reason that this >> may be to do with the size of the mailbox. I couldn't see the rationale >> behind this unless Dovecot is syncing the mailbox after every sent mail >> (due to possibly saving the sent item?) The mail is being delivered >> successfully but the amount of time it is taking to complete the action >> is far too long! > You probably have multiple factors involved in this mail sending delay > issue. > > One may be that you're not bypassing your Postfix restrictions on your > submission service. To fix this, disable your restrictions in the > master.cf service definition of your submission service. For example: > > 587 inet n - n - - smtpd > -o smtpd_enforce_tls=yes > -o smtpd_sasl_auth_enable=yes > -o content_filter= > -o smtpd_client_restrictions= > -o smtpd_helo_restrictions= > -o smtpd_sender_restrictions= > -o smtpd_recipient_restrictions=permit_mynetworks,\ > permit_sasl_authenticated,reject > -o receive_override_options=no_unknown_recipient_checks,\ > no_address_mappings,no_header_body_checks > > This should squash any/all delays in Postfix submission. > > Another is the fact you're storing the users' Sent folders on the IMAP > server. Typically there's nothing wrong with this. I do this and I see > zero delay in Tbird. If a good portion of the delay you're seeing is > Tbird copying messages to the Sent folder then I'd say you may have a > duplex mismatch or some other network layer issue. > > What is the network topology between these client MUAs and the server? > Full duplex fast ethernet? GbE? Or is the server at a remote location, > say a colo/VPS server, and your clients are submitting over a shared > ADSL/cable circuit to the server? If this is the case you'll always > have substantial delays as the real outbound transmission rate of the > best ADSL/cable circuits is only 500-1000 Kbps. Sending an attachment > over such a pipe is always going to be slow, doubly so if you're copying > to an IMAP Sent folder over the same connection, plus sharing it for web > browsing, etc, amongst many users. > > If this is a SOHO environment with shared ADSL/cable the server needs to > be on site, with clients connected via ethernet. This will allow > instantaneous submission and Sent copying, while pushing the delay to > the Postfix outbound queue, where it's invisible to your users. > From sven at svenhartge.de Fri Aug 24 16:53:09 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:53:09 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Robert Schetterer wrote: > Am 24.08.2012 15:13, schrieb Sven Hartge: >> Timo Sirainen wrote: >>> On 24.8.2012, at 15.02, Sven Hartge wrote: >> >>>> Ignoring the content (or increasing the quota) of the Trash folder is >>>> easy and no problem, but ignoring deleted messages seems impossible >>>> without changes to the code. >>>> So I propose an additional flag for the quota_rule config option to be >>>> able to enable a more lax interpretation of the quota enforcement: >>>> >>>> quota_rule = *:storage=1G:ignoredeleted >>>> quota_rule2 = Trash:storage=+100M >>> This can't be implemented race-condition-free without huge changes >>> to code. >> >> Damn, too bad. >> >> I know for sure either my users or my 1st level support team are >> going to kill me if I don't find a solution. >> >> Is is possible to forcibly expunge a message at once, directly after >> a client has marked it as deleted? Kind of the opposite of the >> lazy_expunge plugin? > hm perhaps as workaround > http://wiki2.dovecot.org/Plugins/deleted-to-trash > and do often > http://wiki2.dovecot.org/Plugins/Expire > via cron i.e > doveadm expunge -A mailbox Trash savedbefore 1h I stumbled upon deleted_to_trash 5 minutes ago. This could work, if the code still works with dovecot 2.1. Gr??e, Sven. -- Sigmentation fault. Core dumped. From sven at svenhartge.de Fri Aug 24 16:56:36 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:56:36 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Sven Hartge wrote: > Robert Schetterer wrote: >> Am 24.08.2012 15:13, schrieb Sven Hartge: >>> Is is possible to forcibly expunge a message at once, directly after >>> a client has marked it as deleted? Kind of the opposite of the >>> lazy_expunge plugin? >> hm perhaps as workaround >> http://wiki2.dovecot.org/Plugins/deleted-to-trash >> and do often >> http://wiki2.dovecot.org/Plugins/Expire >> via cron i.e >> doveadm expunge -A mailbox Trash savedbefore 1h > I stumbled upon deleted_to_trash 5 minutes ago. This could work, if the > code still works with dovecot 2.1. Nope, does not compile (dovecot-dev headers are installed): cc \ -fPIC -shared -Wall \ -I/usr/include/dovecot \ -I/usr/include/dovecot/src \ -I/usr/include/dovecot/src/lib \ -I/usr/include/dovecot/src/lib-storage \ -I/usr/include/dovecot/src/lib-mail \ -I/usr/include/dovecot/src/lib-imap \ -I/usr/include/dovecot/src/lib-index \ -DHAVE_CONFIG_H \ deleted-to-trash-plugin.c -o lib_deleted_to_trash_plugin.so deleted-to-trash-plugin.c: In function ?mailbox_open_or_create?: deleted-to-trash-plugin.c:79: error: ?MAILBOX_FLAG_KEEP_RECENT? undeclared (first use in this function) deleted-to-trash-plugin.c:79: error: (Each undeclared identifier is reported only once deleted-to-trash-plugin.c:79: error: for each function it appears in.) deleted-to-trash-plugin.c: In function ?copy_deleted_mail_to_trash?: deleted-to-trash-plugin.c:136: warning: passing argument 1 of ?mailbox_keywords_unref? from incompatible pointer type /usr/include/dovecot/mail-storage.h:612: note: expected ?struct mail_keywords **? but argument is of type ?struct mailbox *? deleted-to-trash-plugin.c:136: error: too many arguments to function ?mailbox_keywords_unref? make: *** [lib_deleted_to_trash_plugin.so] Error 1 Gr??e, Sven. -- Sigmentation fault. Core dumped. From sven at svenhartge.de Fri Aug 24 17:29:15 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 16:29:15 +0200 Subject: [Dovecot] Trying to fix delete_to_trash plugin (was: quota: ignore deleted messages (?)) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Sven Hartge wrote: > Nope, does not compile (dovecot-dev headers are installed): OK, trying to fix this, without having any deeper knowlege of C (anymore): > deleted-to-trash-plugin.c: In function ?mailbox_open_or_create?: > deleted-to-trash-plugin.c:79: error: ?MAILBOX_FLAG_KEEP_RECENT? undeclared (first use in this function) MAILBOX_FLAG_KEEP_RECENT is not present in 2.1, seems to me it was made the default and MAILBOX_FLAG_DROP_RECENT was introduced as its counterpart. I removed the flag from the call to mailbox_alloc() in 72 static struct mailbox * 73 mailbox_open_or_create(struct mailbox_list *list, const char *name, 74 const char **error_r) 75 { 76 struct mailbox *box; 77 enum mail_error error; 78 79 box = mailbox_alloc(list, name, MAILBOX_FLAG_NO_INDEX_FILES); 80 if (mailbox_open(box) == 0) { 81 *error_r = NULL; 82 return box; 83 } 84 and retried to compile: cc \ -fPIC -shared -Wall \ -I/usr/include/dovecot \ -I/usr/include/dovecot/src \ -I/usr/include/dovecot/src/lib \ -I/usr/include/dovecot/src/lib-storage \ -I/usr/include/dovecot/src/lib-mail \ -I/usr/include/dovecot/src/lib-imap \ -I/usr/include/dovecot/src/lib-index \ -DHAVE_CONFIG_H \ deleted-to-trash-plugin.c -o lib_deleted_to_trash_plugin.so deleted-to-trash-plugin.c: In function ?copy_deleted_mail_to_trash?: deleted-to-trash-plugin.c:135: warning: passing argument 1 of ?mailbox_keywords_unref? from incompatible pointer type /usr/include/dovecot/mail-storage.h:612: note: expected ?struct mail_keywords **? but argument is of type ?struct mailbox *? deleted-to-trash-plugin.c:135: error: too many arguments to function ?mailbox_keywords_unref? make: *** [lib_deleted_to_trash_plugin.so] Error 1 _and_ now I am at the end of my wisdom. Pointer magic in C has always been a dark dark mystery to me (I learned programming in Pascal, Ada95 and later Perl ...). Help, anybody? Gr??e, Sven. -- Sigmentation fault. Core dumped. From wagnermazevedo at hotmail.com Fri Aug 24 22:23:43 2012 From: wagnermazevedo at hotmail.com (Wagner Michel Martins de Azevedo) Date: Fri, 24 Aug 2012 16:23:43 -0300 Subject: [Dovecot] Shared mdboxes Message-ID: Hi Timo, I'm trying to share two folders. The first one it's public and the other is per user based, using acl's to control access etc . Dovecot create the folders, but when I'll subscribe using ThunderBird client both of them seens like watermarked and has a "mailboxes" folder inside. I can set up the acl's rules using Thunderbird. Log files like mail.log don't show nothing in special and mail.err has nothing. Here is the config. # 2.1.8 (b4cd382b6606): /etc/dovecot/dovecot.conf# OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 /etc/dovecot/conf.d/10.mail.conf namespace { type = public separator = . prefix = public. location = mdbox:/var/mail_shares/public:INDEX=/var/mail_shares/public subscriptions = no}namespace { type = shared separator = . prefix = %h/shared location = mdbox:%h/shared:INDEX=%h/shared subscriptions = no list = children} Thanks, Wagner Azevedo From tss at iki.fi Sat Aug 25 01:04:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 01:04:10 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <892ajb13nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: On 24.8.2012, at 16.13, Sven Hartge wrote: >>> quota_rule = *:storage=1G:ignoredeleted >>> quota_rule2 = Trash:storage=+100M > >> This can't be implemented race-condition-free without huge changes to code. > > Damn, too bad. > > I know for sure either my users or my 1st level support team are going > to kill me if I don't find a solution. How about just disabling the quota enforcing and doing a nightly run of some type of enforcing (sending notification email and/or disabling new mail delivery until user has more quota again)? From sven at svenhartge.de Sat Aug 25 01:49:12 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 00:49:12 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: Timo Sirainen wrote: > On 24.8.2012, at 16.13, Sven Hartge wrote: >>>> quota_rule = *:storage=1G:ignoredeleted >>>> quota_rule2 = Trash:storage=+100M >> >>> This can't be implemented race-condition-free without huge changes to code. >> >> Damn, too bad. >> I know for sure either my users or my 1st level support team are >> going to kill me if I don't find a solution. > How about just disabling the quota enforcing and doing a nightly run > of some type of enforcing (sending notification email and/or disabling > new mail delivery until user has more quota again)? As a last resort, yes. If possible, I'd like to keep the feedback about mailbox size as direct as possible. Disabling an account only once per night might be acceptable, but the reenabling of the account, once a user has freed some space, has to be instant or I would get constant complains from the users (the ones with the biggest mailboxes being the professors, which can be quite the pain to work with, if they believe they don't get what they think they are entitled to get). I know, this all sounds a bit "whiny", but I've been working for over 8 years in this position and the harsh reality made me somewhat cautious. So far, the description of the delete_to_trash plugin sounds promising, because I can already ignore the Trash (or add to the total quota for this folder and do a nightly expunge run for it), if only it would compile for dovecot 2.1. Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Sat Aug 25 10:23:31 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 10:23:31 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: On 25.8.2012, at 1.49, Sven Hartge wrote: >> How about just disabling the quota enforcing and doing a nightly run >> of some type of enforcing (sending notification email and/or disabling >> new mail delivery until user has more quota again)? > > As a last resort, yes. If possible, I'd like to keep the feedback about > mailbox size as direct as possible. > > Disabling an account only once per night might be acceptable, but the > reenabling of the account, once a user has freed some space, has to be > instant or I would get constant complains from the users (the ones with > the biggest mailboxes being the professors, which can be quite the pain > to work with, if they believe they don't get what they think they are > entitled to get). You can use quota warning scripts to send warnings and enable account instantly when it goes under 100%. > So far, the description of the delete_to_trash plugin sounds promising, > because I can already ignore the Trash (or add to the total quota for > this folder and do a nightly expunge run for it), if only it would > compile for dovecot 2.1. I don't like the idea behind deleted_to_trash and won't offer any support for it if I don't have to. From tresh_dovecot at lefoyer.ru Sat Aug 25 11:05:39 2012 From: tresh_dovecot at lefoyer.ru ((Dovecot) Sergey Sidlyarenko) Date: Sat, 25 Aug 2012 12:05:39 +0400 Subject: [Dovecot] Problem use localized prefix in namespace In-Reply-To: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> References: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> Message-ID: <23adeb68feb387bd625b1d2d1424a987@lefoyer.ru> Thank you, it works. Timo Sirainen ????? 2012-08-23 23:57: > On 17.8.2012, at 21.37, (Dovecot) Sergey Sidlyarenko wrote: > >> Problem with localized prefix in namespace. > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/ade94fde249e -- Best regards, Sidlyarenko Sergey Aleksandrovish +7(495)509-42-07 tresh_dovecot at lefoyer.ru mailto:tresh_dovecot at lefoyer.ru From tss at iki.fi Sat Aug 25 11:25:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 11:25:10 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: <7EC6E90E-3757-440B-A6B7-DBFB70D430A2@iki.fi> On 24.8.2012, at 14.18, Matthew Powell wrote: > On 2012-08-24, at 7.01, Jerry wrote: > >> I would personally recommend supporting it. If history teaches us >> anything, it is that sooner or later, and usually sooner, someone will >> require that block. Being prepared for it in advance would seem like >> the prudent thing to do. > > I wonder whether it would be better to make the exclusion list configurable. The reason for this default exclusion list is exactly to avoid behaving badly in unconfigured systems. Normally people should be using Dovecot proxies and login_trusted_networks setting configured to avoid the problem entirely. From zucca at systemschmiede.com Sat Aug 25 14:11:01 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Sat, 25 Aug 2012 13:11:01 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <50353D32.2080401@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> Message-ID: <5038B2C5.3090408@systemschmiede.com> Hi List, i found out the following: The problem with the "ghostfolder" occurs only if i use prefix = shares/%%n/ When using prefix = shares/%%u/ everytung's ok! Only the name of the folder is a little longish this way, so i would really prefer the %%n way. Any ideas now? Thank you Sascha Am 22.08.2012 22:12, schrieb Sascha Zucca: > If you should need any more info on this, just drop me a line. > I am fully stuck! > I think that my dovecot.conf is not put together well, only i can't > find the problem... > > Thanx > Sascha > > Am 22.08.2012 01:44, schrieb Sascha Zucca: >> Hi list, >> i have a strange "ghost" folder in my subscription list and just >> can't find out how to get rid of it. >> It seems to be someones Inbox, but it doesn't tell me whose. >> >> Here's a screenshot of Open-Xchanges Web-GUI: >> /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg >> / >> As you can see there is an unamed folder just under Freigaben (Shares). >> >> >> In Thunderbird: >> /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ >> >> Now the Folder is "INBOX"...But it is noones Inbox, as the >> corresponding user (amazon e.g.) should be a prefix-folder right >> before the share. >> >> >> some output over Telnet: >> >> 1 lsub "" "*" >> * LSUB () "/" "INBOX" >> * LSUB () "/" "INBOX/Amazon" >> * LSUB () "/" "INBOX/Bestellung" >> * LSUB () "/" "Drafts" >> * LSUB () "/" "Sent Items" >> * LSUB () "/" "Spam" >> * LSUB () "/" "Trash" >> * LSUB () "/" "Freigaben/amazon/INBOX" >> 1 OK Lsub completed. >> >> >> 1 list "" "*" >> * LIST (\HasNoChildren) "/" "Trash" >> * LIST (\HasNoChildren) "/" "Sent Items" >> * LIST (\HasChildren) "/" "INBOX" >> * LIST (\HasNoChildren) "/" "INBOX/Amazon" >> * LIST (\HasNoChildren) "/" "INBOX/Bestellung" >> * LIST (\HasNoChildren) "/" "Spam" >> * LIST (\HasNoChildren) "/" "Drafts" >> * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" >> 1 OK List completed. >> >> >> This looks a bit strange to me: >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> But i don't know really if that is the ghostfolder. >> >> >> finally here's the interesting part in my dovecot.conf: >> / >> namespace private { >> separator = / >> prefix = >> #location defaults to mail_location. >> inbox = yes >> } >> >> namespace shared { >> separator = / >> prefix = Freigaben/%%n/ >> location = >> maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ >> subscriptions = no >> list = children >> inbox = no >> } >> / >> >> Any idea how to banish the ghost in the machine? >> >> Thank you very much >> Sascha >> >> > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Sat Aug 25 14:53:11 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 14:53:11 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5038B2C5.3090408@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> Message-ID: <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> On 25.8.2012, at 14.11, Sascha Zucca wrote: > Hi List, > i found out the following: > The problem with the "ghostfolder" occurs only if i use > > prefix = shares/%%n/ > > When using > prefix = shares/%%u/ > > everytung's ok! What Dovecot version? From sven at svenhartge.de Sat Aug 25 15:40:22 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 14:40:22 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 1.49, Sven Hartge wrote: >>> How about just disabling the quota enforcing and doing a nightly run >>> of some type of enforcing (sending notification email and/or >>> disabling new mail delivery until user has more quota again)? >> >> As a last resort, yes. If possible, I'd like to keep the feedback >> about mailbox size as direct as possible. >> >> Disabling an account only once per night might be acceptable, but the >> reenabling of the account, once a user has freed some space, has to >> be instant or I would get constant complains from the users (the ones >> with the biggest mailboxes being the professors, which can be quite >> the pain to work with, if they believe they don't get what they think >> they are entitled to get). > You can use quota warning scripts to send warnings and enable account > instantly when it goes under 100%. Warning the user at 95%, 97% and 99% using the warning scripts is easy and was already configured and is working like a charm. Disabling the account in a nightly cronjob will be easy as well. Since I use the Mysql-dict for quota, I can just query that, compare the value to the configured quota from LDAP and act accordingly. But how do I instantly reenable the account when it drops below 100% with the warning scripts? As far as I understand the documentation, they are only triggered if the quota use rises over the configured thresholds. I seem to somehow miss a piece, but I cannot see which one. Gr??e, Sven. -- Sigmentation fault. Core dumped. From zucca at systemschmiede.com Sat Aug 25 15:56:17 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Sat, 25 Aug 2012 14:56:17 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> Message-ID: <5038CB71.5010808@systemschmiede.com> Hi Timo, dovecot --version 1.2.15 It's the stable one for debian squeeze i presume. Thank you for your help. Sascha Am 25.08.2012 13:53, schrieb Timo Sirainen: > On 25.8.2012, at 14.11, Sascha Zucca wrote: > >> Hi List, >> i found out the following: >> The problem with the "ghostfolder" occurs only if i use >> >> prefix = shares/%%n/ >> >> When using >> prefix = shares/%%u/ >> >> everytung's ok! > What Dovecot version? > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Sat Aug 25 16:06:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 16:06:23 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5038CB71.5010808@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. On 25.8.2012, at 15.56, Sascha Zucca wrote: > Hi Timo, > dovecot --version > 1.2.15 > > It's the stable one for debian squeeze i presume. > > Thank you for your help. > > Sascha > > > Am 25.08.2012 13:53, schrieb Timo Sirainen: >> On 25.8.2012, at 14.11, Sascha Zucca wrote: >> >>> Hi List, >>> i found out the following: >>> The problem with the "ghostfolder" occurs only if i use >>> >>> prefix = shares/%%n/ >>> >>> When using >>> prefix = shares/%%u/ >>> >>> everytung's ok! >> What Dovecot version? >> >> > > > -- > Systemschmiede IT-L?sungen > Zucca & Teves GbR > August-Thyssen-Str. 2-4 > 52511 Geilenkirchen > www.systemschmiede.com > > > Tel.: 02451 - 9088390 > Fax: 02451 - 9124070 > Mobil: 0178 - 4073254 > > Ust.ID: DE248030393 > From tss at iki.fi Sat Aug 25 16:09:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 16:09:40 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> On 25.8.2012, at 15.40, Sven Hartge wrote: > Warning the user at 95%, 97% and 99% using the warning scripts is easy > and was already configured and is working like a charm. > > But how do I instantly reenable the account when it drops below 100% > with the warning scripts? As far as I understand the documentation, they > are only triggered if the quota use rises over the configured > thresholds. Setting the warning at -100% would do that I think. In any case "-" before the percentage means "reverse". Yeah, not in wiki, I'll add it there.. From sven at svenhartge.de Sat Aug 25 18:28:49 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 17:28:49 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 15.40, Sven Hartge wrote: >> Warning the user at 95%, 97% and 99% using the warning scripts is >> easy and was already configured and is working like a charm. >> >> But how do I instantly reenable the account when it drops below 100% >> with the warning scripts? As far as I understand the documentation, >> they are only triggered if the quota use rises over the configured >> thresholds. > Setting the warning at -100% would do that I think. In any case "-" > before the percentage means "reverse". Yeah, not in wiki, I'll add it > there.. Ah, very nice. Now I need to put the pieces together and test whether this is a working solution for me. Question: is it possible to enforce the quota for IMAP/POP and have it on noenforcing for LDA/LMTP? LDA would be easy, as I could just add -o "plugin/quota=dict:Benutzer-Quota::noenforcing:proxy::quota" to the command line of dovecot-ldap in my exim4.conf. But because of performance considerations I want to use LMTP to deliver the mails. Would this nested plugin configuration work: (sorry, not at work, cannot test directly) protocol lmtp { mail_plugins = $mail_plugins sieve plugin { quota = dict:Benutzer-Quota::noenforcing:proxy::quota } } Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Sat Aug 25 18:39:51 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 18:39:51 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: <20B68DD0-7919-4843-9568-B17597656CEE@iki.fi> On 25.8.2012, at 18.28, Sven Hartge wrote: > But because of performance considerations I want to use LMTP to deliver > the mails. Would this nested plugin configuration work: > (sorry, not at work, cannot test directly) > > protocol lmtp { > mail_plugins = $mail_plugins sieve > plugin { > quota = dict:Benutzer-Quota::noenforcing:proxy::quota > } > } That should work, yes. From sven at svenhartge.de Sat Aug 25 18:45:56 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 17:45:56 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> <20B68DD0-7919-4843-9568-B17597656CEE@iki.fi> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 18.28, Sven Hartge wrote: >> But because of performance considerations I want to use LMTP to deliver >> the mails. Would this nested plugin configuration work: >> (sorry, not at work, cannot test directly) >> >> protocol lmtp { >> mail_plugins = $mail_plugins sieve >> plugin { >> quota = dict:Benutzer-Quota::noenforcing:proxy::quota >> } >> } > That should work, yes. Very good, thank you for your fast answers. Gr??e, Sven. -- Sigmentation fault. Core dumped. From trashcan at odo.in-berlin.de Sat Aug 25 19:09:59 2012 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Sat, 25 Aug 2012 18:09:59 +0200 Subject: [Dovecot] dsync replication available for testing In-Reply-To: References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> Message-ID: <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> On 23.08.2012, at 22:01, Timo Sirainen wrote: > On 19.8.2012, at 12.51, Michael Grimm wrote: >>>> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >>>> >>>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >>>> >>>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >>>> >>>> JFTR: I do have mail_log plugin activated. >>> >>> Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. >> >> >> I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? > > > Not enable mail_log for doveadm: > > protocol !doveadm { > mail_plugins = $mail_plugins = mail_log > } JFTR: That didn't work. > or alternatively override it only for the dsync command with doveadm -o mail_plugins=... But, a ... dsync_remote_cmd = ssh -l%{login} %{host} doveadm -o mail_plugins= dsync-server -u%u -l%{lock_timeout} -n%{namespace} ... did omit those error messages successfully. Thanks and regards, Michael From tss at iki.fi Sat Aug 25 20:16:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 20:16:49 +0300 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> Message-ID: <5D96BF6D-31FA-4842-8A14-0E7F76B1C7C3@iki.fi> On 25.8.2012, at 19.09, Michael Grimm wrote: >> Not enable mail_log for doveadm: >> >> protocol !doveadm { >> mail_plugins = $mail_plugins = mail_log >> } > > JFTR: That didn't work. This would omit it from the local dsync. >> or alternatively override it only for the dsync command with doveadm -o mail_plugins=... > > But, a ... > > dsync_remote_cmd = ssh -l%{login} %{host} doveadm -o mail_plugins= dsync-server -u%u -l%{lock_timeout} -n%{namespace} > > ... did omit those error messages successfully. And yes, this would omit it from the remote dsync. From martin.rabl at rablnet.de Sat Aug 25 21:31:29 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 25 Aug 2012 20:31:29 +0200 Subject: [Dovecot] UIDPLUS for Maildir? Message-ID: <50391A01.4030401@rablnet.de> Hi, I found the following comment in the documentation (http://wiki.dovecot.org/FeatUIDPLUS), last edited on 2009-03-15 > Dovecot already supported UIDPLUS at one point for mbox, but implementing it > for Maildir has to be done differently (UIDs are allocated later with Maildir). > So currently the UIDPLUS code is removed until it can be made to > work with Maildir. My question: does this extension now run with maildir? Thank you, Martin From kgc at corp.sonic.net Sat Aug 25 22:14:20 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Sat, 25 Aug 2012 12:14:20 -0700 Subject: [Dovecot] dovecot stats error In-Reply-To: <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> References: <4FE46641.4030801@schetterer.org> <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> Message-ID: <5039240C.1030003@corp.sonic.net> On 6/22/2012 6:34 AM, Timo Sirainen wrote: > Which Dovecot version? I thought I fixed this already.. I'm seeing these errors running 2.1.8 -- Kelsey Cummings - kgc at corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407 From tss at iki.fi Sat Aug 25 22:17:48 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 22:17:48 +0300 Subject: [Dovecot] UIDPLUS for Maildir? In-Reply-To: <50391A01.4030401@rablnet.de> References: <50391A01.4030401@rablnet.de> Message-ID: <236BEBF4-CEDD-4E86-9C9A-21BFACF2F027@iki.fi> On 25.8.2012, at 21.31, Martin Rabl wrote: > I found the following comment in the documentation (http://wiki.dovecot.org/FeatUIDPLUS), last edited on 2009-03-15 >> Dovecot already supported UIDPLUS at one point for mbox, but implementing it >> for Maildir has to be done differently (UIDs are allocated later with Maildir). >> So currently the UIDPLUS code is removed until it can be made to >> work with Maildir. > > My question: does this extension now run with maildir? Since v1.1 I think. From kgc at corp.sonic.net Sat Aug 25 22:55:23 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Sat, 25 Aug 2012 12:55:23 -0700 Subject: [Dovecot] dovecot stats error In-Reply-To: <5039240C.1030003@corp.sonic.net> References: <4FE46641.4030801@schetterer.org> <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> <5039240C.1030003@corp.sonic.net> Message-ID: <50392DAB.8010303@corp.sonic.net> On 8/25/2012 12:14 PM, Kelsey Cummings wrote: > On 6/22/2012 6:34 AM, Timo Sirainen wrote: >> Which Dovecot version? I thought I fixed this already.. > > I'm seeing these errors running 2.1.8 Examples below, let me know if I can provide any other info Timo. In other news, we're finally migrated to dovecot from courier. WHOOO HOOOO!!!! > Aug 25 12:53:37 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mcache 331 < 332 > Aug 25 12:53:37 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 180435729 < 204849088 > Aug 25 12:53:38 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 50757363 < 62351358 > Aug 25 12:53:38 d dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mlpath 17451 < 20067 > Aug 25 12:53:41 d dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 40483661 < 42086237 > Aug 25 12:53:42 b dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 65540465 < 67974537 > Aug 25 12:53:42 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mlpath 811 < 946 > Aug 25 12:53:43 b dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 220133763 < 221888538 > Aug 25 12:53:47 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mcache 13 < 14 > Aug 25 12:53:48 c dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 118702153 < 121714865 -- Kelsey Cummings - kgc at corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407 From daniel.parthey at informatik.tu-chemnitz.de Sun Aug 26 02:28:33 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sun, 26 Aug 2012 01:28:33 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: <20120825232833.GA11297@daniel.localdomain> Sven Hartge wrote: > I want to use LMTP to deliver the mails. > Would this nested plugin configuration work to disable quota: > > protocol lmtp { > mail_plugins = $mail_plugins sieve > plugin { > quota = dict:Benutzer-Quota::noenforcing:proxy::quota > } > } Concerning http://dovecot.org/list/dovecot/2012-June/066298.html I'm using MySQL userdb, but just want to keep things as simple as possible (KISS principle). What would the configuration look like if I want to setup one lmtp service with quota enforcing on port 10024 and another lmtp service without enforcing on port 20024? Especially how to define two "protocol lmtp" sections which are assigned to their specific service? Will this work with two simple 'nested configuration' or will I need to define SQL statements in the userdb lookup which selects "noenforcing" depending on local port? Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Sun Aug 26 06:55:34 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 25 Aug 2012 22:55:34 -0500 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50378672.70208@googlemail.com> References: <50375D3E.50409@googlemail.com> <5037789F.3070500@hardwarefreak.com> <50378672.70208@googlemail.com> Message-ID: <50399E36.7030304@hardwarefreak.com> On 8/24/2012 8:49 AM, Tim Smith wrote: > My next guess was the upstream data rate. My router states that the > upstream is 10x slower than downstream so I guess this is the culprit. > Time to move to a VPS methinks... Ok, you stated that you have multiple user PCs that are slow when sending. I guess, asked, if they were all behind the same DSL/Cable line and if the Dovecot server was local or remote. If the user PCs are local, and the server is remote, and the slow outbound speed of your internet connection is the cause of the slow sending, then I fail to see how moving to a VPS will help you. You're not providing sufficient technical details explaining what machines are located where. We need to know that to give you the correct answer(s) to your problem. -- Stan From hawat.thufir at gmail.com Sun Aug 26 18:21:28 2012 From: hawat.thufir at gmail.com (Thufir) Date: Sun, 26 Aug 2012 08:21:28 -0700 Subject: [Dovecot] Java driver for doveadm Message-ID: I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and there a few features I like which javax.mail just doesn't have. Is there maybe a Java driver for doveadm? thanks, Thufir From kernel.picknick at gmail.com Sun Aug 26 18:40:34 2012 From: kernel.picknick at gmail.com (Alex) Date: Sun, 26 Aug 2012 17:40:34 +0200 Subject: [Dovecot] How to configure dovecot for specific mailboxes only? Message-ID: Hi, is it possible to configure dovecot so that it only serves mailboxes of specified users? All other users should be completely ignored so that no indexing of messages or other resource consuming actions take place. Thanks in advance, Alex From Ralf.Hildebrandt at charite.de Sun Aug 26 19:47:37 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Sun, 26 Aug 2012 18:47:37 +0200 Subject: [Dovecot] Recipe for "admin-less restore" Message-ID: <20120826164737.GD29284@charite.de> Is there a way for setting up dovecot in such a way that a user can "jump back in time" to an old mailbox "state" in order to retrieve his accidentially deleted mail? -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From lcaron at lncsa.com Sun Aug 26 22:00:04 2012 From: lcaron at lncsa.com (Laurent CARON) Date: Sun, 26 Aug 2012 21:00:04 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: <503A7234.40800@lncsa.com> On 26/08/2012 18:47, Ralf Hildebrandt wrote: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve his > accidentially deleted mail? Hi, We use snapshots for this namespace snaps-h-2 { prefix = INBOX.EmailBackup.h-2. hidden = no list = yes inbox = no location = maildir:/home/.snapshot/hourly.0/%u/Maildir:INDEX=/var/tmp/dovecot/indexes/hourly.0/%u:CONTROL=/var/tmp/dovecot/control/hourly.0/%u type = private } From me at junc.org Mon Aug 27 06:52:08 2012 From: me at junc.org (Benny Pedersen) Date: Mon, 27 Aug 2012 05:52:08 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: Den 2012-08-26 18:47, Ralf Hildebrandt skrev: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve > his > accidentially deleted mail? disable expunge ? From amateo at um.es Mon Aug 27 09:35:52 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 27 Aug 2012 08:35:52 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <503B1548.9030605@um.es> El 25/08/12 09:23, Timo Sirainen escribi?: > On 25.8.2012, at 1.49, Sven Hartge wrote: > >>> How about just disabling the quota enforcing and doing a nightly run >>> of some type of enforcing (sending notification email and/or disabling >>> new mail delivery until user has more quota again)? >> >> As a last resort, yes. If possible, I'd like to keep the feedback about >> mailbox size as direct as possible. >> >> Disabling an account only once per night might be acceptable, but the >> reenabling of the account, once a user has freed some space, has to be >> instant or I would get constant complains from the users (the ones with >> the biggest mailboxes being the professors, which can be quite the pain >> to work with, if they believe they don't get what they think they are >> entitled to get). > > You can use quota warning scripts to send warnings and enable account instantly when it goes under 100%. > But, if you still use quota, you are still counting deleted messages in the quota. Aren't you? Is not easier just making users conscious of deleted messages? Many clients that hide deleted messages, show them in a trash folder (although they don't use move to trash) so it's easy for user to expunge deleted messages. And you could also run a cron to expunge old deleted messages from user mailboxes (for example, messages deleted more than 15 days ago) -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From tss at iki.fi Mon Aug 27 10:00:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:00:09 +0300 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> On 26.8.2012, at 19.47, Ralf Hildebrandt wrote: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve his > accidentially deleted mail? http://wiki2.dovecot.org/Plugins/Lazyexpunge is one possibility From tss at iki.fi Mon Aug 27 10:01:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:01:37 +0300 Subject: [Dovecot] How to configure dovecot for specific mailboxes only? In-Reply-To: References: Message-ID: On 26.8.2012, at 18.40, Alex wrote: > is it possible to configure dovecot so that it only serves mailboxes > of specified users? All other users should be completely ignored so > that no indexing of messages or other resource consuming actions take > place. You can configure passdb/userdb to give different settings to different users. So maybe for some users you return mail_location with :INDEX=MEMORY and don't accept their passwords. Depends on your setup what exactly you need to do.. From tss at iki.fi Mon Aug 27 10:01:54 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:01:54 +0300 Subject: [Dovecot] Java driver for doveadm In-Reply-To: References: Message-ID: On 26.8.2012, at 18.21, Thufir wrote: > I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and > there a few features I like which javax.mail just doesn't have. Is > there maybe a Java driver for doveadm? You can access doveadm via TCP socket. Would that be enough? From robert at schetterer.org Mon Aug 27 10:02:37 2012 From: robert at schetterer.org (Robert Schetterer) Date: Mon, 27 Aug 2012 09:02:37 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> References: <20120826164737.GD29284@charite.de> <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> Message-ID: <503B1B8D.9030705@schetterer.org> Am 27.08.2012 09:00, schrieb Timo Sirainen: > On 26.8.2012, at 19.47, Ralf Hildebrandt wrote: > >> Is there a way for setting up dovecot in such a way that a user can >> "jump back in time" to an old mailbox "state" in order to retrieve his >> accidentially deleted mail? > > http://wiki2.dovecot.org/Plugins/Lazyexpunge is one possibility > also possible you may setup an archive solution i.e with bc copy send to another mail account -- Best Regards MfG Robert Schetterer From tss at iki.fi Mon Aug 27 10:03:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:03:15 +0300 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: On 24.8.2012, at 13.53, Tim Smith wrote: > Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! Other than the bandwidth others already mentioned, the only reason it could be Dovecot's fault is exactly the size of the Sent mailbox. How large is that and what mailbox format are you using? From sven at svenhartge.de Mon Aug 27 11:59:08 2012 From: sven at svenhartge.de (Sven Hartge) Date: Mon, 27 Aug 2012 10:59:08 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503B1548.9030605@um.es> Message-ID: <1192i1o63nov8@mids.svenhartge.de> Angel L. Mateo wrote: > El 25/08/12 09:23, Timo Sirainen escribi?: >> On 25.8.2012, at 1.49, Sven Hartge wrote: >> >>>> How about just disabling the quota enforcing and doing a nightly run >>>> of some type of enforcing (sending notification email and/or disabling >>>> new mail delivery until user has more quota again)? >>> >>> As a last resort, yes. If possible, I'd like to keep the feedback about >>> mailbox size as direct as possible. >>> >>> Disabling an account only once per night might be acceptable, but the >>> reenabling of the account, once a user has freed some space, has to be >>> instant or I would get constant complains from the users (the ones with >>> the biggest mailboxes being the professors, which can be quite the pain >>> to work with, if they believe they don't get what they think they are >>> entitled to get). >> You can use quota warning scripts to send warnings and enable account >> instantly when it goes under 100%. >> > But, if you still use quota, you are still counting deleted messages > in the quota. Aren't you? Quota would be noenforcing. So the users still sees "105% of quota used" but this does not result in any mail bouncing at once. Gr??e, Sven. -- Sigmentation fault. Core dumped. From aconraz at gmail.com Mon Aug 27 12:11:48 2012 From: aconraz at gmail.com (Alano Conraz) Date: Mon, 27 Aug 2012 11:11:48 +0200 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins Message-ID: Hello, i don't know if it a the right place to ask my question related to the development of dovecot plugins, please correct me if it is not. I'm trying some dovecot plugin development. I did a little plugin that suit my needs but i'd like to go further now... I would like to know if there is a kind of "getenv" function that I could call to retrieve in my plugin the username of the mailbox being delivered by dovecot-lda or served by imap server. For example, when I use the deliver with "cat file.txt | deliver -d " user at domain.net" -f "me at domain.net" I would like to call a function that could return for me the argument of "-d" or "-f". i'm working with dovecot 2.0.17 by now. Thank you From tss at iki.fi Mon Aug 27 12:15:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 12:15:49 +0300 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: References: Message-ID: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> On 27.8.2012, at 12.11, Alano Conraz wrote: > I'm trying some dovecot plugin development. I did a little plugin that suit > my needs but i'd like to go further now... I would like to know if there is > a kind of "getenv" function that I could call to retrieve in my plugin the > username of the mailbox being delivered by dovecot-lda or served by imap > server. struct mail_user->username has it. How you get to struct mail_user depends on where you want to access it from. Note that each process is capable of handling multiple different users (although it's not commonly done). From amateo at um.es Mon Aug 27 13:32:13 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 27 Aug 2012 12:32:13 +0200 Subject: [Dovecot] doveadm commands returning 139 at director servers Message-ID: <503B4CAD.6090908@um.es> Hello, I have configured director in front of dovecot imap/pop/lmtp servers. When I need to manipulate a user mailbox, I use doveadm commands at director server's, with -S option. But some commands return exit code 139 when command returns more than 40 entries (I think). For example, the command: sudo doveadm fetch -u amateo hdr mailbox Trash HEADER Subject "nyctalus11/" executed at the backend server returns 952 mails, but executed at director server with -S option, returns only 40 mails and exit code 139. I'm using dovecot 2.1.5 and I attached doveconf -n at director and backend servers. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.2.19um1 x86_64 Ubuntu 12.04.1 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_verbose = yes default_process_limit = 1024 disable_plaintext_auth = no log_timestamp = %Y-%m-%d %H:%M:%S login_trusted_networks = 155.54.211.176/28 mail_debug = yes mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_privileged_group = mail mdbox_rotate_size = 20 M namespace { inbox = yes location = prefix = separator = . } namespace { hidden = yes list = no location = maildir:~/Maildir/expunged prefix = BORRADOS. separator = . } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = session=yes dovecot driver = pam } plugin { lazy_expunge = BORRADOS. quota = maildir:User quota quota_rule = *:storage=20G quota_rule2 = Trash:storage=+1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at um.es service anvil { client_limit = 2051 } service auth { client_limit = 3072 unix_listener auth-userdb { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap { process_limit = 5120 process_min_avail = 6 vsz_limit = 512 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3 { process_min_avail = 6 } ssl = no ssl_cert = } -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-24-generic x86_64 Ubuntu 12.04.1 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_username_format = %n auth_verbose = yes default_process_limit = 1024 director_mail_servers = 155.54.211.161-155.54.211.164 director_servers = 155.54.211.185 155.54.211.186 director_username_hash = %n disable_plaintext_auth = no doveadm_proxy_port = 24245 lmtp_proxy = yes log_timestamp = %Y-%m-%d %H:%M:%S mail_debug = yes passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = proxy=y nopassword=y proxy_timeout=600 driver = static } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 } service anvil { client_limit = 2051 } service auth { client_limit = 3072 unix_listener auth-userdb { mode = 0666 } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { client_limit = 2206 executable = imap-login director process_limit = 6 process_min_avail = 6 service_count = 0 } service imap { process_limit = 5120 process_min_avail = 6 vsz_limit = 512 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3-login { client_limit = 833 executable = pop3-login director process_limit = 6 process_min_avail = 6 service_count = 0 } service pop3 { process_min_avail = 6 } ssl = no ssl_cert = } From benjamin.guy.thomas at gmail.com Mon Aug 27 13:40:10 2012 From: benjamin.guy.thomas at gmail.com (Benjamin Thomas) Date: Mon, 27 Aug 2012 12:40:10 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects Message-ID: Hi, I'm running a small email server with the help of iRedMail. I can manage sieve scripts from the Rouncube web interface or manually inside the user's personal sieve folder. I have an email account setup to receive automated tasks. Some of these "alerts" occur too often and they have the same subject line, but different senders. This is the rule I am currently using: ##CODE START## # rule:[AutoAlerts] if anyof ( header :matches "Subject" "AutoAlert Type1*", header :matches "Subject" "AutoAlert Type2*", header :matches "Subject" "AutoAlert Type3*" ) { fileinto "INBOX.AutoAlerts"; stop; } ##CODE END## I was wondering if it's possible to gracefully handle duplicate subjects lines (within a given time frame) with sieve filters ? Ideally, I would like the first email of the day with subject ""AutoAlert Type1..." to get moved to the subfolder given above. Subsequent "duplicate" emails would then go into a "duplicate" subfolder. Is this possible with sieve filters ? I could not find anything striking me as obvious while reading the page http://wiki.dovecot.org/LDA/Sieve. Thanks very much for your input. From alessio at skye.it Mon Aug 27 16:33:44 2012 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 27 Aug 2012 15:33:44 +0200 Subject: [Dovecot] Java driver for doveadm In-Reply-To: References: Message-ID: <503B7738.1040308@skye.it> Il 27/08/2012 09:01, Timo Sirainen ha scritto: > On 26.8.2012, at 18.21, Thufir wrote: > >> I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and >> there a few features I like which javax.mail just doesn't have. Is >> there maybe a Java driver for doveadm? > You can access doveadm via TCP socket. Would that be enough? > How can I configure doveadm to listen via socket? I'm developing an interface, in Ruby, to manage a mail server and could be useful. Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it From aconraz at gmail.com Mon Aug 27 16:47:12 2012 From: aconraz at gmail.com (Alano Conraz) Date: Mon, 27 Aug 2012 15:47:12 +0200 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> References: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> Message-ID: > > struct mail_user->username has it. How you get to struct mail_user depends > on where you want to access it from. Note that each process is capable of > handling multiple different users (although it's not commonly done). > i'm not sure to understand the last part. mail_user->username is a char *, right ? What is the content of the string if there is multiple users ? Thanks for your answer btw. From tss at iki.fi Mon Aug 27 16:51:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 16:51:03 +0300 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: References: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> Message-ID: On 27.8.2012, at 16.47, Alano Conraz wrote: > struct mail_user->username has it. How you get to struct mail_user depends on where you want to access it from. Note that each process is capable of handling multiple different users (although it's not commonly done). > > i'm not sure to understand the last part. mail_user->username is a char *, right ? What is the content of the string if there is multiple users ? > Thanks for your answer btw. Each user has a separate struct mail_user. I was mainly trying to say that that's the reason for why there's no global variable or such where you can get access to the username. From tss at iki.fi Mon Aug 27 16:54:28 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 16:54:28 +0300 Subject: [Dovecot] Java driver for doveadm In-Reply-To: <503B7738.1040308@skye.it> References: <503B7738.1040308@skye.it> Message-ID: <74977FCB-7525-42B5-BFFB-DF8B390871FA@iki.fi> On 27.8.2012, at 16.33, Alessio Cecchi wrote: > How can I configure doveadm to listen via socket? I'm developing an interface, in Ruby, to manage a mail server and could be useful. http://wiki2.dovecot.org/Director#Doveadm_server has an example. Now, what the protocol itself looks like isn't documented anywhere currently.. You could look at what doveadm sends when it's talking to a remote doveadm server via -s host:port parameter. Or from code see doveadm-mail-server.c:doveadm_mail_server_handle() From zucca at systemschmiede.com Mon Aug 27 18:05:52 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Mon, 27 Aug 2012 17:05:52 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: <503B8CD0.5070202@systemschmiede.com> Hi Timo, hi list I upgraded: dovecot --version 2.1.7 But still i have this ghostfolder as soon as i want to use prefix = shares/%%n/ all is good, when using prefix = shares/%%u/ Any idea what could be wrong? Thank you very much Sascha Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 Am 25.08.2012 15:06, schrieb Timo Sirainen: > It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. > > On 25.8.2012, at 15.56, Sascha Zucca wrote: > >> Hi Timo, >> dovecot --version >> 1.2.15 >> >> It's the stable one for debian squeeze i presume. >> >> Thank you for your help. >> >> Sascha >> >> >> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>> >>>> Hi List, >>>> i found out the following: >>>> The problem with the "ghostfolder" occurs only if i use >>>> >>>> prefix = shares/%%n/ >>>> >>>> When using >>>> prefix = shares/%%u/ >>>> >>>> everytung's ok! >>> What Dovecot version? >>> >>> >> >> -- >> Systemschmiede IT-L?sungen >> Zucca & Teves GbR >> August-Thyssen-Str. 2-4 >> 52511 Geilenkirchen >> www.systemschmiede.com >> >> >> Tel.: 02451 - 9088390 >> Fax: 02451 - 9124070 >> Mobil: 0178 - 4073254 >> >> Ust.ID: DE248030393 >> From pj.netfilter at gmail.com Tue Aug 28 10:47:41 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 13:17:41 +0530 Subject: [Dovecot] Help with Virtual Plugin Message-ID: Dear Experts, I have configured virtual plugin for my setup which is working as expected but after this dovecot lda is unable to deliver message to any mailbox and showing following error:- Error: user XXXXX: Initialization failed: Namespace 'virtual.': Unknown mail storage driver virtual Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to server log for more information. Here is Namespace setting on my server:- namespace { type = private separator = . prefix = inbox = yes } namespace { prefix = virtual. separator = . location = virtual:~/Maildir/virtual:LAYOUT=maildir++ } Please let me know what could be the issue.. From robert at schetterer.org Tue Aug 28 11:21:57 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 28 Aug 2012 10:21:57 +0200 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: References: Message-ID: <503C7FA5.5020400@schetterer.org> Am 28.08.2012 09:47, schrieb Joy: > Dear Experts, > I have configured virtual plugin for my setup > which is working as expected but after this dovecot lda is unable to > deliver message to any mailbox and showing following error:- > > > Error: user XXXXX: Initialization failed: Namespace 'virtual.': > Unknown mail storage driver virtual > Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to > server log for more information. > > Here is Namespace setting on my server:- > > > namespace { > type = private > separator = . > prefix = > inbox = yes > } > > namespace { > prefix = virtual. > separator = . > location = virtual:~/Maildir/virtual:LAYOUT=maildir++ > } > > > Please let me know what could be the issue.. > have you read http://wiki2.dovecot.org/Plugins/Virtual ? do you load mail_plugins = $mail_plugins virtual ? show you whole setup -- Best Regards MfG Robert Schetterer From zucca at systemschmiede.com Tue Aug 28 11:30:02 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Tue, 28 Aug 2012 10:30:02 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: <503C818A.4010203@systemschmiede.com> another update on this: I have this in my logfile: Debug: Namespace : type=shared, prefix=Freigaben/%u/, sep=/, inbox=no, hidden=yes, list=children, subscriptions=no location=maildir:/var/vmail/%d/%n/Maildir:INDEX=/var/vmail/parrotshop.de/testuser-2/Maildir/shared/%u Though this is in my dovecot.conf: prefix=Freigaben/%%u/ location=maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u How come? And does this behaviour maybe also explain the unnamed folder i have when using prefix=Freigaben/%%n/ instead of %%u ? Thanks for your assistance Sascha > > Hi Timo, hi list > I upgraded: > dovecot --version > 2.1.7 > But still i have this ghostfolder as soon as i want to use > prefix = shares/%%n/ > > all is good, when using > prefix = shares/%%u/ > > > Any idea what could be wrong? > > > Thank you very much > Sascha > > Systemschmiede IT-L?sungen > Zucca & Teves GbR > August-Thyssen-Stra?e 2-4 > 52511 Geilenkirchen > www.systemschmiede.com > > > Tel.: 02451 - 9088390 > Fax: 02451 - 9124070 > Mobil: 0178 - 4073254 > > Ust.ID: DE248030393 > > Am 25.08.2012 15:06, schrieb Timo Sirainen: >> It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. >> >> On 25.8.2012, at 15.56, Sascha Zucca wrote: >> >>> Hi Timo, >>> dovecot --version >>> 1.2.15 >>> >>> It's the stable one for debian squeeze i presume. >>> >>> Thank you for your help. >>> >>> Sascha >>> >>> >>> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>>> >>>>> Hi List, >>>>> i found out the following: >>>>> The problem with the "ghostfolder" occurs only if i use >>>>> >>>>> prefix = shares/%%n/ >>>>> >>>>> When using >>>>> prefix = shares/%%u/ >>>>> >>>>> everytung's ok! >>>> What Dovecot version? >>>> >>>> >>> >>> -- >>> Systemschmiede IT-L?sungen >>> Zucca & Teves GbR >>> August-Thyssen-Str. 2-4 >>> 52511 Geilenkirchen >>> www.systemschmiede.com >>> >>> >>> Tel.: 02451 - 9088390 >>> Fax: 02451 - 9124070 >>> Mobil: 0178 - 4073254 >>> >>> Ust.ID: DE248030393 >>> > From pj.netfilter at gmail.com Tue Aug 28 14:19:27 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 16:49:27 +0530 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: <503C7FA5.5020400@schetterer.org> References: <503C7FA5.5020400@schetterer.org> Message-ID: I have loaded the module in IMAP file as suggested in wiki. On Tue, Aug 28, 2012 at 1:51 PM, Robert Schetterer wrote: > Am 28.08.2012 09:47, schrieb Joy: >> Dear Experts, >> I have configured virtual plugin for my setup >> which is working as expected but after this dovecot lda is unable to >> deliver message to any mailbox and showing following error:- >> >> >> Error: user XXXXX: Initialization failed: Namespace 'virtual.': >> Unknown mail storage driver virtual >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to >> server log for more information. >> >> Here is Namespace setting on my server:- >> >> >> namespace { >> type = private >> separator = . >> prefix = >> inbox = yes >> } >> >> namespace { >> prefix = virtual. >> separator = . >> location = virtual:~/Maildir/virtual:LAYOUT=maildir++ >> } >> >> >> Please let me know what could be the issue.. >> > > have you read > > http://wiki2.dovecot.org/Plugins/Virtual ? > > do you load > > mail_plugins = $mail_plugins virtual ? > > show you whole setup > > -- > Best Regards > MfG Robert Schetterer From Ralf.Hildebrandt at charite.de Tue Aug 28 14:24:08 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Tue, 28 Aug 2012 13:24:08 +0200 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: References: <503C7FA5.5020400@schetterer.org> Message-ID: <20120828112408.GD14245@charite.de> * Joy : > I have loaded the module in IMAP file as suggested in wiki. But the LDA is throwing the error. Did you add it there as well? > >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to > >> server log for more information. -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From pj.netfilter at gmail.com Tue Aug 28 16:02:08 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 18:32:08 +0530 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: <20120828112408.GD14245@charite.de> References: <503C7FA5.5020400@schetterer.org> <20120828112408.GD14245@charite.de> Message-ID: Thanks .. It helped me .. On Tue, Aug 28, 2012 at 4:54 PM, Ralf Hildebrandt wrote: > * Joy : >> I have loaded the module in IMAP file as suggested in wiki. > > But the LDA is throwing the error. Did you add it there as well? > >> >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to >> >> server log for more information. > > -- > Ralf Hildebrandt > Gesch?ftsbereich IT | Abteilung Netzwerk > Charit? - Universit?tsmedizin Berlin > Campus Benjamin Franklin > Hindenburgdamm 30 | D-12203 Berlin > Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 > ralf.hildebrandt at charite.de | http://www.charite.de > From no-reply at dropboxmail.com Tue Aug 28 17:13:16 2012 From: no-reply at dropboxmail.com (Dropbox) Date: Tue, 28 Aug 2012 14:13:16 +0000 Subject: [Dovecot] Fabricio Archanjo invited you to check out Dropbox Message-ID: <20120828141316.1902FB408F2@sjc-batch3.sjc.dropbox.com> Fabricio Archanjo wants you to try Dropbox! Dropbox lets you bring all your photos, docs and videos with you anywhere and share them easily. Accept invitation here: http://www.dropbox.com/el/?r=/referrals/NjI1MTc0MTkzODc%3Fsrc%3Dreferrals_bulk9%26eh%3D597a916&b=clk:None:18425774632604476847:789:462&z=AABq5aDvAxIPiLnfMP0QGm4052ThNJIoPgpBWZ7hh8WIpA - The Dropbox Team ____________________________________________________ To stop receiving invites from Dropbox, please go to http://www.dropbox.com/bl/694ad39c033e/dovecot%40dovecot.org From no-reply at dropboxmail.com Tue Aug 28 17:14:16 2012 From: no-reply at dropboxmail.com (Dropbox) Date: Tue, 28 Aug 2012 14:14:16 +0000 Subject: [Dovecot] Fabricio Archanjo invited you to check out Dropbox Message-ID: <20120828141416.3F1F0B40545@sjc-batch3.sjc.dropbox.com> Fabricio Archanjo wants you to try Dropbox! Dropbox lets you bring all your photos, docs and videos with you anywhere and share them easily. Accept invitation here: http://www.dropbox.com/el/?r=/referrals/NjI1MTc0NDM1Mjc%3Fsrc%3Dreferrals_bulk9%26eh%3D597a916&b=clk:None:16632688623146141049:789:462&z=AABGfwc2Hx_ZSAT0TKGYP34S_535s5Wa-UF_hbzBU7FEyA - The Dropbox Team ____________________________________________________ To stop receiving invites from Dropbox, please go to http://www.dropbox.com/bl/694ad39c033e/dovecot%40dovecot.org From aconraz at gmail.com Tue Aug 28 17:38:54 2012 From: aconraz at gmail.com (Alano Conraz) Date: Tue, 28 Aug 2012 16:38:54 +0200 Subject: [Dovecot] use sieve plugin with variable and folders Message-ID: Hello , I'm trying to use the pigeonhole plugin but I'm experiencing configuration problem... Hope you could help me! Firstly : my sieve filter test is the next one : /////////////////// require ["fileinto" , "variables" , "mailbox"]; if address :matches "Delivered-To" "*@*.*" { fileinto :create ".INBOX.iop" ; stop ; } //////////////////// I get in the log the following : "error: msgid=<****>: failed to store into mailbox '.INBOX.iop': Invalid mailbox name" And the email is stored in the INBOX (implicit keep was successful) I checked that "lda_mailbox_autocreate" and "lda_mailbox_autosubscribre" are set to "yes". Then , when this problem be solved, I would like to know if it is possible with the sieve plugin to implement the following algorithm : - extract the address from the header field "Delivered-To" and set the variable $delivto to this previous value. - extract the address from the header field "To" and set the variable $to to this previous value. - compare $delivto and $to : if they are diffrent, then redirect the email in the subfolder .INBOX.iop. Thank you for any help! From ewald.lists at fun.de Tue Aug 28 17:42:13 2012 From: ewald.lists at fun.de (Ewald Dieterich) Date: Tue, 28 Aug 2012 16:42:13 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <503CD8C5.7060907@fun.de> On 08/08/12 14:23, Andre Gr?be wrote: > I am using dovecot (see dovecot -n output below) with metadata plugin in > my own plugin. I want to insert and delete some large metadata (>4KiB). > It seems, that the delete in a second call of my plugin smashes the file > dovecot.dict in users dir: That's an error in dict-file.c, file_dict_refresh(): while ((key = i_stream_read_next_line(input)) != NULL && (value = i_stream_read_next_line(input)) != NULL) { If reading the value requires reading from the stream (because the value doesn't fit into the input buffer), the key is overwritten. The attached patch duplicates the key before reading the value. -------------- next part -------------- A non-text attachment was scrubbed... Name: dict-file.c.patch Type: text/x-diff Size: 665 bytes Desc: not available URL: From stephan at rename-it.nl Tue Aug 28 18:03:41 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:03:41 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects In-Reply-To: References: Message-ID: <503CDDCD.4060407@rename-it.nl> Op 8/27/2012 12:40 PM, Benjamin Thomas schreef: > Hi, > > I was wondering if it's possible to gracefully handle duplicate subjects > lines (within a given time frame) with sieve filters ? > > Ideally, I would like the first email of the day with subject ""AutoAlert > Type1..." to get moved to the subfolder given above. Subsequent "duplicate" > emails would then go into a "duplicate" subfolder. > > Is this possible with sieve filters ? I could not find anything striking me > as obvious while reading the page http://wiki.dovecot.org/LDA/Sieve. It is currently not possible to maintain some sort of custom state information between deliveries, i.e. Sieve invocations. There is the unofficial vnd.dovecot.duplicate extension, but that uses the message-id exclusively and (currently) cannot be used to track duplicate subjects. Regards, Stephan. From benjamin.guy.thomas at gmail.com Tue Aug 28 18:07:01 2012 From: benjamin.guy.thomas at gmail.com (Benjamin Thomas) Date: Tue, 28 Aug 2012 17:07:01 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects In-Reply-To: <503CDDCD.4060407@rename-it.nl> References: <503CDDCD.4060407@rename-it.nl> Message-ID: Ok. Thanks very much for your response! 2012/8/28 Stephan Bosch > Op 8/27/2012 12:40 PM, Benjamin Thomas schreef: > >> Hi, >> >> >> I was wondering if it's possible to gracefully handle duplicate subjects >> lines (within a given time frame) with sieve filters ? >> >> Ideally, I would like the first email of the day with subject ""AutoAlert >> Type1..." to get moved to the subfolder given above. Subsequent >> "duplicate" >> emails would then go into a "duplicate" subfolder. >> >> Is this possible with sieve filters ? I could not find anything striking >> me >> as obvious while reading the page http://wiki.dovecot.org/LDA/**Sieve >> . >> > > It is currently not possible to maintain some sort of custom state > information between deliveries, i.e. Sieve invocations. There is the > unofficial vnd.dovecot.duplicate extension, but that uses the message-id > exclusively and (currently) cannot be used to track duplicate subjects. > > Regards, > > Stephan. > > > -- *Benjamin Thomas* From stephan at rename-it.nl Tue Aug 28 18:08:49 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:08:49 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: <503CDF01.5040007@rename-it.nl> Op 8/22/2012 8:56 AM, David Anderson schreef: > > Self-explanatory, I hope (note the period on the end of the username); > sieve/pigeonhole does not allow you to have senders which end with a > period, which means that any UNIX users with such usernames who send > mail have it rejected by sieve: > > # useradd testuser. > # su - testuser. > $ mail david at example.com -s 'testing' > 123 > . > [testuser. at levi ~]$ logout > > # less /var/log/maillog > > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: > envelope sender address 'testuser. at myhost.example.com' is unparsable > > Versions: > dovecot-pigeonhole-0.2.6-21.el5 > dovecot-managesieve-0.2.6-21.el5 > dovecot-2.0.18-1_134.el5 > > Why would anyone have a UNIX username ending in a period? For one, web > hosting companies may use your domain name as your username - but be > subject to a 32-character limit, so your domain name gets truncated. I would have expected to see that address escaped as "testuser."@myhost.example.com. I notice that I haven't tested such addresses much with Sieve and I don't actually know in what form MTAs provide such addresses to the LDA. I'll give that a look soon. Regards, Stephan. From stephan at rename-it.nl Tue Aug 28 18:25:54 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:25:54 +0200 Subject: [Dovecot] use sieve plugin with variable and folders In-Reply-To: References: Message-ID: <503CE302.4060506@rename-it.nl> Op 8/28/2012 4:38 PM, Alano Conraz schreef: > Hello , > > I'm trying to use the pigeonhole plugin but I'm experiencing configuration > problem... Hope you could help me! > > Firstly : > my sieve filter test is the next one : > /////////////////// > require ["fileinto" , "variables" , "mailbox"]; > > if address :matches "Delivered-To" "*@*.*" { > fileinto :create ".INBOX.iop" ; stop ; > } > //////////////////// > > I get in the log the following : "error: msgid=<****>: failed to store into > mailbox '.INBOX.iop': Invalid mailbox name" > And the email is stored in the INBOX (implicit keep was successful) > I checked that "lda_mailbox_autocreate" and "lda_mailbox_autosubscribre" > are set to "yes". Mailbox name should probably not start with a '.'. I'm assuming it is a maildir storage. The physical mailbox directories in that maildir have a '.' prefix, but the actual mailbox name does not: it should be 'INBOX.iop'. > Then , when this problem be solved, I would like to know if it is possible > with the sieve plugin to implement the following algorithm : > - extract the address from the header field "Delivered-To" and set the > variable $delivto to this previous value. > - extract the address from the header field "To" and set the variable > $to to this previous value. > - compare $delivto and $to : if they are diffrent, then redirect the > email in the subfolder .INBOX.iop. > > > Thank you for any help! Something like this: require ["fileinto", "variables", "mailbox"]; if address :matches "delivered-to" "*" { set "delivto" "${1}"; } if address :matches "to" "*" { set "to" "${1}"; } if not string "${delivto}" "${to}" { fileinto :create "INBOX.iop"; stop; } For reference you can read RFC5229 (http://tools.ietf.org/html/rfc5229). Regards, Stephan. From tss at iki.fi Tue Aug 28 18:48:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 18:48:49 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: On 22.8.2012, at 9.56, David Anderson wrote: > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: envelope sender address 'testuser. at myhost.example.com' is unparsable Also is this really rejecting the mail?.. When I looked at it I thought it would simply replace the sender with empty string. From tss at iki.fi Tue Aug 28 18:54:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 18:54:03 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <503CD8C5.7060907@fun.de> References: <50225A24.4010109@fun.de> <503CD8C5.7060907@fun.de> Message-ID: <48AB63AB-A4CF-4B99-AF71-91966896C202@iki.fi> On 28.8.2012, at 17.42, Ewald Dieterich wrote: > On 08/08/12 14:23, Andre Gr?be wrote: >> I am using dovecot (see dovecot -n output below) with metadata plugin in >> my own plugin. I want to insert and delete some large metadata (>4KiB). >> It seems, that the delete in a second call of my plugin smashes the file >> dovecot.dict in users dir: > > That's an error in dict-file.c, file_dict_refresh(): > > while ((key = i_stream_read_next_line(input)) != NULL && > (value = i_stream_read_next_line(input)) != NULL) { > > If reading the value requires reading from the stream (because the value doesn't fit into the input buffer), the key is overwritten. The attached patch duplicates the key before reading the value. Committed: http://hg.dovecot.org/dovecot-2.1/rev/6e53209030f6 From tss at iki.fi Tue Aug 28 19:12:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 19:12:16 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <20120825232833.GA11297@daniel.localdomain> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> <20120825232833.GA11297@daniel.localdomain> Message-ID: On 26.8.2012, at 2.28, Daniel Parthey wrote: > What would the configuration look like if I want to setup > one lmtp service with quota enforcing on port 10024 and > another lmtp service without enforcing on port 20024? > Especially how to define two "protocol lmtp" sections > which are assigned to their specific service? You can't. (Maybe you could create another service lmtp2 {} block and override the quota setting with lmtp -o plugin/quota=.. parameter, but I don't know if that would work.) > or will I need to define SQL statements in the userdb > lookup which selects "noenforcing" depending on local port? That would work. From mgc_dovecot at chamberlain.net.au Wed Aug 29 04:07:11 2012 From: mgc_dovecot at chamberlain.net.au (mgc_dovecot at chamberlain.net.au) Date: Wed, 29 Aug 2012 11:07:11 +1000 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: References: <50375D3E.50409@googlemail.com> Message-ID: <503D6B3F.4040004@chamberlain.net.au> On 27/08/2012 5:03 PM, Timo Sirainen wrote: > On 24.8.2012, at 13.53, Tim Smith wrote: > >> Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! > Other than the bandwidth others already mentioned, the only reason it could be Dovecot's fault is exactly the size of the Sent mailbox. How large is that and what mailbox format are you using? > I missed the original message, but if your users are using Thunderbird I've seen slow sending of email be caused by a large number of temporary files being created by Thunderbird (it doesn't clean up properly), and so when it goes to create a new temporary file it goes very slowly - it may be worth checking the users mailboxes to see if they have a large number of temporary files with a similar name but different number (I forget the name, sorry - it might start with something like "nsmail", but may not). Stop Thunderbird, clear out the temporary files, and sending becomes much faster (if this is the cause of the problem). Regards, Michael. From dmalolepszy at optusnet.com.au Wed Aug 29 05:14:47 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Wed, 29 Aug 2012 12:14:47 +1000 Subject: [Dovecot] Dovecot Director Output buffer full Message-ID: <503D7B17.9020308@optusnet.com.au> Hi, I have been seeing the following messages in logs on all my Dovecot servers each running both a dovecot-director instance and a dovecot pop3/imap backend. These logs appear to relate to problems with the director. Aug 28 16:09:52 dovecot01 dovecot: director: Error: director(10.0.0.2:9090/right): Output buffer full, disconnecting Aug 28 16:10:01 dovecot01 dovecot: director: Error: Ring SYNC appears to have got lost, resending Aug 28 16:10:02 dovecot01 dovecot: director: Error: Director 10.0.0.2:9090/right disconnected Aug 28 16:09:51 dovecot02 dovecot: director: Error: director(10.0.0.3:9090/right): Output buffer full, disconnecting Aug 28 16:09:57 dovecot02 dovecot: director: Error: Ring SYNC appears to have got lost, resending Aug 28 16:10:01 dovecot02 dovecot: director: Error: Director 10.0.0.3:9090/right disconnected Aug 28 16:10:02 dovecot02 dovecot: director: Error: director(10.0.0.1:9090/left): Ping timed out, disconnecting Aug 28 16:13:15 dovecot02 dovecot: director: Warning: Delaying new user requests until ring is synced Note dovecot01 has IP 10.0.0.1 and dovecot02 has IP 10.0.0.2 and so on. This seems to show up when I enable the poolmon script (https://github.com/brandond/poolmon) on all the servers, and all servers start simultaneous logins to each others Dovecot backends. I did notice that the poolmon script has been flapping vhost weights a lot (I am looking at making the script handle transient errors better), which means that it is connecting to the dovecot-director socket every few minutes and changing vhost weights from 100 to 0 and vice-versa. Is there some sort of limit in the Dovecot Director that is being exceeded that should be tweaked? # 2.1.5: /etc/dovecot-director/dovecot.conf # OS: Linux 2.6.32-279.el6.mccqfix.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.3 (Santiago) auth_cache_size = 100 M auth_default_realm = example.com auth_failure_delay = 5 secs auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 auth_worker_max_count = 600 base_dir = /var/run/dovecot-director/ director_mail_servers = 10.0.0.1 10.0.0.2 10.0.0.3 10.0.0.4 10.0.0.5 director_servers = 10.0.0.1 10.0.0.2 10.0.0.3 10.0.0.4 10.0.0.5 disable_plaintext_auth = no instance_name = dovecot-dir passdb { args = /etc/dovecot-director/dovecot-sql.conf driver = sql } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 10.0.0.1 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { address = 10.0.0.1 port = 143 } inet_listener imaps { address = 10.0.0.1 port = 993 ssl = yes } process_min_avail = 100 } service pop3-login { executable = pop3-login director inet_listener pop3 { address = 10.0.0.1 port = 110 } inet_listener pop3s { address = 10.0.0.1 port = 995 ssl = yes } process_min_avail = 100 } verbose_proctitle = yes From zucca at systemschmiede.com Wed Aug 29 12:37:29 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 29 Aug 2012 11:37:29 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503C818A.4010203@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> Message-ID: <503DE2D9.3080300@systemschmiede.com> Hi all. Sorry, but i can't believe noone has a hint on this one. I guess it's just some stupid detail i am missing. dovecot --version 2.1.7 If in the shared folders part of dovecot.conf i use: *prefix = Freigaben/%%n/ * Then in the subscription menu (and later in shared Folder too) i see http://s9.postimage.org/6aohh97ov/iehadjhb.jpg (Open-Xchange-GUI) http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) all is good, when using *prefix = Freigaben/%%u/ * only the name is very longish then, so i'd really prefer "n". Please help me. Thank you very much Sascha Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 Am 28.08.2012 10:30, schrieb Sascha Zucca: > another update on this: > > I have this in my logfile: > Debug: Namespace : type=shared, prefix=Freigaben/%u/, sep=/, inbox=no, > hidden=yes, list=children, subscriptions=no > location=maildir:/var/vmail/%d/%n/Maildir:INDEX=/var/vmail/parrotshop.de/testuser-2/Maildir/shared/%u > > Though this is in my dovecot.conf: > > prefix=Freigaben/%%u/ > location=maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u > > > How come? And does this behaviour maybe also explain the unnamed > folder i have when using prefix=Freigaben/%%n/ instead of %%u ? > > Thanks for your assistance > Sascha > > >> >> Hi Timo, hi list >> I upgraded: >> dovecot --version >> 2.1.7 >> But still i have this ghostfolder as soon as i want to use >> prefix = shares/%%n/ >> >> all is good, when using >> prefix = shares/%%u/ >> >> >> Any idea what could be wrong? >> >> >> Thank you very much >> Sascha >> >> Systemschmiede IT-L?sungen >> Zucca & Teves GbR >> August-Thyssen-Stra?e 2-4 >> 52511 Geilenkirchen >> www.systemschmiede.com >> >> >> Tel.: 02451 - 9088390 >> Fax: 02451 - 9124070 >> Mobil: 0178 - 4073254 >> >> Ust.ID: DE248030393 >> >> Am 25.08.2012 15:06, schrieb Timo Sirainen: >>> It's very likely that this has been fixed in v2.1. And in any case >>> I'm not fixing non-security bugs anymore for v1.x. You can find v2.x >>> debian packages from backports.org. >>> >>> On 25.8.2012, at 15.56, Sascha Zucca wrote: >>> >>>> Hi Timo, >>>> dovecot --version >>>> 1.2.15 >>>> >>>> It's the stable one for debian squeeze i presume. >>>> >>>> Thank you for your help. >>>> >>>> Sascha >>>> >>>> >>>> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>>>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>>>> >>>>>> Hi List, >>>>>> i found out the following: >>>>>> The problem with the "ghostfolder" occurs only if i use >>>>>> >>>>>> prefix = shares/%%n/ >>>>>> >>>>>> When using >>>>>> prefix = shares/%%u/ >>>>>> >>>>>> everytung's ok! >>>>> What Dovecot version? >>>>> >>>>> >>>> >>>> -- >>>> Systemschmiede IT-L?sungen >>>> Zucca & Teves GbR >>>> August-Thyssen-Str. 2-4 >>>> 52511 Geilenkirchen >>>> www.systemschmiede.com >>>> >>>> >>>> Tel.: 02451 - 9088390 >>>> Fax: 02451 - 9124070 >>>> Mobil: 0178 - 4073254 >>>> >>>> Ust.ID: DE248030393 >>>> >> From rrosenfeld at netcologne.de Wed Aug 29 15:44:47 2012 From: rrosenfeld at netcologne.de (Roland Rosenfeld) Date: Wed, 29 Aug 2012 14:44:47 +0200 Subject: [Dovecot] ACL MySQL dict: to_user==from_user entries Message-ID: <20120829124447.GA16592@sys-241.netcologne.de> Hi! We run dovecot 2.1.6 with ACL support and MySQL dict for shared/shared-boxes/user/$to/$from. When a user does a SETACL (via IMAP) to himself he is added as $to and $from to the MySQL dict. Se for example this IMAP conversation: 5 GETACL INBOX * ACL "INBOX" "user at domain" lrwstipekxacd 5 OK Getacl completed. 6 SETACL INBOX user at domain lrwstipekxacd 6 OK Setacl complete. 7 GETACL INBOX * ACL "INBOX" "user at domain" akxeilprwtscd 7 OK Getacl completed. As you can see, user at domain sets the ACL of his INBOX to the same value it was set before (reading it from the server after this idempotent write changed the order but none of the flags). But after "SETACL INBOX user at domain lrwstipekxacd" I see a new entry in my imap_acl_shares table where to_user and from_user both contain the value "user at domain". As far as I can see, this entry does not make much sense in the database, because every user should be able so see its own folders. But adding this line may blow up the database especially according to the full table scan problem for acl dict rebuild mentioned in http://www.dovecot.org/list/dovecot/2012-August/067548.html. Does it make sense to run a daily cron job, that removes all entries with from_user=to_user or may this cause other inconsistencies? If you need to have a look at my complete setup, it's in http://www.dovecot.org/list/dovecot/2012-July/067130.html, so I don't have to clone this here. Tschoeeee Roland From giles at coochey.net Wed Aug 29 18:10:02 2012 From: giles at coochey.net (Giles Coochey) Date: Wed, 29 Aug 2012 16:10:02 +0100 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <503E30CA.7010007@coochey.net> On 23/08/2012 21:49, Timo Sirainen wrote: > On 23.8.2012, at 23.26, Warren Baker wrote: > >> On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >>> On 14.8.2012, at 11.18, Timo Sirainen wrote: >>> >>> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). > I specifically use 172.16.0.0/12 because others don't, I also specifically don't use 172.16.0.0/16, because if someone does use 172.16.0.0/12 they usually only use 172.16.0.0/16... It's easy for people to connect to my networks via a VPN connection, and generally not have any IP conflicts with their own RFC1918 ranges and not have to fiddle with NAT issues. -- Regards, Giles Coochey, CCNA, CCNAS NetSecSpec Ltd +44 (0) 7983 877438 http://www.coochey.net http://www.netsecspec.co.uk giles at coochey.net -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4968 bytes Desc: S/MIME Cryptographic Signature URL: From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 29 23:48:14 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 29 Aug 2012 22:48:14 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503DE2D9.3080300@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> Message-ID: <20120829204814.GA9265@daniel.localdomain> Hi Sascha, Sascha Zucca wrote: > Sorry, but i can't believe noone has a hint on this one. Sorry, but you forgot to post your complete doveconf -n output and how to exactly reproduce this. > http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) I'm getting the same result when SIEVE sorts Messages into autocreated subfolders inside of folders which do not exist. So it's probably not a ghost folder, it is just an intermediate folder which does not exist itself, but contains existing subfolders. This forces your mail client to display the folder in the tree: INBOX exists (black) INBOX/foo does not exist (grey) INBOX/foo/bar exists (black) HTH and Regards Daniel -- https://plus.google.com/103021802792276734820 From kgc at corp.sonic.net Thu Aug 30 00:47:00 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Wed, 29 Aug 2012 14:47:00 -0700 Subject: [Dovecot] FS Quotas, what am I doing wrong? Message-ID: <20120829214700.GN13924@corp.sonic.net> I'm not able to get the FS quota module to behave as I expect. Depsite having function fs quotas and dovecot apparently configured to use then, the quotas appear to be empty and/or not configured. Any clues? # quota kgc Disk quotas for user kgc (uid 500): Filesystem blocks quota limit grace files quota limit grace /dev/sda3 1229460 7000000 8000000 103776 5000000 6000000 # doveadm quota get -u kgc Quota name Type Value Limit % User user STORAGE 0 - 0 User user MESSAGE 0 - 0 # telnet 0 143 ... A003 GETQUOTAROOT INBOX <- Not sure this is correct A003 OK No quota. imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=6048, secured, session=<1CGqXm7IhwB/AAAB> imap: Debug: Loading modules from directory: /usr/lib64/dovecot imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so imap(kgc): Debug: Effective uid=500, gid=501, home=/home/kgc imap(kgc): Debug: Quota root: name=User user backend=fs args=inode_per_mail:noenforcing imap(kgc): Debug: maildir++: root=/home/kgc/Maildir, index=, control=, inbox=/home/kgc/Maildir, alt= imap(kgc): Debug: fs quota add mailbox dir = /home/kgc/Maildir imap(kgc): Debug: fs quota block device = /dev/sda3 imap(kgc): Debug: fs quota mount point = / imap(kgc): Debug: fs quota mount type = ext4 # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.5.1.el6.x86_64 x86_64 Scientific Linux release 6.0 (Carbon) mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = quota mbox_write_locks = fcntl passdb { driver = pam } plugin { quota = fs:User user:inode_per_mail:noenforcing } ssl_cert = References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> Message-ID: <503F0B77.5030206@systemschmiede.com> Hi! I am very sorry, i thought i had done so before. Well here ist is: dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-14-pve i686 Debian 6.0.5 simfs auth_mechanisms = plain login disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/var/vmail/%%d/%%n/Maildir mail_plugins = acl mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = children location = maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u prefix = Freigaben/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db quota = dict:user::file:/var/vmail/%d/%n/.quotausage sieve = /var/vmail/%d/%n/.sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } ssl_cert = Hi Sascha, > > Sascha Zucca wrote: >> Sorry, but i can't believe noone has a hint on this one. > Sorry, but you forgot to post your complete doveconf -n output > and how to exactly reproduce this. > >> http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) > I'm getting the same result when SIEVE sorts Messages into autocreated > subfolders inside of folders which do not exist. So it's probably > not a ghost folder, it is just an intermediate folder > which does not exist itself, but contains existing subfolders. > > This forces your mail client to display the folder in the tree: > > INBOX exists (black) > INBOX/foo does not exist (grey) > INBOX/foo/bar exists (black) > > HTH and Regards > Daniel -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From lists at wiesinger.com Thu Aug 30 21:34:36 2012 From: lists at wiesinger.com (Gerhard Wiesinger) Date: Thu, 30 Aug 2012 20:34:36 +0200 Subject: [Dovecot] deliver doesn't update cache index with mbox Message-ID: <503FB23C.5040309@wiesinger.com> Hello Timo, I'm having a problem with mbox that opening folder is slow when new mails are delivered to a folder. I'm delivering through the deliver program. Deliver updates index files but IHMO not completely correct. Therefore I compared index files before and after: 1.) Just delivered 2.) After accessing through imap via Thunderbird diff looks like (stripped down to the relevant things): INDEX: -first recent uid ......... = 25847 +first recent uid ......... = 25848 -log file tail offset ..... = 16468 -log file head offset ..... = 16468 +log file tail offset ..... = 16828 +log file head offset ..... = 16828 - - sync_mtime . = 2012-08-30 19:38:05 + - sync_mtime . = 2012-08-30 20:09:23 - - dirty_flag . = 1 + - dirty_flag . = 0 - - highest_modseq = 11162 + - highest_modseq = 11163 - - log_offset ... = 16468 + - log_offset ... = 16828 CACHE: -used_file_size ....... = 6385696 +used_file_size ....... = 6392132 RECORD: seq=25663, uid=25835, flags=0x00 - - ext 0 keywords : (0000) - - ext 1 modseq : 11156 (942b000000000000) + - ext 0 keywords : (0100) + - ext 1 modseq : 11163 (9b2b000000000000) - ext 2 mbox : 42923286 (16f58e0200000000) - - ext 3 cache : 0 (00000000) + - ext 3 cache : 6385696 (20706100) - ext 4 header-md5: (00000000000000000000000000000000) + - cache offset=6385696 size=488, prev_offset = 0 + - hdr.BCC: + - hdr.CC: + - hdr.CONTENT-TYPE: 18: Content-Type: text/plain; charset=us-ascii + - hdr.DATE: 13: Date: Thu, 30 Aug 2012 19:37:24 +0200 + - size.virtual: 1081 (3904000000000000) Same patterns from record: 25664-25675 What does dirty_flag=1 mean? Why are the cache headers missing and not written by deliver? Any ideas? Config is below. Thank you. Ciao, Gerhard # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux listen = * mail_full_filesystem_access = yes mail_location = mbox:~:INBOX=/var/mail/%u mbox_lazy_writes = no mbox_write_locks = fcntl passdb { driver = pam } postmaster_address = postmaster at domain protocols = imap service auth { unix_listener auth-userdb { group = users mode = 0660 } } service imap-login { inet_listener imap { port = 0 } } service imap { executable = imap postlogin } service postlogin { executable = script-login -d rawlog } ssl_cert = Hello, So I am trying to construct mail path for my LDAP user lookups, and i need to use two attributes instead of one. For examle, my LDAP directory has two attributes: departmentAttr and userIDAttr, and I want the maildir to reside in /home/${departmentAttr}/${userIDAttr} Unfortunately, I cannot seem to find a way to configure dovecot this way. Right now, I have something like user_attrs = departmentAttr=mail=maildir:/home/%$/%u But %u is the username (which in my environment can easily change, so I cannot use this for maildir location). Any ideas on how to achieve that? So far I have just one brute-force solution - to create an attribute MailDirAttr, and populate it with concatenation of departmentAttr+'/'+userIDAttr by means of a scheduled task. This sounds like unnecessary information duplication, which is usually a very bad practice. So, again - any ideas? Thank you, Anatoly. From adi at ddns.com.au Fri Aug 31 05:51:20 2012 From: adi at ddns.com.au (Adi Pircalabu) Date: Fri, 31 Aug 2012 12:51:20 +1000 Subject: [Dovecot] [Postfix] SASL Auth. using Dovecot with password forwarding proxy configuration Message-ID: <20120831125120.37a3f7cf@adi.ddns.local> Hi, I'm relatively new to Dovecot and I did a bit of search but couldn't find a possible solution for the particular setup I'm working on. Basically I have an SMTP/POP/IMAP proxy setup running Postfix & Dovecot. IMAP/POP authentication is done using the password proxy feature, where the login credentials are passed to the backend server after a db lookup, which does the actual authentication. The POP/IMAP part is working fine. What I'm trying to do is to use Dovecot SASL implementation in Postfix to do SMTP authentication in a similar manner. The problem I have with my current configuration is that SMTP authentication succeeds if only the username matches, because password forwarding works if the authentication succeeds with any given password, as documented at http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy My question is, given the above: is there a way to get SMTP authentication properly in this scenario? The way I see it now, Dovecot SASL accepting the login if only the user matches isn't quite "complete", the auth process should go further and authenticate against the backend server, same as for POP/IMAP connections. Does this requirement make any sense? Maybe I'm missing something in Dovecot configuration to get the SMTP authentication work in password forwarding mode, few pointers will be highly appreciated. PopBSMTP is not an sensible alternative in my case. Here's my configuration, plus some dovecot auth_debug log entries. As you can see, SMTP authentication succeeds with any given password. ---Dovecot--- dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.centos.plus.x86_64 x86_64 CentOS release 6.3 (Final) auth_cache_size = 4 k auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_ca = , method=PLAIN, rip=192.168.1.56, lip=192.168.1.222, TLS [...] (SMTP connection) Aug 31 11:36:14 centos6 postfix/smtpd[11213]: connect from unknown[192.168.1.200] Aug 31 11:36:14 centos6 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: auth client connected (pid=11213) Aug 31 11:36:14 centos6 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=smtp#011nologin#011lip=192.168.1.222#011rip=192.168.1.200#011resp=AGFAMGFkaXRlc3QubmV0AGFzZA== Aug 31 11:36:14 centos6 dovecot: auth: Debug: cache(a at 0aditest.net,192.168.1.200): miss Aug 31 11:36:14 centos6 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 31 11:36:14 centos6 dovecot: auth: mysql: Connected to /var/lib/mysql/mysql.sock (postfix) Aug 31 11:36:14 centos6 dovecot: auth: Debug: sql(a at 0aditest.net,192.168.1.200): query: SELECT NULL AS password, 'Y' as nopassword, host, email, 'Y' AS proxy FROM mailbox WHERE email = 'a at 0aditest.net' Aug 31 11:36:14 centos6 dovecot: auth: Debug: client out: OK#0111#011user=a at 0aditest.net#011host=203.63.79.87#011email=a at 0aditest.net#011proxy#011pass=anygivenpassword Aug 31 11:36:14 centos6 postfix/smtpd[11213]: C9620600A9: client=unknown[192.168.1.200], sasl_method=PLAIN, sasl_username=a at 0aditest.net Aug 31 11:36:14 centos6 postfix/cleanup[11219]: C9620600A9: message-id=<20120831113614.72ed32df at adi.ddns.local> [...] ---/var/log/maillog--- -- Adi Pircalabu From amateo at um.es Fri Aug 31 09:43:58 2012 From: amateo at um.es (Angel L. Mateo) Date: Fri, 31 Aug 2012 08:43:58 +0200 Subject: [Dovecot] doveadm commands returning 139 at director servers In-Reply-To: <503B4CAD.6090908@um.es> References: <503B4CAD.6090908@um.es> Message-ID: <50405D2E.6000902@um.es> El 27/08/12 12:32, Angel L. Mateo escribi?: > Hello, > > I have configured director in front of dovecot imap/pop/lmtp > servers. When I need to manipulate a user mailbox, I use doveadm > commands at director server's, with -S option. But some commands return > exit code 139 when command returns more than 40 entries (I think). > > For example, the command: > > sudo doveadm fetch -u amateo hdr mailbox Trash HEADER Subject > "nyctalus11/" > > executed at the backend server returns 952 mails, but executed at > director server with -S option, returns only 40 mails and exit code 139. > > I'm using dovecot 2.1.5 and I attached doveconf -n at director and > backend servers. > Updating from 2.1.5 to 2.1.5 has fixed the problem. From linuxmail at 4lin.net Fri Aug 31 10:55:16 2012 From: linuxmail at 4lin.net (Denny Schierz) Date: Fri, 31 Aug 2012 09:55:16 +0200 Subject: [Dovecot] mail_location / mail_home Message-ID: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> hi, I had a long (upgraded today from 2.0.17 to 2.1.9) time mail_location and mail_home at the same path, which I recognize know, that it wasn't a good idea, idea. On my testsystem I've set: mail_home = /imap/spool/%d/%1u/%u mail_location = maildir:~/:INDEX=~/ otherwise I don't have access to the mails anymore. Is that ok? cu denny From linuxmail at 4lin.net Fri Aug 31 11:15:33 2012 From: linuxmail at 4lin.net (Denny Schierz) Date: Fri, 31 Aug 2012 10:15:33 +0200 Subject: [Dovecot] mail_location / mail_home In-Reply-To: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> References: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> Message-ID: <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> Am 31.08.2012 um 09:55 schrieb Denny Schierz: > > mail_home = /imap/spool/%d/%1u/%u > mail_location = maildir:~/:INDEX=~/ I think, it doesn't make any difference, if I have "~" or a fixed path :-/ On the productive system (also 2.1.9) I get messages like: [...] dovecot.lda-dupes/tmp) failed: Not a directory [...] So, I need a way, to move ~11.000 Maildirs .... any suggestions? From zucca at systemschmiede.com Fri Aug 31 11:16:58 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 10:16:58 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503F0B77.5030206@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> Message-ID: <504072FA.8020606@systemschmiede.com> Hi! Still noone? strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. Anyways, thanks for any help Sascha Am 30.08.2012 08:43, schrieb Sascha Zucca: > Hi! > I am very sorry, i thought i had done so before. Well here ist is: > > > dovecot -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-14-pve i686 Debian 6.0.5 simfs > auth_mechanisms = plain login > disable_plaintext_auth = no > log_timestamp = "%Y-%m-%d %H:%M:%S " > mail_location = maildir:/var/vmail/%%d/%%n/Maildir > mail_plugins = acl > mail_privileged_group = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > namespace { > inbox = yes > location = > prefix = > separator = / > type = private > } > namespace { > hidden = yes > list = children > location = > maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u > prefix = Freigaben/%%n/ > separator = / > subscriptions = no > type = shared > } > passdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > plugin { > acl = vfile > acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db > quota = dict:user::file:/var/vmail/%d/%n/.quotausage > sieve = /var/vmail/%d/%n/.sieve > } > protocols = imap pop3 sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > user = root > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > protocol pop3 { > mail_plugins = quota > pop3_uidl_format = %08Xu%08Xv > } > protocol lda { > mail_plugins = sieve quota > } > protocol imap { > mail_plugins = quota imap_quota acl imap_acl > } > > > I don't really think, it has anything to do with sieve, as the folder > simply won't show up as soo as i just change prefix = Freigaben/%%n/ > to prefix = Freigaben/%%u/. > And i didn't filter into autocreated folders yet. For now, i created > only one sieve rule, that filters into an folder i created manually. > > > Thank you very much for your help > Sascha > > > > Am 29.08.2012 22:48, schrieb Daniel Parthey: >> Hi Sascha, >> >> Sascha Zucca wrote: >>> Sorry, but i can't believe noone has a hint on this one. >> Sorry, but you forgot to post your complete doveconf -n output >> and how to exactly reproduce this. >> >>> http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) >> I'm getting the same result when SIEVE sorts Messages into autocreated >> subfolders inside of folders which do not exist. So it's probably >> not a ghost folder, it is just an intermediate folder >> which does not exist itself, but contains existing subfolders. >> >> This forces your mail client to display the folder in the tree: >> >> INBOX exists (black) >> INBOX/foo does not exist (grey) >> INBOX/foo/bar exists (black) >> >> HTH and Regards >> Daniel > > From Jost.Krieger+dovecot at rub.de Fri Aug 31 11:42:34 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 31 Aug 2012 10:42:34 +0200 Subject: [Dovecot] Possible mbox corruption if mail is saved with wrong Content-Length header (2.1.6) Message-ID: <20120831084233.GE3002@ruhr-uni-bochum.de> One of our users likes to delete attachments from his mails. He is using roundcube and we installed a plugin for that. He reports that from time to time one of his mails gets corrupted (cut off in the middle). I could verify there is something wrong in the logs: imap(x1234567): Error: Cached message size larger than expected (6796 > 2844) imap(x1234567): Error: Corrupted index cache file /net/mbx3/disc2/home/85/x1234567/Index/.imap/Sent/dovecot.index.cache: Broken physical size for mail UID 5001 imap(x1234567): Error: read(/net/mbx3/disc2/home/85/x1234567/Mail/Sent) failed: Input/output error (FETCH for mailbox Sent UID 5001) imap(x1234567): Info: Disconnected: Internal error occurred. Refer to server log for more information. [2012-08-23 00:00:49] in=1124145 out=1324791 I had a look at the plugin and it works by duplicating the message and leaving out the attachment(s). The headers are also duplicated, including Content-Length. I've fixed that in the plugin, (don't know yet if it helps), but I think it shouldn't cause such breakage in dovecot. # doveconf -n # 2.1.6: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-103.ELsmp i686 Red Hat Enterprise Linux AS release 4 (Nahant Update 9) doveconf: Warning: Dovecot was last started using /usr/local/dovecot/etc/dovecot.conf, but this config is /usr/local/dovecot/etc/dovecot/dovecot.conf auth_master_user_separator = * disable_plaintext_auth = no doveadm_password = (hidden) lda_mailbox_autocreate = yes log_path = /dev/stderr log_timestamp = mail_location = mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/Index mail_plugins = " quota zlib mail_log notify virtual" mdbox_rotate_size = 5 M namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes inbox = no list = children location = maildir:~/Maildir prefix = "#MD/" separator = / type = private } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { acl = vfile mail_log_events = undelete mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = fs:Disk quota } protocols = pop3 imap service auth { client_limit = 4300 user = root } service doveadm { inet_listener { port = 542 } } service imap-login { inet_listener imap { address = 134.147.64.42 port = 143 } service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 4096 vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = 134.147.64.42 port = 110 } service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } ssl = no userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota zlib mail_log notify virtual imap_quota imap_zlib" } Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From Ralf.Hildebrandt at charite.de Fri Aug 31 13:01:06 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 31 Aug 2012 12:01:06 +0200 Subject: [Dovecot] Merge multiple doveadm commands Message-ID: <20120831100106.GU23678@charite.de> Can I merge these three commands into one? doveadm expunge -u %s mailbox \"INBOX.Deleted Messages\" NOT NEW doveadm expunge -u %s mailbox INBOX.Trash NOT NEW doveadm expunge -u %s mailbox INBOX deleted -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From tss at iki.fi Fri Aug 31 13:04:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 13:04:09 +0300 Subject: [Dovecot] Merge multiple doveadm commands In-Reply-To: <20120831100106.GU23678@charite.de> References: <20120831100106.GU23678@charite.de> Message-ID: <1000E259-87A8-44CE-BFA4-55F925FDF68F@iki.fi> On 31.8.2012, at 13.01, Ralf Hildebrandt wrote: > Can I merge these three commands into one? > > doveadm expunge -u %s mailbox \"INBOX.Deleted Messages\" NOT NEW > doveadm expunge -u %s mailbox INBOX.Trash NOT NEW > doveadm expunge -u %s mailbox INBOX deleted doveadm expunge -u %s \( mailbox \"INBOX.Deleted Messages\" NOT NEW \) or \( mailbox INBOX.Trash NOT NEW \) or \( mailbox INBOX deleted \) (Does "new" actually work? I'm not sure if that's intentional, or simply a side effect of some IMAP behavior accidentally spilling over.. :) From Hauke.Fuhrmann at funkwerk-it.com Fri Aug 31 15:27:40 2012 From: Hauke.Fuhrmann at funkwerk-it.com (Fuhrmann, Hauke) Date: Fri, 31 Aug 2012 14:27:40 +0200 Subject: [Dovecot] Length of attachment filenames Message-ID: Hi there, I have a beginners question to Dovecot: does it have a restriction on the supported length and character encodings of filenames of attachments? Can filenames be arbitrary large? Cheers, Hauke -- Diese E-Mail kann vertrauliche und/oder rechtlich geschuetzte Informationen enthalten. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtuemlich erhalten haben, informieren Sie bitte sofort den Absender durch eine Antwortmail und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. Wir danken fuer Ihre Kooperation. This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error, you are on notice of its status. Please notify the sender immediately by reply e-mail and delete this e-mail from your systems. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly prohibited. Thank you for your cooperation. From tss at iki.fi Fri Aug 31 16:10:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:10:14 +0300 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: <50334A72.2020908@integrafin.co.uk> References: <503255FA.9080300@integrafin.co.uk> <50334A72.2020908@integrafin.co.uk> Message-ID: <9D363A6A-454B-484B-B7C1-7745DCF30B2C@iki.fi> On 21.8.2012, at 11.44, Alex Crow wrote: > To clarify, what happens in these case with regard to the default mail_location set in the config files (ie is it used or overridden): > > 1. The LDAP attribute referenced in the userdb lookup exists but is empty The value will be overridden as empty, which could be an error. > 2. The LDAP attribute is not present for the user. The value isn't overridden. From tss at iki.fi Fri Aug 31 16:19:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:19:38 +0300 Subject: [Dovecot] segfault in mail_user_get_home() In-Reply-To: References: Message-ID: <384C6524-721B-4700-A550-EFEB897A8B24@iki.fi> I couldn't reproduce it with your config, but I figured out the cause of it anyway. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/6b9db780b47d On 21.8.2012, at 15.45, Lazy wrote: > it was shared namespace with empty location that produced the error > so : > namespace test { > list = children > location = > prefix = test. > subscriptions = yes > type = shared > } > > segfaults > > with location is fine > > > > 2012/8/21, Lazy : >> gdb ./src/imap/.libs/imap >> >> Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. >> (gdb) run >> Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap >> warning: no loadable sections found in added symbol-file >> system-supplied DSO at 0x7ffff7ffa000 >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> process 1104 is executing new program: /usr/local/dovecot/bin/doveconf >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> process 1104 is executing new program: >> /usr/src/dovecot-2.1.9/src/imap/.libs/imap >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> >> Program received signal SIGSEGV, Segmentation fault. >> 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, >> home_r=0x7fffffffe308) at mail-user.c:310 >> 310 if (user->home_looked_up) { >> (gdb) bt >> #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, >> home_r=0x7fffffffe308) at mail-user.c:310 >> #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at >> mdbox-storage.c:90 >> #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, >> set=0x7fffffffe4d0) at mdbox-storage.c:113 >> #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, >> set=0x7fffffffe4d0) at mail-storage.c:105 >> #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, >> driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) >> at mail-storage.c:180 >> #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, >> driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 >> #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, >> ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, >> ns_p=0x645380, >> error_r=0x7fffffffe6e8) at mail-namespace.c:126 >> #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, >> error_r=0x7fffffffe6e8) at mail-namespace.c:289 >> #8 0x00007ffff7b34a64 in mail_storage_service_init_post >> (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, >> mail_user_r=0x7fffffffe7b8, >> error_r=0x7fffffffe6e8) at mail-storage-service.c:641 >> #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, >> user=0x633e08, mail_user_r=0x7fffffffe7b8) at >> mail-storage-service.c:1114 >> #10 0x00007ffff7b35efa in mail_storage_service_lookup_next >> (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, >> mail_user_r=0x7fffffffe7b8, >> error_r=0x7fffffffe808) at mail-storage-service.c:1149 >> #11 0x000000000041f61c in client_create_from_input >> (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, >> input_buf=0x0, >> error_r=0x7fffffffe808) at main.c:202 >> #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 >> #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 >> >> /usr/local/dovecot/bin/doveconf -n >> # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32 x86_64 Debian wheezy/sid >> namespace test { >> list = children >> location = maildir:/root/test >> prefix = test. >> subscriptions = yes >> type = shared >> } >> namespace inbox { >> inbox = yes >> list = yes >> location = >> mailbox Drafts { >> special_use = \Drafts >> } >> mailbox Junk { >> special_use = \Junk >> } >> mailbox Sent { >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> special_use = \Trash >> } >> prefix = >> subscriptions = yes >> } >> passdb { >> driver = pam >> } >> ssl = no >> userdb { >> driver = passwd >> } >> >> without type = shared there is no segfault, >> >> I understand this config might not work (invoking imap directly) but >> it should't segfault. >> >> Regards, >> >> Michal Grzedzicki >> > From tss at iki.fi Fri Aug 31 16:23:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:23:07 +0300 Subject: [Dovecot] exclude a folder for lazy expunge (move to trash) In-Reply-To: <503491C4.7030208@um.es> References: <503491C4.7030208@um.es> Message-ID: <712399DF-2E5C-4BCF-BF4B-3C8A919D4F9B@iki.fi> On 22.8.2012, at 11.01, Angel L. Mateo wrote: > I'm configuring lazy expunge plugin to act as a kind of backup of my user's emails. > > I'm getting a little problem because a lot of my users use "move to trash" behaviour in their email client (most of them are using thunderbird which has no option to hide deleted messages and is a hassle working with mark as deleted with it). The problem combining move to trash with lazy expunge is that messages are stored in the expunge namespace twice, first when it was deleted from the original folder and the second when is deleted from the trash. > > So... is there any way to exclude trash folder from lazy expunge plugin, so mails are stored in the expunge namespace only when they are deleted from their original folder and not from the trash? Not right now. Maybe it could be automatically done when SPECIAL-USE is enabled and the deletion is from a \Trash mailbox. > Another idea... We are purging trash folders with a cron running "doveadm purge" commands. Is there any way to run this command disabling lazy expunge plugin? doveadm purge shouldn't affect lazy expunge, but you can disable lazy_expunge by using something like doveadm -o mail_plugins=everything,except,lazy_expunge expunge .. From tss at iki.fi Fri Aug 31 16:34:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:34:20 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <504072FA.8020606@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> Message-ID: <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> On 31.8.2012, at 11.16, Sascha Zucca wrote: > Hi! > Still noone? > strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. No. I can't reproduce it. What does your LIST "" * reply look like now with v2.1? From tss at iki.fi Fri Aug 31 16:40:44 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:40:44 +0300 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <5035D234.50306@optusnet.com.au> References: <5035D234.50306@optusnet.com.au> Message-ID: <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> On 23.8.2012, at 9.48, Dominic Malolepszy wrote: > I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings From tss at iki.fi Fri Aug 31 16:46:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:46:08 +0300 Subject: [Dovecot] pop3 migration In-Reply-To: <503632C7.2070008@rfa.cz> References: <503632C7.2070008@rfa.cz> Message-ID: <984B7F63-322D-430E-B495-88ED2274728A@iki.fi> On 23.8.2012, at 16.40, TeTeHacko wrote: > I have problems with pop3 migration, the server disconect the dovesync when > fetching mails after 5 minutes with this error in server log: > > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6548 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 47522 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6549 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 355289 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6550 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 9638 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6551 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 2188 octets > xx.xx.xx.xx [28F4] 11:59:05 >>> -ERR Command unrecognized: "" > xx.xx.xx.xx [28F4] 11:59:05 *** 6551 477693894 00:12:55 ERROR > xx.xx.xx.xx [28F4] 11:59:05 Disconnected Looks like a bug. But in Dovecot POP3 client or the POP3 server? Apparently either Dovecot sends an empty line after RETR or the server thinks Dovecot sends it. Can you get the actual TCP traffic logs? and/or set pop3c_rawlog_dir and see if it's there. From tss at iki.fi Fri Aug 31 16:49:52 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:49:52 +0300 Subject: [Dovecot] Vpopmail Dynamic Authentication Module In-Reply-To: References: Message-ID: <8992E740-591B-4572-AE89-5260D40CBB8F@iki.fi> On 24.8.2012, at 16.42, Eric Sisolak wrote: > I had to modify the command to build the module, but was able to > successfully build it: > gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL > -I../.. -I../lib -I/home/vpopmail/include -I/home/vpopmail/lib > userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so > -L/home/vpopmail/lib/libvpopmail.a -L means a path, pointing it to .a file doesn't do anything useful. By giving the .a file directly probably also fails if libvpopmail.a hasn't been built with -fPIC. > /usr/lib64/dovecot/auth/vpopmail.so: undefined symbol: vclose And that's the reason this fails, because libvpopmail isn't included in vpopmail.so. From tss at iki.fi Fri Aug 31 16:53:51 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:53:51 +0300 Subject: [Dovecot] Length of attachment filenames In-Reply-To: References: Message-ID: <79371183-6453-4A1B-BFCB-377643FD09EF@iki.fi> On 31.8.2012, at 15.27, Fuhrmann, Hauke wrote: > I have a beginners question to Dovecot: does it have a restriction on > the supported length and character encodings of filenames of > attachments? > > Can filenames be arbitrary large? The filenames in IMAP's BODYSTRUCTURE reply probably get truncated somewhere around 8192 bytes (then again, maybe not, depends on the encoding I think). And in any case not all IMAP clients use BODYSTRUCTURE. From tss at iki.fi Fri Aug 31 16:54:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:54:45 +0300 Subject: [Dovecot] mail_location / mail_home In-Reply-To: <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> References: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> Message-ID: On 31.8.2012, at 11.15, Denny Schierz wrote: > Am 31.08.2012 um 09:55 schrieb Denny Schierz: >> >> mail_home = /imap/spool/%d/%1u/%u >> mail_location = maildir:~/:INDEX=~/ > > I think, it doesn't make any difference, if I have "~" or a fixed path :-/ On the productive system (also 2.1.9) I get messages like: > > [...] dovecot.lda-dupes/tmp) failed: Not a directory [...] Here's a simple fix: maildir_stat_dirs=yes From tss at iki.fi Fri Aug 31 16:56:59 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:56:59 +0300 Subject: [Dovecot] LDAP auth and multiple attributes to construct the mail path In-Reply-To: References: Message-ID: On 31.8.2012, at 2.45, Anatoly Ivanov wrote: > So I am trying to construct mail path for my LDAP user lookups, and i need > to use two attributes instead of one. > > For examle, my LDAP directory has two attributes: departmentAttr and > userIDAttr, and I want the maildir to reside in > /home/${departmentAttr}/${userIDAttr} With v2.1: /home/%{ldap:departmentAttr}/%{ldap:userIDAttr} With older versions: you can't. From zucca at systemschmiede.com Fri Aug 31 16:59:08 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 15:59:08 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> Message-ID: <5040C32C.2020706@systemschmiede.com> Hi and thanks for replying! Here's what you asked for: _*with %%n:*_ 1 LIST "" * * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" * LIST (\Noselect \HasChildren) "/" "Freigaben/testuser-1" * LIST (\HasNoChildren) "/" "Freigaben/testuser-1/INBOX/test" 1 OK List completed. _*with %%u:*_ 1 LIST "" * * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "Freigaben/testuser-1 at parrotshop.de" * LIST (\HasNoChildren) "/" "Freigaben/testuser-1 at parrotshop.de/INBOX/test" 1 OK List completed. So i guess * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" is the Problem... Thank you again Sascha Am 31.08.2012 15:34, schrieb Timo Sirainen: > On 31.8.2012, at 11.16, Sascha Zucca wrote: > >> Hi! >> Still noone? >> strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. > No. I can't reproduce it. What does your LIST "" * reply look like now with v2.1? > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Fri Aug 31 17:06:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:06:13 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5040C32C.2020706@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> Message-ID: <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> On 31.8.2012, at 16.59, Sascha Zucca wrote: > So i guess > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > is the Problem... Yes. The problem is, I don't see it even with v2.1.7. Although I do see that when a user sees zero shared mailboxes, but that has also been fixed with v2.1.9. So I'd try upgrading again.. From tss at iki.fi Fri Aug 31 17:11:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:11:07 +0300 Subject: [Dovecot] [Postfix] SASL Auth. using Dovecot with password forwarding proxy configuration In-Reply-To: <20120831125120.37a3f7cf@adi.ddns.local> References: <20120831125120.37a3f7cf@adi.ddns.local> Message-ID: <13A83420-05D7-4DBF-A09B-2D2EE1FE9F48@iki.fi> On 31.8.2012, at 5.51, Adi Pircalabu wrote: > I'm relatively new to Dovecot and I did a bit of search but couldn't > find a possible solution for the particular setup I'm working on. > Basically I have an SMTP/POP/IMAP proxy setup running Postfix & > Dovecot. IMAP/POP authentication is done using the password proxy > feature, where the login credentials are passed to the backend server > after a db lookup, which does the actual authentication. POP/IMAP logs the user in and Dovecot proxies it. > The POP/IMAP part is working fine. What I'm trying to do is to use > Dovecot SASL implementation in Postfix to do SMTP authentication in a > similar manner. The problem I have with my current configuration is that > SMTP authentication succeeds if only the username matches, because > password forwarding works if the authentication succeeds with any given > password, as documented at > http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy Dovecot has no SMTP proxy (currently). And anyway Postfix doesn't use SMTP to do authentication, Postfix authenticates using Dovecot's internal protocol, which replies that Postfix should do the proxying, which it of course doesn't do. > My question is, given the above: is there a way to get SMTP > authentication properly in this scenario? Make Postfix authenticate against the backend Dovecot server. You'll need to setup service auth { inet_listener } to some port for it. From d.caspari at eurodata.de Fri Aug 31 16:51:25 2012 From: d.caspari at eurodata.de (Dirk Caspari) Date: Fri, 31 Aug 2012 15:51:25 +0200 Subject: [Dovecot] How Converting/Using courier-userdb Files ? Message-ID: <5040C15D.4000303@eurodata.de> Hello, how can i convert/use the Original userdb-Files from courier Installation ? The files are looking like a "Special"-DB-Format and are not readable. ----------------- #file /etc/courier/userdb.dat /etc/courier/userdb.dat: GNU dbm 1.x or ndbm database, little endian ----------------- /etc/courier/userdb.dat /etc/courier/userdbshadow.dat These Files was created with the following scripts (Part of "courier-authlib-userdb" Package). ......... /usr/sbin/makeuserdb /usr/sbin/pw2userdb /usr/sbin/userdb .......... Regards D I R K -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 7675 bytes Desc: S/MIME Cryptographic Signature URL: From zucca at systemschmiede.com Fri Aug 31 17:17:45 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 16:17:45 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> Message-ID: <5040C789.8000502@systemschmiede.com> Am 31.08.2012 16:06, schrieb Timo Sirainen: > On 31.8.2012, at 16.59, Sascha Zucca wrote: > >> So i guess >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> is the Problem... > Yes. The problem is, I don't see it even with v2.1.7. Although I do see that when a user sees zero shared mailboxes, but that has also been fixed with v2.1.9. So I'd try upgrading again.. > hm, but 2.1.9 is not in backports yet, is it? -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From dmalolepszy at optusnet.com.au Fri Aug 31 17:23:55 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Sat, 01 Sep 2012 00:23:55 +1000 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> References: <5035D234.50306@optusnet.com.au> <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> Message-ID: <5040C8FB.7020409@optusnet.com.au> On 31/08/2012 11:40 PM, Timo Sirainen wrote: > On 23.8.2012, at 9.48, Dominic Malolepszy wrote: > >> I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. > Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings > > They appear to trigger during maildelivers say via the LDA, however IMAP mailbox interactions (say deleting an email or copying an email) do not trigger them. I ended up having this patched into the quota plugin and works a treat. From tss at iki.fi Fri Aug 31 17:26:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:26:23 +0300 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <5040C8FB.7020409@optusnet.com.au> References: <5035D234.50306@optusnet.com.au> <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> <5040C8FB.7020409@optusnet.com.au> Message-ID: <03EE8709-B737-497E-A5CC-0026154D33F7@iki.fi> On 31.8.2012, at 17.23, Dominic Malolepszy wrote: > On 31/08/2012 11:40 PM, Timo Sirainen wrote: >> On 23.8.2012, at 9.48, Dominic Malolepszy wrote: >> >>> I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. >> Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings >> >> > They appear to trigger during maildelivers say via the LDA, however IMAP mailbox interactions (say deleting an email or copying an email) do not trigger them. I ended up having this patched into the quota plugin and works a treat. The quota plugin, including quota warnings, works identically in LDA and IMAP. So I wonder what your patch does. Of course in IMAP a mail deletion is often a copy+mark as deleted with the expunge happening sometimes later. From sven at svenhartge.de Fri Aug 31 19:40:56 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 31 Aug 2012 18:40:56 +0200 Subject: [Dovecot] Imap Ghost folder References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> <5040C789.8000502@systemschmiede.com> Message-ID: <292te8ob8kv8@mids.svenhartge.de> Sascha Zucca wrote: > Am 31.08.2012 16:06, schrieb Timo Sirainen: >> On 31.8.2012, at 16.59, Sascha Zucca wrote: >>> So i guess >>> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >>> is the Problem... >> Yes. The problem is, I don't see it even with v2.1.7. Although I do >> see that when a user sees zero shared mailboxes, but that has also >> been fixed with v2.1.9. So I'd try upgrading again.. >> > hm, but 2.1.9 is not in backports yet, is it? And will not be for some time. 2.1.9 is not even in Unstable and even if it were, it would not migrate to testing (and be an eligible backporting target) due to the freeze before the Wheezy release. Gr??e, Sven. -- Sigmentation fault. Core dumped. From user+dovecot at localhost.localdomain.org Fri Aug 31 20:43:32 2012 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Fri, 31 Aug 2012 19:43:32 +0200 Subject: [Dovecot] How Converting/Using courier-userdb Files ? In-Reply-To: <5040C15D.4000303@eurodata.de> References: <5040C15D.4000303@eurodata.de> Message-ID: <5040F7C4.1050908@localhost.localdomain.org> On 08/31/2012 03:51 PM Dirk Caspari wrote: > Hello, > > how can i convert/use the Original userdb-Files from courier Installation ? > The files are looking like a "Special"-DB-Format and are not readable. > ----------------- > #file /etc/courier/userdb.dat > /etc/courier/userdb.dat: GNU dbm 1.x or ndbm database, little endian > ----------------- > > /etc/courier/userdb.dat > /etc/courier/userdbshadow.dat > > These Files was created with the following scripts (Part of > "courier-authlib-userdb" Package). > ......... > /usr/sbin/makeuserdb > /usr/sbin/pw2userdb > /usr/sbin/userdb > .......... > > Regards > D I R K RTFM: makeuserdb(8) / DESCRIPTION / Format of /etc/courier/userdb http://manpages.ubuntu.com/manpages/natty/man8/makeuserdb.8.html Regards, Pascal -- The trapper recommends today: decade.1224419 at localdomain.org From robert at schetterer.org Wed Aug 1 00:29:52 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 31 Jul 2012 23:29:52 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected Message-ID: <50184E50.7030907@schetterer.org> Hi Timo, by having errors like Cached message size smaller than expected and Maildir filename has wrong S value and Corrupted index cache file in dove 2.1.8 i can reproduce the problem with tb 14 with 2 nat machines connected to the same server the problem relates with create new folder then copy some uncompressed and compressed mail to it, the i.e open it by other client sometime this happens at once , sometime after a few copy actions however thunderbird ,then errors above apear, sometimes no mail is shown, sometimes only uncompressed or only compressed so funktion read both formats gets lost somehow any idea, you need a better debug ? -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 00:44:43 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 00:44:43 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50184E50.7030907@schetterer.org> References: <50184E50.7030907@schetterer.org> Message-ID: On 1.8.2012, at 0.29, Robert Schetterer wrote: > Cached message size smaller than expected > and > Maildir filename has wrong S value > and > Corrupted index cache file > > in dove 2.1.8 > > i can reproduce the problem with tb 14 > with 2 nat machines connected to the same server > > the problem relates with create new folder then copy > some uncompressed and compressed mail to it, the i.e > open it by other client > > sometime this happens at once , sometime after a few copy actions I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? It would help to know how to reproduce this on an entirely empty mail account. From hendy at soluvas.com Wed Aug 1 01:12:50 2012 From: hendy at soluvas.com (Hendy Irawan) Date: Tue, 31 Jul 2012 15:12:50 -0700 (PDT) Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: References: <34226738.post@talk.nabble.com> Message-ID: <34238207.post@talk.nabble.com> Dear Timo, Thank you very much for your kind work. I apologize, my previous statement were wrong. At least on ApacheDS 1.5.7, it doesn't search entries using the '' base DN (it doesn't give error though, just cannot return results, ApacheDS requires the search base to be in a partition). However, your patch would be great for servers who support the '' search base DN. If I may ask, would you improve it further to accept multiple bases? I'm not sure what the proper character separator would be, but I think something like this would work : base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com The proposed configuration above asks to try the two search bases in succession, whichever first succeeds get logged in, else fails like usual. I hope it's okay with you. I'll definitely help with the testing. Hendy Timo Sirainen wrote: > > On 29.7.2012, at 15.00, Hendy Irawan wrote: > >> We have several context entries and want to authenticate a user against >> the >> whole LDAP server. >> >> However when setting "base = " Dovecot LDAP fails with following message: >> >> Jul 29 10:50:59 nitik1 dovecot: auth: Error: >> ldap(hendy at staging.member.berbatik.com,127.0.0.1): >> ldap_search((virtualMail=hendy at staging.member.berbatik.com)) failed: >> Other >> (e.g., implementation specific) error > > Does the attached patch help? If yes, I'll add it to next version. > > > > ----- http://www.Soluvas.com/ Soluvas - Making eCommerce Work for You -- View this message in context: http://old.nabble.com/BUG%3A-LDAP-extension-failed-to-authenticate-if-%27base%27-DN-configuration-is-empty-%27%27-tp34226738p34238207.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Wed Aug 1 01:51:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 01:51:08 +0300 Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: <34238207.post@talk.nabble.com> References: <34226738.post@talk.nabble.com> <34238207.post@talk.nabble.com> Message-ID: <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> On 1.8.2012, at 1.12, Hendy Irawan wrote: > I apologize, my previous statement were wrong. At least on ApacheDS 1.5.7, > it doesn't search entries using the '' base DN (it doesn't give error > though, just cannot return results, ApacheDS requires the search base to be > in a partition). > > However, your patch would be great for servers who support the '' search > base DN. But does my patch actually make it work in some such servers? I did it only as a guess. If it doesn't fix anything I'd rather just drop the patch. > If I may ask, would you improve it further to accept multiple bases? I'm not > sure what the proper character separator would be, but I think something > like this would work : > > base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com > > The proposed configuration above asks to try the two search bases in > succession, whichever first succeeds get logged in, else fails like usual. You can already do this by creating multiple passdb/userdb ldap sections with different config files. Searching multiple bases requires doing multiple LDAP lookups anyway. From hendy at soluvas.com Wed Aug 1 06:53:42 2012 From: hendy at soluvas.com (Hendy Irawan) Date: Tue, 31 Jul 2012 20:53:42 -0700 (PDT) Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> References: <34226738.post@talk.nabble.com> <34238207.post@talk.nabble.com> <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> Message-ID: <34238917.post@talk.nabble.com> Dear Timo, Thank you for your information about multiple sections! I didn't realize that was possible. Yes, your patch will work on at least ApacheDS 2.0.0-M7 (see https://issues.apache.org/jira/browse/DIRSERVER-1742 ) and I would appreciate it very much ! Hendy Timo Sirainen wrote: > > On 1.8.2012, at 1.12, Hendy Irawan wrote: > >> I apologize, my previous statement were wrong. At least on ApacheDS >> 1.5.7, >> it doesn't search entries using the '' base DN (it doesn't give error >> though, just cannot return results, ApacheDS requires the search base to >> be >> in a partition). >> >> However, your patch would be great for servers who support the '' search >> base DN. > > But does my patch actually make it work in some such servers? I did it > only as a guess. If it doesn't fix anything I'd rather just drop the > patch. > >> If I may ask, would you improve it further to accept multiple bases? I'm >> not >> sure what the proper character separator would be, but I think something >> like this would work : >> >> base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com >> >> The proposed configuration above asks to try the two search bases in >> succession, whichever first succeeds get logged in, else fails like >> usual. > > You can already do this by creating multiple passdb/userdb ldap sections > with different config files. Searching multiple bases requires doing > multiple LDAP lookups anyway. > ----- http://www.Soluvas.com/ Soluvas - Making eCommerce Work for You -- View this message in context: http://old.nabble.com/BUG%3A-LDAP-extension-failed-to-authenticate-if-%27base%27-DN-configuration-is-empty-%27%27-tp34226738p34238917.html Sent from the Dovecot mailing list archive at Nabble.com. From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 07:32:58 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 01 Aug 2012 06:32:58 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> Message-ID: <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> Timo Sirainen schrieb: >On 12.7.2012, at 14.14, Angel L. Mateo wrote: > >> So I have used doveadm director move to move >them to its "hashed" server. Although a doveadm director status >now shows me that this user is directed to the new server, doveadm who >in the temporal server shows me that the user is actually connected to >it, although messages are delivered to it through is correct server. So >I have had to manually kick that users in the temporal servers. >> >> Is this the expected behaviour of the move command for director? >> >> Is there any way to also force the kick of the imap/pop user's >connection in the temporal server? > >Do you see any errors in logs? Especially: > >director: Error: connect(ipc) failed: Permission denied Looks very familiar to me. I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. Regards Daniel From robert at schetterer.org Wed Aug 1 08:36:56 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 07:36:56 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: References: <50184E50.7030907@schetterer.org> Message-ID: <5018C078.9090503@schetterer.org> Am 31.07.2012 23:44, schrieb Timo Sirainen: > On 1.8.2012, at 0.29, Robert Schetterer wrote: > >> Cached message size smaller than expected >> and >> Maildir filename has wrong S value >> and >> Corrupted index cache file >> >> in dove 2.1.8 >> >> i can reproduce the problem with tb 14 >> with 2 nat machines connected to the same server >> >> the problem relates with create new folder then copy >> some uncompressed and compressed mail to it, the i.e >> open it by other client >> >> sometime this happens at once , sometime after a few copy actions > > I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? at my recent onwledge mixing compressed new mails from my sent folder, and older uncompressed ones ( which are shown nice both in tb ), with some copy action in a new folder from another client leads to wrong S and tb does not display them any longer sometime, perhaps a double zip happens? It would help to know how to reproduce this on an entirely empty mail account. > i will try to test, but first i have to deal with now broken maildirs i try disable zlip plugin now ,as workaround hopefully this does not lead to more problems on old maildirs , and fix the problem with new mail -- Best Regards MfG Robert Schetterer From ml-dovecot at zu-con.org Wed Aug 1 09:09:43 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 08:09:43 +0200 Subject: [Dovecot] virtual folder - crash while searching Message-ID: <5018C827.80406@zu-con.org> Hi, I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in a virtual folder dovecot crashes. Here's the stacktrace: http://pastebin.com/urSDDzku Regards, Matthias From f.bonnet at esiee.fr Wed Aug 1 10:19:32 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 09:19:32 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory Message-ID: <5018D884.7000103@esiee.fr> hello I see this message in the dovecot error log every time a user connect to IMAP service. imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In the server's config I've this mail_location = mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u As we can see INDEX files are not living in user's home directories but in /var/spool/dovecot/index/%u so why this error message ? BTW : users access normally to their IMAP folders , I'm just curious about this message which is not marked as warning but error Thank you From nikolai at net24.co.nz Wed Aug 1 11:13:48 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Wed, 1 Aug 2012 20:13:48 +1200 Subject: [Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox Message-ID: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> I'm seeing the following error in our logs when removing mailboxes (we are using mdbox and dovecot 2.1.8): Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Error: stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation not permitted Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Mailbox deleted: Spam When I run truss against the process it appears the error relates to attempted unlink of a directory, not a stat of it, as reported by the log. However the mailbox does appear to be deleted fine, so it appears to be an erroneous error. Here is the truss output from the "3 DELETE INBOX.Spam" IMAP command: gettimeofday({1343808204.962165 },0x0) = 0 (0x0) gettimeofday({1343808204.962351 },0x0) = 0 (0x0) kevent(9,0x0,0,{0xb,EVFILT_READ,0x0,0,0x15,0x21c17a40},6,{1786.679649000 }) = 1 (0x1) gettimeofday({1343808216.031493 },0x0) = 0 (0x0) gettimeofday({1343808216.031676 },0x0) = 0 (0x0) read(11,"3 DELETE INBOX.Spam\r\n",8179) = 21 (0x15) getpid() = 6293 (0x1895) __sysctl(0x7fffffffd850,0x4,0x0,0x0,0x21c8f000,0x2a) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam",{ mode=drwx------ ,inode=28760,size=3,blksize=131072 }) = 0 (0x0) open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",O_RDWR,037777753160) = 10 (0xa) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) pread(0xa,0x21c30000,0x90,0x0,0x1000,0x0) = 144 (0x90) open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index",O_RDWR,037777731760) ERR#2 'No such file or directory' open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2",O_RDWR,037777731520) ERR#2 'No such file or directory' fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) unlink("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam") ERR#1 'Operation not permitted' stat("/usr/share/nls/C/libc.cat",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/share/nls/libc/C",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/local/share/nls/C/libc.cat",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/local/share/nls/libc/C",0x7fffffffd0a0) ERR#2 'No such file or directory' write(2,"\^A\b6293 prefix=imap(test at test."...,36) = 36 (0x24) write(2,"\^A\^D6293 stat(/mailstore/domai"...,99) = 99 (0x63) access("/etc/localtime",4) = 0 (0x0) open("/etc/localtime",O_RDONLY,04160026530) = 12 (0xc) fstat(12,{ mode=-r--r--r-- ,inode=16454,size=2434,blksize=4096 }) = 0 (0x0) read(12,"TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0"...,41448) = 2434 (0x982) close(12) = 0 (0x0) issetugid(0x20ee7fd1,0x21e72000,0x0,0xa7,0x4e,0xc) = 1 (0x1) open("/usr/share/zoneinfo/posixrules",O_RDONLY,056) = 12 (0xc) fstat(12,{ mode=-r--r--r-- ,inode=545,size=3519,blksize=4096 }) = 0 (0x0) read(12,"TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0"...,41448) = 3519 (0xdbf) close(12) = 0 (0x0) madvise(0x21eba000,0xb000,0x5,0x2b9,0x17,0x1) = 0 (0x0) madvise(0x21e72000,0x5000,0x5,0x271,0x17,0x1) = 0 (0x0) madvise(0x21e63000,0xc000,0x5,0x262,0x7fffffffcbf0,0x7fffffffcbf0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) gettimeofday({1343808216.048607 },0x0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2",0x7fffffffd600) ERR#2 'No such file or directory' setitimer(0,{0.000000, 180.000000 },{0.000000, 0.000000 }) = 0 (0x0) fcntl(10,F_SETLKW,0x7fffffffd520) = 0 (0x0) setitimer(0,{0.000000, 0.000000 },{0.000000, 180.000000 }) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) pwrite(0xa,0x21c09000,0xc,0x90,0x10ab6b8,0x2) = 12 (0xc) pwrite(0xa,0x7fffffffd69c,0x4,0x90,0x10ab6b8,0x2) = 4 (0x4) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) fcntl(10,F_SETLK,0x7fffffffd5e0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) setitimer(0,{0.000000, 180.000000 },{0.000000, 0.000000 }) = 0 (0x0) fcntl(10,F_SETLKW,0x7fffffffd1f0) = 0 (0x0) setitimer(0,{0.000000, 0.000000 },{0.000000, 180.000000 }) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) pwrite(0xa,0x21c09400,0x1c,0x9c,0xffff800021c0bea4,0x7fffffffa9f0) = 28 (0x1c) pwrite(0xa,0x7fffffffd57c,0x4,0x9c,0xffff800021c0bea4,0x7fffffffa9f0) = 4 (0x4) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) fcntl(10,F_SETLK,0x7fffffffd610) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=184,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=184,blksize=4096 }) = 0 (0x0) rename("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails","/mailstore/domains/test.com/test/mdbox/..DOVECOT-TrasH") = 0 (0x0) open(".",O_RDONLY,00) = 12 (0xc) open("/mailstore/domains/test.com/test/mdbox/..DOVECOT-TrasH",O_NOFOLLOW,00) = 13 (0xd) fchdir(0xd,0x100,0x0,0x7b30,0x101010101010101,0x8080808080808080) = 0 (0x0) stat(".",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) open(".",O_NONBLOCK|0x20000,00) = 14 (0xe) fstat(14,{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) fcntl(14,F_SETFD,FD_CLOEXEC) = 0 (0x0) fstatfs(0xe,0x7fffffffd3a0,0x21c00400,0x29,0x61ff20,0x0) = 0 (0x0) getdirentries(0xe,0x21c31000,0x1000,0x21c284e8,0x61ff20,0x0) = 52 (0x34) unlink("dovecot.index.log") = 0 (0x0) getdirentries(0xe,0x21c31000,0x1000,0x21c284e8,0x61ff20,0x0) = 0 (0x0) close(13) = 0 (0x0) lseek(14,0x0,SEEK_SET) = 0 (0x0) close(14) = 0 (0x0) fchdir(0xc,0x0,0x21c07400,0x28,0x61ff20,0x0) = 0 (0x0) close(12) = 0 (0x0) rmdir(0x21c18470,0x0,0x21c07400,0x28,0x61ff20,0x0) = 0 (0x0) rmdir(0x21c184f0,0x4,0x21c18000,0x7af8,0xffffffffffdd6669,0x21c8c298) = 0 (0x0) open("/mailstore/domains/test.com/test/mdbox/dovecot.mailbox.log",O_RDWR|O_APPEND,0125337603) = 12 (0xc) write(12,"\^A\0\0\0\M^L\M-M%\^E\M^F\M-b\^X"...,24) = 24 (0x18) fstat(12,{ mode=-rw------- ,inode=28751,size=144,blksize=4096 }) = 0 (0x0) rmdir(0x21c186d0,0x21e41eb8,0x21c186d0,0x7918,0xffffffffffdd6849,0x21c8c298) ERR#2 'No such file or directory' write(12,"\^B\0\0\0\M-Xb\M^JRY\M-I{x\M--C"...,24) = 24 (0x18) fstat(12,{ mode=-rw------- ,inode=28751,size=168,blksize=4096 }) = 0 (0x0) write(2,"\^A\^B6293 Mailbox deleted: Spam"...,29) = 29 (0x1d) gettimeofday({1343808216.058749 },0x0) = 0 (0x0) madvise(0x21e65000,0x1000,0x5,0x264,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21e63000,0x1000,0x5,0x262,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21e41000,0x2000,0x5,0x240,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21d8d000,0x4000,0x5,0x18c,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21c91000,0x2000,0x5,0x90,0x7fffffffcfa0,0xffffffff) = 0 (0x0) gettimeofday({1343808216.059531 },0x0) = 0 (0x0) getpid() = 6293 (0x1895) __sysctl(0x7fffffffd830,0x4,0x0,0x0,0x21c8f000,0x23) = 0 (0x0) write(11,"3 OK Delete completed.\r\n",24) = 24 (0x18) gettimeofday({1343808216.060105 },0x0) = 0 (0x0) Regard, Nikolai. From matthias.lay at securepoint.de Wed Aug 1 12:45:38 2012 From: matthias.lay at securepoint.de (Matthias Lay) Date: Wed, 01 Aug 2012 11:45:38 +0200 Subject: [Dovecot] ntlm auth / usernames with white spaces In-Reply-To: References: <1343399579.3072.19.camel@hermann.potsdam.securepoint.local> Message-ID: <1343814338.3072.31.camel@hermann.potsdam.securepoint.local> works the same way! at least for ntlm but should do the same for spnego. thx. didnt see your strarray join function. On Tue, 2012-07-31 at 22:10 +0300, Timo Sirainen wrote: > On 27.7.2012, at 17.32, Matthias Lay wrote: > > > we experienced some problems with white spaces in usernames (this was > > NOT our idea) authenticated bei dovecots ntlmhelper > > > > I wrote a little patch fixing this, if you would like. > > > > patch applies on 2.1.7 and 2.1.8 (tested those) > > Does this simpler patch also work? From CMarcus at Media-Brokers.com Wed Aug 1 13:53:04 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 06:53:04 -0400 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5018C827.80406@zu-con.org> References: <5018C827.80406@zu-con.org> Message-ID: <50190A90.7090109@Media-Brokers.com> On 2012-08-01 2:09 AM, Matthias Rieber wrote: > I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in > a virtual folder dovecot crashes. Sorry, our crystal ball is broken, although Timo can sometimes get his to work, how I don't know... ;) doveconf -n output? Logs (untrimmed) showing the events leading to the crash? > Here's the stacktrace: > > http://pastebin.com/urSDDzku Stack trace *may* be useful to Timo, but first, please provide bare minimum details of your system/config/errors as requested above - as you should do *always* when asking for support for any software on any mail support list... -- Best regards, Charles From CMarcus at Media-Brokers.com Wed Aug 1 13:56:47 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 06:56:47 -0400 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <5018D884.7000103@esiee.fr> References: <5018D884.7000103@esiee.fr> Message-ID: <50190B6F.7020600@Media-Brokers.com> Please help us help you. Always provide bare minimum system/config/error details, like: Full doveconf -n output (don't 'describe' your config with a one line copy/paste from some random config file) Full (untrimmed) logs exhibiting the problem On 2012-08-01 3:19 AM, Frank Bonnet wrote: > hello > > I see this message in the dovecot error log every time > a user connect to IMAP service. > > imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such > file or directory > > In the server's config I've this > > mail_location = > mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u > > As we can see INDEX files are not living in user's home directories but > in /var/spool/dovecot/index/%u > so why this error message ? > > BTW : users access normally to their IMAP folders , I'm just curious > about this message > which is not marked as warning but error -- Best regards, Charles From tss at iki.fi Wed Aug 1 13:58:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 13:58:01 +0300 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> Message-ID: <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> On 1.8.2012, at 7.32, Daniel Parthey wrote: >> Do you see any errors in logs? Especially: >> >> director: Error: connect(ipc) failed: Permission denied > > Looks very familiar to me. > > I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. I added a note about it to http://wiki2.dovecot.org/Director#Other_settings From f.bonnet at esiee.fr Wed Aug 1 14:03:50 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:03:50 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190B6F.7020600@Media-Brokers.com> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> Message-ID: <50190D16.1090901@esiee.fr> Yes sorry I forgot :-( See attached the doveconf -n output Thanks On 08/01/2012 12:56 PM, Charles Marcus wrote: > Please help us help you. > > Always provide bare minimum system/config/error details, like: > > Full doveconf -n output > (don't 'describe' your config with a one line copy/paste from some > random config file) > > Full (untrimmed) logs exhibiting the problem > > On 2012-08-01 3:19 AM, Frank Bonnet wrote: >> hello >> >> I see this message in the dovecot error log every time >> a user connect to IMAP service. >> >> imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such >> file or directory >> >> In the server's config I've this >> >> mail_location = >> mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u >> >> As we can see INDEX files are not living in user's home directories but >> in /var/spool/dovecot/index/%u >> so why this error message ? >> >> BTW : users access normally to their IMAP folders , I'm just curious >> about this message >> which is not marked as warning but error > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr -------------- next part -------------- # 2.1.8: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.0-RELEASE-p3 amd64 auth_verbose = yes auth_verbose_passwords = plain auth_worker_max_count = 100 debug_log_path = /var/log/dovecot/debug.log default_client_limit = 6144 default_process_limit = 1024 default_vsz_limit = 1 G disable_plaintext_auth = no info_log_path = /var/log/dovecot/info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_fsync = always mail_location = mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u mail_temp_dir = /var/tmp managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_lock_timeout = 3 mins mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = prefix = separator = / subscriptions = yes type = private } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at esiee.fr protocols = imap pop3 sendmail_path = /usr/local/sbin/sendmail service auth { client_limit = 7169 } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 10 service_count = 1 vsz_limit = 3 G } service imap { process_limit = 2048 vsz_limit = 3 G } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = [REMOVED INTENTIONALLY] ssl_cert = [REMOVED INTENTIONALLY] ssl_key = [REMOVED INTENTIONALLY] userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lda { info_log_path = /var/log/dovecot/dovecot-lda.log log_path = /var/log/dovecot/dovecot-lda-errors.log mail_plugins = sieve $mail_plugins } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 } protocol sieve { mail_max_userip_connections = 30 managesieve_implementation_string = Dovecot Pigeonhole } From CMarcus at Media-Brokers.com Wed Aug 1 14:16:13 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 07:16:13 -0400 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190D16.1090901@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> Message-ID: <50190FFD.5060406@Media-Brokers.com> On 2012-08-01 7:03 AM, Frank Bonnet wrote: > Yes sorry I forgot :-( > > See attached the doveconf -n output Logs? > On 08/01/2012 12:56 PM, Charles Marcus wrote: >> Please help us help you. >> >> Always provide bare minimum system/config/error details, like: >> >> Full doveconf -n output >> (don't 'describe' your config with a one line copy/paste from some >> random config file) >> >> Full (untrimmed) logs exhibiting the problem -- Best regards, Charles From rafinathan25 at gmail.com Wed Aug 1 14:18:01 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Wed, 1 Aug 2012 16:48:01 +0530 Subject: [Dovecot] can't recieve emails to inbox Message-ID: Hi, I am unable to send emails to virtual users I created. Here is my output for dovecot -n # 1.0.7: /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log ssl_disable: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:~/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: verbose: yes passdb: driver: passwd-file args: /etc/dovecot/passwd passdb: driver: pam userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/home/vmail/%u == Contents of my passwd file located at /etc/dovecot/passwd user1 at mydomain.com user2 at mydomain.com I sent an email to user1 at mydomain.com from gmail.com but can view it anywhere. Please suggest. Where am I going wrong? From robert at schetterer.org Wed Aug 1 14:19:15 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 13:19:15 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <5018C078.9090503@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> Message-ID: <501910B3.2030306@schetterer.org> Am 01.08.2012 07:36, schrieb Robert Schetterer: > Am 31.07.2012 23:44, schrieb Timo Sirainen: >> On 1.8.2012, at 0.29, Robert Schetterer wrote: >> >>> Cached message size smaller than expected >>> and >>> Maildir filename has wrong S value >>> and >>> Corrupted index cache file >>> >>> in dove 2.1.8 >>> >>> i can reproduce the problem with tb 14 >>> with 2 nat machines connected to the same server >>> >>> the problem relates with create new folder then copy >>> some uncompressed and compressed mail to it, the i.e >>> open it by other client >>> >>> sometime this happens at once , sometime after a few copy actions >> >> I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? > > at my recent onwledge > mixing compressed new mails from my sent folder, and older uncompressed > ones ( which are shown nice both in tb ), with some copy action in a new > folder from another client leads to wrong S > and tb does not display them any longer sometime, perhaps a double zip > happens? > > It would help to know how to reproduce this on an entirely empty mail > account. >> > > i will try to test, but first i have to deal with now broken maildirs > i try disable zlip plugin now ,as workaround hopefully this does not > lead to more problems on old maildirs , and fix the problem with new mail > hi Timo, rolled back all stuff you recommended offlist so situation is a bit better now, however why, i had to handle cause more mailldirs get broken i guess iam dealing with equal Problems described here http://www.mail-archive.com/dovecot at dovecot.org/msg43986.html conversation with ralf, looks like your patch wasnt enough i have a few mailboxes and folders now i cant fix compressed files stay unreadable after move copy by Maildir filename has wrong S value i need some kind of mass repair actions etc , or some new patch -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 14:21:31 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:21:31 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190FFD.5060406@Media-Brokers.com> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> Message-ID: <5019113B.7030509@esiee.fr> On 08/01/2012 01:16 PM, Charles Marcus wrote: > On 2012-08-01 7:03 AM, Frank Bonnet wrote: >> Yes sorry I forgot :-( >> >> See attached the doveconf -n output > > Logs? > All lines are IDENTICALS except the user id I put MY login but it happen for ALL users when they connect Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory BTW : I use real unix users thru nss_ldap & pam_ldap auth, no virtual user >> On 08/01/2012 12:56 PM, Charles Marcus wrote: >>> Please help us help you. >>> >>> Always provide bare minimum system/config/error details, like: >>> >>> Full doveconf -n output >>> (don't 'describe' your config with a one line copy/paste from some >>> random config file) >>> >>> Full (untrimmed) logs exhibiting the problem > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr From tss at iki.fi Wed Aug 1 14:22:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 14:22:03 +0300 Subject: [Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox In-Reply-To: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> References: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> Message-ID: On 1.8.2012, at 11.13, Nikolai Schupbach wrote: > I'm seeing the following error in our logs when removing mailboxes (we are using mdbox and dovecot 2.1.8): > > Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Error: stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation not permitted > Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Mailbox deleted: Spam > > When I run truss against the process it appears the error relates to attempted unlink of a directory, not a stat of it, as reported by the log. However the mailbox does appear to be deleted fine, so it appears to be an erroneous error. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/8029f1b4afd0 From tss at iki.fi Wed Aug 1 14:27:31 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 14:27:31 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <5019113B.7030509@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: On 1.8.2012, at 14.21, Frank Bonnet wrote: > Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: chmod a+rw /var/run/dovecot/config gdb /usr/local/lib/dovecot/imap b i_error run bt full where the will probably work if you do something like: a list "" * b lsub "" * c select inbox if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog From f.bonnet at esiee.fr Wed Aug 1 14:56:03 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:56:03 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: <50191953.2010501@esiee.fr> On 08/01/2012 01:27 PM, Timo Sirainen wrote: > On 1.8.2012, at 14.21, Frank Bonnet wrote: > >> Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory > I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: > > chmod a+rw /var/run/dovecot/config > gdb /usr/local/lib/dovecot/imap it starts badly mail# gdb /usr/local/libexec/dovecot/imap GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... (gdb) b i_error Function "i_error" not defined. > b i_error > run > > bt full > > where the will probably work if you do something like: > > a list "" * > b lsub "" * > c select inbox > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr From f.bonnet at esiee.fr Wed Aug 1 15:00:24 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:00:24 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: <50191A58.8030404@esiee.fr> On 08/01/2012 01:27 PM, Timo Sirainen wrote: > On 1.8.2012, at 14.21, Frank Bonnet wrote: > >> Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory > I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: > > chmod a+rw /var/run/dovecot/config > gdb /usr/local/lib/dovecot/imap > b i_error > run > > bt full > > where the will probably work if you do something like: > > a list "" * > b lsub "" * > c select inbox > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog I ran it anyway , the output is below %gdb /usr/local/libexec/dovecot/imap GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... (gdb) (gdb) b i_error Function "i_error" not defined. Make breakpoint pending on future shared library load? (y or [n]) y Breakpoint 1 (i_error) pending. (gdb) run Starting program: /usr/local/libexec/dovecot/imap (no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...[New LWP 102225] (no debugging symbols found)...Breakpoint 2 at 0x800ba4430 Pending breakpoint "i_error" resolved [New Thread 801c07400 (LWP 102225/imap)] Debug: Effective uid=3003, gid=3010, home=/user/bonnetf Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:/user/bonnetf/:INBOX=/var/mail/bonnetf:INDEX=/var/spool/dovecot/index/bonnetf Debug: fs: root=/user/bonnetf, index=/var/spool/dovecot/index/bonnetf, control=, inbox=/var/mail/bonnetf, alt= * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as bonnetf a list "" * * LIST (\NoInferiors \UnMarked) "/" ".dovecot.sieve" * LIST (\NoInferiors \UnMarked) "/" "NetAPP" * LIST (\NoInferiors \Marked) "/" "Admin" * LIST (\NoInferiors \UnMarked) "/" "CCIP" * LIST (\NoInferiors \UnMarked) "/" "Clement" * LIST (\Noselect \HasChildren) "/" "sieve" * LIST (\Noselect \HasChildren) "/" "sieve/tmp" * LIST (\NoInferiors \UnMarked) "/" "sieve/roundcube.sieve" * LIST (\NoInferiors \UnMarked) "/" "Drafts" * LIST (\NoInferiors \UnMarked) "/" "ESIEE" * LIST (\NoInferiors \UnMarked) "/" ".dovecot.sieve.log" * LIST (\NoInferiors \UnMarked) "/" ".dovecot.svbin" * LIST (\NoInferiors \UnMarked) "/" "FPS" * LIST (\NoInferiors \Marked) "/" "PRIVE" * LIST (\NoInferiors \UnMarked) "/" "Sent" * LIST (\NoInferiors \UnMarked) "/" ".vacation.msg" * LIST (\NoInferiors \UnMarked) "/" "Templates" * LIST (\NoInferiors \UnMarked) "/" "Trash" * LIST (\NoInferiors \UnMarked) "/" "UMLV" * LIST (\NoInferiors \UnMarked) "/" "Caille" * LIST (\NoInferiors \UnMarked) "/" "Postmaster" * LIST (\NoInferiors \UnMarked) "/" "Junk" * LIST (\NoInferiors \UnMarked) "/" "Archives" * LIST (\NoInferiors \UnMarked) "/" "bkup-ldap" * LIST (\NoInferiors \UnMarked) "/" "Deleted Messages" * LIST (\NoInferiors \UnMarked) "/" "Apple" * LIST (\NoInferiors \UnMarked) "/" "Notes" * LIST (\NoInferiors \UnMarked) "/" "EmailStuff" * LIST (\NoInferiors \UnMarked) "/" "LISTSERV" * LIST (\NoInferiors \UnMarked) "/" "RENATER" * LIST (\NoInferiors \UnMarked) "/" "Free" * LIST (\NoInferiors \UnMarked) "/" "filers" * LIST (\NoInferiors \UnMarked) "/" "PRIVE2" * LIST (\NoInferiors \UnMarked) "/" "SUSE-NOVELL" * LIST (\NoInferiors \UnMarked) "/" "SYBASE" * LIST (\NoInferiors \UnMarked) "/" "Nono" * LIST (\NoInferiors \UnMarked) "/" "NGINX" * LIST (\NoInferiors \UnMarked) "/" "DIFFGEN" * LIST (\NoInferiors \UnMarked) "/" "ADESOFT" * LIST (\NoInferiors \UnMarked) "/" "RENATER-TCS" * LIST (\NoInferiors \UnMarked) "/" "Forensic" * LIST (\NoInferiors \UnMarked) "/" "EnCours" * LIST (\NoInferiors \UnMarked) "/" "BSD" * LIST (\NoInferiors \UnMarked) "/" "NYP" * LIST (\NoInferiors \UnMarked) "/" "Sent Messages" * LIST (\NoInferiors \UnMarked) "/" ".forward" * LIST (\HasNoChildren) "/" "INBOX" a OK List completed. b lsub "" * * LSUB () "/" "Admin" * LSUB () "/" "CCIP" * LSUB () "/" "Clement" * LSUB () "/" "Drafts" * LSUB () "/" "ESIEE" * LSUB () "/" "FPS" * LSUB () "/" "PRIVE" * LSUB () "/" "Sent" * LSUB () "/" "Templates" * LSUB () "/" "Trash" * LSUB () "/" "UMLV" * LSUB () "/" "Caille" * LSUB () "/" "Postmaster" * LSUB () "/" "Junk" * LSUB () "/" "Archives" * LSUB () "/" "bkup-ldap" * LSUB () "/" "Apple" * LSUB () "/" "Deleted Messages" * LSUB () "/" "Sent Messages" * LSUB () "/" "Notes" * LSUB () "/" "EmailStuff" * LSUB () "/" "LISTSERV" * LSUB () "/" "RENATER" * LSUB () "/" "Free" * LSUB () "/" "filers" * LSUB () "/" "PRIVE2" * LSUB () "/" "INBOX" * LSUB () "/" "SUSE-NOVELL" * LSUB () "/" "SYBASE" * LSUB () "/" "Nono" * LSUB () "/" "NGINX" * LSUB () "/" "DIFFGEN" * LSUB () "/" "ADESOFT" * LSUB () "/" "RENATER-TCS" * LSUB () "/" "Forensic" * LSUB () "/" "EnCours" * LSUB () "/" "BSD" * LSUB () "/" "NYP" * LSUB () "/" "NetAPP" b OK Lsub completed. c select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk $Forwarded $MDNSent $label1 $label4) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk $Forwarded $MDNSent $label1 $label4 \*)] Flags permitted. * 564 EXISTS * 0 RECENT * OK [UNSEEN 557] First unseen. * OK [UIDVALIDITY 1219087912] UIDs valid * OK [UIDNEXT 1049549] Predicted next UID * OK [NOMODSEQ] No permanent modsequences c OK [READ-WRITE] Select completed. From tss at iki.fi Wed Aug 1 15:06:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 15:06:07 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <501910B3.2030306@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> Message-ID: <1343822767.19913.81.camel@hurina> See what you get by running the maildir through: http://dovecot.org/tools/maildir-size-check.sh From tss at iki.fi Wed Aug 1 15:07:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 15:07:49 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50191A58.8030404@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> Message-ID: <1343822869.19913.82.camel@hurina> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: > > where the will probably work if you do something like: > > > > a list "" * > > b lsub "" * > > c select inbox > > > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > > > I ran it anyway , the output is below All good, except the error didn't happen. So you'd need to look at the IMAP traffic to see which command generates the error. From f.bonnet at esiee.fr Wed Aug 1 15:10:59 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:10:59 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <1343822869.19913.82.camel@hurina> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> Message-ID: <50191CD3.7010902@esiee.fr> On 08/01/2012 02:07 PM, Timo Sirainen wrote: > On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>> where the will probably work if you do something like: >>> >>> a list "" * >>> b lsub "" * >>> c select inbox >>> >>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >> >> I ran it anyway , the output is below > All good, except the error didn't happen. So you'd need to look at the > IMAP traffic to see which command generates the error. > > we use thunderbird, maybe trying with evolution give some way ? From robert at schetterer.org Wed Aug 1 15:12:40 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:12:40 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <1343822767.19913.81.camel@hurina> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> Message-ID: <50191D38.4010908@schetterer.org> Am 01.08.2012 14:06, schrieb Timo Sirainen: > See what you get by running the maildir through: > http://dovecot.org/tools/maildir-size-check.sh > > tons of i.e Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong S=2647728 value, should be S=3838835 -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 15:17:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:17:49 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50191D38.4010908@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> Message-ID: <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> On 1.8.2012, at 15.12, Robert Schetterer wrote: > Am 01.08.2012 14:06, schrieb Timo Sirainen: >> See what you get by running the maildir through: >> http://dovecot.org/tools/maildir-size-check.sh >> >> > > tons of i.e > > Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong > S=2647728 value, should be S=3838835 If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails and do those other checks, since it updates the uidlists and doesn't cause UIDs to change.) From tss at iki.fi Wed Aug 1 15:19:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:19:20 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50191CD3.7010902@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: On 1.8.2012, at 15.10, Frank Bonnet wrote: > On 08/01/2012 02:07 PM, Timo Sirainen wrote: >> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>> where the will probably work if you do something like: >>>> >>>> a list "" * >>>> b lsub "" * >>>> c select inbox >>>> >>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>> >>> I ran it anyway , the output is below >> All good, except the error didn't happen. So you'd need to look at the >> IMAP traffic to see which command generates the error. >> >> > we use thunderbird, maybe trying with evolution give some way ? Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. From robert at schetterer.org Wed Aug 1 15:25:00 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:25:00 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> Message-ID: <5019201C.3000106@schetterer.org> Am 01.08.2012 14:17, schrieb Timo Sirainen: > On 1.8.2012, at 15.12, Robert Schetterer wrote: > >> Am 01.08.2012 14:06, schrieb Timo Sirainen: >>> See what you get by running the maildir through: >>> http://dovecot.org/tools/maildir-size-check.sh >>> >>> >> >> tons of i.e >> >> Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong >> S=2647728 value, should be S=3838835 > > If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. i will try things couldn not get more worst > > (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails jep compressed is a must have and do those other checks, since it updates the uidlists and doesn't cause UIDs to change.) > i will report next using script -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 15:29:27 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:29:27 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: <50192127.3060803@esiee.fr> On 08/01/2012 02:19 PM, Timo Sirainen wrote: > On 1.8.2012, at 15.10, Frank Bonnet wrote: > >> On 08/01/2012 02:07 PM, Timo Sirainen wrote: >>> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>>> where the will probably work if you do something like: >>>>> >>>>> a list "" * >>>>> b lsub "" * >>>>> c select inbox >>>>> >>>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>>> I ran it anyway , the output is below >>> All good, except the error didn't happen. So you'd need to look at the >>> IMAP traffic to see which command generates the error. >>> >>> >> we use thunderbird, maybe trying with evolution give some way ? > Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. > ok understood , I have looked carrefully in logs , it *seems* to happen ONLY at the first connection of the day ... would it be possible ? would it be a caching problem ? From robert at schetterer.org Wed Aug 1 15:43:17 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:43:17 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <5019201C.3000106@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> Message-ID: <50192465.7080805@schetterer.org> Am 01.08.2012 14:25, schrieb Robert Schetterer: > Am 01.08.2012 14:17, schrieb Timo Sirainen: >> On 1.8.2012, at 15.12, Robert Schetterer wrote: >> >>> Am 01.08.2012 14:06, schrieb Timo Sirainen: >>>> See what you get by running the maildir through: >>>> http://dovecot.org/tools/maildir-size-check.sh >>>> >>>> >>> >>> tons of i.e >>> >>> Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong >>> S=2647728 value, should be S=3838835 >> >> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. > > i will try things couldn not get more worst >> >> (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails > > jep compressed is a must have > > and do those other checks, since it updates the uidlists and doesn't > cause UIDs to change.) >> > > i will report next using script > ./maildir-size-check.sh -f maildir is an unknown option...? -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 15:58:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:58:38 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50192465.7080805@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> Message-ID: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> On 1.8.2012, at 15.43, Robert Schetterer wrote: >>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >> >> i will try things couldn not get more worst > > ./maildir-size-check.sh -f maildir is an unknown option...? Oh, looks like I forgot to re-upload it after adding that option. It's there now. From tlx at leuxner.net Wed Aug 1 16:31:30 2012 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 1 Aug 2012 15:31:30 +0200 Subject: [Dovecot] can't recieve emails to inbox In-Reply-To: References: Message-ID: <20120801133130.GA6049@nihlus.leuxner.net> On Wed, Aug 01, 2012 at 04:48:01PM +0530, Rafael Nathan wrote: > I am unable to send emails to virtual users I created. Here is my output > for dovecot -n > > I sent an email to user1 at mydomain.com from gmail.com but can view it > anywhere. Your MTA logs will most likely show. Anyway this version is ages old and you should update to a current supported branch. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From robert at schetterer.org Wed Aug 1 16:39:17 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 15:39:17 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> Message-ID: <50193185.4050309@schetterer.org> Am 01.08.2012 14:58, schrieb Timo Sirainen: > On 1.8.2012, at 15.43, Robert Schetterer wrote: > >>>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >>> >>> i will try things couldn not get more worst >> >> ./maildir-size-check.sh -f maildir is an unknown option...? > > Oh, looks like I forgot to re-upload it after adding that option. It's there now. > looks like working fine, but it has some problems with pathnames with special char and spaces -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 16:43:35 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 15:43:35 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: <50193287.10903@esiee.fr> On 08/01/2012 02:19 PM, Timo Sirainen wrote: > On 1.8.2012, at 15.10, Frank Bonnet wrote: > >> On 08/01/2012 02:07 PM, Timo Sirainen wrote: >>> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>>> where the will probably work if you do something like: >>>>> >>>>> a list "" * >>>>> b lsub "" * >>>>> c select inbox >>>>> >>>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>>> I ran it anyway , the output is below >>> All good, except the error didn't happen. So you'd need to look at the >>> IMAP traffic to see which command generates the error. >>> >>> >> we use thunderbird, maybe trying with evolution give some way ? > Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. > do you think imaptest could help ? From tss at iki.fi Wed Aug 1 20:24:36 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 20:24:36 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5018C827.80406@zu-con.org> References: <5018C827.80406@zu-con.org> Message-ID: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> On 1.8.2012, at 9.09, Matthias Rieber wrote: > I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in > a virtual folder dovecot crashes. > > Here's the stacktrace: > > http://pastebin.com/urSDDzku Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad From tss at iki.fi Wed Aug 1 20:58:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 20:58:39 +0300 Subject: [Dovecot] v2.1.9 released Message-ID: <1343843919.18782.22.camel@innu> http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig I've again mostly finished reading and answering most of the mails in Dovecot mailing list. There are a couple annoyingly difficult / time consuming bugreport mails that I haven't replied to yet, but if anyone thinks I should have replied to something already feel free to resend the mail. For the new Redis/memcached dict stuff see http://master.wiki2.dovecot.org/AuthDatabase/Dict and http://master.wiki2.dovecot.org/Quota/Dict I'm thinking about removing the new quota_ignore_save_errors=yes setting in v2.2 and just forcing it enabled always. Thoughts? (I didn't want to change v2.1 behavior by doing this.) The most important changes since v2.1.8: * mail-log plugin: Log mailbox names with UTF-8 everywhere (instead of mUTF-7 in some places and UTF-8 in other places) * director: Changed director_username_hash setting's default from %u to %Lu (= lowercase usernames). This doesn't break any existing installations, but might fix some of them. + doveadm: Added "auth cache flush []" command. + Implemented dict passdb/userdb + Implemented Redis and memcached dict backends, which can be used as auth backends. Redis can also be used as dict-quota backend. + Added plugin { quota_ignore_save_errors=yes } setting to allow saving a mail when quota lookup fails with temporary failure. - Full text search indexing might have failed for some messages, always causing indexer-worker process to run out of memory. - fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC when the header wasn't lowercased. - fts-squat: Fixed crash when searching a virtual mailbox. - pop3: Fixed assert crash when doing UIDL on empty mailbox on some setups. - auth: GSSAPI RFC compliancy and error handling fixes. - Various fixes related to handling shared namespaces From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 21:09:29 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 20:09:29 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> Message-ID: <20120801180929.GA7779@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 7.32, Daniel Parthey wrote: > > >> Do you see any errors in logs? Especially: > >> > >> director: Error: connect(ipc) failed: Permission denied > > > > Looks very familiar to me. > > > > I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. > > I added a note about it to http://wiki2.dovecot.org/Director#Other_settings > > doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. > > service ipc { > unix_listener ipc { > user = dovecot > } > } Thanks, Timo. Does this apply to the mailbox config or the director config? Which instance needs to access the ipc socket of which instance? Regards Daniel -- https://plus.google.com/103021802792276734820 From tss at iki.fi Wed Aug 1 21:10:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:10:40 +0300 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <20120801180929.GA7779@daniel.localdomain> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: On 1.8.2012, at 21.09, Daniel Parthey wrote: >> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >> >> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >> >> service ipc { >> unix_listener ipc { >> user = dovecot >> } >> } > > Thanks, Timo. > > Does this apply to the mailbox config or the director config? > Which instance needs to access the ipc socket of which instance? director instance needs access to director instance. From ml at smtp.fakessh.eu Wed Aug 1 21:12:58 2012 From: ml at smtp.fakessh.eu (ml) Date: Wed, 01 Aug 2012 20:12:58 +0200 Subject: [Dovecot] v2.1.9 released In-Reply-To: <1343843919.18782.22.camel@innu> References: <1343843919.18782.22.camel@innu> Message-ID: <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> the recurring problems of these minor errors that often appear timesmap. I almost successful make them disappear with an ultra clean install. they appearing more generally for L INBOX Trash Le 2012-08-01 19:58, Timo Sirainen a ?crit?: > http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz > http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig > > I've again mostly finished reading and answering most of the mails in > Dovecot mailing list. There are a couple annoyingly difficult / time > consuming bugreport mails that I haven't replied to yet, but if > anyone > thinks I should have replied to something already feel free to resend > the mail. > > For the new Redis/memcached dict stuff see > http://master.wiki2.dovecot.org/AuthDatabase/Dict and > http://master.wiki2.dovecot.org/Quota/Dict > > I'm thinking about removing the new quota_ignore_save_errors=yes > setting > in v2.2 and just forcing it enabled always. Thoughts? (I didn't want > to > change v2.1 behavior by doing this.) > > The most important changes since v2.1.8: > > * mail-log plugin: Log mailbox names with UTF-8 everywhere > (instead of mUTF-7 in some places and UTF-8 in other places) > * director: Changed director_username_hash setting's default from %u > to %Lu (= lowercase usernames). This doesn't break any existing > installations, but might fix some of them. > > + doveadm: Added "auth cache flush []" command. > + Implemented dict passdb/userdb > + Implemented Redis and memcached dict backends, which can be used > as > auth backends. Redis can also be used as dict-quota backend. > + Added plugin { quota_ignore_save_errors=yes } setting to allow > saving > a mail when quota lookup fails with temporary failure. > - Full text search indexing might have failed for some messages, > always causing indexer-worker process to run out of memory. > - fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC > when > the header wasn't lowercased. > - fts-squat: Fixed crash when searching a virtual mailbox. > - pop3: Fixed assert crash when doing UIDL on empty mailbox on some > setups. > - auth: GSSAPI RFC compliancy and error handling fixes. > - Various fixes related to handling shared namespaces -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xC2626742 gpg --keyserver pgp.mit.edu --recv-key C2626742 http://about.me/fakessh http://urlshort.eu fakessh @ http://gplus.to/sshfake http://gplus.to/sshswilting http://gplus.to/john.swilting https://lists.fakessh.eu/mailman/ This list is moderated by me, but all applications will be accepted provided they receive a note of presentation From ml-dovecot at zu-con.org Wed Aug 1 21:13:55 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 20:13:55 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> Message-ID: <501971E3.80206@zu-con.org> Hello, Am 01.08.2012 19:24, schrieb Timo Sirainen: > On 1.8.2012, at 9.09, Matthias Rieber wrote: > >> I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in >> a virtual folder dovecot crashes. >> >> Here's the stacktrace: >> >> http://pastebin.com/urSDDzku > > Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: > http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad thanks, but in the meanwhile I moved to Solr, but I've still some, maybe different, crashes. I'll send a report later after upgrading to v2.1.9 (with config and log). Is lucence the better choice? According to the wiki Solr seems to be the most preferred solution. Regards, Matthias From tss at iki.fi Wed Aug 1 21:16:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:16:08 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <501971E3.80206@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501971E3.80206@zu-con.org> Message-ID: <96BC9767-9121-4745-B82D-8A426A94DD53@iki.fi> On 1.8.2012, at 21.13, Matthias Rieber wrote: > Is lucence the better choice? According to the wiki Solr seems to be the most preferred solution. Solr and Lucene both work. Solr has a newer Lucene version, but it requires running a Solr server. From tss at iki.fi Wed Aug 1 21:17:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:17:40 +0300 Subject: [Dovecot] v2.1.9 released In-Reply-To: <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> References: <1343843919.18782.22.camel@innu> <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> Message-ID: On 1.8.2012, at 21.12, ml wrote: > the recurring problems of these minor errors that often appear timesmap. I almost successful make them disappear with an ultra clean install. they appearing more generally for L INBOX Trash Sorry, but that doesn't make any sense. What errors? From ml-dovecot at zu-con.org Wed Aug 1 22:21:47 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 21:21:47 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> Message-ID: <501981CB.3030709@zu-con.org> Hi, Am 01.08.2012 19:24, schrieb Timo Sirainen: > On 1.8.2012, at 9.09, Matthias Rieber wrote: > >> I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in >> a virtual folder dovecot crashes. >> >> Here's the stacktrace: >> >> http://pastebin.com/urSDDzku > > Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: > http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad here are the crashes with fts_solr: Configuration ------------- # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-vserver-amd64 x86_64 Debian 5.0.10 auth_master_user_separator = * disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = virtual fts fts_solr zlib acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = yes inbox = no list = no location = prefix = mail separator = type = private } namespace { hidden = no inbox = yes location = prefix = separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace { location = maildir:/home/sharedbox/Maildir prefix = shared. separator = . type = public } namespace { list = yes location = maildir:/home/%%n/Maildir prefix = common.%%u. separator = . subscriptions = no type = shared } namespace { hidden = no list = yes location = virtual:~/Maildir/virtual prefix = virtual. separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=7200 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db fts = solr fts_solr = url=http://localhost:8983/solr/ sieve_dir = ~/Maildir/sieve } protocols = imap pop3 sieve service imap { executable = imap vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = , method=PLAIN, rip=10.0.1.3, lip=10.0.1.3, mpid=18561, TLS, session= Aug 1 21:05:37 smtp dovecot: imap(matthias): Disconnected: Logged out in=689 out=239091 Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head Aug 1 21:05:45 smtp dovecot: imap(matthias): Panic: Leaked t_pop() call Aug 1 21:05:45 smtp dovecot: imap(matthias): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636d71] -> /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] -> /usr/local/lib/dov] Aug 1 21:05:45 smtp dovecot: imap(matthias): Fatal: master: service(imap): child 18507 killed with signal 6 (core dumped) Backtrace: Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. [New process 18507] #0 0xf74d6556 in raise () from /lib/libc.so.6 #0 0xf74d6556 in raise () from /lib/libc.so.6 No symbol table info available. #1 0xf74d7d78 in abort () from /lib/libc.so.6 No symbol table info available. #2 0xf7636d85 in default_fatal_finish (type=, status=0) at failures.c:191 backtrace = 0x961f2b0 "/usr/local/lib/dovecot/libdovecot.so.0 [0xf7636d71] -> /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] -> /usr/local/lib/dovecot/l"... #3 0xf7636def in i_internal_fatal_handler (ctx=0xffb97268, format=0xf76620b1 "Leaked t_pop() call", args=0xffb97284 "\024") at failures.c:649 status = 0 #4 0xf76370c4 in i_panic (format=0xf76620b1 "Leaked t_pop() call") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} #5 0xf76348e1 in t_pop_check (id=0xffb972c8) at data-stack.c:271 No locals. #6 0x08056c6a in client_handle_input (client=0x9670768) at imap-client.c:787 _data_stack_cur_id = 3 ret = true remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #7 0x0805765f in client_input (client=0x9670768) at imap-client.c:825 cmd = output = (struct ostream *) 0x9671094 bytes = __FUNCTION__ = "client_input" #8 0xf7644f12 in io_loop_call_io (io=0x96710f8) at ioloop.c:379 ioloop = (struct ioloop *) 0x96273f8 t_id = 2 #9 0xf76460d0 in io_loop_handler_run (ioloop=0x96273f8) at ioloop-epoll.c:213 ctx = (struct ioloop_handler_context *) 0x96275e0 event = (const struct epoll_event *) 0x9627620 list = (struct io_list *) 0x9671128 io = (struct io_file *) 0x6 tv = {tv_sec = 1799, tv_usec = 998952} msecs = ret = 1 i = 0 j = 0 call = false #10 0xf7644ea0 in io_loop_run (ioloop=0x96273f8) at ioloop.c:398 No locals. #11 0xf762d87d in master_service_run (service=0x9627328, callback=0x80607c0 ) at master-service.c:543 No locals. #12 0x08060684 in main (argc=1329791025, argv=0x4749464e) at main.c:389 login_set = {auth_socket_path = 0x961f068 "/usr/local/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x8060960 , failure_callback = 0x8060900 } service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = set_roots = {0x8063340, 0x0} Crash 2 ------- What I did: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. a LOGIN matthias XXXX a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE SEARCH=FUZZY COMPRESS=DEFLATE ACL RIGHTS=texk] Logged in a SELECT virtual.spam.disagree.spamassassin * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 198 EXISTS * 6 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1343840294] UIDs valid * OK [UIDNEXT 417] Predicted next UID * OK [NOMODSEQ] No permanent modsequences a OK [READ-WRITE] Select completed. a SEARCH OR HEADER FROM foobar HEADER SUBJECT barfoos (server disconnects) Log: Aug 1 21:10:01 smtp dovecot: imap-login: Login: user=, method=PLAIN, rip=10.0.1.3, lip=10.0.1.3, mpid=20709, TLS, session= Aug 1 21:10:15 smtp dovecot: imap(matthias): Fatal: master: service(imap): child 20642 killed with signal 11 (core dumped) Backtrace: Core was generated by `dovecot/imap'. Program terminated with signal 11, Segmentation fault. [New process 20642] #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 125 for (i = 0; result->box_results[i].box != NULL; i++) { #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 _data_stack_cur_id = 4 #1 0xf734447b in fts_search_lookup (fctx=0x897cfc8) at fts-search.c:350 last_uid = 409 seq1 = 192 seq2 = 198 __FUNCTION__ = "fts_search_lookup" #2 0xf7345dc7 in fts_mailbox_search_init (t=0x897d910, args=0x8995518, sort_program=0x0, wanted_fields=0, wanted_headers=0x0) at fts-storage.c:199 flist = (struct fts_mailbox_list *) 0x8949898 ctx = (struct mail_search_context *) 0x8953068 fctx = (struct fts_search_context *) 0x897cfc8 #3 0xf776cf47 in mailbox_search_init (t=0x897d910, args=0x8995518, sort_program=0x0, wanted_fields=0, wanted_headers=0x0) at mail-storage.c:1402 No locals. #4 0x0805d741 in imap_search_start (ctx=0x894c238, sargs=0x8995518, sort_program=0x0) at imap-search.c:550 cmd = (struct client_command_context *) 0x894c180 #5 0x08053ac6 in cmd_search (cmd=0x894c180) at cmd-search.c:45 ctx = sargs = (struct mail_search_args *) 0x8995518 args = (const struct imap_arg *) 0x894ea88 charset = 0x8061738 "UTF-8" ret = #6 0x08057b03 in command_exec (cmd=0x894c180) at imap-commands.c:148 hook = (const struct command_hook *) 0x8903260 ret = false #7 0x08056a3f in client_command_input (cmd=0x894c180) at imap-client.c:682 client = (struct client *) 0x894b768 command = __FUNCTION__ = "client_command_input" #8 0x08056ae1 in client_command_input (cmd=0x894c180) at imap-client.c:733 client = (struct client *) 0x894b768 command = (struct command *) 0x0 __FUNCTION__ = "client_command_input" #9 0x08056c5d in client_handle_input (client=0x894b768) at imap-client.c:774 _data_stack_cur_id = 3 ret = false remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #10 0x0805765f in client_input (client=0x894b768) at imap-client.c:825 cmd = output = (struct ostream *) 0x894c094 bytes = __FUNCTION__ = "client_input" #11 0xf76c7f12 in io_loop_call_io (io=0x894c0f8) at ioloop.c:379 ioloop = (struct ioloop *) 0x89023f8 t_id = 2 #12 0xf76c90d0 in io_loop_handler_run (ioloop=0x89023f8) at ioloop-epoll.c:213 ctx = (struct ioloop_handler_context *) 0x89025e0 event = (const struct epoll_event *) 0x8902620 list = (struct io_list *) 0x894c128 io = (struct io_file *) 0x0 tv = {tv_sec = 1789, tv_usec = 618880} msecs = ret = 1 i = 0 j = 0 call = 16 #13 0xf76c7ea0 in io_loop_run (ioloop=0x89023f8) at ioloop.c:398 No locals. #14 0xf76b087d in master_service_run (service=0x8902328, callback=0x80607c0 ) at master-service.c:543 No locals. #15 0x08060684 in main (argc=1329791025, argv=0x4749464e) at main.c:389 login_set = {auth_socket_path = 0x88fa068 "/usr/local/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x8060960 , failure_callback = 0x8060900 } service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = set_roots = {0x8063340, 0x0} Regards, Matthias From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 22:32:09 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 21:32:09 +0200 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: <20120710224947.GA10641@daniel.localdomain> References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> Message-ID: <20120801193209.GA9069@daniel.localdomain> Daniel Parthey wrote: > Timo Sirainen wrote: > > On 29.6.2012, at 19.21, Daniel Parthey wrote: > > > > > Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): > > > Error: user user31 at domain1.example.org: Error reading configuration: > > > net_connect_unix(/var/run/dovecot/config) failed: Permission denied > > > > I've noticed a similar problem happening somewhat randomly, but I still > > haven't looked into why exactly it happens. Anyway the attached patch should > > fix this specific error, but I'm not sure if there isn't another one. Try and > > let me know? :) > > Unfortunately, the problem still persists with dovecot 2.1.8, > which already contains the following code: > > enum master_service_flags service_flags = > MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN; > const char *error; > master_service = master_service_init("doveadm", service_flags, > &argc, &argv, NULL); > if (master_getopt(master_service) > 0) > return FATAL_DEFAULT; > > The command > /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A > still generates the following errors after iterating some dozen users: > > doveadm(nagios at metaways.de): Error: doveadm server failure > doveadm: Error: Failed to iterate through some users > > Which information should I provide to help debugging the problem? The change in 2.1.8 didn't fix it and still does not iterate *all* users. My current workaround is to list all users, run a for-loop over the userlist and flush one mailbox after another via the director. Any hints how to solve this? Regards Daniel -- https://plus.google.com/103021802792276734820 From tss at iki.fi Wed Aug 1 22:45:56 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 22:45:56 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <501981CB.3030709@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> Message-ID: <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> On 1.8.2012, at 22.21, Matthias Rieber wrote: > here are the crashes with fts_solr: .. > Crash 1 > Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 > Crash 2 > #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 > 125 for (i = 0; result->box_results[i].box != NULL; i++) { Fixed: http://hg.dovecot.org/dovecot-2.1/rev/323d6ce62567 From tss at iki.fi Wed Aug 1 22:56:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 22:56:39 +0300 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: <20120801193209.GA9069@daniel.localdomain> References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: On 1.8.2012, at 22.32, Daniel Parthey wrote: >>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): >>>> Error: user user31 at domain1.example.org: Error reading configuration: >>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied > The change in 2.1.8 didn't fix it and still does not iterate *all* users. > My current workaround is to list all users, run a for-loop over the userlist > and flush one mailbox after another via the director. > > Any hints how to solve this? The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 464 bytes Desc: not available URL: -------------- next part -------------- From ml-dovecot at zu-con.org Wed Aug 1 23:06:09 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 22:06:09 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> Message-ID: <50198C31.5070902@zu-con.org> Hi, Am 01.08.2012 21:45, schrieb Timo Sirainen: > On 1.8.2012, at 22.21, Matthias Rieber wrote: > >> here are the crashes with fts_solr: > .. >> Crash 1 >> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head > > The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 I thought non-fulltext searches were done by dovecot itself? Matthias From tss at iki.fi Wed Aug 1 23:14:53 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 23:14:53 +0300 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: On 1.8.2012, at 22.56, Timo Sirainen wrote: > On 1.8.2012, at 22.32, Daniel Parthey wrote: > >>>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): >>>>> Error: user user31 at domain1.example.org: Error reading configuration: >>>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied >> The change in 2.1.8 didn't fix it and still does not iterate *all* users. >> My current workaround is to list all users, run a for-loop over the userlist >> and flush one mailbox after another via the director. >> >> Any hints how to solve this? > > The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) Also I wonder if this helps (at least it fixes a crash I managed to cause): http://hg.dovecot.org/dovecot-2.1/rev/476381017ec7 From tss at iki.fi Wed Aug 1 23:16:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 23:16:57 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <50198C31.5070902@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> Message-ID: <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> On 1.8.2012, at 23.06, Matthias Rieber wrote: >>> here are the crashes with fts_solr: >> .. >>> Crash 1 >>> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head >> >> The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 > > I thought non-fulltext searches were done by dovecot itself? They are, but header searches are part of full text search. From peter at grimmond.org Wed Aug 1 23:22:35 2012 From: peter at grimmond.org (Peter Grimmond) Date: Wed, 1 Aug 2012 20:22:35 +0000 Subject: [Dovecot] Problem with preserving MIME format with Dovecot IMAP and Outlook Message-ID: From ml-dovecot at zu-con.org Wed Aug 1 23:23:59 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 22:23:59 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> Message-ID: <5019905F.3010102@zu-con.org> Am 01.08.2012 22:16, schrieb Timo Sirainen: > On 1.8.2012, at 23.06, Matthias Rieber wrote: > >>>> here are the crashes with fts_solr: >>> .. >>>> Crash 1 >>>> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head >>> >>> The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 >> >> I thought non-fulltext searches were done by dovecot itself? > > They are, but header searches are part of full text search. alright. Some resources say that "413 FULL head" means request too large. Maybe that's caused by the pretty big folder virtual.all which contains more than 360000 mails. Matthias From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 23:25:02 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 22:25:02 +0200 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: <20120801202502.GA9951@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 22.32, Daniel Parthey wrote: > > >>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): > >>>> Error: user user31 at domain1.example.org: Error reading configuration: > >>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied > > The change in 2.1.8 didn't fix it and still does not iterate *all* users. > > My current workaround is to list all users, run a for-loop over the userlist > > and flush one mailbox after another via the director. > > > > Any hints how to solve this? > > The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) Running command on a four host setup with mailbox+director instance each: /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A Output is: doveadm(username at example.org): Error: doveadm server failure doveadm: Error: Failed to iterate through some users Log says: dovecot: doveadm(username at example.org): Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied (euid=501(vmail) egid=123(vmail) missing +r perm: /var/run/dovecot/auth-userdb, we're not in group 122(dovecot), dir owned by 0:0 mode=0755) dovecot: doveadm(username at example.org): Error: purge: User lookup failed: Internal error occurred. Refer to server log for more information. Here are the directory permissions: mail01:~# id vmail uid=501(vmail) gid=123(vmail) groups=123(vmail) mail01:~# id dovecot uid=120(dovecot) gid=122(dovecot) groups=122(dovecot) mail01:~# ls -ld /var/run/dovecot drwxr-xr-x 4 root root 660 2012-07-11 18:35 /var/run/dovecot mail01:~# ls -l /var/run/dovecot total 8 srw------- 1 root root 0 2012-07-10 18:29 anvil srw------- 1 root root 0 2012-07-10 18:29 anvil-auth-penalty srw------- 1 root root 0 2012-07-11 18:35 auth-client srw------- 1 dovecot root 0 2012-07-11 18:35 auth-login srw------- 1 root root 0 2012-07-11 18:35 auth-master srw-rw---- 1 dovecot dovecot 0 2012-07-11 18:35 auth-userdb srw------- 1 dovecot root 0 2012-07-11 18:35 auth-worker srw------- 1 root root 0 2012-07-11 18:35 config srw-rw---- 1 root vmail 0 2012-07-11 18:35 dict srw------- 1 root root 0 2012-07-11 18:35 director-admin srw------- 1 root root 0 2012-07-10 10:19 director-userdb srw-rw-rw- 1 root root 0 2012-07-11 18:35 dns-client srw------- 1 root root 0 2012-07-11 18:35 doveadm-server lrwxrwxrwx 1 root root 25 2012-07-10 18:29 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 40 2012-07-10 10:19 empty srw------- 1 root root 0 2012-07-11 18:35 imap-postlogin srw-rw-rw- 1 root root 0 2012-07-11 18:35 indexer srw------- 1 dovecot root 0 2012-07-11 18:35 indexer-worker srw------- 1 root root 0 2012-07-11 18:35 ipc srw-rw-rw- 1 root root 0 2012-07-11 18:35 lmtp srw------- 1 root root 0 2012-07-11 18:35 log-errors drwxr-x--- 2 root nogroup 180 2012-07-11 18:35 login -rw------- 1 root root 5 2012-07-10 18:29 master.pid -rw-r--r-- 1 root root 71 2012-07-10 18:29 mounts srw------- 1 root root 0 2012-07-11 18:35 pop3-postlogin srw------- 1 vmail root 0 2012-07-11 18:35 quota-warning srw------- 1 root root 0 2012-07-11 18:35 replication-notify prw------- 1 root root 0 2012-07-11 18:35 replication-notify-fifo srw------- 1 dovecot root 0 2012-07-11 18:35 replicator srw------- 1 root root 0 2012-07-11 18:35 stats prw------- 1 vmail root 0 2012-08-01 22:20 stats-mail Please see mailbox and director config attached. Any help is appreciated. Regards Daniel -- https://plus.google.com/103021802792276734820 -------------- next part -------------- # 2.1.8: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_verbose = yes auth_verbose_passwords = sha1 deliver_log_format = mailbox: deliver: msgid=%m from=%f: %$ dict { quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = xxx imapc_features = rfc822.size imapc_host = local-mailbox imapc_port = 18143 instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Mailbox login_log_format = mailbox: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "mailbox: mail: %s(%u): " mail_plugins = quota stats mail_privileged_group = vmail mail_uid = vmail managesieve_implementation_string = Sieve managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 50 M mmap_disable = yes passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = dovecot mode = 0660 user = dovecot } } service dict { unix_listener dict { group = vmail mode = 0660 } } service doveadm { inet_listener doveadm-server { port = 19000 } } service imap-login { inet_listener imap { port = 19143 } } service imap-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { address = * port = 19024 } } service managesieve-login { inet_listener sieve { port = 19200 } } service pop3-login { inet_listener pop3 { port = 19110 } } service pop3-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script /usr/local/bin/quota-warning extra_groups = dovecot unix_listener quota-warning { user = vmail } user = vmail } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = quota stats imap_quota imap_stats } protocol lmtp { mail_plugins = quota stats sieve } -------------- next part -------------- # 2.1.8: /etc/dovecot-director/dovecot-director.conf # OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS auth_verbose = yes auth_verbose_passwords = sha1 base_dir = /var/run/dovecot-director deliver_log_format = director: deliver: msgid=%m from=%f: %$ director_doveadm_port = 20000 director_mail_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_user_expire = 2 days disable_plaintext_auth = no doveadm_password = xxx doveadm_proxy_port = 19000 instance_name = dovecot-director lmtp_proxy = yes login_greeting = Mail Balancer login_log_format = director: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "director: mail: %s(%u): " mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes passdb { args = /etc/dovecot-director/conf.d/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { executable = doveadm-server director inet_listener doveadm-server { port = 20000 } } service imap-login { executable = imap-login director inet_listener imap { port = 20143 } inet_listener imaps { port = 20993 ssl = yes } } service lmtp { inet_listener lmtp { address = * port = 20024 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 20200 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 20110 } inet_listener pop3s { port = 20995 ssl = yes } } ssl_cert = References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> <20120801202502.GA9951@daniel.localdomain> Message-ID: <98D34C84-B1F4-47B3-9145-06E262FC11D7@iki.fi> On 1.8.2012, at 23.25, Daniel Parthey wrote: >> The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) > > Running command on a four host setup with mailbox+director instance each: > /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A > > dovecot: doveadm(username at example.org): Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied (euid=501(vmail) egid=123(vmail) missing +r perm: /var/run/dovecot/auth-userdb, we're not in group 122(dovecot), dir owned by 0:0 mode=0755) Ah, so the original patch helped! This is a different error. > srw-rw---- 1 dovecot dovecot 0 2012-07-11 18:35 auth-userdb Simplest solution now would be to make this world-rw, see the auth-userdb socket configuration in http://wiki2.dovecot.org/LDA#Virtual_users But I guess this should also be fixed by doveadm-server. Although I don't think this should be happening by default anyway. Maybe this is also solved by the http://hg.dovecot.org/dovecot-2.1/rev/476381017ec7 patch? From peter at grimmond.org Wed Aug 1 23:53:00 2012 From: peter at grimmond.org (Peter Grimmond) Date: Wed, 1 Aug 2012 20:53:00 +0000 Subject: [Dovecot] Problem with preserving MIME format with Dovecot IMAP and MS Outlook client Message-ID: Hello all, Apologies for the repost, but I am really struggling to solve this problem... I have installed Dovecot 2.0.19 on Ubuntu 12.04 LTS. I have set up a very basic IMAP configuration. I have two different laptops running MS Outlook (one MacOS, one Windows 7) and I have configured both to connect to the Dovecot service. My problem is, emails in MIME format that I synchronise from one MS Outlook client are not being correctly decoded as MIME messages on the other client. Instead, the message is rendered in plaintext, starting with the lines: This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. --B_3426360453_22814Content-type: multipart/alternative; boundary="B_3426360453_4099" --B_3426360453_4099Content-type: text/plain; charset="ISO-8859-1"Content-transfer-encoding: quoted-printable Can anyone help me understand why this might be happening? The output from dovecot -n is: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-26-generic-pae i686 Ubuntu 12.04 LTS auth_debug = yes auth_verbose = yes disable_plaintext_auth = no mail_location = maildir:~/Maildir passdb { driver = pam } protocols = " imap" ssl_cert = References: Message-ID: <60F3895B-5FE9-4A8A-9273-4FE661C75285@iki.fi> On 1.8.2012, at 23.53, Peter Grimmond wrote: > have installed Dovecot 2.0.19 on Ubuntu 12.04 LTS. I have set up a > very basic IMAP configuration. I have two different laptops running MS > Outlook (one MacOS, one Windows 7) and I have configured both to connect > to the Dovecot service. My problem is, emails in MIME format that I > synchronise from one MS Outlook client are not being correctly decoded > as MIME messages on the other client. Instead, the message is rendered > in plaintext, starting with the lines: Have you tried other clients? Maybe the mails are actually broken? In any case it doesn't really look like a Dovecot problem. From daniel.parthey at informatik.tu-chemnitz.de Thu Aug 2 01:04:46 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Thu, 2 Aug 2012 00:04:46 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <1343822869.19913.82.camel@hurina> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> Message-ID: <20120801220446.GA12171@daniel.localdomain> Timo Sirainen wrote: > On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: > > > where the will probably work if you do something like: > > > > > > a list "" * > > > b lsub "" * > > > c select inbox > > > > > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > > > > I ran it anyway , the output is below > > All good, except the error didn't happen. So you'd need to look at the > IMAP traffic to see which command generates the error. Frank, please do a plaintext connect on IMAP port 143 from your mail client to dovecot with a changed test password and record your traffic using tcpdump or wireshark, something like this: tcpdump -n -s 0 -w /tmp/pcap.dat -i eth0 tcp port 143 Then view the file pcap.dat with wireshark[1], right click on the TCP connection and select "Follow TCP Stream" from the context menu. Then you'll get the IMAP commands and responses spoken between Thunderbird and Dovecot. Regards Daniel [1] http://www.wireshark.org/ -- https://plus.google.com/103021802792276734820 From robert at schetterer.org Thu Aug 2 10:09:24 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 02 Aug 2012 09:09:24 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> Message-ID: <501A27A4.7000303@schetterer.org> Am 01.08.2012 14:58, schrieb Timo Sirainen: > On 1.8.2012, at 15.43, Robert Schetterer wrote: > >>>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >>> >>> i will try things couldn not get more worst >> >> ./maildir-size-check.sh -f maildir is an unknown option...? > > Oh, looks like I forgot to re-upload it after adding that option. It's there now. > Hi Timo, most of the Problems are fixed now many thx for your script , but how to avoid that in future ( Maildir filename has wrong S value ) with Ralf you released a patch diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 @@ -20,6 +20,7 @@ struct mail *mail = mstream->mail; enum mail_lookup_abort orig_lookup_abort; + return FALSE; if (mstream->expected_size != (uoff_t)-1) return TRUE; would it be a good idea to include it in 2.1.9 for me ? as it looks like its not in the public code ? -- Best Regards MfG Robert Schetterer From brad at comstyle.com Thu Aug 2 10:58:45 2012 From: brad at comstyle.com (Brad Smith) Date: Thu, 2 Aug 2012 03:58:45 -0400 Subject: [Dovecot] LZMA2 (xz) support for Dovecot? Message-ID: <20120802075845.GF18868@rox.home.comstyle.com> Timo, Thoughts on adding LZMA2 (xz) support via liblzma to Dovecot? -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. From f.bonnet at esiee.fr Thu Aug 2 11:24:13 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Thu, 02 Aug 2012 10:24:13 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <20120801220446.GA12171@daniel.localdomain> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <20120801220446.GA12171@daniel.localdomain> Message-ID: <501A392D.3070705@esiee.fr> On 08/02/2012 12:04 AM, Daniel Parthey wrote: > Timo Sirainen wrote: >> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>> where the will probably work if you do something like: >>>> >>>> a list "" * >>>> b lsub "" * >>>> c select inbox >>>> >>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>> I ran it anyway , the output is below >> All good, except the error didn't happen. So you'd need to look at the >> IMAP traffic to see which command generates the error. > Frank, please do a plaintext connect on IMAP port 143 from your mail client > to dovecot with a changed test password and record your traffic using tcpdump > or wireshark, something like this: > > tcpdump -n -s 0 -w /tmp/pcap.dat -i eth0 tcp port 143 > > Then view the file pcap.dat with wireshark[1], right click on the TCP connection > and select "Follow TCP Stream" from the context menu. Then you'll get the IMAP > commands and responses spoken between Thunderbird and Dovecot. > > Regards > Daniel > > [1] http://www.wireshark.org/ Hello Thanks for your help. well I did but haven't found anything interrestiing in tcpdump log ... and the problem did not happened this morning since I have mail_debug=no in 10-logging.conf file then restart dovecot ... BTW if it matter the users's home directories is a link than point to the real directory. From rrosenfeld at netcologne.de Thu Aug 2 11:42:57 2012 From: rrosenfeld at netcologne.de (Roland Rosenfeld) Date: Thu, 2 Aug 2012 10:42:57 +0200 Subject: [Dovecot] ACL with MySQL dict => full table scans (was: v2.1.9 released) In-Reply-To: <1343843919.18782.22.camel@innu> References: <1343843919.18782.22.camel@innu> Message-ID: <20120802084257.GB23882@sys-241.netcologne.de> On Wed, 01 Aug 2012, Timo Sirainen wrote: > I've again mostly finished reading and answering most of the mails in > Dovecot mailing list. There are a couple annoyingly difficult / time > consuming bugreport mails that I haven't replied to yet, but if anyone > thinks I should have replied to something already feel free to resend > the mail. I'm not sure where my request was annoying or difficult, but I didn't read an answer to it ;-) http://www.dovecot.org/list/dovecot/2012-July/067130.html Maybe you could have a look at it... Tschoeeee Roland -- Roland Rosenfeld - Content Delivery - NED - Technik NetCologne Gesellschaft f?r Telekommunikation mbH - HRB 25580, AG K?ln Am Coloneum 9 50829 K?ln Tel.: +49 221 2222-373 Fax: +49 221 2222-7373 Gesch?ftsf?hrer: Dr. Hans Konle (Sprecher), Karl-Heinz Zankel From tss at iki.fi Thu Aug 2 16:46:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 2 Aug 2012 16:46:13 +0300 Subject: [Dovecot] LZMA2 (xz) support for Dovecot? In-Reply-To: <20120802075845.GF18868@rox.home.comstyle.com> References: <20120802075845.GF18868@rox.home.comstyle.com> Message-ID: On 2.8.2012, at 10.58, Brad Smith wrote: > Thoughts on adding LZMA2 (xz) support via liblzma to Dovecot? If someone sends a patch I'll add it. Apparently its API should be similar to zlib so probably it's just a matter of renaming some functions and such. From bam at miranda.org Thu Aug 2 19:10:17 2012 From: bam at miranda.org (Bret Martin) Date: Thu, 2 Aug 2012 12:10:17 -0400 Subject: [Dovecot] Overriding inbox= in userdb extra fields Message-ID: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Hello, I'm trying to set up an alternate user with a different inbox using passwd-file and userdb extra fields and the extra field settings don't seem to be taking effect. I've used auth_debug and mail_debug and I'm unclear how I can further troubleshoot this. Is it possible to have inbox=yes in one namespace globally and then override this for one user by setting inbox=no for that namespace and then inbox=yes for another? My doveconf -n is below. I would like to have inbox=yes for the inbox namespace, inbox=no for the virtual namespace, and then be able to invert these for selected users using userdb extra fields. My attempt at doing this so far looks like bam-ios:[REDACTED]:500:500::/home/bam::user=bam namespace/inbox/inbox=no namespace/virtual/inbox=yes Changing the user with user= seems to work fine, but the inbox= changes don't. Here is some relevant log data. Aug 2 11:37:29 new-miranda dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file /etc/dovecot/users: Read 1 users in 0 secs Aug 2 11:37:29 new-miranda dovecot: auth: Debug: auth client connected (pid=14967) Aug 2 11:37:29 new-miranda dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=Rgx2MErG4wBAd51y#011lip=216.93.241.245#011rip=64.119.157.114#011lport=993#011rport=38115#011resp= Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file(bam-ios,64.119.157.114,): lookup: user=bam-ios file=/etc/dovecot/users Aug 2 11:37:29 new-miranda dovecot: auth: Debug: auth(bam-ios,64.119.157.114,): username changed bam-ios -> bam Aug 2 11:37:29 new-miranda dovecot: auth: Debug: client out: OK#0111#011user=bam#011namespace/inbox/inbox=no#011namespace/virtual/inbox=yes Aug 2 11:37:29 new-miranda dovecot: auth: Debug: master in: REQUEST#[REDACTED] Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file(bam,64.119.157.114,): lookup: user=bam file=/etc/dovecot/users Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup Aug 2 11:37:29 new-miranda dovecot: auth: Debug: master out: USER#0111425670145#011bam#011system_groups_user=bam#011uid=500#011gid=500#011home=/home/bam Aug 2 11:37:29 new-miranda dovecot: imap-login: Login: user=, method=PLAIN, rip=64.119.157.114, lip=216.93.241.245, mpid=14970, TLS, session= Aug 2 11:37:29 new-miranda dovecot: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 2 11:37:29 new-miranda dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_virtual_plugin.so Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Effective uid=500, gid=500, home=/home/bam Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/bam/mdbox Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/mdbox, index=, control=, inbox=, alt= Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace : Using permissions from /srv/mail/bam/mdbox: mode=0700 gid=-1 Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace virtual: type=private, prefix=virtual/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=virtual:/srv/mail/bam/virtual Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/virtual, index=, control=, inbox=, alt= Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace mdbox: type=private, prefix=mdbox/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:/srv/mail/bam/mdbox Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/mdbox, index=, control=, inbox=, alt= I also tried not having inbox=yes anywhere in the global configurations, but then I get Aug 2 11:52:22 new-miranda dovecot: imap(bam): Error: user bam: Initialization failed: namespace configuration error: inbox=yes namespace missing I'm having great luck with the virtual plugin, but I only want to use it for the inbox on some clients. Any ideas on why my inbox=yes/no overrides aren't taking effect? Thanks, --Bret # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 ext4 mail_location = mdbox:/srv/mail/%u/mdbox mail_plugins = " virtual" namespace inbox { inbox = no location = prefix = } namespace mdbox { hidden = yes list = no location = prefix = mdbox/ separator = / } namespace virtual { hidden = yes inbox = yes list = no location = virtual:/srv/mail/%u/virtual prefix = virtual/ separator = / } passdb { args = scheme=SSHA512 username_format=%u /etc/dovecot/users driver = passwd-file } passdb { driver = pam } protocols = " imap" service imap-login { inet_listener imap { port = 0 } } ssl_cert = References: Message-ID: 2012/7/31 Timo Sirainen : > On 18.7.2012, at 4.33, Lazy wrote: > >> I wan't it to stay that way. The problem is that it dosn't update the >> quota rules in Maildir when quota is changed in userdb. >> I have the rules avaiable in qmail-lda's environment, but I need an >> idea on how to feed the quota rule string to quota plugin without >> doing userdb lookup. >> >> What whould be the best way to do this, maybe in >> plugins/quota/quota.c:quota_root_add_rules() ? > > dovecot-lda -o plugin/quota_rule=*:storage=1G > thank You ! This is simple and elegant. Sill I need this to be taken from environment, I produced a simple patch adding one '-o' from an environment variable. If You consider this useful I can try and make it more generic, enable multiple option overriding. Regards, Michal Grzedzicki From tss at iki.fi Fri Aug 3 02:27:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 02:27:01 +0300 Subject: [Dovecot] dovecot-lda setting quota rules In-Reply-To: References: Message-ID: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> On 3.8.2012, at 2.13, Lazy wrote: >> dovecot-lda -o plugin/quota_rule=*:storage=1G >> > > thank You ! > > This is simple and elegant. > > Sill I need this to be taken from environment, I produced a simple > patch adding one '-o' from an environment variable. You can also set environment: PLUGIN/QUOTA_RULE=*:storage=1G and then use dovecot-lda -k parameter. And if even that doesn't work, you could simply create a wrapper script. > If You consider this useful I can try and make it more generic, enable > multiple option overriding. You can also give -o parameter multiple times. From ml-dovecot at zu-con.org Fri Aug 3 09:49:52 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Fri, 03 Aug 2012 08:49:52 +0200 Subject: [Dovecot] Mail deletion and Solr index update Message-ID: <501B7490.1020108@zu-con.org> Hi, I've deleted 10000s emails and it seems that every mail is removed with a single request from Solrs index. This works, but it's quite slow. Is it possible/plans to improve that? Matthias From nikolai at net24.co.nz Fri Aug 3 10:04:36 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Fri, 3 Aug 2012 19:04:36 +1200 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout Message-ID: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> Timo, There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 15: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 16: Disconnected ... dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14492: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14493: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14494: Disconnected Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, or it should simply reconnect if sees the connection is lost. At the moment the only work around is to increase the POP3 server's idle timeout to a multi hour value, which isn't a good work around as it causes a lot of inactive POP sessions to bank up. Regards, Nikolai. From stephan at rename-it.nl Fri Aug 3 12:28:36 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 03 Aug 2012 11:28:36 +0200 Subject: [Dovecot] managesieve segfault with gold linker In-Reply-To: <5016A0A3.1020201@caf.com.tr> References: <4FFF3326.9060802@caf.com.tr> <4FFFF01A.9020402@rename-it.nl> <500024B8.2020500@caf.com.tr> <5016A0A3.1020201@caf.com.tr> Message-ID: <501B99C4.2070909@rename-it.nl> On 7/30/2012 4:56 PM, Eray Aslan wrote: > On 07/13/2012 04:38 PM, Eray Aslan wrote: >> I'll try to find out more but I will be on vacation for a few days >> so it might not be quick. > Recap: > When linked with gold, pigeonhole-0.3.1 make check fails with: > dovecot-2.1-pigeonhole-0.3.1/src/testsuite/.libs/lt-testsuite: > symbol lookup error: > dovecot-2.1-pigeonhole-0.3.1/src/lib-sieve/.libs/libdovecot-sieve.so.0: > undefined symbol: mail_deliver_get_log_var_expand_table > > Well, /usr/lib64/dovecot/libdovecot-lda.so provides the > mail_deliver_get_log_var_expand_table symbol, but > /usr/lib64/dovecot/libdovecot-sieve.so doesn't link against it. The > following patch works for me: I applied this patch a while back, but I forgot to mail about it after I tested it. It works also for the normal linker, so I guess it is ok. I cannot produce a URL for the commit right now, because the hg server is down for some unexpected maintenance. Regards, Stephan. From lazy404 at gmail.com Fri Aug 3 12:33:27 2012 From: lazy404 at gmail.com (Lazy) Date: Fri, 3 Aug 2012 11:33:27 +0200 Subject: [Dovecot] dovecot-lda setting quota rules In-Reply-To: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> References: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> Message-ID: it works great. thank You again Regards, Michal Grzedzicki 2012/8/3, Timo Sirainen : > On 3.8.2012, at 2.13, Lazy wrote: > >>> dovecot-lda -o plugin/quota_rule=*:storage=1G >>> >> >> thank You ! >> >> This is simple and elegant. >> >> Sill I need this to be taken from environment, I produced a simple >> patch adding one '-o' from an environment variable. > > You can also set environment: > > PLUGIN/QUOTA_RULE=*:storage=1G > > and then use dovecot-lda -k parameter. > > And if even that doesn't work, you could simply create a wrapper script. > >> If You consider this useful I can try and make it more generic, enable >> multiple option overriding. > > You can also give -o parameter multiple times. > From dgp-dove at corefiling.co.uk Fri Aug 3 14:30:34 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Fri, 03 Aug 2012 12:30:34 +0100 Subject: [Dovecot] Pigeonhole sieve include namespace regression Message-ID: <501BB65A.2090601@corefiling.co.uk> Hi, We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. We provide a selection of global sieve scripts to make users' lives easier and one noticed that some of these have stopped working. I tracked it down to them having personal scripts with the same name. Using a really simple sieve script: require "include"; include :personal "svn"; include :global "svn"; sievec debug output for sieve 0.1.18 (trimmed a bit): * Required extensions: 0: include (16) 1: fileinto (5) * Included personal script 'svn' (block: 3): [script code here] * Included global script 'svn' (block: 4): [script code here] * Main program (block: 1): 00000000: EXTENSIONS [1]: 00000001: include 00000002: INCLUDE: 00000004: script: svn.sieve [ID: 1, BLOCK: 3] 00000006: INCLUDE: 00000008: script: svn.sieve [ID: 2, BLOCK: 4] 0000000a: [End of code] sievec debug output for Pigeonhole 0.3.1: * Required extensions (block: 1): 0: include (id: 16; block: 4) 1: fileinto (id: 5) * Included personal script 'svn' (block: 5): [script code here] * Main program (block: 2): Address Line Code 00000000: DEBUG BLOCK: 3 00000001: EXTENSIONS [1]: 00000002: include 00000003: 2: INCLUDE: 00000005: script: `svn' from /home/notroot/sieve/svn.sieve [ID: 1, BLOCK: 5] 00000007: 3: INCLUDE: 00000009: script: `svn' from /home/notroot/sieve/svn.sieve [ID: 1, BLOCK: 5] 0000000b: 3: [End of code] As can be seen the personal script is included twice. Obvious work around is to rename the personal script. However it'd be nice if namespacing came back. Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From sandro.tosi at dada.eu Fri Aug 3 15:03:28 2012 From: sandro.tosi at dada.eu (Sandro Tosi) Date: Fri, 03 Aug 2012 14:03:28 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages Message-ID: <501BBE10.5040209@dada.eu> Hello, we're setting up a weird platform where every incoming email is passed from the MTA directly to a tool that then uses dovecot LMTP to deliver the message into the user mailbox. We are legally *not* allowed to run antispam on all the incoming messages, but only on some of them, as they are recognized by the aforementioned tool; but given that tool directly uses LMTP to delivers the mail we need to find a way to parse the messages passing thru LMTP and run spamassassin only on those matching some regex on subject and mail body. Is is possible to do that with some dovecot LMTP feature? i've read a lot of documentation about how to possibly implement it and it *seems* there would be a way using pigeonhole sieve and extprograms - what do you think? The idea I have in mind is something like: 1. identify the mails we want to scan with spamassassin (using regex or whatever else to precisely pin-point them) 2. run SA on those 3. in case it's spam, rewrite the subject (or similar) Do you think it's something doable with dovecot? Thanks in advance, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi at register.it From h.reindl at thelounge.net Fri Aug 3 15:09:44 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Aug 2012 14:09:44 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBE10.5040209@dada.eu> References: <501BBE10.5040209@dada.eu> Message-ID: <501BBF88.7080403@thelounge.net> Am 03.08.2012 14:03, schrieb Sandro Tosi: > We are legally *not* allowed to run antispam on all the incoming messages you ARE allowed if you are doing it right right in this context means you have to run the filter pre-queue and REJECT blocked messages, so the sending server knows that you did NOT accept the message and can send a bounce to his user wrong in this context means you accept the message, filter it after that and throw it away while the sender has a confirmed delivery - this is a legal problem in the first front and technically wrong because you risk to become a backscatter by starting active bounes on your server if you are not 100% sure how all the pieces work togehter and how the whole system acts in each situation bringing LMTP and Dovecot in the context of spam-filtering is automatically doing it completly wrong -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From sandro.tosi at dada.eu Fri Aug 3 15:17:57 2012 From: sandro.tosi at dada.eu (Sandro Tosi) Date: Fri, 03 Aug 2012 14:17:57 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBF88.7080403@thelounge.net> References: <501BBE10.5040209@dada.eu> <501BBF88.7080403@thelounge.net> Message-ID: <501BC175.9050005@dada.eu> Hello, thanks for you reply. On 08/03/2012 02:09 PM, Reindl Harald wrote: > > > Am 03.08.2012 14:03, schrieb Sandro Tosi: >> We are legally *not* allowed to run antispam on all the incoming messages > > you ARE allowed if you are doing it right please.. don't consider everyone that writes a junior with no experience, I know what i'm doing :) In a classic mail setup, i'd have done as you described, but the introduction of my email makes it clear this is a particular situation. as I said, we *cannot* do it the "standard way"! we are forced to accept messages if they come in a particular format (yes even spam ones), and we can only run SA on a subset if the incoming mails, as decided by the tool we're passing all the messages to. Now, getting back on topic, is it possible to do what I have in mind? is there some other solutions to achieve my goal? Regards, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi at register.it From robert at schetterer.org Fri Aug 3 15:45:33 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 14:45:33 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBE10.5040209@dada.eu> References: <501BBE10.5040209@dada.eu> Message-ID: <501BC7ED.1090003@schetterer.org> Am 03.08.2012 14:03, schrieb Sandro Tosi: > Hello, > we're setting up a weird platform where every incoming email is passed > from the MTA directly to a tool that then uses dovecot LMTP to deliver > the message into the user mailbox. > > We are legally *not* allowed to run antispam on all the incoming > messages, but only on some of them, as they are recognized by the > aforementioned tool; but given that tool directly uses LMTP to delivers > the mail we need to find a way to parse the messages passing thru LMTP > and run spamassassin only on those matching some regex on subject and > mail body. > > Is is possible to do that with some dovecot LMTP feature? > > i've read a lot of documentation about how to possibly implement it and > it *seems* there would be a way using pigeonhole sieve and extprograms - > what do you think? > > The idea I have in mind is something like: > > 1. identify the mails we want to scan with spamassassin (using regex or > whatever else to precisely pin-point them) > 2. run SA on those > 3. in case it's spam, rewrite the subject (or similar) > > Do you think it's something doable with dovecot? > > Thanks in advance, you may use global sieve rules perhaps look here for ideas http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples#Spam.2BAC8-Virus_rules -- Best Regards MfG Robert Schetterer From voytek at sbt.net.au Fri Aug 3 16:09:47 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:09:47 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <4FFC1340.6060607@schetterer.org> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: On Tue, July 10, 2012 9:34 pm, Robert Schetterer wrote: > perhaps use daily cron with something like this > > doveadm expunge -A mailbox Junk savedbefore 7d; where am I going wrong ? nothing gets removed: # pwd /var/mail/vhosts/sbt.net.au/spam at sbt.net.au/.spam/cur # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7day # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 5d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 4d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 3d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 2d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1w # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox .spam savedbefore 1w # ls | wc 532 532 30884 ------------- ls -al -rw------- 1 vmail vmail 5921 Jul 9 21:55 1341834948.M445074P17475.geko.sbt.net.au,S=5921,W=6003:2, -rw------- 1 vmail vmail 3021 Jul 9 22:06 1341835577.M701903P17756.geko.sbt.net.au,S=3021,W=3125:2, .... -- Voytek From robert at schetterer.org Fri Aug 3 16:14:05 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 15:14:05 +0200 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: <501BCE9D.5050303@schetterer.org> Am 03.08.2012 15:09, schrieb Voytek Eymont: > > On Tue, July 10, 2012 9:34 pm, Robert Schetterer wrote: > >> perhaps use daily cron with something like this >> >> doveadm expunge -A mailbox Junk savedbefore 7d; > > where am I going wrong ? > > nothing gets removed: > > # pwd > /var/mail/vhosts/sbt.net.au/spam at sbt.net.au/.spam/cur > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7day > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 5d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 4d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 3d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 2d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1w > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox .spam savedbefore 1w > # ls | wc > 532 532 30884 > > ------------- > ls -al > -rw------- 1 vmail vmail 5921 Jul 9 21:55 > 1341834948.M445074P17475.geko.sbt.net.au,S=5921,W=6003:2, > -rw------- 1 vmail vmail 3021 Jul 9 22:06 > 1341835577.M701903P17756.geko.sbt.net.au,S=3021,W=3125:2, > .... > do you use expire plugin ? http://wiki2.dovecot.org/Plugins/Expire -- Best Regards MfG Robert Schetterer From voytek at sbt.net.au Fri Aug 3 16:24:49 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:24:49 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <501BCE9D.5050303@schetterer.org> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <501BCE9D.5050303@schetterer.org> Message-ID: <6cb5d27e683ddfa9532a8dc0d79aa301.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:14 pm, Robert Schetterer wrote: > do you use expire plugin ? > > http://wiki2.dovecot.org/Plugins/Expire no... I saw this part: "Note that: This command runs fine even without expire plugin loaded." and assumed I didn't have to.... OK, back to drawing board, thanks for your help -- Voytek Eymont From voytek at sbt.net.au Fri Aug 3 16:32:37 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:32:37 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? Message-ID: looking through logs I noticed this today: grep mysql /var/log/maillog | grep fail Aug 3 17:35:25 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:35:57 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:02 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:23 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:40 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:50 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:40:04 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:04 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:19 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:38 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist looking at mysqld.log, all i see is: 120721 17:58:44 InnoDB: Shutdown completed; log sequence number 0 76814 120721 17:58:44 [Note] /usr/libexec/mysqld: Shutdown complete 120721 17:58:44 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended 120721 17:59:53 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 120721 17:59:54 InnoDB: Initializing buffer pool, size = 8.0M 120721 17:59:54 InnoDB: Completed initialization of buffer pool 120721 17:59:54 InnoDB: Started; log sequence number 0 76814 120721 17:59:54 [Note] Event Scheduler: Loaded 0 events 120721 17:59:54 [Note] /usr/libexec/mysqld: ready for connections. Version: '5.1.61' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution no failure were noticed or reported, except for log items any thoughts ? I might have been importing (phpmyadmin) some 3 or 4 databases around that time, surely that wouldn't cause such issue ? -- Voytek Eymont From h.reindl at thelounge.net Fri Aug 3 16:36:19 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Aug 2012 15:36:19 +0200 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: References: Message-ID: <501BD3D3.7010208@thelounge.net> Am 03.08.2012 15:32, schrieb Voytek Eymont: > grep mysql /var/log/maillog | grep fail > Aug 3 17:35:25 dovecot: auth-worker(28335): Error: mysql: Query failed, > retrying: Table 'postfix.users' doesn't exist states clearly that a table is missing > looking at mysqld.log, all i see is: > no failure were noticed or reported, except for log items > > any thoughts ? why should mysqld report a error if a nonsystem table is mising > I might have been importing (phpmyadmin) some 3 or 4 databases around that > time, surely that wouldn't cause such issue ? what about connect directly to mysqld and look if the table exists and review your import dump-files if they did drop tables? however, this is not a dovecot issue -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Fri Aug 3 16:42:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:42:38 +0300 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: On 3.8.2012, at 16.09, Voytek Eymont wrote: >> doveadm expunge -A mailbox Junk savedbefore 7d; > > where am I going wrong ? > > nothing gets removed: Find out what Dovecot thinks the save dates are: doveadm fetch -u user at domain date.saved mailbox spam I'm pretty sure the problem is simply that the saved date isn't what you expect it to be. With maildir it's initially taken from the file's ctime and added to cache. From voytek at sbt.net.au Fri Aug 3 16:47:55 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:47:55 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:42 pm, Timo Sirainen wrote: > On 3.8.2012, at 16.09, Voytek Eymont wrote: > >>> doveadm expunge -A mailbox Junk savedbefore 7d; >> where am I going wrong ? >> nothing gets removed: > Find out what Dovecot thinks the save dates are: > doveadm fetch -u user at domain date.saved mailbox spam Timo, thanks I see... date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 > I'm pretty sure the problem is simply that the saved date isn't what you > expect it to be. With maildir it's initially taken from the file's ctime > and added to cache. so... what do I need ? -- Voytek Eymont From tss at iki.fi Fri Aug 3 16:51:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:51:49 +0300 Subject: [Dovecot] ACL with MySQL dict => full table scans (was: v2.1.9 released) In-Reply-To: <20120802084257.GB23882@sys-241.netcologne.de> References: <1343843919.18782.22.camel@innu> <20120802084257.GB23882@sys-241.netcologne.de> Message-ID: <1F8B6836-9873-4BA8-A2FF-C9EDCE306895@iki.fi> On 2.8.2012, at 11.42, Roland Rosenfeld wrote: > On Wed, 01 Aug 2012, Timo Sirainen wrote: > >> I've again mostly finished reading and answering most of the mails in >> Dovecot mailing list. There are a couple annoyingly difficult / time >> consuming bugreport mails that I haven't replied to yet, but if anyone >> thinks I should have replied to something already feel free to resend >> the mail. > > I'm not sure where my request was annoying or difficult, but I didn't > read an answer to it ;-) > http://www.dovecot.org/list/dovecot/2012-July/067130.html Yes, it was one of the "annoying" mails. :) The problem is this I think: http://hg.dovecot.org/dovecot-2.1/file/476381017ec7/src/plugins/acl/acl-backend-vfile-acllist.c#l296 I think it does the rebuild simply because the rebuild code was needed to be written anyway, and doing anything else requires adding more code to handle only the specific necessary additions/removals. A nice side effect of this rebuild is also that it makes sure that the dict is fully up to date even if you had manually changed the dovecot-acl files. But I guess a better solution for that would be a "doveadm acl rebuild" command. So .. yes, this definitely should be fixed, but it's not really a high priority right now.. From tss at iki.fi Fri Aug 3 16:53:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:53:38 +0300 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> Message-ID: On 3.8.2012, at 16.47, Voytek Eymont wrote: >> Find out what Dovecot thinks the save dates are: >> doveadm fetch -u user at domain date.saved mailbox spam > > Timo, thanks > > I see... > > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > >> I'm pretty sure the problem is simply that the saved date isn't what you >> expect it to be. With maildir it's initially taken from the file's ctime >> and added to cache. > > so... what do I need ? Are those dates changed all the time? The problem should get fixed eventually by itself, unless something else weird is going on. From tss at iki.fi Fri Aug 3 16:56:42 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:56:42 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: <501A27A4.7000303@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> <501A27A4.7000303@schetterer.org> Message-ID: On 2.8.2012, at 10.09, Robert Schetterer wrote: > Hi Timo, most of the Problems are fixed now > many thx for your script > > , but how to avoid that in future ( Maildir filename has wrong S value ) You'd need to find out why it started happening in the first place. What software wrote those filenames? Are new filenames still creating with wrong S value? Does your dovecot.conf use zlib plugin globally (instead of only in some protocol sections, which might cause this kind of trouble)? > you released a patch > > diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c > --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 > +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 > @@ -20,6 +20,7 @@ > struct mail *mail = mstream->mail; > enum mail_lookup_abort orig_lookup_abort; > > + return FALSE; > if (mstream->expected_size != (uoff_t)-1) > return TRUE; > > would it be a good idea to include it in 2.1.9 for me ? > as it looks like its not in the public code ? It's an ugly workaround for the wrong S=size problem when zlib is used. Preferably you wouldn't ever need to use it. From tss at iki.fi Fri Aug 3 16:59:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:59:58 +0300 Subject: [Dovecot] Overriding inbox= in userdb extra fields In-Reply-To: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> References: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Message-ID: On 2.8.2012, at 19.10, Bret Martin wrote: > I'm trying to set up an alternate user with a different inbox using passwd-file and userdb extra fields and the extra field settings don't seem to be taking effect. I've used auth_debug and mail_debug and I'm unclear how I can further troubleshoot this. > > Is it possible to have inbox=yes in one namespace globally and then override this for one user by setting inbox=no for that namespace and then inbox=yes for another? Yes. > My doveconf -n is below. I would like to have inbox=yes for the inbox namespace, inbox=no for the virtual namespace, and then be able to invert these for selected users using userdb extra fields. My attempt at doing this so far looks like > > bam-ios:[REDACTED]:500:500::/home/bam::user=bam namespace/inbox/inbox=no namespace/virtual/inbox=yes Problem 1: The userdb fields need to be prefixed in passwd-file with "userdb_" prefix, so "userdb_namespace/inbox/inbox=no". Problem 2: You change the username from bam-ios to bam, which results in: > Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user > Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup So the userdb fields aren't looked up from passwd-file anyway. From voytek at sbt.net.au Fri Aug 3 17:08:18 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 00:08:18 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <501BD3D3.7010208@thelounge.net> References: <501BD3D3.7010208@thelounge.net> Message-ID: <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:36 pm, Reindl Harald wrote: > states clearly that a table is missing > what about connect directly to mysqld and look if the table exists and > review your import dump-files if they did drop tables? auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Reindl , thanks oops, I clearly mis-interpreted what happened... looking at mysql tables, I don't have such table, and, it seems I'm not using it in my sql: grep users dovecot-sql.conf grep users dovecot* conf.d]# grep users auth-sql* auth-sql.conf:# Authentication for SQL users. Included from auth.conf. auth-sql.conf.ext:# Authentication for SQL users. Included from auth.conf. conf.d]# grep users 10-auth.conf # If you want to allow master users to log in by specifying the master # Username to use for users logging in with ANONYMOUS SASL mechanism # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. where could that be called from ? -- Voytek Eymont From tss at iki.fi Fri Aug 3 17:10:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:10:14 +0300 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <501B7490.1020108@zu-con.org> References: <501B7490.1020108@zu-con.org> Message-ID: <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> On 3.8.2012, at 9.49, Matthias Rieber wrote: > I've deleted 10000s emails and it seems that every mail is removed with > a single request from Solrs index. This works, but it's quite slow. Is > it possible/plans to improve that? Could you try if the attached patch works? It compiles, but didn't test it. -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 2727 bytes Desc: not available URL: -------------- next part -------------- From tss at iki.fi Fri Aug 3 17:12:35 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:12:35 +0300 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> Message-ID: <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> On 3.8.2012, at 17.08, Voytek Eymont wrote: >> states clearly that a table is missing >> what about connect directly to mysqld and look if the table exists and >> review your import dump-files if they did drop tables? > > auth-worker(28335): Error: mysql: Query failed, retrying: Table > 'postfix.users' doesn't exist > > Reindl , thanks > > oops, I clearly mis-interpreted what happened... > looking at mysql tables, I don't have such table, and, it seems I'm not > using it in my sql: .. > where could that be called from ? From the default passdb/userdb sql settings. You haven't set one of password_query, user_query or iterate_query and it's trying to use the default which doesn't of course work with your database. From bam at miranda.org Fri Aug 3 17:13:15 2012 From: bam at miranda.org (Bret Martin) Date: Fri, 3 Aug 2012 10:13:15 -0400 Subject: [Dovecot] Overriding inbox= in userdb extra fields In-Reply-To: References: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Message-ID: <696C86DB-367F-4F93-AA1C-B231D5730A8A@miranda.org> On Aug 3, 2012, at 9:59 AM, Timo Sirainen wrote: [...] > Problem 1: The userdb fields need to be prefixed in passwd-file with "userdb_" prefix, so "userdb_namespace/inbox/inbox=no". Aha! This is what I was missing. The documentation on userdb extra fields even says this, but I missed it even on multiple readings. > Problem 2: You change the username from bam-ios to bam, which results in: > >> Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user >> Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup > > So the userdb fields aren't looked up from passwd-file anyway. I discovered this as well after sending my mail. My goal in changing the username was to point at bam's mail storage without having a symlink or something like that. But I solved this instead by adding more userdb extra fields to override namespace/{inbox,mdbox,virtual}/location. Thanks so much! I've now got exactly what I want: a full view of my many folders from desktop IMAP clients, and a collapsed hierarchy using virtual folders for mobile IMAP clients where navigating a huge folder tree can be cumbersome. --Bret From tss at iki.fi Fri Aug 3 17:14:55 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:14:55 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5019905F.3010102@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> <5019905F.3010102@zu-con.org> Message-ID: <381E6606-D4BA-4F8C-8A78-3B78CAA031BA@iki.fi> On 1.8.2012, at 23.23, Matthias Rieber wrote: > alright. Some resources say that "413 FULL head" means request too large. Maybe that's caused by the pretty big folder virtual.all which contains more than 360000 mails. Probably it means that the virtual folder consists of too many real folders. Dovecot's Solr query adds each real folder's GUID to the query. I guess there should be some limit and it would have to send more than one query and merge the results. From tss at iki.fi Fri Aug 3 17:40:27 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:40:27 +0300 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> Message-ID: <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> On 3.8.2012, at 10.04, Nikolai Schupbach wrote: > There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. What should happen is: 1. pop3c connects to server 2. issues LIST and UIDL commands 3. IMAP server issues fetch 1:* RFC822.SIZE (or I guess it does this with a ton of separate commands) 4. pop3c attempts to do some TOP commands. > When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): > > dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly > dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected It looks like the 3 step takes a long time. Do you have imapc_features=rfc822.size? Also setting mail_prefetch_count to something between 10..100 should help a lot. And this should also fix it by moving 3 step to 1: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d > Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. Yes, looks like dsync simply continues without assigning POP3 UIDL. Hmm. Perhaps it shouldn't do that on temporary failures.. > Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, This isn't easily possible. > or it should simply reconnect if sees the connection is lost. It should probably do that, yes. From robert at schetterer.org Fri Aug 3 20:17:46 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 19:17:46 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> <501A27A4.7000303@schetterer.org> Message-ID: <501C07BA.80004@schetterer.org> Am 03.08.2012 15:56, schrieb Timo Sirainen: > On 2.8.2012, at 10.09, Robert Schetterer wrote: > >> Hi Timo, most of the Problems are fixed now >> many thx for your script >> >> , but how to avoid that in future ( Maildir filename has wrong S value ) > > You'd need to find out why it started happening in the first place. the problem is/was getting maildirs fixed, no time to debug on production system in deed i have no idea why this happend, i found out some broken were old maildirs, so for them i bet coruption by migration 2.0 -2.1 other cuted out attachments imap online with serveral clients on = user fault in my meaning left the cases which i reproduced myself, or some brand new mailboxes it was about compressed mail and nocompressed with wrong message size in one folder What software wrote those filenames? Are new filenames still creating with wrong S value? Does your dovecot.conf use zlib plugin globally (instead of only in some protocol sections, which might cause this kind of trouble)? 10-mail.conf:mail_plugins = $mail_plugins zlib expire virtual fts fts_lucene mail_log autocreate notify acl listescape 20-imap.conf: mail_plugins = imap_acl acl fts fts_lucene mail_log autocreate notify expire virtual quota imap_quota zlib imap_zlib listescape 90-plugin.conf:zlib_save_level = 6 90-plugin.conf:zlib_save = gz should be ok ? > >> you released a patch >> >> diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c >> --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 >> +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 >> @@ -20,6 +20,7 @@ >> struct mail *mail = mstream->mail; >> enum mail_lookup_abort orig_lookup_abort; >> >> + return FALSE; >> if (mstream->expected_size != (uoff_t)-1) >> return TRUE; >> >> would it be a good idea to include it in 2.1.9 for me ? >> as it looks like its not in the public code ? > > It's an ugly workaround for the wrong S=size problem when zlib is used. Preferably you wouldn't ever need to use it. ok , i fixed all mailboxes with your script and one from ralf with compressed maildirs, updated to 2.1.9, using lucene now, disabled stats ( for kernel bugs ), and for now all problems are gone if i cant find any better reason, i go for shit happens, and learned how to fix it, however it were only 6 maildirs from 200 which got broken going trough lot of updates in years , so this is ok in my mind good time for users learn to build some mail archive from time to time however no mail got lost > -- Best Regards MfG Robert Schetterer From stephan at rename-it.nl Fri Aug 3 21:02:28 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 03 Aug 2012 20:02:28 +0200 Subject: [Dovecot] Pigeonhole sieve include namespace regression In-Reply-To: <501BB65A.2090601@corefiling.co.uk> References: <501BB65A.2090601@corefiling.co.uk> Message-ID: <501C1234.20504@rename-it.nl> On 8/3/2012 1:30 PM, Daniel Piddock wrote: > Hi, > > We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian > Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. > > We provide a selection of global sieve scripts to make users' lives > easier and one noticed that some of these have stopped working. I > tracked it down to them having personal scripts with the same name. > > Using a really simple sieve script: Nice bug report. > As can be seen the personal script is included twice. Obvious work > around is to rename the personal script. However it'd be nice if > namespacing came back. This should fix it: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/6a34eda7924e I also extended the test suite to prevent this situation from occurring again, for file-based scripts anyway. Regards, Stephan. From voytek at sbt.net.au Sat Aug 4 01:33:55 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 08:33:55 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> Message-ID: <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:53 pm, Timo Sirainen wrote: > On 3.8.2012, at 16.47, Voytek Eymont wrote: >>> Find out what Dovecot thinks the save dates are: >>> doveadm fetch -u user at domain date.saved mailbox spam >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> >>> I'm pretty sure the problem is simply that the saved date isn't what >>> you expect it to be. With maildir it's initially taken from the file's >>> ctime and added to cache. >> >> so... what do I need ? > > Are those dates changed all the time? The problem should get fixed > eventually by itself, unless something else weird is going on. thanks. don't know, looking this morning it shows like below, the 00:05:05 is probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to see what gets removed from 'spam' box, before and after each attempt to expunge : date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 06:45:33 date.saved: 2012-08-03 06:45:33 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 18:37:25 date.saved: 2012-08-03 18:55:34 date.saved: 2012-08-03 19:51:02 date.saved: 2012-08-04 02:45:21 date.saved: 2012-08-04 06:33:16 -- Voytek From voytek at sbt.net.au Sat Aug 4 01:55:01 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 08:55:01 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> Message-ID: <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> >> where could that be called from ? > > From the default passdb/userdb sql settings. You haven't set one of > password_query, user_query or iterate_query and it's trying to use the > default which doesn't of course work with your database. thanks cd /etc/dovecot grep password_query * dovecot-sql.conf:password_query = SELECT username as user, password, '/var/mail/vhosts/%d/%n@%d' as userdb_home, **TRIM** # grep user_query * dovecot-sql.conf:user_query = SELECT concat('/var/mail/vhosts/', maildir) as home, concat('maildir:/var/mail/vhosts/', maildir) as mail, **TRIM** dovecot-sql.conf:user_query = SELECT '/var/mail/vhosts/%d/%n@%d' as home, 'maildir:/var/mail/vhosts/%d/%n@%d' as mail, **TRIM** OOPS, I seem to have duplicate user_query with my two 'user_query', it's the last one in the file that wins, yes ? so, I should remove the 1st one # grep iterate_query * # none. so, I need some 'iterate_query' inserted in my dovecot-sql.conf ? -- Voytek From ml-dovecot at zu-con.org Sat Aug 4 10:11:24 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Sat, 04 Aug 2012 09:11:24 +0200 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> Message-ID: <501CCB1C.80908@zu-con.org> Hello, Am 03.08.2012 16:10, schrieb Timo Sirainen: > On 3.8.2012, at 9.49, Matthias Rieber wrote: > >> I've deleted 10000s emails and it seems that every mail is removed with >> a single request from Solrs index. This works, but it's quite slow. Is >> it possible/plans to improve that? > > Could you try if the attached patch works? It compiles, but didn't test it. it segfaults: Aug 4 08:55:58 smtp dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for matthias Aug 4 08:55:58 smtp dovecot: indexer-worker(matthias): Fatal: master: service(indexer-worker): child 32503 killed with signal 11 (core not dumped) But I didn't managed to get a core dump. I start dovecot with ulimit -c unlimited and I also set /proc/sys/kernel/core_pattern to world writeable directory. Matthias From teopro at gmail.com Sat Aug 4 16:05:12 2012 From: teopro at gmail.com (Gmail-teopro) Date: Sat, 4 Aug 2012 16:05:12 +0300 Subject: [Dovecot] disable auth-worker logging Message-ID: <1809306900.20120804160512@gmail.com> Hello all, Can someone please give me a hint about how can I disable such messages to be inserted into log file(maillog this case as syslog_facility = mail)? >> dovecot: auth-worker(13377): mysql(localhost): Connected to database postfix All the '_debug' and '_verbose' statements bear the 'no' value. Thank you. -- Best regards, Gmail-teopro mailto:teopro at gmail.com From matthew at atom.net Sat Aug 4 16:30:03 2012 From: matthew at atom.net (Matthew Powell) Date: Sat, 4 Aug 2012 09:30:03 -0400 Subject: [Dovecot] authenticate plain and utf-8 with special chars In-Reply-To: <1343727740.3072.28.camel@hermann.potsdam.securepoint.local> References: <1343727740.3072.28.camel@hermann.potsdam.securepoint.local> Message-ID: <9424CEA0-4105-44BA-80D1-FA28E6950581@atom.net> On 2012-07-31, at 5.42, Matthias Lay wrote: > seems like the mail clients like thunderbird send their base64 string in > ISO- encoding, which doesnt work on my dovecot setup if there are some > Umlauts > > I am not able to login as > "?mer" for example > > If I authenticate from telnet with an base64 encoded utf-8 string like > 'echo -en "\0?mer\0Start12" |base64' > everything works fine This looks like a Thunderbird bug. SASL PLAIN uses UTF-8, not ISO-8859; see RFC 4616. Thunderbird's bug #312593 relates to password handling, but it sounds like there's a similar issue affecting usernames. See https://bugzilla.mozilla.org/show_bug.cgi?id=312593. It might be worth adding a comment there. -- Matthew Powell matthew at atom.net From e-frog at gmx.de Sat Aug 4 16:45:51 2012 From: e-frog at gmx.de (e-frog) Date: Sat, 04 Aug 2012 15:45:51 +0200 Subject: [Dovecot] disable auth-worker logging In-Reply-To: <1809306900.20120804160512@gmail.com> References: <1809306900.20120804160512@gmail.com> Message-ID: <501D278F.2020606@gmx.de> On 04.08.2012 15:05, wrote Gmail-teopro: > Hello all, > > Can someone please give me a hint about how can I disable such messages to > be inserted into log file(maillog this case as syslog_facility = mail)? > >>> dovecot: auth-worker(13377): mysql(localhost): Connected to database postfix > > All the '_debug' and '_verbose' statements bear the 'no' value. > > Thank you. > Hello, I don't think this message can be disabled in dovecot. You can however configure your syslog daemon to ignore the message. The following works for me using rsyslog: $: cat /etc/rsyslog.d/40-dovecot.conf :msg, contains, "mysql(localhost): Connected to database" ~ -- e-frog From daniel.parthey at informatik.tu-chemnitz.de Sun Aug 5 04:08:41 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sun, 5 Aug 2012 03:08:41 +0200 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> Message-ID: <20120805010841.GA13639@daniel.localdomain> Voytek Eymont wrote: > I need some 'iterate_query' inserted in my dovecot-sql.conf ? You only need it if you need to run some doveadm -A command over all users. Regards Daniel -- https://plus.google.com/103021802792276734820 From voytek at sbt.net.au Sun Aug 5 04:21:41 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sun, 5 Aug 2012 11:21:41 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <20120805010841.GA13639@daniel.localdomain> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> <20120805010841.GA13639@daniel.localdomain> Message-ID: <20d4d5457e4f22ef3d71210867e962ed.squirrel@geko.sbt.net.au> On Sun, August 5, 2012 11:08 am, Daniel Parthey wrote: > Voytek Eymont wrote: >> I need some 'iterate_query' inserted in my dovecot-sql.conf ? > You only need it if you need to run some doveadm -A command > over all users. Daniel, thanks for explanation, so I got these when I tried my expunge, I was trying also all 'local' users I only have virtual users in mysql, there is no *nix users on this system, so, if I had a properly constructed 'iterate_query' I could use that '-A' option to go against all mysql virtual users, and, not try and fail on '/home/whatevr' as valid users ? -- Voytek From peter at snowweb.co.uk Sun Aug 5 08:22:23 2012 From: peter at snowweb.co.uk (Peter Snow) Date: Sun, 05 Aug 2012 13:22:23 +0800 Subject: [Dovecot] Just trying to make dovecot work. Message-ID: <501E030F.5090209@snowweb.co.uk> Hi, I have to say that Dovecot is certainly the most challenging piece of software I've ever had the pleasure of setting up (due mainly to the reams of largely unhelpful documentation). After 36 almost non-stop hours reading and trying, I finally end up here. :-) I really would appreciate your help - and many thanks in advance! *************************************************************** /var/log/dovecot.info.log (showing unsuccessful login) *************************************************************** Aug 04 21:32:36 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 04 21:32:36 auth: Debug: passwd-file /usr/local/etc/dovecot.passdb: Read 1 users Aug 04 21:32:36 auth: Debug: auth client connected (pid=24769) Aug 04 21:32:41 auth: Debug: client in: AUTH 1 PLAIN service=imap securedlip=::1 rip=::1 lport=143 rport=52551 resp=AHBldGVyAGZ1YXNpbjU0MTRz Aug 04 21:32:41 auth: Debug: passwd-file(peter,::1): lookup: user=peter file=/usr/local/etc/dovecot.passdb Aug 04 21:32:41 auth: Debug: client out: OK 1 user=peter Aug 04 21:32:41 auth: Debug: master in: REQUEST 1417805825 24769 1 44a3aec60ec6eaec6eff0efb99971eee Aug 04 21:32:41 auth: Debug: master out: USER 1417805825 peter Aug 04 21:32:41 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=24772, secured *************************************************************** END *************************************************************** *************************************************************** /var/log/dovecot.log (showing unsuccessful login) *************************************************************** Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop privileges: User is missing UID (see mail_uid setting) Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to server log for more information. *************************************************************** END *************************************************************** *************************************************************** dovecot -n *************************************************************** # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) ext4 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 1000 info_log_path = /var/log/dovecot.info.log last_valid_uid = 5000 log_path = /var/log/dovecot.log login_trusted_networks = 127.0.0.1 mail_debug = yes mail_location = maildir:/var/mail/%u/Maildir mail_log_prefix = "%Us(%u): " passdb { args = /usr/local/etc/dovecot.passdb driver = passwd-file } protocols = imap ssl = no verbose_proctitle = yes *************************************************************** END *************************************************************** *************************************************************** /usr/local/etc/dovecot.passdb *************************************************************** peter:{CRYPT}BrtgyyOEX33w6:1000:500:Peter Snow:/var/mail/peter:: *************************************************************** END *************************************************************** *************************************************************** cat /etc/passwd | grep peter *************************************************************** peter:x:1000:500::/home/peter:/sbin/nologin *************************************************************** END *************************************************************** Notes: 'peter' does not yet have a system password, since I'm testing this for users which will only be virtual users. I made the password for 'peter' in the dovecot.passdb using "doveadm pw -s crypt" although once I've got it working I'd like to change the encryption to something as strong as possible - any suggestions please? Hope you can help and many thanks. Kind regards, Peter From lists at wildgooses.com Sun Aug 5 12:38:49 2012 From: lists at wildgooses.com (Ed W) Date: Sun, 05 Aug 2012 10:38:49 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501E030F.5090209@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> Message-ID: <501E3F29.9090401@wildgooses.com> On 05/08/2012 06:22, Peter Snow wrote: > Hi, > > I have to say that Dovecot is certainly the most challenging piece of > software I've ever had the pleasure of setting up (due mainly to the > reams of largely unhelpful documentation). After 36 almost non-stop > hours reading and trying, I finally end up here. :-) > > I really would appreciate your help - and many thanks in advance! Phew, haven't you set yourself up for a hostile response..? It's only an opinion, but I would say that the Dovecot docs are rather helpful and thorough? Also dovecot ships with an almost working config out of the box, really you only need to adjust a couple of settings to achieve most setups. OK, reading your log files, I think this is probably the clue? > /var/log/dovecot.log > (showing unsuccessful login) > > *************************************************************** > Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop > privileges: User is missing UID (see mail_uid setting) > Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to > server log for more information. > *************************************************************** I don't use that auth method so I don't want to give you a definitive suggestion, but we can certainly use google to get some ideas: http://lmgtfy.com/?q=dovecot+mail_uid+ Third link down seems to cover your question. Basically says you need to define the setting listed above, but also why. Note, I think it's easy to level critique against dovecot auth, but if you look for a few moments longer you will see that you are probably just criticising flexibility. You can use a very wide array of database types to store your auth information and with that flexibility comes the requirement to actually define your specific choice. Some people run a multi-tennanted system and like to be able to run each user under their own uid, hence that being flexible. Others want to use LDAP or a database to store auth info (I think you can even use both at the same time). It's even possible to use both at the same time I believe, or to lookup users in one db, and passwords in another. Note, I don't know your requirements, but you might want to look at some kind of database for your user storage if you have more than a fairly simple installation? Either LDAP or sql is likely to give you more flexibility than a flat file pwdb, but I don't know your requirements, so just a thought Finally note that there are literally dozens of "how to install dovecot" guides on the internet that will help you get a working setup with various auth db choices. Once you understand the big picture using one of those guides you will be able to customise things to a very specific situation Good luck Ed W From CMarcus at Media-Brokers.com Sun Aug 5 19:23:30 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 05 Aug 2012 12:23:30 -0400 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> Message-ID: <501E9E02.5000203@Media-Brokers.com> On 2012-08-03 6:33 PM, Voytek Eymont wrote: > don't know, looking this morning it shows like below, the 00:05:05 is > probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to > see what gets removed from 'spam' box, before and after each attempt to > expunge : > > date.saved: 2012-08-03 00:05:05 The 'date.saved:' is the date/time that the message was moved into that folder. The clock for these messages is based on the time it was moved into that folder, NOT the date/time the message was received in the message header. Maybe this is what is confusing you? So, if you have issue the command to remove messages older than 7 days, that would be 7 days *since they were moved into the folder*. -- Best regards, Charles From voytek at sbt.net.au Mon Aug 6 01:47:19 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Mon, 6 Aug 2012 08:47:19 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <501E9E02.5000203@Media-Brokers.com> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> Message-ID: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > The 'date.saved:' is the date/time that the message was moved into that > folder. > > The clock for these messages is based on the time it was moved into that > folder, NOT the date/time the message was received in the message header. > Maybe this is what is confusing you? > So, if you have issue the command to remove messages older than 7 days, > that would be 7 days *since they were moved into the folder*. Charles, thanks these are a user+spam spam basket, the actual messages are either in 'new' or 'cur', depending if a particular user logged to 'spam' basket or not does that mean that say 7 days would clear new messages after 7 days, and, any message that is not 'new' after 7 more days, assuming I run the command daily ? all I want is an auto way to clear +spam baskets after x days -- Voytek Eymont From CMarcus at Media-Brokers.com Mon Aug 6 02:24:54 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 05 Aug 2012 19:24:54 -0400 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> Message-ID: <501F00C6.6030908@Media-Brokers.com> On 2012-08-05 6:47 PM, Voytek Eymont wrote: > > On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > >> The 'date.saved:' is the date/time that the message was moved into that >> folder. >> >> The clock for these messages is based on the time it was moved into that >> folder, NOT the date/time the message was received in the message header. >> Maybe this is what is confusing you? > >> So, if you have issue the command to remove messages older than 7 days, >> that would be 7 days *since they were moved into the folder*. > > Charles, > > thanks > > these are a user+spam spam basket, the actual messages are either in 'new' > or 'cur', depending if a particular user logged to 'spam' basket or not > > does that mean that say 7 days would clear new messages after 7 days, and, > any message that is not 'new' after 7 more days, assuming I run the > command daily ? > > all I want is an auto way to clear +spam baskets after x days I'm not sure I understand your question... Again, the date.saved is the date/tome the message was moved into the folder, and has nothing to do with the date the message was received or the date/time in the message header. So, as long as the date.saved date/time is not older than the date/time you are searching on, then they will not be deleted. -- Best regards, Charles From peter at snowweb.co.uk Mon Aug 6 04:35:49 2012 From: peter at snowweb.co.uk (Peter Snow) Date: Mon, 06 Aug 2012 09:35:49 +0800 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501E3F29.9090401@wildgooses.com> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> Message-ID: <501F1F75.5040906@snowweb.co.uk> Well you can continue to kid yourselves that the documentation is good if you like. The facts say differently. For example, I visit http://wiki.dovecot.org/MainConfig for help with the main config and at the top of the page it tells me that this page is for version 1.x, so I click the link to view the page for 2.x, which takes me to a page saying that the page I want has yet to be created. I therefore have no option but to refer to the version 1.x documentation. I copy "mechanisms = plain" from it but when I restart dovecot, it fails, telling me that it is not recognized! > Finally note that there are literally dozens of "how to install > dovecot" guides on the internet I noticed that also and did indeed follow many of them. Many of them though are for version 1.x but don't say so. Other's just leave you hanging. I could and probably will carry on digging on Google and probably will find a bunch of erroneous documents among the good ones and will have no easy way to tell the difference, but one might expect the official website to have the right information to save me this hassle. By the way, I've now got it running. It wasn't failing due to the user being used to run the processes. It was due to misconfiguration of the way that the virtual users were setup, which in the end I managed to fix by interrogating a server with a working implementation (albeit ver 1.x) which was similar to what I needed and copying parts of it's config. Although mutt now connects to it fine, roundcube doesn't, but don't worry. I'm not planning to bother you further. Kind regards, Peter On 08/05/2012 05:38 PM, Ed W wrote: > On 05/08/2012 06:22, Peter Snow wrote: >> Hi, >> >> I have to say that Dovecot is certainly the most challenging piece of >> software I've ever had the pleasure of setting up (due mainly to the >> reams of largely unhelpful documentation). After 36 almost non-stop >> hours reading and trying, I finally end up here. :-) >> >> I really would appreciate your help - and many thanks in advance! > > Phew, haven't you set yourself up for a hostile response..? > > It's only an opinion, but I would say that the Dovecot docs are rather > helpful and thorough? Also dovecot ships with an almost working > config out of the box, really you only need to adjust a couple of > settings to achieve most setups. > > OK, reading your log files, I think this is probably the clue? > > > >> /var/log/dovecot.log >> (showing unsuccessful login) >> >> *************************************************************** >> Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop >> privileges: User is missing UID (see mail_uid setting) >> Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to >> server log for more information. >> *************************************************************** > > > I don't use that auth method so I don't want to give you a definitive > suggestion, but we can certainly use google to get some ideas: > http://lmgtfy.com/?q=dovecot+mail_uid+ > > Third link down seems to cover your question. Basically says you need > to define the setting listed above, but also why. > > > Note, I think it's easy to level critique against dovecot auth, but if > you look for a few moments longer you will see that you are probably > just criticising flexibility. You can use a very wide array of > database types to store your auth information and with that > flexibility comes the requirement to actually define your specific > choice. > > Some people run a multi-tennanted system and like to be able to run > each user under their own uid, hence that being flexible. Others want > to use LDAP or a database to store auth info (I think you can even use > both at the same time). It's even possible to use both at the same > time I believe, or to lookup users in one db, and passwords in another. > > Note, I don't know your requirements, but you might want to look at > some kind of database for your user storage if you have more than a > fairly simple installation? Either LDAP or sql is likely to give you > more flexibility than a flat file pwdb, but I don't know your > requirements, so just a thought > > Finally note that there are literally dozens of "how to install > dovecot" guides on the internet that will help you get a working setup > with various auth db choices. Once you understand the big picture > using one of those guides you will be able to customise things to a > very specific situation > > Good luck > > Ed W From robert at schetterer.org Mon Aug 6 09:30:00 2012 From: robert at schetterer.org (Robert Schetterer) Date: Mon, 06 Aug 2012 08:30:00 +0200 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> Message-ID: <501F6468.2050409@schetterer.org> Am 06.08.2012 00:47, schrieb Voytek Eymont: > > On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > >> The 'date.saved:' is the date/time that the message was moved into that >> folder. >> >> The clock for these messages is based on the time it was moved into that >> folder, NOT the date/time the message was received in the message header. >> Maybe this is what is confusing you? > >> So, if you have issue the command to remove messages older than 7 days, >> that would be 7 days *since they were moved into the folder*. > > Charles, > > thanks > > these are a user+spam spam basket, the actual messages are either in 'new' > or 'cur', depending if a particular user logged to 'spam' basket or not > > does that mean that say 7 days would clear new messages after 7 days, and, > any message that is not 'new' after 7 more days, assuming I run the > command daily ? > > all I want is an auto way to clear +spam baskets after x days > > an ugly workaround maybe is ,thing like this, if using maidir v1.0 cronjob equivalent For Dovecot v1.0, this can be accomplished by running a daily shell script: # delete 30 day old mails find /var/virtualmail/ -regex '.*/\.\(Trash\|Junk\)\(/.*\)?\/\(cur\|new\)/.*' -type f -ctime +30 -delete # or -exec rm '{}' \; instead of -delete Using ctime means that messages are deleted 30 days after they've been moved to Trash. If mtime was used instead, it would mean the message is deleted 30 days after its original creation, which could be immediately. but i recommend expire plugin, also Timos advices should work for sure -- Best Regards MfG Robert Schetterer From acrow at integrafin.co.uk Mon Aug 6 09:30:59 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Mon, 06 Aug 2012 07:30:59 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F1F75.5040906@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> Message-ID: <501F64A3.8090202@integrafin.co.uk> On 06/08/12 02:35, Peter Snow wrote: > Well you can continue to kid yourselves that the documentation is good > if you like. The facts say differently. It would be easier if you started at the correct wiki for the version you have: http://wiki2.dovecot.org/FrontPage I have always found the documentation superb. I think you must have standards to which most other can merely aspire. Alex From jtam.home at gmail.com Mon Aug 6 10:46:45 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 6 Aug 2012 00:46:45 -0700 (PDT) Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: Message-ID: Charles Marcus writes: > On 2012-08-03 6:33 PM, Voytek Eymont wrote: >> don't know, looking this morning it shows like below, the 00:05:05 is >> probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to >> see what gets removed from 'spam' box, before and after each attempt to >> expunge : >> >> date.saved: 2012-08-03 00:05:05 > > The 'date.saved:' is the date/time that the message was moved into that > folder. Perhaps this related thread starting at http://dovecot.org/list/dovecot/2012-July/067199.html and ending with the patch by Timo http://dovecot.org/list/dovecot/2012-July/067423.html may be of interest to the OP. Joseph Tam From lists at wildgooses.com Mon Aug 6 10:48:25 2012 From: lists at wildgooses.com (Ed W) Date: Mon, 06 Aug 2012 08:48:25 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F1F75.5040906@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> Message-ID: <501F76C9.2080202@wildgooses.com> On 06/08/2012 02:35, Peter Snow wrote: > Well you can continue to kid yourselves that the documentation is good > if you like. The facts say differently. For example, I visit > http://wiki.dovecot.org/MainConfig for help with the main config and > at the top of the page it tells me that this page is for version 1.x, > so I click the link to view the page for 2.x, which takes me to a page > saying that the page I want has yet to be created. I therefore have no > option but to refer to the version 1.x documentation. I copy > "mechanisms = plain" from it Google is *such* a useful tool.. http://lmgtfy.com/?q=dovecot+%22mechanisms+plain%22 > but when I restart dovecot, it fails, telling me that it is not > recognized! No, probably it says something different. Please quote the error message, not your interpretation of the error message? > I noticed that also and did indeed follow many of them. Many of them > though are for version 1.x but don't say so. There are many useful differences between 1.x and 2.x, but its a gradual evolution, not a big change. As such the configuration changed a "large amount" between 1.x and 2.x, in that it's now stored in multiple files rather than a few big files, but for your concern such a change is relatively minor and the configuration options are largely the same. > By the way, I've now got it running. It wasn't failing due to the user > being used to run the processes. It was due to misconfiguration of the > way that the virtual users were setup, which in the end I managed to > fix by interrogating a server with a working implementation (albeit > ver 1.x) which was similar to what I needed and copying parts of it's > config. Please always post details of your problem and solution - us technical folks learn from people's mistakes, but it's not possible to learn and make things better without knowing what your problem and eventual solution were? Additionally note that this is an opensource project and the documentation is written by people like yourself. Please consider clarifying whatever original document put you on the wrong track? > Although mutt now connects to it fine, roundcube doesn't, but don't > worry. I'm not planning to bother you further. Well, IMAP is just IMAP no matter which server you are using, so don't treat this as some big black box that you can't open up and inspect. IMAP is a plain text protocol and it shouldn't scare a technical person to debug things. roundcube is also an extremely flexible beast and you will need to get certain key settings correct before it connects correctly, it likely also feels very "brittle" in that there aren't that many settings to get right, but if any are wrong you will get major breakage Good luck Ed W P.S. You came here with all guns blazing and seems like you are going to leave the same way? Why not try a more softly softly approach? From ngoonee.talk at gmail.com Mon Aug 6 10:57:42 2012 From: ngoonee.talk at gmail.com (Oon-Ee Ng) Date: Mon, 6 Aug 2012 15:57:42 +0800 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F76C9.2080202@wildgooses.com> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> <501F76C9.2080202@wildgooses.com> Message-ID: On Mon, Aug 6, 2012 at 3:48 PM, Ed W wrote: > > P.S. You came here with all guns blazing and seems like you are going to > leave the same way? Why not try a more softly softly approach? Because the 'customer' has right to throw his weight around =). Especially after paying such a large amount of money for the product..... From rafinathan25 at gmail.com Mon Aug 6 11:09:51 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Mon, 6 Aug 2012 13:39:51 +0530 Subject: [Dovecot] find virtual users Message-ID: Hi, Can sendmail find virtual users in /etc/dovecot/passwd ? If yes, what are the necesary changes I have to make ? Urgent help needed. Thanks in advance. Regards, Rafael From lists at wildgooses.com Mon Aug 6 11:49:19 2012 From: lists at wildgooses.com (Ed W) Date: Mon, 06 Aug 2012 09:49:19 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> <501F76C9.2080202@wildgooses.com> Message-ID: <501F850F.2090306@wildgooses.com> On 06/08/2012 08:57, Oon-Ee Ng wrote: > On Mon, Aug 6, 2012 at 3:48 PM, Ed W wrote: >> P.S. You came here with all guns blazing and seems like you are going to >> leave the same way? Why not try a more softly softly approach? > Because the 'customer' has right to throw his weight around =). > Especially after paying such a large amount of money for the > product..... Lets and avoid chasing folks away. Ed From CMarcus at Media-Brokers.com Mon Aug 6 14:09:10 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 06 Aug 2012 07:09:10 -0400 Subject: [Dovecot] find virtual users In-Reply-To: References: Message-ID: <501FA5D6.1040000@Media-Brokers.com> On 2012-08-06 4:09 AM, Rafael Nathan wrote: > Hi, > > Can sendmail find virtual users in /etc/dovecot/passwd ? > If yes, what are the necesary changes I have to make ? > > Urgent help needed. Thanks in advance. This is the dovecot support list. For sendmail support, you should seek an appropriate venue... -- Best regards, Charles From andrzej.filip at gmail.com Mon Aug 6 21:33:27 2012 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Mon, 06 Aug 2012 20:33:27 +0200 Subject: [Dovecot] find virtual users [sendmail] In-Reply-To: References: Message-ID: <50200DF7.9060000@gmail.com> On 08/06/2012 10:09 AM, Rafael Nathan wrote: > Can sendmail find virtual users in /etc/dovecot/passwd ? > If yes, what are the necesary changes I have to make ? > > Urgent help needed. Thanks in advance. Sendmail/sendmail.cf can do lookups in passwd like files => It should be possible to check recipient existence before "RCPT TO:" reply. SMTP AUTH is another story. There are a few+ ways to integrate sendmail and dovecot. Which one do you use? From mikeg at rockisland.com Mon Aug 6 21:34:22 2012 From: mikeg at rockisland.com (Mike Greene) Date: Mon, 6 Aug 2012 18:34:22 +0000 Subject: [Dovecot] redirect actions exceeds policy limit Message-ID: <07A08B628EAA1D4F8ADAE2C68D980A9F019B50@mercury.office.rockisland.com> Hello, We have a vacation/mail forwarder plugin in squirrel mail that allows customers to forward email. It has come to my attention that there is a limit (appears to be 5) on the number of addresses that can be specified. I'm now trying to track down where this policy limit is set. This is the error we see in the customers .dovecot.sieve.log file: main_script: line 26: error: number of redirect actions exceeds policy limit. sieve: info: started log at Jul 25 07:02:54. I checked the following for possible settings: /usr/local/etc/dovecot/dovecot.conf /usr/local/etc/sieve/dovecot.sieve /usr/local/etc/sieve/global.sieve I didn't see anything specific to limiting the number of redirects. I'm wondering where else I can look to find where this limit is coming from and adjust it upwards. We are using the following dovecot / pigeonhole versions. dovecot-2.0.7 dovecot-pigeonhole-0.2.1 athena# dovecot -n # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.1-RELEASE amd64 auth_default_realm = rockisland.com auth_mechanisms = plain login cram-md5 auth_username_format = %Lu disable_plaintext_auth = no dotlock_use_excl = yes first_valid_gid = 1000 first_valid_uid = 1000 listen = * mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { quota = maildir quota_rule = *:storage=2G quota_warning = storage=90%% /usr/local/sbin/quota-warning.sh 90 quota_warning2 = storage=80%% /usr/local/sbin/quota-warning.sh 80 sieve = ~/.dovecot.sieve sieve_dir = ~/ sieve_global_dir = /usr/local/etc/sieve/ } protocols = imap pop3 service auth { unix_listener auth-client { mode = 0660 } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service imap-login { service_count = 0 } service pop3-login { service_count = 0 } ssl_cert = References: <07A08B628EAA1D4F8ADAE2C68D980A9F019B50@mercury.office.rockisland.com> Message-ID: In conf.d/90-sieve.conf we have: # The maximum number of redirect actions that can be performed during # a single script execution. #sieve_max_redirects = 4 sieve_max_redirects = 25 I think that's the setting you're looking for. -David Warden On 2012-08-06 14:34, Mike Greene wrote: > Hello, We have a vacation/mail forwarder plugin in squirrel mail that allows customers to forward email. It has come to my attention that there is a limit (appears to be 5) on the number of addresses that can be specified. I'm now trying to track down where this policy limit is set. > > This is the error we see in the customers .dovecot.sieve.log file: > > main_script: line 26: error: number of redirect actions exceeds policy limit. > sieve: info: started log at Jul 25 07:02:54. > > I checked the following for possible settings: > > /usr/local/etc/dovecot/dovecot.conf > /usr/local/etc/sieve/dovecot.sieve > /usr/local/etc/sieve/global.sieve > > I didn't see anything specific to limiting the number of redirects. I'm wondering where else I can look to find where this limit is coming from and adjust it upwards. > > We are using the following dovecot / pigeonhole versions. > > dovecot-2.0.7 > dovecot-pigeonhole-0.2.1 > > athena# dovecot -n > # 2.0.7: /usr/local/etc/dovecot/dovecot.conf > # OS: FreeBSD 8.1-RELEASE amd64 > auth_default_realm = rockisland.com > auth_mechanisms = plain login cram-md5 > auth_username_format = %Lu > disable_plaintext_auth = no > dotlock_use_excl = yes > first_valid_gid = 1000 > first_valid_uid = 1000 > listen = * > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_privileged_group = mail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date > passdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > plugin { > quota = maildir > quota_rule = *:storage=2G > quota_warning = storage=90%% /usr/local/sbin/quota-warning.sh 90 > quota_warning2 = storage=80%% /usr/local/sbin/quota-warning.sh 80 > sieve = ~/.dovecot.sieve > sieve_dir = ~/ > sieve_global_dir = /usr/local/etc/sieve/ > } > protocols = imap pop3 > service auth { > unix_listener auth-client { > mode = 0660 > } > unix_listener auth-master { > group = vmail > mode = 0600 > user = vmail > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > user = root > } > service imap-login { > service_count = 0 > } > service pop3-login { > service_count = 0 > } > ssl_cert = ssl_key = userdb { > driver = prefetch > } > userdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > verbose_proctitle = yes > protocol imap { > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep > mail_plugins = quota imap_quota > } > protocol pop3 { > mail_plugins = quota > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } > protocol lda { > auth_socket_path = /var/run/dovecot/auth-master > info_log_path = > lda_mailbox_autocreate = no > lda_mailbox_autosubscribe = yes > log_path = > mail_plugins = quota sieve > postmaster_address = postmaster at rockisland.com > sendmail_path = /usr/sbin/sendmail > } > > Mike Greene > Rock Island Technology Solutions, Inc. > San Juan Islands, WA. 360-378-5884 x201 From chris.visser at rtt.co.za Tue Aug 7 10:03:53 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 7 Aug 2012 07:03:53 +0000 Subject: [Dovecot] LDAP auth with AD Message-ID: <1B5F61B24A54E54397345A133BD0A48D07D73EEA@RTTGMBX02.thefuelgroup.com> Hi, I'm struggling to setup LDAP authentication with dovecot against an AD server. When I attempt to bind using the same DN I use to do address lookups in exim and to do searches using ldap search on the command line I get the following in my logs: Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: auth client connected (pid=1523) Aug 7 08:55:58 mail-dev dovecot: auth: Error: LDAP: binding failed (dn CN=Linux Sync,CN=Users,DC=RTT,DC=co,DC=za): Invalid credentials, 80090308: LdapErr: DSID-0C0903A9, comment: AcceptSecurityContext error, data 52e, v1db1? I'm running CentOS 6 and connect to a Windows 2008 R2 domain. The output from dovecot -n: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_verbose = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } ssl_cert = Hello, i have a user who is able to do pop3 on port 110 without problems and without limits. There are ~10 real users using same public IP. When switching to port 995 to use pop3s he is limited at connection count. Some people can reach pop3s-server successful, some getting a timeout. I cant find any errors or limits within my config or in my log, there are no differences between using plain text and using tls. Are there some special loglines to grep for at this situation? Maybe i missed some lines... At the moment i dont see server-side problems. Somebody knows some typical clientside problems when this problem occurs? dovecot version is 1.2.11 Thanks, Hajo From robert at schetterer.org Tue Aug 7 10:32:37 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 07 Aug 2012 09:32:37 +0200 Subject: [Dovecot] connectionlimit for pop3s? In-Reply-To: <6FB9BD6F1FC54ADEB52F690E1321ADCA@ai.local> References: <6FB9BD6F1FC54ADEB52F690E1321ADCA@ai.local> Message-ID: <5020C495.5010309@schetterer.org> Am 07.08.2012 09:19, schrieb Hajo Locke: > Hello, > > i have a user who is able to do pop3 on port 110 without problems and without limits. There are ~10 real users using same public IP. > When switching to port 995 to use pop3s he is limited at connection count. Some people can reach pop3s-server successful, some getting a timeout. > I cant find any errors or limits within my config or in my log, there are no differences between using plain text and using tls. > Are there some special loglines to grep for at this situation? Maybe i missed some lines... > At the moment i dont see server-side problems. Somebody knows some typical clientside problems when this problem occurs? > > dovecot version is 1.2.11 > > Thanks, > Hajo > any firewalls involved , some ugly ones have problems with tls ? -- Best Regards MfG Robert Schetterer From stsiol at yahoo.co.uk Tue Aug 7 12:40:34 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Tue, 7 Aug 2012 10:40:34 +0100 (BST) Subject: [Dovecot] error message. Some help please Message-ID: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> Hello all : dovecot -n : # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3 base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-info.log ssl_parameters_regenerate: 48 verbose_ssl: yes login_dir: /var/run/dovecot//login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login login_greeting: * Dovecot ready * login_max_processes_count: 64 mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir mail_plugins: zlib auth default: ? verbose: yes ? debug: yes ? debug_passwords: yes ? passdb: ??? driver: passwd-file ??? args: /etc/dovecot/passwd ? passdb: ??? driver: pam ? userdb: ??? driver: static ??? args: uid=vmail gid=vmail home=/home/vmail/%u ? userdb: ??? driver: passwd From the logs : tail -100 /var/log/dovecot/dovecot | more : ......... Jul 06 13:51:20 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count Jul 18 15:20:32 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count Jul 19 09:16:40 dovecot: Warning: Killed with signal 15 (by pid=3062 uid=0 code=kill) ......... Should I just go ahead and increase login_max_processes_count ? Is it that simple ? Just asking for your feedback and experience chaps. Thank you in advance, Spyros ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From Wiethoff at tfh-bochum.de Tue Aug 7 13:30:15 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Tue, 7 Aug 2012 10:30:15 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue Message-ID: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> Hello everybody, i have a problem with dovecot+Active Directory as Authentication-Service. I am not able to use special characters (???? (german umlaut)) within a password. Normally I would suggest that the ldap-query is done in UTF-8 but as I debugged the auth-process, I have seen that the password is ISO-8859-1 encoded. The "original" query (from roundcube for example) is UTF-8 encoded (I dumped the POST-Query). So far I wasn't able to find my error by myself or by searching the web. Maybe someone of you can give me a hint :-) Thanks and greetings from Germany, Helge ---- dovecot --version 2.0.16 ---- D-AS01:/etc/dovecot # grep -v '^ *\(#.*\)\?$' dovecot-ldap.conf.ext uris = ldap://10.37.5.90 dn = CN=ldap-d-as01,CN=Users,DC=tfh-bochum,DC=de dnpass = xxxx auth_bind = yes ldap_version = 3 base = ou=Benutzer, ou=Lehre, dc=tfh-bochum, dc=de user_attrs = =uid=10000,=gid=10000,=home=/srv/mail/%Ld/%Ln user_filter = mail=%u pass_attrs = =uid=10000,=gid=10000,=home=/srv/mail/%Ld/%Ln pass_filter = (&(mail=%u)(!(extensionAttribute3=*))) ---- dovecot -n # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.37.6-0.11-default x86_64 openSUSE 11.4 (x86_64) auth_debug = yes auth_mechanisms = plain login auth_username_translation = %Lu auth_verbose = yes mail_location = maildir:~/Maildir mail_max_userip_connections = 1000 mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes list = yes location = prefix = INBOX/ separator = / subscriptions = yes type = private } namespace { list = yes location = maildir:%%h/Maildir:INDEX=%h/Maildir/shared/%%u:CONTROL=%h/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/srv/mail/shared-mailboxes quota = maildir:Quota quota_rule = *:storage=1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 10 } protocols = imap pop3 sieve lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0770 user = root } } service imap-login { process_min_avail = 4 service_count = 0 } service managesieve-login { inet_listener sieve { address = * port = 4190 } inet_listener sieve_deprecated { address = * port = 2000 } process_min_avail = 2 service_count = 0 } ssl_ca = References: <501BB65A.2090601@corefiling.co.uk> <501C1234.20504@rename-it.nl> Message-ID: <5020F52B.9060005@corefiling.co.uk> On 03/08/12 19:02, Stephan Bosch wrote: > On 8/3/2012 1:30 PM, Daniel Piddock wrote: >> Hi, >> >> We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian >> Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. >> >> We provide a selection of global sieve scripts to make users' lives >> easier and one noticed that some of these have stopped working. I >> tracked it down to them having personal scripts with the same name. >> >> Using a really simple sieve script: > > Nice bug report. > >> As can be seen the personal script is included twice. Obvious work >> around is to rename the personal script. However it'd be nice if >> namespacing came back. > > This should fix it: > > http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/6a34eda7924e > > I also extended the test suite to prevent this situation from > occurring again, for file-based scripts anyway. Hi Stephan, Thank you for the quick patch! Fixes the problem perfectly. Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From tonio at starbridge.org Tue Aug 7 14:47:50 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 13:47:50 +0200 Subject: [Dovecot] pop3 proxying error Message-ID: <50210066.8040205@starbridge.org> Hi Timo, I've got some errors with pop3 proxying and dovecot 2.1.9 I's occured on the proxy side: Aug 7 13:16:47 dev1 dovecot: pop3-login: Fatal: master: service(pop3-login): child 23046 killed with signal 11 (core dumped) Server side shows no error, and runs the same dovecot version. Thanks for your help. Best regards Tonio Buonaguidi Core dump: GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/pop3-login...done. [New LWP 23046] warning: Can't read pathname for load map: Erreur d'entr?e/sortie. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". Core was generated by `dovecot/pop3-login -D'. Program terminated with signal 11, Segmentation fault. #0 settings_parser_dup (old_ctx=0x8783480, new_pool=0x632e6465) at settings-parser.c:1742 1742 pool_ref(new_pool); doveconf -n # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.2-xxxx-std-ipv6-32 i686 Debian wheezy/sid auth_cache_size = 4 k auth_mechanisms = plain login director_mail_servers = bb.bb.bb.bb cc.cc.cc.cc director_servers = dd.dd.dd.dd aa.aa.aa.aa log_timestamp = %Y-%m-%d %H:%M:%S mail_debug = yes managesieve_notify_capability = mailto managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date spamtest spamtestplus virustest passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0660 user = postfix } unix_listener auth-master { mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0660 user = vmail } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = aa.aa.aa.aa port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 143 } inet_listener imaps { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 993 } process_limit = 256 process_min_avail = 2 service_count = 0 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 4190 } vsz_limit = 64 M } service pop3-login { executable = pop3-login -D inet_listener pop3 { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 110 } inet_listener pop3s { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 995 } service_count = 0 } ssl_ca = good day! I wonder if it is possible to make a chain of replication in dovecot 2.1.9. Now I'm using two way replication(I use proxy to redirect users) and it's working just fine but is it possible to setup replication like this: serverA ---> serverB --> server C <--- I've added additional mail_replica2 on serverB and after restart dovecot didn't complain about errors, with doveconf -n I am able to see two replica's settings but user's mails aren't replicating to server C. no errors in logs. I want to use server C as backup server with lvm snapshots. From Jost.Krieger+dovecot at rub.de Tue Aug 7 15:43:08 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 7 Aug 2012 14:43:08 +0200 Subject: [Dovecot] For the wishlist Message-ID: <20120807124305.GA13644@ruhr-uni-bochum.de> I would like very much to have a "doveadm copy", which probably could be made out of "doveadm move" by removing ca. 2 lines (and changing a few strings from "move" to "copy"). This would make it a lot easier to script quite a few things without using a real imap client. I can run around this by doing an import followed by a move but this will duplicate the mails (even when using mdbox). Mit freundlichen Gr??en Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From tonio at starbridge.org Tue Aug 7 15:54:05 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 14:54:05 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50210066.8040205@starbridge.org> References: <50210066.8040205@starbridge.org> Message-ID: <50210FED.5020508@starbridge.org> Le 07/08/2012 13:47, tonio at starbridge.org a ?crit : > > Hi Timo, > I've got some errors with pop3 proxying and dovecot 2.1.9 > > I's occured on the proxy side: > > Aug 7 13:16:47 dev1 dovecot: pop3-login: Fatal: master: > service(pop3-login): child 23046 killed with signal 11 (core dumped) > > Server side shows no error, and runs the same dovecot version. > > Thanks for your help. > Best regards > Tonio Buonaguidi > > Core dump: > > > GNU gdb (GDB) 7.4.1-debian > Copyright (C) 2012 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show > copying" > and "show warranty" for details. > This GDB was configured as "i486-linux-gnu". > For bug reporting instructions, please see: > ... > Reading symbols from /usr/lib/dovecot/pop3-login...done. > [New LWP 23046] > > warning: Can't read pathname for load map: Erreur d'entr?e/sortie. > [Thread debugging using libthread_db enabled] > Using host libthread_db library > "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". > Core was generated by `dovecot/pop3-login -D'. > Program terminated with signal 11, Segmentation fault. > #0 settings_parser_dup (old_ctx=0x8783480, new_pool=0x632e6465) at > settings-parser.c:1742 > 1742 pool_ref(new_pool); > > sorry I've forgot bt full ! (gdb) bt full #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 new_ctx = iter = new_link = links = key = value = i = parser_pool = __FUNCTION__ = "settings_parser_dup" #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) at master-service-settings-cache.c:221 entry = 0xe98b90 pool = 0xe98b70 pool_size = entry_local_name = 0xe98b90 "pop.te.com" #2 master_service_settings_cache_read (cache=0x60ea50, input=, dyn_parsers=, parser_r=0x7ffffe4558b8, error_r=) at master-service-settings-cache.c:297 output = {specific_services = 0x0, service_uses_local = 1, service_uses_remote = 0, used_local = 1, used_remote = 0} new_input = {roots = 0x604500, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x403640 "pop3-login", service = 0x40363b "pop3", username = 0x0, local_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = ".iHb", '\000' , __u6_addr16 = {26926, 25160, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1648912686, 0, 0, 0}}}, ip4 = {s_addr = 1648912686}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = "ZT\220]", '\000' , __u6_addr16 = {21594, 23952, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1569739866, 0, 0, 0}}}, ip4 = {s_addr = 1569739866}}}, local_name = 0x9fa1d0 "pop.te.com"} set = __FUNCTION__ = "master_service_settings_cache_read" #3 0x00007fc7a7a25a1b in login_settings_read (pool=0xbc54e0, local_ip=, remote_ip=, local_name=, other_settings_r=0x7ffffe455908) at login-settings.c:226 input = {roots = 0x604500, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x403640 "pop3-login", service = 0x40363b "pop3", username = 0x0, local_ip = {family = 2, u = {ip6 = { ---Type to continue, or q to quit--- __in6_u = {__u6_addr8 = ".iHb", '\000' , __u6_addr16 = {26926, 25160, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1648912686, 0, 0, 0}}}, ip4 = {s_addr = 1648912686}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = "ZT\220]", '\000' , __u6_addr16 = {21594, 23952, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1569739866, 0, 0, 0}}}, ip4 = {s_addr = 1569739866}}}, local_name = 0x9fa1d0 "pop.te.com"} error = parser = cache_sets = sets = i = count = __FUNCTION__ = "login_settings_read" #4 0x00007fc7a7a28278 in ssl_servername_callback (ssl=0xa0d6e0, al=, context=) at ssl-proxy-openssl.c:1144 ctx = proxy = client = 0xe95b98 host = other_sets = 0x0 #5 0x00007fc7a71c6162 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #6 0x00007fc7a71b2205 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #7 0x00007fc7a71b68c5 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #8 0x00007fc7a71c3103 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #9 0x00007fc7a7a289b9 in ssl_handshake (proxy=0xa185e0) at ssl-proxy-openssl.c:465 ret = #10 ssl_step (proxy=0xa185e0) at ssl-proxy-openssl.c:528 No locals. #11 0x00007fc7a77d6566 in io_loop_call_io (io=0xa15080) at ioloop.c:379 ioloop = 0x60d6e0 t_id = 2 #12 0x00007fc7a77d7237 in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0x9e6470 events = 0x0 event = 0x9e8030 list = 0x9f8ae0 io = tv = {tv_sec = 179, tv_usec = 999811} msecs = ret = 1 i = call = #13 0x00007fc7a77d5f78 in io_loop_run (ioloop=0x60d6e0) at ioloop.c:398 No locals. #14 0x00007fc7a77c1ee3 in master_service_run (service=0x60d590, callback=) at master-service.c:543 No locals. #15 0x00007fc7a7a266be in login_binary_run (binary=, argc=2, argv=0x60d370) at main.c:406 set_pool = 0x60da20 allow_core_dumps = login_socket = c = #16 0x00007fc7a7419ead in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #17 0x0000000000401fd9 in _start () No symbol table info available. From tss at iki.fi Tue Aug 7 17:57:43 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 7 Aug 2012 17:57:43 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50210FED.5020508@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> Message-ID: <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> On 7.8.2012, at 15.54, tonio at starbridge.org wrote: > #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 > new_ctx = > iter = > new_link = > links = > key = > value = > i = > parser_pool = > __FUNCTION__ = "settings_parser_dup" > #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) > at master-service-settings-cache.c:221 > entry = 0xe98b90 > pool = 0xe98b70 > pool_size = > entry_local_name = 0xe98b90 "pop.te.com" I guess nobody had tried to run Dovecot with many local / remote {} blocks previously. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/2815175a0ffc From tonio at starbridge.org Tue Aug 7 18:16:58 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 17:16:58 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> Message-ID: <5021316A.4020105@starbridge.org> Le 07/08/2012 16:57, Timo Sirainen a ?crit : > On 7.8.2012, at 15.54, tonio at starbridge.org wrote: > >> #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 >> new_ctx = >> iter = >> new_link = >> links = >> key = >> value = >> i = >> parser_pool = >> __FUNCTION__ = "settings_parser_dup" >> #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) >> at master-service-settings-cache.c:221 >> entry = 0xe98b90 >> pool = 0xe98b70 >> pool_size = >> entry_local_name = 0xe98b90 "pop.te.com" > I guess nobody had tried to run Dovecot with many local / remote {} blocks previously. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/2815175a0ffc > Thanks Timo I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? Thanks again for your work ! Regards Tonio From kavish.karkera at yahoo.com Tue Aug 7 18:17:43 2012 From: kavish.karkera at yahoo.com (Kavish Karkera) Date: Tue, 7 Aug 2012 23:17:43 +0800 (SGT) Subject: [Dovecot] Dovecot with Company - level Quota Message-ID: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> Hi Timo, We are using maildir as quota-backend , and performing user level quota, which is working fine.? (using dovecot 2.x ). Now the requirement is to , restrict the quota to client / company level along with user level quota. ?For. eg. We have a mailbox path like /mail/mailstore/10001/kavish.karkera at linoquery.com/Maildir/ where 10001 is Client code (unique number given to very client) instead of domain name. So there would be two quota's one at company level and other user level. Such as 10001(linoquery.com) = 5GB ---> Company Quota kavish.karkera at linoquery.com = 0 ? ---> User Quota If the sum of the user quota under 10001/*? exceeds the 5GB limit then the mails for that particular domain should get bounced. Please Help , if this is possible. Regards, Kavish Karkera From tss at iki.fi Tue Aug 7 18:21:12 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 7 Aug 2012 18:21:12 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <5021316A.4020105@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> Message-ID: On 7.8.2012, at 18.16, tonio at starbridge.org wrote: > I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? Not a bad thing, but it uses up somewhat more memory. From hmoreno at gmv.com Tue Aug 7 18:40:59 2012 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Tue, 7 Aug 2012 15:40:59 +0000 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> References: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> Message-ID: Hello everybody, We have the same problem with the vacation response. Why dovecot leaves the from empty? Does it something to do with this NULL field? src/deliver/mail-send.c: smtp_client = smtp_client_open(return_addr, NULL, &f); We have tried changing that line for this one, with no success: src/deliver/mail-send.c: smtp_client = smtp_client_open(return_addr, src->fromaddr, &f); We also have tried different versions of dovecot an pigeonhole, but the error persists. Any help would be much appreciated. Thank you very much in advanced. Kind regards- H?ctor Moreno Blanco Divisi?n de Seguridad e Infraestructuras / Security and Infrastructures Division GMV Isaac Newton, 11 P.T.M. Tres Cantos E-28760 Madrid Tel. +34 91 807 21 00 Fax +34 91 807 21 99 www.gmv.com ? ? ? -----Mensaje original----- De: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] En nombre de asier.cidon at externo.uam.es Enviado el: lunes, 30 de julio de 2012 9:06 Para: dovecot at dovecot.org Asunto: [Dovecot] sieve vacation messages trouble FROM:mailman-bounces at dovecot.org DATE:27. hein?kuuta 2012 16.58.35 UTC+3.00 TO:dovecot-owner at dovecot.org SUBJECT:CONTENT FILTERED MESSAGE NOTIFICATION The attached message matched the dovecot mailing list's content filtering rules and was prevented from being forwarded on to the list membership. ?You are receiving the only remaining copy of the discarded message. FROM:Asier Cidon Peria?ez DATE:27. hein?kuuta 2012 16.01.59 UTC+3.00 TO:dovecot at dovecot.org SUBJECT:RE: [DOVECOT] SIEVE VACATION MESSAGES TROUBLE Hi, I have a problem when I define a? Filter SIEVE vacation with Horde, Qmail and Dovecot. When I sent the message vacation for domains external, the log of postfix show <"<>"@mymachine>. I am writing you because I saw the post http://www.dovecot.org/list/dovecot/2009-June/040811.html Can you explain me whqt is the solution? Many Thanks. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From admin at sagredo.eu Tue Aug 7 19:20:39 2012 From: admin at sagredo.eu (Roberto Puzzanghera) Date: Tue, 07 Aug 2012 18:20:39 +0200 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> References: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> Message-ID: <7ed42f758c282216bb4ac454314acb8a@sagredo.eu> Il 30.07.2012 09:06 asier.cidon at externo.uam.es ha scritto: > FROM:mailman-bounces at dovecot.org > DATE:27. hein?kuuta 2012 16.58.35 UTC+3.00 > TO:dovecot-owner at dovecot.org > SUBJECT:CONTENT FILTERED MESSAGE NOTIFICATION > > The attached message matched the dovecot mailing list's content > filtering rules and was prevented from being forwarded on to the list > membership. ?You are receiving the only remaining copy of the > discarded message. > > FROM:Asier Cidon Peria?ez > DATE:27. hein?kuuta 2012 16.01.59 UTC+3.00 > TO:dovecot at dovecot.org > SUBJECT:RE: [DOVECOT] SIEVE VACATION MESSAGES TROUBLE > > Hi, > > I have a problem when I define a? Filter SIEVE vacation with Horde, > Qmail > and Dovecot. > > When I sent the message vacation for domains external, the log of > postfix > show <"<>"@mymachine>. > > I am writing you because I saw the post > http://www.dovecot.org/list/dovecot/2009-June/040811.html > > Can you explain me whqt is the solution? > > Many Thanks. Hi, this is a qmail-inject issue. You have to patch qmail-inject. See here for more info http://notes.sagredo.eu/node/133 regards Roberto From mikeg at rockisland.com Tue Aug 7 19:32:12 2012 From: mikeg at rockisland.com (Mike Greene) Date: Tue, 7 Aug 2012 16:32:12 +0000 Subject: [Dovecot] redirect actions exceeds policy limit In-Reply-To: References: Message-ID: <07A08B628EAA1D4F8ADAE2C68D980A9F01A74D@mercury.office.rockisland.com> Thank you David, I saw that in the share/docs but we didn't have the /conf.d/ folder or any of the extra conf files in place. I created that directory, copied the file over, made my changes and all is well again. Not sure why things were setup the way they were, after looking at the other files in conf.d it would appear the previous sysadmin had merged a lot of those bits and pieces into the main dovecot.conf file. Perhaps leftovers from v1.x days. Will likely address that down the road when we update that server. Mike Greene Rock Island Technology Solutions, Inc. San Juan Islands, WA. 360-378-5884 x201 > -----Original Message----- > > Date: Mon, 06 Aug 2012 14:46:22 -0400 > From: David Webmailbeta Warden > To: > Subject: Re: [Dovecot] redirect actions exceeds policy limit > Message-ID: > Content-Type: text/plain; charset="utf-8" > > > > In conf.d/90-sieve.conf we have: > > # The maximum number of redirect > actions that can be performed during > # a single script execution. > > #sieve_max_redirects = 4 > sieve_max_redirects = 25 > > I think that's the > setting you're looking for. > > -David Warden From voytek at sbt.net.au Wed Aug 8 00:06:52 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Wed, 8 Aug 2012 07:06:52 +1000 Subject: [Dovecot] how to duplicate users emails to allow deleted recovery? Message-ID: <7865bbafeaadafa7c712b61d4022c029.squirrel@geko.sbt.net.au> I have a situation where a user deleted emails using iphone, then, wants he sees messages are gone from desktop client, wants them recovered from server, happened several times now is there a way to have all deletes to go to server trash for potential recovery ? off topic: is there a way on iphone to force deletions to server's trash is there a way to have dovecot duplicate all emails to say user_backup at dom.tld mail box ? or should I duplicate emails in postfix ? using dovecot 2 with lmpt and virtual domains thanks -- Voytek From tss at iki.fi Wed Aug 8 00:45:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 08 Aug 2012 00:45:38 +0300 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <501CCB1C.80908@zu-con.org> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> <501CCB1C.80908@zu-con.org> Message-ID: <1344375938.19913.85.camel@hurina> On Sat, 2012-08-04 at 09:11 +0200, Matthias Rieber wrote: > >> I've deleted 10000s emails and it seems that every mail is removed with > >> a single request from Solrs index. This works, but it's quite slow. Is > >> it possible/plans to improve that? > > > > Could you try if the attached patch works? It compiles, but didn't test it. > > it segfaults: This should work: http://hg.dovecot.org/dovecot-2.1/rev/82f59d2139a9 From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 8 01:22:26 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 8 Aug 2012 00:22:26 +0200 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> Message-ID: <20120807222226.GA8406@daniel.localdomain> Wiethoff, Helge wrote: > Hello everybody, > > i have a problem with dovecot+Active Directory as Authentication-Service. I am not able to use special characters (???? (german umlaut)) within a password. Normally I would suggest that the ldap-query is done in UTF-8 but as I debugged the auth-process, I have seen that the password is ISO-8859-1 encoded. > The "original" query (from roundcube for example) is UTF-8 encoded (I dumped the POST-Query). > So far I wasn't able to find my error by myself or by searching the web. Maybe someone of you can give me a hint :-) > > Thanks and greetings from Germany, > Helge Hello Helge, In order to make it work with LDAP, the password transmitted over the IMAP connection needs to be encoded with the same character set as the password used to generate the hash. IMAP does not specify how the mail client should encode the password during the login process. So some older clients use Latin1 and some newer use UTF-8. Probably you are interested in reading the discussion from 2008: http://www.dovecot.org/list/dovecot/2008-November/035263.html Possibly you could reencode your passwords with some IMAP proxy like nginx and the mail and mail_auth modules and detect german umlauts, but such a setup will quickly get complex. I think, a simple and robust solution would be to limit the allowed characters for user passwords in your password management system to 7-bit ASCII characters (only) and reset passwords of all users having any login problems. Greetings, Daniel -- https://plus.google.com/103021802792276734820 From jtam.home at gmail.com Wed Aug 8 01:55:59 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 7 Aug 2012 15:55:59 -0700 (PDT) Subject: [Dovecot] connectionlimit for pop3s? In-Reply-To: References: Message-ID: On Tue, 7 Aug 2012, dovecot-request at dovecot.org wrote: > When switching to port 995 to use pop3s he is limited at connection > count. Some people can reach pop3s-server successful, some getting a > timeout. > ... > Somebody knows some typical clientside problems when this problem > occurs? Do the same user(s) have this problem and/or do each user have their own mail configuration for their mail readers? If yes, I would also check that the port and security protocol matches (i.e. clear/TLS/SSL on ports 110/110/995 respectively). Mismatched configurations could cause what you describe. Log messages could also be helpful here. Joseph Tam From tonio at starbridge.org Wed Aug 8 09:42:06 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Wed, 08 Aug 2012 08:42:06 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> Message-ID: <50220A3E.407@starbridge.org> Le 07/08/2012 17:21, Timo Sirainen a ?crit : > On 7.8.2012, at 18.16, tonio at starbridge.org wrote: > >> I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? > Not a bad thing, but it uses up somewhat more memory. > Timo, I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) Director is configured in my dovecot.conf, but I dont use it here. Proxying is made by sql request with static host. (gdb) bt full #0 0xffffe424 in __kernel_vsyscall () No symbol table info available. #1 0xb760d941 in raise () from /lib/i386-linux-gnu/i686/cmov/libc.so.6 No symbol table info available. #2 0xb7610d72 in abort () from /lib/i386-linux-gnu/i686/cmov/libc.so.6 No symbol table info available. #3 0xb77912c0 in default_fatal_finish (type=, status=status at entry=0) at failures.c:191 backtrace = 0xb77de600 "<$\t" #4 0xb7791321 in i_internal_fatal_handler (ctx=0xbfd20944, format=0xb77bd4de "key not found from hash", args=0xbfd20964 "\204\n??Hv\005\b?ey?Wb?m\230v\005\b?\232x?") at failures.c:649 status = 0 #5 0xb7760edd in i_panic ( format=format at entry=0xb77bd4de "key not found from hash") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = 0xbfd20964 "\204\n??Hv\005\b?ey?Wb?m\230v\005\b?\232x?" #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) at hash.c:317 node = hash = 1839751767 #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) at master-service-settings-cache.c:167 No locals. #8 cache_add (parser=0x8b2f388, output=0xbfd209c0, input=0xbfd209c8, cache=0x8057648) at master-service-settings-cache.c:203 entry = pool = 0x8833fc0 pool_size = entry_local_name = #9 master_service_settings_cache_read (cache=0x8057648, input=input at entry=0xbfd20a68, dyn_parsers=dyn_parsers at entry=0x0, parser_r=parser_r at entry=0xbfd20a64, error_r=error_r at entry=0xbfd20a60) at master-service-settings-cache.c:297 output = {specific_services = 0x0, service_uses_local = 1, service_uses_remote = 0, used_local = 1, used_remote = 0} new_input = {roots = 0x804dba0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x804bc38 "imap-login", service = 0x804bc33 "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = {25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = { s_addr = 1839751767}}}, remote_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, local_name = 0x0} set = __FUNCTION__ = "master_service_settings_cache_read" #10 0xb77ef48d in login_settings_read (pool=0x9801dc8, local_ip=local_ip at entry=0xbfd20b1c, remote_ip=remote_ip at entry=0xbfd20b84, local_name=local_name at entry=0x0, other_settings_r=other_settings_r at entry=0xbfd20b18) at login-settings.c:226 input = {roots = 0x804dba0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x804bc38 "imap-login", service = 0x804bc33 "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = {25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = { s_addr = 1839751767}}}, remote_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, local_name = 0x0} error = parser = cache_sets = sets = i = count = __FUNCTION__ = "login_settings_read" #11 0xb77ef833 in client_connected_finish (conn=0xbfd20b78) at main.c:119 client = proxy = local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = { 25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = {s_addr = 1839751767}}} set = local_port = 993 pool = 0x9801dc8 fd_ssl = other_sets = #12 0xb778929c in master_service_listen (l=0x834d308) at master-service.c:803 service = 0x8056398 conn = {fd = 155, listen_fd = 11, name = 0x8056585 "imaps", remote_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, remote_port = 55451, fifo = 0, ssl = 1, accepted = 1} #13 0xb77a0054 in io_loop_call_io (io=0x834d438) at ioloop.c:379 ioloop = 0x8056468 t_id = 2 #14 0xb77a0ebe in io_loop_handler_run (ioloop=ioloop at entry=0x8056468) at ioloop-epoll.c:213 ctx = 0x834c488 events = 0x0 event = 0x96af618 list = 0x834d468 io = tv = {tv_sec = 45, tv_usec = 831525} events_count = 0 msecs = ret = 1 i = j = call = #15 0xb779f9f0 in io_loop_run (ioloop=0x8056468) at ioloop.c:398 No locals. #16 0xb7788aae in master_service_run (service=0x8056398, callback=callback at entry=0xb77efb60 ) at master-service.c:543 No locals. #17 0xb77f0300 in login_binary_run (binary=0x804bec0, argc=argc at entry=3, argv=0x80561c0, argv at entry=0xbfd20e14) at main.c:406 set_pool = 0x8056630 allow_core_dumps = login_socket = 0x80561e6 "director" c = #18 0x08049b63 in main (argc=3, argv=0xbfd20e14) at client.c:530 No locals. From Juergen.Obermann at hrz.uni-giessen.de Wed Aug 8 09:55:05 2012 From: Juergen.Obermann at hrz.uni-giessen.de (=?UTF-8?Q?J=C3=BCrgen_Obermann?=) Date: Wed, 08 Aug 2012 08:55:05 +0200 Subject: [Dovecot] doveadm import is always verbose Message-ID: Hello, with dovecot versions up to 2.1.9, when I use: doveadm import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all it always sends out info messages for every mail copied like that: doveadm(guser): Info: copy from mymail: box=restore_2012-05-08/mymail, uid=5, msgid=<######>, size=6999462 I had expected to see these info messages only if I add the verbose option to doveadm. And using the option -v with: doveadm -v import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all makes no difference at all, the same messages appear. The verbose option seems to be always on. Is this a bug or intended behaviour? Greetings, J?rgen -- J?rgen Obermann Hochschulrechenzentrum der Justus-Liebig-Universit?t Gie?en Heinrich-Buff-Ring 44 Tel. 0641-9913054 From madduck at madduck.net Wed Aug 8 12:08:10 2012 From: madduck at madduck.net (martin f krafft) Date: Wed, 8 Aug 2012 11:08:10 +0200 Subject: [Dovecot] Running spamc during LMTP delivery Message-ID: <20120808090810.GA9152@fishbowl.rw.madduck.net> Hello list, we are using dovecot-lmtp for delivery to virtual users, and vmm[1] to manage them. 1. http://vmm.localdomain.org/ One nice feature of vmm is that every virtual user has their own UID/GID on the UNIX filesystem. There is no passwd entry, so no shell login, but each user effectively has a home directory and can run commands in isolation and with lowered privileges. This requires dovecot-lmtp because only the LMTP LDA runs with root rights and can drop privileges to become the specific user for which it is delivering mail. We would now like to run SpamAssassin with the possibility of using the antispam plugin to enable virtual users to train their databases. Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an external command as a filter, to be run by the final user? Thanks, -- martin | http://madduck.net/ | http://two.sentenc.es/ "truth is stranger than fiction, but it is because fiction is obliged to stick to possibilities; truth isnt." -- mark twain spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From dgp-dove at corefiling.co.uk Wed Aug 8 13:01:30 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Wed, 08 Aug 2012 11:01:30 +0100 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120808090810.GA9152@fishbowl.rw.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> Message-ID: <502238FA.6040901@corefiling.co.uk> On 08/08/12 10:08, martin f krafft wrote: > Hello list, > > we are using dovecot-lmtp for delivery to virtual users, and vmm[1] > to manage them. > > 1. http://vmm.localdomain.org/ > > One nice feature of vmm is that every virtual user has their own > UID/GID on the UNIX filesystem. There is no passwd entry, so no > shell login, but each user effectively has a home directory and can > run commands in isolation and with lowered privileges. > > This requires dovecot-lmtp because only the LMTP LDA runs with root > rights and can drop privileges to become the specific user for which > it is delivering mail. > > We would now like to run SpamAssassin with the possibility of using > the antispam plugin to enable virtual users to train their > databases. > > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > external command as a filter, to be run by the final user? > > Thanks, Hi Martin, Have you taken a look at Pigeonhole and Sieve? There's experimental support for running spam filters and external commands. You'll need at least 0.3.0 which requires Dovecot 2.1. http://wiki2.dovecot.org/Pigeonhole/Sieve HTH, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From madduck at madduck.net Wed Aug 8 13:46:22 2012 From: madduck at madduck.net (martin f krafft) Date: Wed, 8 Aug 2012 12:46:22 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <502238FA.6040901@corefiling.co.uk> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> Message-ID: <20120808104622.GA16169@albatross.gern.madduck.net> also sprach Daniel Piddock [2012.08.08.1201 +0200]: > Have you taken a look at Pigeonhole and Sieve? There's experimental > support for running spam filters and external commands. You'll need at > least 0.3.0 which requires Dovecot 2.1. > > http://wiki2.dovecot.org/Pigeonhole/Sieve I have found this since and am working on it. Thanks! This looks like the ticket, and I will post back when I know more? -- martin | http://madduck.net/ | http://two.sentenc.es/ "we all know linux is great... it does infinite loops in 5 seconds." -- linus torvalds spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From Wiethoff at tfh-bochum.de Wed Aug 8 14:56:01 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Wed, 8 Aug 2012 11:56:01 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <20120807222226.GA8406@daniel.localdomain> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> Message-ID: <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> Hello Daniel, Daniel Parthey wrote: > Probably you are interested in reading the discussion from 2008: > http://www.dovecot.org/list/dovecot/2008-November/035263.html > > I think, a simple and robust solution would be to limit the > allowed characters for user passwords in your password > management system to 7-bit ASCII characters (only) and > reset passwords of all users having any login problems. Thanks for the link! I think I understood the major problem. But there is one point I couldn?t find out: From the dovecot auth-log I traced a password (T?st1234) with Umlaut: D-AS01:/var/log # grep st1234\) mail | cut -c 127-134 | hexdump -C 00000000 54 e4 73 74 31 32 33 34 0a |T.st1234.| 00000009 As you can see this is ISO-8859-1: e4 --> ? But the first incoming String from the client was UTF-8 encoded!? [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 Anyway... I guess I have to force our users to 7-bit Characters :-( Greetings, Helge ________________________________ Helge Wiethoff Medienzentrum Telefon: +49 (234) 968 8717 Fax: +49 (234) 968 3453 E-Mail: Wiethoff at tfh-bochum.de Technische Fachhochschule Georg Agricola f?r Rohstoff, Energie und Umwelt zu Bochum Staatlich anerkannte Fachhochschule der DMT-Gesellschaft f?r Lehre und Bildung mbH Herner Stra?e 45 44787 Bochum http://www.tfh-bochum.de ________________________________ Tr?ger: DMT-Gesellschaft f?r Lehre und Bildung mbH Sitz der Gesellschaft: Bochum Registergericht: Amtsgericht Bochum Handelsregister: B 4052 Gesch?ftsf?hrung: Prof. Dr. J?rgen Kretschmann (Vorsitzender) Manfred Freitag From andre.groebe at fun.de Wed Aug 8 15:23:00 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Wed, 08 Aug 2012 14:23:00 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict Message-ID: <50225A24.4010109@fun.de> Hi, I am using dovecot (see dovecot -n output below) with metadata plugin in my own plugin. I want to insert and delete some large metadata (>4KiB). It seems, that the delete in a second call of my plugin smashes the file dovecot.dict in users dir: 1st call: *dovecot.dict is empty -delete metadata 1 -delete metadata 2 -insert metadata 1 ~8KiB -insert metadata 2 <1KiB *dovecot.dict contains two entries 2nd call: -delete metadata 1 -delete metadata 2 -insert metadata 1 ~8KiB -insert metadata 2 <1KiB *dovecot.dict contains the two entries + some waste If all eight steps are called together (in the same plugin context) the file dovecot.dict seems to be ok. I have created a test plugin to reproduce this behaviour: . It needs the notify and (patched) metadata plugin to run. To get it work i copy an email from one IMAP folder to another (to trigger the copy notifier). It seems, that there is an issue on writing metadata/dict, can anybody reproduce it or knows what is wrong? TIA -- Andre From andre.groebe at fun.de Wed Aug 8 15:33:03 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Wed, 08 Aug 2012 14:33:03 +0200 Subject: [Dovecot] [bulk]: Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <50225C7F.2070300@fun.de> missing patch and info: metadata patch ============== --- a/src/metadata-backend.c +++ b/src/metadata-backend.c @@ -130,7 +130,8 @@ metadata_set_entry(struct metadata_entry *entry, struct mail_user *user) { if (!metadata_entry_is_valid(entry)) return -METADATA_ERROR_INVALID; - if (strlen(metadata_entry_get_value(entry)) > muser->set->maxsize) + if (metadata_entry_get_value(entry) != NULL + && strlen(metadata_entry_get_value(entry)) > muser->set->maxsize) return -METADATA_ERROR_TOOLARGE; if (count_entries(muser) > muser->set->maxentries) return -METADATA_ERROR_TOOMANY; --- a/Makefile.am +++ b/Makefile.am @@ -1,3 +1,6 @@ ACLOCAL_AMFLAGS = -I m4 SUBDIRS = src + +pkginc_libdir=$(dovecot_pkgincludedir)/metadata +nodist_pkginc_lib_HEADERS = metadata-config.h --- a/src/Makefile.am +++ b/src/Makefile.am @@ -42,7 +42,7 @@ lib90_imap_annotatemore_plugin_la_LIBADD = \ lib80_metadata_plugin.la endif -noinst_HEADERS = \ +headers = \ metadata-backend.h \ metadata-entry.h \ metadata-entry-private.h \ @@ -55,3 +55,6 @@ noinst_HEADERS = \ imap-arg-ext.h \ mailbox-ext.h \ str-ext.h + +pkginc_libdir=$(dovecot_pkgincludedir)/metadata +pkginc_lib_HEADERS = $(headers) dovecot -n ========== # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35-1exp2-intern-k8-kvm x86_64 Debian 6.0.5 ext3 debug_log_path = /var/opt/dovecot/log/dovecot.log default_vsz_limit = 512 M disable_plaintext_auth = no first_valid_uid = 0 info_log_path = /var/opt/dovecot/log/dovecot.log lmtp_check_rcpt = yes lmtp_rcpt_to_parameters { * = i: ignorequota = b:plugin/quota_ignore xtolain = s:plugin/lain xtomsgtype = s:plugin/mailtype_xtomsgtype xtospam = b:plugin/spamflag_xtospam xtovacation = B:plugin/sieve_xtovacation } log_path = /var/opt/dovecot/log/dovecot.log log_timestamp = "%y%m%H%M%S " mail_gid = mail mail_home = /var/spool/dovecot/%2.256Hu/%3.4096Hu/%u mail_location = mdbox:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u mail_plugin_dir = /opt/app/dovecot/lib/dovecot mail_plugins = notify metadata test mail_uid = mail namespace inbox { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = nocache=y /var/spool/dovecot/deny deny = yes driver = passwd-file } passdb { args = nopassword=y driver = static } plugin { acl = vfile autocreate = INBOX.Drafts autocreate2 = INBOX.Sent autocreate3 = INBOX.Trash metadata_dict = file:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u/dovecot.dict metadata_maxsize = 10240 quota = dict:User quota::file:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u/dovecot.dict quota_rule = *:bytes=999999 quota_rule2 = *:messages=999 quota_rule3 = *:mailboxes=99 quota_rule4 = *:levels=9 quota_rule5 = INBOX.Voicebox:ignore } service anvil { unix_listener anvil { group = dovecot mode = 0660 } } service auth-worker { user = $default_internal_user } service auth { unix_listener auth-userdb { group = dovecot mode = 0660 } } service config { unix_listener config { group = dovecot mode = 0660 } } service dict { unix_listener dict { mode = 0600 user = mail } } service lmtp { inet_listener lmtp { port = 2003 } } ssl = no userdb { args = /opt/app/dovecot/etc/dovecot/dovecot-tdbfcall.conf.ext driver = tdbfcall } protocol imap { mail_plugins = notify metadata test autocreate imap_metadata imap_annotatemore } protocol pop3 { pop3_uidl_format = %v.%u } -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Wed Aug 8 16:09:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:09:09 +0300 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120808090810.GA9152@fishbowl.rw.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> Message-ID: <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> On 8.8.2012, at 12.08, martin f krafft wrote: > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > external command as a filter, to be run by the final user? Use spampd LMTP proxy? From tss at iki.fi Wed Aug 8 16:14:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:14:13 +0300 Subject: [Dovecot] error message. Some help please In-Reply-To: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> References: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> Message-ID: <3B1B423B-AAD3-405A-86EE-31063DD914E0@iki.fi> On 7.8.2012, at 12.40, Spyros Tsiolis wrote: > Jul 06 13:51:20 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count > Jul 18 15:20:32 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count > Jul 19 09:16:40 dovecot: Warning: Killed with signal 15 (by pid=3062 uid=0 code=kill) > ......... > > Should I just go ahead and increase login_max_processes_count ? > Is it that simple ? Yes, you probably should just increase it. http://wiki1.dovecot.org/LoginProcess has more info. From tss at iki.fi Wed Aug 8 16:16:17 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:16:17 +0300 Subject: [Dovecot] replication chain In-Reply-To: <213B51F00051AE48A9F0E11288017717B84099@Delta.sc.local> References: <213B51F00051AE48A9F0E11288017717B84099@Delta.sc.local> Message-ID: On 7.8.2012, at 15.04, ???????? ????????? ?????????? wrote: > good day! > > I wonder if it is possible to make a chain of replication in dovecot 2.1.9. > Now I'm using two way replication(I use proxy to redirect users) and it's working just fine but > is it possible to setup replication like this: > > serverA ---> serverB --> server C > <--- > > I've added additional mail_replica2 on serverB > and after restart dovecot didn't complain about errors, > with doveconf -n I am able to see two replica's settings but > user's mails aren't replicating to server C. > no errors in logs. > I want to use server C as backup server with lvm snapshots. The automatic replication currently can replicate to only one other server. And the replication doesn't trigger again when dsync is run. You could do this if you manually run dsync e.g. in a cronjob. From tss at iki.fi Wed Aug 8 16:20:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:20:15 +0300 Subject: [Dovecot] Dovecot with Company - level Quota In-Reply-To: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> References: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> Message-ID: <5F1A3083-7354-44DA-BBA1-CD7DCE80115C@iki.fi> On 7.8.2012, at 18.17, Kavish Karkera wrote: > We are using maildir as quota-backend , and performing user level quota, which is working fine. (using dovecot 2.x ). > > Now the requirement is to , restrict the quota to client / company level along with user level quota. http://www.dovecot.org/list/dovecot/2010-May/049168.html http://wiki2.dovecot.org/Quota/Dict The quota recalculation (also means setting the initial quota) is still a problem. I guess it could be possible to fix nowadays since you can also script it by doing something like: doveadm quota get -u '*@example.com' and sum up the quota values and update the domain quota. From tss at iki.fi Wed Aug 8 16:21:50 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:21:50 +0300 Subject: [Dovecot] doveadm import is always verbose In-Reply-To: References: Message-ID: <5D3FA231-0235-478B-A375-320FE798844F@iki.fi> On 8.8.2012, at 9.55, J?rgen Obermann wrote: > doveadm(guser): Info: copy from mymail: box=restore_2012-05-08/mymail, uid=5, msgid=<######>, size=6999462 > I had expected to see these info messages only if I add the verbose option to doveadm. And using the option -v with: > doveadm -v import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all > makes no difference at all, the same messages appear. The verbose option seems to be always on. Is this a bug or intended behaviour? Those messages are coming from mail_log plugin. You could do something like: protocol doveadm { plugin { mail_log_events = } } From tss at iki.fi Wed Aug 8 16:41:06 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:41:06 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50220A3E.407@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> Message-ID: <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> On 8.8.2012, at 9.42, tonio at starbridge.org wrote: > I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) > > Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) .. > #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) > at hash.c:317 > node = > hash = 1839751767 > #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) > at master-service-settings-cache.c:167 I don't see how this could happen by looking at the code. I also can't reproduce this myself. Can you easily reproduce this? Could you run imap-login via valgrind (it slows things down): service imap-login { executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login } (you may not have/need --vgdb=no, depends on your valgrind version) From asier.cidon at externo.uam.es Wed Aug 8 17:12:52 2012 From: asier.cidon at externo.uam.es (asier.cidon at externo.uam.es) Date: Wed, 08 Aug 2012 16:12:52 +0200 Subject: [Dovecot] sieve vacation messages trouble Message-ID: <20120808161252.79072gldxhycsphc@webmail.uam.es> The problem is solved!!!! In the library "src/lib-sieve/plugins/vacation/cmd-vacation.c", in the package "dovecot-sieve" or "dovecot-pigeonhole" modify: smtp_handle = sieve_smtp_open(senv, reply_to, NULL, &f); smtp_handle = sieve_smtp_open(senv, reply_to, reply_from, &f); You can check the correct operation in your logs. /var/log/maillog postfix/smtpd[27112]: connect from smtp.mydomain.com postfix/smtpd[27112]: A95D2168456: client=smtp.mydomain.com postfix/cleanup[27114]: A95D2168456: message-id= postfix/smtpd[27112]: disconnect from smtp.mydomain.com postfix/qmgr[17010]: A95D2168456: from=, size=7274, nrcpt=1 (queue active) postfix/pipe[27115]: A95D2168456: to=, relay=dovecot, delay=0.09, delays=0.01/0/0/0.08, dsn=2.0.0, status=sent (delivered via dovecot service) postfix/qmgr[17010]: A95D2168456: removed /var/log/dovecot.log dovecot: auth(default): master out: USER 1 asier.cidon at mydomain.com uid=xxx gid=xxx quota_rule=*:bytes=524288000 home=/buzon/asier.cidon dovecot: deliver(asier.cidon at mydomain.com): sieve: msgid=: sent vacation response to dovecot: deliver(asier.cidon at mydomain.com): sieve: msgid=: stored mail into mailbox 'INBOX' /var/log/maillog postfix/pickup[17009]: B221D168458: uid=xxx from= postfix/cleanup[27114]: B221D168458: message-id= postfix/qmgr[17010]: B221D168458: from=, size=661, nrcpt=1 (queue active) postfix/smtp[27195]: B221D168458: to=, relay=smtpinterno.mydomain.com, delay=0.04, delays=0.01/0/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as A3A092280B3) postfix/qmgr[17010]: B221D168458: removed From stephan at rename-it.nl Wed Aug 8 17:32:48 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 08 Aug 2012 16:32:48 +0200 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120808161252.79072gldxhycsphc@webmail.uam.es> References: <20120808161252.79072gldxhycsphc@webmail.uam.es> Message-ID: <50227890.7040107@rename-it.nl> Op 8/8/2012 4:12 PM, asier.cidon at externo.uam.es schreef: > The problem is solved!!!! > > > In the library "src/lib-sieve/plugins/vacation/cmd-vacation.c", in the > package "dovecot-sieve" or "dovecot-pigeonhole" modify: > > smtp_handle = sieve_smtp_open(senv, reply_to, NULL, &f); > smtp_handle = sieve_smtp_open(senv, reply_to, reply_from, &f); As pointed out earlier in this thread, this is a qmail issue. The SMTP MAIL FROM is set to <> on purpose: http://tools.ietf.org/html/rfc3834#section-3.3 http://tools.ietf.org/html/rfc5230#section-5.1 This prevents other automated responders from replying to this message, e.g. an MTA sending a delivery failure. This (among other safeguards) prevents mail loops. The above change is therefore not recommended. Regards, Stephan. From nikolai at net24.co.nz Wed Aug 8 18:28:27 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Thu, 9 Aug 2012 03:28:27 +1200 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> Message-ID: <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> Hi Timo, Thanks for your fix! Just want to confirm that the re-order of connections has fixed the issue. We still have occasional issues with the POP3 server (locking issues and busy timeouts etc). Because dsync reports sync ok, we have parse to output looking for 'Error: pop3_migration' to determine if it was in-fact ok or if we need to do a re-sync. We have seen some IMAP 'Server dsconnected unexpectedly' errors also (on large mailboxes again), but it doesn't appear to cause any issues. Does dsync reconnect if the IMAP connection is lost? Thank you. Regards, Nikolai. On 4/08/2012, at 2:40 AM, Timo Sirainen wrote: > On 3.8.2012, at 10.04, Nikolai Schupbach wrote: > >> There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. > > What should happen is: > > 1. pop3c connects to server > 2. issues LIST and UIDL commands > 3. IMAP server issues fetch 1:* RFC822.SIZE (or I guess it does this with a ton of separate commands) > 4. pop3c attempts to do some TOP commands. > >> When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): >> >> dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly >> dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected > > It looks like the 3 step takes a long time. Do you have imapc_features=rfc822.size? Also setting mail_prefetch_count to something between 10..100 should help a lot. And this should also fix it by moving 3 step to 1: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d > >> Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. > > Yes, looks like dsync simply continues without assigning POP3 UIDL. Hmm. Perhaps it shouldn't do that on temporary failures.. > >> Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, > > This isn't easily possible. > >> or it should simply reconnect if sees the connection is lost. > > It should probably do that, yes. From tss at iki.fi Wed Aug 8 18:59:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 18:59:07 +0300 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> Message-ID: <8D9C4418-B83E-403C-9669-2A3F0278795A@iki.fi> On 8.8.2012, at 18.28, Nikolai Schupbach wrote: > Hi Timo, > > Thanks for your fix! Just want to confirm that the re-order of connections has fixed the issue. We still have occasional issues with the POP3 server (locking issues and busy timeouts etc). Because dsync reports sync ok, we have parse to output looking for 'Error: pop3_migration' to determine if it was in-fact ok or if we need to do a re-sync. v2.2 dsync gives a real error instead of ignoring the problem. > We have seen some IMAP 'Server dsconnected unexpectedly' errors also (on large mailboxes again), but it doesn't appear to cause any issues. Does dsync reconnect if the IMAP connection is lost? Yes, the imapc backend code does automatic reconnections. From kind at it.uib.no Wed Aug 8 19:13:21 2012 From: kind at it.uib.no (Hans Morten Kind) Date: Wed, 8 Aug 2012 18:13:21 +0200 Subject: [Dovecot] Statistics scripts In-Reply-To: <42DEDB45-6B9A-47BB-BFB1-B82ECC086839@iki.fi> References: <42DEDB45-6B9A-47BB-BFB1-B82ECC086839@iki.fi> Message-ID: <20120808161320.GA1497@alf.uib.no> I guess everybody has spent their holiday looking into the stats features of dovecot-2.1! This is as far as I have got, it is a perl-script using Curses to smooth the screen and capture keystrokes while running. Mostly tested on Solaris but should probably run everywhere setting $base_dir, it does not make use of temporary files. http://half.uib.no/dovtop/dovtop.txt Our site has app 20k users with 4-5k concurrent. We have been using dovecot since 2006 with great success - though a lot of the staff are prefering exhcange to get the calendar ... When running for a while with a sleeptime of 10 or more 'dovtop' should give a reasonable status of current usage? hmk From uros.gruber at gmail.com Wed Aug 8 19:13:42 2012 From: uros.gruber at gmail.com (Uros) Date: Wed, 8 Aug 2012 18:13:42 +0200 Subject: [Dovecot] Quota dict configuration Message-ID: Hi, I have enabled quota dict with mysql following wiki http://wiki2.dovecot.org/Quota/Dict Everything work as expected. I just have a question about query used for updating quota usage. I already check the source file dict-sql.c but i still can't figure it out. I store user info in a mysql table where only left (user) part of an email address is stored with foreign id for domain conected to domain table. The problem is administration because quota table have primary key whole email. Is there even possible to configure quota dict settings to use separate variables %n and %d like in user and password query? -- lp Uro? From acrow at integrafin.co.uk Wed Aug 8 21:19:55 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Wed, 08 Aug 2012 19:19:55 +0100 Subject: [Dovecot] Dsync and SIS Message-ID: <5022ADCB.8060805@integrafin.co.uk> Hi all, Just to clarify, if we back up a dovecot 2 server with SIS for attachments and ALT storage by rsyncing it (including the SIS and ALT storage) to a remote server when it's idle (or at least almost entirely so), and run dovecot on that machine, would it seem feasible to restore backups from that server by using dysnc - specifically for the scenario where someone accidentally deletes emails/folders etc.? I've seen queries about SIS before but nothing specifically about this scenario. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From elias.tamas at vagyok.eu Thu Aug 9 03:34:13 2012 From: elias.tamas at vagyok.eu (_ET_) Date: Wed, 8 Aug 2012 17:34:13 -0700 (PDT) Subject: [Dovecot] maildir to sdbox offline conversion Message-ID: <34274589.post@talk.nabble.com> Hi all. I've just installed dovecot v2.1 in a multihomed, multiinstance setup, It took me two days to convert the old v1.1 configs, now everything works like charm! But. :) I have several maildir mailboxes, I decided to use the sdbox storage type instead. I ran into difficoulties using the dsync util. My virtual users are in an OpenLDAP DB on a differnet machine, and I do not have access to the database (I can authenticate the users from ldap, but cannot change or see anything) So it's not easy to do an "online" conversion and follow the instructions at dsync's wiki. Do you know a way how to simply tell dsync or a similar util the following dsync convert maildir:/data/vmail/domain/user sdbox:/newdata/vmail/domain/user without touching the ldap database, only the files on the disk. I can run this command as root on this mail server, if it is needed, I can run the command for each and every maildir. That's not a problem. any ideas, how this woul?d be the simpliest? -- View this message in context: http://old.nabble.com/maildir-to-sdbox-offline-conversion-tp34274589p34274589.html Sent from the Dovecot mailing list archive at Nabble.com. From matthew at atom.net Thu Aug 9 05:10:30 2012 From: matthew at atom.net (Matthew Powell) Date: Wed, 8 Aug 2012 22:10:30 -0400 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> Message-ID: <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> On 2012-08-08, at 7.56, "Wiethoff, Helge" wrote: > As you can see this is ISO-8859-1: e4 --> ? > But the first incoming String from the client was UTF-8 encoded!? > > [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 > > Anyway... I guess I have to force our users to 7-bit Characters :-( You mentioned Roundcube earlier. I notice this in Roundcube's default main.inc.php: // Password charset. // Use it if your authentication backend doesn't support UTF-8. // Defaults to ISO-8859-1 for backward compatibility $rcmail_config['password_charset'] = 'ISO-8859-1'; ...so changing that to UTF-8 may fix the problem so far as Roundcube is concerned. But you may still face a problem with other clients. We just discussed Thunderbird's behaviour a few days back... -- Matthew Powell matthew at atom.net From ml-dovecot at zu-con.org Thu Aug 9 09:20:17 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Thu, 09 Aug 2012 08:20:17 +0200 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <1344375938.19913.85.camel@hurina> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> <501CCB1C.80908@zu-con.org> <1344375938.19913.85.camel@hurina> Message-ID: Hi, Am 07.08.2012 23:45, schrieb Timo Sirainen: > On Sat, 2012-08-04 at 09:11 +0200, Matthias Rieber wrote: >> >> I've deleted 10000s emails and it seems that every mail is >> removed with >> >> a single request from Solrs index. This works, but it's quite >> slow. Is >> >> it possible/plans to improve that? >> > >> > Could you try if the attached patch works? It compiles, but didn't >> test it. >> >> it segfaults: > > This should work: http://hg.dovecot.org/dovecot-2.1/rev/82f59d2139a9 perfect. I deleted the content of a folder with ~50000 mails, the speed was good. Matthias From stsiol at yahoo.co.uk Thu Aug 9 09:31:26 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Thu, 9 Aug 2012 07:31:26 +0100 (BST) Subject: [Dovecot] dovecot rpm packages for CentOS ? Message-ID: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Hello all again, Has anyone any idea how to get the latest dovecot version for CentOS 5.8 or 6.2 32-bit OS ? I did a quick search and found out that the official version of dovecot for CentOS v5.8 is 1.0.2 (!!). Any repos ? Any ideas :-) ? Thank you all, spyros ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From bmalik at ihlas.net.tr Thu Aug 9 09:10:20 2012 From: bmalik at ihlas.net.tr (Bulend Mali) Date: Wed, 8 Aug 2012 23:10:20 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 Message-ID: <34275123.post@talk.nabble.com> Hello I use dovecot2 on vpopmail,qmail. i want to use login-intranet-imap.sh in order to restrict by emailaddress and ip address. i read it at http://wiki2.dovecot.org/PostLoginScripting. But there is an expression "mail_executable" in conf. but there is no such thing in dovecot2. what is equivalent of it for dovecot2 ? -- View this message in context: http://old.nabble.com/about-postlogin-in-dovecot2-tp34275123p34275123.html Sent from the Dovecot mailing list archive at Nabble.com. From voytek at sbt.net.au Thu Aug 9 09:42:12 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Thu, 9 Aug 2012 16:42:12 +1000 Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> References: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Message-ID: <445039c8e7186d42c3750792f42bd3b5.squirrel@geko.sbt.net.au> On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > Hello all again, > Has anyone any idea how to get the latest dovecot version for CentOS > 5.8 or 6.2 32-bit OS ? > I did a quick search and found out that the official version of dovecot > for CentOS v5.8 is 1.0.2 (!!). > > Any repos ? Any ideas :-) ? I've followed/used the link on dovecot main page, and, ended up with: # dovecot --version 2.1.1 dovecot-2.1.1-2_132.el6.i686.rpm dovecot-2.1.1-2_132.el6.x86_64.rpm -- Voytek Eymont From tonio at starbridge.org Thu Aug 9 10:15:12 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Thu, 09 Aug 2012 09:15:12 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> Message-ID: <50236380.1070703@starbridge.org> Le 08/08/2012 15:41, Timo Sirainen a ?crit : > On 8.8.2012, at 9.42, tonio at starbridge.org wrote: > >> I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) >> >> Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) > .. >> #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) >> at hash.c:317 >> node = >> hash = 1839751767 >> #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) >> at master-service-settings-cache.c:167 > I don't see how this could happen by looking at the code. I also can't reproduce this myself. Can you easily reproduce this? Could you run imap-login via valgrind (it slows things down): > > service imap-login { > executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login > } > > (you may not have/need --vgdb=no, depends on your valgrind version) > Timo, I can'f find what trigger this error, and it seems only happenig under some load here the error log in mail.log: (by the way, this is not the same server than before, this one running a Debian Wheezy on a 2.6.32.2 linux kernel and 64 bits architecture.) Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EE3D: client_connected_finish (main.c:139) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508C3E4: master_service_listen (master-service.c:803) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA6A: login_settings_read (login-settings.c:226) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x509FC87: io_loop_run (ioloop.c:398) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BB3: settings_parser_get_list (settings-parser.c:255) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EE3D: client_connected_finish (main.c:139) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508C3E4: master_service_listen (master-service.c:803) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA6A: login_settings_read (login-settings.c:226) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x509FC87: io_loop_run (ioloop.c:398) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Aug 9 09:01:37 smtp dovecot: imap-login: Panic: file login-settings.c: line 232 (login_settings_read): assertion failed: (cache_sets[count] == NULL) backtrace on vgcore: gdb /usr/lib/dovecot/imap-login /root/vgcore.27313 GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/imap-login...done. warning: core file may not match specified executable file. [New LWP 27313] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `'. Program terminated with signal 6, Aborted. #0 0x0000000005311475 in *__GI_raise (sig=) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 ../nptl/sysdeps/unix/sysv/linux/raise.c: Aucun fichier ou dossier de ce type. (gdb) bt full #0 0x0000000005311475 in *__GI_raise (sig=) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 pid = selftid = #1 0x00000000053146f0 in *__GI_abort () at abort.c:92 act = {__sigaction_handler = {sa_handler = 0x4e45130, sa_sigaction = 0x4e45130}, sa_mask = {__val = {34342962424, 84234600, 67249360, 84246240, 4294967295, 86924192, 67250608, 2684328, 4294967295, 34342962672, 1, 2679208, 0, 34342962672, 113514016, 84197376}}, sa_flags = 67164658, sa_restorer = 0x1} sigs = {__val = {32, 0 }} #2 0x0000000005093538 in default_fatal_finish (type=, status=status at entry=0) at failures.c:191 backtrace = 0x76d2364 "\003\003P#`P1" #3 0x000000000509356e in i_internal_fatal_handler (ctx=0x7ff0004e0, format=, args=) at failures.c:649 status = 0 #4 0x0000000005067efa in i_panic (format=format at entry=0x4e45130 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ff0005d0, reg_save_area = 0x7ff000510}} #5 0x0000000004e3ecd4 in login_settings_read (pool=0x8783670, local_ip=local_ip at entry=0xafce3e4, remote_ip=remote_ip at entry=0xafce3f8, local_name=, other_settings_r=other_settings_r at entry=0x7ff000698) at login-settings.c:232 input = {roots = 0x6056c0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x4043b4 "imap-login", service = 0x4043af "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "Wb?e", '\000' , __u6_addr16 = {25175, 26023, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1705468503, 0, 0, 0}}}, ip4 = {s_addr = 1705468503}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = ".il?", '\000' , __u6_addr16 = {26926, 53868, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {3530320174, 0, 0, 0}}}, ip4 = {s_addr = 3530320174}}}, local_name = 0x75f1b00 "imap.spamguard.fr"} error = parser = 0x65fc1c0 cache_sets = 0x6c41628 sets = i = count = ---Type to continue, or q to quit--- __FUNCTION__ = "login_settings_read" #6 0x0000000004e41348 in ssl_servername_callback (ssl=0x6cf8c70, al=, context=) at ssl-proxy-openssl.c:1144 ctx = proxy = client = 0xafce360 host = other_sets = 0x1 #7 0x000000000568f162 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #8 0x000000000567b205 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #9 0x000000000567f8c5 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #10 0x000000000568c103 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #11 0x0000000004e41af1 in ssl_handshake (proxy=0x7010e10) at ssl-proxy-openssl.c:465 ret = #12 ssl_step (proxy=0x7010e10) at ssl-proxy-openssl.c:528 No locals. #13 0x0000000004e420c5 in ssl_proxy_start (proxy=) at ssl-proxy-openssl.c:658 No locals. #14 0x0000000004e3ee3e in client_connected_finish (conn=0x7ff000880) at main.c:139 client = 0xafce360 proxy = 0x7010e10 local_ip = {family = 2, u = {ip6 = {__in6_u = {__u6_addr8 = "Wb?e", '\000' , __u6_addr16 = { 25175, 26023, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1705468503, 0, 0, 0}}}, ip4 = {s_addr = 1705468503}}} set = 0x87836a8 local_port = 993 pool = 0x8783670 fd_ssl = other_sets = 0x8783698 #15 0x000000000508c3e5 in master_service_listen (l=0x7187990) at master-service.c:803 service = 0x64ef820 ---Type to continue, or q to quit--- conn = {fd = 141, listen_fd = 9, name = 0x64efd3a "imaps", remote_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = ".il?", '\000' , __u6_addr16 = {26926, 53868, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {3530320174, 0, 0, 0}}}, ip4 = {s_addr = 3530320174}}}, remote_port = 34589, fifo = 0, ssl = 1, accepted = 1} #16 0x00000000050a0276 in io_loop_call_io (io=0x7187bd0) at ioloop.c:379 ioloop = 0x64efa10 t_id = 2 #17 0x00000000050a0f07 in io_loop_handler_run (ioloop=ioloop at entry=0x64efa10) at ioloop-epoll.c:213 ctx = 0x7185c80 events = 0x0 event = 0xae5d410 list = 0x7187c50 io = tv = {tv_sec = 54, tv_usec = 854242} events_count = msecs = ret = 1 i = call = #18 0x000000000509fc88 in io_loop_run (ioloop=0x64efa10) at ioloop.c:398 No locals. #19 0x000000000508bd23 in master_service_run (service=0x64ef820, callback=callback at entry=0x4e3f060 ) at master-service.c:543 No locals. #20 0x0000000004e3f6fe in login_binary_run (binary=, argc=2, argv=0x64ef450) at main.c:406 set_pool = 0x64eff90 allow_core_dumps = login_socket = c = #21 0x00000000052fdead in __libc_start_main (main=, argc=, ubp_av=, init=, fini=, rtld_fini=, stack_end=0x7ff000b38) at libc-start.c:228 result = unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 4734455784457788985, 4203696, 34342964032, 0, 0, 4736613026474909241, 4734444482055265849}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x4041a0, ---Type to continue, or q to quit--- 0x7ff000b48}, data = {prev = 0x0, cleanup = 0x0, canceltype = 4211104}}} not_first_call = #22 0x00000000004024d9 in _start () No symbol table info available. From tss at iki.fi Thu Aug 9 10:27:06 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 10:27:06 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50236380.1070703@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> Message-ID: <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> On 9.8.2012, at 10.15, tonio at starbridge.org wrote: >> Could you run imap-login via valgrind (it slows things down): >> >> service imap-login { >> executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login >> } >> >> (you may not have/need --vgdb=no, depends on your valgrind version) >> > > Timo, > I can'f find what trigger this error, and it seems only happenig under some load > here the error log in mail.log: .. > Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) .. > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Thanks. Obviously I shouldn't free cached settings while they're still being used. :) I'll get it fixed tomorrow. For now you could work around it by increasing config_cache_size setting (default is 1M). From c at roessner-network-solutions.com Thu Aug 9 11:14:13 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 9 Aug 2012 10:14:13 +0200 Subject: [Dovecot] some mdbox mails get lost each day Message-ID: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> Hi, I have a strange problem here. I had installed Dovecot-2.1.6 on a customers setup. They have 102 mail accounts on the server. The started using this dovecot version on the 20th June. One mailbox suddenly started expunging mails. Not from the current day, but one week back in the past. First I thought about an Outlook issue. Some filter or archieving thing, but we did a test and on one day, the curstomer did not start Outlook first; instead he checked his mails with the SOGo-webinterface. We saw that mails got deleted again. I checked for sieve filters. None. I upgraded dovecot to 2.1.7, as I have not done any newer packages yet for Ubuntu (using my own PPA). Same problem one day later. I tested with telnet locally. Same result as in the client. I also did doveadm dump -t log and index and saw that there had been expunged mails. Yesterday I asked the customer to backup all his mails in Outlook. After that I renamed the whole mdbox folder of this account on the server and sent one test mail to recreate the mailbox. After that her restored his mail in Outlook. This morning her contacted me and said that all mails are ok right now and no mails have been erased anymore. Coud this been a corrupted index? I also chekced the storage/-folder and see that all mails are still on disk. Now he asked me if there is any way to get all the lost messaged back? It would be okay for him, if all mails since June are sent again, as he can clean his mailbox afterwards. So does somebody have an idea on how to solve this? Maybe scripting something in python and using local sendmail command? Or is there some doveadm voodoo to repair the index or unexpunge all mails? Thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From tss at iki.fi Thu Aug 9 11:20:42 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 11:20:42 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> Message-ID: <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> On 9.8.2012, at 11.14, Christian R??ner wrote: > I have a strange problem here. I had installed Dovecot-2.1.6 on a customers setup. They have 102 mail accounts on the server. The started using this dovecot version on the 20th June. One mailbox suddenly started expunging mails. Not from the current day, but one week back in the past. First I thought about an Outlook issue. Some filter or archieving thing, but we did a test and on one day, the curstomer did not start Outlook first; instead he checked his mails with the SOGo-webinterface. We saw that mails got deleted again. A wrongly used doveadm expunge in a cronjob? mail_log plugin is very helpful when trying to figure out what deletes messages. http://wiki2.dovecot.org/Plugins/MailLog > Yesterday I asked the customer to backup all his mails in Outlook. After that I renamed the whole mdbox folder of this account on the server and sent one test mail to recreate the mailbox. After that her restored his mail in Outlook. This morning her contacted me and said that all mails are ok right now and no mails have been erased anymore. > > Coud this been a corrupted index? Corrupted indexes would log errors in log file. Do you see any errors/warning? > I also chekced the storage/-folder and see that all mails are still on disk. Now he asked me if there is any way to get all the lost messaged back? It would be okay for him, if all mails since June are sent again, as he can clean his mailbox afterwards. So does somebody have an idea on how to solve this? Maybe scripting something in python and using local sendmail command? > > Or is there some doveadm voodoo to repair the index or unexpunge all mails? cp mdbox ~/mdbox-backup rm -rf ~/mdbox-backup/storage/dovecot.map* ~/mdbox-backup/mailboxes/ doveadm import mdbox:~/mdbox-backup all-mails all Now all the mails in m.* files are under all-mails folder. From nikolai at net24.co.nz Thu Aug 9 11:20:56 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Thu, 9 Aug 2012 20:20:56 +1200 Subject: [Dovecot] dsync \noselect on INBOX.INBOX skips sync of INBOX Message-ID: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> Hi Timo, We have encountered an issue today with a number of migrations. Some customers have mailboxes on the source IMAP server that look like this: 3 LIST "" * * LIST () "." "INBOX" * LIST () "." "INBOX.Statements" * LIST () "." "INBOX.Draft" * LIST () "." "INBOX.Drafts" * LIST () "." "INBOX.Invoices" * LIST (\Noselect) "." "INBOX.INBOX" * LIST () "." "INBOX.Jokes" * LIST () "." "INBOX.Payslips" * LIST () "." "INBOX.Personal" When we run dsync it skips the INBOX presumably because of the Noselect on INBOX.INBOX. and the "imapc_list_prefix = INBOX" setting. Regards, Nikolai. From tss at iki.fi Thu Aug 9 11:30:11 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 11:30:11 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <7AEA5CEE-0738-4723-B7E4-E1D39C72ED8F@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <7AEA5CEE-0738-4723-B7E4-E1D39C72ED8F@roessner-network-solutions.com> Message-ID: On 9.8.2012, at 11.24, Christian R??ner wrote: > I had enabled mail_log and search for any kind of errors. None. Only expunge messages from a imap process. Which I thought was Outlook. But isn't. So there is an imap expunge entry for all of the mails that get lost? You should be able to match that with the IMAP client's IP address by using session IDs, for example: mail_log_prefix = "%s(%u) <%{session}>: " Also you may be able to find out what client is doing it by setting: imap_id_log = * From vlb at isks.ru Thu Aug 9 11:33:39 2012 From: vlb at isks.ru (Vladimir Bukov) Date: Thu, 09 Aug 2012 12:33:39 +0400 Subject: [Dovecot] dovecot rpm packages for CentOS ? Message-ID: <502375E3.7030104@isks.ru> On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > > Hello all again, > > Has anyone any idea how to get the latest dovecot version for CentOS > > 5.8 or 6.2 32-bit OS ? > > I did a quick search and found out that the official version of dovecot > > for CentOS v5.8 is 1.0.2 (!!). > > > > Any repos ? Any ideas :-) ? > http://www.city-fan.org/ftp/contrib/mail/ From Wiethoff at tfh-bochum.de Thu Aug 9 11:47:47 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Thu, 9 Aug 2012 08:47:47 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> Message-ID: <194290040642FB4D952083D79F7F7D1D31A129@BOHEMSX2010.rbbk.de> Hi Matthew, > You mentioned Roundcube earlier. I notice this in Roundcube's default > main.inc.php: > > // Password charset. > // Use it if your authentication backend doesn't support UTF-8. > // Defaults to ISO-8859-1 for backward compatibility > $rcmail_config['password_charset'] = 'ISO-8859-1'; > > ...so changing that to UTF-8 may fix the problem so far as Roundcube is > concerned. > > But you may still face a problem with other clients. We just discussed > Thunderbird's behaviour a few days back... D'oh... This fixed it. I haven't taken this into account yet because of the dumpio log, which told me this is already an UTF-8 encoded string... > > [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 Now the authentication works within Roundcube... Thanks for the hint. Greetings, Helge ________________________________ Helge Wiethoff Medienzentrum Telefon: +49 (234) 968 8717 Fax: +49 (234) 968 3453 E-Mail: Wiethoff at tfh-bochum.de Technische Fachhochschule Georg Agricola f?r Rohstoff, Energie und Umwelt zu Bochum Staatlich anerkannte Fachhochschule der DMT-Gesellschaft f?r Lehre und Bildung mbH Herner Stra?e 45 44787 Bochum http://www.tfh-bochum.de ________________________________ Tr?ger: DMT-Gesellschaft f?r Lehre und Bildung mbH Sitz der Gesellschaft: Bochum Registergericht: Amtsgericht Bochum Handelsregister: B 4052 Gesch?ftsf?hrung: Prof. Dr. J?rgen Kretschmann (Vorsitzender) Manfred Freitag From madduck at madduck.net Thu Aug 9 11:57:34 2012 From: madduck at madduck.net (martin f krafft) Date: Thu, 9 Aug 2012 10:57:34 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> Message-ID: <20120809085734.GB3929@albatross.gern.madduck.net> also sprach Timo Sirainen [2012.08.08.1509 +0200]: > > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > > external command as a filter, to be run by the final user? > > Use spampd LMTP proxy? That's a system-wide filtering daemon, it does not run per-user. Since spam is a subjective classification, especially as soon as you add training to the mix, we require per-user configuration. -- martin | http://madduck.net/ | http://two.sentenc.es/ warning: dates in calendar are closer than they appear. spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From giles at coochey.net Thu Aug 9 12:27:53 2012 From: giles at coochey.net (Giles Coochey) Date: Thu, 09 Aug 2012 10:27:53 +0100 Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <502375E3.7030104@isks.ru> References: <502375E3.7030104@isks.ru> Message-ID: <50238299.5030404@coochey.net> On 09/08/2012 09:33, Vladimir Bukov wrote: > On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > >> > Hello all again, >> > Has anyone any idea how to get the latest dovecot version for CentOS >> > 5.8 or 6.2 32-bit OS ? >> > I did a quick search and found out that the official version of >> dovecot >> > for CentOS v5.8 is 1.0.2 (!!). >> > >> > Any repos ? Any ideas :-) ? > > http://www.city-fan.org/ftp/contrib/mail/ I use the city-fan repo, it's great for a whole variety of Mail related packages. The dovecot rpm's are generally updated within 24-48hours of a new release by Timo. -- Regards, Giles Coochey, CCNA, CCNAS NetSecSpec Ltd +44 (0) 7983 877438 http://www.coochey.net http://www.netsecspec.co.uk giles at coochey.net -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4968 bytes Desc: S/MIME Cryptographic Signature URL: From dgp-dove at corefiling.co.uk Thu Aug 9 13:26:58 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Thu, 09 Aug 2012 11:26:58 +0100 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness Message-ID: <50239072.10607@corefiling.co.uk> Hi, I'm not sure if this is a deliberate design decision or a technical limitation that I've missed. Please briefly explain if so :). Or a bug or feature request? When LMTP receives a mail with a single recipient it adds a Delivered-To header. However if the message is delivered in a batch that header isn't added. At first I thought maybe the LMTP was doing something with hardlinks but that doesn't appear to be the case (for rather obvious reasons.) Sample headers (single recipient): Return-Path: Delivered-To: Received: from mx.domain.test ([127.0.0.1]) by domain.test (Dovecot) with LMTP id ZNTPFX2NI1CcCwAAVMeomg for ; Thu, 09 Aug 2012 11:14:21 +0100 Envelope-to: user at domain.test Delivery-date: Thu, 09 Aug 2012 11:14:21 +0100 Received: from host.domain.test ([172.16.252.1]:44058) by relay.domain.test ([172.16.252.120]:25) with esmtp id 1SzPkz-0000lz-7v (Exim 4.80) for user at domain.test (return-path ); Thu, 09 Aug 2012 11:14:21 +0100 Message-ID: <50238D7D.2000707 at domain.test> Date: Thu, 09 Aug 2012 11:14:21 +0100 From: User To: User Subject: test And an expansion list: Return-Path: Received: from mx.domain.test ([127.0.0.1]) by domain.test (Dovecot) with LMTP id Gf+yBmiNI1CECwAAVMeomg ; Thu, 09 Aug 2012 11:14:00 +0100 Envelope-to: expansion at domain.test Delivery-date: Thu, 09 Aug 2012 11:14:00 +0100 Received: from host.domain.test ([172.16.252.1]:44053) by relay.domain.test ([172.16.252.120]:25) with esmtp id 1SzPkd-0000ls-Qr (Exim 4.80) for expansion at domain.test (return-path ); Thu, 09 Aug 2012 11:13:59 +0100 Message-ID: <50238D67.3090802 at domain.test> Date: Thu, 09 Aug 2012 11:13:59 +0100 From: User To: Expansion Subject: test At the moment we've turned off batch delivery in the exim smtp transport (max_rcpt=1). Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From robert at schetterer.org Thu Aug 9 14:04:50 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 09 Aug 2012 13:04:50 +0200 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239072.10607@corefiling.co.uk> References: <50239072.10607@corefiling.co.uk> Message-ID: <50239952.8030206@schetterer.org> Am 09.08.2012 12:26, schrieb Daniel Piddock: > I'm not sure if this is a deliberate design decision or a technical > limitation that I've missed. Please briefly explain if so :). Or a bug > or feature request? as far i remember its a design decide dont know exim but it looks like max_rcpt=1 is the same then i.e postfix lmtp_destination_recipient_limit = 1 guess its the best solution for now, if you strongly need that header there were posts in the postfix and dovecot lists search archives -- Best Regards MfG Robert Schetterer From stsiol at yahoo.co.uk Thu Aug 9 14:08:13 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Thu, 9 Aug 2012 12:08:13 +0100 (BST) Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> References: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Message-ID: <1344510493.32546.YahooMailNeo@web132204.mail.ird.yahoo.com> ----- Original Message ----- > Hello all again, > > Has anyone any idea how to get the latest dovecot version for CentOS > 5.8 or 6.2 32-bit OS ? > > I did a quick search and found out that the official version of dovecot > for CentOS v5.8 is 1.0.2 (!!). > > Any repos ? Any ideas :-) ? > > Thank you all, > > spyros Oh "Duh" ! Here I go again :-) http://www.dovecot.org/download.html In front of my eyes, all this time. Thank you all though. s. ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From CMarcus at Media-Brokers.com Thu Aug 9 14:40:54 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 09 Aug 2012 07:40:54 -0400 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239952.8030206@schetterer.org> References: <50239072.10607@corefiling.co.uk> <50239952.8030206@schetterer.org> Message-ID: <5023A1C6.2050706@Media-Brokers.com> On 2012-08-09 7:04 AM, Robert Schetterer wrote: > Am 09.08.2012 12:26, schrieb Daniel Piddock: >> I'm not sure if this is a deliberate design decision or a technical >> limitation that I've missed. Please briefly explain if so :). Or a bug >> or feature request? > as far i remember its a design decide > > dont know exim > > but it looks like max_rcpt=1 > > is the same then i.e postfix > > lmtp_destination_recipient_limit = 1 > > guess its the best solution for now, if you strongly need that header > > there were posts in the postfix and dovecot lists search archives I wonder if this is related or the same problem as the lack of the x-original-to header that was discussed, and that Timo said would be relatively easy to fix in dovecot's LMTP client. If so, it is on his ToDo, he just hasn't gotten to it yet. -- Best regards, Charles From madduck at madduck.net Thu Aug 9 15:23:51 2012 From: madduck at madduck.net (martin f krafft) Date: Thu, 9 Aug 2012 14:23:51 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <502238FA.6040901@corefiling.co.uk> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> Message-ID: <20120809122351.GA26800@albatross.gern.madduck.net> also sprach Daniel Piddock [2012.08.08.1201 +0200]: > Have you taken a look at Pigeonhole and Sieve? There's > experimental support for running spam filters and external > commands. You'll need at least 0.3.0 which requires Dovecot 2.1. Dear list, here is an update. Indeed, the pigeonhole filters suggested by Daniel were the ticket. It took me a while to figure it all out though. Therefore, for posterity, at least for those running Debian systems: First, I compiled the extprograms plugin, running into a segfault, which Stephan helped me solve. Essentially, the extprograms are not in Debian, but everything else is (install dovecot-dev!), so I checked out revision 058de395713a [1], ran ./configure --with-dovecot=/usr/lib/dovecot --with-pigeonhole=/usr/include/dovecot/sieve --with-prefix=/usr/local/stow/pigeonhole-extprograms make make install cd /usr/local/stow/ stow pigeonhole-extprograms 1. http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=684271#10 Since dovecot only allows a single plugin dir to be specified, I had to hack around this by creating a symlink: ln -s /usr/local/lib/dovecot/sieve /usr/lib/dovecot/modules Now, after enabling the following in /etc/dovecot/conf.d/90-sieve: sieve_extensions = +vnd.dovecot.filter sieve_plugins = sieve_extprograms you should see 'vnd.dovecot.filter' in the dovecot -n output: dovecot -n | grep vnd.dovecot managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.filter ^^^^^^^^^^^^^^^^^^ I used sieve_global_extensions instead, because I wanted to enable spamc globally for all users using the dovecot LDA, which includes all virtual users on this machine. I also set (in 90-sieve.conf) sieve_before = /etc/dovecot/sieve.before.d and then put the following sieve script into /etc/dovecot/sieve.before.d/spamassassin.sieve: require [ "vnd.dovecot.filter" ]; filter "spamc" [ "--no-safe-fallback" ]; and then ran sievec spamassassin.sieve && chmod 444 spamassassin.svbin To tell the LDA where to find the spamc filter, I added (to 90-sieve.conf): sieve_filter_bin_dir = /etc/dovecot/sieve-filter and symlinked spamc there ln -s /usr/bin/spamc /etc/dovecot/sieve-filter/spamc So far so good, this now works for real system users, but it would not work for virtual users. The reason for that is that while vmm uses UIDs/GIDs above 70000 to tighten permissions per-virtual-user, spamc and spamd were unable to deal with the lack of libnss integration. Stephan suggested simply to let libnss know about the virtual mail accounts, and I did. After installing libnss-pgsql2 and extending /etc/nsswitch.conf to read passwd: compat pgsql group: compat pgsql I wrote the attached configuration file (/etc/nss-pgsql.conf), which I will submit to the vmm project. The advantage is that now, while the users cannot log in, their UIDs/GIDs on the filesystems are properly mapped, and root *can* /bin/su to them (using -s to override the shell). After a restart of spamd and dovecot, spamc is now run for every user as part of the LDA process before the user's sieve script runs. Thanks to Stephan for his help. Comments welcome. I hope I did not forget anything. PS: I know there are good reasons against running a spamfilter post-queue. There are also several reasons for that. The most important for me is that spam is subjective, especially in combination with training, and I never want to reject spam for fear of false positives, and since I do not want to overload the queues of mail servers (like debian.org) that forward to my account. -- martin | http://madduck.net/ | http://two.sentenc.es/ "the unexamined life is not worth living" -- platon spamtraps: madduck.bogus at madduck.net -------------- next part -------------- connectionstring = hostaddr=127.0.0.1 dbname=vmm user=nss password=5ecr41 connect_timeout=1 getgroupmembersbygid = SELECT local_part||'@'||domainname AS name FROM users JOIN domain_name USING (gid) WHERE gid = $1 AND is_primary = 't' getpwnam = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE local_part = split_part($1, '@', 1) AND domainname = split_part($1, '@', 2) AND is_primary = 't' getpwuid = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE uid = $1 AND is_primary = 't' allusers = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE is_primary = 't' getgrnam = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE domainname = $1 getgrgid = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE gid = $1 groups_dyn = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE is_primary = 't' allgroups = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE is_primary = 't' -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From dgp-dove at corefiling.co.uk Thu Aug 9 15:42:32 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Thu, 09 Aug 2012 13:42:32 +0100 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239952.8030206@schetterer.org> References: <50239072.10607@corefiling.co.uk> <50239952.8030206@schetterer.org> Message-ID: <5023B038.40308@corefiling.co.uk> On 09/08/12 12:04, Robert Schetterer wrote: > Am 09.08.2012 12:26, schrieb Daniel Piddock: >> I'm not sure if this is a deliberate design decision or a technical >> limitation that I've missed. Please briefly explain if so :). Or a bug >> or feature request? > as far i remember its a design decide > > dont know exim > > but it looks like max_rcpt=1 > > is the same then i.e postfix > > lmtp_destination_recipient_limit = 1 > > guess its the best solution for now, if you strongly need that header > > there were posts in the postfix and dovecot lists search archives You're right, I should have search a bit harder. I found the thread from Feb 2010 discussing Return-Path and Delivered-To headers http://www.dovecot.org/list/dovecot/2010-February/046401.html . The conclusion there appears to be the suggested addition of an lmtp_headers option. This got me thinking. With the latest versions of Pigeonhole and Dovecot this header can be added using a global sieve script: require ["envelope", "editheader", "variables"]; if allof (not exists "Delivered-To", envelope :matches :all "To" "*") { addheader "Delivered-To" "${1}"; } Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From c at roessner-network-solutions.com Thu Aug 9 16:10:22 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 9 Aug 2012 15:10:22 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> Message-ID: <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> Hi, > cp mdbox ~/mdbox-backup done > rm -rf ~/mdbox-backup/storage/dovecot.map* ~/mdbox-backup/mailboxes/ done > doveadm import mdbox:~/mdbox-backup all-mails all problem I tried so, but this does not work here: doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(root): Debug: Effective uid=0, gid=0, home=/root doveadm(root): Debug: fs: root=/srv/mail/foo.bar at example.com-backup, index=, control=, inbox=, alt= doveadm(root): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com-backup: mode=0700 gid=-1 doveadm(foo.bar at example.com): Debug: Effective uid=5000, gid=5000, home=/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: fs: root=/srv/mail/foo.bar at example.com, index=, control=, inbox=, alt= doveadm(foo.bar at example.com): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com: mode=0700 gid=-1 The mail box is under: /srv/mail/foo.bar at example.com The backup is under: /srv/mail/foo.bar at example.com-backup It does nothing. The command directly returns. No copied mails. So what am I missing here? Current version here is Dovecot 2.1.7. Thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From nmilas at noa.gr Thu Aug 9 17:58:10 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Thu, 09 Aug 2012 17:58:10 +0300 Subject: [Dovecot] HA Mailbox Design Message-ID: <5023D002.6040101@noa.gr> Hi, We would like to implement a Highly Available Mail Server and would like to ask advice on how to architect this. Some details on our setup: Currently we have only one internal mail server (Postfix/Dovecot 2.0 - planning to move to 2.1), receiving mail from a gateway server (filtering spam/viruses) - a Cisco Ironport - which we are considering to replace with one (or a set of) cloud-based Postfix/Amavis-new/SpamAssassin/ClamAV VMs (currently in testing mode). Delivery uses Dovecot LDA. User accounts are LDAP-based. We use Maildir and the load is low (aside spam). Only about 250 users/mailboxes (4G each). All servers are CentOS 5.8 (planning move to 6.3) KVM VMs (on a cloud where we don't have control on the host, but on highly reliable hardware/networks). We can have VMs on two different clouds and we also have at least two different connections (routes) to the cloud(s) (to support HA). Any directions will be appreciated. Hoping to design an HA architecture but aiming to keep it simple and (as much as possible) easily maintainable one. Thanks for your response and help, Nick From lists at luigirosa.com Thu Aug 9 19:16:08 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 18:16:08 +0200 Subject: [Dovecot] Server side Sieve with virtual users Message-ID: <5023E248.3030408@luigirosa.com> Is there a way to implement server-side filters with Dovecot configured with virtual users (userbase in mysql, a single *NIX user account that owns /var/spool/mail and its content)? Thanks Ciao, luigi -- / +--[Luigi Rosa]-- \ A generation which ignores history has no past... and no future. From adrian.minta at gmail.com Thu Aug 9 19:33:34 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 19:33:34 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023E248.3030408@luigirosa.com> References: <5023E248.3030408@luigirosa.com> Message-ID: <5023E65E.8010608@gmail.com> On 08/09/12 19:16, Luigi Rosa wrote: > Is there a way to implement server-side filters with Dovecot > configured with virtual users (userbase in mysql, a single *NIX user > account that owns /var/spool/mail and its content)? > > Thanks > > > Ciao, > luigi > Yes ! From rob at fantinibakery.com Thu Aug 9 20:08:25 2012 From: rob at fantinibakery.com (rob) Date: Thu, 09 Aug 2012 13:08:25 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply Message-ID: <5023EE89.9050904@fantinibakery.com> Hello We are looking for information on how to use Vacation auto-reply . I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few other pages, but have not found how to set it up. We use sogo and thunderbird . Is there a how to or document for this somewhere? This is our configuration information: dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid auth_mechanisms = plain login auth_username_format = %Ln lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:%h/Maildir mail_plugins = " quota" maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_plugins = quota sieve quota = fs:user quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=60%% quota-warning 60 %u quota_warning4 = storage=40%% quota-warning 40 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ } postmaster_address = fbcadmin at fantinibakery.com protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service imap-login { service_count = 0 vsz_limit = 128 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 vsz_limit = 256 M } service quota-warning { executable = script /fbc/bin/mail/quota-warning.sh user = dovecot } ssl = required ssl_ca = References: <5023E248.3030408@luigirosa.com> Message-ID: <5023F070.8090001@luigirosa.com> Luigi Rosa said the following on 09/08/2012 18:16: > Is there a way to implement server-side filters with Dovecot configured with > virtual users (userbase in mysql, a single *NIX user account that owns > /var/spool/mail and its content)? :) And the webpage/wikipage with documentation about this is.... ? Ciao, luigi -- / +--[Luigi Rosa]-- \ Error in operator: add beer. From adrian.minta at gmail.com Thu Aug 9 20:25:17 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 20:25:17 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023EF1B.5030101@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> Message-ID: <5023F27D.10508@gmail.com> On 08/09/12 20:10, Luigi Rosa wrote: > Adrian Minta said the following on 09/08/2012 18:33: > >>> Is there a way to implement server-side filters with Dovecot >>> configured with >>> virtual users (userbase in mysql, a single *NIX user account that owns >>> /var/spool/mail and its content)? > >> Yes ! > > :) > > And the webpage/wikipage with documentation about this is.... ? > > > Ciao, > luigi > First step is to have a mail system that works without sieve. This is the hard part. Depending on your preferred distro here are two nice webpages for this: http://wiki.mediatemple.net/w/(ve):Install_Postfix_with_Dovecot_on_CentOS http://workaround.org/ispmail Second step is to enable sieve, for witch you only need to uncomment the specific lines from dovecot.conf. For dovecot 1.2, you will have something like: protocols = pop3 pop3s imap imaps managesieve protocol lda { ... mail_plugins: quota sieve } protocol managesieve { } plugin { ... sieve=~/.dovecot.sieve sieve_dir=~/sieve } -- Best regards, Adrian Minta From lists at luigirosa.com Thu Aug 9 20:37:00 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 19:37:00 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F27D.10508@gmail.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> Message-ID: <5023F53C.7000509@luigirosa.com> Adrian Minta said the following on 09/08/2012 19:25: > First step is to have a mail system that works without sieve. This is the hard > part. Not for me. I have more than 20 customers with their own Centos Linux with Postfix and Dovecot compiled by me, and Mysql, apache, php from the distribution source and RoundCube. > protocols = pop3 pop3s imap imaps managesieve > protocol lda { > ... > mail_plugins: quota sieve > } > protocol managesieve { > } > plugin { > ... > sieve=~/.dovecot.sieve > sieve_dir=~/sieve > } That's the point: sieve_dir can be the 'root' of the maildir structure? Virtual users do not have their own home (~) directory. If the sieve file is store in the 'root' maildir of each user, Dovecot uses the same single virtual (linux) user to access the maildir? Ciao, luigi -- / +--[Luigi Rosa]-- \ To define recursion, we must first define recursion. From adrian.minta at gmail.com Thu Aug 9 20:46:43 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 20:46:43 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F53C.7000509@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> Message-ID: <5023F783.6090907@gmail.com> On 08/09/12 20:37, Luigi Rosa wrote: >> plugin { >> ... >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> } > > That's the point: sieve_dir can be the 'root' of the maildir > structure? Virtual users do not have their own home (~) directory. > > If the sieve file is store in the 'root' maildir of each user, Dovecot > uses the same single virtual (linux) user to access the maildir? (~) is the account maildir, not the homedir of linux user. -- Best regards, Adrian Minta From lists at luigirosa.com Thu Aug 9 20:47:45 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 19:47:45 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F783.6090907@gmail.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> <5023F783.6090907@gmail.com> Message-ID: <5023F7C1.6050405@luigirosa.com> Adrian Minta said the following on 09/08/2012 19:46: > (~) is the account maildir, not the homedir of linux user. Ok, thanks! Ciao, luigi -- / +--[Luigi Rosa]-- \ I went to the airport, with my ticket to Los Angeles. I brought three bags and told the Skycap "I want this on to go to Seattle, this one to St. Louis and this one to Chicago." He said "I'm sorry sir, but we can't do that." I said "Why not? You did it last time." --Henny Youngman From robert at schetterer.org Thu Aug 9 21:17:54 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 09 Aug 2012 20:17:54 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F53C.7000509@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> Message-ID: <5023FED2.3060609@schetterer.org> Am 09.08.2012 19:37, schrieb Luigi Rosa: > Adrian Minta said the following on 09/08/2012 19:25: > >> First step is to have a mail system that works without sieve. This is >> the hard >> part. > > Not for me. I have more than 20 customers with their own Centos Linux > with Postfix and Dovecot compiled by me, and Mysql, apache, php from the > distribution source and RoundCube. > >> protocols = pop3 pop3s imap imaps managesieve >> protocol lda { >> ... >> mail_plugins: quota sieve >> } >> protocol managesieve { >> } >> plugin { >> ... >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> } > > That's the point: sieve_dir can be the 'root' of the maildir structure? > Virtual users do not have their own home (~) directory. however they have a dovecot "home", with virtual users all mailboxes belong to i.e system user vmail, and their dovecot "home/mailbox" is taken out of the dovecot config > > If the sieve file is store in the 'root' maildir of each user, Dovecot > uses the same single virtual (linux) user to access the maildir? > > > > > Ciao, > luigi > as far i remember , reading changelog, you can now store sieve rules in mysql too, this should solve any of such problems -- Best Regards MfG Robert Schetterer From stephan at rename-it.nl Thu Aug 9 22:19:03 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 09 Aug 2012 21:19:03 +0200 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5023EE89.9050904@fantinibakery.com> References: <5023EE89.9050904@fantinibakery.com> Message-ID: <50240D27.5080102@rename-it.nl> On 8/9/2012 7:08 PM, rob wrote: > Hello > We are looking for information on how to use Vacation auto-reply . > > I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few > other pages, but have not found how to set it up. > > We use sogo and thunderbird . > > Is there a how to or document for this somewhere? What exactly do you want to know? Regards, Stephan. From rob at fantinibakery.com Thu Aug 9 22:32:05 2012 From: rob at fantinibakery.com (rob) Date: Thu, 09 Aug 2012 15:32:05 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <50240D27.5080102@rename-it.nl> Message-ID: <24a9-50241000-13-11050340@19539233> On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: > On 8/9/2012 7:08 PM, rob wrote: > > Hello > > We are looking for information on how to use Vacation auto-reply . > > > > I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few > > other pages, but have not found how to set it up. > > > > We use sogo and thunderbird . > > > > Is there a how to or document for this somewhere? > > What exactly do you want to know? > > Regards, > > Stephan. > I'd like to know : - If we have Dovecot configured OK for vacation sieve. - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? From tss at iki.fi Fri Aug 10 02:34:56 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 02:34:56 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> Message-ID: On 9.8.2012, at 10.27, Timo Sirainen wrote: >> Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) > .. >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) > > Thanks. Obviously I shouldn't free cached settings while they're still being used. :) Actually it wasn't that obvious: http://hg.dovecot.org/dovecot-2.1/rev/b082b8260782 plus http://hg.dovecot.org/dovecot-2.1/rev/9d0873cefa08 From tss at iki.fi Fri Aug 10 02:38:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 02:38:18 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> Message-ID: <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> On 9.8.2012, at 16.10, Christian R??ner wrote: >> doveadm import mdbox:~/mdbox-backup all-mails all > > problem > > I tried so, but this does not work here: I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX From stan at hardwarefreak.com Fri Aug 10 04:47:50 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 09 Aug 2012 20:47:50 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <5023D002.6040101@noa.gr> References: <5023D002.6040101@noa.gr> Message-ID: <50246846.6020606@hardwarefreak.com> On 8/9/2012 9:58 AM, Nikolaos Milas wrote: > Hi, > > We would like to implement a Highly Available Mail Server and would like > to ask advice on how to architect this. > > Some details on our setup: > > Currently we have only one internal mail server (Postfix/Dovecot 2.0 - > planning to move to 2.1), receiving mail from a gateway server > (filtering spam/viruses) - a Cisco Ironport - which we are considering > to replace with one (or a set of) cloud-based > Postfix/Amavis-new/SpamAssassin/ClamAV VMs (currently in testing mode). First, please don't use the term "cloud". That's a marketing buzzword that variously covers many actual network computing architectures. This is a technical mailing list. We use technical terms here, and precise detail of the architecture matters greatly, buzzwords are irrelevant. > Delivery uses Dovecot LDA. User accounts are LDAP-based. > We use Maildir and the load is low (aside spam). Only about 250 > users/mailboxes (4G each). All servers are CentOS 5.8 (planning move to > 6.3) KVM VMs (on a cloud where we don't have control on the host, but on > highly reliable hardware/networks). If you don't control the host you don't control the storage (disks), thus making a traditional "HA" mail server system difficult. You state the "cloud" infrastructure is highly reliable. That begs the question, what is your definition of a "Highly Available Mail Server"? What is it that you actually want to accomplish? In some detail please. Do you mean "POP/IMAP service is always available to clients even when something fails"? > We can have VMs on two different clouds and we also have at least two > different connections (routes) to the cloud(s) (to support HA). Again, please stop talking about "clouds". None of what you just stated above means anything without actual architectural details. When designing/implementing an HA setup, details are absolutely critical, required to make it work. Details, details, details. Also, you've mentioned absolutely nothing about storage. Storage is the pivot pin in an HA setup, the central consideration. HA is built around the storage architecture, not around applications and servers (hosts or VMs). > Any directions will be appreciated. Hoping to design an HA architecture > but aiming to keep it simple and (as much as possible) easily > maintainable one. HA architectures are never simple. That's the nature of the beast. And they're typically not cheap to implement as they absolutely require fault tolerant shared storage of one kind or another, either a disk array with dual active/active controllers and PSUs with a cluster filesystem on Dovecot nodes, or storage appliance that offers full redundancy and NFS protocol for Dovecot node access. This prevents single point of failure, which is what HA is all about. To be quite frank, based upon the level of technical acumen you've demonstrated here, and the general financial position Greece finds itself in, and the fact you're a public institution, it seems you're a much better candidate for a Gmail hosted infrastructure than a VPS infrastructure with some manner of ad hoc software only HA measures bolted on, which is all you can do with VPS servers--you don't control the storage. Gmail hosted mail instantly gives you a high availability email infrastructure for "free". Cost is negligible for your number of mailboxes. Antispam and all the standard stuff is built in and fairly decent. You get both POP and IMAP connectivity options, allowing access with desktop/mobile MUAs. If you prefer a different web interface you can setup a Horde or Roundcube VM at your "cloud" provider and access the Gmail accounts. You'll have less "control" of the system, but it will save far more money than a VPS "cloud" solution, be far easier to administer, and the setup can be done in a day, with almost zero administration required afterward. If you have many users with personal Gmail accounts they'll take to it like a duck to water. If you're looking for a "cloud" based HA email infrastructure at very low cost, you simply can't beat hosted Gmail. Or Google Apps, whatever they call it these days. The downside is it may eliminate your job if you're strictly a dedicated email system administrator. -- Stan From daniel.parthey at informatik.tu-chemnitz.de Fri Aug 10 05:35:25 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 10 Aug 2012 04:35:25 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <34275123.post@talk.nabble.com> References: <34275123.post@talk.nabble.com> Message-ID: <20120810023525.GA14423@daniel.localdomain> Bulend Mali wrote: > i want to use login-intranet-imap.sh in order to restrict by emailaddress and ip address. > i read it at http://wiki2.dovecot.org/PostLoginScripting. > But there is an expression "mail_executable" in [dovecot1] conf. > but there is no such thing in dovecot2. > What is equivalent of it for dovecot2 ? service imap { executable = imap imap-postlogin } or service pop3 { executable = pop3 pop3-postlogin } I assume the exec "$@" in your login-intranet-imap.sh is there to execute the imap binary (or call it "mail executable") which handles the protocol traffic after your post-login script has done its work and granted access to the user. If you would like to deny access, you should not execute the protocol handler, but simply exit 0, see "Denying connection from some IP/User" at http://wiki2.dovecot.org/PostLoginScripting Regards Daniel -- https://plus.google.com/103021802792276734820 From dovecot at noboost.org Fri Aug 10 05:44:44 2012 From: dovecot at noboost.org (dovecot at noboost.org) Date: Fri, 10 Aug 2012 12:44:44 +1000 Subject: [Dovecot] IMAP IDLE - iPhone? Message-ID: <20120810024444.GA16856@noboost.org> Hi All, Probably a very common question now days. I'd like to configure our iPhones at work to go directly to my dovecot server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE (push email) protocol. Has anyone successfully deployed this? If yes, did you have to use an app from the Apple store? For me the IMAP process works, however it's clearly not notifying the client when new email is detected on the server. cya Craig From tss at iki.fi Fri Aug 10 05:48:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 05:48:57 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> Related question that came to my mind: Does anyone know if XAPPLEPUSHSERVICE feature can be implemented by any server, or does it require cooperation between the server and the mobile network operator? I'm guessing the latter.. From lists at luigirosa.com Fri Aug 10 09:26:02 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Fri, 10 Aug 2012 08:26:02 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <5024A97A.8050204@luigirosa.com> dovecot at noboost.org said the following on 10/08/2012 04:44: > Probably a very common question now days. > I'd like to configure our iPhones at work to go directly to my dovecot > server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE > (push email) protocol. I used K-9 client on Android for one year with push, but I had to remove it and go back to integrated email client because it drained the battery. Ciao, luigi -- / +--[Luigi Rosa]-- \ Why do we want intelligent terminals when there are so many stupid users? From robert at schetterer.org Fri Aug 10 09:26:08 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 08:26:08 +0200 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <24a9-50241000-13-11050340@19539233> References: <24a9-50241000-13-11050340@19539233> Message-ID: <5024A980.1080207@schetterer.org> Am 09.08.2012 21:32, schrieb rob: > > On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: > >> On 8/9/2012 7:08 PM, rob wrote: >>> Hello >>> We are looking for information on how to use Vacation auto-reply . >>> >>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few >>> other pages, but have not found how to set it up. >>> >>> We use sogo and thunderbird . >>> >>> Is there a how to or document for this somewhere? >> >> What exactly do you want to know? >> >> Regards, >> >> Stephan. >> > > > > I'd like to know : > - If we have Dovecot configured OK for vacation sieve. > > - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? > sieve in dovecot acts like a server where you can feed sieve rules i.e vacation, some software mostly webmailsers have guis for this, like sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin if you setup dovecot sieve server rightly , you might see in the dovecot logs , and/or send dovecot config to the list, look for manuals on the dovecot site and in www for setup instructions -- Best Regards MfG Robert Schetterer From dovecot at r.paypc.com Fri Aug 10 09:31:46 2012 From: dovecot at r.paypc.com (Robin) Date: Thu, 09 Aug 2012 23:31:46 -0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024A97A.8050204@luigirosa.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> Message-ID: <5024AAD2.3040909@r.paypc.com> On 8/9/2012 11:26 PM, Luigi Rosa wrote: > I used K-9 client on Android for one year with push, but I had to remove > it and go back to integrated email client because it drained the battery. It sounds like "push" was really implemented as a poll. =R= From robert at schetterer.org Fri Aug 10 09:54:41 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 08:54:41 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024A97A.8050204@luigirosa.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> Message-ID: <5024B031.5010707@schetterer.org> Am 10.08.2012 08:26, schrieb Luigi Rosa: > dovecot at noboost.org said the following on 10/08/2012 04:44: > >> Probably a very common question now days. >> I'd like to configure our iPhones at work to go directly to my dovecot >> server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE >> (push email) protocol. so simply do it > > I used K-9 client on Android for one year with push, but I had to remove > it and go back to integrated email client because it drained the battery. > > > > > > Ciao, > luigi > imap idle is often promoted as push mail but tec side it isnt "exactly" the same, in users eyes the result looks nearly equal yes every service which let stay you online, robs power from battery but you can sync only manuall etc ( for sure then push makes no sense anymore ) however its a human related question, if i need mails always and everywhere and in "real time" in my eyes , if its really urgent people should phone together *g -- Best Regards MfG Robert Schetterer From xray at randoman.ru Fri Aug 10 10:08:47 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 14:08:47 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <5024B37F.2040709@randoman.ru> 10.08.2012 09:44, dovecot at noboost.org ?????: > Hi All, > > Probably a very common question now days. > I'd like to configure our iPhones at work to go directly to my dovecot > server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE > (push email) protocol. > > Has anyone successfully deployed this? If yes, did you have to use an > app from the Apple store? For me the IMAP process works, however it's > clearly not notifying the client when new email is detected on the > server. > > cya > > Craig iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. IMAP IDLE monitor only one selected folder. If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. Sergey S. Kovalev From robert at schetterer.org Fri Aug 10 10:12:09 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 09:12:09 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024B37F.2040709@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> Message-ID: <5024B449.7000005@schetterer.org> Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: > On small mailboxes it's z-push and tine20 for example - they can use > IMAP server as backend. z-push works nice here with android, also the new horde beta has now calender, abook, notes, mail sync -- Best Regards MfG Robert Schetterer From tss at iki.fi Fri Aug 10 09:39:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 09:39:00 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024AAD2.3040909@r.paypc.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> <5024AAD2.3040909@r.paypc.com> Message-ID: <77C53D85-F8E9-49CC-99EC-2904BEA24E4D@iki.fi> On 10.8.2012, at 9.31, Robin wrote: > On 8/9/2012 11:26 PM, Luigi Rosa wrote: >> I used K-9 client on Android for one year with push, but I had to remove >> it and go back to integrated email client because it drained the battery. > > It sounds like "push" was really implemented as a poll. Dovecot has by default: imap_idle_notify_interval = 2 mins So the phone needs to receive and send data every 2 minutes. Increasing this / disabling it entirely should help with power usage. But even then active TCP connections do eat up battery. From c at roessner-network-solutions.com Fri Aug 10 10:29:39 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Fri, 10 Aug 2012 09:29:39 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> Message-ID: <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Hi, > >>> doveadm import mdbox:~/mdbox-backup all-mails all >> >> problem >> >> I tried so, but this does not work here: > > I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: > > doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX > done And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From h.reindl at thelounge.net Fri Aug 10 11:16:17 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 10:16:17 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024B37F.2040709@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> Message-ID: <5024C351.7030101@thelounge.net> Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: > iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. > IMAP IDLE monitor only one selected folder. > If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. > On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. this may be a IPHONE limitation as all the apple clients are buggy like hell since years i have a Android with K9, a lot of folders where messages are stored by sieve-scirpts and on my phone i can actively select which folders should be used for push -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From xray at randoman.ru Fri Aug 10 11:46:50 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 15:46:50 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024C351.7030101@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> Message-ID: <5024CA7A.80006@randoman.ru> 10.08.2012 15:16, Reindl Harald ?????: > > Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: >> iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. >> IMAP IDLE monitor only one selected folder. >> If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. >> On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. > this may be a IPHONE limitation as all the apple > clients are buggy like hell since years > > i have a Android with K9, a lot of folders where messages are stored > by sieve-scirpts and on my phone i can actively select which folders > should be used for push > Sure, it can do it in two ways: open several connections to imap server (one per folder) or periodically change current directory and get changes. But any of this solution will eat battery very fast, proportionally to count of folders to check. I think that battery life is the reason, why this feature is not implemented in iPhone. It will use only one IMAP connection. Sergey S. Kovalev From arne at drlinux.no Fri Aug 10 11:57:55 2012 From: arne at drlinux.no (Arne K. Haaje) Date: Fri, 10 Aug 2012 10:57:55 +0200 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50246846.6020606@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> Message-ID: <1528826.6G1CvjlpWE@marvin> Torsdag 9. august 2012 20.47.50 skrev Stan Hoeppner: [snip] > To be quite frank, based upon the level of technical acumen you've > demonstrated here, and the general financial position Greece finds > itself in, and the fact you're a public institution, it seems you're a > much better candidate for a Gmail hosted infrastructure than a VPS > infrastructure with some manner of ad hoc software only HA measures > bolted on, which is all you can do with VPS servers--you don't control > the storage. If they are a public institution, then they may be prohibited from hosting on Google, simply because possibly sensitive data would then be hosted in another country. As for HA I agree with Stan in that it is both very expensive and difficult to do right, but I would also ask if do you *really* need it? Arne -- Arne K. Haaje http://www.drlinux.no/ Twitter: drlinuxno LinkedIn: http://no.linkedin.com/pub/arne-haaje/27/189/bb From h.reindl at thelounge.net Fri Aug 10 11:59:49 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 10:59:49 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024CA7A.80006@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> Message-ID: <5024CD85.4020705@thelounge.net> Am 10.08.2012 10:46, schrieb Sergey S. Kovalev: > 10.08.2012 15:16, Reindl Harald ?????: >> i have a Android with K9, a lot of folders where messages are stored >> by sieve-scirpts and on my phone i can actively select which folders >> should be used for push >> > Sure, it can do it in two ways: open several connections to imap server > (one per folder) or periodically change current directory and get changes. typically the client opens a connecton for each folder to check > But any of this solution will eat battery very fast, proportionally > to count of folders to check. and that is why K9 on android let you select which folders are relevant for you on the mobile and which should be completly ignored and display the selected in "common inbox" > I think that battery life is the reason, why this feature is not implemented > in iPhone. It will use only one IMAP connection so it is not "it's IMAP limitation" how does help me "save battery" if i have a folder-structure maintained by sieve if i do not get my new mails? it's a limitation from Apple because they have not the knowledge to implement relieable mail-clients see below the removed posting on apple-support (first paragraphs german but posting and answer from Apple below in english) http://www.rhsoft.net/ -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From xray at randoman.ru Fri Aug 10 12:21:34 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 16:21:34 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024CD85.4020705@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> Message-ID: <5024D29E.5040400@randoman.ru> 10.08.2012 15:59, Reindl Harald ?????: > Am 10.08.2012 10:46, schrieb Sergey S. Kovalev: >> 10.08.2012 15:16, Reindl Harald ?????: >>> i have a Android with K9, a lot of folders where messages are stored >>> by sieve-scirpts and on my phone i can actively select which folders >>> should be used for push >>> >> Sure, it can do it in two ways: open several connections to imap server >> (one per folder) or periodically change current directory and get changes. > typically the client opens a connecton for each folder to check Sure, it's better. > >> But any of this solution will eat battery very fast, proportionally >> to count of folders to check. > and that is why K9 on android let you select which folders > are relevant for you on the mobile and which should be > completly ignored and display the selected in "common inbox" This is not an argument. You can have hundred of folders sorted by sieve and really need to know if there new mail in any of it. >> I think that battery life is the reason, why this feature is not implemented >> in iPhone. It will use only one IMAP connection > so it is not "it's IMAP limitation" As I told - IMAP limitation is to control only one folder. > how does help me "save battery" if i have a folder-structure > maintained by sieve if i do not get my new mails? If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. Imagine if there will 100 folders? Therefore IMAP really have limitation to use it on mobile devices. > it's a limitation from Apple because they have not the > knowledge to implement relieable mail-clients see below > the removed posting on apple-support (first paragraphs > german but posting and answer from Apple below in english) > http://www.rhsoft.net/ I'm not fan of apple anyway, so do not interested in this discussion at all. Sergey S. Kovalev. From tss at iki.fi Fri Aug 10 12:25:35 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 12:25:35 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024D29E.5040400@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> Message-ID: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> On 10.8.2012, at 12.21, Sergey S. Kovalev wrote: >>> I think that battery life is the reason, why this feature is not implemented >>> in iPhone. It will use only one IMAP connection >> so it is not "it's IMAP limitation" > As I told - IMAP limitation is to control only one folder. Assuming NOTIFY extension isn't implemented by both. (Dovecot v2.2 hopefully will have it, and K-9 apparently is interested in adding it too after that.) >> how does help me "save battery" if i have a folder-structure >> maintained by sieve if i do not get my new mails? > If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. > Imagine if there will 100 folders? Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. From ms at mike2k.de Fri Aug 10 12:29:42 2012 From: ms at mike2k.de (Michael Stilkerich) Date: Fri, 10 Aug 2012 11:29:42 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> References: <20120810024444.GA16856@noboost.org> <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> Message-ID: <5024D486.40703@mike2k.de> Hi, On 10-Aug-12 4:48, Timo Sirainen wrote: > Related question that came to my mind: Does anyone know if XAPPLEPUSHSERVICE feature can be implemented by any server, or does it require cooperation between the server and the mobile network operator? I'm guessing the latter.. the Apple push service for Mail.app uses the same push notification service as all other push notifications for iOS (APNS, Apple Push Notification Service). The Device retains a persistent connection to Apple's APNS Gateway. To transmit a push notification via APNS, the sender needs a certificate issued by Apple for the receiving application (Mail.app in this case). One can get such a certificate by purchasing Lion Server, which includes such a certificate (I presume Mountain Lion Server does as well). The Lion Server uses dovecot, and Apple's patch for the XAPPLEPUSHSERVICE extension is available on http://www.opensource.apple.com/source/dovecot/dovecot-239/dovecot/src/plugins/push-notify/ It basically works as following: 1) Dovecot advertises the XAPPLEPUSHSERVICE Capability 2) When the device logs in to the IMAP server and sees that it supports this capability, it registers with the server for push notifications and provides its device id and the id of the corresponding mail account on the device. These two ids are required to route a push notification to the device. 3) The server records all registered devices for an account. Upon an incoming mail for the account, it transmits a push notification. 4) The device does not directly unregister; this is done using the feedback mechanism of APNS, which tells a service provider that a device does not wish to receive push notifications any longer. The actual transmission of the push notifications to the APNS server is not part of the dovecot patch but a separate program. One can use the Net::APNS perl module (found on cpan) to fairly easily replicate that program. Apple's original is also available: http://www.opensource.apple.com/source/dovecot/dovecot-239/dovecot.push-notify/daemon -Mike P.S.: I'm not sure if one is allowed to do this, though. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4493 bytes Desc: S/MIME Cryptographic Signature URL: From xray at randoman.ru Fri Aug 10 12:45:15 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 16:45:15 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> Message-ID: <5024D82B.5040007@randoman.ru> 10.08.2012 16:25, Timo Sirainen ?????: >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? > Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. > I guess, there is no trick, that will change the linear complexity by traffic and by CPU usage. If you can change settings in dovecot - you can set up ActiveSync there. It's more suitable for mobile mailing. From h.reindl at thelounge.net Fri Aug 10 12:57:43 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 11:57:43 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024D29E.5040400@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> Message-ID: <5024DB17.2080600@thelounge.net> Am 10.08.2012 11:21, schrieb Sergey S. Kovalev: >> and that is why K9 on android let you select which folders >> are relevant for you on the mobile and which should be >> completly ignored and display the selected in "common inbox" > This is not an argument. You can have hundred of folders sorted by > sieve and really need to know if there new mail > in any of it surely IT IS an argument on a non-iPhone you can chosse what is important your agrumentation is even one argument more against iPhone >>> I think that battery life is the reason, why this feature is not implemented >>> in iPhone. It will use only one IMAP connection >> so it is not "it's IMAP limitation" > As I told - IMAP limitation is to control only one folder as proven by other devices there is no limitation >> how does help me "save battery" if i have a folder-structure >> maintained by sieve if i do not get my new mails? > If you open 10 connections to IMAP server and will IDLE on them - your phone > will wake up to reply for ping in every of that 10 connections. > Imagine if there will 100 folders? > Therefore IMAP really have limitation to use it on mobile devices again: how does it help me if I NEED to check them? and no, IMAP has no limitations proven by Android-client my Samsung Galaxy S3 has around 25 push folders no problem with K9 mail to have them in my "common inbox" including my own sent messages while on the desktop i use the folder structure and my battery has a average lifetime of 1.5 days -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From me at junc.org Fri Aug 10 14:03:36 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 13:03:36 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql Message-ID: currently dovecot dict is CREATE TABLE IF NOT EXISTS `quota` ( `username` varchar(100) COLLATE latin1_general_ci NOT NULL, `bytes` bigint(20) NOT NULL DEFAULT '0', `messages` int(11) NOT NULL DEFAULT '0', PRIMARY KEY (`username`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; there is not field that says how much quota each user have, so one cant make a query on how much its left pr user how can i resolve this in dovecot dict ? i like to do an postfix mysql map to temp reject if quota is out of limit -- Benny Pedersen From me at junc.org Fri Aug 10 14:29:21 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 13:29:21 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023E248.3030408@luigirosa.com> References: <5023E248.3030408@luigirosa.com> Message-ID: <760112e9985c43c2ff1bedb08a8444ed@junc.org> Den 2012-08-09 18:16, Luigi Rosa skrev: > Is there a way to implement server-side filters with Dovecot > configured with virtual users (userbase in mysql, a single *NIX user > account that owns /var/spool/mail and its content)? http://wiki1.dovecot.org/ManageSieve if using dovecot 2.x.x there is a seperate wiki From robert at schetterer.org Fri Aug 10 14:44:18 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 13:44:18 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: <5024F412.8090501@schetterer.org> Am 10.08.2012 13:03, schrieb Benny Pedersen: > > currently dovecot dict is > > > CREATE TABLE IF NOT EXISTS `quota` ( > `username` varchar(100) COLLATE latin1_general_ci NOT NULL, > `bytes` bigint(20) NOT NULL DEFAULT '0', > `messages` int(11) NOT NULL DEFAULT '0', > PRIMARY KEY (`username`) > ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; > > > there is not field that says how much quota each user have, so one cant > make a query on how much its left pr user > > how can i resolve this in dovecot dict ? > > i like to do an postfix mysql map to temp reject if quota is out of limit > you may use ideas out of postfixadmin mysql layout -- Best Regards MfG Robert Schetterer From me at junc.org Fri Aug 10 18:18:07 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 17:18:07 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: Den 2012-08-10 13:03, Benny Pedersen skrev: if others need something like this: CREATE TABLE IF NOT EXISTS `quota` ( `username` varchar(100) COLLATE latin1_general_ci NOT NULL, `bytes` bigint(20) NOT NULL DEFAULT '0', `messages` int(11) NOT NULL DEFAULT '0', `quotamax` bigint(20) NOT NULL DEFAULT '0', PRIMARY KEY (`username`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; # /etc/postfix/dovecot_quota_maps.cf user = user password = password hosts = localhost dbname = database query = SELECT CONCAT('DEFER_IF_PERMIT Quotas Excceded') FROM quota WHERE username='%s' AND bytes>=quotamax # /etc/postfix/main.cf smtpd_recipient_restrictions = check_recipient_access mysql:/etc/postfix/dovecot_quota_maps.cf enjoy add to wiki if one could do this From duihi77 at gmail.com Fri Aug 10 19:25:43 2012 From: duihi77 at gmail.com (Duane Hill) Date: Fri, 10 Aug 2012 16:25:43 +0000 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: <1712023239.20120810162543@gmail.com> On Friday, August 10, 2012 at 15:18:07 UTC, me at junc.org confabulated: > Den 2012-08-10 13:03, Benny Pedersen skrev: > if others need something like this: > CREATE TABLE IF NOT EXISTS `quota` ( > `username` varchar(100) COLLATE latin1_general_ci NOT NULL, > `bytes` bigint(20) NOT NULL DEFAULT '0', > `messages` int(11) NOT NULL DEFAULT '0', > `quotamax` bigint(20) NOT NULL DEFAULT '0', > PRIMARY KEY (`username`) > ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; > # /etc/postfix/dovecot_quota_maps.cf > user = user > password = password > hosts = localhost > dbname = database > query = SELECT CONCAT('DEFER_IF_PERMIT Quotas Excceded') FROM quota > WHERE username='%s' AND bytes>=quotamax No need to CONCAT when you are not concatenating anything. Just: SELECT 'DEFER_IF_PERMIT Quotas Exceeded' FROM quota ... > # /etc/postfix/main.cf > smtpd_recipient_restrictions = > check_recipient_access mysql:/etc/postfix/dovecot_quota_maps.cf > enjoy > add to wiki if one could do this -- If at first you don't succeed... ...so much for skydiving. From me at junc.org Fri Aug 10 19:48:32 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 18:48:32 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: <1712023239.20120810162543@gmail.com> References: <1712023239.20120810162543@gmail.com> Message-ID: <48ed8ad322ebb709ac8c37a1d70af271@junc.org> Den 2012-08-10 18:25, Duane Hill skrev: > SELECT 'DEFER_IF_PERMIT Quotas Exceeded' FROM quota ... query = SELECT 'DEFER_IF_PERMIT Quotas Excceded' FROM quota WHERE username='%s' AND bytes>=quotamax AND quotamax>'0' so postfixadmin unlimted is supported thanks for suggesting to make to even better From djonas at vitalwerks.com Fri Aug 10 20:05:08 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:05:08 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory Message-ID: <50253F44.9040203@vitalwerks.com> Hello, I have a mailbox with an ungodly number of small messages in it. When new messages are delivered lmtp kicks up an error like the one below. I tried raising the vsz_limit for lmtp but that didn't see to help. Any ideas (besides deleting 400k messages)? Thanks! dovecot: lmtp(6068, user at example.com): Error: mmap() failed with file /home/vmail/domains/example.com/user/Maildir/dovecot.index.cache: Cannot allocate memory # ls -lah dovecot.index.cache -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache # doveadm mailbox status -u user at example.com all inbox INBOX messages=434118 recent=59848 uidnext=434119 uidvalidity=1293568548 unseen=432625 highestmodseq=14023 vsize=1329486283 guid=f8d48232244a1a4dfe2e0000cb0ad7e0 # doveconf -n ... default_vsz_limit = 256 M service lmtp { inet_listener lmtp { port = 24 } vsz_limit = 256 M } -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Fri Aug 10 20:10:21 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 20:10:21 +0300 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <50253F44.9040203@vitalwerks.com> References: <50253F44.9040203@vitalwerks.com> Message-ID: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> On 10.8.2012, at 20.05, David Jonas wrote: > I have a mailbox with an ungodly number of small messages in it. When > new messages are delivered lmtp kicks up an error like the one below. I > tried raising the vsz_limit for lmtp but that didn't see to help. That should help. > # ls -lah dovecot.index.cache > -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache > > default_vsz_limit = 256 M > service lmtp { > inet_listener lmtp { > port = 24 > } > vsz_limit = 256 M > } Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. From djonas at vitalwerks.com Fri Aug 10 20:13:20 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:13:20 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> References: <50253F44.9040203@vitalwerks.com> <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> Message-ID: <50254130.3040209@vitalwerks.com> On Fri Aug 10 10:10:21 2012, Timo Sirainen wrote: > On 10.8.2012, at 20.05, David Jonas wrote: > >> I have a mailbox with an ungodly number of small messages in it. When >> new messages are delivered lmtp kicks up an error like the one below. I >> tried raising the vsz_limit for lmtp but that didn't see to help. > > That should help. > >> # ls -lah dovecot.index.cache >> -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache >> >> default_vsz_limit = 256 M >> service lmtp { >> inet_listener lmtp { >> port = 24 >> } >> vsz_limit = 256 M >> } > > Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. > I haven't tried higher. I'll make the change now though. Is there a way to test it besides delivering a new message? -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From djonas at vitalwerks.com Fri Aug 10 20:19:59 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:19:59 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> References: <50253F44.9040203@vitalwerks.com> <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> Message-ID: <502542BF.5040907@vitalwerks.com> On 8/10/12 10:10 AM, Timo Sirainen wrote: > On 10.8.2012, at 20.05, David Jonas wrote: > >> I have a mailbox with an ungodly number of small messages in it. When >> new messages are delivered lmtp kicks up an error like the one below. I >> tried raising the vsz_limit for lmtp but that didn't see to help. > That should help. > >> # ls -lah dovecot.index.cache >> -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache >> >> default_vsz_limit = 256 M >> service lmtp { >> inet_listener lmtp { >> port = 24 >> } >> vsz_limit = 256 M >> } > Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. > service lmtp { vsz_limit = 320 M } Yep. That seems to cover it. Delivered a message with lmtp and no error in the logs. dovecot.index.cache timestamp updated too. Thanks! Guess I should have tried something absurdly high before emailing, just to see if that was it. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From rob at fantinibakery.com Fri Aug 10 20:32:13 2012 From: rob at fantinibakery.com (rob) Date: Fri, 10 Aug 2012 13:32:13 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5024A980.1080207@schetterer.org> References: <24a9-50241000-13-11050340@19539233> <5024A980.1080207@schetterer.org> Message-ID: <5025459D.1070403@fantinibakery.com> On 08/10/2012 02:26 AM, Robert Schetterer wrote: > Am 09.08.2012 21:32, schrieb rob: >> >> On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: >> >>> On 8/9/2012 7:08 PM, rob wrote: >>>> Hello >>>> We are looking for information on how to use Vacation auto-reply . >>>> >>>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few >>>> other pages, but have not found how to set it up. >>>> >>>> We use sogo and thunderbird . >>>> >>>> Is there a how to or document for this somewhere? >>> What exactly do you want to know? >>> >>> Regards, >>> >>> Stephan. >>> >> >> >> >> I'd like to know : >> - If we have Dovecot configured OK for vacation sieve. >> >> - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? >> > sieve in dovecot acts like a server where you can feed sieve rules i.e > vacation, some software mostly webmailsers have guis for this, like > sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin > > if you setup dovecot sieve server rightly , you might see in the dovecot > logs , and/or send dovecot config to the list, look for manuals on the > dovecot site and in www for setup instructions What I need to know is if we have enabled siege and managesieve correctly in dovecot. The following is out config. : root at mail ~ # dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid auth_mechanisms = plain login auth_username_format = %Ln lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:%h/Maildir mail_plugins = " quota" maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_plugins = quota sieve quota = fs:user quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=60%% quota-warning 60 %u quota_warning4 = storage=40%% quota-warning 40 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ } postmaster_address = fbcadmin at fantinibakery.com protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service imap-login { service_count = 0 vsz_limit = 128 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 vsz_limit = 256 M } service quota-warning { executable = script /fbc/bin/mail/quota-warning.sh user = dovecot } ssl = required ssl_ca = References: <34275123.post@talk.nabble.com> <20120810023525.GA14423@daniel.localdomain> Message-ID: <34284058.post@talk.nabble.com> my 10-master.conf; service pop3-login { inet_listener pop3 { } service pop3 { executable = pop3 pop3-postlogin } service pop3-postlogin { executable = script-login /usr/local/bin/postlogin_pop3.sh user = root unix_listener pop3-postlogin { } } when i restart dovecot service. i get an error; Aug 11 00:48:27 pop3y dovecot: pop3-postlogin: Error: read: Illegal option -d Aug 11 00:39:56 pop3y dovecot: pop3-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=99386, secured, session= Aug 11 00:39:56 pop3y dovecot: pop3(test at test.com): Post-login script denied access to user test at test.com Aug 11 00:39:56 pop3y dovecot: pop3-postlogin: Fatal: master: service(pop3-postlogin): child 99387 returned error 10 pop3y# ll /usr/local/bin/postlogin_pop3.sh -rwxr-xr-x 1 root wheel 5449 Aug 11 00:46 /usr/local/bin/postlogin_pop3.sh i use freebsd8.2 -- View this message in context: http://old.nabble.com/about-postlogin-in-dovecot2-tp34275123p34284058.html Sent from the Dovecot mailing list archive at Nabble.com. From ncjeffgus at zimage.com Sat Aug 11 00:54:02 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Fri, 10 Aug 2012 14:54:02 -0700 Subject: [Dovecot] dsync backup gets stuck... fails Message-ID: <1344635642.23239.8.camel@maclinux> More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same problem with both versions. I'm getting an error 75 on about 40 boxes out of 1800. It is the same list of boxes every time we use 'dsync backup' to backup the server. dsync seems to stop communicating to the backup box (over ssh). strace just shows it sitting at a epoll_wait. Once the program quits (times out?), a 'du' shows the destination is smaller (200kbyte in one case). Has anyone else seen an exit code of 75? Nothing in the documentation mentions what exit code 75 could mean. What can I do to help the developers locate the bug? ...Jeff From xray at randoman.ru Sat Aug 11 00:55:49 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Sat, 11 Aug 2012 04:55:49 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024DB17.2080600@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <5024DB17.2080600@thelounge.net> Message-ID: <50258365.4060504@randoman.ru> 10.08.2012 16:57, Reindl Harald ?????: > surely IT IS an argument > > on a non-iPhone you can chosse what is important > your agrumentation is even one argument more against iPhone If we now talking about android vs iPhone now... Imagine Android default email client. It have no many features, that iPhone's default have (Note: i do not use iPhone, i'm not fan of Apple). Then return to thing I wanna tell in previous letter - the situation, when you really NEED to follow ALL of hundred of mail dirs. >>>> I think that battery life is the reason, why this feature is not implemented >>>> in iPhone. It will use only one IMAP connection >>> so it is not "it's IMAP limitation" >> As I told - IMAP limitation is to control only one folder > as proven by other devices there is no limitation Can't you distinguish the protocol itself with limitation to follow only one dir and the realization with workaround to create many connections to follow all required dirs? Just imagine that ActiveSync have no that limitation - it use only one connection for any count of mail dirs and therefore it's scalability is very good! >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone >> will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? >> Therefore IMAP really have limitation to use it on mobile devices > again: how does it help me if I NEED to check them? Sure! If you NEED to check them - I guess you can find some app in Apple Store. > and no, IMAP has no limitations proven by Android-client > my Samsung Galaxy S3 has around 25 push folders Yes, it has. The workaround is something else, that limitation itself. > no problem with K9 mail to have them in my "common inbox" > including my own sent messages while on the desktop i > use the folder structure and my battery has a average > lifetime of 1.5 days Android's power consumption is a result of very many factors. Spherical 1.5 days is something that have no any sense. From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 00:58:02 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 10 Aug 2012 23:58:02 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <34284058.post@talk.nabble.com> References: <34275123.post@talk.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> Message-ID: <20120810215802.GA11509@daniel.localdomain> Bulend Mali wrote: > service pop3-postlogin { > executable = script-login /usr/local/bin/postlogin_pop3.sh > } > > when i restart dovecot service. i get an error; > Aug 11 00:48:27 pop3y dovecot: pop3-postlogin: Error: read: Illegal option -d Seems like you are calling a command with argument -d in your script while the command does not recognize any argument -d. Can you post your script "postlogin_pop3.sh" for review please? Regards Daniel -- https://plus.google.com/103021802792276734820 From bmalik at ihlas.net.tr Sat Aug 11 01:14:12 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Fri, 10 Aug 2012 15:14:12 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810215802.GA11509@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> Message-ID: <1344636852565-7786.post@n4.nabble.com> i can manage read -d problem changing -p what should be user rights of the postlogin_pop3.sh ? i use vpopmail the pop3script; #!/bin/sh # 30-jul-2007 # # Author: # Oliver Schulze L. # Contact: http://tinymailto.com/oliver # Paraguay INTRANET_NETS="127.0.0.1 10." # users that can login from the Internet INTERNET_USERS="user1 user2 user3 user4 test at test.com" DEBUG=0 # variables setup by dovecot: IP USER # configure the dovecot binary to run based on the name of the script, so # this script can be used for imap and pop3 just by making a link SCRIPT_BASE="postlogin" DOVECOT_EXEC="" if [ "$(basename $0)" = "${SCRIPT_BASE}_imap.sh" ] ; then DOVECOT_EXEC="/usr/local/libexec/dovecot/imap" elif [ "$(basename $0)" = "${SCRIPT_BASE}_pop3.sh" ] ; then DOVECOT_EXEC="/usr/local/libexec/dovecot/pop3" else MSG="Please edit the file $(basename $0) and change the SCRIPT_BASE variable" /usr/bin/logger "$MSG" # display a message to the user echo "* OK [ALERT] $MSG" # cancel the current imap request echo "* NO $MSG" exit 1 fi # debug if [ $DEBUG -eq 1 ] ; then # TEST data DEBUG=1 # intranet test, any user can login #IP=192.168.1.23 #USER=user222 # internet test, only user user2 can login #IP=200.85.32.2 #USER=user2 fi if [ -z "$IP" ] ; then echo "$(basename $0): IP variable is empty" exit 2 fi if [ -z "$USER" ] ; then echo "$(basename $0): USER variable is empty" exit 3 fi # FLAGS IN_INTRANET=0 INTERNET_ALLOWED=0 DOVECOT_ALLOW=0 # Create this file in a RAM based directory in order to gain performance FILE_TMP=$(mktemp /tmp/login-intranet-dovecot.tmp.XXXXXX) # ------------------------------------------------------------------------------ # check if the IP is from the Intranet # always use a tmp file in while in order to modify this script variables echo "$INTRANET_NETS " > $FILE_TMP # cicle all intranets while read -p ' ' net_intranet ; do net_grep=$(echo $net_intranet | sed -e 's/\./\\\./g') echo $IP | grep $net_grep 2>/dev/null 1>/dev/null RES=$? if [ $DEBUG -eq 1 ] ; then echo " net_intranet: $net_intranet -> RES: $RES" fi if [ $RES -eq 0 ] ; then # the IP is from the intranet, stop processing and allow login IN_INTRANET=1 break fi done < $FILE_TMP # ------------------------------------------------------------------------------ # if the user is connecting from outside the intranet, check if it is allowed # to do so if [ $IN_INTRANET -eq 0 ] ; then # always use a tmp file in while echo "$INTERNET_USERS " > $FILE_TMP # cicle all allowed internet users while read -p ' ' user_inet ; do if [ $DEBUG -eq 1 ] ; then echo " $USER == $user_inet" fi if [ "$USER" = "$user_inet" ] ; then # the user is conecting from the Internet and is allowed, stop # processing and allow login INTERNET_ALLOWED=1 break fi done < $FILE_TMP fi if [ $DEBUG -eq 1 ] ; then echo "IN_INTRANET : $IN_INTRANET" echo "INTERNET_ALLOWED: $INTERNET_ALLOWED" fi # delete temp file rm -f $FILE_TMP if [ $IN_INTRANET -eq 1 ] ; then # the user is conecting from the intranet DOVECOT_ALLOW=1 elif [ $IN_INTRANET -eq 0 ] && [ $INTERNET_ALLOWED -eq 1 ] ; then # the user is conecting from the internet and is an allowed internet user DOVECOT_ALLOW=1 fi # check if the user can login if [ $DOVECOT_ALLOW -eq 1 ] ; then # the user can login, run the imap or pop3 server if [ $DEBUG -eq 1 ] ; then echo "exec $DOVECOT_EXEC" else # this script ends here exec $DOVECOT_EXEC fi else # user is not allowed to login, inform the user and system log #MSG="El usuario '$USER' no puede conectarse desde Internet" MSG="User '$USER' not allowed to connect from the Internet [$IP]" /usr/bin/logger "$(basename $0): $MSG" # display a message to the user echo "* OK [ALERT] $MSG" # cancel the current imap request echo "* NO $MSG" exit 10 fi exec $@ -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p7786.html Sent from the Dovecot mailing list archive at Nabble.com. From rob at fantinibakery.com Sat Aug 11 01:15:23 2012 From: rob at fantinibakery.com (rob) Date: Fri, 10 Aug 2012 18:15:23 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5025459D.1070403@fantinibakery.com> References: <24a9-50241000-13-11050340@19539233> <5024A980.1080207@schetterer.org> <5025459D.1070403@fantinibakery.com> Message-ID: <502587FB.6090300@fantinibakery.com> On 08/10/2012 01:32 PM, rob wrote: > On 08/10/2012 02:26 AM, Robert Schetterer wrote: >> Am 09.08.2012 21:32, schrieb rob: >>> >>> On Thursday, August 9, 2012 15:19 EDT, Stephan >>> Bosch wrote: >>> >>>> On 8/9/2012 7:08 PM, rob wrote: >>>>> Hello >>>>> We are looking for information on how to use Vacation auto-reply . >>>>> >>>>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a >>>>> few >>>>> other pages, but have not found how to set it up. >>>>> >>>>> We use sogo and thunderbird . >>>>> >>>>> Is there a how to or document for this somewhere? >>>> What exactly do you want to know? >>>> >>>> Regards, >>>> >>>> Stephan. >>>> >>> >>> >>> >>> I'd like to know : >>> - If we have Dovecot configured OK for vacation sieve. >>> >>> - It looks like we should try to manage the vacation sieve filters >>> using sogo or thunderbird . Is that the normal way to do so? >>> >> sieve in dovecot acts like a server where you can feed sieve rules i.e >> vacation, some software mostly webmailsers have guis for this, like >> sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin >> >> if you setup dovecot sieve server rightly , you might see in the dovecot >> logs , and/or send dovecot config to the list, look for manuals on the >> dovecot site and in www for setup instructions > > What I need to know is if we have enabled siege and managesieve > correctly in dovecot. The following is out config. : > > root at mail ~ # dovecot -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid > auth_mechanisms = plain login > auth_username_format = %Ln > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > mail_location = maildir:%h/Maildir > mail_plugins = " quota" > maildir_very_dirty_syncs = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > namespace { > inbox = yes > location = > prefix = INBOX. > separator = . > type = private > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > mail_plugins = quota sieve > quota = fs:user > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > quota_warning3 = storage=60%% quota-warning 60 %u > quota_warning4 = storage=40%% quota-warning 40 %u > sieve = ~/.dovecot.sieve > sieve_before = /etc/dovecot/sieve/spam.sieve > sieve_dir = ~/sieve > sieve_global_dir = /etc/dovecot/sieve/ > } > postmaster_address = fbcadmin at fantinibakery.com > protocols = " imap lmtp sieve" > quota_full_tempfail = yes > service auth-worker { > user = $default_internal_user > } > service auth { > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = postfix > mode = 0600 > user = postfix > } > } > service imap-login { > service_count = 0 > vsz_limit = 128 M > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0660 > user = postfix > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > process_min_avail = 1 > service_count = 0 > vsz_limit = 256 M > } > service quota-warning { > executable = script /fbc/bin/mail/quota-warning.sh > user = dovecot > } > ssl = required > ssl_ca = ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol lmtp { > mail_plugins = quota sieve > } > protocol imap { > mail_max_userip_connections = 30 > mail_plugins = " quota imap_quota" > plugin { > antispam_backend = spool2dir > antispam_signature = X-DSPAM-Signature > antispam_spam = Junk > antispam_spool2dir_notspam = /var/spamtrain/not-spam/%%020lu-%u-%%05 > antispam_spool2dir_spam = /var/spamtrain/spam/%%020lu-%u-%%05 > antispam_trash = Trash > antispam_verbose_debug = 1 > } > } > protocol sieve { > mail_debug = yes > managesieve_implementation_string = Dovecot Pigeonhole > } > > Best regards and thank you for the help! > Rob > OK It looks like our dovecot setup is ok: gnutls-cli --starttls -p 4190 127.0.0.1 Processed 152 CA certificate(s). Resolving '127.0.0.1'... Connecting to '127.0.0.1:4190'... |<1>| Note that the security level of the Diffie-Hellman key exchange has been lowered to 512 bits and this may allow decryption of the session data - Simple Client Mode: "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 01:46:38 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 00:46:38 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344636852565-7786.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> Message-ID: <20120810224638.GA11918@daniel.localdomain> bmalik wrote: > i can manage read -d problem changing -p You should not do that, since the semantics of -d and -p are completely different. Argument -d ' ' sets the delimiter for reading words to space, while -p enables password mode in order to disable input echo. By simply replacing -d with -p you will most probably break the functionality of the original script. On freeBSD you're using a different default shell (sh) than the original author, so your "read" command provided by the shell behaves differently. Install bash or some other compatible shell which supports read -d and try to replace the first line of the script with #!/bin/bash or the corresponding shell executable to use another shell for the execution of the script. > what should be user rights of the postlogin_pop3.sh? The flags r (read) and x (execute) should be allowed for dovecot group, so that the mailserver can read and execute the script. Others do not need access to the script. I've set permissions for the "post-login" script as follows: -rwxr-x--- root dovecot Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 01:56:22 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 00:56:22 +0200 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <20120810225621.GA12297@daniel.localdomain> Hi Jeff, Jeff Gustafson wrote: > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > problem with both versions. > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > list of boxes every time we use 'dsync backup' to backup the server. > dsync seems to stop communicating to the backup box (over ssh). strace > just shows it sitting at a epoll_wait. Once the program quits (times > out?), a 'du' shows the destination is smaller (200kbyte in one case). > What can I do to help the developers locate the bug? Please start by following the instructions at http://dovecot.org/bugreport.html and post your 'doveconf -n' output in order to provide possibly important information about your system and configs. Regards Daniel -- https://plus.google.com/103021802792276734820 From bmalik at ihlas.net.tr Sat Aug 11 04:33:51 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Fri, 10 Aug 2012 18:33:51 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810224638.GA11918@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> Message-ID: <1344648831922-25969.post@n4.nabble.com> I started to use bash in the script and changed read -d instead of -p. Also I get the script 's rights root:dovecot I get an error; -ERR pop3 binary must not be started from inetd, use pop3-login instead. Connection closed by foreign host. Aug 11 04:30:05 pop3y dovecot: pop3(test at test.com): Post-login script denied access to user test at test.com Aug 11 04:30:05 pop3y dovecot: pop3-postlogin: Fatal: master: service(pop3-postlogin): child 15837 returned error 1 -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p25969.html Sent from the Dovecot mailing list archive at Nabble.com. From ncjeffgus at zimage.com Sat Aug 11 04:50:16 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Fri, 10 Aug 2012 18:50:16 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <20120810225621.GA12297@daniel.localdomain> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> Message-ID: <1344649816.23239.13.camel@maclinux> On Sat, 2012-08-11 at 00:56 +0200, Daniel Parthey wrote: > Hi Jeff, > Please start by following the instructions at > http://dovecot.org/bugreport.html > and post your 'doveconf -n' output in order to provide > possibly important information about your system and configs. Storage is local hardware-based RAID (SATA drives). FS is ext4. No core dump that I know of. Command used (mailbox is over 2GB): # su vmail -c "dsync -u user at domain.com backup ssh vmail at bk05 dsync -c /etc/dovecot/dovecot.conf -u user at domain.com" Config file: # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 CentOS release 6.2 (Final) auth_mechanisms = plain login default_client_limit = 15000 default_process_limit = 10000 disable_plaintext_auth = no listen = * mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib quota stats mail_uid = vmail mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User noenforcing quota::file:%h/dovecot-quota stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz } protocols = imap pop3 service auth { client_limit = 10000 unix_listener auth-userdb { mode = 0666 } } service imap-postlogin { executable = script-login /usr/bin/postlogin-imap.sh user = $default_internal_user } service imap { drop_priv_before_exec = yes executable = imap process_limit = 10000 } service pop3-postlogin { executable = script-login /usr/bin/postlogin-pop.sh user = $default_internal_user } service pop3 { drop_priv_before_exec = yes executable = pop3 process_limit = 2500 } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = Hello, is it possible to use the Solr full text search plugin for indexing mail attachments? I found a very old patch and some hints regarding a fts_decoder script that I don't understand. Making Solr indexing PDF or Office files shouldn't be that difficult, but how can I enable the plugin to transfer the attachments to Solr? Best regards, Sebastian From bmalik at ihlas.net.tr Sat Aug 11 12:36:21 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Sat, 11 Aug 2012 02:36:21 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810224638.GA11918@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> Message-ID: <1344677781012-37034.post@n4.nabble.com> is there another post-login script that i can use on freebsd ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37034.html Sent from the Dovecot mailing list archive at Nabble.com. From rafinathan25 at gmail.com Sat Aug 11 13:11:55 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Sat, 11 Aug 2012 15:41:55 +0530 Subject: [Dovecot] Exim and Dovecot Message-ID: Hi, I am installing Exim and Dovecot through yum on my Centos 5 x86_64 machine. Exim is unable to find the virtual users. Is there a full-fledged guide to get the two working. Any help is highly appreciated. Regards, Rafael From nmilas at noa.gr Sat Aug 11 16:02:39 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Sat, 11 Aug 2012 16:02:39 +0300 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50246846.6020606@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> Message-ID: <502657EF.2090600@noa.gr> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: > That begs the question, > what is your definition of a "Highly Available Mail Server"? What is it > that you actually want to accomplish? In some detail please. OK, I'll make it as much as possible accurate. Let's skip all the network stuff and see a particular scenario (as we have drafted it). We have an incoming gateway server (gw.example.com) accepting mail and filtering viruses/spam. Then it relays all (clean) mail to mail1.example.com, which uses Postfix/Dovecot (2.0 or 2.1) and provides Maildir mailboxes (POP/IMAP) to users. Now, let us assume we are deploying another server, mail2.example.com (also Postfix/Dovecot), which we want to function as follows: 1. Under normal conditions, mail2.example.com is a full mirror of mail1.example.com; when any mail message is added/viewed/moved/removed etc. to any user's folder or any folder is added/viewed/moved/removed etc. at mail1.example.com, we want it to be automatically and directly (in real time) added/viewed/moved/removed etc. to mail2.example.com too. In other words, we need continuous, real-time sync. 2. If mail1.example.com for some reason is unavailable, then we will be able to manually redirect relaying (of incoming messages) to mail2.example.com. Then, users will be able to use mail2.example.com to access their mail. Now, when mail1.example.com becomes available again, we want to: a. inform users (by sending them a mail on mail2.example.com) that mail1.example.com is available again, b. stop relaying to mail2.example.com c. sync once mailboxes on mail1.example.com to mail2.example.com (because mail2.example.com is now more current) d. redirect relaying to mail1.example.com e. switch to normal operation (see ?1 above) Can I do this and how? I would call this pseudo-HA, since users have to switch servers in case of failures. To use the above as "true" HA (as I view it), there could be a mail.example.com functioning as a proxy and automatically redirecting users to mail1 or mail2, depending on admins' choice. Can I do this too? (How?) [Google mail is not an option, we don't want external hosting. We can have as many high-performance, highly-reliable VMs as we want for free on our ISP's network - it's a service to the Greek educational/research community. They use two different specialized high-end enterprise-grade dedicated virtualization clusters of host hardware (which I -not being very accurate- called clouds) on their networks, each of which uses dedicated high-end enterprise-grade SAN-based storage. Practically we have never had VM outages due to hardware failures, only due to software (rarely) or network (mainly) ones. mail1.example.com would be deployed on the main virtualization cluster and mail2.example.com would be on the the other cluster. KVM is used as host virtualization software.] Alternative suggestions on design approaches would be welcome. Thanks and regards, Nick From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 16:50:13 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 15:50:13 +0200 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344649816.23239.13.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> <1344649816.23239.13.camel@maclinux> Message-ID: <20120811135012.GA18601@daniel.localdomain> Jeff Gustafson wrote: > On Sat, 2012-08-11 at 00:56 +0200, Daniel Parthey wrote: > > Hi Jeff, > > Please start by following the instructions at > > http://dovecot.org/bugreport.html > > and post your 'doveconf -n' output in order to provide > > possibly important information about your system and configs. > > Storage is local hardware-based RAID (SATA drives). FS is ext4. > No core dump that I know of. > Command used (mailbox is over 2GB): > > # su vmail -c "dsync -u user at domain.com backup ssh vmail at bk05 dsync -c /etc/dovecot/dovecot.conf -u user at domain.com" > > Config file: > # 2.1.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 CentOS release 6.2 > (Final) Maybe you have run into the epoll kernel bug under RHEL/CentOS: http://dovecot.org/oldnews.html Thu Mar 22 14:38:53 EET 2012 Red Hat/CentOS users: A recent kernel update causes Dovecot to start failing after it has reached 1000 child processes. To fix this, downgrade your kernel until Red Hat releases a fixed kernel. See also: https://bugzilla.redhat.com/show_bug.cgi?id=681578 You should try another kernel: https://rhn.redhat.com/errata/RHSA-2012-1129.html Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 18:19:20 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 17:19:20 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344677781012-37034.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> Message-ID: <20120811151920.GA19891@daniel.localdomain> bmalik wrote: > is there another post-login script that i can use on freebsd ? You can use virtually any executable for post-login if they communicate as expected. First you should start simple and create a post-login script consisting of just a few lines which just covers the case of "access always granted to any user". Once you got this working, you will be able to extend your script with the required denial features. Why are you executing any $DOVECOT_EXEC anyways? The example scripts at http://wiki2.dovecot.org/PostLoginScripting are just doing a exec "$@" to exec chained scripts. It seems that dovecot already executes the service binary, which then communicates with the script-login process from "imap-postlogin" service via its "imap-postlogin" socket: service imap { # tell imap to do post-login lookup using a socket called "imap-postlogin" executable = imap imap-postlogin } # The service name below doesn't actually matter. service imap-postlogin { # all post-login scripts are executed via script-login binary executable = script-login /usr/local/bin/postlogin.sh # the script process runs as the user specified here (v2.0.14+): user = $default_internal_user # this UNIX socket listener must use the same name as given to imap executable unix_listener imap-postlogin { } } Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 19:52:45 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 18:52:45 +0200 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502657EF.2090600@noa.gr> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> Message-ID: <20120811165245.GA21206@daniel.localdomain> Nikolaos Milas wrote: > On 10/8/2012 4:47 ??, Stan Hoeppner wrote: > > >That begs the question, > >what is your definition of a "Highly Available Mail Server"? What is it > >that you actually want to accomplish? In some detail please. > > 1. Under normal conditions, mail2.example.com is a full mirror of > mail1.example.com; when any mail message is > added/viewed/moved/removed etc. to any user's folder or any folder > is added/viewed/moved/removed etc. at mail1.example.com, we want it > to be automatically and directly (in real time) > added/viewed/moved/removed etc. to mail2.example.com too. In other > words, we need continuous, real-time sync. > > Can I do this and how? You might have a look at DRBD (distributed replicated block device) which provides a high available block device with fully synchronous mirroring: http://www.drbd.org/home/mirroring Dovecot can then simply work with the filesystem residing on the highly avilable DRBD volume. Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Sat Aug 11 20:11:46 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 11 Aug 2012 12:11:46 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502657EF.2090600@noa.gr> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> Message-ID: <50269252.8060508@hardwarefreak.com> On 8/11/2012 8:02 AM, Nikolaos Milas wrote: > 1. Under normal conditions, mail2.example.com is a full mirror of > mail1.example.com; when any mail message is added/viewed/moved/removed > etc. to any user's folder or any folder is added/viewed/moved/removed > etc. at mail1.example.com, we want it to be automatically and directly > (in real time) added/viewed/moved/removed etc. to mail2.example.com too. > In other words, we need continuous, real-time sync. There are 3 ways to do this, all require a form of shared storage: 1. A cluster filesystem atop shared storage 2. DRBD mirroring with a cluster filesystem atop 3. NFS #1 won't work in a VPS "cloud" unless the provider gives you direct access to an iSCSI SAN LUN. #2 might but you'll be in uncharted waters. #3 will work in a VPS cloud, but the host serving NFS is a single point of failure. DRBD mirroring is typically done with an X-over cable between the two nodes. If the packets must traverse a WAN link, or an internal network that experiences any packet loss, DRBD will have problems. You'll need to make sure fencing is working properly which entails lots of testing before going into production. http://www.drbd.org/ Pick DRBD expert's brains to determine if doing it over a VPS LAN is possible/feasible. > 2. If mail1.example.com for some reason is unavailable, then we will be > able to manually redirect relaying (of incoming messages) to > mail2.example.com. When setup properly no manual intervention is necessary. Everything is automatic. If one of the two Dovecot/DRBD nodes is down mail is automatically relayed to the other. This is done by putting putting a Postfix instance on each cluster node with equal priority MX records for both. So instead of having two MX relay/AS/AV servers and two Dovecot mailbox servers, you have once instance of everything on each of two nodes. I.e. Postfix+amavisd+SA+Dovecot+etc on each node. Equal priority MX will route inbound mail fairly evenly between both nodes. If one MX is unreachable, remote SMTP clients will retry the other MX. It's fully automatic. You may want to install Dovecot director on one of the nodes so IMAP connections are spread evenly and to avoid mailbox locking/delay issues. > Then, users will be able to use mail2.example.com to > access their mail. Now, when mail1.example.com becomes available again, > we want to: > a. inform users (by sending them a mail on mail2.example.com) that > mail1.example.com is available again, > b. stop relaying to mail2.example.com > c. sync once mailboxes on mail1.example.com to mail2.example.com > (because mail2.example.com is now more current) > d. redirect relaying to mail1.example.com > e. switch to normal operation (see ?1 above) Again, all of this is unnecessary, as it's fully automatic when done properly. > Can I do this and how? Writing you a complete design document for doing this is beyond the scope of a mailing list thread. There exists plenty of documentation on the web. You will have to do your own research, but I've pointed you in the right direction. There are people on this list using a configuration almost identical to this, but not with VPS, though I am not one of them. When you are far enough along in the process and have specific questions I'm sure others will be glad to help. > I would call this pseudo-HA, since users have to switch servers in case > of failures. To use the above as "true" HA (as I view it), there could > be a mail.example.com functioning as a proxy and automatically > redirecting users to mail1 or mail2, depending on admins' choice. Can I > do this too? (How?) See Dovecot director: http://wiki2.dovecot.org/Director > [Google mail is not an option, we don't want external hosting. We can > have as many high-performance, highly-reliable VMs as we want for free > on our ISP's network - it's a service to the Greek educational/research > community. They use two different specialized high-end enterprise-grade > dedicated virtualization clusters of host hardware (which I -not being > very accurate- called clouds) on their networks, each of which uses > dedicated high-end enterprise-grade SAN-based storage. Practically we > have never had VM outages due to hardware failures, only due to software > (rarely) or network (mainly) ones. mail1.example.com would be deployed > on the main virtualization cluster and mail2.example.com would be on the > the other cluster. KVM is used as host virtualization software.] The approach I outlined above may work, as long as the network is reliable enough to keep DRBD happy. Once built you will obviously want to test the setup with a simulated real world workload for a few weeks to a month in order to confirm the network is reliable enough to support DRBD, before attempting full live deployment. But this is true of any new back end services deployment. I dunno if Eric Rostetter is still around. He's got a very similar setup running at UT Austin, but on two dedicated servers, not VPS. He could probably give you some pointers if you run into design/config trouble: http://www.ph.utexas.edu/person/rostetter_eric I'm sure there are others with a very similar setup on this list. -- Stan From stan at hardwarefreak.com Sat Aug 11 20:18:18 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 11 Aug 2012 12:18:18 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <20120811165245.GA21206@daniel.localdomain> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <20120811165245.GA21206@daniel.localdomain> Message-ID: <502693DA.7020202@hardwarefreak.com> On 8/11/2012 11:52 AM, Daniel Parthey wrote: > Nikolaos Milas wrote: >> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: >> >>> That begs the question, >>> what is your definition of a "Highly Available Mail Server"? What is it >>> that you actually want to accomplish? In some detail please. >> >> 1. Under normal conditions, mail2.example.com is a full mirror of >> mail1.example.com; when any mail message is >> added/viewed/moved/removed etc. to any user's folder or any folder >> is added/viewed/moved/removed etc. at mail1.example.com, we want it >> to be automatically and directly (in real time) >> added/viewed/moved/removed etc. to mail2.example.com too. In other >> words, we need continuous, real-time sync. >> >> Can I do this and how? > > You might have a look at DRBD (distributed replicated block device) > which provides a high available block device with fully synchronous > mirroring: > > http://www.drbd.org/home/mirroring > > Dovecot can then simply work with the filesystem residing on > the highly avilable DRBD volume. But to be clear, for a true HA setup with full active/active nodes, this must be a cluster filesystem (GFS2/OCFS2). -- Stan From rob at fantinibakery.com Sat Aug 11 20:43:52 2012 From: rob at fantinibakery.com (rob) Date: Sat, 11 Aug 2012 13:43:52 -0400 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502693DA.7020202@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <20120811165245.GA21206@daniel.localdomain> <502693DA.7020202@hardwarefreak.com> Message-ID: <502699D8.3050306@fantinibakery.com> On 08/11/2012 01:18 PM, Stan Hoeppner wrote: > On 8/11/2012 11:52 AM, Daniel Parthey wrote: >> Nikolaos Milas wrote: >>> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: >>> >>>> That begs the question, >>>> what is your definition of a "Highly Available Mail Server"? What is it >>>> that you actually want to accomplish? In some detail please. >>> 1. Under normal conditions, mail2.example.com is a full mirror of >>> mail1.example.com; when any mail message is >>> added/viewed/moved/removed etc. to any user's folder or any folder >>> is added/viewed/moved/removed etc. at mail1.example.com, we want it >>> to be automatically and directly (in real time) >>> added/viewed/moved/removed etc. to mail2.example.com too. In other >>> words, we need continuous, real-time sync. >>> >>> Can I do this and how? >> You might have a look at DRBD (distributed replicated block device) >> which provides a high available block device with fully synchronous >> mirroring: >> >> http://www.drbd.org/home/mirroring >> >> Dovecot can then simply work with the filesystem residing on >> the highly avilable DRBD volume. > But to be clear, for a true HA setup with full active/active nodes, this > must be a cluster filesystem (GFS2/OCFS2). > A good solution for kvm + drbd is this: http://pve.proxmox.com/wiki/Two-Node_High_Availability_Cluster From bmalik at ihlas.net.tr Sun Aug 12 16:44:43 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Sun, 12 Aug 2012 06:44:43 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120811151920.GA19891@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> Message-ID: <1344779083953-37043.post@n4.nabble.com> Thank you I wrote a loginscript in bash. it works well. I can restrict a user by IP. Well , how can i restrict a particular email address by tcp port ? I want a particular mail address to be forced to use pop3s/imaps. I use vpopmail / dovecot2 -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37043.html Sent from the Dovecot mailing list archive at Nabble.com. From madduck at debian.org Sun Aug 12 20:26:10 2012 From: madduck at debian.org (martin f krafft) Date: Sun, 12 Aug 2012 19:26:10 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120809122351.GA26800@albatross.gern.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> <20120809122351.GA26800@albatross.gern.madduck.net> Message-ID: <20120812172610.GA2741@fishbowl.rw.madduck.net> also sprach martin f krafft [2012.08.09.1423 +0200]: > and then put the following sieve script into /etc/dovecot/sieve.before.d/spamassassin.sieve: > > require [ "vnd.dovecot.filter" ]; > filter "spamc" [ "--no-safe-fallback" ]; > > and then ran > > sievec spamassassin.sieve && chmod 444 spamassassin.svbin > > To tell the LDA where to find the spamc filter, I added (to > 90-sieve.conf): > > sieve_filter_bin_dir = /etc/dovecot/sieve-filter > > and symlinked spamc there > > ln -s /usr/bin/spamc /etc/dovecot/sieve-filter/spamc Btw, this won't work reliably. The reason is that vnd.dovecot.filter currently requires the filter executable to soak up all of the input before it even bothers reading its output. Under certain conditions, however ? for instance when the input is larger than the SpamAssassin max_size setting, spamc just pipes input to output, without buffering. This would yield a deadlock because vnd.dovecot.filter would not be reading output yet but still be writing input, whereas spamc would no longer be willing to handle input while its output was not being read. Stephan Bosch has indicated a solution to this problem (asynchronous IO), but until that's in place, I simply put the following shell script in place: -----8<----8<----8<----- #!/bin/sh set -eu TMPFILE=$(tempfile -p spamc) cleanup() { rm -f $TMPFILE; trap - EXIT; } trap cleanup EXIT cat > $TMPFILE spamc -x < $TMPFILE cleanup -----8<----8<----8<----- This is ugly because Dovecot itself may already have spooled the mail message to disk (if it was too large for in-memory buffering), and now we're spooling it a second time. Asynchronous IO will alleviate this need for the second roundtrip via the filesystem. Hope this helps, -- .''`. martin f. krafft Related projects: : :' : proud Debian developer http://debiansystem.info `. `'` http://people.debian.org/~madduck http://vcs-pkg.org `- Debian - when you have better things to do than fixing systems -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From daniel.parthey at informatik.tu-chemnitz.de Mon Aug 13 02:13:07 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 13 Aug 2012 01:13:07 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344779083953-37043.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> Message-ID: <20120812231307.GA11093@daniel.localdomain> bmalik wrote: > I wrote a loginscript in bash. it works well. I can restrict a user by IP. > how can i restrict a particular email address by tcp port ? > I want a particular mail address to be forced to use pop3s/imaps. What's your doveconf -n output, please? Are you using SQL or LDAP for user lookup? You probably should do the filtering already in your userdb/authdb lookup queries, since Variable %a or %{lport} which contains the local port is only available in Dovecot-Auth according to http://wiki2.dovecot.org/Variables Regards Daniel -- https://plus.google.com/103021802792276734820 From ibrahim.harrani at gmail.com Mon Aug 13 11:24:57 2012 From: ibrahim.harrani at gmail.com (Ibrahim Harrani) Date: Mon, 13 Aug 2012 11:24:57 +0300 Subject: [Dovecot] master user auth problem Message-ID: Hi, I tried to setup a master auth authentication. I also use auth_pop3wrapper to authenticate from qmail-ldap. But I could not login with master user. Here is the config. auth_master_user_separator = * passdb { driver = passwd-file args = /usr/local/etc/dovecot/passwd.masterusers master = yes pass = yes } passdb { # Path for checkpassword binary driver = checkpassword args = /var/qmail/bin/auth_popwrapper } userdb { driver = prefetch } cat /opt/surmail/etc/dovecot/passwd.masterusers user:{SHA}W6ph5Mm5Pz8GgiULbPgzG37mj9g= The log: #telnet localhost 143 Trying 0.0.0.0... Connected to 0. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] SurGATE Messaging Suite POP3/IMAP ready. o login user at domain.com*user password o NO [AUTHORIZATIONFAILED] Authorization failed Aug 09 16:17:44 auth: Debug: auth(user,127.0.0.1,master,): Master user lookup for login: user at domain.com Aug 09 16:17:44 auth: Debug: passwd-file(user,127.0.0.1,master,): lookup: user=user file= /usr/local/etc/dovecot/passwd.masterusers Aug 09 16:17:44 auth: Info: passdb(user,127.0.0.1,master,): Master user logging in as user at domain.com Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): execute: /var/qmail/bin/auth_popwrapper /usr/local/dovecot/libexec/dovecot/checkpassword-reply Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): Received input: Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): exit_status=3 Aug 09 16:17:44 auth: Info: checkpassword(user at domain.com,127.0.0.1,): Login failed (status=3) Aug 09 16:17:46 auth: Debug: client out: FAIL 1 user=user at domain.com authz Aug 09 16:18:08 auth: Debug: client in: AUTH 2 PLAIN service=imap secured session=KmGNDdXGrwB/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=48047 resp= From bmalik at ihlas.net.tr Mon Aug 13 12:54:43 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 02:54:43 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <1344851683428-37047.post@n4.nabble.com> hello how can i do a login script by tcp port ? I use cdb database my dovecot.conf -n; # doveconf -n # 2.1.8: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.2-RELEASE amd64 auth_mechanisms = plain login digest-md5 cram-md5 apop disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 login_greeting = Dovecot ready2. mail_gid = 89 mail_plugin_dir = /usr/lib/dovecot mail_uid = 89 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = webmail=127.0.0.1 driver = vpopmail } protocols = imap pop3 service pop3-postlogin { executable = script-login /usr/local/bin/postlogin_pop3.sh user = root } service pop3 { executable = pop3 pop3-postlogin } ssl = no userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol imap { mail_max_userip_connections = 20 } protocol pop3 { mail_max_userip_connections = 20 } -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37047.html Sent from the Dovecot mailing list archive at Nabble.com. From CMarcus at Media-Brokers.com Mon Aug 13 13:27:25 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 13 Aug 2012 06:27:25 -0400 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <5028D68D.5090604@Media-Brokers.com> On 2012-08-12 7:13 PM, Daniel Parthey wrote: > bmalik wrote: >> I wrote a loginscript in bash. it works well. I can restrict a user by IP. >> how can i restrict a particular email address by tcp port ? >> I want a particular mail address to be forced to use pop3s/imaps. > What's your doveconf -n output, please? > Are you using SQL or LDAP for user lookup? > > You probably should do the filtering already in your > userdb/authdb lookup queries, since Variable %a or %{lport} > which contains the local port is only available in > Dovecot-Auth according to http://wiki2.dovecot.org/Variables Or you could use something like: http://wiki2.dovecot.org/Authentication/RestrictAccess -- Best regards, Charles From voytek at sbt.net.au Mon Aug 13 14:12:14 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Mon, 13 Aug 2012 21:12:14 +1000 Subject: [Dovecot] imap-login process_limit (100) reached, client connections are being dropped Message-ID: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> noticed this in the log today, after about 11 warning IMAP appears to have not worked, 'service dovecot reload' got it going again question: what to check/alter ? ---------------- # grep process_limit /var/log/maillog Aug 13 15:31:44 geko dovecot: master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped ''' Aug 13 20:45:35 geko dovecot: master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped # doveconf -n | grep limit # # dovecot --version 2.1.1 # ps ax | grep imap | wc 109 546 4693 # ps ax | grep imap-login | wc 57 286 2619 # doveadm who | wc 16 122 1531 centos 6, 20 virtual domains, 100 users -- Voytek Eymont From bmalik at ihlas.net.tr Mon Aug 13 14:34:44 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 04:34:44 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <5028D68D.5090604@Media-Brokers.com> References: <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> <5028D68D.5090604@Media-Brokers.com> Message-ID: <1344857684827-37050.post@n4.nabble.com> Ok where do i have to locate the passwd-file in dovecot2 i use vpopmail and dovecot2. -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37050.html Sent from the Dovecot mailing list archive at Nabble.com. From nmilas at noa.gr Mon Aug 13 15:08:14 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Mon, 13 Aug 2012 15:08:14 +0300 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50269252.8060508@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <50269252.8060508@hardwarefreak.com> Message-ID: <5028EE2E.9040305@noa.gr> On 11/8/2012 8:11 ??, Stan Hoeppner wrote: > Writing you a complete design document for doing this is beyond the > scope of a mailing list thread. There exists plenty of documentation on > the web. You will have to do your own research, but I've pointed you in > the right direction. Thank you Stan and everyone else who contributed on this subject. I'll research further. Your info has been very enlightening. Thanks again, Nick From tss at iki.fi Mon Aug 13 15:40:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 13 Aug 2012 15:40:58 +0300 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more Message-ID: <1344861658.13571.10.camel@hurina> v2.2 hg now has support for NOTIFY extension. The only thing missing is support for SubscriptionChange events. Now would be a good time for IMAP clients to start implementing and testing it. :) I remember K9 developers at least said they were just waiting for Dovecot to support it first. v2.2 implements some other extensions also: BINARY, CATENATE and MOVE. Stephan has also implemented URLAUTH pretty far. Hopefully it gets finished in time for v2.2.0. I'll also try to implement the rest of the LEMONADE extensions: CONVERT, CONTEXT=SORT and URLAUTH=BINARY. I'm also considering implementing an SMTP submission server, which works only as a proxy to the real SMTP server. The benefits of it would mainly be: * It could support BURL command and other extensions required by LEMONADE. The real SMTP server would see only regular DATA commands. * Would make SMTP AUTH easy to implement regardless of what the real SMTP server is. From tonio at starbridge.org Mon Aug 13 18:40:03 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Mon, 13 Aug 2012 17:40:03 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> Message-ID: <50291FD3.30908@starbridge.org> Le 10/08/2012 01:34, Timo Sirainen a ?crit : > Actually it wasn't that obvious: > http://hg.dovecot.org/dovecot-2.1/rev/b082b8260782 plus > http://hg.dovecot.org/dovecot-2.1/rev/9d0873cefa08 Thanks Timo, it's working fine now Best regards Tonio Buonaguidi From p.pridt at chello.at Mon Aug 13 18:18:05 2012 From: p.pridt at chello.at (ppridt) Date: Mon, 13 Aug 2012 08:18:05 -0700 (PDT) Subject: [Dovecot] Permission denied on dovecot.lda-dupes Message-ID: <1344871085776-37053.post@n4.nabble.com> Hi, I have converted my Imap Server from Courier to Dovecot in order to use sieve support. Everything works fine with the exception that the sender always gets the vacation msg since there is a permission error on writing of dovecot.lda-dupes. I've tried several version of permissions including 777 to both home and maildir - always the same result. I also googled for hours .. Any help will be appreciated. Paul This is the debug log: ----------------------------------------------------------------------------------------------------- Aug 13 14:51:26 Srv dovecot: deliver(pp): Loading modules from directory: /usr/lib/dovecot/modules/lda Aug 13 14:51:26 Srv dovecot: deliver(pp): Module loaded: /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so Aug 13 14:51:26 Srv dovecot: deliver(pp): Home dir not found: Aug 13 14:51:26 Srv dovecot: deliver(pp): maildir: data=/Daten/Vmail/pp/Maildir Aug 13 14:51:26 Srv dovecot: deliver(pp): maildir++: root=/Daten/Vmail/pp/Maildir, index=, control=, inbox=/Daten/Vmail/pp/Maildir Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: using sieve path for user's script: /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: opening script /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: executing compiled script /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): Namespace : Using permissions from /Daten/Vmail/pp/Maildir: mode=0700 gid=-1 Aug 13 14:51:26 Srv dovecot: deliver(pp): file_dotlock_create(/.dovecot.lda-dupes) failed: Permission denied ----------------------------------------------------------------------------------------------------- This ist my dovecot.conf: ----------------------------------------------------------------------------------------------------- protocols = imap imaps managesieve mail_debug = yes log_path = info_log_path = disable_plaintext_auth = no # Authentication configuration: mail_location = maildir:/Daten/Vmail/%u/Maildir auth_verbose = yes mail_nfs_storage = no mail_nfs_index = no nfs_check = no lock_method = dotlock mail_uid = vmail mail_gid = vmail auth default { mechanisms = plain login passdb pam { } userdb passwd { args = uid=vmail gid=vmail home=/home/%u mail=maildir:/Daten/Vmail/%u/Maildir } socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 user = vmail } } } protocol lda { postmaster_address = admin at ppridt.dnsalias.org mail_plugins = sieve auth_socket_path = /var/run/dovecot/auth-master } protocol managesieve { login_executable = /usr/lib/dovecot/managesieve-login mail_executable = /usr/lib/dovecot/managesieve managesieve_implementation_string = Cyrus timsieved v2.2.13 } plugin { sieve=/Daten/Vmail/%u/.dovecot.sieve sieve_dir=/Daten/Vmail/%u/.sieve } ----------------------------------------------------------------------------------------------------- This is the exim delivery transport: ----------------------------------------------------------------------------------------------------- dovecot_lda: driver = pipe command = /usr/lib/dovecot/deliver message_prefix = message_suffix = log_output delivery_date_add envelope_to_add return_path_add user = vmail group = vmail temp_errors = 64 : 69 : 70: 71 : 72 : 73 : 74 : 75 : 78 ----------------------------------------------------------------------------------------------------- -- View this message in context: http://dovecot.2317879.n4.nabble.com/Permission-denied-on-dovecot-lda-dupes-tp37053.html Sent from the Dovecot mailing list archive at Nabble.com. From c at roessner-network-solutions.com Mon Aug 13 21:15:45 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Mon, 13 Aug 2012 20:15:45 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Message-ID: Hi, >>>> doveadm import mdbox:~/mdbox-backup all-mails all >>> >>> problem >>> >>> I tried so, but this does not work here: >> >> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >> >> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >> > done > > And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? > I tested today with Dovecot 2.1.9. Still not getting mails imported :-( How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? Many thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From p at state-of-mind.de Mon Aug 13 21:27:37 2012 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Mon, 13 Aug 2012 20:27:37 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <1344861658.13571.10.camel@hurina> References: <1344861658.13571.10.camel@hurina> Message-ID: <20120813182736.GB11223@state-of-mind.de> * Timo Sirainen : > I'm also considering implementing an SMTP submission server, which works > only as a proxy to the real SMTP server. The benefits of it would mainly > be: > > * It could support BURL command and other extensions required by > LEMONADE. The real SMTP server would see only regular DATA commands. > * Would make SMTP AUTH easy to implement regardless of what the real > SMTP server is. Nice move! Especially since I recall Wietse being not very inclined to implement anything alike. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From CMarcus at Media-Brokers.com Mon Aug 13 21:52:11 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 13 Aug 2012 14:52:11 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <20120813182736.GB11223@state-of-mind.de> References: <1344861658.13571.10.camel@hurina> <20120813182736.GB11223@state-of-mind.de> Message-ID: <50294CDB.2010800@Media-Brokers.com> On 2012-08-13 2:27 PM, Patrick Ben Koetter

wrote: > * Timo Sirainen: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: >> >> * It could support BURL command and other extensions required by >> LEMONADE. The real SMTP server would see only regular DATA commands. >> * Would make SMTP AUTH easy to implement regardless of what the real >> SMTP server is. > > Nice move! Especially since I recall Wietse being not very inclined to > implement anything alike. Amen to that! This is a feature request I made a long time ago (I called it the dovecot LSA for Local Submission Agent), and I'm *very* glad that soon I'll be able to tell all my clients they can uncheck the 'Save copy of Sent messages' option for good... :) Thanks Timo!! -- Best regards, Charles From ncjeffgus at zimage.com Mon Aug 13 22:17:47 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Mon, 13 Aug 2012 12:17:47 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <20120811135012.GA18601@daniel.localdomain> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> <1344649816.23239.13.camel@maclinux> <20120811135012.GA18601@daniel.localdomain> Message-ID: <1344885467.19606.3.camel@maclinux> On Sat, 2012-08-11 at 15:50 +0200, Daniel Parthey wrote: > Maybe you have run into the epoll kernel bug under RHEL/CentOS: > :) Yeah... been there, done that. We found that bug within *minutes* of ksplice updating the kernel. I don't think this is an epoll thing because, if it was, customers wouldn't be able to connect to our services. I think there is something else going on. I think it is a bug, but I suppose it could be a setting somewhere. Something is timing out or getting stuck. ...Jeff From chris at arachsys.com Mon Aug 13 19:12:51 2012 From: chris at arachsys.com (Chris Webb) Date: Mon, 13 Aug 2012 17:12:51 +0100 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting Message-ID: <20120813161251.GB14149@arachsys.com> Sharing an installed copy of dovecot between several users each running a daemon within their own account (or using the same binaries for a system daemon and a user daemon) is difficult because the compile-time directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the location of things like the ssl-parameters.dat file and the replicator database. Replace all these uses of PKG_STATEDIR with a state_dir setting which defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the same way base_dir can be used to override PKG_RUNDIR. Signed-off-by: --- src/config/Makefile.am | 1 - src/doveadm/doveadm-instance.c | 10 ++++------ src/doveadm/doveadm-mount.c | 3 +-- src/doveadm/doveadm-settings.c | 2 -- src/doveadm/doveadm-settings.h | 1 - src/lib-master/master-instance.h | 2 ++ src/lib-master/master-service-settings.c | 2 -- src/lib-master/master-service-settings.h | 1 - src/lib-master/master-service.c | 6 ++---- src/login-common/ssl-proxy-openssl.c | 3 ++- src/master/main.c | 11 ++++------- src/master/master-settings.c | 6 ++---- src/master/master-settings.h | 1 - src/replication/replicator/replicator-settings.c | 2 -- src/replication/replicator/replicator-settings.h | 1 - src/replication/replicator/replicator.c | 16 +++++----------- src/ssl-params/main.c | 5 ++--- src/ssl-params/ssl-params-settings.c | 2 -- src/ssl-params/ssl-params-settings.h | 1 - 19 files changed, 24 insertions(+), 52 deletions(-) diff --git a/src/config/Makefile.am b/src/config/Makefile.am --- a/src/config/Makefile.am +++ b/src/config/Makefile.am @@ -9,6 +9,7 @@ -I$(top_srcdir)/src/lib-settings \ -I$(top_srcdir)/src/lib-master \ -DPKG_RUNDIR=\""$(rundir)"\" \ + -DPKG_STATEDIR=\""$(statedir)"\" \ -DPKG_LIBEXECDIR=\""$(pkglibexecdir)"\" \ -DEXAMPLE_CONFIG_DIR=\""$(exampledir)"\" \ -DMODULEDIR=\""$(moduledir)"\" \ diff --git a/src/doveadm/doveadm-instance.c b/src/doveadm/doveadm-instance.c --- a/src/doveadm/doveadm-instance.c +++ b/src/doveadm/doveadm-instance.c @@ -48,7 +48,7 @@ struct master_instance_list *list; struct master_instance_list_iter *iter; const struct master_instance *inst; - const char *pidfile_path; + const char *instance_path, *pidfile_path; bool show_config = FALSE; int c; @@ -71,7 +71,8 @@ doveadm_print_header_simple("running"); } - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(doveadm_settings->state_dir, "/instances", NULL); + list = master_instance_list_init(instance_path); iter = master_instance_list_iterate_init(list); while ((inst = master_instance_iterate_list_next(iter)) != NULL) { if (argv[0] != NULL && strcmp(argv[0], inst->name) != 0) @@ -99,13 +100,14 @@ { struct master_instance_list *list; const struct master_instance *inst; - const char *base_dir; + const char *base_dir, *instance_path; int ret; if (argc != 2) instance_cmd_help(cmd_instance_remove); - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(doveadm_settings->state_dir, "/instances", NULL); + list = master_instance_list_init(instance_path); inst = master_instance_list_find_by_name(list, argv[1]); base_dir = inst != NULL ? inst->base_dir : argv[1]; if ((ret = master_instance_list_remove(list, base_dir)) < 0) { diff --git a/src/doveadm/doveadm-mount.c b/src/doveadm/doveadm-mount.c --- a/src/doveadm/doveadm-mount.c +++ b/src/doveadm/doveadm-mount.c @@ -13,7 +13,8 @@ { const char *perm_path, *state_path; - perm_path = t_strconcat(PKG_STATEDIR"/"MOUNTPOINT_LIST_FNAME, NULL); + perm_path = t_strconcat(doveadm_settings->state_dir, + "/"MOUNTPOINT_LIST_FNAME, NULL); state_path = t_strconcat(doveadm_settings->base_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); return mountpoint_list_init(perm_path, state_path); diff --git a/src/doveadm/doveadm-settings.c b/src/doveadm/doveadm-settings.c --- a/src/doveadm/doveadm-settings.c +++ b/src/doveadm/doveadm-settings.c @@ -53,6 +53,7 @@ static const struct setting_define doveadm_setting_defines[] = { DEF(SET_STR, base_dir), + DEF(SET_STR, state_dir), DEF(SET_STR, mail_plugins), DEF(SET_STR, mail_plugin_dir), DEF(SET_STR, doveadm_socket_path), @@ -70,6 +71,7 @@ const struct doveadm_settings doveadm_default_settings = { .base_dir = PKG_RUNDIR, + .state_dir = PKG_STATEDIR, .mail_plugins = "", .mail_plugin_dir = MODULEDIR, .doveadm_socket_path = "doveadm-server", diff --git a/src/doveadm/doveadm-settings.h b/src/doveadm/doveadm-settings.h --- a/src/doveadm/doveadm-settings.h +++ b/src/doveadm/doveadm-settings.h @@ -3,6 +3,7 @@ struct doveadm_settings { const char *base_dir; + const char *state_dir; const char *mail_plugins; const char *mail_plugin_dir; const char *doveadm_socket_path; diff --git a/src/lib-master/master-instance.h b/src/lib-master/master-instance.h --- a/src/lib-master/master-instance.h +++ b/src/lib-master/master-instance.h @@ -1,8 +1,6 @@ #ifndef MASTER_INSTANCE_H #define MASTER_INSTANCE_H -#define MASTER_INSTANCE_PATH PKG_STATEDIR"/instances" - struct master_instance_list; struct master_instance { diff --git a/src/lib-master/master-service-settings.c b/src/lib-master/master-service-settings.c --- a/src/lib-master/master-service-settings.c +++ b/src/lib-master/master-service-settings.c @@ -33,6 +33,7 @@ master_service_settings_check(void *_set, pool_t pool, const char **error_r); static const struct setting_define master_service_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_STR, log_path), DEF(SET_STR, info_log_path), DEF(SET_STR, debug_log_path), @@ -47,6 +48,7 @@ }; static const struct master_service_settings master_service_default_settings = { + .state_dir = PKG_STATEDIR, .log_path = "syslog", .info_log_path = "", .debug_log_path = "", diff --git a/src/lib-master/master-service-settings.h b/src/lib-master/master-service-settings.h --- a/src/lib-master/master-service-settings.h +++ b/src/lib-master/master-service-settings.h @@ -7,6 +7,7 @@ struct master_service; struct master_service_settings { + const char *state_dir; const char *log_path; const char *info_log_path; const char *debug_log_path; diff --git a/src/lib-master/master-service.c b/src/lib-master/master-service.c --- a/src/lib-master/master-service.c +++ b/src/lib-master/master-service.c @@ -332,9 +332,11 @@ { struct master_instance_list *list; const struct master_instance *inst; - const char *path; + const char *instance_path, *path; - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(master_service->set->state_dir, + "/instances", NULL); + list = master_instance_list_init(instance_path); inst = master_instance_list_find_by_name(list, name); if (inst != NULL) { path = t_strdup_printf("%s/dovecot.conf", inst->base_dir); diff --git a/src/login-common/ssl-proxy-openssl.c b/src/login-common/ssl-proxy-openssl.c --- a/src/login-common/ssl-proxy-openssl.c +++ b/src/login-common/ssl-proxy-openssl.c @@ -152,8 +152,7 @@ static void ssl_params_corrupted(void) { - i_fatal("Corrupted SSL parameters file: " - PKG_STATEDIR"/ssl-parameters.dat"); + i_fatal("Corrupted SSL parameters file: ssl-parameters.dat"); } static void read_next(struct ssl_parameters *params, void *data, size_t size) diff --git a/src/master/main.c b/src/master/main.c --- a/src/master/main.c +++ b/src/master/main.c @@ -311,7 +311,7 @@ struct mountpoint_list *mountpoints; const char *perm_path, *state_path; - perm_path = t_strconcat(PKG_STATEDIR"/"MOUNTPOINT_LIST_FNAME, NULL); + perm_path = t_strconcat(set->state_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); state_path = t_strconcat(set->base_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); mountpoints = mountpoint_list_init(perm_path, state_path); @@ -340,9 +340,12 @@ instance_update_now, list); } -static void instance_update(void) +static void instance_update(const struct master_settings *set) { - instances = master_instance_list_init(MASTER_INSTANCE_PATH); + const char *path; + + path = t_strconcat(set->state_dir, "/instances", NULL); + instances = master_instance_list_init(path); instance_update_now(instances); } @@ -538,7 +541,7 @@ create_pid_file(pidfile_path); create_config_symlink(set); mountpoints_update(set); - instance_update(); + instance_update(set); services_monitor_start(services); } diff --git a/src/master/master-settings.c b/src/master/master-settings.c --- a/src/master/master-settings.c +++ b/src/master/master-settings.c @@ -171,6 +171,7 @@ static const struct setting_define master_setting_defines[] = { DEF(SET_STR, base_dir), + DEF(SET_STR, state_dir), DEF(SET_STR, libexec_dir), DEF(SET_STR, instance_name), DEF(SET_STR, import_environment), @@ -211,6 +212,7 @@ static const struct master_settings master_default_settings = { .base_dir = PKG_RUNDIR, + .state_dir = PKG_STATEDIR, .libexec_dir = PKG_LIBEXECDIR, .instance_name = PACKAGE, .import_environment = "TZ" ENV_SYSTEMD ENV_GDB, @@ -737,8 +739,8 @@ } /* Make sure our permanent state directory exists */ - if (mkdir_parents(PKG_STATEDIR, 0750) < 0 && errno != EEXIST) { - i_error("mkdir(%s) failed: %m", PKG_STATEDIR); + if (mkdir_parents(set->state_dir, 0750) < 0 && errno != EEXIST) { + i_error("mkdir(%s) failed: %m", set->state_dir); return FALSE; } diff --git a/src/master/master-settings.h b/src/master/master-settings.h --- a/src/master/master-settings.h +++ b/src/master/master-settings.h @@ -5,6 +5,7 @@ struct master_settings { const char *base_dir; + const char *state_dir; const char *libexec_dir; const char *instance_name; const char *import_environment; diff --git a/src/replication/replicator/replicator-settings.c b/src/replication/replicator/replicator-settings.c --- a/src/replication/replicator/replicator-settings.c +++ b/src/replication/replicator/replicator-settings.c @@ -49,6 +49,7 @@ { type, #name, offsetof(struct replicator_settings, name), NULL } static const struct setting_define replicator_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_STR, auth_socket_path), DEF(SET_STR, doveadm_socket_path), @@ -59,6 +60,7 @@ }; const struct replicator_settings replicator_default_settings = { + .state_dir = PKG_STATEDIR, .auth_socket_path = "auth-userdb", .doveadm_socket_path = "doveadm-server", diff --git a/src/replication/replicator/replicator-settings.h b/src/replication/replicator/replicator-settings.h --- a/src/replication/replicator/replicator-settings.h +++ b/src/replication/replicator/replicator-settings.h @@ -2,6 +2,7 @@ #define REPLICATOR_SETTINGS_H struct replicator_settings { + const char *state_dir; const char *auth_socket_path; const char *doveadm_socket_path; diff --git a/src/replication/replicator/replicator.c b/src/replication/replicator/replicator.c --- a/src/replication/replicator/replicator.c +++ b/src/replication/replicator/replicator.c @@ -13,7 +13,6 @@ #define REPLICATOR_AUTH_SERVICE_NAME "replicator" #define REPLICATOR_DB_DUMP_INTERVAL_MSECS (1000*60*15) -#define REPLICATOR_DB_PATH PKG_STATEDIR"/replicator.db" static struct replicator_queue *queue; static struct replicator_brain *brain; @@ -32,7 +31,7 @@ struct auth_master_user_list_ctx *ctx; struct auth_user_info user_info; struct replicator_user *user; - const char *username; + const char *db_path, *username; auth_conn = auth_master_init(set->auth_socket_path, AUTH_MASTER_FLAG_NO_IDLE_TIMEOUT); @@ -53,12 +52,16 @@ auth_master_deinit(&auth_conn); /* add updates from replicator db, if it exists */ - (void)replicator_queue_import(queue, REPLICATOR_DB_PATH); + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_import(queue, db_path); } static void replicator_dump_timeout(void *context ATTR_UNUSED) { - (void)replicator_queue_export(queue, REPLICATOR_DB_PATH); + const char *db_path; + + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_export(queue, db_path); } static void main_init(void) @@ -77,10 +80,13 @@ static void main_deinit(void) { + const char *db_path; + notify_connections_destroy_all(); replicator_brain_deinit(&brain); timeout_remove(&to_dump); - (void)replicator_queue_export(queue, REPLICATOR_DB_PATH); + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_export(queue, db_path); replicator_queue_deinit(&queue); } diff --git a/src/ssl-params/main.c b/src/ssl-params/main.c --- a/src/ssl-params/main.c +++ b/src/ssl-params/main.c @@ -112,11 +112,12 @@ static void main_init(const struct ssl_params_settings *set) { + const char *filename; lib_signals_set_handler(SIGCHLD, LIBSIG_FLAGS_SAFE, sig_chld, NULL); ssl_params = buffer_create_dynamic(default_pool, 1024); - param = ssl_params_init(PKG_STATEDIR"/"SSL_BUILD_PARAM_FNAME, - ssl_params_callback, set); + filename = t_strconcat(set->state_dir, "/"SSL_BUILD_PARAM_FNAME, NULL); + param = ssl_params_init(filename, ssl_params_callback, set); } static void main_deinit(void) diff --git a/src/ssl-params/ssl-params-settings.c b/src/ssl-params/ssl-params-settings.c --- a/src/ssl-params/ssl-params-settings.c +++ b/src/ssl-params/ssl-params-settings.c @@ -58,12 +58,14 @@ { type, #name, offsetof(struct ssl_params_settings, name), NULL } static const struct setting_define ssl_params_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_TIME, ssl_parameters_regenerate), SETTING_DEFINE_LIST_END }; static const struct ssl_params_settings ssl_params_default_settings = { + .state_dir = PKG_STATEDIR, .ssl_parameters_regenerate = 3600*24*7 }; diff --git a/src/ssl-params/ssl-params-settings.h b/src/ssl-params/ssl-params-settings.h --- a/src/ssl-params/ssl-params-settings.h +++ b/src/ssl-params/ssl-params-settings.h @@ -4,6 +4,7 @@ struct master_service; struct ssl_params_settings { + const char *state_dir; unsigned int ssl_parameters_regenerate; }; From chris at arachsys.com Mon Aug 13 19:14:25 2012 From: chris at arachsys.com (Chris Webb) Date: Mon, 13 Aug 2012 17:14:25 +0100 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting In-Reply-To: <20120813161251.GB14149@arachsys.com> References: <20120813161251.GB14149@arachsys.com> Message-ID: <20120813161425.GC14149@arachsys.com> Chris Webb writes: > Sharing an installed copy of dovecot between several users each running > a daemon within their own account (or using the same binaries for a > system daemon and a user daemon) is difficult because the compile-time > directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the > location of things like the ssl-parameters.dat file and the replicator > database. > > Replace all these uses of PKG_STATEDIR with a state_dir setting which > defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the > same way base_dir can be used to override PKG_RUNDIR. A little background to this patch: I run a shell account box on which a number of users want to do customized things with their own IMAP servers, and they previously ran their own copy of Dovecot 1.0, using the system installed copy of dovecot but with their own dovecot.conf overrode base_dir, used passwd-file, etc. I've been looking at upgrading this machine, and encouraging SSL imap at the same point, but replicating these users' setups with Dovecot 2.1.9 was harder than I expected because of hard-coded references to /var/lib/dovecot that their config files couldn't override. This patch fixes that problem: they just create a ~/dovecot/dovecot.conf with something like base_dir = /home/foo/dovecot/run state_dir = /home/foo/dovecot/state [...] run dovecot -c ~/dovecot/dovecot.conf as they did before, and they're away with a completely self-contained IMAP server without having to compile a complete separate copy of Dovecot each. Best wishes, Chris. From jtam.home at gmail.com Tue Aug 14 01:39:06 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 13 Aug 2012 15:39:06 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: References: Message-ID: writes: > where do i have to locate the passwd-file in dovecot2 For what purpose? Master user? Password/user lookup? passdb { driver = passwd-file master = yes args = /anywhere/you/want/master-users pass = yes } passdb { driver = passwd-file args = /anywhere/you/want/passwd } userdb { driver = passwd-file args = /anywhere/you/want/passwd } Joseph Tam From bmalik at ihlas.net.tr Tue Aug 14 09:11:00 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 23:11:00 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: References: <1344636852567-5993.post@n4.nabble.com> Message-ID: <1344924660889-37062.post@n4.nabble.com> My purpose is to restrict a particular email address 's reach for dovecot services such as pop3/imap. how can i restrict a particular email address by tcp port ? I want a particular mail address to be forced to use pop3s/imaps. I use vpopmail / dovecot2. How can i do a script for that ? cat auth-vpopmail.conf.ext passdb { driver = vpopmail args = webmail=127.0.0.1 } userdb { driver = vpopmail args = quota_template=quota_rule=*:backend=%q } -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37062.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Tue Aug 14 09:15:19 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 09:15:19 +0300 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344924660889-37062.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> Message-ID: <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> On 14.8.2012, at 9.11, bmalik wrote: > how can i restrict a particular email address by tcp port ? > I want a particular mail address to be forced to use pop3s/imaps. > I use vpopmail / dovecot2. > How can i do a script for that ? > > userdb { > driver = vpopmail > args = quota_template=quota_rule=*:backend=%q args = secured=%c quota... In post-login script see if $SECURED = secured. From bmalik at ihlas.net.tr Tue Aug 14 09:26:04 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 23:26:04 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> Message-ID: <1344925564701-37064.post@n4.nabble.com> But I 'll do that for only some email addresses. How can i do that ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37064.html Sent from the Dovecot mailing list archive at Nabble.com. From koshikov at gmail.com Tue Aug 14 09:49:38 2012 From: koshikov at gmail.com (Nikita Koshikov) Date: Tue, 14 Aug 2012 09:49:38 +0300 Subject: [Dovecot] Libdovecot-sieve segfaults Message-ID: <20120814094938.6977cc9d@jimbo> Hello Stephan, Preface - one of my users went to vacation and changed his sieve script to run autoreply vacation message, after that - I have noticed some annoying errors in system log, like: dovecot-lda[2400]: segfault at 3eb3333f ip b7446c7a sp bfaab050 error 4 in libdovecot-sieve.so.0.0.0[b7429000+5b000] Dovecot-error log is empty, but in exim log(exim runs dovecot-lda) I got: 2012-08-13 09:35:27 1T0oFK-0000aW-6j ** sr at domain.com (sr at domain.com, root at domain.com) F=<59942270813 at mymail.in.ua> R=ldap_accept T=local_delivery: Child process of local_delivery transport (running command "/usr/libexec/dovecot/dovecot-lda -e -d $local_part@$domain") was terminated by signal 11 (Segmentation fault) sr at domain.com - is the user, who created such sieve-script, which cause segfaults. I have tried run the same message over this script from sieve-test utility - but result is success. Can you please, take a look to this sieve script and check is it ok, I'll send it to you privately since it contains user's data. Also I'll attach message.eml which triggers segfault. Dovecot version - 2.0.21, Sieve version - 0.2.6. Relevant to sieve dovecot config section: plugin { sieve = ~/.dovecot.sieve sieve_after = /etc/dovecot/sieve/default-after.sieve sieve_dir = ~/sieve sieve_extensions = +notify +spamtest sieve_spamtest_max_value = 10 sieve_spamtest_status_header = X-Spam-Scan-Score sieve_spamtest_status_type = score } Hope you'll help. From lists at wildgooses.com Tue Aug 14 10:47:42 2012 From: lists at wildgooses.com (Ed W) Date: Tue, 14 Aug 2012 08:47:42 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <20120813182736.GB11223@state-of-mind.de> References: <1344861658.13571.10.camel@hurina> <20120813182736.GB11223@state-of-mind.de> Message-ID: <502A029E.9000309@wildgooses.com> On 13/08/2012 19:27, Patrick Ben Koetter wrote: > * Timo Sirainen : >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: >> >> * It could support BURL command and other extensions required by >> LEMONADE. The real SMTP server would see only regular DATA commands. >> * Would make SMTP AUTH easy to implement regardless of what the real >> SMTP server is. > Nice move! Especially since I recall Wietse being not very inclined to > implement anything alike. > Annoyingly Apple implemented burl for postfix, submitted the patch, but Wietse declined it (for reasons I would need to remind myself of - I think some implementation concerns, but mainly "who is using it, lets see the clients first") I would also be very interested to see BURL support appear. It appears to offer bandwidth reductions (my customers are all on slow dialup links), and at least some apple clients (IOS?) support it Cheers Ed W From lists at wildgooses.com Tue Aug 14 11:04:22 2012 From: lists at wildgooses.com (Ed W) Date: Tue, 14 Aug 2012 09:04:22 +0100 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> Message-ID: <502A0686.30309@wildgooses.com> On 10/08/2012 10:25, Timo Sirainen wrote: >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? > Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. The battery consumption problem seems common, but understanding of it is poor... The situation is simply: - Waking up a 3G radio is expensive on power - So prefer to do it less frequently and do a chunk of stuff, rather than doing a small amount of data quite frequently - Every 30 mins is only 48 times a day. Every 15 seconds is massively more - Different 3G networks have different parameters set which will dramatically affect battery life. ie they wait longer/shorter before allowing the radio to go idle once woken up. I don't know a good online resource to see these settings, my old Nokia had a utility to investigate things... - Firewalls impose challenges on being silent for 30 mins at a time and may drop any NAT mappings - The 3G network will almost certainly have a NAT in the way which guarantees you have a (probably very short) NAT timeout (perhaps 10 mins or perhaps less) - Then there is tcp keepalive. Does Dovecot enable these? (Sorry, I should look in the code...). However, applications which enable it (eg optional in SSH) will trigger a default (I think) 75 second network packet As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? But of course if your emails turn up every few seconds, then you will be triggering wakeups every few seconds also. I think if you tune things with that in mind, it's very possible to get very low battery usage. Using tcpdump on your mobile client to help tune things is a great help. Basically every stray packet is a killer for battery, hunt them down. Cheers Ed W From tss at iki.fi Tue Aug 14 11:18:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 11:18:18 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <502A0686.30309@wildgooses.com> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: On 14.8.2012, at 11.04, Ed W wrote: > - Then there is tcp keepalive. Does Dovecot enable these? (Sorry, I should look in the code...). Yes. > However, applications which enable it (eg optional in SSH) will trigger a default (I think) 75 second network packet It's something like 2 hours by default in Linux. > As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) > But of course if your emails turn up every few seconds, then you will be triggering wakeups every few seconds also. Maybe Dovecot could make this somehow smarter some day.. Or create a plugin that allows that. From ngoonee.talk at gmail.com Tue Aug 14 11:41:15 2012 From: ngoonee.talk at gmail.com (Oon-Ee Ng) Date: Tue, 14 Aug 2012 16:41:15 +0800 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: On Tue, Aug 14, 2012 at 4:18 PM, Timo Sirainen wrote: > Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) I for one welcome our new Dovecot overlords Sorry for the noise. From andre.groebe at fun.de Tue Aug 14 13:07:59 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 14 Aug 2012 12:07:59 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225C7F.2070300@fun.de> References: <50225A24.4010109@fun.de> <50225C7F.2070300@fun.de> Message-ID: <502A237F.4060308@fun.de> On reading 'big' metadata entries i got a similiar behaviour (metadata_maxsize = 10240). The command getmetadata returns no data. I have created a dovecot.dict with a single entry (key=priv/mailbox/fba9aa2cf41721501f340000d6254462/private/vendor/test/10458d10cf1f2a5023750000d6254462/2) to reproduce that. I expected to get the value with command: . getmetadata inbox /private/vendor/test/10458d10cf1f2a5023750000d6254462/2 . OK Completed. It seems to me that there is a bug in metadata plugin. Anyone any ideas? TIA Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot.dict.bz2 Type: application/x-bzip Size: 7405 bytes Desc: not available URL: From klimenko.n at theitidea.ru Tue Aug 14 15:23:55 2012 From: klimenko.n at theitidea.ru (=?UTF-8?B?0J3QuNC60L7Qu9Cw0Lkg0JrQu9C40LzQtdC90LrQvg==?=) Date: Tue, 14 Aug 2012 16:23:55 +0400 Subject: [Dovecot] vacation and field FROM Message-ID: <502A435B.7090909@theitidea.ru> Hi to all Here is the following scheme: Dovecot in a link with AD. For LDA and IMAP different views are used in a base. For example there is a user with such e-mail type - 1.name at domain.ltd with the name of authorization auth_1.name. Incoming male folds up in /var/mail/domain/auth_1.name When vacation is on, the letters from 1.name at domain.ltd are sent in a following way auth_1.name at domain.ltd I guess the problem is in two different data-base queries. Could you please tell me how to solve this problem and to make the answer to be sent from the same adress it is comes to. part of dovecot.conf protocol lda { mail_plugins = sieve acl hostname = domain.ltd postmaster_address = auth_socket_path = /var/run/dovecot/auth-master_lda log_path = /var/log/dovecot-deliver.log } auth default { verbose = no debug = no debug_passwords = no mechanisms = plain user = dovecot passdb passwd-file { args = /etc/dovecot/passwd.masterusers master = yes } passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb static { args = uid=20000 gid=20000 home=/opt/mail/user_mailbox/%Lu allow_all_users=yes } socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = vmail } client { path = /var/spool/postfix/private/dovecot-auth mode = 0660 user = postfix group = postfix } } } auth auth_lda { verbose = no debug = no debug_passwords = no mechanisms = plain user = dovecot passdb ldap { args = /etc/dovecot/dovecot-ldap_lda.conf } userdb ldap { args = /etc/dovecot/dovecot-ldap_lda.conf } socket listen { master { path = /var/run/dovecot/auth-master_lda mode = 0660 user = vmail group = vmail } part of dovecot-ldap.conf (filter options) pass_attrs = sAMAccountName=user pass_filter = (&(sAMAccountName=%u)(objectClass=user)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) part of dovecot-ldap_lda.conf user_attrs = sAMAccountName=user user_filter = (mail=%u) pass_attrs = sAMAccountName=user pass_filter = (mail=%u) -- From ncjeffgus at zimage.com Tue Aug 14 23:01:58 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 13:01:58 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <1344974518.25701.6.camel@maclinux> I ran a rsync on the mailboxes that I was having issues with. I re-ran rsync until I had a full sync with no further updates. Then I ran a dsync. dsync was able to run without issue. If I wipe out the target directory and re-run dsync, I'm back to dsync getting stuck. Running rsync on mdbox files is not optimal. What else can I do to track down the issue? I've contacted Timo's company about payed support so we can get a fix for this issue. I hope to hear from them soon. ...Jeff From tss at iki.fi Tue Aug 14 23:23:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 23:23:39 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> On 11.8.2012, at 0.54, Jeff Gustafson wrote: > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > problem with both versions. > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > list of boxes every time we use 'dsync backup' to backup the server. > dsync seems to stop communicating to the backup box (over ssh). strace > just shows it sitting at a epoll_wait. So you can easily reproduce this by running dsync for a specific user? > Once the program quits (times > out?), a 'du' shows the destination is smaller (200kbyte in one case). As in, some of the mails didn't get synced? (doveadm fetch could be used to do a better comparison, file sizes don't necessarily mean anything.) > Has anyone else seen an exit code of 75? Nothing in the documentation > mentions what exit code 75 could mean. "temporary failure". > What can I do to help the developers locate the bug? Those hangs are a little bit annoying to debug, and the whole code has been rewritten for v2.2 already in a way that should make the hangs pretty much impossible. Annoyingly v2.2 isn't ready yet.. From bmalik at ihlas.net.tr Wed Aug 15 01:01:40 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Tue, 14 Aug 2012 15:01:40 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <1344981700620-37074.post@n4.nabble.com> is there a solution ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37074.html Sent from the Dovecot mailing list archive at Nabble.com. From durket at highwire.stanford.edu Wed Aug 15 01:12:59 2012 From: durket at highwire.stanford.edu (Michael Durket) Date: Tue, 14 Aug 2012 15:12:59 -0700 Subject: [Dovecot] Listen on multiple ports possible using same protocol? Message-ID: Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: protocol imap { listen = *:143 listen = *:10143 ssl_listen = *:993 ssl_listen = *:10993 for example. Or is this more preferably done by pointing dovecot at different configuration files? From ncjeffgus at zimage.com Wed Aug 15 01:33:47 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 15:33:47 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> Message-ID: <1344983627.25701.10.camel@maclinux> On Tue, 2012-08-14 at 23:23 +0300, Timo Sirainen wrote: > On 11.8.2012, at 0.54, Jeff Gustafson wrote: > > > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > > problem with both versions. > > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > > list of boxes every time we use 'dsync backup' to backup the server. > > dsync seems to stop communicating to the backup box (over ssh). strace > > just shows it sitting at a epoll_wait. > > So you can easily reproduce this by running dsync for a specific user? Yes. There is a subset of mailboxes that always time out. > > Once the program quits (times > > out?), a 'du' shows the destination is smaller (200kbyte in one case). > > As in, some of the mails didn't get synced? (doveadm fetch could be > used to do a better comparison, file sizes don't necessarily mean > anything.) True, I will dump out the mailboxes and see if it truly was incomplete. > Those hangs are a little bit annoying to debug, and the whole code has > been rewritten for v2.2 already in a way that should make the hangs > pretty much impossible. Annoyingly v2.2 isn't ready yet.. I have found a manual work around. I use rsync to get the files over to the backup machines, then I let the backup script keep things up to date. It is not the best way to go, but at least I have backups. I suppose I can check the log and continue to rsync things over until 2.2 comes out. ...Jeff From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 15 02:04:03 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 15 Aug 2012 01:04:03 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344925564701-37064.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> <1344925564701-37064.post@n4.nabble.com> Message-ID: <20120814230403.GA11246@daniel.localdomain> bmalik wrote: > But I 'll do that for only some email addresses. I assume that by "email addresses" you mean "user names". > How can i do that ? The $SECURED variable contains "secured" if a user tries to log in via SSL/TLS, so if an insecure connection is found, the script should check whether the user is in the list if users which are forced to use encryption: ############################################################################## if [ "$SECURED" == "secure" ] then :# handle secure connections here else :# handle insecure connections here if grep -q "$USER" in /etc/users-with-forced-encryption then printf "* NO [ALERT] You are not allowed to connect without encryption\r\n" exit 0 fi fi ############################################################################## Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Wed Aug 15 02:56:10 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Tue, 14 Aug 2012 18:56:10 -0500 Subject: [Dovecot] Listen on multiple ports possible using same protocol? In-Reply-To: References: Message-ID: <502AE59A.2040504@hardwarefreak.com> On 8/14/2012 5:12 PM, Michael Durket wrote: > Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: > > protocol imap { > listen = *:143 > listen = *:10143 > ssl_listen = *:993 > ssl_listen = *:10993 > > > for example. Or is this more preferably done by pointing dovecot at different configuration files? Did you test it? -- Stan From ncjeffgus at zimage.com Wed Aug 15 05:41:58 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 19:41:58 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> Message-ID: <1344998518.25701.13.camel@maclinux> On Tue, 2012-08-14 at 23:23 +0300, Timo Sirainen wrote: > On 11.8.2012, at 0.54, Jeff Gustafson wrote: > > What can I do to help the developers locate the bug? > > Those hangs are a little bit annoying to debug, and the whole code has > been rewritten for v2.2 already in a way that should make the hangs > pretty much impossible. Annoyingly v2.2 isn't ready yet.. I have an issue related to this problem. dsync returns an error 75 when it detects the source mailbox is empty (client probably pop3'd all of their email). It also returns an error 75 when I get the timeout error. For not I am parsing the error to find out which is which and act accordingly. It would be much nicer if dsync returned a different error code for empty source mailboxes. ...Jeff From bmalik at ihlas.net.tr Wed Aug 15 09:24:59 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Tue, 14 Aug 2012 23:24:59 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120814230403.GA11246@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> <1344925564701-37064.post@n4.nabble.com> <20120814230403.GA11246@daniel.localdomain> Message-ID: <1345011899792-37080.post@n4.nabble.com> Thanks a lot. the script you gave works . -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37080.html Sent from the Dovecot mailing list archive at Nabble.com. From cpservicespb at gmail.com Wed Aug 15 09:51:09 2012 From: cpservicespb at gmail.com (CpServiceSPb) Date: Wed, 15 Aug 2012 10:51:09 +0400 Subject: [Dovecot] Thread sorting problem Message-ID: Hi. How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later cost ? Artyom. From tss at iki.fi Wed Aug 15 12:27:27 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:27:27 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344998518.25701.13.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> Message-ID: <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> On 15.8.2012, at 5.41, Jeff Gustafson wrote: > I have an issue related to this problem. dsync returns an error 75 when > it detects the source mailbox is empty (client probably pop3'd all of > their email). It also returns an error 75 when I get the timeout error. You mean this? dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run backup in wrong direction. Source is empty and destination is not. Maybe it needs a force setting, or change the detection somehow.. From tss at iki.fi Wed Aug 15 12:28:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:28:45 +0300 Subject: [Dovecot] Listen on multiple ports possible using same protocol? In-Reply-To: References: Message-ID: On 15.8.2012, at 1.12, Michael Durket wrote: > Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: > > protocol imap { > listen = *:143 > listen = *:10143 I think this works: listen = *:143, *:10143 I think dovecot-example.conf says something about it. From tss at iki.fi Wed Aug 15 12:30:33 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:30:33 +0300 Subject: [Dovecot] Thread sorting problem In-Reply-To: References: Message-ID: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> On 15.8.2012, at 9.51, CpServiceSPb wrote: > How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later > cost ? What do you need it for? There is THREAD=REFERENCES that is superior to it in most situations. From svoop at delirium.ch Wed Aug 15 13:14:39 2012 From: svoop at delirium.ch (Sven Schwyn) Date: Wed, 15 Aug 2012 12:14:39 +0200 Subject: [Dovecot] bcrypt again Message-ID: Hi I'd like Dovecot to consume a list of users exported from an external application which stores bcrypted passwords. This has been asked in the past, however, I'm not sure how to read the following reply: > If you are using Dovecot< 2.0 you can also use any of the algorithms > supported by your system's libc. But then you have to prefix the hashes > with {CRYPT} - not {{BLF,SHA256,SHA512}-CRYPT}. I'm on Dovecot 2.0.19. Does this mean that only the hashes listed with "doveadm pw -l" are supported and even if glibc can do bcrypt, the CRYPT scheme won't do the trick anymore? Thanks for your help! From tss at iki.fi Wed Aug 15 13:43:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 13:43:40 +0300 Subject: [Dovecot] Thread sorting problem In-Reply-To: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> References: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> Message-ID: <85B6A78B-DFB4-4775-A212-0530669DA84E@iki.fi> On 15.8.2012, at 12.30, Timo Sirainen wrote: > On 15.8.2012, at 9.51, CpServiceSPb wrote: > >> How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later >> cost ? > > What do you need it for? There is THREAD=REFERENCES that is superior to it in most situations. Well, anyway, here you go: http://hg.dovecot.org/dovecot-2.1/rev/670f467ff5c5 From tss at iki.fi Wed Aug 15 13:54:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 13:54:03 +0300 Subject: [Dovecot] bcrypt again In-Reply-To: References: Message-ID: <6750912E-4BBE-490E-9BAE-429468C20B7F@iki.fi> On 15.8.2012, at 13.14, Sven Schwyn wrote: > I'd like Dovecot to consume a list of users exported from an external application which stores bcrypted passwords. > > This has been asked in the past, however, I'm not sure how to read the following reply: > >> If you are using Dovecot< 2.0 you can also use any of the algorithms >> supported by your system's libc. But then you have to prefix the hashes >> with {CRYPT} - not {{BLF,SHA256,SHA512}-CRYPT}. > > I'm on Dovecot 2.0.19. Does this mean that only the hashes listed with "doveadm pw -l" are supported and even if glibc can do bcrypt, the CRYPT scheme won't do the trick anymore? {CRYPT} means that the password is put through libc's crypt() function. If your libc's crypt() supports bcrypt, then Dovecot supports bcrypt. I don't know why (whoever) said "<2.0". From ncjeffgus at zimage.com Wed Aug 15 22:23:34 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Wed, 15 Aug 2012 12:23:34 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> Message-ID: <1345058614.25701.20.camel@maclinux> On Wed, 2012-08-15 at 12:27 +0300, Timo Sirainen wrote: > On 15.8.2012, at 5.41, Jeff Gustafson wrote: > > > I have an issue related to this problem. dsync returns an error 75 when > > it detects the source mailbox is empty (client probably pop3'd all of > > their email). It also returns an error 75 when I get the timeout error. > > You mean this? > > dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run > backup in wrong direction. Source is empty and destination is not. That's the one! > Maybe it needs a force setting, or change the detection somehow.. That would be nice. A backup script is executing the command, so it should never do it in the wrong direction. A force setting might be the simplest way to go. ...Jeff From listas at adminlinux.com.br Wed Aug 15 23:01:16 2012 From: listas at adminlinux.com.br (3.listas@adminlinux.com.br) Date: Wed, 15 Aug 2012 17:01:16 -0300 Subject: [Dovecot] Mdbox corruption Message-ID: <502C000C.9060206@adminlinux.com.br> Hi, I have a "ubuntu10.04 + ext4-filesystem + dovecot-2.0.13 +mdbox" configuration in my server. It works fine with ~50k accounts. Recently happened a filesystem corruption in a device of StMailLocation and I fix with fsck.ext4. After this crash, one account began to show access timeout and errors like this on force-resync: # doveadm force-resync -u account INBOX doveadm(account): Warning: mdbox /path-to-mdbox/storage: rebuilding indexes doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) doveadm(account): Warning: dbox: Copy of the broken file saved to /path-to-mdbox/storage/m.83.broken doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) doveadm(account): Error: mdbox rebuild: Failed to fix file /path-to-mdbox/storage/m.83 doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.92 (around offset=7): Invalid dbox version ... Should I worry about the m.X.broken files ? How I fix these broken mdboxes ? Thanks. -- Thiago Henrique adminlinux.com.br From mailadmin at cubixys.com Thu Aug 16 03:52:40 2012 From: mailadmin at cubixys.com (Fasil) Date: Thu, 16 Aug 2012 03:52:40 +0300 Subject: [Dovecot] Dovecot: pipe() failed: Too many open files Message-ID: <502C4458.8090808@cubixys.com> Dear all, Thank you all for such a wonderful support. Hats off to all :) Few times I came across imap login issues where new users will not be allowed to login. /var/log/mail.err shows the error below Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 # ulimit -Hn 1024 # ulimit -Sn 1024 # cat /proc/sys/fs/file-max 1238548 # cat /proc/`pidof dovecot`/limits | grep 'Max open' Max open files 1024 1024 files Please advice how to get rid off this. Fasil. From manu at netbsd.org Thu Aug 16 04:07:20 2012 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Thu, 16 Aug 2012 03:07:20 +0200 Subject: [Dovecot] Auth worker max line size In-Reply-To: <20090624144545.GF13977@NetBSD.org> Message-ID: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> Hi 38 month ago, I submitted a patch to increase AUTH_WORKER_MAX_LINE_LENGTH to use exotic authentication scheme (see message below). The patch was accepted, but now I upgrade to dovecot 2.1.7, I face the same problem with MASTER_AUTH_MAX_DATA_SIZE. I had to increase it from 1024 to 4096. Is it safe to do so? Would such a change be accepted upstream? The patch is below. (please Cc: me, I'm not subscribed ot the list) --- src/lib-master/master-auth.h.orig +++ src/lib-master/master-auth.h @@ -13,9 +13,9 @@ /* Authentication client process's cookie size */ #define MASTER_AUTH_COOKIE_SIZE (128/8) /* LOGIN_MAX_INBUF_SIZE should be based on this.*/ -#define MASTER_AUTH_MAX_DATA_SIZE 1024 +#define MASTER_AUTH_MAX_DATA_SIZE 4096 #define MASTER_AUTH_ERRMSG_INTERNAL_FAILURE \ "Internal error occurred. Refer to server log for more information." Emmanuel Dreyfus wrote: > Hello > > I have been playing with some exotic authentication scheme with Dovecot > and PAM. That involves sending really large base64 encoded data as > the IMAP password, and I have hit a line limit in Dovecot, with > AUTH_WORKER_MAX_LINE_LENGTH set to 1024. > > This limit is especially frustrating since other parts of the software > use much larger limits: > MAX_INBUF_SIZE 4096 > MAX_IMAP_LINE 8192 > AUTH_CLIENT_MAX_LINE_LENGTH 8192 > > I had to make the patch attached below to get my authentication working. > I can live with this local patch, but given the much more liberal limits > of MAX_INBUF_SIZE at 4096 makes we wonder if this 1024 limit on > AUTH_WORKER_MAX_LINE_LENGTH could not be a bug. Or is there a security > concern at using more than 1kB? > > Opinions? (please Cc: me, I'm not subscribed ot the list) > > --- src/auth/auth-worker-client.h.orig 2009-06-23 18:32:15.000000000 +0200 > +++ src/auth/auth-worker-client.h 2009-06-23 18:32:33.000000000 +0200 > @@ -1,8 +1,8 @@ > #ifndef AUTH_WORKER_CLIENT_H > #define AUTH_WORKER_CLIENT_H > > -#define AUTH_WORKER_MAX_LINE_LENGTH 1024 > +#define AUTH_WORKER_MAX_LINE_LENGTH 4096 > > struct auth_worker_client *auth_worker_client_create(struct auth *auth, int fd); > void auth_worker_client_destroy(struct auth_worker_client **client); > void auth_worker_client_unref(struct auth_worker_client **client); -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From f.bonnet at esiee.fr Thu Aug 16 09:17:14 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Thu, 16 Aug 2012 08:17:14 +0200 Subject: [Dovecot] Dovecot: pipe() failed: Too many open files In-Reply-To: <502C4458.8090808@cubixys.com> References: <502C4458.8090808@cubixys.com> Message-ID: <5B19308C-D60C-4CBD-9CD2-519C98DFCC5B@esiee.fr> hello here some useful informations http://posidev.com/blog/2009/06/04/set-ulimit-parameters-on-ubuntu/ Envoy? de mon iPhone. Le 16 ao?t 2012 ? 02:52, Fasil a ?crit : > Dear all, > > Thank you all for such a wonderful support. Hats off to all :) > > Few times I came across imap login issues where new users will not be allowed to login. > /var/log/mail.err shows the error below > Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now > Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files > > I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 > > # ulimit -Hn > 1024 > > # ulimit -Sn > 1024 > > # cat /proc/sys/fs/file-max > 1238548 > > # cat /proc/`pidof dovecot`/limits | grep 'Max open' > Max open files 1024 1024 files > > Please advice how to get rid off this. > > Fasil. From cor at xs4all.nl Thu Aug 16 10:02:47 2012 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 16 Aug 2012 09:02:47 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <1344861658.13571.10.camel@hurina> References: <1344861658.13571.10.camel@hurina> Message-ID: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> > > I'm also considering implementing an SMTP submission server, which works > only as a proxy to the real SMTP server. The benefits of it would mainly > be: What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. Cor From lists at wildgooses.com Thu Aug 16 10:59:07 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 08:59:07 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> Message-ID: <502CA84B.6080500@wildgooses.com> On 16/08/2012 08:02, Cor Bosman wrote: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: > What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. > Postfix allows you to write policy agents very simply. I wrote a small perl utility which uses a database to count the number of emails a user has sent in the last 1 and 24 hours. Based on that we throttle users (I have some fudging for recipients per email also). If you like the idea then it's about 10 lines of perl (+ a decent chunk of boiler plate). Ed From tss at iki.fi Thu Aug 16 11:00:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:00:01 +0300 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> Message-ID: <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> On 16.8.2012, at 10.02, Cor Bosman wrote: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: > > What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) From cor at xs4all.nl Thu Aug 16 11:11:31 2012 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 16 Aug 2012 10:11:31 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> Message-ID: <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> >> What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. > > > The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) > > Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) They would indeed need to share the state, this is what the commercial system does (Cloudmark Gateway). The idea is to prevent senders to send email beyond certain limits that are configurable. Lets say, 200 emails in a minute, or 500 an hour, or whatever. Of course allowing for whitelists. With ever increasing speeds of residential connections (we have hundreds of fiber connections now, growing rapidly), these become very fast spam sources without something to keep them in check. It's easy on 1 server, not so easy if you have dozens of smtp servers. But yes, something for a distant future :) And CM has other features as well, so it may not be so easy to replace :) Cor From c at roessner-network-solutions.com Thu Aug 16 11:15:34 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 10:15:34 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Message-ID: <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> Hi, >>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>> >>>> problem >>>> >>>> I tried so, but this does not work here: >>> >>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>> >>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>> >> done >> >> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >> > I tested today with Dovecot 2.1.9. Still not getting mails imported :-( > > How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? > > Many thanks in advance sorry for bumping, but I am stuck at the moment. -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From amateo at um.es Thu Aug 16 11:20:13 2012 From: amateo at um.es (Angel L. Mateo) Date: Thu, 16 Aug 2012 10:20:13 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <502CAD3D.90004@um.es> El 01/08/12 20:10, Timo Sirainen escribi?: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > >>> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >>> >>> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >>> >>> service ipc { >>> unix_listener ipc { >>> user = dovecot >>> } >>> } >> >> Thanks, Timo. >> >> Does this apply to the mailbox config or the director config? >> Which instance needs to access the ipc socket of which instance? > > director instance needs access to director instance. > Hello, Sorry for the delay, I've been on vacation these days. I'm going to try it. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From tss at iki.fi Thu Aug 16 11:20:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:20:23 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> Message-ID: <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> On 16.8.2012, at 11.15, Christian R??ner wrote: >>>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>>> >>>>> problem >>>>> >>>>> I tried so, but this does not work here: >>>> >>>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>>> >>>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>>> >>> done >>> >>> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >>> >> I tested today with Dovecot 2.1.9. Still not getting mails imported :-( >> >> How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? >> >> Many thanks in advance > > > sorry for bumping, but I am stuck at the moment. 1) Can you read mails from the resynced mdbox? For example: doveadm -o mail=mdbox:/anothermdbox fetch uid all 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? From jeremy.jarry at admin.gmessaging.net Thu Aug 16 11:41:36 2012 From: jeremy.jarry at admin.gmessaging.net (=?iso-8859-1?B?IkpBUlJZIErpculteSI=?=) Date: Thu, 16 Aug 2012 10:41:36 +0200 Subject: [Dovecot] Postfix & Dovecot: Client certificate authentication Message-ID: <5af13c674a81dc56.502cce60@admin.gmessaging.net> Hello, I would like to set up an authentication using certificate with Dovecot: A user sends mail to Postfix and Dovecot authentication is valid only if certificate is trusted. So, I enable the parameter auth_ssl_require_client_cert in dovecot configuration but it is not running. Here are the postfix logs: Aug 16 09:51:48 myserver dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 16 09:51:48 myserver dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 16 09:51:48 myserver dovecot: auth: Debug: auth client connected (pid=6922) Aug 16 09:51:51 myserver dovecot: auth: Debug: client in: AUTH?????? 1?????? PLAIN?? service=smtp??? nologin lip=127.0.0.1?? rip=127.0.0.1?????? secured resp=xxx Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL PLAIN authentication failed: Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: PLAIN(?,127.0.0.1): Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client out: FAIL????? 1?????? reason=Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client in: AUTH?????? 2?????? LOGIN?? service=smtp??? nologin lip=127.0.0.1?? rip=127.0.0.1?????? secured Aug 16 09:51:51 myserver dovecot: auth: LOGIN(?,127.0.0.1): Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client out: FAIL????? 2?????? reason=Client didn't present valid SSL certificate Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL LOGIN authentication failed: Client didn't present valid SSL certificate It seems Postfix doesn't send the client certificat to Dovecot. What do you think ? What is wrong ? Below are some information about my configuration: OS: RHEL5 Postfix: 2.7.3 Dovecot: 2.0.14 Dovecot config: auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_ssl_require_client_cert = yes auth_ssl_username_from_cert = yes auth_verbose = yes mail_debug = yes passdb { ? args = /etc/dovecot/dovecot-ldap.conf ? driver = ldap } protocols = none service auth { ? unix_listener /data/postfix/private/auth { ??? group = postfix ??? mode = 0660 ??? user = postfix ? } ? user = root } ssl = required ssl_ca = URL: From tss at iki.fi Thu Aug 16 11:54:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:54:49 +0300 Subject: [Dovecot] Postfix & Dovecot: Client certificate authentication In-Reply-To: <5af13c674a81dc56.502cce60@admin.gmessaging.net> References: <5af13c674a81dc56.502cce60@admin.gmessaging.net> Message-ID: On 16.8.2012, at 11.41, JARRY J?r?my wrote: > I would like to set up an authentication using certificate with Dovecot: A user sends mail to Postfix and Dovecot authentication is valid only if certificate is trusted. > > So, I enable the parameter auth_ssl_require_client_cert in dovecot configuration but it is not running. Here are the postfix logs: .. > Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL LOGIN authentication failed: Client didn't present valid SSL certificate > > It seems Postfix doesn't send the client certificat to Dovecot. What do you think ? What is wrong ? Correct. Postfix doesn't send it to Dovecot, so you can't do this currently. I'm not sure if this would require about 2 lines of code or hundreds to Postfix. From lists at wildgooses.com Thu Aug 16 14:12:31 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 12:12:31 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> Message-ID: <502CD59F.9030705@wildgooses.com> On 16/08/2012 09:11, Cor Bosman wrote: >>> What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. >> >> The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) >> >> Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) > They would indeed need to share the state, this is what the commercial system does (Cloudmark Gateway). The idea is to prevent senders to send email beyond certain limits that are configurable. Lets say, 200 emails in a minute, or 500 an hour, or whatever. Of course allowing for whitelists. With ever increasing speeds of residential connections (we have hundreds of fiber connections now, growing rapidly), these become very fast spam sources without something to keep them in check. It's easy on 1 server, not so easy if you have dozens of smtp servers. > > But yes, something for a distant future :) And CM has other features as well, so it may not be so easy to replace :) > My opinion is that this is very easily to implement in at least Postfix and probably other servers, hence I would suggest this is a function for the MTA, not for the Dovecot relay? What MTA are you using? If Postfix then there are several off the shelf solutions which control sending rates. As I said in a previous email, I wanted the rate to be configurable per user, and so we store the rates in our user database. It's then fairly trivial to write a small "policy server" to enforce whatever policies you wish, eg as well as rate limiting we have some control over whether users can "forge" their FROM address, etc. This all gets implemented in a small Perl based policy server Effectively Postfix talks to a network socket for every email, passes a bunch of detail about the email and asks for a yes/no answer. Caveat the boiler plate to listen to a network socket the rest is just a couple of lines of code. Distributed, re-entrant, simple. Give it some consideration. I doubt the time to implement a complete prototype solution would be more than half a day for your IT guy and if that's attractive then perhaps you have grounds to look at replacing CM? Good luck Ed W From c at roessner-network-solutions.com Thu Aug 16 14:13:00 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 13:13:00 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> Message-ID: <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> Am 16.08.2012 um 10:20 schrieb Timo Sirainen: > On 16.8.2012, at 11.15, Christian R??ner wrote: > >>>>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>>>> >>>>>> problem >>>>>> >>>>>> I tried so, but this does not work here: >>>>> >>>>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>>>> >>>>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>>>> >>>> done >>>> >>>> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >>>> >>> I tested today with Dovecot 2.1.9. Still not getting mails imported :-( >>> >>> How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? >>> >>> Many thanks in advance >> >> >> sorry for bumping, but I am stuck at the moment. > > 1) Can you read mails from the resynced mdbox? For example: > > doveadm -o mail=mdbox:/anothermdbox fetch uid all > doveadm -o mail=mdbox:/srv/mail/foo.bar at example.com-backup fetch uid all | grep uid | wc -l 949 There seem to be mails. At least I get several lines with uid: > 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? It seems, it is just the import thing. doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(root): Debug: Effective uid=0, gid=0, home=/root doveadm(root): Debug: fs: root=/srv/mail/foo.bar at example.com-backup, index=, control=, inbox=, alt= doveadm(root): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com-backup: mode=0700 gid=-1 doveadm(foo.bar at example.com): Debug: Effective uid=5000, gid=5000, home=/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: fs: root=/srv/mail/foo.bar at example.com, index=, control=, inbox=, alt= doveadm(foo.bar at example.com): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com: mode=0700 gid=-1 Thanks in advance -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From CMarcus at Media-Brokers.com Thu Aug 16 14:24:09 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 16 Aug 2012 07:24:09 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CD59F.9030705@wildgooses.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> Message-ID: <502CD859.6030709@Media-Brokers.com> On 2012-08-16 7:12 AM, Ed W wrote: > My opinion is that this is very easily to implement in at least Postfix > and probably other servers, hence I would suggest this is a function for > the MTA, not for the Dovecot relay? Well, true enough for simpler installations, but integrating something like this in dovecot that can be applied across large dovecot director based farms might be a good thing. Actually, maybe (and maybe not, I honestly haven't thought this through at all, and this might be a really dumb idea), instead of specific support for this one feature, I wonder if it would make more sense to actually build in support for a policy server (ie, amavisd-new) like postfix has... -- Best regards, Charles From claus.rosenberger at rocnet.de Thu Aug 16 14:30:56 2012 From: claus.rosenberger at rocnet.de (Claus Rosenberger) Date: Thu, 16 Aug 2012 13:30:56 +0200 Subject: [Dovecot] Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators) In-Reply-To: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> References: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> Message-ID: <502CD9F0.1060801@rocnet.de> Could i send some more informations about this topic? I'm not sure whats happening here but i think it has something to do with the shared mailboxes. With cyrus i had following folder structure: user1 -> inbox -> subfolders -> user -> user1 -> user2 With dovecot the folder structure look like: user1 -> inbox -> subfolders -> shared -> user1 -> inbox -> user2 -> inbox is there any way to show inbox directly in user1/user2 folder without having an inbox subfolder? Am 22.07.2012 00:04, schrieb Claus Rosenberger: > Hi, > > with fetching the folder structure with the webclient Tine i can see following error messages inside of the logfiles: > > Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) > > Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x448fa) [0x7f70036db8fa] -> /usr/lib/dovecot/libdovecot.so.0(+0x44946) [0x7f70036db946] -> /usr/lib/dovecot/libdovecot.so.0(+0x1b8ca) [0x7f70036b28ca] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open_stream+0) [0x7f70039a1550] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f70039a156f] -> dovecot/imap(cmd_select_full+0x14a) [0x40db1a] -> dovecot/imap(command_exec+0x3d) [0x41160d] -> dovecot/imap() [0x41058e] -> dovecot/imap() [0x41066d] -> dovecot/imap(client_handle_input+0x135) [0x410895] -> dovecot/imap(client_input+0x5f) [0x4111bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f70036e7ea6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f70036e8f2f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f70036e7e48] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f70036d4103] -> dovecot/imap(main+0x2a5) [0x419695] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f7003353c8d] -> dovecot/imap() [0x408f49] > > Fatal: master: service(imap): child 21152 killed with signal 6 (core dumps disabled) > From lazy404 at gmail.com Thu Aug 16 14:58:35 2012 From: lazy404 at gmail.com (Lazy) Date: Thu, 16 Aug 2012 13:58:35 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: <1337453839.4384.141.camel@innu> References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: 2012/5/19 Timo Sirainen : > On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >> failed: Read-only file system > > Does the attached patch help? > >> maybe it will be easier to move all dovecot metadata to separate (non >> snapshot) location ? > > It could also be a bit problematic. At least message keywords (=custom > flags) wouldn't work because the dovecot-keywords file exists only in > the snapshot dir. Moving metadata helped, but now archived inbox is unsubscribed. Is there a way to make all folders in an namespace subscribed by default ? Regards, Michal Grzedzicki From lists at wildgooses.com Thu Aug 16 14:58:59 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 12:58:59 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CD859.6030709@Media-Brokers.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> <502CD859.6030709@Media-Brokers.com> Message-ID: <502CE083.3030103@wildgooses.com> On 16/08/2012 12:24, Charles Marcus wrote: > On 2012-08-16 7:12 AM, Ed W wrote: >> My opinion is that this is very easily to implement in at least Postfix >> and probably other servers, hence I would suggest this is a function for >> the MTA, not for the Dovecot relay? > > Well, true enough for simpler installations, but integrating something > like this in dovecot that can be applied across large dovecot director > based farms might be a good thing. > > Actually, maybe (and maybe not, I honestly haven't thought this > through at all, and this might be a really dumb idea), instead of > specific support for this one feature, I wonder if it would make more > sense to actually build in support for a policy server (ie, > amavisd-new) like postfix has... > I'm really missing the key point here? The proposal was (I think?): Have Dovecot accept emails and feed them to the MTA (eg Postfix) This means you have access to all the MTA features (hence why I was pointing out these features exist today). Further, by centralising this function you don't need to duplicate the functionality depending on whether an email was sent via Dovecot or SMTP. So I don't see that policy servers are necessary in Dovecot for this particular requirement - I think most ideas we can come up with would benefit from delegating policy to the MTA so that it's centralised? I might be missing the point, so see above for my understanding of the problem? Ed W From CMarcus at Media-Brokers.com Thu Aug 16 15:38:00 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 16 Aug 2012 08:38:00 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CE083.3030103@wildgooses.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> <502CD859.6030709@Media-Brokers.com> <502CE083.3030103@wildgooses.com> Message-ID: <502CE9A8.5060203@Media-Brokers.com> On 2012-08-16 7:58 AM, Ed W wrote: > On 16/08/2012 12:24, Charles Marcus wrote: >> Actually, maybe (and maybe not, I honestly haven't thought this >> through at all, and this might be a really dumb idea), instead of >> specific support for this one feature, I wonder if it would make more >> sense to actually build in support for a policy server (ie, >> amavisd-new) like postfix has... > I'm really missing the key point here? > > The proposal was (I think?): Have Dovecot accept emails and feed them to > the MTA (eg Postfix) > > This means you have access to all the MTA features (hence why I was > pointing out these features exist today). Further, by centralising this > function you don't need to duplicate the functionality depending on > whether an email was sent via Dovecot or SMTP. > > So I don't see that policy servers are necessary in Dovecot for this > particular requirement - I think most ideas we can come up with would > benefit from delegating policy to the MTA so that it's centralised? But doing it in dovecot would mean that it wouldn't matter what MTA you were using, or even what OS/platform said MTAs were running on, you would handle all said policies for your entire (dovecot-director) infrastructure in one place (dovecot)... Also, this would only be for *outbound* policies, so would provide a degree of separation with your *inbound* policies... which could be a good or bad thing I guess depending on your needs and requirements. Like I said, I haven't thought it completely through and it may indeed be a bad idea... -- Best regards, Charles From tomislav.mihalicek at gmail.com Thu Aug 16 16:27:52 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Thu, 16 Aug 2012 06:27:52 -0700 (PDT) Subject: [Dovecot] dovecot 2.1 Master account Error Message-ID: <1345123672440-37109.post@n4.nabble.com> HI I am running parallel dovecot 1.2 for main accounts and 2.1 for test accounts, and for some reason when i try to login with master user on dovecot 2.1 service errors. However the normal user logins and rest works flawlesly Here is the debug Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: auth client connected (pid=27557) Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=pop3#011secured#011no-penalty#011session=ZOcF2GHHdQAKVCKD#011lip=10.84.34.122#011rip=10.84.34.131#011lport=110#011rport=60021 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client out: CONT#0111#011 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client in: CONT Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: auth(migration at example.net,10.84.34.131,master,): Master user lookup for login: tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: passwd-file(migration at example.net,10.84.34.131,master,): lookup: user=migration at example.net file=/etc/dovecot/master-users Aug 16 15:15:56 mailstore-node-02 dovecot: auth: passdb(migration at example.net,10.84.34.131,master,): Master user logging in as tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): pass search: base=ou=accounts,dc=example,dc=net scope=subtree filter=(&(objectClass=mailUser)(accountService=mail)(accountService=pop3secured)(|(mail=tomislav.mihalicek at example.net)(mailAlternateAddress=tomislav.mihalicek at example.net))) fields=mail,userPassword Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): result: mail=tomislav.mihalicek at example.net userPassword= Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client out: OK#0111#011user=tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: master in: REQUEST#0113563585537#01127557#0111#0118ccf2bab093bd33a4b93958c99236471 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): user search: base=ou=accounts,dc=example,dc=net scope=subtree filter=(&(objectClass=mailUser)(accountService=mail)(accountService=pop3secured)(|(mail=tomislav.mihalicek at example.net)(mailAlternateAddress=tomislav.mihalicek at example.net))) fields=mail,homeDirectory,mailQuotaSize Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): result: mail=tomislav.mihalicek at example.net mailQuotaSize=4294967296 homeDirectory=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: master out: USER#0113563585537#011tomislav.mihalicek at example.net#011home=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek#011quota_rule=*:bytes=4294967296#011master_user=migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3-login: Login: user=, method=PLAIN, rip=10.84.34.131, lip=10.84.34.122, mpid=27558, secured, session= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_expire_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_virtual_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_stats_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Added userdb setting: plugin/master_user=migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Added userdb setting: plugin/quota_rule=*:bytes=4294967296 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Effective uid=10101, gid=10101, home=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota root: name=user backend=dict args=:proxy::quota Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota rule: root=user mailbox=* bytes=4294967296 messages=0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=4080218931 (95%) messages=0 reverse=no command=quota-warning 95 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=3650722201 (85%) messages=0 reverse=no command=quota-warning 85 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=3006477107 (70%) messages=0 reverse=no command=quota-warning 70 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: dict quota: user=tomislav.mihalicek at example.net, uri=proxy::quota, noenforcing=0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/sdbox:INDEX=~/index Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: fs: root=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox, index=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/index, control=, inbox=, alt= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: initializing backend with data: vfile:/etc/dovecot/global-acls:cache_secs=300 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: acl username = migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: owner = 0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: Global ACL directory: /etc/dovecot/global-acls Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Namespace : type=shared, prefix=X-Share/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%h/Maildir:INDEX=~/index/Shared/%u Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: shared: root=/var/run/dovecot, index=, control=, inbox=, alt= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: initializing backend with data: vfile:/etc/dovecot/global-acls:cache_secs=300 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: acl username = migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: owner = 0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: Global ACL directory: /etc/dovecot/global-acls Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /etc/dovecot/global-acls/INBOX not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /etc/dovecot/global-acls/ not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox/mailboxes/dovecot-acl not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Error: Failed to autocreate mailbox INBOX: Permission denied Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Error: Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2012-08-16 15:15:56] Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Couldn't open INBOX top=0/0, retr=0/0, del=0/0, size=0 -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-2-1-Master-account-Error-tp37109.html Sent from the Dovecot mailing list archive at Nabble.com. From merrickville at gmail.com Thu Aug 16 19:01:59 2012 From: merrickville at gmail.com (Merrickville) Date: Thu, 16 Aug 2012 09:01:59 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding Message-ID: <1345132919122-37110.post@n4.nabble.com> Trying to figure out hostname based IMAP proxy forwarding. I have two mail servers: mail.example.com mail.fakedomain.ca proxy server running dovecat/IMAPS, facing the Internet. *Both* names are DNS resolve(able), but.., both are the *same IP address.* For example: Joe configures his email client username: joe at example.com IMAP Addr: mail.example.com For example: Jane configures her email client username: jane at fakedomain.ca IMAP Addr: mail.fakedomain.ca So, now all clients must change their user-name in their email client to their full email address, because there is a Jane & Joe on "both" servers and..., dovecot proxies based on 'user name' Is there a way to proxy based on the host name the client has configured in his/her email client? (Like Apache VirtualHosts) This would be ideal, as the clients can then go back to using just their name as the username. Thanks Rick -- View this message in context: http://dovecot.2317879.n4.nabble.com/Hostname-Based-forwarding-tp37110.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Thu Aug 16 19:21:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 19:21:45 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> Message-ID: <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> On 16.8.2012, at 14.13, Christian R??ner wrote: >> 1) Can you read mails from the resynced mdbox? For example: >> >> doveadm -o mail=mdbox:/anothermdbox fetch uid all >> > doveadm -o mail=mdbox:/srv/mail/foo.bar at example.com-backup fetch uid all | grep uid | wc -l > 949 > > There seem to be mails. At least I get several lines with uid: > >> 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? > > > It seems, it is just the import thing. > > doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL I find this strange. Does the mdbox size on filesystem get increased at all? (You sure it's not just that they're not visible in your IMAP client?) From c at roessner-network-solutions.com Thu Aug 16 19:42:54 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 18:42:54 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> Message-ID: Hi, >> doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL > > I find this strange. Does the mdbox size on filesystem get increased at all? (You sure it's not just that they're not visible in your IMAP client?) > I find that strange, either :-) I have done: tree . ??? Drafts ? ??? dbox-Mails ? ??? dovecot.index.log ??? Gel&APY-schte Elemente ? ??? dbox-Mails ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? Gesendete Elemente ? ??? dbox-Mails ? ??? dovecot.index ? ??? dovecot.index.backup ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? INBOX ? ??? dbox-Mails ? ??? dovecot.index ? ??? dovecot.index.backup ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? Junk ? ??? dbox-Mails ? ??? dovecot.index.log ??? Junk-E-Mail ? ??? dbox-Mails ? ??? dovecot.index.log ??? Sent ? ??? dbox-Mails ? ??? dovecot.index.log ??? Trash ??? dbox-Mails ??? dovecot.index.log 16 directories, 15 files So at least I should see a folder called all-mail, don't I? If nothing helps, I create a new user called foo.bar at example.com-backup and ask the customer to include that account as well just for importing stuff, he still needs. On the perspective of being a developer, too, I am interested why this does not work. So if you like to dig deeper into this, I gonna help you as much as I can. -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From tss at iki.fi Fri Aug 17 09:18:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 17 Aug 2012 09:18:15 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1345058614.25701.20.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> <1345058614.25701.20.camel@maclinux> Message-ID: <01AB0F8C-CEA1-48F8-B197-E8E8137B427E@iki.fi> On 15.8.2012, at 22.23, Jeff Gustafson wrote: >> dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run >> backup in wrong direction. Source is empty and destination is not. > > That's the one! > >> Maybe it needs a force setting, or change the detection somehow.. > > That would be nice. A backup script is executing the command, so it > should never do it in the wrong direction. A force setting might be the > simplest way to go. This should do it: http://hg.dovecot.org/dovecot-2.1/rev/5f280c1ec9fd From dof at projektfabrik.com Fri Aug 17 13:06:38 2012 From: dof at projektfabrik.com (dof at projektfabrik.com) Date: Fri, 17 Aug 2012 12:06:38 +0200 Subject: [Dovecot] =?utf-8?q?antispam=5Fplugin_prevents_IMAP_login_=28erro?= =?utf-8?b?ciAzKSBbRG92ZWNvdCAyLjAuMTld?= Message-ID: <22a789efa29d55b6725759b7ee4b5bd0@webmail.projektfabrik.com> Hi everybody, trying to get the Dovecot antispam_plugin to work and I must be doing something wrong, because as soon as it is enabled with a certain backend, imap logins do not work anymore (the session is immediately closed after a successful login). Interestingly, pipe and spool2dir are working (that is, the session won't be closed), dspam-exec and crm114-exec are not. If this happens, mail_debug output is as follows: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10420, secured imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_antispam_plugin.so imap(dof): Debug: Effective uid=23244, gid=8, home=/var/spool/dovecot/userdata/dof imap(dof): Debug: Home dir not found: /var/spool/dovecot/userdata/dof master: Error: service(imap): child 10420 returned error 3 Without the plugin I get: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10469, secured imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so imap(dof): Debug: Effective uid=23244, gid=8, home=/var/spool/dovecot/userdata/dof imap(dof): Debug: Home dir not found: /var/spool/dovecot/userdata/dof imap(dof): Debug: fs: root=/var/spool/dovecot/mail/dof, index=, control=, inbox=/var/spool/dovecot/mail/dof/INBOX, alt= imap(dof): Debug: Namespace : Using permissions from /var/spool/dovecot/mail/dof: mode=0755 gid=-1 Hopefully this is just a configuration problem. I tried the plugin in the Ubuntu repository (I'm using LTS 12.04) and even checked out the source from git and compiled it myself, but to no avail. Thanks a lot in advance and best regards, Florian ------------------- dovecot -n output: auth_cache_size = 128 k auth_cache_ttl = 20 mins auth_failure_delay = 10 secs auth_mechanisms = plain login disable_plaintext_auth = no login_greeting = Projektfabrik IMAP ready. mail_gid = mail mail_home = /var/spool/dovecot/userdata/%u mail_location = maildir:/var/spool/dovecot/mail/%u:INBOX=/var/spool/dovecot/mail/%u/INBOX:LAYOUT=fs mail_uid = dovemail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { antispam_backend = dspam-exec antispam_dspam_binary = /usr/bin/dspam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam antispam_trash = trash;Trash;Deleted Items; Deleted Messages autocreate = INBOX/Sent Mail autocreate2 = INBOX/Spam autocreate3 = INBOX/Trash autosubscribe = INBOX/Sent Mail autosubscribe2 = INBOX/Spam autosubscribe3 = INBOX/Trash fts = squat sieve = /var/spool/dovecot/sieve/%u/defaultbc sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = /var/spool/dovecot/sieve/%u } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0600 user = postfix } unix_listener auth-userdb { mode = 0600 user = dovemail } user = dovenull } service imap-login { inet_listener imap { address = localhost port = 143 } inet_listener imaps { address = localhost XX.XXX.XX.XXX port = 993 } service_count = 1 user = dovenull } service managesieve-login { inet_listener sieve { address = localhost port = 2000 } service_count = 1 user = dovenull } service pop3-login { inet_listener pop3 { address = localhost port = 110 } inet_listener pop3s { address = XX.XXX.XX.XXX port = 995 } service_count = 1 user = dovenull } ssl_ca = Maybe it's fixed, but the last "interesting" text in the Changelog was before 2.1.6. Most of our users still have mboxes in the classical layout, so you can't have subfolders and messages in the same folder, *except for the INBOX*, as it is physically separate. Someone complained that he saw subfolders in roundcube he couldn't delete, because they didn't show up in the subscription view. Before hitting on roundcube, I mperformed a few checks and got the following: root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/*' root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/test1' INBOX/test1 messages=0 This is mysterious. It doesn't happen with my account, that is in a mdbox: root at cx-y-z qmail # doveadm mailbox status -u kriegjcb messages 'INBOX/*' INBOX/test1 messages=1 Our setup is a bit complicated, but most of it shouldn't be relevant to the problem. # 2.1.6: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-103.ELsmp i686 Red Hat Enterprise Linux AS release 4 (Nahant Update 9) auth_first_valid_uid = 100 auth_master_user_separator = * dict { quota = mysql:/usr/local/dovecot/etc/dovecot-dict-mysql.conf } disable_plaintext_auth = no first_valid_uid = 100 lda_mailbox_autocreate = yes log_path = /dev/stderr log_timestamp = mail_access_groups = nofiles mail_location = mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/Index mail_plugins = " quota zlib mail_log notify virtual stats" mdbox_rotate_size = 5 M namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes inbox = no list = children location = maildir:~/Maildir prefix = "#MD/" separator = / type = private } namespace { hidden = yes list = no location = virtual:~/Maildir/Virtual prefix = Virtual/ separator = / type = private } namespace { hidden = yes list = no location = virtual:/usr/local/dovecot/etc/virtuell:INDEX=~/Virtuell prefix = Virtuell/ separator = / subscriptions = no type = private } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { acl = vfile mail_log_events = undelete mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota quota2 = fs:Disk quota stats_refresh = 30 secs stats_track_cmds = yes } protocols = pop3 imap service auth { client_limit = 4300 user = root } service dict { unix_listener dict { group = nofiles mode = 0666 } } service doveadm { inet_listener { port = 542 } } service imap-login { inet_listener imap { address = 134.147.64.38 port = 143 } service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = 134.147.64.38 port = 110 } service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } service stats { fifo_listener stats-mail { mode = 0666 user = dovenull } } ssl = no stats_command_min_time = 5 mins stats_domain_min_time = 1 hours stats_ip_min_time = 1 hours stats_memory_limit = 64 M userdb { args = /usr/local/dovecot/etc/dovecot-mysql.conf driver = sql } userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota zlib mail_log notify virtual stats imap_quota imap_zlib imap_stats" } Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From kryol at bigmir.net Fri Aug 17 14:24:09 2012 From: kryol at bigmir.net (Oleksii Krykun) Date: Fri, 17 Aug 2012 14:24:09 +0300 Subject: [Dovecot] Expire-tool does not delete duplicate messages (dovecot-1.2.17) Message-ID: Trying to implement expire plugin. expire-tool works fine. This delete expunged messages but not all of them. I have duplicate messages in appropriate folder. These messages are from expanding postfix aliases (e.g. postmaster@, hostmaster@, abuse@ etc. points to same mailbox and spam often sent to all of them. If duplicate message is received only one entry in dovecot-uidlist is created and only first of duplicates is deleted with expire-tool. Rest of duolicates are not deleted. Any suggestions. Thanks, Kryol From tss at iki.fi Fri Aug 17 19:32:24 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 17 Aug 2012 19:32:24 +0300 Subject: [Dovecot] Expire-tool does not delete duplicate messages (dovecot-1.2.17) In-Reply-To: References: Message-ID: On 17.8.2012, at 14.24, Oleksii Krykun wrote: > Trying to implement expire plugin. > expire-tool works fine. This delete expunged messages but not all of them. > I have duplicate messages in appropriate folder. These messages are from > expanding postfix aliases (e.g. postmaster@, hostmaster@, abuse@ etc. > points to same mailbox and spam often sent to all of them. > If duplicate message is received only one entry in dovecot-uidlist is > created and only first of duplicates is deleted with expire-tool. Rest of > duolicates are not deleted. > > Any suggestions. No idea, but if it's a bug, it won't be fixed anymore in v1.2. The whole thing has been rewritten in v2.x. I suggest upgrade. From tresh_dovecot at lefoyer.ru Fri Aug 17 21:37:08 2012 From: tresh_dovecot at lefoyer.ru ((Dovecot) Sergey Sidlyarenko) Date: Fri, 17 Aug 2012 22:37:08 +0400 Subject: [Dovecot] Problem use localized prefix in namespace Message-ID: dovecot --version 2.1.7 uname -a Linux ns 3.2.0-2-amd64 #1 SMP Mon Jun 11 17:24:18 UTC 2012 x86_64 GNU/Linux Debian sid Problem with localized prefix in namespace. Create namespace namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/mail/%d%n/test1:LAYOUT=fs:DIRNAME=maildirfolder:UTF-8 mailbox next { auto = subscribe special_use = } prefix = ????1/ separator = / subscriptions = yes type = private } namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/mail/%d%n/test2:LAYOUT=fs:DIRNAME=maildirfolder:UTF-8 mailbox next { auto = subscribe special_use = } prefix = &BCIENQRBBEI-2/ separator = / subscriptions = yes type = private } result A0002 NAMESPACE * NAMESPACE (("" "/")("links/" "/")({10} ????1/ "/")("&BCIENQRBBEI-2/" "/")) NIL NIL A0002 OK Namespace completed. A0003 LIST "" "*" ... cut * LIST (\Noselect \HasChildren) "/" "&BCIENQRBBEI-1" * LIST (\HasNoChildren) "/" "&BCIENQRBBEI-1/next" * LIST (\Noselect \HasChildren) "/" "&-BCIENQRBBEI-2" * LIST (\HasNoChildren) "/" "&-BCIENQRBBEI-2/next" * LIST (\HasNoChildren) "/" "&BCIENQRBBEI-1/next" * LIST (\HasNoChildren) "/" "&-BCIENQRBBEI-2/next" A0002 OK List completed. A0003 LSUB "" "*" ... cut * LSUB () "/" "&-BCIENQRBBEI-2/next" * LSUB () "/" "&BCIENQRBBEI-1/next" * LSUB () "/" "&BCIENQRBBEI-1/next" * LSUB () "/" "&-BCIENQRBBEI-2/next" A0003 OK Lsub completed. A0004 SELECT "&BCIENQRBBEI-1/next" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1344240572] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [NOMODSEQ] No permanent modsequences A0004 OK [READ-WRITE] Select completed. A0005 SELECT "&BCIENQRBBEI-2/next" Connection closed by foreign host. in error log 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4413a) [0x7f8d6bcc613a] -> /usr/lib/dovecot/libdovecot.so.0(+0x4417e) [0x7f8d6bcc617e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8d6bc9d82a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x7e506) [0x7f8d6bf8e506] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0x18) [0x7f8d6bf8e538] -> dovecot/imap(cmd_select_full+0x13e) [0x40ddbe] -> dovecot/imap(command_exec+0x3c) [0x4118dc] -> dovecot/imap() [0x4109ae] -> dovecot/imap() [0x410a5a] -> dovecot/imap(client_handle_input+0x11d) [0x410cad] -> dovecot/imap(client_input+0x62) [0x411552] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f8d6bcd2ff6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f8d6bcd3ca7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f8d6bcd2a08] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8d6bcbf483] -> dovecot/imap(main+0x285) [0x409265] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f8d6b919ead] -> dovecot/imap() [0x4093d5] 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Fatal: master: service(imap): child 20040 killed with signal 6 (core dumps disabled) -- Best regards, Sidlyarenko Sergey Aleksandrovish +7(495)509-42-07 tresh_dovecot at lefoyer.ru mailto:tresh_dovecot at lefoyer.ru From Lutz.Pressler at SerNet.DE Sat Aug 18 00:12:14 2012 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Fri, 17 Aug 2012 23:12:14 +0200 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: <1291312192.5119.455.camel@kurkku.sapo.corppt.com> References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: Hello Timo, virtual file with "inthread/younger" (other dynamic searches?) in it and indexes leading to too many (or too few?) search results. On Do, 02 Dez 2010, Timo Sirainen wrote: > On Thu, 2010-12-02 at 11:08 +0100, Lutz Pre?ler wrote: > > > inthread refs younger 604800 > > > > This works as expected for the first time. But later on, also older messages/ > > threads are included until I delete the virtual/.week/dovecot.index*. > > I know there are problems related to this with INTHREAD, but they aren't > very easy to solve and for now I've more important things to do.. If it > seemed to work before, it was due to luck or due to some bug causing an > unnecessary index rebuild. You could set :INDEX=MEMORY to work around > this, but I don't know how much worse the performance would become. Or > you could just manually delete the virtual indexes once a week. Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ enhance now? Any estimate how much effort it would be? Thanks again for your work, Lutz From jtam.home at gmail.com Sat Aug 18 03:29:49 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Fri, 17 Aug 2012 17:29:49 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding In-Reply-To: References: Message-ID: Merrickville writes: > Is there a way to proxy based on the host name the client has configured in > his/her email client? (Like Apache VirtualHosts) I doubt it; the virtual name is not part of the IMAP protocol as it is in HTTP. The IMAP server is not told which hostname was mapped to its IP. You'll either have to add the @domain, or perhaps multi-home your host, remap one of your domains to the new IP, and add another running instance of dovecot to listen on that interface. Joseph Tam From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 18 04:16:01 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 18 Aug 2012 03:16:01 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <20120818011601.GA12947@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > > http://wiki2.dovecot.org/Director#Other_settings > > doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. > > service ipc { > unix_listener ipc { > user = dovecot > } > } > > director instance needs access to director instance. With the above configuration, ipc works correctly between our directors and kicks the moved users which had been connected via proxy. Thanks a lot! Regards Daniel -- https://plus.google.com/103021802792276734820 From me at junc.org Sat Aug 18 05:36:24 2012 From: me at junc.org (Benny Pedersen) Date: Sat, 18 Aug 2012 04:36:24 +0200 Subject: [Dovecot] =?utf-8?q?Listen_on_multiple_ports_possible_using_same_?= =?utf-8?q?protocol=3F?= In-Reply-To: References: Message-ID: <9d88e2853396bae613dc925a02f5dbb5@junc.org> Den 2012-08-15 00:12, Michael Durket skrev: > for example. Or is this more preferably done by pointing dovecot at > different configuration files? listen = wan-ip:143 listen = 127.0.0.2:143 ssl_listen = wan-ip:993 ssl_listen = 127.0.0.3:993 just examples since it dont understand what you like to test :) From tss at iki.fi Sun Aug 19 05:57:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 05:57:16 +0300 Subject: [Dovecot] Search extensions Message-ID: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": a search or x-anyheader application/pdf x-anyheader .pdf b fetch $ bodystructure The client can verify the results with the fetch. The "x-anyheader" can already be implemented without changes to full text search plugin, because all backends store message/MIME headers and body text separately. So, questions for the list, especially client developers: 1) What's a better name for x-anyheader? :) 2) Any other ideas about search extensions you'd want to see? Maybe I could get this standardized at some point. I think one other thing missing has been "show me messages that have attachments". I've thought about maybe creating a $hasattachments keyword for that, which the server could automatically set for new mails that it thinks has attachments (and clients can set/unset the keyword if wanted). From kamath at moltingpenguin.com Sun Aug 19 09:47:36 2012 From: kamath at moltingpenguin.com (Sean Kamath) Date: Sat, 18 Aug 2012 23:47:36 -0700 Subject: [Dovecot] Search extensions In-Reply-To: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: On Aug 18, 2012, at 7:57 PM, Timo Sirainen wrote: > I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": > > a search or x-anyheader application/pdf x-anyheader .pdf > b fetch $ bodystructure > > The client can verify the results with the fetch. The "x-anyheader" can already be implemented without changes to full text search plugin, because all backends store message/MIME headers and body text separately. > > So, questions for the list, especially client developers: > > 1) What's a better name for x-anyheader? :) > > 2) Any other ideas about search extensions you'd want to see? Maybe I could get this standardized at some point. > > I think one other thing missing has been "show me messages that have attachments". I've thought about maybe creating a $hasattachments keyword for that, which the server could automatically set for new mails that it thinks has attachments (and clients can set/unset the keyword if wanted). At work we've flipped to Google mail (I run Dovecot at home). 99.9% of the time I just cry. Once feature of their search capability that sometimes is nice is the ability to not only see if it has an attachment (has:attachment) but the ability to search for the attachments by a specific name (filename:). That can be, and has proven, useful. I suspect this could turn into a nightmare, however. Ditto something like "has N attachments" (sometime I dearly wish I had at times -- I want to find that damn message with like 10 attachments). Or math around number of attachments. My $0.02. Sean From trashcan at odo.in-berlin.de Sun Aug 19 12:51:08 2012 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Sun, 19 Aug 2012 11:51:08 +0200 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <1331206534.2081.101.camel@innu> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> Message-ID: <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> On 08.03.2012, at 12:35, Timo Sirainen wrote: > On Thu, 2012-03-08 at 11:26 +0100, Michael Grimm wrote: >> Now some observations regarding replicator: >> >> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >> >> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >> >> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >> >> JFTR: I do have mail_log plugin activated. > > Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? Regards, Michael From tss at iki.fi Sun Aug 19 14:10:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 14:10:09 +0300 Subject: [Dovecot] Search extensions In-Reply-To: References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: <66CC9348-E96F-48D9-9B56-25FF10E1F1E8@iki.fi> On 19.8.2012, at 9.47, Sean Kamath wrote: >> I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": >> >> a search or x-anyheader application/pdf x-anyheader .pdf >> b fetch $ bodystructure >> >> The client can verify the results with the fetch. > Once feature of their search capability that sometimes is nice is the ability to not only see if it has an attachment (has:attachment) but the ability to search for the attachments by a specific name (filename:). That can be, and has proven, useful. I suspect this could turn into a nightmare, however. Ditto something like "has N attachments" (sometime I dearly wish I had at times -- I want to find that damn message with like 10 attachments). Or math around number of attachments. Actually searching by attachment filename was also in my requirements list, but I forgot to mention it. It can anyway be done the same way as the pdf example above. The bodystructure reply includes attachment filenames. Of course you'll still need a client that can give a nice UI for those.. From tss at iki.fi Sun Aug 19 18:08:47 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:08:47 +0300 Subject: [Dovecot] Dsync and SIS In-Reply-To: <5022ADCB.8060805@integrafin.co.uk> References: <5022ADCB.8060805@integrafin.co.uk> Message-ID: <4F899205-CEF9-4C9F-8FAC-ADD59E566811@iki.fi> On 8.8.2012, at 21.19, Alex Crow wrote: > Just to clarify, if we back up a dovecot 2 server with SIS for attachments and ALT storage by rsyncing it (including the SIS and ALT storage) to a remote server when it's idle (or at least almost entirely so), and run dovecot on that machine, would it seem feasible to restore backups from that server by using dysnc - specifically for the scenario where someone accidentally deletes emails/folders etc.? dsync over ssh should work for that, yes. (Locally if you use doveadm import it's going to use the same SIS storage unless you override the settings.) From tss at iki.fi Sun Aug 19 18:09:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:09:57 +0300 Subject: [Dovecot] maildir to sdbox offline conversion In-Reply-To: <34274589.post@talk.nabble.com> References: <34274589.post@talk.nabble.com> Message-ID: On 9.8.2012, at 3.34, _ET_ wrote: > So it's not easy to do an "online" conversion and follow the instructions at > dsync's wiki. Do you know a way how to simply tell dsync or a similar util > the following > > dsync convert maildir:/data/vmail/domain/user > sdbox:/newdata/vmail/domain/user > > without touching the ldap database, only the files on the disk. I can run > this command as root on this mail server, if it is needed, I can run the > command for each and every maildir. That's not a problem. > > any ideas, how this woul?d be the simpliest? doveadm -o mail=maildir:/data/... sync sdbox:/newdata/... From tss at iki.fi Sun Aug 19 18:22:30 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:22:30 +0300 Subject: [Dovecot] dsync \noselect on INBOX.INBOX skips sync of INBOX In-Reply-To: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> References: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> Message-ID: <8C1B93D0-C743-4340-BFE7-160B17212002@iki.fi> On 9.8.2012, at 11.20, Nikolai Schupbach wrote: > We have encountered an issue today with a number of migrations. Some customers have mailboxes on the source IMAP server that look like this: > > 3 LIST "" * > * LIST () "." "INBOX" > * LIST () "." "INBOX.Statements" > * LIST () "." "INBOX.Draft" > * LIST () "." "INBOX.Drafts" > * LIST () "." "INBOX.Invoices" > * LIST (\Noselect) "." "INBOX.INBOX" > * LIST () "." "INBOX.Jokes" > * LIST () "." "INBOX.Payslips" > * LIST () "." "INBOX.Personal" > > When we run dsync it skips the INBOX presumably because of the Noselect on INBOX.INBOX. and the "imapc_list_prefix = INBOX" setting. Does the attached patch help? -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 968 bytes Desc: not available URL: From tss at iki.fi Sun Aug 19 18:26:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:26:10 +0300 Subject: [Dovecot] Full text search in attachments In-Reply-To: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> Message-ID: <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> On 11.8.2012, at 5.28, Mailing wrote: > is it possible to use the Solr full text search plugin for indexing mail attachments? I found a very old patch and some hints regarding a fts_decoder script that I don't understand. > > Making Solr indexing PDF or Office files shouldn't be that difficult, but how can I enable the plugin to transfer the attachments to Solr? I updated the wiki with: * See the decode2text.sh script included in Dovecot for how to use this. From tss at iki.fi Sun Aug 19 18:28:30 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:28:30 +0300 Subject: [Dovecot] imap-login process_limit (100) reached, client connections are being dropped In-Reply-To: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> References: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> Message-ID: On 13.8.2012, at 14.12, Voytek Eymont wrote: > noticed this in the log today, after about 11 warning IMAP appears to have > not worked, 'service dovecot reload' got it going again > > question: what to check/alter ? http://wiki2.dovecot.org/LoginProcess Easiest/safest is to just increase process_limit. From tss at iki.fi Sun Aug 19 18:33:34 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:33:34 +0300 Subject: [Dovecot] Permission denied on dovecot.lda-dupes In-Reply-To: <1344871085776-37053.post@n4.nabble.com> References: <1344871085776-37053.post@n4.nabble.com> Message-ID: <0098E449-2043-4CEB-B617-2F3C2D561F67@iki.fi> On 13.8.2012, at 18.18, ppridt wrote: > Hi, > I have converted my Imap Server from Courier to Dovecot in order to use > sieve support. > Everything works fine with the exception that the sender always gets the > vacation msg since there is a permission error on writing of > dovecot.lda-dupes. .. > Aug 13 14:51:26 Srv dovecot: deliver(pp): Home dir not found: The dupe file is written to home dir, but you have no home dir. > file_dotlock_create(/.dovecot.lda-dupes) failed: Permission denied So it's trying to write to the root directory. But I find these messages strange. They shouldn't happen at least newer Dovecots. What version are you using? From tss at iki.fi Sun Aug 19 18:36:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:36:39 +0300 Subject: [Dovecot] Mdbox corruption In-Reply-To: <502C000C.9060206@adminlinux.com.br> References: <502C000C.9060206@adminlinux.com.br> Message-ID: <8AB4531A-2EE3-4F6B-A3BF-9DBF79A2EC31@iki.fi> On 15.8.2012, at 23.01, 3.listas at adminlinux.com.br wrote: > I have a "ubuntu10.04 + ext4-filesystem + dovecot-2.0.13 +mdbox" configuration in my server. It works fine with ~50k accounts. > Recently happened a filesystem corruption in a device of StMailLocation and I fix with fsck.ext4. > After this crash, one account began to show access timeout and errors like this on force-resync: > > # doveadm force-resync -u account INBOX > doveadm(account): Warning: mdbox /path-to-mdbox/storage: rebuilding indexes > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) > doveadm(account): Warning: dbox: Copy of the broken file saved to /path-to-mdbox/storage/m.83.broken > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) > doveadm(account): Error: mdbox rebuild: Failed to fix file /path-to-mdbox/storage/m.83 > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.92 (around offset=7): Invalid dbox version > ... > > Should I worry about the m.X.broken files ? > How I fix these broken mdboxes ? Dovecot fixed the mdbox files automatically and wrote m.*.broken files that contain the originals, just in case the fixing didn't do something correctly so you could manually look at them. Now, if doveadm force-resync keeps finding errors all the time it's a bug. I'd first try the latest v2.1 though, may be fixed already. From tss at iki.fi Sun Aug 19 18:39:04 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:39:04 +0300 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: On 16.8.2012, at 14.58, Lazy wrote: > 2012/5/19 Timo Sirainen : >> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>> failed: Read-only file system >> >> Does the attached patch help? >> >>> maybe it will be easier to move all dovecot metadata to separate (non >>> snapshot) location ? >> >> It could also be a bit problematic. At least message keywords (=custom >> flags) wouldn't work because the dovecot-keywords file exists only in >> the snapshot dir. > > Moving metadata helped, but now archived inbox is unsubscribed. Is > there a way to make all folders in an namespace subscribed by default > ? Nope. I could try to get the snapshots fixed at some point when I have more time, but I'm not going to add a feature to subscribe everything by default. People might try to start using it. From tss at iki.fi Sun Aug 19 18:43:47 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:43:47 +0300 Subject: [Dovecot] dovecot 2.1 Master account Error In-Reply-To: <1345123672440-37109.post@n4.nabble.com> References: <1345123672440-37109.post@n4.nabble.com> Message-ID: <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> On 16.8.2012, at 16.27, tmihalicek wrote: > I am running parallel dovecot 1.2 for main accounts and 2.1 for test > accounts, and for some reason when i try to login with master user on > dovecot 2.1 service errors. http://wiki2.dovecot.org/Authentication/MasterUsers#ACLs From andre.rodier at gmail.com Sun Aug 19 19:03:39 2012 From: andre.rodier at gmail.com (Andre Rodier) Date: Sun, 19 Aug 2012 17:03:39 +0100 Subject: [Dovecot] case insensitive acl Message-ID: <50310E5B.9010908@gmail.com> Hello, I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. Because I use LDAP, the name of the users is case insensitive. Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? This would be useful with some ACL managers, like roundcube ACL plugin, that uses an LDAP query to autocomplete the user name for the ACL. Kind regards, Andr? From tss at iki.fi Sun Aug 19 19:25:22 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 19:25:22 +0300 Subject: [Dovecot] case insensitive acl In-Reply-To: <50310E5B.9010908@gmail.com> References: <50310E5B.9010908@gmail.com> Message-ID: <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> On 19.8.2012, at 19.03, Andre Rodier wrote: > I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. > > Because I use LDAP, the name of the users is case insensitive. Translate the username to lowercase. It's the default nowadays: auth_username_format = %Lu > Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? No. From andre.rodier at gmail.com Sun Aug 19 19:51:41 2012 From: andre.rodier at gmail.com (Andre Rodier) Date: Sun, 19 Aug 2012 17:51:41 +0100 Subject: [Dovecot] case insensitive acl In-Reply-To: <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> References: <50310E5B.9010908@gmail.com> <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> Message-ID: <5031199D.9010809@gmail.com> On 19/08/12 17:25, Timo Sirainen wrote: > On 19.8.2012, at 19.03, Andre Rodier wrote: > >> I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. >> >> Because I use LDAP, the name of the users is case insensitive. > Translate the username to lowercase. It's the default nowadays: > > auth_username_format = %Lu > >> Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? > No. > Thanks, Timo. Thanks for your huge work on Dovecot. From maillist at endfertig.de Sun Aug 19 21:57:51 2012 From: maillist at endfertig.de (Mailing) Date: Sun, 19 Aug 2012 20:57:51 +0200 Subject: [Dovecot] Full text search in attachments In-Reply-To: <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> Message-ID: <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> Hi Timo, Am 19.08.2012 17:26, schrieb Timo Sirainen: > On 11.8.2012, at 5.28, Mailing wrote: > I updated the wiki with: > > * See the decode2text.sh script included in Dovecot for how to use > this. I want to send the complete attachments (unparsed) to solr server and let solr do the parsing work. Is it maybe possible to use a decode2text like script together with curl to send the attachments to the sold server? But in this case I would have to know additional informations in the script like message id and the mailbox name. Best regards, Sebastian From tss at iki.fi Mon Aug 20 08:16:02 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 08:16:02 +0300 Subject: [Dovecot] Full text search in attachments In-Reply-To: <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> Message-ID: On 19.8.2012, at 21.57, Mailing wrote: > Am 19.08.2012 17:26, schrieb Timo Sirainen: >> On 11.8.2012, at 5.28, Mailing wrote: >> I updated the wiki with: >> >> * See the decode2text.sh script included in Dovecot for how to use this. > > I want to send the complete attachments (unparsed) to solr server and let solr do the parsing work. Is it maybe possible to use a decode2text like script together with curl to send the attachments to the sold server? > > But in this case I would have to know additional informations in the script like message id and the mailbox name. It can't work like that, because all the text from one message (text & all attachments) has to go to one document. From dof at projektfabrik.com Mon Aug 20 12:14:43 2012 From: dof at projektfabrik.com (dof at projektfabrik.com) Date: Mon, 20 Aug 2012 11:14:43 +0200 Subject: [Dovecot] =?utf-8?q?SOLVED_antispam=5Fplugin_prevents_IMAP_login_?= =?utf-8?b?KGVycm9yIDMpIFtEb3ZlY290IDIuMC4xOV0=?= Message-ID: <02e97d2e165b7b33b947c615d71724b7@webmail.projektfabrik.com> On 17.08.2012 12:06, dof at projektfabrik.com wrote: > Hi everybody, > > trying to get the Dovecot antispam_plugin to work and I must be doing > something wrong, because as soon as it is enabled with a certain > backend, imap logins do not work anymore (the session is immediately > closed after a successful login). Interestingly, pipe and spool2dir > are working (that is, the session won't be closed), dspam-exec and > crm114-exec are not. If this happens, mail_debug output is as > follows: > > [...] Hi again, how embarrassing. I should use the correct name for the backend type. :\ So everything works as expected, sorry for spamming the mailing list. Best regards, Florian From amateo at um.es Mon Aug 20 11:33:55 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 10:33:55 +0200 Subject: [Dovecot] userdb multiple databases Message-ID: <5031F673.8040702@um.es> Hello, I'm trying to configure per user plugins. My original passdb and userdb is in a ldap directory (using userdb with prefetch). To configure per user plugins (in fact, I want to enable quota plugin for some users) I need to configure mail_plugins attribute in the userdb. The problem is that I don't know any ldap attribute to store this information (is there any schema with includes an attribute for this). So I want to configure it in a passwd-file file. My problem is that I don't know if I can chain userdb databases. I know I can configure multiple databases, but as far as I know, they are looked in order, so if the user is found in the first one, then is no look for the user in the second one, so I have to configure all user's attributes in the passwd-file database. Is there any way to chain these lookups? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 11:38:26 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 10:38:26 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 Message-ID: <5031F782.9010802@um.es> Hello, I am configuring quota plugin per user, not for the whole system. As documentation says (http://wiki2.dovecot.org/Quota), I have to add "quota" to the global mail_plugins and "imap_quota" to mail_plugins for protocol imap, but I don't know how to configure this in a userdb. I'm using a passwd-file in the way: :{plain}password::::::userdb_mail_plugins=quota,imap_quota but this activate both plugins in the global mail_plugins option. The problem with this is that if the user tries to connect via pop3 instead of imap (a thing that I permit, although the user shouldn't do it) I have the error: Aug 20 10:04:18 myotis30 dovecot: pop3: Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline is there any way to solve this problem? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 13:56:48 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 12:56:48 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <5031F782.9010802@um.es> References: <5031F782.9010802@um.es> Message-ID: <503217F0.3090609@um.es> Hi again, Another problem I'm having with this is that quota (maildirsize) is not updated when mail is delivered. According to http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be sure that dovecot-lda is run with -d option, but in my configuration I'm receiving mail via lmtp and (I think) dovecot-lda is not running at all. So the problem (I think) is that quota plugin is not used in the lmtp process. Is there any way to configure that lmtp processes use the mail_plugins in the userdb database? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 14:07:57 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 13:07:57 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <503217F0.3090609@um.es> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> Message-ID: <50321A8D.5000702@um.es> El 20/08/12 12:56, Angel L. Mateo escribi?: > Hi again, > > Another problem I'm having with this is that quota (maildirsize) is > not updated when mail is delivered. > > According to > http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be > sure that dovecot-lda is run with -d option, but in my configuration I'm > receiving mail via lmtp and (I think) dovecot-lda is not running at all. > > So the problem (I think) is that quota plugin is not used in the > lmtp process. Is there any way to configure that lmtp processes use the > mail_plugins in the userdb database? > I forgot to attach doveconf -n -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.4.0-030400-generic x86_64 Ubuntu 12.04 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_verbose = yes default_process_limit = 1000 disable_plaintext_auth = no log_timestamp = %Y-%m-%d %H:%M:%S login_trusted_networks = 155.54.211.176/28 mail_debug = yes mail_fsync = always mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_nfs_storage = yes mail_privileged_group = mail maildir_stat_dirs = yes mdbox_rotate_size = 20 M passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = session=yes dovecot driver = pam } plugin { lazy_expunge = .EXPUNGED/ .DELETED/ .DELETED/.EXPUNGED/ quota = maildir:User quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at um.es service anvil { client_limit = 2003 } service auth { client_limit = 3000 unix_listener auth-userdb { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap { process_limit = 5120 process_min_avail = 2 vsz_limit = 512 M } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3 { process_min_avail = 2 } ssl = no ssl_cert = References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> Message-ID: <503223EE.3030801@um.es> El 20/08/12 12:56, Angel L. Mateo escribi?: > Hi again, > > Another problem I'm having with this is that quota (maildirsize) is > not updated when mail is delivered. > > According to > http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be > sure that dovecot-lda is run with -d option, but in my configuration I'm > receiving mail via lmtp and (I think) dovecot-lda is not running at all. > > So the problem (I think) is that quota plugin is not used in the > lmtp process. Is there any way to configure that lmtp processes use the > mail_plugins in the userdb database? > I have discovered the origin of my problem, but not the solution. The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. Any idea? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From Jost.Krieger+dovecot at rub.de Mon Aug 20 16:06:18 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 20 Aug 2012 15:06:18 +0200 Subject: [Dovecot] Is it possible to save only some messages compressed to mdbox? (2.1.6) Message-ID: <20120820130617.GT24203@ruhr-uni-bochum.de> I'm trying to save some messages as compressed (via zlib plugin) and it doesn't seem to work. Here's a log line (I'm logging to stderr): d k 1345467448.705591500 1345467448.705596500 1345467448.974808500 1650 local.jost.krieger+hirn at ruhr-uni-bochum.de 10909 80 Extra: -o plugin/zlib_save_level=9 -o plugin/zlib_save=bz2 lda(kriegjcb): Info: msgid=<20120820125728.58CC9172B6C at c2-4-7.noc.ruhr-uni-bochum.de>: saved mail to Hirn-2012-08 did 0+0+1 This probably doesn't make much sense to anyone except the last line but 1. It is a somewhat complicated qmail/maildrop/dovecot setup, which works for the standard cases. The Extra gets interpolated into the lda command and this works because an incorrect option blows up the delivery. The mails arrive uncompressed. So here's the questions: 1. Is it possible to have compressed/uncompressed mails mixed in an mdbox? 2. Will it work via "-o" in lda delivery? I tried to find out in the source but found it hard to see which options are pulled in when. Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From andre.groebe at fun.de Mon Aug 20 16:35:55 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Mon, 20 Aug 2012 15:35:55 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <50323D3B.1030701@fun.de> Hi it seems to me, that it depends on how dovecot handles line reading. Dovecot presumes that a line is of max length of IO_BLOCK_SIZE (=8192) Bytes. Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? Regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From acrow at integrafin.co.uk Mon Aug 20 18:21:30 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Mon, 20 Aug 2012 16:21:30 +0100 Subject: [Dovecot] Variables in LDAP userdb Message-ID: <503255FA.9080300@integrafin.co.uk> Hi Timo, Is it OK to have dovecot variables in entries in an LDAP userdb? Say I wanted to set the mail userdb parameter to override mail_location, would it work by having an entry in LDAP (eg for mailMessageStore attrib) like: mdbox:/home/email/%d/%n:INDEX=/home/indexes/%d/%1n/%n:ALT=/home/email_archive/%d/%1n/%n and those % variables will still be expanded by dovecot? Or would I be required to replace them in the LDAP directory with their actual values? Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From merrickville at gmail.com Mon Aug 20 19:22:59 2012 From: merrickville at gmail.com (Merrickville) Date: Mon, 20 Aug 2012 09:22:59 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding In-Reply-To: References: <1345132919122-37110.post@n4.nabble.com> Message-ID: <1345479779161-37150.post@n4.nabble.com> Thanks for the info. That unfortunately does not make it as flexible as name based hosting, too bad. -- View this message in context: http://dovecot.2317879.n4.nabble.com/Hostname-Based-forwarding-tp37110p37150.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Mon Aug 20 21:22:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 21:22:58 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50323D3B.1030701@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> Message-ID: On 20.8.2012, at 16.35, Andre Gr?be wrote: > it seems to me, that it depends on how dovecot handles line reading. Dovecot presumes that a line is of max length of IO_BLOCK_SIZE (=8192) Bytes. > > Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE with (size_t)-1. From tss at iki.fi Mon Aug 20 21:25:24 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 21:25:24 +0300 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: <503255FA.9080300@integrafin.co.uk> References: <503255FA.9080300@integrafin.co.uk> Message-ID: On 20.8.2012, at 18.21, Alex Crow wrote: > Is it OK to have dovecot variables in entries in an LDAP userdb? Say I wanted to set the mail userdb parameter to override mail_location, would it work by having an entry in LDAP (eg for mailMessageStore attrib) like: > > mdbox:/home/email/%d/%n:INDEX=/home/indexes/%d/%1n/%n:ALT=/home/email_archive/%d/%1n/%n > > and those % variables will still be expanded by dovecot? No. Otherwise it would break paths that actually contain % characters. > Or would I be required to replace them in the LDAP directory with their actual values? Yes. If you really wanted to avoid that and you have only a few different values, you could create some namespaces in dovecot.conf and enable/disable them as needed in the ldap fields. Although I guess that's not a whole lot better since there's currently no simple "enabled" setting for namespaces, maybe I should add one.. From tomislav.mihalicek at gmail.com Mon Aug 20 21:39:03 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Mon, 20 Aug 2012 11:39:03 -0700 (PDT) Subject: [Dovecot] dovecot 2.1 Master account Error In-Reply-To: <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> References: <1345123672440-37109.post@n4.nabble.com> <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> Message-ID: <1345487943866-37153.post@n4.nabble.com> Thanks Timo, after i read the ACL stuff i have another question. I would like to use a third solution which is assigning master_user=%u in userdb lookup. Should i use? userdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext # Default fields can be used to specify defaults that LDAP may override default_fields = uid=vmail gid=vmail allow_all_users=yes master_user=%u } -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-2-1-Master-account-Error-tp37109p37153.html Sent from the Dovecot mailing list archive at Nabble.com. From kavish.karkera at yahoo.com Tue Aug 21 08:42:39 2012 From: kavish.karkera at yahoo.com (Kavish Karkera) Date: Tue, 21 Aug 2012 13:42:39 +0800 (SGT) Subject: [Dovecot] Error: Couldn't open INBOX: Timeout while waiting for lock Message-ID: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> Hi , My users are frequetly getting the below error, Aug 21 00:04:18 blade6 dovecot: pop3-login: proxy(hgl_dipak): Login failed to 192.168.1.43:110: [IN-USE] Couldn't open INBOX: Timeout while waiting for lock. We are proxing pop connections from one pop server (dovecot version 1.1.20) i.e 192.168.1.39 to the other pop Server (Dovecot version 2.0.16 ) i.e 192.168.1.4. We have set? pop3_lock_session = yes and dont want to disable it. Please Help !! :) K.K From acrow at integrafin.co.uk Tue Aug 21 11:44:34 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Tue, 21 Aug 2012 09:44:34 +0100 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: References: <503255FA.9080300@integrafin.co.uk> Message-ID: <50334A72.2020908@integrafin.co.uk> Timo, Thanks, I scripted replacing the correct entries in LDAP. To clarify, what happens in these case with regard to the default mail_location set in the config files (ie is it used or overridden): 1. The LDAP attribute referenced in the userdb lookup exists but is empty 2. The LDAP attribute is not present for the user. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From andre.groebe at fun.de Tue Aug 21 13:10:17 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 21 Aug 2012 12:10:17 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> Message-ID: <50335E89.9010104@fun.de> Hi Timo, thx for reply. [tss at iki.fi; Mo 20 Aug 2012 20:22:58 CEST] >> Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? > > Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE > with (size_t)-1. Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. Best regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Aug 21 13:22:04 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 21 Aug 2012 13:22:04 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50335E89.9010104@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> Message-ID: On 21.8.2012, at 13.10, Andre Gr?be wrote: > [tss at iki.fi; Mo 20 Aug 2012 20:22:58 CEST] >>> Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? >> >> Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE > > with (size_t)-1. > > Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. Does the attached patch fix it? (not a very good fix) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 449 bytes Desc: not available URL: From andre.groebe at fun.de Tue Aug 21 14:16:17 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 21 Aug 2012 13:16:17 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> Message-ID: <50336E01.6000909@fun.de> Hi Timo, [tss at iki.fi; Di 21 Aug 2012 12:22:04 CEST] >> Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. > > Does the attached patch fix it? (not a very good fix) No, it doesn't. Still got no response on large metadata and writing destroys the dictionary. Best Regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From lazy404 at gmail.com Tue Aug 21 14:22:02 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 13:22:02 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: 2012/8/19, Timo Sirainen : > On 16.8.2012, at 14.58, Lazy wrote: > >> 2012/5/19 Timo Sirainen : >>> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>>> failed: Read-only file system >>> >>> Does the attached patch help? >>> >>>> maybe it will be easier to move all dovecot metadata to separate (non >>>> snapshot) location ? >>> >>> It could also be a bit problematic. At least message keywords (=custom >>> flags) wouldn't work because the dovecot-keywords file exists only in >>> the snapshot dir. >> >> Moving metadata helped, but now archived inbox is unsubscribed. Is >> there a way to make all folders in an namespace subscribed by default >> ? > > Nope. I could try to get the snapshots fixed at some point when I have more > time, but I'm not going to add a feature to subscribe everything by default. > People might try to start using it. If I enable per snapshot subscriptions i see all folders except INBOX, i have tried to subscribe it using mailbox_list_subscription_fill_one() or using imap as bellow without success http://dovecot.org/list/dovecot/2007-October/025965.html suggest that it isn't possible ./imap/.libs/imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as root a subscribe "test" a OK Subscribe completed. a lsub "" "*" imap(root): Warning: Subscriptions file /root/Maildir/subscriptions: Removing invalid entry: * LSUB () "." "Drafts" * LSUB () "." "Sent" * LSUB () "." "Junk" * LSUB () "." "Trash" * LSUB () "." "Deleted Messages" * LSUB () "." "test.Drafts" * LSUB () "." "test.Sent" * LSUB () "." "test.Junk" * LSUB () "." "test.Trash" * LSUB () "." "test.Deleted Messages" a OK Lsub completed. b list "" "*" * LIST (\HasNoChildren) "." "DUpa" * LIST (\HasNoChildren) "." "Deleted Messages" * LIST (\HasNoChildren) "." "Junk" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasNoChildren) "." "Drafts" * LIST (\HasNoChildren) "." "INBOX" * LIST (\HasChildren) "." "test" * LIST (\HasNoChildren) "." "test.TEst" * LIST (\HasNoChildren) "." "test.Deleted Messages" * LIST (\HasNoChildren) "." "test.Junk" * LIST (\HasNoChildren) "." "test.Trash" * LIST (\HasNoChildren) "." "test.Sent" * LIST (\HasNoChildren) "." "test.Drafts" b OK List completed. From lazy404 at gmail.com Tue Aug 21 15:36:15 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 14:36:15 +0200 Subject: [Dovecot] segfault in mail_user_get_home() Message-ID: gdb ./src/imap/.libs/imap Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. (gdb) run Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7ffff7ffa000 [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". process 1104 is executing new program: /usr/local/dovecot/bin/doveconf [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". process 1104 is executing new program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Program received signal SIGSEGV, Segmentation fault. 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, home_r=0x7fffffffe308) at mail-user.c:310 310 if (user->home_looked_up) { (gdb) bt #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, home_r=0x7fffffffe308) at mail-user.c:310 #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at mdbox-storage.c:90 #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, set=0x7fffffffe4d0) at mdbox-storage.c:113 #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, set=0x7fffffffe4d0) at mail-storage.c:105 #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:180 #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, ns_p=0x645380, error_r=0x7fffffffe6e8) at mail-namespace.c:126 #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, error_r=0x7fffffffe6e8) at mail-namespace.c:289 #8 0x00007ffff7b34a64 in mail_storage_service_init_post (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, mail_user_r=0x7fffffffe7b8, error_r=0x7fffffffe6e8) at mail-storage-service.c:641 #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, user=0x633e08, mail_user_r=0x7fffffffe7b8) at mail-storage-service.c:1114 #10 0x00007ffff7b35efa in mail_storage_service_lookup_next (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, mail_user_r=0x7fffffffe7b8, error_r=0x7fffffffe808) at mail-storage-service.c:1149 #11 0x000000000041f61c in client_create_from_input (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, input_buf=0x0, error_r=0x7fffffffe808) at main.c:202 #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 /usr/local/dovecot/bin/doveconf -n # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32 x86_64 Debian wheezy/sid namespace test { list = children location = maildir:/root/test prefix = test. subscriptions = yes type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = subscriptions = yes } passdb { driver = pam } ssl = no userdb { driver = passwd } without type = shared there is no segfault, I understand this config might not work (invoking imap directly) but it should't segfault. Regards, Michal Grzedzicki From lazy404 at gmail.com Tue Aug 21 15:45:07 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 14:45:07 +0200 Subject: [Dovecot] segfault in mail_user_get_home() In-Reply-To: References: Message-ID: it was shared namespace with empty location that produced the error so : namespace test { list = children location = prefix = test. subscriptions = yes type = shared } segfaults with location is fine 2012/8/21, Lazy : > gdb ./src/imap/.libs/imap > > Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. > (gdb) run > Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap > warning: no loadable sections found in added symbol-file > system-supplied DSO at 0x7ffff7ffa000 > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > process 1104 is executing new program: /usr/local/dovecot/bin/doveconf > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > process 1104 is executing new program: > /usr/src/dovecot-2.1.9/src/imap/.libs/imap > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > > Program received signal SIGSEGV, Segmentation fault. > 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, > home_r=0x7fffffffe308) at mail-user.c:310 > 310 if (user->home_looked_up) { > (gdb) bt > #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, > home_r=0x7fffffffe308) at mail-user.c:310 > #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at > mdbox-storage.c:90 > #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, > set=0x7fffffffe4d0) at mdbox-storage.c:113 > #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, > set=0x7fffffffe4d0) at mail-storage.c:105 > #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, > driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) > at mail-storage.c:180 > #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, > driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 > #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, > ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, > ns_p=0x645380, > error_r=0x7fffffffe6e8) at mail-namespace.c:126 > #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, > error_r=0x7fffffffe6e8) at mail-namespace.c:289 > #8 0x00007ffff7b34a64 in mail_storage_service_init_post > (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, > mail_user_r=0x7fffffffe7b8, > error_r=0x7fffffffe6e8) at mail-storage-service.c:641 > #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, > user=0x633e08, mail_user_r=0x7fffffffe7b8) at > mail-storage-service.c:1114 > #10 0x00007ffff7b35efa in mail_storage_service_lookup_next > (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, > mail_user_r=0x7fffffffe7b8, > error_r=0x7fffffffe808) at mail-storage-service.c:1149 > #11 0x000000000041f61c in client_create_from_input > (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, > input_buf=0x0, > error_r=0x7fffffffe808) at main.c:202 > #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 > #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 > > /usr/local/dovecot/bin/doveconf -n > # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf > # OS: Linux 2.6.32 x86_64 Debian wheezy/sid > namespace test { > list = children > location = maildir:/root/test > prefix = test. > subscriptions = yes > type = shared > } > namespace inbox { > inbox = yes > list = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > subscriptions = yes > } > passdb { > driver = pam > } > ssl = no > userdb { > driver = passwd > } > > without type = shared there is no segfault, > > I understand this config might not work (invoking imap directly) but > it should't segfault. > > Regards, > > Michal Grzedzicki > From chris.visser at rtt.co.za Tue Aug 21 15:47:42 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 21 Aug 2012 12:47:42 +0000 Subject: [Dovecot] Spaces in DN with AD auth Message-ID: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> Hi guys, I'm back to fiddling with my Dovecot and AD intergation and I've noticed that if a DN contains spaces, dovecot doesn't bind to the AD server. I'm running: dovecot-2.1.1 exim-4.72 on CentOS 6.3 Exim binds fine with the DNs containing spaces, it's just dovecot that exhibits the symptoms. Chris Visser Linux/Network Infrastructure? ================== Please read our Email Disclaimer : http://www.rtt.co.za/disclaimer.html From me at junc.org Tue Aug 21 15:52:31 2012 From: me at junc.org (Benny Pedersen) Date: Tue, 21 Aug 2012 14:52:31 +0200 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> Message-ID: <05ae0f05a73de2768e0afa089c28ccdf@junc.org> Den 2012-08-21 14:47, Chris Visser skrev: > I'm back to fiddling with my Dovecot and AD intergation and I've > noticed that if a DN contains spaces, dovecot doesn't bind to the AD > server. that means you like to fix this in dovecot since its not AD that make the error in first place ? From chris.visser at rtt.co.za Tue Aug 21 15:59:58 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 21 Aug 2012 12:59:58 +0000 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <05ae0f05a73de2768e0afa089c28ccdf@junc.org> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> Message-ID: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Yes. Is it possible? If I try bind with a dn like: CN=Chris Visser,OU=Users,DC=mydomain,DC=com then I can't make the bind to AD, even though I can do it using exim and ldapsearch. Dovecot however binds if I use a dn like: CN=Chris,OU=Users,DC=mydomain,DC=com Chris Visser Linux/Network Infrastructure? -----Original Message----- From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Benny Pedersen Sent: Tuesday, August 21, 2012 2:53 PM To: dovecot at dovecot.org Subject: Re: [Dovecot] Spaces in DN with AD auth Den 2012-08-21 14:47, Chris Visser skrev: > I'm back to fiddling with my Dovecot and AD intergation and I've > noticed that if a DN contains spaces, dovecot doesn't bind to the AD > server. that means you like to fix this in dovecot since its not AD that make the error in first place ? ================== Please read our Email Disclaimer : http://www.rtt.co.za/disclaimer.html From me at junc.org Tue Aug 21 16:15:17 2012 From: me at junc.org (Benny Pedersen) Date: Tue, 21 Aug 2012 15:15:17 +0200 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Message-ID: <7b11ec35394fe151755e6d7b1b42452c@junc.org> Den 2012-08-21 14:59, Chris Visser skrev: > Dovecot however binds if I use a dn like: > CN=Chris,OU=Users,DC=mydomain,DC=com why not use it so ? From lazy404 at gmail.com Tue Aug 21 16:28:08 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 15:28:08 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: I managed to get it working using a litle change in sources an extra mailbox_list_subscription_fill_one(dest_list, src_list, "" ); in src/lib-storage/list/mailbox-list-subscriptions.c:mailbox_list_subscriptions_refresh() --- src/lib-storage/list/mailbox-list-subscriptions.c (wersja 494) +++ src/lib-storage/list/mailbox-list-subscriptions.c (kopia robocza) @@ -142,6 +142,9 @@ subsfile_ctx = subsfile_list_init(dest_list, path); if (subsfile_list_fstat(subsfile_ctx, &st) == 0) dest_list->subscriptions_mtime = st.st_mtime; + + mailbox_list_subscription_fill_one(dest_list, src_list, "" ); + while ((name = subsfile_list_next(subsfile_ctx)) != NULL) T_BEGIN { T_BEGIN { ret = mailbox_list_subscription_fill_one(dest_list, now lsub works as expected, namespace root which is an INBOX from a snapshot is subscribed, all the subfolders are also subscribed (from original subscriptions file). It whould be great if one could specify in the namespace mailboxes that whould get autosubscribed or just to autosubscribe root whitch is what You need if You have a copy of Maildir with INBOX. If You think this can be usefull I will try to produce more general patch automagicly subscribing root or any other mailbox in an namespace. Regards, Michal Grzedzicki 2012/8/21, Lazy : > 2012/8/19, Timo Sirainen : >> On 16.8.2012, at 14.58, Lazy wrote: >> >>> 2012/5/19 Timo Sirainen : >>>> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>>>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>>>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>>>> failed: Read-only file system >>>> >>>> Does the attached patch help? >>>> >>>>> maybe it will be easier to move all dovecot metadata to separate (non >>>>> snapshot) location ? >>>> >>>> It could also be a bit problematic. At least message keywords (=custom >>>> flags) wouldn't work because the dovecot-keywords file exists only in >>>> the snapshot dir. >>> >>> Moving metadata helped, but now archived inbox is unsubscribed. Is >>> there a way to make all folders in an namespace subscribed by default >>> ? >> >> Nope. I could try to get the snapshots fixed at some point when I have >> more >> time, but I'm not going to add a feature to subscribe everything by >> default. >> People might try to start using it. > > If I enable per snapshot subscriptions i see all folders except INBOX, > i have tried to subscribe it using > mailbox_list_subscription_fill_one() or using imap as bellow without > success > > http://dovecot.org/list/dovecot/2007-October/025965.html suggest that > it isn't possible > > ./imap/.libs/imap > * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID > ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS > MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED > I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as root > a subscribe "test" > a OK Subscribe completed. > a lsub "" "*" > imap(root): Warning: Subscriptions file /root/Maildir/subscriptions: > Removing invalid entry: > * LSUB () "." "Drafts" > * LSUB () "." "Sent" > * LSUB () "." "Junk" > * LSUB () "." "Trash" > * LSUB () "." "Deleted Messages" > * LSUB () "." "test.Drafts" > * LSUB () "." "test.Sent" > * LSUB () "." "test.Junk" > * LSUB () "." "test.Trash" > * LSUB () "." "test.Deleted Messages" > a OK Lsub completed. > b list "" "*" > * LIST (\HasNoChildren) "." "DUpa" > * LIST (\HasNoChildren) "." "Deleted Messages" > * LIST (\HasNoChildren) "." "Junk" > * LIST (\HasNoChildren) "." "Trash" > * LIST (\HasNoChildren) "." "Sent" > * LIST (\HasNoChildren) "." "Drafts" > * LIST (\HasNoChildren) "." "INBOX" > * LIST (\HasChildren) "." "test" > * LIST (\HasNoChildren) "." "test.TEst" > * LIST (\HasNoChildren) "." "test.Deleted Messages" > * LIST (\HasNoChildren) "." "test.Junk" > * LIST (\HasNoChildren) "." "test.Trash" > * LIST (\HasNoChildren) "." "test.Sent" > * LIST (\HasNoChildren) "." "test.Drafts" > b OK List completed. > From tss at iki.fi Tue Aug 21 17:37:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 21 Aug 2012 17:37:37 +0300 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Message-ID: On 21.8.2012, at 15.59, Chris Visser wrote: > Yes. Is it possible? > > If I try bind with a dn like: CN=Chris Visser,OU=Users,DC=mydomain,DC=com > then I can't make the bind to AD, even though I can do it using exim and ldapsearch. > > Dovecot however binds if I use a dn like: CN=Chris,OU=Users,DC=mydomain,DC=com Maybe the problem is simply that space isn't in auth_username_chars? If not, show doveconf -n, dovecot-ldap.conf and log output when auth_debug_passwords=yes (with a test user/pass). From slusarz at curecanti.org Tue Aug 21 20:31:46 2012 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 21 Aug 2012 11:31:46 -0600 Subject: [Dovecot] Search extensions In-Reply-To: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: <20120821113146.Horde.yqEaGoF5lbhQM8YCyLWQ2pA@bigworm.curecanti.org> Quoting Timo Sirainen : > The client can verify the results with the fetch. The "x-anyheader" > can already be implemented without changes to full text search > plugin, because all backends store message/MIME headers and body > text separately. > > So, questions for the list, especially client developers: > > 1) What's a better name for x-anyheader? :) Maybe X-ALLHEADERS? X-ANYHEADER seems ok also. Either one, if properly documented, would be easy enough to implement (I know that I personally never implement any IMAP command without staring at the RFCs so if you wanted to name it X-FUZZYWUZZY, that would also be fine). > I think one other thing missing has been "show me messages that have > attachments". I've thought about maybe creating a $hasattachments > keyword for that, which the server could automatically set for new > mails that it thinks has attachments (and clients can set/unset the > keyword if wanted). I think you are entering a *very* slippery slope when it comes to this feature. Because I believe that determination of what is an "attachment" is necessarily a client (read: UI) question, not a server question. See, e.g.: http://markmail.org/message/q4mjgbcxks5j4ue6 michael From zinovik.igor at gmail.com Tue Aug 21 20:51:18 2012 From: zinovik.igor at gmail.com (Igor Zinovik) Date: Tue, 21 Aug 2012 21:51:18 +0400 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section Message-ID: <5033CA96.3080305@gmail.com> Hello. I read on upgrading page that one can use UTF8 mailbox names for plugins. As i understand i do not need to convert UTF8 names to mUTF-7 and can use raw UTF8 in plugins section, e.g.: /etc/dovecot/dovecot.conf ... plugin { ... # Autocreate \Spam folder autocreate = ???? autosubscribe = ???? ... But what about sieve scripts and other configuration sections: 1. Do i need to convert UTF8 mailbox names in `namespace' section? namespace inbox { ... mailbox &BCEEPwQwBDw- { special_use = \Junk } 2. Do i need to convert UTF8 mailbox names in sieve scripts? /etc/dovecot/dovecot_before.sieve ... require ["reject","fileinto"]; # Put all spam into separete IMAP folder if header :contains "X-Spam-Flag" "YES" { fileinto "&BCEEPwQwBDw-"; } From stephan at rename-it.nl Tue Aug 21 22:10:03 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 21 Aug 2012 21:10:03 +0200 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section In-Reply-To: <5033CA96.3080305@gmail.com> References: <5033CA96.3080305@gmail.com> Message-ID: <5033DD0B.90602@rename-it.nl> On 8/21/2012 7:51 PM, Igor Zinovik wrote: > 2. Do i need to convert UTF8 mailbox names in sieve scripts? > /etc/dovecot/dovecot_before.sieve > > require ["reject","fileinto"]; > > # Put all spam into separete IMAP folder > if header :contains "X-Spam-Flag" "YES" { > fileinto "&BCEEPwQwBDw-"; > } The Sieve language only accepts UTF-8, making the above example wrong. That is also what Pigeonhole Sieve requires. The much older cmusieve plugin did use mUTF7, but I'm hoping that very few people are still using that. Regards, Stephan From leamhall at gmail.com Tue Aug 21 22:16:31 2012 From: leamhall at gmail.com (leam hall) Date: Tue, 21 Aug 2012 15:16:31 -0400 Subject: [Dovecot] Ways to poke and prod Dovecot? Message-ID: I'm a newbie and want to learn more about Dovecot. I can install it in a test bed but am not sure how to run it so it shows me what it's doing but i'm not actually mailing stuff. Is there a doc somewhere? Thanks! Leam -- Mind on a Mission From tlx at leuxner.net Tue Aug 21 22:20:12 2012 From: tlx at leuxner.net (Thomas Leuxner) Date: Tue, 21 Aug 2012 21:20:12 +0200 Subject: [Dovecot] Ways to poke and prod Dovecot? In-Reply-To: References: Message-ID: m 21.08.2012 um 21:16 schrieb leam hall : > I'm a newbie and want to learn more about Dovecot. I can install it in a > test bed but am not sure how to run it so it shows me what it's doing but > i'm not actually mailing stuff. Is there a doc somewhere? The Wiki is a good starting point listing several typical configurations: http://wiki2.dovecot.org/HowTo Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4364 bytes Desc: not available URL: From svoop at delirium.ch Tue Aug 21 22:38:48 2012 From: svoop at delirium.ch (Sven Schwyn) Date: Tue, 21 Aug 2012 21:38:48 +0200 Subject: [Dovecot] blf-crypt Message-ID: Hi The blf-crypt password schema mentioned in the docs could be a solution to my auth problem. However, the docs state that actual support depends on the glibc. Mine apparently doesn't. Does support depend on the glibc's version (mine is 2.15-r2)? Maybe someone with access to a box with a good enough glibc could do the following and post the hash for the plain password "test"? doveadm pw -s BLF-CRYPT Enter new password: test With this I could verify whether the BLF-CRYPT scheme would solve my problem in the first place without going through the hassle of upping the glibc. Thanks a bunch! From zucca at systemschmiede.com Wed Aug 22 02:44:00 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 22 Aug 2012 01:44:00 +0200 Subject: [Dovecot] Imap Ghost folder Message-ID: <50341D40.9090001@systemschmiede.com> Hi list, i have a strange "ghost" folder in my subscription list and just can't find out how to get rid of it. It seems to be someones Inbox, but it doesn't tell me whose. Here's a screenshot of Open-Xchanges Web-GUI: /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg / As you can see there is an unamed folder just under Freigaben (Shares). In Thunderbird: /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ Now the Folder is "INBOX"...But it is noones Inbox, as the corresponding user (amazon e.g.) should be a prefix-folder right before the share. some output over Telnet: 1 lsub "" "*" * LSUB () "/" "INBOX" * LSUB () "/" "INBOX/Amazon" * LSUB () "/" "INBOX/Bestellung" * LSUB () "/" "Drafts" * LSUB () "/" "Sent Items" * LSUB () "/" "Spam" * LSUB () "/" "Trash" * LSUB () "/" "Freigaben/amazon/INBOX" 1 OK Lsub completed. 1 list "" "*" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Sent Items" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasNoChildren) "/" "INBOX/Amazon" * LIST (\HasNoChildren) "/" "INBOX/Bestellung" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Drafts" * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" 1 OK List completed. This looks a bit strange to me: * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" But i don't know really if that is the ghostfolder. finally here's the interesting part in my dovecot.conf: / namespace private { separator = / prefix = #location defaults to mail_location. inbox = yes } namespace shared { separator = / prefix = Freigaben/%%n/ location = maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ subscriptions = no list = children inbox = no } / Any idea how to banish the ghost in the machine? Thank you very much Sascha -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From amateo at um.es Wed Aug 22 11:01:08 2012 From: amateo at um.es (Angel L. Mateo) Date: Wed, 22 Aug 2012 10:01:08 +0200 Subject: [Dovecot] exclude a folder for lazy expunge (move to trash) Message-ID: <503491C4.7030208@um.es> Hello, I'm configuring lazy expunge plugin to act as a kind of backup of my user's emails. I'm getting a little problem because a lot of my users use "move to trash" behaviour in their email client (most of them are using thunderbird which has no option to hide deleted messages and is a hassle working with mark as deleted with it). The problem combining move to trash with lazy expunge is that messages are stored in the expunge namespace twice, first when it was deleted from the original folder and the second when is deleted from the trash. So... is there any way to exclude trash folder from lazy expunge plugin, so mails are stored in the expunge namespace only when they are deleted from their original folder and not from the trash? Another idea... We are purging trash folders with a cron running "doveadm purge" commands. Is there any way to run this command disabling lazy expunge plugin? Any other idea not to duplicate these emails? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From tss at iki.fi Wed Aug 22 16:56:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 16:56:20 +0300 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting In-Reply-To: <20120813161251.GB14149@arachsys.com> References: <20120813161251.GB14149@arachsys.com> Message-ID: <1345643780.13571.33.camel@hurina> On Mon, 2012-08-13 at 17:12 +0100, Chris Webb wrote: > Sharing an installed copy of dovecot between several users each running > a daemon within their own account (or using the same binaries for a > system daemon and a user daemon) is difficult because the compile-time > directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the > location of things like the ssl-parameters.dat file and the replicator > database. > > Replace all these uses of PKG_STATEDIR with a state_dir setting which > defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the > same way base_dir can be used to override PKG_RUNDIR. Committed to v2.2 with some changes: http://hg.dovecot.org/dovecot-2.2/rev/543852ebb327 From david at wordshell.net Wed Aug 22 09:56:04 2012 From: david at wordshell.net (David Anderson) Date: Wed, 22 Aug 2012 09:56:04 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users Message-ID: <50348284.8050609@wordshell.net> Self-explanatory, I hope (note the period on the end of the username); sieve/pigeonhole does not allow you to have senders which end with a period, which means that any UNIX users with such usernames who send mail have it rejected by sieve: # useradd testuser. # su - testuser. $ mail david at example.com -s 'testing' 123 . [testuser. at levi ~]$ logout # less /var/log/maillog Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: envelope sender address 'testuser. at myhost.example.com' is unparsable Versions: dovecot-pigeonhole-0.2.6-21.el5 dovecot-managesieve-0.2.6-21.el5 dovecot-2.0.18-1_134.el5 Why would anyone have a UNIX username ending in a period? For one, web hosting companies may use your domain name as your username - but be subject to a 32-character limit, so your domain name gets truncated. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From tss at iki.fi Wed Aug 22 17:36:34 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 17:36:34 +0300 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section In-Reply-To: <5033CA96.3080305@gmail.com> References: <5033CA96.3080305@gmail.com> Message-ID: <1345646194.13571.34.camel@hurina> On Tue, 2012-08-21 at 21:51 +0400, Igor Zinovik wrote: > I read on upgrading page that one can use UTF8 mailbox names for > plugins. As i understand i do not need to convert UTF8 names to mUTF-7 > and can use raw UTF8 in plugins section, e.g.: > /etc/dovecot/dovecot.conf You couldn't need to use mUTF7 anywhere at all anymore. If you do, it's a bug. From lgb at lgb.hu Wed Aug 22 18:16:25 2012 From: lgb at lgb.hu (=?iso-8859-1?B?R+Fib3IgTOlu4XJ0?=) Date: Wed, 22 Aug 2012 17:16:25 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: <20120822151624.GC22547@vega.lgb.hu> Hi, On Wed, Aug 22, 2012 at 09:56:04AM +0300, David Anderson wrote: > Self-explanatory, I hope (note the period on the end of the > username); sieve/pigeonhole does not allow you to have senders which > end with a period, which means that any UNIX users with such > usernames who send mail have it rejected by sieve: > > # useradd testuser. > # su - testuser. > $ mail david at example.com -s 'testing' > 123 > . > [testuser. at levi ~]$ logout > > # less /var/log/maillog > > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: > envelope sender address 'testuser. at myhost.example.com' is unparsable Afaik local-part can't have period as the first or the last character by RFC ... But correct me if I am wrong. At least according to wikipedia: The local-part of the email address may use any of these ASCII characters RFC 5322 Section 3.2.3, RFC 6531 permits Unicode beyond the ASCII range: [...] Character . (dot, period, full stop) (ASCII: 46) provided that it is not the first or last character, and provided also that it does not appear two or more times consecutively (e.g. John..Doe at example.com is not allowed.). http://en.wikipedia.org/wiki/Email_address#Local_part I think nowdays it's a bit outdated to have 1:1 mapping between UNIX users and email addresses anyway. Maybe it's OK, but it's surely problematic in case of mass hosting with many users with policies like you mentioned as well. Virtual users (in the sense of MTA/IMAP/etc servers) are much better idea, in my oppinion. It's OK for a small "server" used for own purposes for example. But it's only my opinion ... From david at wordshell.net Wed Aug 22 18:45:17 2012 From: david at wordshell.net (David Anderson) Date: Wed, 22 Aug 2012 18:45:17 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <20120822151624.GC22547@vega.lgb.hu> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> Message-ID: <5034FE8D.2030704@wordshell.net> On 22/08/12 18:16, G?bor L?n?rt wrote: > I think nowdays it's a bit outdated to have 1:1 mapping between UNIX > users and email addresses anyway. Maybe it's OK, but it's surely > problematic in case of mass hosting with many users with policies like > you mentioned as well. Virtual users (in the sense of MTA/IMAP/etc > servers) are much better idea, in my oppinion. It's OK for a small > "server" used for own purposes for example. But it's only my opinion ... There are no incoming mail accounts for those users. The server in question is a webserver. Every website has a unique UNIX user, for security when running scripts. You can't virtualise that. If you run all your scripts under the same UNIX user on a shared server, then it's less secure. Sieve was complaining about the envelope *sender* address being invalid, on a piece of outgoing mail (generated by the website). It wasn't about incoming mail or maintaining accounts. That's a bit academic, though. It think the main points are that: * Many Unixes allow you to set up usernames ending in periods * The MTAs also allow you to send and receive mail using those periods Strictly according to the RFC, the address is invalid. But if the MTA accepts it, why should sieve reject it? Sieve is deployed to apply filters to mail - not to make policy decisions on valid email addresses. That's a layering violation. If my MTA accepts the mail,and then the dovecot LDA does too, I don't want sieve to over-turn the decision. It's not sieve's job to enforce that part of the RFC and over-rule the MTA and LDA. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From lgb at lgb.hu Wed Aug 22 19:20:55 2012 From: lgb at lgb.hu (=?iso-8859-1?B?R+Fib3IgTOlu4XJ0?=) Date: Wed, 22 Aug 2012 18:20:55 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <5034FE8D.2030704@wordshell.net> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> <5034FE8D.2030704@wordshell.net> Message-ID: <20120822162055.GD22547@vega.lgb.hu> On Wed, Aug 22, 2012 at 06:45:17PM +0300, David Anderson wrote: > There are no incoming mail accounts for those users. The server in > question is a webserver. Every website has a unique UNIX user, for > security when running scripts. You can't virtualise that. If you run > all your scripts under the same UNIX user on a shared server, then > it's less secure. > > Sieve was complaining about the envelope *sender* address being > invalid, on a piece of outgoing mail (generated by the website). It > wasn't about incoming mail or maintaining accounts. I guess what an RFC says about "email address syntax" is valid rule for both sender _and_ recipient. Mails are usually filtered to check they are valid, for example a *sender* what you mentioned as an example would not be able to send mails to our ISP since syntax of sender address are checked on the MX MTAs as well. So I don't see too much point to send mails with invalid (by RFC) sender as most mail softwares and/or MTA admin's configuration will reject it, like with your example, check the subject out of your mail. I guess it's a valid decision to reject these. But _again_: I can be wrong here. > That's a bit academic, though. It think the main points are that: > > * Many Unixes allow you to set up usernames ending in periods > * The MTAs also allow you to send and receive mail using those periods > > Strictly according to the RFC, the address is invalid. But if the > MTA accepts it, why should sieve reject it? Sieve is deployed to Which MTA? Our ISP would reject those, for example. It's matter of the kind of the MTA, and also its configuration, but since according to the RFC which says that invalid, it's not so suprising that some people and/or mail related software decide not to accept. For sure, there can be softwares/configs which allows it. It clearly shows that it's better to avoid addresses which are often handled as invalid ("but not always", it depends, yes), especially if "standards" says they are invalid as well. > apply filters to mail - not to make policy decisions on valid email > addresses. That's a layering violation. Well, it's bit out of scope my intent, also I am not instered to start a flame war or so :) I just wanted to point out that it's anyway a very bad idea to use invalid addresses even if it can be said as true that sieve should not reject things if it's MTA's job ... The basic idea is the same: why do you want to use them, if there are problems with these anyway, and sooner or later you will hit a rejection, even if sieve is "fixed" not having this decision as well. Creating a system which use known to be invalid things (even if it works locally, or other similar examples) are a "good" sign to introduce "interesting" and hard-to-track-down problems later, maybe in the more far future only. I can't say anything about sieve itself, to be honest, anyway, and your suggestion that it must be fixed or not. Again, sorry if someone treated my mail as OT/flame/whatever. From zinovik.igor at gmail.com Wed Aug 22 23:01:15 2012 From: zinovik.igor at gmail.com (Igor Zinovik) Date: Thu, 23 Aug 2012 00:01:15 +0400 Subject: [Dovecot] difference between namespace auto=subscribe and autocreate plugin Message-ID: <50353A8B.8000904@gmail.com> Hello. I read docs, but still do not understand difference between following configuration options: namespace inbox { # Create and subscribe to folder mailbox Drafts { auto=subscribe } and `autocreate' plugin plugin { autocreate = inbox.Drafts autosubscribe = inbox.Drafts On wiki page that describes `autocreate' plugin i read: ... mailboxes that must always exist for all users. So even if user delete Drafts IMAP folder on next connection server will create it. Is `mailbox' undocumented feature? I see it only in configuration file, but wiki does not mention it. From tss at iki.fi Wed Aug 22 23:07:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 23:07:37 +0300 Subject: [Dovecot] difference between namespace auto=subscribe and autocreate plugin In-Reply-To: <50353A8B.8000904@gmail.com> References: <50353A8B.8000904@gmail.com> Message-ID: <732BA52B-944D-465E-8BF4-C851E2E1A8D1@iki.fi> On 22.8.2012, at 23.01, Igor Zinovik wrote: > I read docs, but still do not understand difference between following > configuration options: > > namespace inbox { > # Create and subscribe to folder > mailbox Drafts { auto=subscribe } > > and `autocreate' plugin > > plugin { > autocreate = inbox.Drafts > autosubscribe = inbox.Drafts Zero difference. autocreate plugin is deprecated, the auto=subscribe is the new way, the plugin is simply a small wrapper to it. Yeah, the wiki should be updated to say this. From zucca at systemschmiede.com Wed Aug 22 23:12:34 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 22 Aug 2012 22:12:34 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <50341D40.9090001@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> Message-ID: <50353D32.2080401@systemschmiede.com> If you should need any more info on this, just drop me a line. I am fully stuck! I think that my dovecot.conf is not put together well, only i can't find the problem... Thanx Sascha Am 22.08.2012 01:44, schrieb Sascha Zucca: > Hi list, > i have a strange "ghost" folder in my subscription list and just can't > find out how to get rid of it. > It seems to be someones Inbox, but it doesn't tell me whose. > > Here's a screenshot of Open-Xchanges Web-GUI: > /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg > / > As you can see there is an unamed folder just under Freigaben (Shares). > > > In Thunderbird: > /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ > > Now the Folder is "INBOX"...But it is noones Inbox, as the > corresponding user (amazon e.g.) should be a prefix-folder right > before the share. > > > some output over Telnet: > > 1 lsub "" "*" > * LSUB () "/" "INBOX" > * LSUB () "/" "INBOX/Amazon" > * LSUB () "/" "INBOX/Bestellung" > * LSUB () "/" "Drafts" > * LSUB () "/" "Sent Items" > * LSUB () "/" "Spam" > * LSUB () "/" "Trash" > * LSUB () "/" "Freigaben/amazon/INBOX" > 1 OK Lsub completed. > > > 1 list "" "*" > * LIST (\HasNoChildren) "/" "Trash" > * LIST (\HasNoChildren) "/" "Sent Items" > * LIST (\HasChildren) "/" "INBOX" > * LIST (\HasNoChildren) "/" "INBOX/Amazon" > * LIST (\HasNoChildren) "/" "INBOX/Bestellung" > * LIST (\HasNoChildren) "/" "Spam" > * LIST (\HasNoChildren) "/" "Drafts" > * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" > 1 OK List completed. > > > This looks a bit strange to me: > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > But i don't know really if that is the ghostfolder. > > > finally here's the interesting part in my dovecot.conf: > / > namespace private { > separator = / > prefix = > #location defaults to mail_location. > inbox = yes > } > > namespace shared { > separator = / > prefix = Freigaben/%%n/ > location = > maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ > subscriptions = no > list = children > inbox = no > } > / > > Any idea how to banish the ghost in the machine? > > Thank you very much > Sascha > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From patrickdk at patrickdk.com Thu Aug 23 03:47:54 2012 From: patrickdk at patrickdk.com (Patrick Domack) Date: Wed, 22 Aug 2012 20:47:54 -0400 Subject: [Dovecot] blf-crypt In-Reply-To: References: Message-ID: <20120822204754.Horde.-FZmPpLnE6FQNX26KBNk2GA@mail.patrickdk.com> BLF-CRYPT has been part of glibc for a very very long time. it uses the blowfish crypt version, that have been changed like 4 times now, do to issues with it. I'm not sure why CRYPT wouldn't work for you, seems to work fine in my dovecot installs. I'm not sure where the dovecot < 2.0 can use {CRYPT} came from. I'm using that, since 0.7x? or somewhere around there, all the way up through, and currently 2.1.7 without issue. Quoting Sven Schwyn : > Hi > > The blf-crypt password schema mentioned in the docs could be a > solution to my auth problem. However, the docs state that actual > support depends on the glibc. Mine apparently doesn't. > > Does support depend on the glibc's version (mine is 2.15-r2)? > > Maybe someone with access to a box with a good enough glibc could do > the following and post the hash for the plain password "test"? > > doveadm pw -s BLF-CRYPT > Enter new password: test > > With this I could verify whether the BLF-CRYPT scheme would solve my > problem in the first place without going through the hassle of > upping the glibc. > > Thanks a bunch! From ncjeffgus at zimage.com Thu Aug 23 05:02:36 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Wed, 22 Aug 2012 19:02:36 -0700 Subject: [Dovecot] more dsync issues Message-ID: <1345687356.3986.11.camel@maclinux> It hit another dsync snag. We have a script that executes a dsync backup command to a remote host. No write should be happening on the remote host (the backup host). The error is: dsync-local(anonymous at domain.com): Error: remote: dsync-remote(anonymous at domain.com): Error: Can't delete mailbox INBOX: INBOX can't be deleted. dsync-remote(anonymous at domain.com): Error: command MSG-SAVE failed dsync-local(anonymous at domain.com): Error: read() from worker server failed: EOF dsync-local(anonymous at domain.com): Error: Unexpected reply from server: dsync-local(anonymous at domain.com): Warning: Mailbox changes caused a desync. You may want to run dsync again. We're currently running 2.1.7 since > 2.1.8 causes a problem with our webmail software. ...Jeff From david at wordshell.net Thu Aug 23 09:46:36 2012 From: david at wordshell.net (David Anderson) Date: Thu, 23 Aug 2012 09:46:36 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <20120822162055.GD22547@vega.lgb.hu> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> <5034FE8D.2030704@wordshell.net> <20120822162055.GD22547@vega.lgb.hu> Message-ID: <5035D1CC.9060005@wordshell.net> On 22/08/12 19:20, G?bor L?n?rt wrote: > I guess what an RFC says about "email address syntax" is valid rule for both > sender _and_ recipient. Perhaps it would be best if dovecot applied a policy (whatever policy) consistently. It was a surprise to me to transition from CMU sieve to Pigeonhole sieve and find that Dovecot LDA now was happy to deliver the mail, but that Pigeonhole sieve was unhappy. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From dmalolepszy at optusnet.com.au Thu Aug 23 09:48:20 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Thu, 23 Aug 2012 16:48:20 +1000 Subject: [Dovecot] Dovecot generate file when over quota detected Message-ID: <5035D234.50306@optusnet.com.au> Hi, I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. This means that an MTA can efficiently check for the existence of this 'overquota' file and return a "user at domain.com Mailbox full" TEMPFAIL error early during the SMTP transaction prior to accepting any data. Dominic From amateo at um.es Thu Aug 23 11:38:48 2012 From: amateo at um.es (Angel L. Mateo) Date: Thu, 23 Aug 2012 10:38:48 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <5035EC18.3020807@um.es> El 01/08/12 20:10, Timo Sirainen escribi?: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > >>> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >>> >>> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >>> >>> service ipc { >>> unix_listener ipc { >>> user = dovecot >>> } >>> } >> >> Thanks, Timo. >> >> Does this apply to the mailbox config or the director config? >> Which instance needs to access the ipc socket of which instance? > > director instance needs access to director instance. > With this configuration, doveadm director move now works correctly, kicking user's connection in the old backend server. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From frank at celebrate.de Thu Aug 23 16:37:14 2012 From: frank at celebrate.de (Frank Kirschner) Date: Thu, 23 Aug 2012 15:37:14 +0200 Subject: [Dovecot] MailDir Issue Message-ID: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> Hello List, I'm still running dovecot in version 1.1.7 No I have setup a new installation with dovecot 2.0.9 and had running some tests with a testdomain. Everything is working well. The Maildir has exactly the same structure like ../domain/username/... Can I copy the whole maildir to the new server? Logical that I have also to move the SMTP network configuration to the new machine. best regards Frank From tth at rfa.cz Thu Aug 23 16:40:23 2012 From: tth at rfa.cz (TeTeHacko) Date: Thu, 23 Aug 2012 15:40:23 +0200 Subject: [Dovecot] pop3 migration Message-ID: <503632C7.2070008@rfa.cz> Hi, I have problems with pop3 migration, the server disconect the dovesync when fetching mails after 5 minutes with this error in server log: xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6548 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 47522 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6549 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 355289 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6550 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 9638 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6551 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 2188 octets xx.xx.xx.xx [28F4] 11:59:05 >>> -ERR Command unrecognized: "" xx.xx.xx.xx [28F4] 11:59:05 *** 6551 477693894 00:12:55 ERROR xx.xx.xx.xx [28F4] 11:59:05 Disconnected and this in dovecot log: dsync(info at istan.cz): Debug: imapc(mail.stable.cz:143): Authenticated successfully dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Looking up IP address dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Connecting to 88.86.120.212:110 dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Authenticating as info at istan.cz dsync(info at istan.cz): Error: pop3c(mail.stable.cz): Server disconnected unexpectedly dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 1: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 2: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 3: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 4: Disconnected is there any timeout in dovecot for 300s? can anybody point me where may be some problem? This error occurs everytime i test it and the mail box has cca 2GB, on small mailboxes is no problem, i try this patch: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d on dovecot version 2.1.7 but the problem isn't solved. Thanks for help Tomas Herceg From robert at schetterer.org Thu Aug 23 19:24:20 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 23 Aug 2012 18:24:20 +0200 Subject: [Dovecot] MailDir Issue In-Reply-To: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> References: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> Message-ID: <50365934.5030205@schetterer.org> Am 23.08.2012 15:37, schrieb Frank Kirschner: > Hello List, > > I'm still running dovecot in version 1.1.7 > No I have setup a new installation with dovecot 2.0.9 and had running some > tests with a testdomain. Everything is working well. The Maildir has exactly > the same structure like ../domain/username/... > > Can I copy the whole maildir to the new server? Logical that I have also to > move the SMTP network configuration to the new machine. > > best regards > Frank > you may try , but i would recommand use imapsync etc -- Best Regards MfG Robert Schetterer From adam at rosi-kessel.org Thu Aug 23 19:55:25 2012 From: adam at rosi-kessel.org (Adam Rosi-Kessel) Date: Thu, 23 Aug 2012 12:55:25 -0400 Subject: [Dovecot] Dovecot / Win8 Mail App Folder Subscription Issue Message-ID: <5036607D.8080100@rosi-kessel.org> Win8 RTM Mail App now supports IMAP. I am running Dovecot 1.2.15 on a Debian Stable server. The App works fine except the list of folders displayed seems to be a random subset of all my folders. I can't figure out how it's picking which folders to show, or how to change what's subscribed. Editing the "subscriptions" folder in ~/Maildir/ doesn't seem to have any impact. Any suggestions on how to troubleshoot or narrow done this issue? I posted to a Microsoft forum but was told the Mail App will only support official email providers. From tss at iki.fi Thu Aug 23 21:30:21 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 21:30:21 +0300 Subject: [Dovecot] For the wishlist In-Reply-To: <20120807124305.GA13644@ruhr-uni-bochum.de> References: <20120807124305.GA13644@ruhr-uni-bochum.de> Message-ID: On 7.8.2012, at 15.43, Jost Krieger wrote: > I would like very much to have a "doveadm copy", which probably could be > made out of "doveadm move" by removing ca. 2 lines (and changing a few > strings from "move" to "copy"). OK: http://hg.dovecot.org/dovecot-2.1/rev/9d35aca14c81 From tss at iki.fi Thu Aug 23 21:50:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 21:50:16 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> On 14.8.2012, at 11.18, Timo Sirainen wrote: >> As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? > > Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c From tss at iki.fi Thu Aug 23 22:00:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:00:10 +0300 Subject: [Dovecot] Auth worker max line size In-Reply-To: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> References: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> Message-ID: <19A4E62F-42A0-4FDD-AD68-31C1B26B9E65@iki.fi> On 16.8.2012, at 4.07, Emmanuel Dreyfus wrote: > 38 month ago, I submitted a patch to increase > AUTH_WORKER_MAX_LINE_LENGTH to use exotic authentication scheme (see > message below). The patch was accepted, but now I upgrade to dovecot > 2.1.7, I face the same problem with MASTER_AUTH_MAX_DATA_SIZE. I had to > increase it from 1024 to 4096. > > Is it safe to do so? Would such a change be accepted upstream? The patch > is below. Couldn't you change the client to use AUTHENTICATE PLAIN command instead? The buffer wouldn't be a problem then.. From tss at iki.fi Thu Aug 23 22:22:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:22:45 +0300 Subject: [Dovecot] No status for INBOX/* in mbox NS (2.1.6) In-Reply-To: <20120817094601.GB21534@ruhr-uni-bochum.de> References: <20120817094601.GB21534@ruhr-uni-bochum.de> Message-ID: On 17.8.2012, at 12.46, Jost Krieger wrote: > Most of our users still have mboxes in the classical layout, so you > can't have subfolders and messages in the same folder, *except for the > INBOX*, as it is physically separate. > > Someone complained that he saw subfolders in roundcube he couldn't > delete, because they didn't show up in the subscription view. > > Before hitting on roundcube, I mperformed a few checks and got the > following: > > root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/*' > root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/test1' > INBOX/test1 messages=0 Fixed & added to regression tests: http://hg.dovecot.org/dovecot-2.1/rev/b8173f8a1447 From tss at iki.fi Thu Aug 23 22:57:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:57:23 +0300 Subject: [Dovecot] Problem use localized prefix in namespace In-Reply-To: References: Message-ID: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> On 17.8.2012, at 21.37, (Dovecot) Sergey Sidlyarenko wrote: > Problem with localized prefix in namespace. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/ade94fde249e From tss at iki.fi Thu Aug 23 22:58:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:58:23 +0300 Subject: [Dovecot] Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators) In-Reply-To: <502CD9F0.1060801@rocnet.de> References: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> <502CD9F0.1060801@rocnet.de> Message-ID: The assert crash I think is fixed already in v2.1.9. The folder structure can be changed with mail_shared_explicit_inbox=no On 16.8.2012, at 14.30, Claus Rosenberger wrote: > Could i send some more informations about this topic? I'm not sure whats > happening here but i think it has something to do with the shared mailboxes. > With cyrus i had following folder structure: > > user1 -> inbox -> subfolders > -> user -> user1 > -> user2 > > > With dovecot the folder structure look like: > > user1 -> inbox -> subfolders > -> shared -> user1 -> inbox > -> user2 -> inbox > > is there any way to show inbox directly in user1/user2 folder without > having an inbox subfolder? > > > > Am 22.07.2012 00:04, schrieb Claus Rosenberger: >> Hi, >> >> with fetching the folder structure with the webclient Tine i can see following error messages inside of the logfiles: >> >> Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) >> >> Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x448fa) [0x7f70036db8fa] -> /usr/lib/dovecot/libdovecot.so.0(+0x44946) [0x7f70036db946] -> /usr/lib/dovecot/libdovecot.so.0(+0x1b8ca) [0x7f70036b28ca] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open_stream+0) [0x7f70039a1550] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f70039a156f] -> dovecot/imap(cmd_select_full+0x14a) [0x40db1a] -> dovecot/imap(command_exec+0x3d) [0x41160d] -> dovecot/imap() [0x41058e] -> dovecot/imap() [0x41066d] -> dovecot/imap(client_handle_input+0x135) [0x410895] -> dovecot/imap(client_input+0x5f) [0x4111bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f70036e7ea6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f70036e8f2f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f70036e7e48] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f70036d4103] -> dovecot/imap(main+0x2a5) [0x419695] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f7003353c8d] -> dovecot/imap() [0x408f49] >> >> Fatal: master: service(imap): child 21152 killed with signal 6 (core dumps disabled) >> > From tss at iki.fi Thu Aug 23 23:00:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:00:00 +0300 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: On 18.8.2012, at 0.12, Lutz Pre?ler wrote: >>> inthread refs younger 604800 >>> >>> This works as expected for the first time. But later on, also older messages/ >>> threads are included until I delete the virtual/.week/dovecot.index*. >> >> I know there are problems related to this with INTHREAD, but they aren't >> very easy to solve and for now I've more important things to do.. If it >> seemed to work before, it was due to luck or due to some bug causing an >> unnecessary index rebuild. You could set :INDEX=MEMORY to work around >> this, but I don't know how much worse the performance would become. Or >> you could just manually delete the virtual indexes once a week. > Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ > enhance now? Any estimate how much effort it would be? Just about the same amount of work I think. I haven't really looked at virtual plugin for a while, so I can't easily say how much work it would be. But my guess is that it wouldn't be easy. From tss at iki.fi Thu Aug 23 23:01:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:01:23 +0300 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> Message-ID: On 19.8.2012, at 12.51, Michael Grimm wrote: >>> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >>> >>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >>> >>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >>> >>> JFTR: I do have mail_log plugin activated. >> >> Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. > > > I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? Not enable mail_log for doveadm: protocol !doveadm { mail_plugins = $mail_plugins = mail_log } or alternatively override it only for the dsync command with doveadm -o mail_plugins=... From tss at iki.fi Thu Aug 23 23:03:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:03:00 +0300 Subject: [Dovecot] userdb multiple databases In-Reply-To: <5031F673.8040702@um.es> References: <5031F673.8040702@um.es> Message-ID: <7D274FA9-B3B7-49AB-B12A-7F6932ECA3A9@iki.fi> On 20.8.2012, at 11.33, Angel L. Mateo wrote: > I'm trying to configure per user plugins. My original passdb and userdb is in a ldap directory (using userdb with prefetch). > > To configure per user plugins (in fact, I want to enable quota plugin for some users) I need to configure mail_plugins attribute in the userdb. > > The problem is that I don't know any ldap attribute to store this information (is there any schema with includes an attribute for this). So I want to configure it in a passwd-file file. > > My problem is that I don't know if I can chain userdb databases. I know I can configure multiple databases, but as far as I know, they are looked in order, so if the user is found in the first one, then is no look for the user in the second one, so I have to configure all user's attributes in the passwd-file database. Correct. > Is there any way to chain these lookups? No. You could generate the passwd-file based on data in LDAP. From tss at iki.fi Thu Aug 23 23:05:33 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:05:33 +0300 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <503223EE.3030801@um.es> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> <503223EE.3030801@um.es> Message-ID: <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> On 20.8.2012, at 14.47, Angel L. Mateo wrote: > The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. > > But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error > > Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline > > and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. You can't do it with one passwd-file, you'd have to use multiple per-protocol passwd files.. For example: userdb passwd-file { args = /etc/dovecot/passwd.%s } Yeah, passwd-files aren't very flexible for things like these. Maybe you should look into using sqlite? It probably allows some if() or case() in the query (I haven't used sqlite). From tss at iki.fi Thu Aug 23 23:08:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:08:38 +0300 Subject: [Dovecot] Is it possible to save only some messages compressed to mdbox? (2.1.6) In-Reply-To: <20120820130617.GT24203@ruhr-uni-bochum.de> References: <20120820130617.GT24203@ruhr-uni-bochum.de> Message-ID: On 20.8.2012, at 16.06, Jost Krieger wrote: > So here's the questions: > > 1. Is it possible to have compressed/uncompressed mails mixed in an > mdbox? Yes. Compression is detected on a per-mail basis. > 2. Will it work via "-o" in lda delivery? > > I tried to find out in the source but found it hard to see which options > are pulled in when. -o can override all settings that are handled by the running process itself, so yes that includes compression stuff. From tss at iki.fi Thu Aug 23 23:11:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:11:38 +0300 Subject: [Dovecot] Error: Couldn't open INBOX: Timeout while waiting for lock In-Reply-To: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> References: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> Message-ID: <8572F459-1569-4FE2-87EA-A7A0C738A876@iki.fi> On 21.8.2012, at 8.42, Kavish Karkera wrote: > My users are frequetly getting the below error, > > Aug 21 00:04:18 blade6 dovecot: pop3-login: proxy(hgl_dipak): Login failed to 192.168.1.43:110: [IN-USE] Couldn't open INBOX: Timeout while waiting for lock. > > We are proxing pop connections from one pop server (dovecot version 1.1.20) i.e 192.168.1.39 to the other pop Server (Dovecot version 2.0.16 ) i.e 192.168.1.4. > > We have set pop3_lock_session = yes and dont want to disable it. Are your users behind bad internet connections that leave dead connections lying around? If so, maybe changing the kernel's TCP keepalive value to something very aggressive (e.g. 10 secs) would fix those. Of course that makes other traffic behave worse. From warren at decoy.co.za Thu Aug 23 23:26:59 2012 From: warren at decoy.co.za (Warren Baker) Date: Thu, 23 Aug 2012 22:26:59 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> Message-ID: On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: > On 14.8.2012, at 11.18, Timo Sirainen wrote: > > v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? -- .warren From tss at iki.fi Thu Aug 23 23:49:44 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:49:44 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> Message-ID: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> On 23.8.2012, at 23.26, Warren Baker wrote: > On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >> On 14.8.2012, at 11.18, Timo Sirainen wrote: >> >> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c > > Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). From daryl at isletech.net Thu Aug 23 23:57:40 2012 From: daryl at isletech.net (Daryl Richards) Date: Thu, 23 Aug 2012 16:57:40 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <50369944.4050107@isletech.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 12-08-23 4:49 PM, Timo Sirainen wrote: > On 23.8.2012, at 23.26, Warren Baker wrote: > >> On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >>> On 14.8.2012, at 11.18, Timo Sirainen wrote: >>> >>> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c >> >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). > Well, here's a "We use it" if you need it.. It probably just makes sense to block all out all RFC1918 addresses.. - -- Daryl Richards Isle Technical Services Inc. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlA2mUMACgkQbMWpShDgLrWMSQCfY9tBtDvgVuQDMjUbbNlyGkUb yNQAn2u1tHOZkZc7dugeXaLQ/mfmBFvP =lQb3 -----END PGP SIGNATURE----- From lists at luigirosa.com Fri Aug 24 07:56:41 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Fri, 24 Aug 2012 06:56:41 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <50370989.3010402@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Timo Sirainen said the following on 23/08/12 22:49: >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > Is it actually used? :) YES! I have a big customer (400 PCs) with 172.16.0.0/16 internal network and a subnet of 192.168.0.0 for DMZ I use it more than 192.168 when I create networks. Ciao, luigi - -- / +--[Luigi Rosa]-- \ Walk softly and carry a megawatt laser. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlA3CYkACgkQ3kWu7Tfl6ZSRaQCgy1YilsGEL7JXIDabKm+zSjZN cvEAoKYqE1ZjbR/g1XTiHUvlfpPuvWAE =RSAO -----END PGP SIGNATURE----- From voytek at sbt.net.au Fri Aug 24 08:18:56 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 24 Aug 2012 15:18:56 +1000 Subject: [Dovecot] Disable security for testing? Message-ID: <6fbbd67b-dc1e-4875-826f-e646751d6278@email.android.com> I want to offer 'plain' unsecure pop/imap access, just for temp. testing purpose, do I simply comment out ssl = required ? Voytek -- Swyped on Motrix with K-9 Mail. Please excuse my brevity. From Lutz.Pressler at SerNet.DE Fri Aug 24 10:28:10 2012 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Fri, 24 Aug 2012 09:28:10 +0200 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: On Thu, 23 Aug 2012, Timo Sirainen wrote: > On 18.8.2012, at 0.12, Lutz Pre?ler wrote: > > >>> inthread refs younger 604800 > >>> > >>> This works as expected for the first time. But later on, also older messages/ > >>> threads are included until I delete the virtual/.week/dovecot.index*. > >> [...] > > Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ > > enhance now? Any estimate how much effort it would be? > > Just about the same amount of work I think. I haven't really looked at virtual plugin for a while, so I can't easily say how much work it would be. But my guess is that it wouldn't be easy. > Thanks. To force MEMORY indexes only (with location option in namespace or forcibly - with warnings - by having empty index files for one mailbox chattr +i'ed (extended attributes immutable flag on Linux filesystems)) disables full text search indexing also. What about regular deletion of main index files. Is this a problem with FTS? "doveadm fts rescan" necessary, too? Btw, with 2.1 search results with or without fts indexes (solr,squat) differ in substring behaviour (http://wiki2.dovecot.org/Plugins/FTS/Squat). Namespaces with INDEX=MEMORY allow for a "slow search view". But then no attachment content is searched... Lutz From andre.groebe at fun.de Fri Aug 24 10:38:49 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Fri, 24 Aug 2012 09:38:49 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50336E01.6000909@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> <50336E01.6000909@fun.de> Message-ID: <50372F89.60301@fun.de> Hi Timo, > [Timo Sirainen; Di 21 Aug 2012 12:22:04 CEST] >>> Unfortunatly this can't be a fix because in file_set_size() dovecot >>> defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the >>> default block size is predestined for file ops. >> >> Does the attached patch fix it? (not a very good fix) > > No, it doesn't. Still got no response on large metadata and writing > destroys the dictionary. Sorry for bumping - is there a chance to get it work with dovecot 2.1.7? TIA Andre From warren at decoy.co.za Fri Aug 24 11:10:42 2012 From: warren at decoy.co.za (Warren Baker) Date: Fri, 24 Aug 2012 10:10:42 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: On Thu, Aug 23, 2012 at 10:49 PM, Timo Sirainen wrote: >> >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). Yeah as others have mentioned - also not sure whether it is worth the effort to support IPv6's 'private' network (fc00::/7)? I havent seen anyone making use of this for their v6 enabled sites but others may have input here. thanks -- .warren From amateo at um.es Fri Aug 24 13:23:57 2012 From: amateo at um.es (Angel L. Mateo) Date: Fri, 24 Aug 2012 12:23:57 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> <503223EE.3030801@um.es> <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> Message-ID: <5037563D.8080402@um.es> El 23/08/12 22:05, Timo Sirainen escribi?: > On 20.8.2012, at 14.47, Angel L. Mateo wrote: > >> The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. >> >> But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error >> >> Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline >> >> and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. > > You can't do it with one passwd-file, you'd have to use multiple per-protocol passwd files.. For example: > > userdb passwd-file { > args = /etc/dovecot/passwd.%s > } > I have tried this option. It works, although I have to duplicate this file. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From tcsmith1978 at googlemail.com Fri Aug 24 13:53:50 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 11:53:50 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? Message-ID: <50375D3E.50409@googlemail.com> Hi, I didn't know where to post this one so I'll start off with you guys and then try Postfix if I'm barking up the wrong tree! Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! Sorry this is a bit vague but any advice on trying to diagnose the problem would be appreciated. Thanks in advance! Tim From jerry at seibercom.net Fri Aug 24 14:01:40 2012 From: jerry at seibercom.net (Jerry) Date: Fri, 24 Aug 2012 07:01:40 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <20120824070140.09041498@scorpio> On Fri, 24 Aug 2012 10:10:42 +0200 Warren Baker articulated: > Yeah as others have mentioned - also not sure whether it is worth the > effort to support IPv6's 'private' network (fc00::/7)? > I havent seen anyone making use of this for their v6 enabled sites but > others may have input here. I would personally recommend supporting it. If history teaches us anything, it is that sooner or later, and usually sooner, someone will require that block. Being prepared for it in advance would seem like the prudent thing to do. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From robert at schetterer.org Fri Aug 24 14:06:06 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 13:06:06 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: <5037601E.5090401@schetterer.org> Am 24.08.2012 12:53, schrieb Tim Smith: > Hi, > > I didn't know where to post this one so I'll start off with you guys and > then try Postfix if I'm barking up the wrong tree! > > Having set up my mail server (Dovecot/Postfix), users are experiencing > long delays (a couple of minutes) when sending mail from mail client > such as Thunderbird - this increases with attachments. Having had a > brief discussion with someone, they mentioned that the reason that this > may be to do with the size of the mailbox. I couldn't see the rationale > behind this unless Dovecot is syncing the mailbox after every sent mail > (due to possibly saving the sent item?) The mail is being delivered > successfully but the amount of time it is taking to complete the action > is far too long! > > Sorry this is a bit vague but any advice on trying to diagnose the > problem would be appreciated. > > Thanks in advance! > > Tim sending mail ist usual smtp ( postfix ), not dovecot if no firewalls/proxies , slow lines , dns problems are involved, there may exist some policy or milter service which slows down smtp out from i.e tb, ask same question with logs and config in the postfix mail list size of mailbox should be not involved in this -- Best Regards MfG Robert Schetterer From tcsmith1978 at googlemail.com Fri Aug 24 14:14:50 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 12:14:50 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037601E.5090401@schetterer.org> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> Message-ID: <5037622A.30808@googlemail.com> Thanks Robert. That's what I thought. I couldn't make the connection. Will try the Postfix list! On 24/08/12 12:06, Robert Schetterer wrote: > Am 24.08.2012 12:53, schrieb Tim Smith: >> Hi, >> >> I didn't know where to post this one so I'll start off with you guys and >> then try Postfix if I'm barking up the wrong tree! >> >> Having set up my mail server (Dovecot/Postfix), users are experiencing >> long delays (a couple of minutes) when sending mail from mail client >> such as Thunderbird - this increases with attachments. Having had a >> brief discussion with someone, they mentioned that the reason that this >> may be to do with the size of the mailbox. I couldn't see the rationale >> behind this unless Dovecot is syncing the mailbox after every sent mail >> (due to possibly saving the sent item?) The mail is being delivered >> successfully but the amount of time it is taking to complete the action >> is far too long! >> >> Sorry this is a bit vague but any advice on trying to diagnose the >> problem would be appreciated. >> >> Thanks in advance! >> >> Tim > sending mail ist usual smtp ( postfix ), not dovecot > if no firewalls/proxies , slow lines , dns problems are involved, there > may exist some policy or milter service which slows down smtp out from > i.e tb, ask same question with logs and config in the postfix mail list > size of mailbox should be not involved in this From matthew at atom.net Fri Aug 24 14:18:41 2012 From: matthew at atom.net (Matthew Powell) Date: Fri, 24 Aug 2012 07:18:41 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120824070140.09041498@scorpio> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: On 2012-08-24, at 7.01, Jerry wrote: > I would personally recommend supporting it. If history teaches us > anything, it is that sooner or later, and usually sooner, someone will > require that block. Being prepared for it in advance would seem like > the prudent thing to do. I wonder whether it would be better to make the exclusion list configurable. As I understand it, the intention is to avoid treating connections through a load balancer or proxy as though they're the same client device. The assumption that private address = proxy is a fair default, but some sites will be using public addresses for their proxies. And that's only going to increase with IPv6. -- Matthew Powell matthew at atom.net From dirk.jahnke-zumbusch at desy.de Fri Aug 24 14:35:32 2012 From: dirk.jahnke-zumbusch at desy.de (Jahnke-Zumbusch, Dirk) Date: Fri, 24 Aug 2012 13:35:32 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037622A.30808@googlemail.com> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> <5037622A.30808@googlemail.com> Message-ID: <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> Hi all, >>> Having set up my mail server (Dovecot/Postfix), users are experiencing >>> long delays (a couple of minutes) when sending mail from mail client >>> such as Thunderbird - this increases with attachments. Having had a While in the first place sending e-mail has to do with SMTP and not IMAP, most mail client programs are configured to save a copy of an e-mail using FCC (file carbon copy) by putting this copy via IMAP into some "Sent" folder. And here you are: this may explain the long delays, esp. if on some asymmetric connection like DSL with low upstream bandwith. Just my 2c Cheers and have a nice weekend -- Dirk Jahnke-Zumbusch Deutsches Elektronen-Synchrotron DESY From h.reindl at thelounge.net Fri Aug 24 14:38:33 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 24 Aug 2012 13:38:33 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: <503767B9.3090002@thelounge.net> Am 24.08.2012 13:18, schrieb Matthew Powell: > On 2012-08-24, at 7.01, Jerry wrote: > >> I would personally recommend supporting it. If history teaches us >> anything, it is that sooner or later, and usually sooner, someone will >> require that block. Being prepared for it in advance would seem like >> the prudent thing to do. > > I wonder whether it would be better to make the exclusion list configurable. > > As I understand it, the intention is to avoid treating connections through a > load balancer or proxy as though they're the same client device i doubt the ip is generally the wrong value to define something is the same client device, there are millions of networks behind NAT out there with a lot of clients usually connecting to the same mailserver via the same public IP and many of them have a workstation beside a mobile device using the same IMAP account the same device = open connection, nothing else > The assumption that private address = proxy is a fair default in my opinion this is generally the wrong direction i do NOT like it when server software behaves different from my private LAN where services are tested than later after making the service public from the WAN -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From robert at schetterer.org Fri Aug 24 14:39:41 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 13:39:41 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> <5037622A.30808@googlemail.com> <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> Message-ID: <503767FD.3030709@schetterer.org> Am 24.08.2012 13:35, schrieb Jahnke-Zumbusch, Dirk: > Hi all, > >>>> Having set up my mail server (Dovecot/Postfix), users are experiencing >>>> long delays (a couple of minutes) when sending mail from mail client >>>> such as Thunderbird - this increases with attachments. Having had a > > While in the first place sending e-mail has to do with SMTP and not IMAP, > most mail client programs are configured to save a copy of an e-mail using > FCC (file carbon copy) by putting this copy via IMAP into some "Sent" > folder. And here you are: this may explain the long delays, esp. if on > some asymmetric connection like DSL with low upstream bandwith. > > Just my 2c > > Cheers and have a nice weekend > > > -- > Dirk Jahnke-Zumbusch Deutsches Elektronen-Synchrotron DESY > very true, but tb should show the copy action, unless its not configured not to do so -- Best Regards MfG Robert Schetterer From sven at svenhartge.de Fri Aug 24 15:02:05 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 14:02:05 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) Message-ID: <692aeic3nov8@mids.svenhartge.de> Hi! I am currently in the process of preparing a migration of our old Courier-based IMAP/POP server setup to a Dovecot-based one. During this process I came across the following problem with the difference Courier and Dovecot handle deleted messages and mail quota. Quote from http://www.courier-mta.org/imap/README.maildirquota.html: ,---- | The default application configuration that uses this maildirquota | library does not count deleted messages, and any contents of the Trash | folder, against the quota. Messages that are marked as deleted (but not | yet actually removed), or messages that are moved to the Trash folder | (which is subject to automatic purging) do not count towards the set | quota. `---- Ignoring the content (or increasing the quota) of the Trash folder is easy and no problem, but ignoring deleted messages seems impossible without changes to the code. While deleted messages are still stored on the server and still take up space until they are expunged, counting them against the quota is somewhat counter-intuitive because most clients don't show those mails and the normal user is unaware the mails he deleted are still there and take up space. Worse yet, if the client uses move-to-Trash, a user deleting mails will double the used space (until Expunge is used) and this may push him over his quota and thus cause any new mail delivery to fail. Unfortunately as our users are used to the courier way of handling the quota this will cause trouble after the migration. And this setup is run at a University, so I don't have any control over the clients a user uses and the behavior of said clients so I am not able to disable the move-to-Trash feature or force an immediate Expunge after a delete. So I propose an additional flag for the quota_rule config option to be able to enable a more lax interpretation of the quota enforcement: quota_rule = *:storage=1G:ignoredeleted quota_rule2 = Trash:storage=+100M Of course I would then have a nightly cronjob which force-expunges all deleted messages so that users can't store mails infinitely in their mailboxes. Thanks for your time and Gr??e, Sven. -- Sigmentation fault. Core dumped. From stan at hardwarefreak.com Fri Aug 24 15:50:39 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 24 Aug 2012 07:50:39 -0500 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: <5037789F.3070500@hardwarefreak.com> On 8/24/2012 5:53 AM, Tim Smith wrote: Hay Tim, > Having set up my mail server (Dovecot/Postfix), users are experiencing > long delays (a couple of minutes) when sending mail from mail client > such as Thunderbird - this increases with attachments. Having had a > brief discussion with someone, they mentioned that the reason that this > may be to do with the size of the mailbox. I couldn't see the rationale > behind this unless Dovecot is syncing the mailbox after every sent mail > (due to possibly saving the sent item?) The mail is being delivered > successfully but the amount of time it is taking to complete the action > is far too long! You probably have multiple factors involved in this mail sending delay issue. One may be that you're not bypassing your Postfix restrictions on your submission service. To fix this, disable your restrictions in the master.cf service definition of your submission service. For example: 587 inet n - n - - smtpd -o smtpd_enforce_tls=yes -o smtpd_sasl_auth_enable=yes -o content_filter= -o smtpd_client_restrictions= -o smtpd_helo_restrictions= -o smtpd_sender_restrictions= -o smtpd_recipient_restrictions=permit_mynetworks,\ permit_sasl_authenticated,reject -o receive_override_options=no_unknown_recipient_checks,\ no_address_mappings,no_header_body_checks This should squash any/all delays in Postfix submission. Another is the fact you're storing the users' Sent folders on the IMAP server. Typically there's nothing wrong with this. I do this and I see zero delay in Tbird. If a good portion of the delay you're seeing is Tbird copying messages to the Sent folder then I'd say you may have a duplex mismatch or some other network layer issue. What is the network topology between these client MUAs and the server? Full duplex fast ethernet? GbE? Or is the server at a remote location, say a colo/VPS server, and your clients are submitting over a shared ADSL/cable circuit to the server? If this is the case you'll always have substantial delays as the real outbound transmission rate of the best ADSL/cable circuits is only 500-1000 Kbps. Sending an attachment over such a pipe is always going to be slow, doubly so if you're copying to an IMAP Sent folder over the same connection, plus sharing it for web browsing, etc, amongst many users. If this is a SOHO environment with shared ADSL/cable the server needs to be on site, with clients connected via ethernet. This will allow instantaneous submission and Sent copying, while pushing the delay to the Postfix outbound queue, where it's invisible to your users. -- Stan From tss at iki.fi Fri Aug 24 16:05:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Aug 2012 16:05:37 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <692aeic3nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> Message-ID: <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> On 24.8.2012, at 15.02, Sven Hartge wrote: > Ignoring the content (or increasing the quota) of the Trash folder is > easy and no problem, but ignoring deleted messages seems impossible > without changes to the code. .. > So I propose an additional flag for the quota_rule config option to be > able to enable a more lax interpretation of the quota enforcement: > > quota_rule = *:storage=1G:ignoredeleted > quota_rule2 = Trash:storage=+100M This can't be implemented race-condition-free without huge changes to code. From sven at svenhartge.de Fri Aug 24 16:13:46 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:13:46 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> Message-ID: <892ajb13nov8@mids.svenhartge.de> Timo Sirainen wrote: > On 24.8.2012, at 15.02, Sven Hartge wrote: >> Ignoring the content (or increasing the quota) of the Trash folder is >> easy and no problem, but ignoring deleted messages seems impossible >> without changes to the code. > .. >> So I propose an additional flag for the quota_rule config option to be >> able to enable a more lax interpretation of the quota enforcement: >> >> quota_rule = *:storage=1G:ignoredeleted >> quota_rule2 = Trash:storage=+100M > This can't be implemented race-condition-free without huge changes to code. Damn, too bad. I know for sure either my users or my 1st level support team are going to kill me if I don't find a solution. Is is possible to forcibly expunge a message at once, directly after a client has marked it as deleted? Kind of the opposite of the lazy_expunge plugin? Gr??e, Sven. -- Sigmentation fault. Core dumped. From robert at schetterer.org Fri Aug 24 16:41:57 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 15:41:57 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <892ajb13nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <503784A5.8080606@schetterer.org> Am 24.08.2012 15:13, schrieb Sven Hartge: > Timo Sirainen wrote: >> On 24.8.2012, at 15.02, Sven Hartge wrote: > >>> Ignoring the content (or increasing the quota) of the Trash folder is >>> easy and no problem, but ignoring deleted messages seems impossible >>> without changes to the code. >> .. >>> So I propose an additional flag for the quota_rule config option to be >>> able to enable a more lax interpretation of the quota enforcement: >>> >>> quota_rule = *:storage=1G:ignoredeleted >>> quota_rule2 = Trash:storage=+100M > >> This can't be implemented race-condition-free without huge changes to code. > > Damn, too bad. > > I know for sure either my users or my 1st level support team are going > to kill me if I don't find a solution. > > Is is possible to forcibly expunge a message at once, directly after a > client has marked it as deleted? Kind of the opposite of the > lazy_expunge plugin? > > Gr??e, > Sven. > hm perhaps as workaround http://wiki2.dovecot.org/Plugins/deleted-to-trash and do often http://wiki2.dovecot.org/Plugins/Expire via cron i.e doveadm expunge -A mailbox Trash savedbefore 1h -- Best Regards MfG Robert Schetterer From haldir.junk at gmail.com Fri Aug 24 16:42:21 2012 From: haldir.junk at gmail.com (Eric Sisolak) Date: Fri, 24 Aug 2012 09:42:21 -0400 Subject: [Dovecot] Vpopmail Dynamic Authentication Module Message-ID: Hello, We currently use qmail with vpopmail for e-mail and are looking to switch from courier-imap to dovecot for IMAP on our RedHat EL 5 systems. Our goal is to use the dovecot RPM supplied by RH (v1.0.7) if at all possible. We can do this if we are able to dynamically load the vpopmail auth module. The wiki (http://wiki.dovecot.org/CompilingSource) notes that this should be possible: Dovecot can also dynamically load authentication modules from the $prefix/lib/dovecot/auth/ directory. Binary packages builders should use them for authentication modules which require external libraries (e. g. LDAP and vpopmail). There is no standard way to build them as modules currently, but something like this should work: gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL \-I../.. -I../lib userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so \-lvpopmail I had to modify the command to build the module, but was able to successfully build it: gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL -I../.. -I../lib -I/home/vpopmail/include -I/home/vpopmail/lib userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so -L/home/vpopmail/lib/libvpopmail.a I am unable to get the module to load properly. Dovecot built with --with-vpopmail works perfectly. When I start dovecot and it tries to load the module it reports: Aug 23 16:48:18 ctd-nix1 dovecot: Dovecot v1.0.7 starting up Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): dlopen(/usr/lib64/dovecot/auth/vpopmail.so) failed: /usr/lib64/dovecot/auth/vpopmail.so: undefined symbol: vclose Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): dlsym(passdb_vpopmail) failed: dovecot-auth: undefined symbol: passdb_vpopmail Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): Unknown passdb driver 'vpopmail' (typo, or Dovecot was built without support for it? Check with dovecot --build-options) Aug 23 16:48:18 ctd-nix1 dovecot: Auth process died too early - shutting down Sometimes instead the last line is replaced with: Aug 23 15:02:45 ctd-nix1 dovecot: child 5412 (auth) returned error 89 Thanks! Eric From tcsmith1978 at googlemail.com Fri Aug 24 16:49:38 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 14:49:38 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037789F.3070500@hardwarefreak.com> References: <50375D3E.50409@googlemail.com> <5037789F.3070500@hardwarefreak.com> Message-ID: <50378672.70208@googlemail.com> My next guess was the upstream data rate. My router states that the upstream is 10x slower than downstream so I guess this is the culprit. Time to move to a VPS methinks... On 24/08/12 13:50, Stan Hoeppner wrote: > On 8/24/2012 5:53 AM, Tim Smith wrote: > > Hay Tim, > >> Having set up my mail server (Dovecot/Postfix), users are experiencing >> long delays (a couple of minutes) when sending mail from mail client >> such as Thunderbird - this increases with attachments. Having had a >> brief discussion with someone, they mentioned that the reason that this >> may be to do with the size of the mailbox. I couldn't see the rationale >> behind this unless Dovecot is syncing the mailbox after every sent mail >> (due to possibly saving the sent item?) The mail is being delivered >> successfully but the amount of time it is taking to complete the action >> is far too long! > You probably have multiple factors involved in this mail sending delay > issue. > > One may be that you're not bypassing your Postfix restrictions on your > submission service. To fix this, disable your restrictions in the > master.cf service definition of your submission service. For example: > > 587 inet n - n - - smtpd > -o smtpd_enforce_tls=yes > -o smtpd_sasl_auth_enable=yes > -o content_filter= > -o smtpd_client_restrictions= > -o smtpd_helo_restrictions= > -o smtpd_sender_restrictions= > -o smtpd_recipient_restrictions=permit_mynetworks,\ > permit_sasl_authenticated,reject > -o receive_override_options=no_unknown_recipient_checks,\ > no_address_mappings,no_header_body_checks > > This should squash any/all delays in Postfix submission. > > Another is the fact you're storing the users' Sent folders on the IMAP > server. Typically there's nothing wrong with this. I do this and I see > zero delay in Tbird. If a good portion of the delay you're seeing is > Tbird copying messages to the Sent folder then I'd say you may have a > duplex mismatch or some other network layer issue. > > What is the network topology between these client MUAs and the server? > Full duplex fast ethernet? GbE? Or is the server at a remote location, > say a colo/VPS server, and your clients are submitting over a shared > ADSL/cable circuit to the server? If this is the case you'll always > have substantial delays as the real outbound transmission rate of the > best ADSL/cable circuits is only 500-1000 Kbps. Sending an attachment > over such a pipe is always going to be slow, doubly so if you're copying > to an IMAP Sent folder over the same connection, plus sharing it for web > browsing, etc, amongst many users. > > If this is a SOHO environment with shared ADSL/cable the server needs to > be on site, with clients connected via ethernet. This will allow > instantaneous submission and Sent copying, while pushing the delay to > the Postfix outbound queue, where it's invisible to your users. > From sven at svenhartge.de Fri Aug 24 16:53:09 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:53:09 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Robert Schetterer wrote: > Am 24.08.2012 15:13, schrieb Sven Hartge: >> Timo Sirainen wrote: >>> On 24.8.2012, at 15.02, Sven Hartge wrote: >> >>>> Ignoring the content (or increasing the quota) of the Trash folder is >>>> easy and no problem, but ignoring deleted messages seems impossible >>>> without changes to the code. >>>> So I propose an additional flag for the quota_rule config option to be >>>> able to enable a more lax interpretation of the quota enforcement: >>>> >>>> quota_rule = *:storage=1G:ignoredeleted >>>> quota_rule2 = Trash:storage=+100M >>> This can't be implemented race-condition-free without huge changes >>> to code. >> >> Damn, too bad. >> >> I know for sure either my users or my 1st level support team are >> going to kill me if I don't find a solution. >> >> Is is possible to forcibly expunge a message at once, directly after >> a client has marked it as deleted? Kind of the opposite of the >> lazy_expunge plugin? > hm perhaps as workaround > http://wiki2.dovecot.org/Plugins/deleted-to-trash > and do often > http://wiki2.dovecot.org/Plugins/Expire > via cron i.e > doveadm expunge -A mailbox Trash savedbefore 1h I stumbled upon deleted_to_trash 5 minutes ago. This could work, if the code still works with dovecot 2.1. Gr??e, Sven. -- Sigmentation fault. Core dumped. From sven at svenhartge.de Fri Aug 24 16:56:36 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:56:36 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Sven Hartge wrote: > Robert Schetterer wrote: >> Am 24.08.2012 15:13, schrieb Sven Hartge: >>> Is is possible to forcibly expunge a message at once, directly after >>> a client has marked it as deleted? Kind of the opposite of the >>> lazy_expunge plugin? >> hm perhaps as workaround >> http://wiki2.dovecot.org/Plugins/deleted-to-trash >> and do often >> http://wiki2.dovecot.org/Plugins/Expire >> via cron i.e >> doveadm expunge -A mailbox Trash savedbefore 1h > I stumbled upon deleted_to_trash 5 minutes ago. This could work, if the > code still works with dovecot 2.1. Nope, does not compile (dovecot-dev headers are installed): cc \ -fPIC -shared -Wall \ -I/usr/include/dovecot \ -I/usr/include/dovecot/src \ -I/usr/include/dovecot/src/lib \ -I/usr/include/dovecot/src/lib-storage \ -I/usr/include/dovecot/src/lib-mail \ -I/usr/include/dovecot/src/lib-imap \ -I/usr/include/dovecot/src/lib-index \ -DHAVE_CONFIG_H \ deleted-to-trash-plugin.c -o lib_deleted_to_trash_plugin.so deleted-to-trash-plugin.c: In function ?mailbox_open_or_create?: deleted-to-trash-plugin.c:79: error: ?MAILBOX_FLAG_KEEP_RECENT? undeclared (first use in this function) deleted-to-trash-plugin.c:79: error: (Each undeclared identifier is reported only once deleted-to-trash-plugin.c:79: error: for each function it appears in.) deleted-to-trash-plugin.c: In function ?copy_deleted_mail_to_trash?: deleted-to-trash-plugin.c:136: warning: passing argument 1 of ?mailbox_keywords_unref? from incompatible pointer type /usr/include/dovecot/mail-storage.h:612: note: expected ?struct mail_keywords **? but argument is of type ?struct mailbox *? deleted-to-trash-plugin.c:136: error: too many arguments to function ?mailbox_keywords_unref? make: *** [lib_deleted_to_trash_plugin.so] Error 1 Gr??e, Sven. -- Sigmentation fault. Core dumped. From sven at svenhartge.de Fri Aug 24 17:29:15 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 16:29:15 +0200 Subject: [Dovecot] Trying to fix delete_to_trash plugin (was: quota: ignore deleted messages (?)) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Sven Hartge wrote: > Nope, does not compile (dovecot-dev headers are installed): OK, trying to fix this, without having any deeper knowlege of C (anymore): > deleted-to-trash-plugin.c: In function ?mailbox_open_or_create?: > deleted-to-trash-plugin.c:79: error: ?MAILBOX_FLAG_KEEP_RECENT? undeclared (first use in this function) MAILBOX_FLAG_KEEP_RECENT is not present in 2.1, seems to me it was made the default and MAILBOX_FLAG_DROP_RECENT was introduced as its counterpart. I removed the flag from the call to mailbox_alloc() in 72 static struct mailbox * 73 mailbox_open_or_create(struct mailbox_list *list, const char *name, 74 const char **error_r) 75 { 76 struct mailbox *box; 77 enum mail_error error; 78 79 box = mailbox_alloc(list, name, MAILBOX_FLAG_NO_INDEX_FILES); 80 if (mailbox_open(box) == 0) { 81 *error_r = NULL; 82 return box; 83 } 84 and retried to compile: cc \ -fPIC -shared -Wall \ -I/usr/include/dovecot \ -I/usr/include/dovecot/src \ -I/usr/include/dovecot/src/lib \ -I/usr/include/dovecot/src/lib-storage \ -I/usr/include/dovecot/src/lib-mail \ -I/usr/include/dovecot/src/lib-imap \ -I/usr/include/dovecot/src/lib-index \ -DHAVE_CONFIG_H \ deleted-to-trash-plugin.c -o lib_deleted_to_trash_plugin.so deleted-to-trash-plugin.c: In function ?copy_deleted_mail_to_trash?: deleted-to-trash-plugin.c:135: warning: passing argument 1 of ?mailbox_keywords_unref? from incompatible pointer type /usr/include/dovecot/mail-storage.h:612: note: expected ?struct mail_keywords **? but argument is of type ?struct mailbox *? deleted-to-trash-plugin.c:135: error: too many arguments to function ?mailbox_keywords_unref? make: *** [lib_deleted_to_trash_plugin.so] Error 1 _and_ now I am at the end of my wisdom. Pointer magic in C has always been a dark dark mystery to me (I learned programming in Pascal, Ada95 and later Perl ...). Help, anybody? Gr??e, Sven. -- Sigmentation fault. Core dumped. From wagnermazevedo at hotmail.com Fri Aug 24 22:23:43 2012 From: wagnermazevedo at hotmail.com (Wagner Michel Martins de Azevedo) Date: Fri, 24 Aug 2012 16:23:43 -0300 Subject: [Dovecot] Shared mdboxes Message-ID: Hi Timo, I'm trying to share two folders. The first one it's public and the other is per user based, using acl's to control access etc . Dovecot create the folders, but when I'll subscribe using ThunderBird client both of them seens like watermarked and has a "mailboxes" folder inside. I can set up the acl's rules using Thunderbird. Log files like mail.log don't show nothing in special and mail.err has nothing. Here is the config. # 2.1.8 (b4cd382b6606): /etc/dovecot/dovecot.conf# OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 /etc/dovecot/conf.d/10.mail.conf namespace { type = public separator = . prefix = public. location = mdbox:/var/mail_shares/public:INDEX=/var/mail_shares/public subscriptions = no}namespace { type = shared separator = . prefix = %h/shared location = mdbox:%h/shared:INDEX=%h/shared subscriptions = no list = children} Thanks, Wagner Azevedo From tss at iki.fi Sat Aug 25 01:04:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 01:04:10 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <892ajb13nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: On 24.8.2012, at 16.13, Sven Hartge wrote: >>> quota_rule = *:storage=1G:ignoredeleted >>> quota_rule2 = Trash:storage=+100M > >> This can't be implemented race-condition-free without huge changes to code. > > Damn, too bad. > > I know for sure either my users or my 1st level support team are going > to kill me if I don't find a solution. How about just disabling the quota enforcing and doing a nightly run of some type of enforcing (sending notification email and/or disabling new mail delivery until user has more quota again)? From sven at svenhartge.de Sat Aug 25 01:49:12 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 00:49:12 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: Timo Sirainen wrote: > On 24.8.2012, at 16.13, Sven Hartge wrote: >>>> quota_rule = *:storage=1G:ignoredeleted >>>> quota_rule2 = Trash:storage=+100M >> >>> This can't be implemented race-condition-free without huge changes to code. >> >> Damn, too bad. >> I know for sure either my users or my 1st level support team are >> going to kill me if I don't find a solution. > How about just disabling the quota enforcing and doing a nightly run > of some type of enforcing (sending notification email and/or disabling > new mail delivery until user has more quota again)? As a last resort, yes. If possible, I'd like to keep the feedback about mailbox size as direct as possible. Disabling an account only once per night might be acceptable, but the reenabling of the account, once a user has freed some space, has to be instant or I would get constant complains from the users (the ones with the biggest mailboxes being the professors, which can be quite the pain to work with, if they believe they don't get what they think they are entitled to get). I know, this all sounds a bit "whiny", but I've been working for over 8 years in this position and the harsh reality made me somewhat cautious. So far, the description of the delete_to_trash plugin sounds promising, because I can already ignore the Trash (or add to the total quota for this folder and do a nightly expunge run for it), if only it would compile for dovecot 2.1. Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Sat Aug 25 10:23:31 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 10:23:31 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: On 25.8.2012, at 1.49, Sven Hartge wrote: >> How about just disabling the quota enforcing and doing a nightly run >> of some type of enforcing (sending notification email and/or disabling >> new mail delivery until user has more quota again)? > > As a last resort, yes. If possible, I'd like to keep the feedback about > mailbox size as direct as possible. > > Disabling an account only once per night might be acceptable, but the > reenabling of the account, once a user has freed some space, has to be > instant or I would get constant complains from the users (the ones with > the biggest mailboxes being the professors, which can be quite the pain > to work with, if they believe they don't get what they think they are > entitled to get). You can use quota warning scripts to send warnings and enable account instantly when it goes under 100%. > So far, the description of the delete_to_trash plugin sounds promising, > because I can already ignore the Trash (or add to the total quota for > this folder and do a nightly expunge run for it), if only it would > compile for dovecot 2.1. I don't like the idea behind deleted_to_trash and won't offer any support for it if I don't have to. From tresh_dovecot at lefoyer.ru Sat Aug 25 11:05:39 2012 From: tresh_dovecot at lefoyer.ru ((Dovecot) Sergey Sidlyarenko) Date: Sat, 25 Aug 2012 12:05:39 +0400 Subject: [Dovecot] Problem use localized prefix in namespace In-Reply-To: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> References: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> Message-ID: <23adeb68feb387bd625b1d2d1424a987@lefoyer.ru> Thank you, it works. Timo Sirainen ????? 2012-08-23 23:57: > On 17.8.2012, at 21.37, (Dovecot) Sergey Sidlyarenko wrote: > >> Problem with localized prefix in namespace. > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/ade94fde249e -- Best regards, Sidlyarenko Sergey Aleksandrovish +7(495)509-42-07 tresh_dovecot at lefoyer.ru mailto:tresh_dovecot at lefoyer.ru From tss at iki.fi Sat Aug 25 11:25:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 11:25:10 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: <7EC6E90E-3757-440B-A6B7-DBFB70D430A2@iki.fi> On 24.8.2012, at 14.18, Matthew Powell wrote: > On 2012-08-24, at 7.01, Jerry wrote: > >> I would personally recommend supporting it. If history teaches us >> anything, it is that sooner or later, and usually sooner, someone will >> require that block. Being prepared for it in advance would seem like >> the prudent thing to do. > > I wonder whether it would be better to make the exclusion list configurable. The reason for this default exclusion list is exactly to avoid behaving badly in unconfigured systems. Normally people should be using Dovecot proxies and login_trusted_networks setting configured to avoid the problem entirely. From zucca at systemschmiede.com Sat Aug 25 14:11:01 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Sat, 25 Aug 2012 13:11:01 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <50353D32.2080401@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> Message-ID: <5038B2C5.3090408@systemschmiede.com> Hi List, i found out the following: The problem with the "ghostfolder" occurs only if i use prefix = shares/%%n/ When using prefix = shares/%%u/ everytung's ok! Only the name of the folder is a little longish this way, so i would really prefer the %%n way. Any ideas now? Thank you Sascha Am 22.08.2012 22:12, schrieb Sascha Zucca: > If you should need any more info on this, just drop me a line. > I am fully stuck! > I think that my dovecot.conf is not put together well, only i can't > find the problem... > > Thanx > Sascha > > Am 22.08.2012 01:44, schrieb Sascha Zucca: >> Hi list, >> i have a strange "ghost" folder in my subscription list and just >> can't find out how to get rid of it. >> It seems to be someones Inbox, but it doesn't tell me whose. >> >> Here's a screenshot of Open-Xchanges Web-GUI: >> /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg >> / >> As you can see there is an unamed folder just under Freigaben (Shares). >> >> >> In Thunderbird: >> /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ >> >> Now the Folder is "INBOX"...But it is noones Inbox, as the >> corresponding user (amazon e.g.) should be a prefix-folder right >> before the share. >> >> >> some output over Telnet: >> >> 1 lsub "" "*" >> * LSUB () "/" "INBOX" >> * LSUB () "/" "INBOX/Amazon" >> * LSUB () "/" "INBOX/Bestellung" >> * LSUB () "/" "Drafts" >> * LSUB () "/" "Sent Items" >> * LSUB () "/" "Spam" >> * LSUB () "/" "Trash" >> * LSUB () "/" "Freigaben/amazon/INBOX" >> 1 OK Lsub completed. >> >> >> 1 list "" "*" >> * LIST (\HasNoChildren) "/" "Trash" >> * LIST (\HasNoChildren) "/" "Sent Items" >> * LIST (\HasChildren) "/" "INBOX" >> * LIST (\HasNoChildren) "/" "INBOX/Amazon" >> * LIST (\HasNoChildren) "/" "INBOX/Bestellung" >> * LIST (\HasNoChildren) "/" "Spam" >> * LIST (\HasNoChildren) "/" "Drafts" >> * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" >> 1 OK List completed. >> >> >> This looks a bit strange to me: >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> But i don't know really if that is the ghostfolder. >> >> >> finally here's the interesting part in my dovecot.conf: >> / >> namespace private { >> separator = / >> prefix = >> #location defaults to mail_location. >> inbox = yes >> } >> >> namespace shared { >> separator = / >> prefix = Freigaben/%%n/ >> location = >> maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ >> subscriptions = no >> list = children >> inbox = no >> } >> / >> >> Any idea how to banish the ghost in the machine? >> >> Thank you very much >> Sascha >> >> > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Sat Aug 25 14:53:11 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 14:53:11 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5038B2C5.3090408@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> Message-ID: <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> On 25.8.2012, at 14.11, Sascha Zucca wrote: > Hi List, > i found out the following: > The problem with the "ghostfolder" occurs only if i use > > prefix = shares/%%n/ > > When using > prefix = shares/%%u/ > > everytung's ok! What Dovecot version? From sven at svenhartge.de Sat Aug 25 15:40:22 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 14:40:22 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 1.49, Sven Hartge wrote: >>> How about just disabling the quota enforcing and doing a nightly run >>> of some type of enforcing (sending notification email and/or >>> disabling new mail delivery until user has more quota again)? >> >> As a last resort, yes. If possible, I'd like to keep the feedback >> about mailbox size as direct as possible. >> >> Disabling an account only once per night might be acceptable, but the >> reenabling of the account, once a user has freed some space, has to >> be instant or I would get constant complains from the users (the ones >> with the biggest mailboxes being the professors, which can be quite >> the pain to work with, if they believe they don't get what they think >> they are entitled to get). > You can use quota warning scripts to send warnings and enable account > instantly when it goes under 100%. Warning the user at 95%, 97% and 99% using the warning scripts is easy and was already configured and is working like a charm. Disabling the account in a nightly cronjob will be easy as well. Since I use the Mysql-dict for quota, I can just query that, compare the value to the configured quota from LDAP and act accordingly. But how do I instantly reenable the account when it drops below 100% with the warning scripts? As far as I understand the documentation, they are only triggered if the quota use rises over the configured thresholds. I seem to somehow miss a piece, but I cannot see which one. Gr??e, Sven. -- Sigmentation fault. Core dumped. From zucca at systemschmiede.com Sat Aug 25 15:56:17 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Sat, 25 Aug 2012 14:56:17 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> Message-ID: <5038CB71.5010808@systemschmiede.com> Hi Timo, dovecot --version 1.2.15 It's the stable one for debian squeeze i presume. Thank you for your help. Sascha Am 25.08.2012 13:53, schrieb Timo Sirainen: > On 25.8.2012, at 14.11, Sascha Zucca wrote: > >> Hi List, >> i found out the following: >> The problem with the "ghostfolder" occurs only if i use >> >> prefix = shares/%%n/ >> >> When using >> prefix = shares/%%u/ >> >> everytung's ok! > What Dovecot version? > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Sat Aug 25 16:06:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 16:06:23 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5038CB71.5010808@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. On 25.8.2012, at 15.56, Sascha Zucca wrote: > Hi Timo, > dovecot --version > 1.2.15 > > It's the stable one for debian squeeze i presume. > > Thank you for your help. > > Sascha > > > Am 25.08.2012 13:53, schrieb Timo Sirainen: >> On 25.8.2012, at 14.11, Sascha Zucca wrote: >> >>> Hi List, >>> i found out the following: >>> The problem with the "ghostfolder" occurs only if i use >>> >>> prefix = shares/%%n/ >>> >>> When using >>> prefix = shares/%%u/ >>> >>> everytung's ok! >> What Dovecot version? >> >> > > > -- > Systemschmiede IT-L?sungen > Zucca & Teves GbR > August-Thyssen-Str. 2-4 > 52511 Geilenkirchen > www.systemschmiede.com > > > Tel.: 02451 - 9088390 > Fax: 02451 - 9124070 > Mobil: 0178 - 4073254 > > Ust.ID: DE248030393 > From tss at iki.fi Sat Aug 25 16:09:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 16:09:40 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> On 25.8.2012, at 15.40, Sven Hartge wrote: > Warning the user at 95%, 97% and 99% using the warning scripts is easy > and was already configured and is working like a charm. > > But how do I instantly reenable the account when it drops below 100% > with the warning scripts? As far as I understand the documentation, they > are only triggered if the quota use rises over the configured > thresholds. Setting the warning at -100% would do that I think. In any case "-" before the percentage means "reverse". Yeah, not in wiki, I'll add it there.. From sven at svenhartge.de Sat Aug 25 18:28:49 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 17:28:49 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 15.40, Sven Hartge wrote: >> Warning the user at 95%, 97% and 99% using the warning scripts is >> easy and was already configured and is working like a charm. >> >> But how do I instantly reenable the account when it drops below 100% >> with the warning scripts? As far as I understand the documentation, >> they are only triggered if the quota use rises over the configured >> thresholds. > Setting the warning at -100% would do that I think. In any case "-" > before the percentage means "reverse". Yeah, not in wiki, I'll add it > there.. Ah, very nice. Now I need to put the pieces together and test whether this is a working solution for me. Question: is it possible to enforce the quota for IMAP/POP and have it on noenforcing for LDA/LMTP? LDA would be easy, as I could just add -o "plugin/quota=dict:Benutzer-Quota::noenforcing:proxy::quota" to the command line of dovecot-ldap in my exim4.conf. But because of performance considerations I want to use LMTP to deliver the mails. Would this nested plugin configuration work: (sorry, not at work, cannot test directly) protocol lmtp { mail_plugins = $mail_plugins sieve plugin { quota = dict:Benutzer-Quota::noenforcing:proxy::quota } } Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Sat Aug 25 18:39:51 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 18:39:51 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: <20B68DD0-7919-4843-9568-B17597656CEE@iki.fi> On 25.8.2012, at 18.28, Sven Hartge wrote: > But because of performance considerations I want to use LMTP to deliver > the mails. Would this nested plugin configuration work: > (sorry, not at work, cannot test directly) > > protocol lmtp { > mail_plugins = $mail_plugins sieve > plugin { > quota = dict:Benutzer-Quota::noenforcing:proxy::quota > } > } That should work, yes. From sven at svenhartge.de Sat Aug 25 18:45:56 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 17:45:56 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> <20B68DD0-7919-4843-9568-B17597656CEE@iki.fi> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 18.28, Sven Hartge wrote: >> But because of performance considerations I want to use LMTP to deliver >> the mails. Would this nested plugin configuration work: >> (sorry, not at work, cannot test directly) >> >> protocol lmtp { >> mail_plugins = $mail_plugins sieve >> plugin { >> quota = dict:Benutzer-Quota::noenforcing:proxy::quota >> } >> } > That should work, yes. Very good, thank you for your fast answers. Gr??e, Sven. -- Sigmentation fault. Core dumped. From trashcan at odo.in-berlin.de Sat Aug 25 19:09:59 2012 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Sat, 25 Aug 2012 18:09:59 +0200 Subject: [Dovecot] dsync replication available for testing In-Reply-To: References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> Message-ID: <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> On 23.08.2012, at 22:01, Timo Sirainen wrote: > On 19.8.2012, at 12.51, Michael Grimm wrote: >>>> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >>>> >>>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >>>> >>>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >>>> >>>> JFTR: I do have mail_log plugin activated. >>> >>> Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. >> >> >> I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? > > > Not enable mail_log for doveadm: > > protocol !doveadm { > mail_plugins = $mail_plugins = mail_log > } JFTR: That didn't work. > or alternatively override it only for the dsync command with doveadm -o mail_plugins=... But, a ... dsync_remote_cmd = ssh -l%{login} %{host} doveadm -o mail_plugins= dsync-server -u%u -l%{lock_timeout} -n%{namespace} ... did omit those error messages successfully. Thanks and regards, Michael From tss at iki.fi Sat Aug 25 20:16:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 20:16:49 +0300 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> Message-ID: <5D96BF6D-31FA-4842-8A14-0E7F76B1C7C3@iki.fi> On 25.8.2012, at 19.09, Michael Grimm wrote: >> Not enable mail_log for doveadm: >> >> protocol !doveadm { >> mail_plugins = $mail_plugins = mail_log >> } > > JFTR: That didn't work. This would omit it from the local dsync. >> or alternatively override it only for the dsync command with doveadm -o mail_plugins=... > > But, a ... > > dsync_remote_cmd = ssh -l%{login} %{host} doveadm -o mail_plugins= dsync-server -u%u -l%{lock_timeout} -n%{namespace} > > ... did omit those error messages successfully. And yes, this would omit it from the remote dsync. From martin.rabl at rablnet.de Sat Aug 25 21:31:29 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 25 Aug 2012 20:31:29 +0200 Subject: [Dovecot] UIDPLUS for Maildir? Message-ID: <50391A01.4030401@rablnet.de> Hi, I found the following comment in the documentation (http://wiki.dovecot.org/FeatUIDPLUS), last edited on 2009-03-15 > Dovecot already supported UIDPLUS at one point for mbox, but implementing it > for Maildir has to be done differently (UIDs are allocated later with Maildir). > So currently the UIDPLUS code is removed until it can be made to > work with Maildir. My question: does this extension now run with maildir? Thank you, Martin From kgc at corp.sonic.net Sat Aug 25 22:14:20 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Sat, 25 Aug 2012 12:14:20 -0700 Subject: [Dovecot] dovecot stats error In-Reply-To: <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> References: <4FE46641.4030801@schetterer.org> <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> Message-ID: <5039240C.1030003@corp.sonic.net> On 6/22/2012 6:34 AM, Timo Sirainen wrote: > Which Dovecot version? I thought I fixed this already.. I'm seeing these errors running 2.1.8 -- Kelsey Cummings - kgc at corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407 From tss at iki.fi Sat Aug 25 22:17:48 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 22:17:48 +0300 Subject: [Dovecot] UIDPLUS for Maildir? In-Reply-To: <50391A01.4030401@rablnet.de> References: <50391A01.4030401@rablnet.de> Message-ID: <236BEBF4-CEDD-4E86-9C9A-21BFACF2F027@iki.fi> On 25.8.2012, at 21.31, Martin Rabl wrote: > I found the following comment in the documentation (http://wiki.dovecot.org/FeatUIDPLUS), last edited on 2009-03-15 >> Dovecot already supported UIDPLUS at one point for mbox, but implementing it >> for Maildir has to be done differently (UIDs are allocated later with Maildir). >> So currently the UIDPLUS code is removed until it can be made to >> work with Maildir. > > My question: does this extension now run with maildir? Since v1.1 I think. From kgc at corp.sonic.net Sat Aug 25 22:55:23 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Sat, 25 Aug 2012 12:55:23 -0700 Subject: [Dovecot] dovecot stats error In-Reply-To: <5039240C.1030003@corp.sonic.net> References: <4FE46641.4030801@schetterer.org> <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> <5039240C.1030003@corp.sonic.net> Message-ID: <50392DAB.8010303@corp.sonic.net> On 8/25/2012 12:14 PM, Kelsey Cummings wrote: > On 6/22/2012 6:34 AM, Timo Sirainen wrote: >> Which Dovecot version? I thought I fixed this already.. > > I'm seeing these errors running 2.1.8 Examples below, let me know if I can provide any other info Timo. In other news, we're finally migrated to dovecot from courier. WHOOO HOOOO!!!! > Aug 25 12:53:37 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mcache 331 < 332 > Aug 25 12:53:37 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 180435729 < 204849088 > Aug 25 12:53:38 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 50757363 < 62351358 > Aug 25 12:53:38 d dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mlpath 17451 < 20067 > Aug 25 12:53:41 d dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 40483661 < 42086237 > Aug 25 12:53:42 b dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 65540465 < 67974537 > Aug 25 12:53:42 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mlpath 811 < 946 > Aug 25 12:53:43 b dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 220133763 < 221888538 > Aug 25 12:53:47 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mcache 13 < 14 > Aug 25 12:53:48 c dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 118702153 < 121714865 -- Kelsey Cummings - kgc at corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407 From daniel.parthey at informatik.tu-chemnitz.de Sun Aug 26 02:28:33 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sun, 26 Aug 2012 01:28:33 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: <20120825232833.GA11297@daniel.localdomain> Sven Hartge wrote: > I want to use LMTP to deliver the mails. > Would this nested plugin configuration work to disable quota: > > protocol lmtp { > mail_plugins = $mail_plugins sieve > plugin { > quota = dict:Benutzer-Quota::noenforcing:proxy::quota > } > } Concerning http://dovecot.org/list/dovecot/2012-June/066298.html I'm using MySQL userdb, but just want to keep things as simple as possible (KISS principle). What would the configuration look like if I want to setup one lmtp service with quota enforcing on port 10024 and another lmtp service without enforcing on port 20024? Especially how to define two "protocol lmtp" sections which are assigned to their specific service? Will this work with two simple 'nested configuration' or will I need to define SQL statements in the userdb lookup which selects "noenforcing" depending on local port? Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Sun Aug 26 06:55:34 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 25 Aug 2012 22:55:34 -0500 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50378672.70208@googlemail.com> References: <50375D3E.50409@googlemail.com> <5037789F.3070500@hardwarefreak.com> <50378672.70208@googlemail.com> Message-ID: <50399E36.7030304@hardwarefreak.com> On 8/24/2012 8:49 AM, Tim Smith wrote: > My next guess was the upstream data rate. My router states that the > upstream is 10x slower than downstream so I guess this is the culprit. > Time to move to a VPS methinks... Ok, you stated that you have multiple user PCs that are slow when sending. I guess, asked, if they were all behind the same DSL/Cable line and if the Dovecot server was local or remote. If the user PCs are local, and the server is remote, and the slow outbound speed of your internet connection is the cause of the slow sending, then I fail to see how moving to a VPS will help you. You're not providing sufficient technical details explaining what machines are located where. We need to know that to give you the correct answer(s) to your problem. -- Stan From hawat.thufir at gmail.com Sun Aug 26 18:21:28 2012 From: hawat.thufir at gmail.com (Thufir) Date: Sun, 26 Aug 2012 08:21:28 -0700 Subject: [Dovecot] Java driver for doveadm Message-ID: I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and there a few features I like which javax.mail just doesn't have. Is there maybe a Java driver for doveadm? thanks, Thufir From kernel.picknick at gmail.com Sun Aug 26 18:40:34 2012 From: kernel.picknick at gmail.com (Alex) Date: Sun, 26 Aug 2012 17:40:34 +0200 Subject: [Dovecot] How to configure dovecot for specific mailboxes only? Message-ID: Hi, is it possible to configure dovecot so that it only serves mailboxes of specified users? All other users should be completely ignored so that no indexing of messages or other resource consuming actions take place. Thanks in advance, Alex From Ralf.Hildebrandt at charite.de Sun Aug 26 19:47:37 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Sun, 26 Aug 2012 18:47:37 +0200 Subject: [Dovecot] Recipe for "admin-less restore" Message-ID: <20120826164737.GD29284@charite.de> Is there a way for setting up dovecot in such a way that a user can "jump back in time" to an old mailbox "state" in order to retrieve his accidentially deleted mail? -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From lcaron at lncsa.com Sun Aug 26 22:00:04 2012 From: lcaron at lncsa.com (Laurent CARON) Date: Sun, 26 Aug 2012 21:00:04 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: <503A7234.40800@lncsa.com> On 26/08/2012 18:47, Ralf Hildebrandt wrote: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve his > accidentially deleted mail? Hi, We use snapshots for this namespace snaps-h-2 { prefix = INBOX.EmailBackup.h-2. hidden = no list = yes inbox = no location = maildir:/home/.snapshot/hourly.0/%u/Maildir:INDEX=/var/tmp/dovecot/indexes/hourly.0/%u:CONTROL=/var/tmp/dovecot/control/hourly.0/%u type = private } From me at junc.org Mon Aug 27 06:52:08 2012 From: me at junc.org (Benny Pedersen) Date: Mon, 27 Aug 2012 05:52:08 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: Den 2012-08-26 18:47, Ralf Hildebrandt skrev: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve > his > accidentially deleted mail? disable expunge ? From amateo at um.es Mon Aug 27 09:35:52 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 27 Aug 2012 08:35:52 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <503B1548.9030605@um.es> El 25/08/12 09:23, Timo Sirainen escribi?: > On 25.8.2012, at 1.49, Sven Hartge wrote: > >>> How about just disabling the quota enforcing and doing a nightly run >>> of some type of enforcing (sending notification email and/or disabling >>> new mail delivery until user has more quota again)? >> >> As a last resort, yes. If possible, I'd like to keep the feedback about >> mailbox size as direct as possible. >> >> Disabling an account only once per night might be acceptable, but the >> reenabling of the account, once a user has freed some space, has to be >> instant or I would get constant complains from the users (the ones with >> the biggest mailboxes being the professors, which can be quite the pain >> to work with, if they believe they don't get what they think they are >> entitled to get). > > You can use quota warning scripts to send warnings and enable account instantly when it goes under 100%. > But, if you still use quota, you are still counting deleted messages in the quota. Aren't you? Is not easier just making users conscious of deleted messages? Many clients that hide deleted messages, show them in a trash folder (although they don't use move to trash) so it's easy for user to expunge deleted messages. And you could also run a cron to expunge old deleted messages from user mailboxes (for example, messages deleted more than 15 days ago) -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From tss at iki.fi Mon Aug 27 10:00:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:00:09 +0300 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> On 26.8.2012, at 19.47, Ralf Hildebrandt wrote: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve his > accidentially deleted mail? http://wiki2.dovecot.org/Plugins/Lazyexpunge is one possibility From tss at iki.fi Mon Aug 27 10:01:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:01:37 +0300 Subject: [Dovecot] How to configure dovecot for specific mailboxes only? In-Reply-To: References: Message-ID: On 26.8.2012, at 18.40, Alex wrote: > is it possible to configure dovecot so that it only serves mailboxes > of specified users? All other users should be completely ignored so > that no indexing of messages or other resource consuming actions take > place. You can configure passdb/userdb to give different settings to different users. So maybe for some users you return mail_location with :INDEX=MEMORY and don't accept their passwords. Depends on your setup what exactly you need to do.. From tss at iki.fi Mon Aug 27 10:01:54 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:01:54 +0300 Subject: [Dovecot] Java driver for doveadm In-Reply-To: References: Message-ID: On 26.8.2012, at 18.21, Thufir wrote: > I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and > there a few features I like which javax.mail just doesn't have. Is > there maybe a Java driver for doveadm? You can access doveadm via TCP socket. Would that be enough? From robert at schetterer.org Mon Aug 27 10:02:37 2012 From: robert at schetterer.org (Robert Schetterer) Date: Mon, 27 Aug 2012 09:02:37 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> References: <20120826164737.GD29284@charite.de> <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> Message-ID: <503B1B8D.9030705@schetterer.org> Am 27.08.2012 09:00, schrieb Timo Sirainen: > On 26.8.2012, at 19.47, Ralf Hildebrandt wrote: > >> Is there a way for setting up dovecot in such a way that a user can >> "jump back in time" to an old mailbox "state" in order to retrieve his >> accidentially deleted mail? > > http://wiki2.dovecot.org/Plugins/Lazyexpunge is one possibility > also possible you may setup an archive solution i.e with bc copy send to another mail account -- Best Regards MfG Robert Schetterer From tss at iki.fi Mon Aug 27 10:03:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:03:15 +0300 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: On 24.8.2012, at 13.53, Tim Smith wrote: > Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! Other than the bandwidth others already mentioned, the only reason it could be Dovecot's fault is exactly the size of the Sent mailbox. How large is that and what mailbox format are you using? From sven at svenhartge.de Mon Aug 27 11:59:08 2012 From: sven at svenhartge.de (Sven Hartge) Date: Mon, 27 Aug 2012 10:59:08 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503B1548.9030605@um.es> Message-ID: <1192i1o63nov8@mids.svenhartge.de> Angel L. Mateo wrote: > El 25/08/12 09:23, Timo Sirainen escribi?: >> On 25.8.2012, at 1.49, Sven Hartge wrote: >> >>>> How about just disabling the quota enforcing and doing a nightly run >>>> of some type of enforcing (sending notification email and/or disabling >>>> new mail delivery until user has more quota again)? >>> >>> As a last resort, yes. If possible, I'd like to keep the feedback about >>> mailbox size as direct as possible. >>> >>> Disabling an account only once per night might be acceptable, but the >>> reenabling of the account, once a user has freed some space, has to be >>> instant or I would get constant complains from the users (the ones with >>> the biggest mailboxes being the professors, which can be quite the pain >>> to work with, if they believe they don't get what they think they are >>> entitled to get). >> You can use quota warning scripts to send warnings and enable account >> instantly when it goes under 100%. >> > But, if you still use quota, you are still counting deleted messages > in the quota. Aren't you? Quota would be noenforcing. So the users still sees "105% of quota used" but this does not result in any mail bouncing at once. Gr??e, Sven. -- Sigmentation fault. Core dumped. From aconraz at gmail.com Mon Aug 27 12:11:48 2012 From: aconraz at gmail.com (Alano Conraz) Date: Mon, 27 Aug 2012 11:11:48 +0200 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins Message-ID: Hello, i don't know if it a the right place to ask my question related to the development of dovecot plugins, please correct me if it is not. I'm trying some dovecot plugin development. I did a little plugin that suit my needs but i'd like to go further now... I would like to know if there is a kind of "getenv" function that I could call to retrieve in my plugin the username of the mailbox being delivered by dovecot-lda or served by imap server. For example, when I use the deliver with "cat file.txt | deliver -d " user at domain.net" -f "me at domain.net" I would like to call a function that could return for me the argument of "-d" or "-f". i'm working with dovecot 2.0.17 by now. Thank you From tss at iki.fi Mon Aug 27 12:15:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 12:15:49 +0300 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: References: Message-ID: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> On 27.8.2012, at 12.11, Alano Conraz wrote: > I'm trying some dovecot plugin development. I did a little plugin that suit > my needs but i'd like to go further now... I would like to know if there is > a kind of "getenv" function that I could call to retrieve in my plugin the > username of the mailbox being delivered by dovecot-lda or served by imap > server. struct mail_user->username has it. How you get to struct mail_user depends on where you want to access it from. Note that each process is capable of handling multiple different users (although it's not commonly done). From amateo at um.es Mon Aug 27 13:32:13 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 27 Aug 2012 12:32:13 +0200 Subject: [Dovecot] doveadm commands returning 139 at director servers Message-ID: <503B4CAD.6090908@um.es> Hello, I have configured director in front of dovecot imap/pop/lmtp servers. When I need to manipulate a user mailbox, I use doveadm commands at director server's, with -S option. But some commands return exit code 139 when command returns more than 40 entries (I think). For example, the command: sudo doveadm fetch -u amateo hdr mailbox Trash HEADER Subject "nyctalus11/" executed at the backend server returns 952 mails, but executed at director server with -S option, returns only 40 mails and exit code 139. I'm using dovecot 2.1.5 and I attached doveconf -n at director and backend servers. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.2.19um1 x86_64 Ubuntu 12.04.1 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_verbose = yes default_process_limit = 1024 disable_plaintext_auth = no log_timestamp = %Y-%m-%d %H:%M:%S login_trusted_networks = 155.54.211.176/28 mail_debug = yes mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_privileged_group = mail mdbox_rotate_size = 20 M namespace { inbox = yes location = prefix = separator = . } namespace { hidden = yes list = no location = maildir:~/Maildir/expunged prefix = BORRADOS. separator = . } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = session=yes dovecot driver = pam } plugin { lazy_expunge = BORRADOS. quota = maildir:User quota quota_rule = *:storage=20G quota_rule2 = Trash:storage=+1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at um.es service anvil { client_limit = 2051 } service auth { client_limit = 3072 unix_listener auth-userdb { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap { process_limit = 5120 process_min_avail = 6 vsz_limit = 512 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3 { process_min_avail = 6 } ssl = no ssl_cert = } -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-24-generic x86_64 Ubuntu 12.04.1 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_username_format = %n auth_verbose = yes default_process_limit = 1024 director_mail_servers = 155.54.211.161-155.54.211.164 director_servers = 155.54.211.185 155.54.211.186 director_username_hash = %n disable_plaintext_auth = no doveadm_proxy_port = 24245 lmtp_proxy = yes log_timestamp = %Y-%m-%d %H:%M:%S mail_debug = yes passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = proxy=y nopassword=y proxy_timeout=600 driver = static } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 } service anvil { client_limit = 2051 } service auth { client_limit = 3072 unix_listener auth-userdb { mode = 0666 } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { client_limit = 2206 executable = imap-login director process_limit = 6 process_min_avail = 6 service_count = 0 } service imap { process_limit = 5120 process_min_avail = 6 vsz_limit = 512 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3-login { client_limit = 833 executable = pop3-login director process_limit = 6 process_min_avail = 6 service_count = 0 } service pop3 { process_min_avail = 6 } ssl = no ssl_cert = } From benjamin.guy.thomas at gmail.com Mon Aug 27 13:40:10 2012 From: benjamin.guy.thomas at gmail.com (Benjamin Thomas) Date: Mon, 27 Aug 2012 12:40:10 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects Message-ID: Hi, I'm running a small email server with the help of iRedMail. I can manage sieve scripts from the Rouncube web interface or manually inside the user's personal sieve folder. I have an email account setup to receive automated tasks. Some of these "alerts" occur too often and they have the same subject line, but different senders. This is the rule I am currently using: ##CODE START## # rule:[AutoAlerts] if anyof ( header :matches "Subject" "AutoAlert Type1*", header :matches "Subject" "AutoAlert Type2*", header :matches "Subject" "AutoAlert Type3*" ) { fileinto "INBOX.AutoAlerts"; stop; } ##CODE END## I was wondering if it's possible to gracefully handle duplicate subjects lines (within a given time frame) with sieve filters ? Ideally, I would like the first email of the day with subject ""AutoAlert Type1..." to get moved to the subfolder given above. Subsequent "duplicate" emails would then go into a "duplicate" subfolder. Is this possible with sieve filters ? I could not find anything striking me as obvious while reading the page http://wiki.dovecot.org/LDA/Sieve. Thanks very much for your input. From alessio at skye.it Mon Aug 27 16:33:44 2012 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 27 Aug 2012 15:33:44 +0200 Subject: [Dovecot] Java driver for doveadm In-Reply-To: References: Message-ID: <503B7738.1040308@skye.it> Il 27/08/2012 09:01, Timo Sirainen ha scritto: > On 26.8.2012, at 18.21, Thufir wrote: > >> I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and >> there a few features I like which javax.mail just doesn't have. Is >> there maybe a Java driver for doveadm? > You can access doveadm via TCP socket. Would that be enough? > How can I configure doveadm to listen via socket? I'm developing an interface, in Ruby, to manage a mail server and could be useful. Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it From aconraz at gmail.com Mon Aug 27 16:47:12 2012 From: aconraz at gmail.com (Alano Conraz) Date: Mon, 27 Aug 2012 15:47:12 +0200 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> References: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> Message-ID: > > struct mail_user->username has it. How you get to struct mail_user depends > on where you want to access it from. Note that each process is capable of > handling multiple different users (although it's not commonly done). > i'm not sure to understand the last part. mail_user->username is a char *, right ? What is the content of the string if there is multiple users ? Thanks for your answer btw. From tss at iki.fi Mon Aug 27 16:51:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 16:51:03 +0300 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: References: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> Message-ID: On 27.8.2012, at 16.47, Alano Conraz wrote: > struct mail_user->username has it. How you get to struct mail_user depends on where you want to access it from. Note that each process is capable of handling multiple different users (although it's not commonly done). > > i'm not sure to understand the last part. mail_user->username is a char *, right ? What is the content of the string if there is multiple users ? > Thanks for your answer btw. Each user has a separate struct mail_user. I was mainly trying to say that that's the reason for why there's no global variable or such where you can get access to the username. From tss at iki.fi Mon Aug 27 16:54:28 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 16:54:28 +0300 Subject: [Dovecot] Java driver for doveadm In-Reply-To: <503B7738.1040308@skye.it> References: <503B7738.1040308@skye.it> Message-ID: <74977FCB-7525-42B5-BFFB-DF8B390871FA@iki.fi> On 27.8.2012, at 16.33, Alessio Cecchi wrote: > How can I configure doveadm to listen via socket? I'm developing an interface, in Ruby, to manage a mail server and could be useful. http://wiki2.dovecot.org/Director#Doveadm_server has an example. Now, what the protocol itself looks like isn't documented anywhere currently.. You could look at what doveadm sends when it's talking to a remote doveadm server via -s host:port parameter. Or from code see doveadm-mail-server.c:doveadm_mail_server_handle() From zucca at systemschmiede.com Mon Aug 27 18:05:52 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Mon, 27 Aug 2012 17:05:52 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: <503B8CD0.5070202@systemschmiede.com> Hi Timo, hi list I upgraded: dovecot --version 2.1.7 But still i have this ghostfolder as soon as i want to use prefix = shares/%%n/ all is good, when using prefix = shares/%%u/ Any idea what could be wrong? Thank you very much Sascha Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 Am 25.08.2012 15:06, schrieb Timo Sirainen: > It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. > > On 25.8.2012, at 15.56, Sascha Zucca wrote: > >> Hi Timo, >> dovecot --version >> 1.2.15 >> >> It's the stable one for debian squeeze i presume. >> >> Thank you for your help. >> >> Sascha >> >> >> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>> >>>> Hi List, >>>> i found out the following: >>>> The problem with the "ghostfolder" occurs only if i use >>>> >>>> prefix = shares/%%n/ >>>> >>>> When using >>>> prefix = shares/%%u/ >>>> >>>> everytung's ok! >>> What Dovecot version? >>> >>> >> >> -- >> Systemschmiede IT-L?sungen >> Zucca & Teves GbR >> August-Thyssen-Str. 2-4 >> 52511 Geilenkirchen >> www.systemschmiede.com >> >> >> Tel.: 02451 - 9088390 >> Fax: 02451 - 9124070 >> Mobil: 0178 - 4073254 >> >> Ust.ID: DE248030393 >> From pj.netfilter at gmail.com Tue Aug 28 10:47:41 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 13:17:41 +0530 Subject: [Dovecot] Help with Virtual Plugin Message-ID: Dear Experts, I have configured virtual plugin for my setup which is working as expected but after this dovecot lda is unable to deliver message to any mailbox and showing following error:- Error: user XXXXX: Initialization failed: Namespace 'virtual.': Unknown mail storage driver virtual Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to server log for more information. Here is Namespace setting on my server:- namespace { type = private separator = . prefix = inbox = yes } namespace { prefix = virtual. separator = . location = virtual:~/Maildir/virtual:LAYOUT=maildir++ } Please let me know what could be the issue.. From robert at schetterer.org Tue Aug 28 11:21:57 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 28 Aug 2012 10:21:57 +0200 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: References: Message-ID: <503C7FA5.5020400@schetterer.org> Am 28.08.2012 09:47, schrieb Joy: > Dear Experts, > I have configured virtual plugin for my setup > which is working as expected but after this dovecot lda is unable to > deliver message to any mailbox and showing following error:- > > > Error: user XXXXX: Initialization failed: Namespace 'virtual.': > Unknown mail storage driver virtual > Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to > server log for more information. > > Here is Namespace setting on my server:- > > > namespace { > type = private > separator = . > prefix = > inbox = yes > } > > namespace { > prefix = virtual. > separator = . > location = virtual:~/Maildir/virtual:LAYOUT=maildir++ > } > > > Please let me know what could be the issue.. > have you read http://wiki2.dovecot.org/Plugins/Virtual ? do you load mail_plugins = $mail_plugins virtual ? show you whole setup -- Best Regards MfG Robert Schetterer From zucca at systemschmiede.com Tue Aug 28 11:30:02 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Tue, 28 Aug 2012 10:30:02 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: <503C818A.4010203@systemschmiede.com> another update on this: I have this in my logfile: Debug: Namespace : type=shared, prefix=Freigaben/%u/, sep=/, inbox=no, hidden=yes, list=children, subscriptions=no location=maildir:/var/vmail/%d/%n/Maildir:INDEX=/var/vmail/parrotshop.de/testuser-2/Maildir/shared/%u Though this is in my dovecot.conf: prefix=Freigaben/%%u/ location=maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u How come? And does this behaviour maybe also explain the unnamed folder i have when using prefix=Freigaben/%%n/ instead of %%u ? Thanks for your assistance Sascha > > Hi Timo, hi list > I upgraded: > dovecot --version > 2.1.7 > But still i have this ghostfolder as soon as i want to use > prefix = shares/%%n/ > > all is good, when using > prefix = shares/%%u/ > > > Any idea what could be wrong? > > > Thank you very much > Sascha > > Systemschmiede IT-L?sungen > Zucca & Teves GbR > August-Thyssen-Stra?e 2-4 > 52511 Geilenkirchen > www.systemschmiede.com > > > Tel.: 02451 - 9088390 > Fax: 02451 - 9124070 > Mobil: 0178 - 4073254 > > Ust.ID: DE248030393 > > Am 25.08.2012 15:06, schrieb Timo Sirainen: >> It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. >> >> On 25.8.2012, at 15.56, Sascha Zucca wrote: >> >>> Hi Timo, >>> dovecot --version >>> 1.2.15 >>> >>> It's the stable one for debian squeeze i presume. >>> >>> Thank you for your help. >>> >>> Sascha >>> >>> >>> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>>> >>>>> Hi List, >>>>> i found out the following: >>>>> The problem with the "ghostfolder" occurs only if i use >>>>> >>>>> prefix = shares/%%n/ >>>>> >>>>> When using >>>>> prefix = shares/%%u/ >>>>> >>>>> everytung's ok! >>>> What Dovecot version? >>>> >>>> >>> >>> -- >>> Systemschmiede IT-L?sungen >>> Zucca & Teves GbR >>> August-Thyssen-Str. 2-4 >>> 52511 Geilenkirchen >>> www.systemschmiede.com >>> >>> >>> Tel.: 02451 - 9088390 >>> Fax: 02451 - 9124070 >>> Mobil: 0178 - 4073254 >>> >>> Ust.ID: DE248030393 >>> > From pj.netfilter at gmail.com Tue Aug 28 14:19:27 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 16:49:27 +0530 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: <503C7FA5.5020400@schetterer.org> References: <503C7FA5.5020400@schetterer.org> Message-ID: I have loaded the module in IMAP file as suggested in wiki. On Tue, Aug 28, 2012 at 1:51 PM, Robert Schetterer wrote: > Am 28.08.2012 09:47, schrieb Joy: >> Dear Experts, >> I have configured virtual plugin for my setup >> which is working as expected but after this dovecot lda is unable to >> deliver message to any mailbox and showing following error:- >> >> >> Error: user XXXXX: Initialization failed: Namespace 'virtual.': >> Unknown mail storage driver virtual >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to >> server log for more information. >> >> Here is Namespace setting on my server:- >> >> >> namespace { >> type = private >> separator = . >> prefix = >> inbox = yes >> } >> >> namespace { >> prefix = virtual. >> separator = . >> location = virtual:~/Maildir/virtual:LAYOUT=maildir++ >> } >> >> >> Please let me know what could be the issue.. >> > > have you read > > http://wiki2.dovecot.org/Plugins/Virtual ? > > do you load > > mail_plugins = $mail_plugins virtual ? > > show you whole setup > > -- > Best Regards > MfG Robert Schetterer From Ralf.Hildebrandt at charite.de Tue Aug 28 14:24:08 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Tue, 28 Aug 2012 13:24:08 +0200 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: References: <503C7FA5.5020400@schetterer.org> Message-ID: <20120828112408.GD14245@charite.de> * Joy : > I have loaded the module in IMAP file as suggested in wiki. But the LDA is throwing the error. Did you add it there as well? > >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to > >> server log for more information. -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From pj.netfilter at gmail.com Tue Aug 28 16:02:08 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 18:32:08 +0530 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: <20120828112408.GD14245@charite.de> References: <503C7FA5.5020400@schetterer.org> <20120828112408.GD14245@charite.de> Message-ID: Thanks .. It helped me .. On Tue, Aug 28, 2012 at 4:54 PM, Ralf Hildebrandt wrote: > * Joy : >> I have loaded the module in IMAP file as suggested in wiki. > > But the LDA is throwing the error. Did you add it there as well? > >> >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to >> >> server log for more information. > > -- > Ralf Hildebrandt > Gesch?ftsbereich IT | Abteilung Netzwerk > Charit? - Universit?tsmedizin Berlin > Campus Benjamin Franklin > Hindenburgdamm 30 | D-12203 Berlin > Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 > ralf.hildebrandt at charite.de | http://www.charite.de > From no-reply at dropboxmail.com Tue Aug 28 17:13:16 2012 From: no-reply at dropboxmail.com (Dropbox) Date: Tue, 28 Aug 2012 14:13:16 +0000 Subject: [Dovecot] Fabricio Archanjo invited you to check out Dropbox Message-ID: <20120828141316.1902FB408F2@sjc-batch3.sjc.dropbox.com> Fabricio Archanjo wants you to try Dropbox! Dropbox lets you bring all your photos, docs and videos with you anywhere and share them easily. Accept invitation here: http://www.dropbox.com/el/?r=/referrals/NjI1MTc0MTkzODc%3Fsrc%3Dreferrals_bulk9%26eh%3D597a916&b=clk:None:18425774632604476847:789:462&z=AABq5aDvAxIPiLnfMP0QGm4052ThNJIoPgpBWZ7hh8WIpA - The Dropbox Team ____________________________________________________ To stop receiving invites from Dropbox, please go to http://www.dropbox.com/bl/694ad39c033e/dovecot%40dovecot.org From no-reply at dropboxmail.com Tue Aug 28 17:14:16 2012 From: no-reply at dropboxmail.com (Dropbox) Date: Tue, 28 Aug 2012 14:14:16 +0000 Subject: [Dovecot] Fabricio Archanjo invited you to check out Dropbox Message-ID: <20120828141416.3F1F0B40545@sjc-batch3.sjc.dropbox.com> Fabricio Archanjo wants you to try Dropbox! Dropbox lets you bring all your photos, docs and videos with you anywhere and share them easily. Accept invitation here: http://www.dropbox.com/el/?r=/referrals/NjI1MTc0NDM1Mjc%3Fsrc%3Dreferrals_bulk9%26eh%3D597a916&b=clk:None:16632688623146141049:789:462&z=AABGfwc2Hx_ZSAT0TKGYP34S_535s5Wa-UF_hbzBU7FEyA - The Dropbox Team ____________________________________________________ To stop receiving invites from Dropbox, please go to http://www.dropbox.com/bl/694ad39c033e/dovecot%40dovecot.org From aconraz at gmail.com Tue Aug 28 17:38:54 2012 From: aconraz at gmail.com (Alano Conraz) Date: Tue, 28 Aug 2012 16:38:54 +0200 Subject: [Dovecot] use sieve plugin with variable and folders Message-ID: Hello , I'm trying to use the pigeonhole plugin but I'm experiencing configuration problem... Hope you could help me! Firstly : my sieve filter test is the next one : /////////////////// require ["fileinto" , "variables" , "mailbox"]; if address :matches "Delivered-To" "*@*.*" { fileinto :create ".INBOX.iop" ; stop ; } //////////////////// I get in the log the following : "error: msgid=<****>: failed to store into mailbox '.INBOX.iop': Invalid mailbox name" And the email is stored in the INBOX (implicit keep was successful) I checked that "lda_mailbox_autocreate" and "lda_mailbox_autosubscribre" are set to "yes". Then , when this problem be solved, I would like to know if it is possible with the sieve plugin to implement the following algorithm : - extract the address from the header field "Delivered-To" and set the variable $delivto to this previous value. - extract the address from the header field "To" and set the variable $to to this previous value. - compare $delivto and $to : if they are diffrent, then redirect the email in the subfolder .INBOX.iop. Thank you for any help! From ewald.lists at fun.de Tue Aug 28 17:42:13 2012 From: ewald.lists at fun.de (Ewald Dieterich) Date: Tue, 28 Aug 2012 16:42:13 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <503CD8C5.7060907@fun.de> On 08/08/12 14:23, Andre Gr?be wrote: > I am using dovecot (see dovecot -n output below) with metadata plugin in > my own plugin. I want to insert and delete some large metadata (>4KiB). > It seems, that the delete in a second call of my plugin smashes the file > dovecot.dict in users dir: That's an error in dict-file.c, file_dict_refresh(): while ((key = i_stream_read_next_line(input)) != NULL && (value = i_stream_read_next_line(input)) != NULL) { If reading the value requires reading from the stream (because the value doesn't fit into the input buffer), the key is overwritten. The attached patch duplicates the key before reading the value. -------------- next part -------------- A non-text attachment was scrubbed... Name: dict-file.c.patch Type: text/x-diff Size: 665 bytes Desc: not available URL: From stephan at rename-it.nl Tue Aug 28 18:03:41 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:03:41 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects In-Reply-To: References: Message-ID: <503CDDCD.4060407@rename-it.nl> Op 8/27/2012 12:40 PM, Benjamin Thomas schreef: > Hi, > > I was wondering if it's possible to gracefully handle duplicate subjects > lines (within a given time frame) with sieve filters ? > > Ideally, I would like the first email of the day with subject ""AutoAlert > Type1..." to get moved to the subfolder given above. Subsequent "duplicate" > emails would then go into a "duplicate" subfolder. > > Is this possible with sieve filters ? I could not find anything striking me > as obvious while reading the page http://wiki.dovecot.org/LDA/Sieve. It is currently not possible to maintain some sort of custom state information between deliveries, i.e. Sieve invocations. There is the unofficial vnd.dovecot.duplicate extension, but that uses the message-id exclusively and (currently) cannot be used to track duplicate subjects. Regards, Stephan. From benjamin.guy.thomas at gmail.com Tue Aug 28 18:07:01 2012 From: benjamin.guy.thomas at gmail.com (Benjamin Thomas) Date: Tue, 28 Aug 2012 17:07:01 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects In-Reply-To: <503CDDCD.4060407@rename-it.nl> References: <503CDDCD.4060407@rename-it.nl> Message-ID: Ok. Thanks very much for your response! 2012/8/28 Stephan Bosch > Op 8/27/2012 12:40 PM, Benjamin Thomas schreef: > >> Hi, >> >> >> I was wondering if it's possible to gracefully handle duplicate subjects >> lines (within a given time frame) with sieve filters ? >> >> Ideally, I would like the first email of the day with subject ""AutoAlert >> Type1..." to get moved to the subfolder given above. Subsequent >> "duplicate" >> emails would then go into a "duplicate" subfolder. >> >> Is this possible with sieve filters ? I could not find anything striking >> me >> as obvious while reading the page http://wiki.dovecot.org/LDA/**Sieve >> . >> > > It is currently not possible to maintain some sort of custom state > information between deliveries, i.e. Sieve invocations. There is the > unofficial vnd.dovecot.duplicate extension, but that uses the message-id > exclusively and (currently) cannot be used to track duplicate subjects. > > Regards, > > Stephan. > > > -- *Benjamin Thomas* From stephan at rename-it.nl Tue Aug 28 18:08:49 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:08:49 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: <503CDF01.5040007@rename-it.nl> Op 8/22/2012 8:56 AM, David Anderson schreef: > > Self-explanatory, I hope (note the period on the end of the username); > sieve/pigeonhole does not allow you to have senders which end with a > period, which means that any UNIX users with such usernames who send > mail have it rejected by sieve: > > # useradd testuser. > # su - testuser. > $ mail david at example.com -s 'testing' > 123 > . > [testuser. at levi ~]$ logout > > # less /var/log/maillog > > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: > envelope sender address 'testuser. at myhost.example.com' is unparsable > > Versions: > dovecot-pigeonhole-0.2.6-21.el5 > dovecot-managesieve-0.2.6-21.el5 > dovecot-2.0.18-1_134.el5 > > Why would anyone have a UNIX username ending in a period? For one, web > hosting companies may use your domain name as your username - but be > subject to a 32-character limit, so your domain name gets truncated. I would have expected to see that address escaped as "testuser."@myhost.example.com. I notice that I haven't tested such addresses much with Sieve and I don't actually know in what form MTAs provide such addresses to the LDA. I'll give that a look soon. Regards, Stephan. From stephan at rename-it.nl Tue Aug 28 18:25:54 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:25:54 +0200 Subject: [Dovecot] use sieve plugin with variable and folders In-Reply-To: References: Message-ID: <503CE302.4060506@rename-it.nl> Op 8/28/2012 4:38 PM, Alano Conraz schreef: > Hello , > > I'm trying to use the pigeonhole plugin but I'm experiencing configuration > problem... Hope you could help me! > > Firstly : > my sieve filter test is the next one : > /////////////////// > require ["fileinto" , "variables" , "mailbox"]; > > if address :matches "Delivered-To" "*@*.*" { > fileinto :create ".INBOX.iop" ; stop ; > } > //////////////////// > > I get in the log the following : "error: msgid=<****>: failed to store into > mailbox '.INBOX.iop': Invalid mailbox name" > And the email is stored in the INBOX (implicit keep was successful) > I checked that "lda_mailbox_autocreate" and "lda_mailbox_autosubscribre" > are set to "yes". Mailbox name should probably not start with a '.'. I'm assuming it is a maildir storage. The physical mailbox directories in that maildir have a '.' prefix, but the actual mailbox name does not: it should be 'INBOX.iop'. > Then , when this problem be solved, I would like to know if it is possible > with the sieve plugin to implement the following algorithm : > - extract the address from the header field "Delivered-To" and set the > variable $delivto to this previous value. > - extract the address from the header field "To" and set the variable > $to to this previous value. > - compare $delivto and $to : if they are diffrent, then redirect the > email in the subfolder .INBOX.iop. > > > Thank you for any help! Something like this: require ["fileinto", "variables", "mailbox"]; if address :matches "delivered-to" "*" { set "delivto" "${1}"; } if address :matches "to" "*" { set "to" "${1}"; } if not string "${delivto}" "${to}" { fileinto :create "INBOX.iop"; stop; } For reference you can read RFC5229 (http://tools.ietf.org/html/rfc5229). Regards, Stephan. From tss at iki.fi Tue Aug 28 18:48:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 18:48:49 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: On 22.8.2012, at 9.56, David Anderson wrote: > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: envelope sender address 'testuser. at myhost.example.com' is unparsable Also is this really rejecting the mail?.. When I looked at it I thought it would simply replace the sender with empty string. From tss at iki.fi Tue Aug 28 18:54:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 18:54:03 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <503CD8C5.7060907@fun.de> References: <50225A24.4010109@fun.de> <503CD8C5.7060907@fun.de> Message-ID: <48AB63AB-A4CF-4B99-AF71-91966896C202@iki.fi> On 28.8.2012, at 17.42, Ewald Dieterich wrote: > On 08/08/12 14:23, Andre Gr?be wrote: >> I am using dovecot (see dovecot -n output below) with metadata plugin in >> my own plugin. I want to insert and delete some large metadata (>4KiB). >> It seems, that the delete in a second call of my plugin smashes the file >> dovecot.dict in users dir: > > That's an error in dict-file.c, file_dict_refresh(): > > while ((key = i_stream_read_next_line(input)) != NULL && > (value = i_stream_read_next_line(input)) != NULL) { > > If reading the value requires reading from the stream (because the value doesn't fit into the input buffer), the key is overwritten. The attached patch duplicates the key before reading the value. Committed: http://hg.dovecot.org/dovecot-2.1/rev/6e53209030f6 From tss at iki.fi Tue Aug 28 19:12:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 19:12:16 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <20120825232833.GA11297@daniel.localdomain> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> <20120825232833.GA11297@daniel.localdomain> Message-ID: On 26.8.2012, at 2.28, Daniel Parthey wrote: > What would the configuration look like if I want to setup > one lmtp service with quota enforcing on port 10024 and > another lmtp service without enforcing on port 20024? > Especially how to define two "protocol lmtp" sections > which are assigned to their specific service? You can't. (Maybe you could create another service lmtp2 {} block and override the quota setting with lmtp -o plugin/quota=.. parameter, but I don't know if that would work.) > or will I need to define SQL statements in the userdb > lookup which selects "noenforcing" depending on local port? That would work. From mgc_dovecot at chamberlain.net.au Wed Aug 29 04:07:11 2012 From: mgc_dovecot at chamberlain.net.au (mgc_dovecot at chamberlain.net.au) Date: Wed, 29 Aug 2012 11:07:11 +1000 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: References: <50375D3E.50409@googlemail.com> Message-ID: <503D6B3F.4040004@chamberlain.net.au> On 27/08/2012 5:03 PM, Timo Sirainen wrote: > On 24.8.2012, at 13.53, Tim Smith wrote: > >> Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! > Other than the bandwidth others already mentioned, the only reason it could be Dovecot's fault is exactly the size of the Sent mailbox. How large is that and what mailbox format are you using? > I missed the original message, but if your users are using Thunderbird I've seen slow sending of email be caused by a large number of temporary files being created by Thunderbird (it doesn't clean up properly), and so when it goes to create a new temporary file it goes very slowly - it may be worth checking the users mailboxes to see if they have a large number of temporary files with a similar name but different number (I forget the name, sorry - it might start with something like "nsmail", but may not). Stop Thunderbird, clear out the temporary files, and sending becomes much faster (if this is the cause of the problem). Regards, Michael. From dmalolepszy at optusnet.com.au Wed Aug 29 05:14:47 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Wed, 29 Aug 2012 12:14:47 +1000 Subject: [Dovecot] Dovecot Director Output buffer full Message-ID: <503D7B17.9020308@optusnet.com.au> Hi, I have been seeing the following messages in logs on all my Dovecot servers each running both a dovecot-director instance and a dovecot pop3/imap backend. These logs appear to relate to problems with the director. Aug 28 16:09:52 dovecot01 dovecot: director: Error: director(10.0.0.2:9090/right): Output buffer full, disconnecting Aug 28 16:10:01 dovecot01 dovecot: director: Error: Ring SYNC appears to have got lost, resending Aug 28 16:10:02 dovecot01 dovecot: director: Error: Director 10.0.0.2:9090/right disconnected Aug 28 16:09:51 dovecot02 dovecot: director: Error: director(10.0.0.3:9090/right): Output buffer full, disconnecting Aug 28 16:09:57 dovecot02 dovecot: director: Error: Ring SYNC appears to have got lost, resending Aug 28 16:10:01 dovecot02 dovecot: director: Error: Director 10.0.0.3:9090/right disconnected Aug 28 16:10:02 dovecot02 dovecot: director: Error: director(10.0.0.1:9090/left): Ping timed out, disconnecting Aug 28 16:13:15 dovecot02 dovecot: director: Warning: Delaying new user requests until ring is synced Note dovecot01 has IP 10.0.0.1 and dovecot02 has IP 10.0.0.2 and so on. This seems to show up when I enable the poolmon script (https://github.com/brandond/poolmon) on all the servers, and all servers start simultaneous logins to each others Dovecot backends. I did notice that the poolmon script has been flapping vhost weights a lot (I am looking at making the script handle transient errors better), which means that it is connecting to the dovecot-director socket every few minutes and changing vhost weights from 100 to 0 and vice-versa. Is there some sort of limit in the Dovecot Director that is being exceeded that should be tweaked? # 2.1.5: /etc/dovecot-director/dovecot.conf # OS: Linux 2.6.32-279.el6.mccqfix.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.3 (Santiago) auth_cache_size = 100 M auth_default_realm = example.com auth_failure_delay = 5 secs auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 auth_worker_max_count = 600 base_dir = /var/run/dovecot-director/ director_mail_servers = 10.0.0.1 10.0.0.2 10.0.0.3 10.0.0.4 10.0.0.5 director_servers = 10.0.0.1 10.0.0.2 10.0.0.3 10.0.0.4 10.0.0.5 disable_plaintext_auth = no instance_name = dovecot-dir passdb { args = /etc/dovecot-director/dovecot-sql.conf driver = sql } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 10.0.0.1 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { address = 10.0.0.1 port = 143 } inet_listener imaps { address = 10.0.0.1 port = 993 ssl = yes } process_min_avail = 100 } service pop3-login { executable = pop3-login director inet_listener pop3 { address = 10.0.0.1 port = 110 } inet_listener pop3s { address = 10.0.0.1 port = 995 ssl = yes } process_min_avail = 100 } verbose_proctitle = yes From zucca at systemschmiede.com Wed Aug 29 12:37:29 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 29 Aug 2012 11:37:29 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503C818A.4010203@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> Message-ID: <503DE2D9.3080300@systemschmiede.com> Hi all. Sorry, but i can't believe noone has a hint on this one. I guess it's just some stupid detail i am missing. dovecot --version 2.1.7 If in the shared folders part of dovecot.conf i use: *prefix = Freigaben/%%n/ * Then in the subscription menu (and later in shared Folder too) i see http://s9.postimage.org/6aohh97ov/iehadjhb.jpg (Open-Xchange-GUI) http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) all is good, when using *prefix = Freigaben/%%u/ * only the name is very longish then, so i'd really prefer "n". Please help me. Thank you very much Sascha Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 Am 28.08.2012 10:30, schrieb Sascha Zucca: > another update on this: > > I have this in my logfile: > Debug: Namespace : type=shared, prefix=Freigaben/%u/, sep=/, inbox=no, > hidden=yes, list=children, subscriptions=no > location=maildir:/var/vmail/%d/%n/Maildir:INDEX=/var/vmail/parrotshop.de/testuser-2/Maildir/shared/%u > > Though this is in my dovecot.conf: > > prefix=Freigaben/%%u/ > location=maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u > > > How come? And does this behaviour maybe also explain the unnamed > folder i have when using prefix=Freigaben/%%n/ instead of %%u ? > > Thanks for your assistance > Sascha > > >> >> Hi Timo, hi list >> I upgraded: >> dovecot --version >> 2.1.7 >> But still i have this ghostfolder as soon as i want to use >> prefix = shares/%%n/ >> >> all is good, when using >> prefix = shares/%%u/ >> >> >> Any idea what could be wrong? >> >> >> Thank you very much >> Sascha >> >> Systemschmiede IT-L?sungen >> Zucca & Teves GbR >> August-Thyssen-Stra?e 2-4 >> 52511 Geilenkirchen >> www.systemschmiede.com >> >> >> Tel.: 02451 - 9088390 >> Fax: 02451 - 9124070 >> Mobil: 0178 - 4073254 >> >> Ust.ID: DE248030393 >> >> Am 25.08.2012 15:06, schrieb Timo Sirainen: >>> It's very likely that this has been fixed in v2.1. And in any case >>> I'm not fixing non-security bugs anymore for v1.x. You can find v2.x >>> debian packages from backports.org. >>> >>> On 25.8.2012, at 15.56, Sascha Zucca wrote: >>> >>>> Hi Timo, >>>> dovecot --version >>>> 1.2.15 >>>> >>>> It's the stable one for debian squeeze i presume. >>>> >>>> Thank you for your help. >>>> >>>> Sascha >>>> >>>> >>>> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>>>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>>>> >>>>>> Hi List, >>>>>> i found out the following: >>>>>> The problem with the "ghostfolder" occurs only if i use >>>>>> >>>>>> prefix = shares/%%n/ >>>>>> >>>>>> When using >>>>>> prefix = shares/%%u/ >>>>>> >>>>>> everytung's ok! >>>>> What Dovecot version? >>>>> >>>>> >>>> >>>> -- >>>> Systemschmiede IT-L?sungen >>>> Zucca & Teves GbR >>>> August-Thyssen-Str. 2-4 >>>> 52511 Geilenkirchen >>>> www.systemschmiede.com >>>> >>>> >>>> Tel.: 02451 - 9088390 >>>> Fax: 02451 - 9124070 >>>> Mobil: 0178 - 4073254 >>>> >>>> Ust.ID: DE248030393 >>>> >> From rrosenfeld at netcologne.de Wed Aug 29 15:44:47 2012 From: rrosenfeld at netcologne.de (Roland Rosenfeld) Date: Wed, 29 Aug 2012 14:44:47 +0200 Subject: [Dovecot] ACL MySQL dict: to_user==from_user entries Message-ID: <20120829124447.GA16592@sys-241.netcologne.de> Hi! We run dovecot 2.1.6 with ACL support and MySQL dict for shared/shared-boxes/user/$to/$from. When a user does a SETACL (via IMAP) to himself he is added as $to and $from to the MySQL dict. Se for example this IMAP conversation: 5 GETACL INBOX * ACL "INBOX" "user at domain" lrwstipekxacd 5 OK Getacl completed. 6 SETACL INBOX user at domain lrwstipekxacd 6 OK Setacl complete. 7 GETACL INBOX * ACL "INBOX" "user at domain" akxeilprwtscd 7 OK Getacl completed. As you can see, user at domain sets the ACL of his INBOX to the same value it was set before (reading it from the server after this idempotent write changed the order but none of the flags). But after "SETACL INBOX user at domain lrwstipekxacd" I see a new entry in my imap_acl_shares table where to_user and from_user both contain the value "user at domain". As far as I can see, this entry does not make much sense in the database, because every user should be able so see its own folders. But adding this line may blow up the database especially according to the full table scan problem for acl dict rebuild mentioned in http://www.dovecot.org/list/dovecot/2012-August/067548.html. Does it make sense to run a daily cron job, that removes all entries with from_user=to_user or may this cause other inconsistencies? If you need to have a look at my complete setup, it's in http://www.dovecot.org/list/dovecot/2012-July/067130.html, so I don't have to clone this here. Tschoeeee Roland From giles at coochey.net Wed Aug 29 18:10:02 2012 From: giles at coochey.net (Giles Coochey) Date: Wed, 29 Aug 2012 16:10:02 +0100 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <503E30CA.7010007@coochey.net> On 23/08/2012 21:49, Timo Sirainen wrote: > On 23.8.2012, at 23.26, Warren Baker wrote: > >> On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >>> On 14.8.2012, at 11.18, Timo Sirainen wrote: >>> >>> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). > I specifically use 172.16.0.0/12 because others don't, I also specifically don't use 172.16.0.0/16, because if someone does use 172.16.0.0/12 they usually only use 172.16.0.0/16... It's easy for people to connect to my networks via a VPN connection, and generally not have any IP conflicts with their own RFC1918 ranges and not have to fiddle with NAT issues. -- Regards, Giles Coochey, CCNA, CCNAS NetSecSpec Ltd +44 (0) 7983 877438 http://www.coochey.net http://www.netsecspec.co.uk giles at coochey.net -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4968 bytes Desc: S/MIME Cryptographic Signature URL: From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 29 23:48:14 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 29 Aug 2012 22:48:14 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503DE2D9.3080300@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> Message-ID: <20120829204814.GA9265@daniel.localdomain> Hi Sascha, Sascha Zucca wrote: > Sorry, but i can't believe noone has a hint on this one. Sorry, but you forgot to post your complete doveconf -n output and how to exactly reproduce this. > http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) I'm getting the same result when SIEVE sorts Messages into autocreated subfolders inside of folders which do not exist. So it's probably not a ghost folder, it is just an intermediate folder which does not exist itself, but contains existing subfolders. This forces your mail client to display the folder in the tree: INBOX exists (black) INBOX/foo does not exist (grey) INBOX/foo/bar exists (black) HTH and Regards Daniel -- https://plus.google.com/103021802792276734820 From kgc at corp.sonic.net Thu Aug 30 00:47:00 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Wed, 29 Aug 2012 14:47:00 -0700 Subject: [Dovecot] FS Quotas, what am I doing wrong? Message-ID: <20120829214700.GN13924@corp.sonic.net> I'm not able to get the FS quota module to behave as I expect. Depsite having function fs quotas and dovecot apparently configured to use then, the quotas appear to be empty and/or not configured. Any clues? # quota kgc Disk quotas for user kgc (uid 500): Filesystem blocks quota limit grace files quota limit grace /dev/sda3 1229460 7000000 8000000 103776 5000000 6000000 # doveadm quota get -u kgc Quota name Type Value Limit % User user STORAGE 0 - 0 User user MESSAGE 0 - 0 # telnet 0 143 ... A003 GETQUOTAROOT INBOX <- Not sure this is correct A003 OK No quota. imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=6048, secured, session=<1CGqXm7IhwB/AAAB> imap: Debug: Loading modules from directory: /usr/lib64/dovecot imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so imap(kgc): Debug: Effective uid=500, gid=501, home=/home/kgc imap(kgc): Debug: Quota root: name=User user backend=fs args=inode_per_mail:noenforcing imap(kgc): Debug: maildir++: root=/home/kgc/Maildir, index=, control=, inbox=/home/kgc/Maildir, alt= imap(kgc): Debug: fs quota add mailbox dir = /home/kgc/Maildir imap(kgc): Debug: fs quota block device = /dev/sda3 imap(kgc): Debug: fs quota mount point = / imap(kgc): Debug: fs quota mount type = ext4 # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.5.1.el6.x86_64 x86_64 Scientific Linux release 6.0 (Carbon) mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = quota mbox_write_locks = fcntl passdb { driver = pam } plugin { quota = fs:User user:inode_per_mail:noenforcing } ssl_cert = References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> Message-ID: <503F0B77.5030206@systemschmiede.com> Hi! I am very sorry, i thought i had done so before. Well here ist is: dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-14-pve i686 Debian 6.0.5 simfs auth_mechanisms = plain login disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/var/vmail/%%d/%%n/Maildir mail_plugins = acl mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = children location = maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u prefix = Freigaben/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db quota = dict:user::file:/var/vmail/%d/%n/.quotausage sieve = /var/vmail/%d/%n/.sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } ssl_cert = Hi Sascha, > > Sascha Zucca wrote: >> Sorry, but i can't believe noone has a hint on this one. > Sorry, but you forgot to post your complete doveconf -n output > and how to exactly reproduce this. > >> http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) > I'm getting the same result when SIEVE sorts Messages into autocreated > subfolders inside of folders which do not exist. So it's probably > not a ghost folder, it is just an intermediate folder > which does not exist itself, but contains existing subfolders. > > This forces your mail client to display the folder in the tree: > > INBOX exists (black) > INBOX/foo does not exist (grey) > INBOX/foo/bar exists (black) > > HTH and Regards > Daniel -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From lists at wiesinger.com Thu Aug 30 21:34:36 2012 From: lists at wiesinger.com (Gerhard Wiesinger) Date: Thu, 30 Aug 2012 20:34:36 +0200 Subject: [Dovecot] deliver doesn't update cache index with mbox Message-ID: <503FB23C.5040309@wiesinger.com> Hello Timo, I'm having a problem with mbox that opening folder is slow when new mails are delivered to a folder. I'm delivering through the deliver program. Deliver updates index files but IHMO not completely correct. Therefore I compared index files before and after: 1.) Just delivered 2.) After accessing through imap via Thunderbird diff looks like (stripped down to the relevant things): INDEX: -first recent uid ......... = 25847 +first recent uid ......... = 25848 -log file tail offset ..... = 16468 -log file head offset ..... = 16468 +log file tail offset ..... = 16828 +log file head offset ..... = 16828 - - sync_mtime . = 2012-08-30 19:38:05 + - sync_mtime . = 2012-08-30 20:09:23 - - dirty_flag . = 1 + - dirty_flag . = 0 - - highest_modseq = 11162 + - highest_modseq = 11163 - - log_offset ... = 16468 + - log_offset ... = 16828 CACHE: -used_file_size ....... = 6385696 +used_file_size ....... = 6392132 RECORD: seq=25663, uid=25835, flags=0x00 - - ext 0 keywords : (0000) - - ext 1 modseq : 11156 (942b000000000000) + - ext 0 keywords : (0100) + - ext 1 modseq : 11163 (9b2b000000000000) - ext 2 mbox : 42923286 (16f58e0200000000) - - ext 3 cache : 0 (00000000) + - ext 3 cache : 6385696 (20706100) - ext 4 header-md5: (00000000000000000000000000000000) + - cache offset=6385696 size=488, prev_offset = 0 + - hdr.BCC: + - hdr.CC: + - hdr.CONTENT-TYPE: 18: Content-Type: text/plain; charset=us-ascii + - hdr.DATE: 13: Date: Thu, 30 Aug 2012 19:37:24 +0200 + - size.virtual: 1081 (3904000000000000) Same patterns from record: 25664-25675 What does dirty_flag=1 mean? Why are the cache headers missing and not written by deliver? Any ideas? Config is below. Thank you. Ciao, Gerhard # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux listen = * mail_full_filesystem_access = yes mail_location = mbox:~:INBOX=/var/mail/%u mbox_lazy_writes = no mbox_write_locks = fcntl passdb { driver = pam } postmaster_address = postmaster at domain protocols = imap service auth { unix_listener auth-userdb { group = users mode = 0660 } } service imap-login { inet_listener imap { port = 0 } } service imap { executable = imap postlogin } service postlogin { executable = script-login -d rawlog } ssl_cert = Hello, So I am trying to construct mail path for my LDAP user lookups, and i need to use two attributes instead of one. For examle, my LDAP directory has two attributes: departmentAttr and userIDAttr, and I want the maildir to reside in /home/${departmentAttr}/${userIDAttr} Unfortunately, I cannot seem to find a way to configure dovecot this way. Right now, I have something like user_attrs = departmentAttr=mail=maildir:/home/%$/%u But %u is the username (which in my environment can easily change, so I cannot use this for maildir location). Any ideas on how to achieve that? So far I have just one brute-force solution - to create an attribute MailDirAttr, and populate it with concatenation of departmentAttr+'/'+userIDAttr by means of a scheduled task. This sounds like unnecessary information duplication, which is usually a very bad practice. So, again - any ideas? Thank you, Anatoly. From adi at ddns.com.au Fri Aug 31 05:51:20 2012 From: adi at ddns.com.au (Adi Pircalabu) Date: Fri, 31 Aug 2012 12:51:20 +1000 Subject: [Dovecot] [Postfix] SASL Auth. using Dovecot with password forwarding proxy configuration Message-ID: <20120831125120.37a3f7cf@adi.ddns.local> Hi, I'm relatively new to Dovecot and I did a bit of search but couldn't find a possible solution for the particular setup I'm working on. Basically I have an SMTP/POP/IMAP proxy setup running Postfix & Dovecot. IMAP/POP authentication is done using the password proxy feature, where the login credentials are passed to the backend server after a db lookup, which does the actual authentication. The POP/IMAP part is working fine. What I'm trying to do is to use Dovecot SASL implementation in Postfix to do SMTP authentication in a similar manner. The problem I have with my current configuration is that SMTP authentication succeeds if only the username matches, because password forwarding works if the authentication succeeds with any given password, as documented at http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy My question is, given the above: is there a way to get SMTP authentication properly in this scenario? The way I see it now, Dovecot SASL accepting the login if only the user matches isn't quite "complete", the auth process should go further and authenticate against the backend server, same as for POP/IMAP connections. Does this requirement make any sense? Maybe I'm missing something in Dovecot configuration to get the SMTP authentication work in password forwarding mode, few pointers will be highly appreciated. PopBSMTP is not an sensible alternative in my case. Here's my configuration, plus some dovecot auth_debug log entries. As you can see, SMTP authentication succeeds with any given password. ---Dovecot--- dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.centos.plus.x86_64 x86_64 CentOS release 6.3 (Final) auth_cache_size = 4 k auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_ca = , method=PLAIN, rip=192.168.1.56, lip=192.168.1.222, TLS [...] (SMTP connection) Aug 31 11:36:14 centos6 postfix/smtpd[11213]: connect from unknown[192.168.1.200] Aug 31 11:36:14 centos6 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: auth client connected (pid=11213) Aug 31 11:36:14 centos6 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=smtp#011nologin#011lip=192.168.1.222#011rip=192.168.1.200#011resp=AGFAMGFkaXRlc3QubmV0AGFzZA== Aug 31 11:36:14 centos6 dovecot: auth: Debug: cache(a at 0aditest.net,192.168.1.200): miss Aug 31 11:36:14 centos6 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 31 11:36:14 centos6 dovecot: auth: mysql: Connected to /var/lib/mysql/mysql.sock (postfix) Aug 31 11:36:14 centos6 dovecot: auth: Debug: sql(a at 0aditest.net,192.168.1.200): query: SELECT NULL AS password, 'Y' as nopassword, host, email, 'Y' AS proxy FROM mailbox WHERE email = 'a at 0aditest.net' Aug 31 11:36:14 centos6 dovecot: auth: Debug: client out: OK#0111#011user=a at 0aditest.net#011host=203.63.79.87#011email=a at 0aditest.net#011proxy#011pass=anygivenpassword Aug 31 11:36:14 centos6 postfix/smtpd[11213]: C9620600A9: client=unknown[192.168.1.200], sasl_method=PLAIN, sasl_username=a at 0aditest.net Aug 31 11:36:14 centos6 postfix/cleanup[11219]: C9620600A9: message-id=<20120831113614.72ed32df at adi.ddns.local> [...] ---/var/log/maillog--- -- Adi Pircalabu From amateo at um.es Fri Aug 31 09:43:58 2012 From: amateo at um.es (Angel L. Mateo) Date: Fri, 31 Aug 2012 08:43:58 +0200 Subject: [Dovecot] doveadm commands returning 139 at director servers In-Reply-To: <503B4CAD.6090908@um.es> References: <503B4CAD.6090908@um.es> Message-ID: <50405D2E.6000902@um.es> El 27/08/12 12:32, Angel L. Mateo escribi?: > Hello, > > I have configured director in front of dovecot imap/pop/lmtp > servers. When I need to manipulate a user mailbox, I use doveadm > commands at director server's, with -S option. But some commands return > exit code 139 when command returns more than 40 entries (I think). > > For example, the command: > > sudo doveadm fetch -u amateo hdr mailbox Trash HEADER Subject > "nyctalus11/" > > executed at the backend server returns 952 mails, but executed at > director server with -S option, returns only 40 mails and exit code 139. > > I'm using dovecot 2.1.5 and I attached doveconf -n at director and > backend servers. > Updating from 2.1.5 to 2.1.5 has fixed the problem. From linuxmail at 4lin.net Fri Aug 31 10:55:16 2012 From: linuxmail at 4lin.net (Denny Schierz) Date: Fri, 31 Aug 2012 09:55:16 +0200 Subject: [Dovecot] mail_location / mail_home Message-ID: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> hi, I had a long (upgraded today from 2.0.17 to 2.1.9) time mail_location and mail_home at the same path, which I recognize know, that it wasn't a good idea, idea. On my testsystem I've set: mail_home = /imap/spool/%d/%1u/%u mail_location = maildir:~/:INDEX=~/ otherwise I don't have access to the mails anymore. Is that ok? cu denny From linuxmail at 4lin.net Fri Aug 31 11:15:33 2012 From: linuxmail at 4lin.net (Denny Schierz) Date: Fri, 31 Aug 2012 10:15:33 +0200 Subject: [Dovecot] mail_location / mail_home In-Reply-To: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> References: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> Message-ID: <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> Am 31.08.2012 um 09:55 schrieb Denny Schierz: > > mail_home = /imap/spool/%d/%1u/%u > mail_location = maildir:~/:INDEX=~/ I think, it doesn't make any difference, if I have "~" or a fixed path :-/ On the productive system (also 2.1.9) I get messages like: [...] dovecot.lda-dupes/tmp) failed: Not a directory [...] So, I need a way, to move ~11.000 Maildirs .... any suggestions? From zucca at systemschmiede.com Fri Aug 31 11:16:58 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 10:16:58 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503F0B77.5030206@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> Message-ID: <504072FA.8020606@systemschmiede.com> Hi! Still noone? strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. Anyways, thanks for any help Sascha Am 30.08.2012 08:43, schrieb Sascha Zucca: > Hi! > I am very sorry, i thought i had done so before. Well here ist is: > > > dovecot -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-14-pve i686 Debian 6.0.5 simfs > auth_mechanisms = plain login > disable_plaintext_auth = no > log_timestamp = "%Y-%m-%d %H:%M:%S " > mail_location = maildir:/var/vmail/%%d/%%n/Maildir > mail_plugins = acl > mail_privileged_group = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > namespace { > inbox = yes > location = > prefix = > separator = / > type = private > } > namespace { > hidden = yes > list = children > location = > maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u > prefix = Freigaben/%%n/ > separator = / > subscriptions = no > type = shared > } > passdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > plugin { > acl = vfile > acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db > quota = dict:user::file:/var/vmail/%d/%n/.quotausage > sieve = /var/vmail/%d/%n/.sieve > } > protocols = imap pop3 sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > user = root > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > protocol pop3 { > mail_plugins = quota > pop3_uidl_format = %08Xu%08Xv > } > protocol lda { > mail_plugins = sieve quota > } > protocol imap { > mail_plugins = quota imap_quota acl imap_acl > } > > > I don't really think, it has anything to do with sieve, as the folder > simply won't show up as soo as i just change prefix = Freigaben/%%n/ > to prefix = Freigaben/%%u/. > And i didn't filter into autocreated folders yet. For now, i created > only one sieve rule, that filters into an folder i created manually. > > > Thank you very much for your help > Sascha > > > > Am 29.08.2012 22:48, schrieb Daniel Parthey: >> Hi Sascha, >> >> Sascha Zucca wrote: >>> Sorry, but i can't believe noone has a hint on this one. >> Sorry, but you forgot to post your complete doveconf -n output >> and how to exactly reproduce this. >> >>> http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) >> I'm getting the same result when SIEVE sorts Messages into autocreated >> subfolders inside of folders which do not exist. So it's probably >> not a ghost folder, it is just an intermediate folder >> which does not exist itself, but contains existing subfolders. >> >> This forces your mail client to display the folder in the tree: >> >> INBOX exists (black) >> INBOX/foo does not exist (grey) >> INBOX/foo/bar exists (black) >> >> HTH and Regards >> Daniel > > From Jost.Krieger+dovecot at rub.de Fri Aug 31 11:42:34 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 31 Aug 2012 10:42:34 +0200 Subject: [Dovecot] Possible mbox corruption if mail is saved with wrong Content-Length header (2.1.6) Message-ID: <20120831084233.GE3002@ruhr-uni-bochum.de> One of our users likes to delete attachments from his mails. He is using roundcube and we installed a plugin for that. He reports that from time to time one of his mails gets corrupted (cut off in the middle). I could verify there is something wrong in the logs: imap(x1234567): Error: Cached message size larger than expected (6796 > 2844) imap(x1234567): Error: Corrupted index cache file /net/mbx3/disc2/home/85/x1234567/Index/.imap/Sent/dovecot.index.cache: Broken physical size for mail UID 5001 imap(x1234567): Error: read(/net/mbx3/disc2/home/85/x1234567/Mail/Sent) failed: Input/output error (FETCH for mailbox Sent UID 5001) imap(x1234567): Info: Disconnected: Internal error occurred. Refer to server log for more information. [2012-08-23 00:00:49] in=1124145 out=1324791 I had a look at the plugin and it works by duplicating the message and leaving out the attachment(s). The headers are also duplicated, including Content-Length. I've fixed that in the plugin, (don't know yet if it helps), but I think it shouldn't cause such breakage in dovecot. # doveconf -n # 2.1.6: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-103.ELsmp i686 Red Hat Enterprise Linux AS release 4 (Nahant Update 9) doveconf: Warning: Dovecot was last started using /usr/local/dovecot/etc/dovecot.conf, but this config is /usr/local/dovecot/etc/dovecot/dovecot.conf auth_master_user_separator = * disable_plaintext_auth = no doveadm_password = (hidden) lda_mailbox_autocreate = yes log_path = /dev/stderr log_timestamp = mail_location = mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/Index mail_plugins = " quota zlib mail_log notify virtual" mdbox_rotate_size = 5 M namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes inbox = no list = children location = maildir:~/Maildir prefix = "#MD/" separator = / type = private } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { acl = vfile mail_log_events = undelete mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = fs:Disk quota } protocols = pop3 imap service auth { client_limit = 4300 user = root } service doveadm { inet_listener { port = 542 } } service imap-login { inet_listener imap { address = 134.147.64.42 port = 143 } service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 4096 vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = 134.147.64.42 port = 110 } service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } ssl = no userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota zlib mail_log notify virtual imap_quota imap_zlib" } Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From Ralf.Hildebrandt at charite.de Fri Aug 31 13:01:06 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 31 Aug 2012 12:01:06 +0200 Subject: [Dovecot] Merge multiple doveadm commands Message-ID: <20120831100106.GU23678@charite.de> Can I merge these three commands into one? doveadm expunge -u %s mailbox \"INBOX.Deleted Messages\" NOT NEW doveadm expunge -u %s mailbox INBOX.Trash NOT NEW doveadm expunge -u %s mailbox INBOX deleted -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From tss at iki.fi Fri Aug 31 13:04:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 13:04:09 +0300 Subject: [Dovecot] Merge multiple doveadm commands In-Reply-To: <20120831100106.GU23678@charite.de> References: <20120831100106.GU23678@charite.de> Message-ID: <1000E259-87A8-44CE-BFA4-55F925FDF68F@iki.fi> On 31.8.2012, at 13.01, Ralf Hildebrandt wrote: > Can I merge these three commands into one? > > doveadm expunge -u %s mailbox \"INBOX.Deleted Messages\" NOT NEW > doveadm expunge -u %s mailbox INBOX.Trash NOT NEW > doveadm expunge -u %s mailbox INBOX deleted doveadm expunge -u %s \( mailbox \"INBOX.Deleted Messages\" NOT NEW \) or \( mailbox INBOX.Trash NOT NEW \) or \( mailbox INBOX deleted \) (Does "new" actually work? I'm not sure if that's intentional, or simply a side effect of some IMAP behavior accidentally spilling over.. :) From Hauke.Fuhrmann at funkwerk-it.com Fri Aug 31 15:27:40 2012 From: Hauke.Fuhrmann at funkwerk-it.com (Fuhrmann, Hauke) Date: Fri, 31 Aug 2012 14:27:40 +0200 Subject: [Dovecot] Length of attachment filenames Message-ID: Hi there, I have a beginners question to Dovecot: does it have a restriction on the supported length and character encodings of filenames of attachments? Can filenames be arbitrary large? Cheers, Hauke -- Diese E-Mail kann vertrauliche und/oder rechtlich geschuetzte Informationen enthalten. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtuemlich erhalten haben, informieren Sie bitte sofort den Absender durch eine Antwortmail und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. Wir danken fuer Ihre Kooperation. This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error, you are on notice of its status. Please notify the sender immediately by reply e-mail and delete this e-mail from your systems. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly prohibited. Thank you for your cooperation. From tss at iki.fi Fri Aug 31 16:10:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:10:14 +0300 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: <50334A72.2020908@integrafin.co.uk> References: <503255FA.9080300@integrafin.co.uk> <50334A72.2020908@integrafin.co.uk> Message-ID: <9D363A6A-454B-484B-B7C1-7745DCF30B2C@iki.fi> On 21.8.2012, at 11.44, Alex Crow wrote: > To clarify, what happens in these case with regard to the default mail_location set in the config files (ie is it used or overridden): > > 1. The LDAP attribute referenced in the userdb lookup exists but is empty The value will be overridden as empty, which could be an error. > 2. The LDAP attribute is not present for the user. The value isn't overridden. From tss at iki.fi Fri Aug 31 16:19:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:19:38 +0300 Subject: [Dovecot] segfault in mail_user_get_home() In-Reply-To: References: Message-ID: <384C6524-721B-4700-A550-EFEB897A8B24@iki.fi> I couldn't reproduce it with your config, but I figured out the cause of it anyway. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/6b9db780b47d On 21.8.2012, at 15.45, Lazy wrote: > it was shared namespace with empty location that produced the error > so : > namespace test { > list = children > location = > prefix = test. > subscriptions = yes > type = shared > } > > segfaults > > with location is fine > > > > 2012/8/21, Lazy : >> gdb ./src/imap/.libs/imap >> >> Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. >> (gdb) run >> Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap >> warning: no loadable sections found in added symbol-file >> system-supplied DSO at 0x7ffff7ffa000 >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> process 1104 is executing new program: /usr/local/dovecot/bin/doveconf >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> process 1104 is executing new program: >> /usr/src/dovecot-2.1.9/src/imap/.libs/imap >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> >> Program received signal SIGSEGV, Segmentation fault. >> 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, >> home_r=0x7fffffffe308) at mail-user.c:310 >> 310 if (user->home_looked_up) { >> (gdb) bt >> #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, >> home_r=0x7fffffffe308) at mail-user.c:310 >> #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at >> mdbox-storage.c:90 >> #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, >> set=0x7fffffffe4d0) at mdbox-storage.c:113 >> #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, >> set=0x7fffffffe4d0) at mail-storage.c:105 >> #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, >> driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) >> at mail-storage.c:180 >> #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, >> driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 >> #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, >> ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, >> ns_p=0x645380, >> error_r=0x7fffffffe6e8) at mail-namespace.c:126 >> #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, >> error_r=0x7fffffffe6e8) at mail-namespace.c:289 >> #8 0x00007ffff7b34a64 in mail_storage_service_init_post >> (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, >> mail_user_r=0x7fffffffe7b8, >> error_r=0x7fffffffe6e8) at mail-storage-service.c:641 >> #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, >> user=0x633e08, mail_user_r=0x7fffffffe7b8) at >> mail-storage-service.c:1114 >> #10 0x00007ffff7b35efa in mail_storage_service_lookup_next >> (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, >> mail_user_r=0x7fffffffe7b8, >> error_r=0x7fffffffe808) at mail-storage-service.c:1149 >> #11 0x000000000041f61c in client_create_from_input >> (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, >> input_buf=0x0, >> error_r=0x7fffffffe808) at main.c:202 >> #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 >> #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 >> >> /usr/local/dovecot/bin/doveconf -n >> # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32 x86_64 Debian wheezy/sid >> namespace test { >> list = children >> location = maildir:/root/test >> prefix = test. >> subscriptions = yes >> type = shared >> } >> namespace inbox { >> inbox = yes >> list = yes >> location = >> mailbox Drafts { >> special_use = \Drafts >> } >> mailbox Junk { >> special_use = \Junk >> } >> mailbox Sent { >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> special_use = \Trash >> } >> prefix = >> subscriptions = yes >> } >> passdb { >> driver = pam >> } >> ssl = no >> userdb { >> driver = passwd >> } >> >> without type = shared there is no segfault, >> >> I understand this config might not work (invoking imap directly) but >> it should't segfault. >> >> Regards, >> >> Michal Grzedzicki >> > From tss at iki.fi Fri Aug 31 16:23:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:23:07 +0300 Subject: [Dovecot] exclude a folder for lazy expunge (move to trash) In-Reply-To: <503491C4.7030208@um.es> References: <503491C4.7030208@um.es> Message-ID: <712399DF-2E5C-4BCF-BF4B-3C8A919D4F9B@iki.fi> On 22.8.2012, at 11.01, Angel L. Mateo wrote: > I'm configuring lazy expunge plugin to act as a kind of backup of my user's emails. > > I'm getting a little problem because a lot of my users use "move to trash" behaviour in their email client (most of them are using thunderbird which has no option to hide deleted messages and is a hassle working with mark as deleted with it). The problem combining move to trash with lazy expunge is that messages are stored in the expunge namespace twice, first when it was deleted from the original folder and the second when is deleted from the trash. > > So... is there any way to exclude trash folder from lazy expunge plugin, so mails are stored in the expunge namespace only when they are deleted from their original folder and not from the trash? Not right now. Maybe it could be automatically done when SPECIAL-USE is enabled and the deletion is from a \Trash mailbox. > Another idea... We are purging trash folders with a cron running "doveadm purge" commands. Is there any way to run this command disabling lazy expunge plugin? doveadm purge shouldn't affect lazy expunge, but you can disable lazy_expunge by using something like doveadm -o mail_plugins=everything,except,lazy_expunge expunge .. From tss at iki.fi Fri Aug 31 16:34:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:34:20 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <504072FA.8020606@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> Message-ID: <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> On 31.8.2012, at 11.16, Sascha Zucca wrote: > Hi! > Still noone? > strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. No. I can't reproduce it. What does your LIST "" * reply look like now with v2.1? From tss at iki.fi Fri Aug 31 16:40:44 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:40:44 +0300 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <5035D234.50306@optusnet.com.au> References: <5035D234.50306@optusnet.com.au> Message-ID: <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> On 23.8.2012, at 9.48, Dominic Malolepszy wrote: > I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings From tss at iki.fi Fri Aug 31 16:46:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:46:08 +0300 Subject: [Dovecot] pop3 migration In-Reply-To: <503632C7.2070008@rfa.cz> References: <503632C7.2070008@rfa.cz> Message-ID: <984B7F63-322D-430E-B495-88ED2274728A@iki.fi> On 23.8.2012, at 16.40, TeTeHacko wrote: > I have problems with pop3 migration, the server disconect the dovesync when > fetching mails after 5 minutes with this error in server log: > > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6548 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 47522 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6549 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 355289 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6550 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 9638 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6551 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 2188 octets > xx.xx.xx.xx [28F4] 11:59:05 >>> -ERR Command unrecognized: "" > xx.xx.xx.xx [28F4] 11:59:05 *** 6551 477693894 00:12:55 ERROR > xx.xx.xx.xx [28F4] 11:59:05 Disconnected Looks like a bug. But in Dovecot POP3 client or the POP3 server? Apparently either Dovecot sends an empty line after RETR or the server thinks Dovecot sends it. Can you get the actual TCP traffic logs? and/or set pop3c_rawlog_dir and see if it's there. From tss at iki.fi Fri Aug 31 16:49:52 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:49:52 +0300 Subject: [Dovecot] Vpopmail Dynamic Authentication Module In-Reply-To: References: Message-ID: <8992E740-591B-4572-AE89-5260D40CBB8F@iki.fi> On 24.8.2012, at 16.42, Eric Sisolak wrote: > I had to modify the command to build the module, but was able to > successfully build it: > gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL > -I../.. -I../lib -I/home/vpopmail/include -I/home/vpopmail/lib > userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so > -L/home/vpopmail/lib/libvpopmail.a -L means a path, pointing it to .a file doesn't do anything useful. By giving the .a file directly probably also fails if libvpopmail.a hasn't been built with -fPIC. > /usr/lib64/dovecot/auth/vpopmail.so: undefined symbol: vclose And that's the reason this fails, because libvpopmail isn't included in vpopmail.so. From tss at iki.fi Fri Aug 31 16:53:51 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:53:51 +0300 Subject: [Dovecot] Length of attachment filenames In-Reply-To: References: Message-ID: <79371183-6453-4A1B-BFCB-377643FD09EF@iki.fi> On 31.8.2012, at 15.27, Fuhrmann, Hauke wrote: > I have a beginners question to Dovecot: does it have a restriction on > the supported length and character encodings of filenames of > attachments? > > Can filenames be arbitrary large? The filenames in IMAP's BODYSTRUCTURE reply probably get truncated somewhere around 8192 bytes (then again, maybe not, depends on the encoding I think). And in any case not all IMAP clients use BODYSTRUCTURE. From tss at iki.fi Fri Aug 31 16:54:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:54:45 +0300 Subject: [Dovecot] mail_location / mail_home In-Reply-To: <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> References: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> Message-ID: On 31.8.2012, at 11.15, Denny Schierz wrote: > Am 31.08.2012 um 09:55 schrieb Denny Schierz: >> >> mail_home = /imap/spool/%d/%1u/%u >> mail_location = maildir:~/:INDEX=~/ > > I think, it doesn't make any difference, if I have "~" or a fixed path :-/ On the productive system (also 2.1.9) I get messages like: > > [...] dovecot.lda-dupes/tmp) failed: Not a directory [...] Here's a simple fix: maildir_stat_dirs=yes From tss at iki.fi Fri Aug 31 16:56:59 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:56:59 +0300 Subject: [Dovecot] LDAP auth and multiple attributes to construct the mail path In-Reply-To: References: Message-ID: On 31.8.2012, at 2.45, Anatoly Ivanov wrote: > So I am trying to construct mail path for my LDAP user lookups, and i need > to use two attributes instead of one. > > For examle, my LDAP directory has two attributes: departmentAttr and > userIDAttr, and I want the maildir to reside in > /home/${departmentAttr}/${userIDAttr} With v2.1: /home/%{ldap:departmentAttr}/%{ldap:userIDAttr} With older versions: you can't. From zucca at systemschmiede.com Fri Aug 31 16:59:08 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 15:59:08 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> Message-ID: <5040C32C.2020706@systemschmiede.com> Hi and thanks for replying! Here's what you asked for: _*with %%n:*_ 1 LIST "" * * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" * LIST (\Noselect \HasChildren) "/" "Freigaben/testuser-1" * LIST (\HasNoChildren) "/" "Freigaben/testuser-1/INBOX/test" 1 OK List completed. _*with %%u:*_ 1 LIST "" * * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "Freigaben/testuser-1 at parrotshop.de" * LIST (\HasNoChildren) "/" "Freigaben/testuser-1 at parrotshop.de/INBOX/test" 1 OK List completed. So i guess * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" is the Problem... Thank you again Sascha Am 31.08.2012 15:34, schrieb Timo Sirainen: > On 31.8.2012, at 11.16, Sascha Zucca wrote: > >> Hi! >> Still noone? >> strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. > No. I can't reproduce it. What does your LIST "" * reply look like now with v2.1? > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Fri Aug 31 17:06:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:06:13 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5040C32C.2020706@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> Message-ID: <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> On 31.8.2012, at 16.59, Sascha Zucca wrote: > So i guess > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > is the Problem... Yes. The problem is, I don't see it even with v2.1.7. Although I do see that when a user sees zero shared mailboxes, but that has also been fixed with v2.1.9. So I'd try upgrading again.. From tss at iki.fi Fri Aug 31 17:11:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:11:07 +0300 Subject: [Dovecot] [Postfix] SASL Auth. using Dovecot with password forwarding proxy configuration In-Reply-To: <20120831125120.37a3f7cf@adi.ddns.local> References: <20120831125120.37a3f7cf@adi.ddns.local> Message-ID: <13A83420-05D7-4DBF-A09B-2D2EE1FE9F48@iki.fi> On 31.8.2012, at 5.51, Adi Pircalabu wrote: > I'm relatively new to Dovecot and I did a bit of search but couldn't > find a possible solution for the particular setup I'm working on. > Basically I have an SMTP/POP/IMAP proxy setup running Postfix & > Dovecot. IMAP/POP authentication is done using the password proxy > feature, where the login credentials are passed to the backend server > after a db lookup, which does the actual authentication. POP/IMAP logs the user in and Dovecot proxies it. > The POP/IMAP part is working fine. What I'm trying to do is to use > Dovecot SASL implementation in Postfix to do SMTP authentication in a > similar manner. The problem I have with my current configuration is that > SMTP authentication succeeds if only the username matches, because > password forwarding works if the authentication succeeds with any given > password, as documented at > http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy Dovecot has no SMTP proxy (currently). And anyway Postfix doesn't use SMTP to do authentication, Postfix authenticates using Dovecot's internal protocol, which replies that Postfix should do the proxying, which it of course doesn't do. > My question is, given the above: is there a way to get SMTP > authentication properly in this scenario? Make Postfix authenticate against the backend Dovecot server. You'll need to setup service auth { inet_listener } to some port for it. From d.caspari at eurodata.de Fri Aug 31 16:51:25 2012 From: d.caspari at eurodata.de (Dirk Caspari) Date: Fri, 31 Aug 2012 15:51:25 +0200 Subject: [Dovecot] How Converting/Using courier-userdb Files ? Message-ID: <5040C15D.4000303@eurodata.de> Hello, how can i convert/use the Original userdb-Files from courier Installation ? The files are looking like a "Special"-DB-Format and are not readable. ----------------- #file /etc/courier/userdb.dat /etc/courier/userdb.dat: GNU dbm 1.x or ndbm database, little endian ----------------- /etc/courier/userdb.dat /etc/courier/userdbshadow.dat These Files was created with the following scripts (Part of "courier-authlib-userdb" Package). ......... /usr/sbin/makeuserdb /usr/sbin/pw2userdb /usr/sbin/userdb .......... Regards D I R K -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 7675 bytes Desc: S/MIME Cryptographic Signature URL: From zucca at systemschmiede.com Fri Aug 31 17:17:45 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 16:17:45 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> Message-ID: <5040C789.8000502@systemschmiede.com> Am 31.08.2012 16:06, schrieb Timo Sirainen: > On 31.8.2012, at 16.59, Sascha Zucca wrote: > >> So i guess >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> is the Problem... > Yes. The problem is, I don't see it even with v2.1.7. Although I do see that when a user sees zero shared mailboxes, but that has also been fixed with v2.1.9. So I'd try upgrading again.. > hm, but 2.1.9 is not in backports yet, is it? -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From dmalolepszy at optusnet.com.au Fri Aug 31 17:23:55 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Sat, 01 Sep 2012 00:23:55 +1000 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> References: <5035D234.50306@optusnet.com.au> <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> Message-ID: <5040C8FB.7020409@optusnet.com.au> On 31/08/2012 11:40 PM, Timo Sirainen wrote: > On 23.8.2012, at 9.48, Dominic Malolepszy wrote: > >> I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. > Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings > > They appear to trigger during maildelivers say via the LDA, however IMAP mailbox interactions (say deleting an email or copying an email) do not trigger them. I ended up having this patched into the quota plugin and works a treat. From tss at iki.fi Fri Aug 31 17:26:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:26:23 +0300 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <5040C8FB.7020409@optusnet.com.au> References: <5035D234.50306@optusnet.com.au> <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> <5040C8FB.7020409@optusnet.com.au> Message-ID: <03EE8709-B737-497E-A5CC-0026154D33F7@iki.fi> On 31.8.2012, at 17.23, Dominic Malolepszy wrote: > On 31/08/2012 11:40 PM, Timo Sirainen wrote: >> On 23.8.2012, at 9.48, Dominic Malolepszy wrote: >> >>> I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. >> Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings >> >> > They appear to trigger during maildelivers say via the LDA, however IMAP mailbox interactions (say deleting an email or copying an email) do not trigger them. I ended up having this patched into the quota plugin and works a treat. The quota plugin, including quota warnings, works identically in LDA and IMAP. So I wonder what your patch does. Of course in IMAP a mail deletion is often a copy+mark as deleted with the expunge happening sometimes later. From sven at svenhartge.de Fri Aug 31 19:40:56 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 31 Aug 2012 18:40:56 +0200 Subject: [Dovecot] Imap Ghost folder References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> <5040C789.8000502@systemschmiede.com> Message-ID: <292te8ob8kv8@mids.svenhartge.de> Sascha Zucca wrote: > Am 31.08.2012 16:06, schrieb Timo Sirainen: >> On 31.8.2012, at 16.59, Sascha Zucca wrote: >>> So i guess >>> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >>> is the Problem... >> Yes. The problem is, I don't see it even with v2.1.7. Although I do >> see that when a user sees zero shared mailboxes, but that has also >> been fixed with v2.1.9. So I'd try upgrading again.. >> > hm, but 2.1.9 is not in backports yet, is it? And will not be for some time. 2.1.9 is not even in Unstable and even if it were, it would not migrate to testing (and be an eligible backporting target) due to the freeze before the Wheezy release. Gr??e, Sven. -- Sigmentation fault. Core dumped. From user+dovecot at localhost.localdomain.org Fri Aug 31 20:43:32 2012 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Fri, 31 Aug 2012 19:43:32 +0200 Subject: [Dovecot] How Converting/Using courier-userdb Files ? In-Reply-To: <5040C15D.4000303@eurodata.de> References: <5040C15D.4000303@eurodata.de> Message-ID: <5040F7C4.1050908@localhost.localdomain.org> On 08/31/2012 03:51 PM Dirk Caspari wrote: > Hello, > > how can i convert/use the Original userdb-Files from courier Installation ? > The files are looking like a "Special"-DB-Format and are not readable. > ----------------- > #file /etc/courier/userdb.dat > /etc/courier/userdb.dat: GNU dbm 1.x or ndbm database, little endian > ----------------- > > /etc/courier/userdb.dat > /etc/courier/userdbshadow.dat > > These Files was created with the following scripts (Part of > "courier-authlib-userdb" Package). > ......... > /usr/sbin/makeuserdb > /usr/sbin/pw2userdb > /usr/sbin/userdb > .......... > > Regards > D I R K RTFM: makeuserdb(8) / DESCRIPTION / Format of /etc/courier/userdb http://manpages.ubuntu.com/manpages/natty/man8/makeuserdb.8.html Regards, Pascal -- The trapper recommends today: decade.1224419 at localdomain.org From robert at schetterer.org Wed Aug 1 00:29:52 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 31 Jul 2012 23:29:52 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected Message-ID: <50184E50.7030907@schetterer.org> Hi Timo, by having errors like Cached message size smaller than expected and Maildir filename has wrong S value and Corrupted index cache file in dove 2.1.8 i can reproduce the problem with tb 14 with 2 nat machines connected to the same server the problem relates with create new folder then copy some uncompressed and compressed mail to it, the i.e open it by other client sometime this happens at once , sometime after a few copy actions however thunderbird ,then errors above apear, sometimes no mail is shown, sometimes only uncompressed or only compressed so funktion read both formats gets lost somehow any idea, you need a better debug ? -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 00:44:43 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 00:44:43 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50184E50.7030907@schetterer.org> References: <50184E50.7030907@schetterer.org> Message-ID: On 1.8.2012, at 0.29, Robert Schetterer wrote: > Cached message size smaller than expected > and > Maildir filename has wrong S value > and > Corrupted index cache file > > in dove 2.1.8 > > i can reproduce the problem with tb 14 > with 2 nat machines connected to the same server > > the problem relates with create new folder then copy > some uncompressed and compressed mail to it, the i.e > open it by other client > > sometime this happens at once , sometime after a few copy actions I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? It would help to know how to reproduce this on an entirely empty mail account. From hendy at soluvas.com Wed Aug 1 01:12:50 2012 From: hendy at soluvas.com (Hendy Irawan) Date: Tue, 31 Jul 2012 15:12:50 -0700 (PDT) Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: References: <34226738.post@talk.nabble.com> Message-ID: <34238207.post@talk.nabble.com> Dear Timo, Thank you very much for your kind work. I apologize, my previous statement were wrong. At least on ApacheDS 1.5.7, it doesn't search entries using the '' base DN (it doesn't give error though, just cannot return results, ApacheDS requires the search base to be in a partition). However, your patch would be great for servers who support the '' search base DN. If I may ask, would you improve it further to accept multiple bases? I'm not sure what the proper character separator would be, but I think something like this would work : base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com The proposed configuration above asks to try the two search bases in succession, whichever first succeeds get logged in, else fails like usual. I hope it's okay with you. I'll definitely help with the testing. Hendy Timo Sirainen wrote: > > On 29.7.2012, at 15.00, Hendy Irawan wrote: > >> We have several context entries and want to authenticate a user against >> the >> whole LDAP server. >> >> However when setting "base = " Dovecot LDAP fails with following message: >> >> Jul 29 10:50:59 nitik1 dovecot: auth: Error: >> ldap(hendy at staging.member.berbatik.com,127.0.0.1): >> ldap_search((virtualMail=hendy at staging.member.berbatik.com)) failed: >> Other >> (e.g., implementation specific) error > > Does the attached patch help? If yes, I'll add it to next version. > > > > ----- http://www.Soluvas.com/ Soluvas - Making eCommerce Work for You -- View this message in context: http://old.nabble.com/BUG%3A-LDAP-extension-failed-to-authenticate-if-%27base%27-DN-configuration-is-empty-%27%27-tp34226738p34238207.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Wed Aug 1 01:51:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 01:51:08 +0300 Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: <34238207.post@talk.nabble.com> References: <34226738.post@talk.nabble.com> <34238207.post@talk.nabble.com> Message-ID: <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> On 1.8.2012, at 1.12, Hendy Irawan wrote: > I apologize, my previous statement were wrong. At least on ApacheDS 1.5.7, > it doesn't search entries using the '' base DN (it doesn't give error > though, just cannot return results, ApacheDS requires the search base to be > in a partition). > > However, your patch would be great for servers who support the '' search > base DN. But does my patch actually make it work in some such servers? I did it only as a guess. If it doesn't fix anything I'd rather just drop the patch. > If I may ask, would you improve it further to accept multiple bases? I'm not > sure what the proper character separator would be, but I think something > like this would work : > > base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com > > The proposed configuration above asks to try the two search bases in > succession, whichever first succeeds get logged in, else fails like usual. You can already do this by creating multiple passdb/userdb ldap sections with different config files. Searching multiple bases requires doing multiple LDAP lookups anyway. From hendy at soluvas.com Wed Aug 1 06:53:42 2012 From: hendy at soluvas.com (Hendy Irawan) Date: Tue, 31 Jul 2012 20:53:42 -0700 (PDT) Subject: [Dovecot] BUG: LDAP extension failed to authenticate if 'base' DN configuration is empty '' In-Reply-To: <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> References: <34226738.post@talk.nabble.com> <34238207.post@talk.nabble.com> <0E31FAE8-D53E-45F6-9F67-7E517DD07A2F@iki.fi> Message-ID: <34238917.post@talk.nabble.com> Dear Timo, Thank you for your information about multiple sections! I didn't realize that was possible. Yes, your patch will work on at least ApacheDS 2.0.0-M7 (see https://issues.apache.org/jira/browse/DIRSERVER-1742 ) and I would appreciate it very much ! Hendy Timo Sirainen wrote: > > On 1.8.2012, at 1.12, Hendy Irawan wrote: > >> I apologize, my previous statement were wrong. At least on ApacheDS >> 1.5.7, >> it doesn't search entries using the '' base DN (it doesn't give error >> though, just cannot return results, ApacheDS requires the search base to >> be >> in a partition). >> >> However, your patch would be great for servers who support the '' search >> base DN. > > But does my patch actually make it work in some such servers? I did it > only as a guess. If it doesn't fix anything I'd rather just drop the > patch. > >> If I may ask, would you improve it further to accept multiple bases? I'm >> not >> sure what the proper character separator would be, but I think something >> like this would work : >> >> base = dc=prd,dc=berbatik,dc=com | dc=stg,dc=berbatik,dc=com >> >> The proposed configuration above asks to try the two search bases in >> succession, whichever first succeeds get logged in, else fails like >> usual. > > You can already do this by creating multiple passdb/userdb ldap sections > with different config files. Searching multiple bases requires doing > multiple LDAP lookups anyway. > ----- http://www.Soluvas.com/ Soluvas - Making eCommerce Work for You -- View this message in context: http://old.nabble.com/BUG%3A-LDAP-extension-failed-to-authenticate-if-%27base%27-DN-configuration-is-empty-%27%27-tp34226738p34238917.html Sent from the Dovecot mailing list archive at Nabble.com. From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 07:32:58 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 01 Aug 2012 06:32:58 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> Message-ID: <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> Timo Sirainen schrieb: >On 12.7.2012, at 14.14, Angel L. Mateo wrote: > >> So I have used doveadm director move to move >them to its "hashed" server. Although a doveadm director status >now shows me that this user is directed to the new server, doveadm who >in the temporal server shows me that the user is actually connected to >it, although messages are delivered to it through is correct server. So >I have had to manually kick that users in the temporal servers. >> >> Is this the expected behaviour of the move command for director? >> >> Is there any way to also force the kick of the imap/pop user's >connection in the temporal server? > >Do you see any errors in logs? Especially: > >director: Error: connect(ipc) failed: Permission denied Looks very familiar to me. I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. Regards Daniel From robert at schetterer.org Wed Aug 1 08:36:56 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 07:36:56 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: References: <50184E50.7030907@schetterer.org> Message-ID: <5018C078.9090503@schetterer.org> Am 31.07.2012 23:44, schrieb Timo Sirainen: > On 1.8.2012, at 0.29, Robert Schetterer wrote: > >> Cached message size smaller than expected >> and >> Maildir filename has wrong S value >> and >> Corrupted index cache file >> >> in dove 2.1.8 >> >> i can reproduce the problem with tb 14 >> with 2 nat machines connected to the same server >> >> the problem relates with create new folder then copy >> some uncompressed and compressed mail to it, the i.e >> open it by other client >> >> sometime this happens at once , sometime after a few copy actions > > I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? at my recent onwledge mixing compressed new mails from my sent folder, and older uncompressed ones ( which are shown nice both in tb ), with some copy action in a new folder from another client leads to wrong S and tb does not display them any longer sometime, perhaps a double zip happens? It would help to know how to reproduce this on an entirely empty mail account. > i will try to test, but first i have to deal with now broken maildirs i try disable zlip plugin now ,as workaround hopefully this does not lead to more problems on old maildirs , and fix the problem with new mail -- Best Regards MfG Robert Schetterer From ml-dovecot at zu-con.org Wed Aug 1 09:09:43 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 08:09:43 +0200 Subject: [Dovecot] virtual folder - crash while searching Message-ID: <5018C827.80406@zu-con.org> Hi, I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in a virtual folder dovecot crashes. Here's the stacktrace: http://pastebin.com/urSDDzku Regards, Matthias From f.bonnet at esiee.fr Wed Aug 1 10:19:32 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 09:19:32 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory Message-ID: <5018D884.7000103@esiee.fr> hello I see this message in the dovecot error log every time a user connect to IMAP service. imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In the server's config I've this mail_location = mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u As we can see INDEX files are not living in user's home directories but in /var/spool/dovecot/index/%u so why this error message ? BTW : users access normally to their IMAP folders , I'm just curious about this message which is not marked as warning but error Thank you From nikolai at net24.co.nz Wed Aug 1 11:13:48 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Wed, 1 Aug 2012 20:13:48 +1200 Subject: [Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox Message-ID: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> I'm seeing the following error in our logs when removing mailboxes (we are using mdbox and dovecot 2.1.8): Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Error: stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation not permitted Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Mailbox deleted: Spam When I run truss against the process it appears the error relates to attempted unlink of a directory, not a stat of it, as reported by the log. However the mailbox does appear to be deleted fine, so it appears to be an erroneous error. Here is the truss output from the "3 DELETE INBOX.Spam" IMAP command: gettimeofday({1343808204.962165 },0x0) = 0 (0x0) gettimeofday({1343808204.962351 },0x0) = 0 (0x0) kevent(9,0x0,0,{0xb,EVFILT_READ,0x0,0,0x15,0x21c17a40},6,{1786.679649000 }) = 1 (0x1) gettimeofday({1343808216.031493 },0x0) = 0 (0x0) gettimeofday({1343808216.031676 },0x0) = 0 (0x0) read(11,"3 DELETE INBOX.Spam\r\n",8179) = 21 (0x15) getpid() = 6293 (0x1895) __sysctl(0x7fffffffd850,0x4,0x0,0x0,0x21c8f000,0x2a) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam",{ mode=drwx------ ,inode=28760,size=3,blksize=131072 }) = 0 (0x0) open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",O_RDWR,037777753160) = 10 (0xa) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) pread(0xa,0x21c30000,0x90,0x0,0x1000,0x0) = 144 (0x90) open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index",O_RDWR,037777731760) ERR#2 'No such file or directory' open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2",O_RDWR,037777731520) ERR#2 'No such file or directory' fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) unlink("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam") ERR#1 'Operation not permitted' stat("/usr/share/nls/C/libc.cat",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/share/nls/libc/C",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/local/share/nls/C/libc.cat",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/local/share/nls/libc/C",0x7fffffffd0a0) ERR#2 'No such file or directory' write(2,"\^A\b6293 prefix=imap(test at test."...,36) = 36 (0x24) write(2,"\^A\^D6293 stat(/mailstore/domai"...,99) = 99 (0x63) access("/etc/localtime",4) = 0 (0x0) open("/etc/localtime",O_RDONLY,04160026530) = 12 (0xc) fstat(12,{ mode=-r--r--r-- ,inode=16454,size=2434,blksize=4096 }) = 0 (0x0) read(12,"TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0"...,41448) = 2434 (0x982) close(12) = 0 (0x0) issetugid(0x20ee7fd1,0x21e72000,0x0,0xa7,0x4e,0xc) = 1 (0x1) open("/usr/share/zoneinfo/posixrules",O_RDONLY,056) = 12 (0xc) fstat(12,{ mode=-r--r--r-- ,inode=545,size=3519,blksize=4096 }) = 0 (0x0) read(12,"TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0"...,41448) = 3519 (0xdbf) close(12) = 0 (0x0) madvise(0x21eba000,0xb000,0x5,0x2b9,0x17,0x1) = 0 (0x0) madvise(0x21e72000,0x5000,0x5,0x271,0x17,0x1) = 0 (0x0) madvise(0x21e63000,0xc000,0x5,0x262,0x7fffffffcbf0,0x7fffffffcbf0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) gettimeofday({1343808216.048607 },0x0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2",0x7fffffffd600) ERR#2 'No such file or directory' setitimer(0,{0.000000, 180.000000 },{0.000000, 0.000000 }) = 0 (0x0) fcntl(10,F_SETLKW,0x7fffffffd520) = 0 (0x0) setitimer(0,{0.000000, 0.000000 },{0.000000, 180.000000 }) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) pwrite(0xa,0x21c09000,0xc,0x90,0x10ab6b8,0x2) = 12 (0xc) pwrite(0xa,0x7fffffffd69c,0x4,0x90,0x10ab6b8,0x2) = 4 (0x4) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) fcntl(10,F_SETLK,0x7fffffffd5e0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) setitimer(0,{0.000000, 180.000000 },{0.000000, 0.000000 }) = 0 (0x0) fcntl(10,F_SETLKW,0x7fffffffd1f0) = 0 (0x0) setitimer(0,{0.000000, 0.000000 },{0.000000, 180.000000 }) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) pwrite(0xa,0x21c09400,0x1c,0x9c,0xffff800021c0bea4,0x7fffffffa9f0) = 28 (0x1c) pwrite(0xa,0x7fffffffd57c,0x4,0x9c,0xffff800021c0bea4,0x7fffffffa9f0) = 4 (0x4) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) fcntl(10,F_SETLK,0x7fffffffd610) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=184,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=184,blksize=4096 }) = 0 (0x0) rename("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails","/mailstore/domains/test.com/test/mdbox/..DOVECOT-TrasH") = 0 (0x0) open(".",O_RDONLY,00) = 12 (0xc) open("/mailstore/domains/test.com/test/mdbox/..DOVECOT-TrasH",O_NOFOLLOW,00) = 13 (0xd) fchdir(0xd,0x100,0x0,0x7b30,0x101010101010101,0x8080808080808080) = 0 (0x0) stat(".",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) open(".",O_NONBLOCK|0x20000,00) = 14 (0xe) fstat(14,{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) fcntl(14,F_SETFD,FD_CLOEXEC) = 0 (0x0) fstatfs(0xe,0x7fffffffd3a0,0x21c00400,0x29,0x61ff20,0x0) = 0 (0x0) getdirentries(0xe,0x21c31000,0x1000,0x21c284e8,0x61ff20,0x0) = 52 (0x34) unlink("dovecot.index.log") = 0 (0x0) getdirentries(0xe,0x21c31000,0x1000,0x21c284e8,0x61ff20,0x0) = 0 (0x0) close(13) = 0 (0x0) lseek(14,0x0,SEEK_SET) = 0 (0x0) close(14) = 0 (0x0) fchdir(0xc,0x0,0x21c07400,0x28,0x61ff20,0x0) = 0 (0x0) close(12) = 0 (0x0) rmdir(0x21c18470,0x0,0x21c07400,0x28,0x61ff20,0x0) = 0 (0x0) rmdir(0x21c184f0,0x4,0x21c18000,0x7af8,0xffffffffffdd6669,0x21c8c298) = 0 (0x0) open("/mailstore/domains/test.com/test/mdbox/dovecot.mailbox.log",O_RDWR|O_APPEND,0125337603) = 12 (0xc) write(12,"\^A\0\0\0\M^L\M-M%\^E\M^F\M-b\^X"...,24) = 24 (0x18) fstat(12,{ mode=-rw------- ,inode=28751,size=144,blksize=4096 }) = 0 (0x0) rmdir(0x21c186d0,0x21e41eb8,0x21c186d0,0x7918,0xffffffffffdd6849,0x21c8c298) ERR#2 'No such file or directory' write(12,"\^B\0\0\0\M-Xb\M^JRY\M-I{x\M--C"...,24) = 24 (0x18) fstat(12,{ mode=-rw------- ,inode=28751,size=168,blksize=4096 }) = 0 (0x0) write(2,"\^A\^B6293 Mailbox deleted: Spam"...,29) = 29 (0x1d) gettimeofday({1343808216.058749 },0x0) = 0 (0x0) madvise(0x21e65000,0x1000,0x5,0x264,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21e63000,0x1000,0x5,0x262,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21e41000,0x2000,0x5,0x240,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21d8d000,0x4000,0x5,0x18c,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21c91000,0x2000,0x5,0x90,0x7fffffffcfa0,0xffffffff) = 0 (0x0) gettimeofday({1343808216.059531 },0x0) = 0 (0x0) getpid() = 6293 (0x1895) __sysctl(0x7fffffffd830,0x4,0x0,0x0,0x21c8f000,0x23) = 0 (0x0) write(11,"3 OK Delete completed.\r\n",24) = 24 (0x18) gettimeofday({1343808216.060105 },0x0) = 0 (0x0) Regard, Nikolai. From matthias.lay at securepoint.de Wed Aug 1 12:45:38 2012 From: matthias.lay at securepoint.de (Matthias Lay) Date: Wed, 01 Aug 2012 11:45:38 +0200 Subject: [Dovecot] ntlm auth / usernames with white spaces In-Reply-To: References: <1343399579.3072.19.camel@hermann.potsdam.securepoint.local> Message-ID: <1343814338.3072.31.camel@hermann.potsdam.securepoint.local> works the same way! at least for ntlm but should do the same for spnego. thx. didnt see your strarray join function. On Tue, 2012-07-31 at 22:10 +0300, Timo Sirainen wrote: > On 27.7.2012, at 17.32, Matthias Lay wrote: > > > we experienced some problems with white spaces in usernames (this was > > NOT our idea) authenticated bei dovecots ntlmhelper > > > > I wrote a little patch fixing this, if you would like. > > > > patch applies on 2.1.7 and 2.1.8 (tested those) > > Does this simpler patch also work? From CMarcus at Media-Brokers.com Wed Aug 1 13:53:04 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 06:53:04 -0400 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5018C827.80406@zu-con.org> References: <5018C827.80406@zu-con.org> Message-ID: <50190A90.7090109@Media-Brokers.com> On 2012-08-01 2:09 AM, Matthias Rieber wrote: > I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in > a virtual folder dovecot crashes. Sorry, our crystal ball is broken, although Timo can sometimes get his to work, how I don't know... ;) doveconf -n output? Logs (untrimmed) showing the events leading to the crash? > Here's the stacktrace: > > http://pastebin.com/urSDDzku Stack trace *may* be useful to Timo, but first, please provide bare minimum details of your system/config/errors as requested above - as you should do *always* when asking for support for any software on any mail support list... -- Best regards, Charles From CMarcus at Media-Brokers.com Wed Aug 1 13:56:47 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 06:56:47 -0400 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <5018D884.7000103@esiee.fr> References: <5018D884.7000103@esiee.fr> Message-ID: <50190B6F.7020600@Media-Brokers.com> Please help us help you. Always provide bare minimum system/config/error details, like: Full doveconf -n output (don't 'describe' your config with a one line copy/paste from some random config file) Full (untrimmed) logs exhibiting the problem On 2012-08-01 3:19 AM, Frank Bonnet wrote: > hello > > I see this message in the dovecot error log every time > a user connect to IMAP service. > > imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such > file or directory > > In the server's config I've this > > mail_location = > mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u > > As we can see INDEX files are not living in user's home directories but > in /var/spool/dovecot/index/%u > so why this error message ? > > BTW : users access normally to their IMAP folders , I'm just curious > about this message > which is not marked as warning but error -- Best regards, Charles From tss at iki.fi Wed Aug 1 13:58:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 13:58:01 +0300 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> Message-ID: <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> On 1.8.2012, at 7.32, Daniel Parthey wrote: >> Do you see any errors in logs? Especially: >> >> director: Error: connect(ipc) failed: Permission denied > > Looks very familiar to me. > > I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. I added a note about it to http://wiki2.dovecot.org/Director#Other_settings From f.bonnet at esiee.fr Wed Aug 1 14:03:50 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:03:50 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190B6F.7020600@Media-Brokers.com> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> Message-ID: <50190D16.1090901@esiee.fr> Yes sorry I forgot :-( See attached the doveconf -n output Thanks On 08/01/2012 12:56 PM, Charles Marcus wrote: > Please help us help you. > > Always provide bare minimum system/config/error details, like: > > Full doveconf -n output > (don't 'describe' your config with a one line copy/paste from some > random config file) > > Full (untrimmed) logs exhibiting the problem > > On 2012-08-01 3:19 AM, Frank Bonnet wrote: >> hello >> >> I see this message in the dovecot error log every time >> a user connect to IMAP service. >> >> imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such >> file or directory >> >> In the server's config I've this >> >> mail_location = >> mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u >> >> As we can see INDEX files are not living in user's home directories but >> in /var/spool/dovecot/index/%u >> so why this error message ? >> >> BTW : users access normally to their IMAP folders , I'm just curious >> about this message >> which is not marked as warning but error > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr -------------- next part -------------- # 2.1.8: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.0-RELEASE-p3 amd64 auth_verbose = yes auth_verbose_passwords = plain auth_worker_max_count = 100 debug_log_path = /var/log/dovecot/debug.log default_client_limit = 6144 default_process_limit = 1024 default_vsz_limit = 1 G disable_plaintext_auth = no info_log_path = /var/log/dovecot/info.log log_path = /var/log/dovecot/dovecot.log mail_debug = yes mail_fsync = always mail_location = mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u mail_temp_dir = /var/tmp managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_lock_timeout = 3 mins mbox_write_locks = fcntl mmap_disable = yes namespace { inbox = yes location = prefix = separator = / subscriptions = yes type = private } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at esiee.fr protocols = imap pop3 sendmail_path = /usr/local/sbin/sendmail service auth { client_limit = 7169 } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 10 service_count = 1 vsz_limit = 3 G } service imap { process_limit = 2048 vsz_limit = 3 G } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = [REMOVED INTENTIONALLY] ssl_cert = [REMOVED INTENTIONALLY] ssl_key = [REMOVED INTENTIONALLY] userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } verbose_proctitle = yes protocol lda { info_log_path = /var/log/dovecot/dovecot-lda.log log_path = /var/log/dovecot/dovecot-lda-errors.log mail_plugins = sieve $mail_plugins } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 30 } protocol sieve { mail_max_userip_connections = 30 managesieve_implementation_string = Dovecot Pigeonhole } From CMarcus at Media-Brokers.com Wed Aug 1 14:16:13 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 01 Aug 2012 07:16:13 -0400 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190D16.1090901@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> Message-ID: <50190FFD.5060406@Media-Brokers.com> On 2012-08-01 7:03 AM, Frank Bonnet wrote: > Yes sorry I forgot :-( > > See attached the doveconf -n output Logs? > On 08/01/2012 12:56 PM, Charles Marcus wrote: >> Please help us help you. >> >> Always provide bare minimum system/config/error details, like: >> >> Full doveconf -n output >> (don't 'describe' your config with a one line copy/paste from some >> random config file) >> >> Full (untrimmed) logs exhibiting the problem -- Best regards, Charles From rafinathan25 at gmail.com Wed Aug 1 14:18:01 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Wed, 1 Aug 2012 16:48:01 +0530 Subject: [Dovecot] can't recieve emails to inbox Message-ID: Hi, I am unable to send emails to virtual users I created. Here is my output for dovecot -n # 1.0.7: /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log ssl_disable: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:~/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: verbose: yes passdb: driver: passwd-file args: /etc/dovecot/passwd passdb: driver: pam userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/home/vmail/%u == Contents of my passwd file located at /etc/dovecot/passwd user1 at mydomain.com user2 at mydomain.com I sent an email to user1 at mydomain.com from gmail.com but can view it anywhere. Please suggest. Where am I going wrong? From robert at schetterer.org Wed Aug 1 14:19:15 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 13:19:15 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <5018C078.9090503@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> Message-ID: <501910B3.2030306@schetterer.org> Am 01.08.2012 07:36, schrieb Robert Schetterer: > Am 31.07.2012 23:44, schrieb Timo Sirainen: >> On 1.8.2012, at 0.29, Robert Schetterer wrote: >> >>> Cached message size smaller than expected >>> and >>> Maildir filename has wrong S value >>> and >>> Corrupted index cache file >>> >>> in dove 2.1.8 >>> >>> i can reproduce the problem with tb 14 >>> with 2 nat machines connected to the same server >>> >>> the problem relates with create new folder then copy >>> some uncompressed and compressed mail to it, the i.e >>> open it by other client >>> >>> sometime this happens at once , sometime after a few copy actions >> >> I can't reproduce this. Are you sure the problem isn't that the old mails already have a wrong S value and the errors happen when Dovecot tries to read them? > > at my recent onwledge > mixing compressed new mails from my sent folder, and older uncompressed > ones ( which are shown nice both in tb ), with some copy action in a new > folder from another client leads to wrong S > and tb does not display them any longer sometime, perhaps a double zip > happens? > > It would help to know how to reproduce this on an entirely empty mail > account. >> > > i will try to test, but first i have to deal with now broken maildirs > i try disable zlip plugin now ,as workaround hopefully this does not > lead to more problems on old maildirs , and fix the problem with new mail > hi Timo, rolled back all stuff you recommended offlist so situation is a bit better now, however why, i had to handle cause more mailldirs get broken i guess iam dealing with equal Problems described here http://www.mail-archive.com/dovecot at dovecot.org/msg43986.html conversation with ralf, looks like your patch wasnt enough i have a few mailboxes and folders now i cant fix compressed files stay unreadable after move copy by Maildir filename has wrong S value i need some kind of mass repair actions etc , or some new patch -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 14:21:31 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:21:31 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50190FFD.5060406@Media-Brokers.com> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> Message-ID: <5019113B.7030509@esiee.fr> On 08/01/2012 01:16 PM, Charles Marcus wrote: > On 2012-08-01 7:03 AM, Frank Bonnet wrote: >> Yes sorry I forgot :-( >> >> See attached the doveconf -n output > > Logs? > All lines are IDENTICALS except the user id I put MY login but it happen for ALL users when they connect Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory BTW : I use real unix users thru nss_ldap & pam_ldap auth, no virtual user >> On 08/01/2012 12:56 PM, Charles Marcus wrote: >>> Please help us help you. >>> >>> Always provide bare minimum system/config/error details, like: >>> >>> Full doveconf -n output >>> (don't 'describe' your config with a one line copy/paste from some >>> random config file) >>> >>> Full (untrimmed) logs exhibiting the problem > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr From tss at iki.fi Wed Aug 1 14:22:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 14:22:03 +0300 Subject: [Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox In-Reply-To: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> References: <1A0C8C18-8448-4C81-9D53-E975ACF51614@net24.co.nz> Message-ID: On 1.8.2012, at 11.13, Nikolai Schupbach wrote: > I'm seeing the following error in our logs when removing mailboxes (we are using mdbox and dovecot 2.1.8): > > Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Error: stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation not permitted > Aug 1 20:03:36 msgsrv dovecot: imap(test at test.com): Mailbox deleted: Spam > > When I run truss against the process it appears the error relates to attempted unlink of a directory, not a stat of it, as reported by the log. However the mailbox does appear to be deleted fine, so it appears to be an erroneous error. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/8029f1b4afd0 From tss at iki.fi Wed Aug 1 14:27:31 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 14:27:31 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <5019113B.7030509@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: On 1.8.2012, at 14.21, Frank Bonnet wrote: > Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: chmod a+rw /var/run/dovecot/config gdb /usr/local/lib/dovecot/imap b i_error run bt full where the will probably work if you do something like: a list "" * b lsub "" * c select inbox if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog From f.bonnet at esiee.fr Wed Aug 1 14:56:03 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 13:56:03 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: <50191953.2010501@esiee.fr> On 08/01/2012 01:27 PM, Timo Sirainen wrote: > On 1.8.2012, at 14.21, Frank Bonnet wrote: > >> Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory > I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: > > chmod a+rw /var/run/dovecot/config > gdb /usr/local/lib/dovecot/imap it starts badly mail# gdb /usr/local/libexec/dovecot/imap GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... (gdb) b i_error Function "i_error" not defined. > b i_error > run > > bt full > > where the will probably work if you do something like: > > a list "" * > b lsub "" * > c select inbox > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > -- CYBERDROID Inc. Frank BONNET 01.45.92.66.17 Service des Moyens Informatiques Generaux ESIEE PARIS Cit? Descartes / BP 99 93162 NOISY-LE-GRAND Cedex http://www.esiee.fr From f.bonnet at esiee.fr Wed Aug 1 15:00:24 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:00:24 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> Message-ID: <50191A58.8030404@esiee.fr> On 08/01/2012 01:27 PM, Timo Sirainen wrote: > On 1.8.2012, at 14.21, Frank Bonnet wrote: > >> Aug 01 13:06:09 imap(bonnetf): Error: opendir(/user/bonnetf/.imap) failed: No such file or directory > I don't see any obvious way for this to happen. Can you reproduce it by running imap process directly and talking imap protocol? Something like this would be helpful: > > chmod a+rw /var/run/dovecot/config > gdb /usr/local/lib/dovecot/imap > b i_error > run > > bt full > > where the will probably work if you do something like: > > a list "" * > b lsub "" * > c select inbox > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog I ran it anyway , the output is below %gdb /usr/local/libexec/dovecot/imap GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"...(no debugging symbols found)... (gdb) (gdb) b i_error Function "i_error" not defined. Make breakpoint pending on future shared library load? (y or [n]) y Breakpoint 1 (i_error) pending. (gdb) run Starting program: /usr/local/libexec/dovecot/imap (no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...(no debugging symbols found)...[New LWP 102225] (no debugging symbols found)...Breakpoint 2 at 0x800ba4430 Pending breakpoint "i_error" resolved [New Thread 801c07400 (LWP 102225/imap)] Debug: Effective uid=3003, gid=3010, home=/user/bonnetf Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:/user/bonnetf/:INBOX=/var/mail/bonnetf:INDEX=/var/spool/dovecot/index/bonnetf Debug: fs: root=/user/bonnetf, index=/var/spool/dovecot/index/bonnetf, control=, inbox=/var/mail/bonnetf, alt= * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as bonnetf a list "" * * LIST (\NoInferiors \UnMarked) "/" ".dovecot.sieve" * LIST (\NoInferiors \UnMarked) "/" "NetAPP" * LIST (\NoInferiors \Marked) "/" "Admin" * LIST (\NoInferiors \UnMarked) "/" "CCIP" * LIST (\NoInferiors \UnMarked) "/" "Clement" * LIST (\Noselect \HasChildren) "/" "sieve" * LIST (\Noselect \HasChildren) "/" "sieve/tmp" * LIST (\NoInferiors \UnMarked) "/" "sieve/roundcube.sieve" * LIST (\NoInferiors \UnMarked) "/" "Drafts" * LIST (\NoInferiors \UnMarked) "/" "ESIEE" * LIST (\NoInferiors \UnMarked) "/" ".dovecot.sieve.log" * LIST (\NoInferiors \UnMarked) "/" ".dovecot.svbin" * LIST (\NoInferiors \UnMarked) "/" "FPS" * LIST (\NoInferiors \Marked) "/" "PRIVE" * LIST (\NoInferiors \UnMarked) "/" "Sent" * LIST (\NoInferiors \UnMarked) "/" ".vacation.msg" * LIST (\NoInferiors \UnMarked) "/" "Templates" * LIST (\NoInferiors \UnMarked) "/" "Trash" * LIST (\NoInferiors \UnMarked) "/" "UMLV" * LIST (\NoInferiors \UnMarked) "/" "Caille" * LIST (\NoInferiors \UnMarked) "/" "Postmaster" * LIST (\NoInferiors \UnMarked) "/" "Junk" * LIST (\NoInferiors \UnMarked) "/" "Archives" * LIST (\NoInferiors \UnMarked) "/" "bkup-ldap" * LIST (\NoInferiors \UnMarked) "/" "Deleted Messages" * LIST (\NoInferiors \UnMarked) "/" "Apple" * LIST (\NoInferiors \UnMarked) "/" "Notes" * LIST (\NoInferiors \UnMarked) "/" "EmailStuff" * LIST (\NoInferiors \UnMarked) "/" "LISTSERV" * LIST (\NoInferiors \UnMarked) "/" "RENATER" * LIST (\NoInferiors \UnMarked) "/" "Free" * LIST (\NoInferiors \UnMarked) "/" "filers" * LIST (\NoInferiors \UnMarked) "/" "PRIVE2" * LIST (\NoInferiors \UnMarked) "/" "SUSE-NOVELL" * LIST (\NoInferiors \UnMarked) "/" "SYBASE" * LIST (\NoInferiors \UnMarked) "/" "Nono" * LIST (\NoInferiors \UnMarked) "/" "NGINX" * LIST (\NoInferiors \UnMarked) "/" "DIFFGEN" * LIST (\NoInferiors \UnMarked) "/" "ADESOFT" * LIST (\NoInferiors \UnMarked) "/" "RENATER-TCS" * LIST (\NoInferiors \UnMarked) "/" "Forensic" * LIST (\NoInferiors \UnMarked) "/" "EnCours" * LIST (\NoInferiors \UnMarked) "/" "BSD" * LIST (\NoInferiors \UnMarked) "/" "NYP" * LIST (\NoInferiors \UnMarked) "/" "Sent Messages" * LIST (\NoInferiors \UnMarked) "/" ".forward" * LIST (\HasNoChildren) "/" "INBOX" a OK List completed. b lsub "" * * LSUB () "/" "Admin" * LSUB () "/" "CCIP" * LSUB () "/" "Clement" * LSUB () "/" "Drafts" * LSUB () "/" "ESIEE" * LSUB () "/" "FPS" * LSUB () "/" "PRIVE" * LSUB () "/" "Sent" * LSUB () "/" "Templates" * LSUB () "/" "Trash" * LSUB () "/" "UMLV" * LSUB () "/" "Caille" * LSUB () "/" "Postmaster" * LSUB () "/" "Junk" * LSUB () "/" "Archives" * LSUB () "/" "bkup-ldap" * LSUB () "/" "Apple" * LSUB () "/" "Deleted Messages" * LSUB () "/" "Sent Messages" * LSUB () "/" "Notes" * LSUB () "/" "EmailStuff" * LSUB () "/" "LISTSERV" * LSUB () "/" "RENATER" * LSUB () "/" "Free" * LSUB () "/" "filers" * LSUB () "/" "PRIVE2" * LSUB () "/" "INBOX" * LSUB () "/" "SUSE-NOVELL" * LSUB () "/" "SYBASE" * LSUB () "/" "Nono" * LSUB () "/" "NGINX" * LSUB () "/" "DIFFGEN" * LSUB () "/" "ADESOFT" * LSUB () "/" "RENATER-TCS" * LSUB () "/" "Forensic" * LSUB () "/" "EnCours" * LSUB () "/" "BSD" * LSUB () "/" "NYP" * LSUB () "/" "NetAPP" b OK Lsub completed. c select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk $Forwarded $MDNSent $label1 $label4) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk Junk $Forwarded $MDNSent $label1 $label4 \*)] Flags permitted. * 564 EXISTS * 0 RECENT * OK [UNSEEN 557] First unseen. * OK [UIDVALIDITY 1219087912] UIDs valid * OK [UIDNEXT 1049549] Predicted next UID * OK [NOMODSEQ] No permanent modsequences c OK [READ-WRITE] Select completed. From tss at iki.fi Wed Aug 1 15:06:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 15:06:07 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <501910B3.2030306@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> Message-ID: <1343822767.19913.81.camel@hurina> See what you get by running the maildir through: http://dovecot.org/tools/maildir-size-check.sh From tss at iki.fi Wed Aug 1 15:07:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 15:07:49 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50191A58.8030404@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> Message-ID: <1343822869.19913.82.camel@hurina> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: > > where the will probably work if you do something like: > > > > a list "" * > > b lsub "" * > > c select inbox > > > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > > > I ran it anyway , the output is below All good, except the error didn't happen. So you'd need to look at the IMAP traffic to see which command generates the error. From f.bonnet at esiee.fr Wed Aug 1 15:10:59 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:10:59 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <1343822869.19913.82.camel@hurina> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> Message-ID: <50191CD3.7010902@esiee.fr> On 08/01/2012 02:07 PM, Timo Sirainen wrote: > On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>> where the will probably work if you do something like: >>> >>> a list "" * >>> b lsub "" * >>> c select inbox >>> >>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >> >> I ran it anyway , the output is below > All good, except the error didn't happen. So you'd need to look at the > IMAP traffic to see which command generates the error. > > we use thunderbird, maybe trying with evolution give some way ? From robert at schetterer.org Wed Aug 1 15:12:40 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:12:40 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <1343822767.19913.81.camel@hurina> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> Message-ID: <50191D38.4010908@schetterer.org> Am 01.08.2012 14:06, schrieb Timo Sirainen: > See what you get by running the maildir through: > http://dovecot.org/tools/maildir-size-check.sh > > tons of i.e Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong S=2647728 value, should be S=3838835 -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 15:17:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:17:49 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50191D38.4010908@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> Message-ID: <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> On 1.8.2012, at 15.12, Robert Schetterer wrote: > Am 01.08.2012 14:06, schrieb Timo Sirainen: >> See what you get by running the maildir through: >> http://dovecot.org/tools/maildir-size-check.sh >> >> > > tons of i.e > > Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong > S=2647728 value, should be S=3838835 If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails and do those other checks, since it updates the uidlists and doesn't cause UIDs to change.) From tss at iki.fi Wed Aug 1 15:19:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:19:20 +0300 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <50191CD3.7010902@esiee.fr> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: On 1.8.2012, at 15.10, Frank Bonnet wrote: > On 08/01/2012 02:07 PM, Timo Sirainen wrote: >> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>> where the will probably work if you do something like: >>>> >>>> a list "" * >>>> b lsub "" * >>>> c select inbox >>>> >>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>> >>> I ran it anyway , the output is below >> All good, except the error didn't happen. So you'd need to look at the >> IMAP traffic to see which command generates the error. >> >> > we use thunderbird, maybe trying with evolution give some way ? Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. From robert at schetterer.org Wed Aug 1 15:25:00 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:25:00 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> Message-ID: <5019201C.3000106@schetterer.org> Am 01.08.2012 14:17, schrieb Timo Sirainen: > On 1.8.2012, at 15.12, Robert Schetterer wrote: > >> Am 01.08.2012 14:06, schrieb Timo Sirainen: >>> See what you get by running the maildir through: >>> http://dovecot.org/tools/maildir-size-check.sh >>> >>> >> >> tons of i.e >> >> Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong >> S=2647728 value, should be S=3838835 > > If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. i will try things couldn not get more worst > > (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails jep compressed is a must have and do those other checks, since it updates the uidlists and doesn't cause UIDs to change.) > i will report next using script -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 15:29:27 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 14:29:27 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: <50192127.3060803@esiee.fr> On 08/01/2012 02:19 PM, Timo Sirainen wrote: > On 1.8.2012, at 15.10, Frank Bonnet wrote: > >> On 08/01/2012 02:07 PM, Timo Sirainen wrote: >>> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>>> where the will probably work if you do something like: >>>>> >>>>> a list "" * >>>>> b lsub "" * >>>>> c select inbox >>>>> >>>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>>> I ran it anyway , the output is below >>> All good, except the error didn't happen. So you'd need to look at the >>> IMAP traffic to see which command generates the error. >>> >>> >> we use thunderbird, maybe trying with evolution give some way ? > Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. > ok understood , I have looked carrefully in logs , it *seems* to happen ONLY at the first connection of the day ... would it be possible ? would it be a caching problem ? From robert at schetterer.org Wed Aug 1 15:43:17 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 14:43:17 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <5019201C.3000106@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> Message-ID: <50192465.7080805@schetterer.org> Am 01.08.2012 14:25, schrieb Robert Schetterer: > Am 01.08.2012 14:17, schrieb Timo Sirainen: >> On 1.8.2012, at 15.12, Robert Schetterer wrote: >> >>> Am 01.08.2012 14:06, schrieb Timo Sirainen: >>>> See what you get by running the maildir through: >>>> http://dovecot.org/tools/maildir-size-check.sh >>>> >>>> >>> >>> tons of i.e >>> >>> Freunde/cur/1321795242.M359794P29783.mail02,S=2647728:2,S: Wrong >>> S=2647728 value, should be S=3838835 >> >> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. > > i will try things couldn not get more worst >> >> (There is also http://dovecot.org/tools/maildir-size-fix.pl which I of course noticed only after writing the whole script. That perl script should preferably be modified to support compressed mails > > jep compressed is a must have > > and do those other checks, since it updates the uidlists and doesn't > cause UIDs to change.) >> > > i will report next using script > ./maildir-size-check.sh -f maildir is an unknown option...? -- Best Regards MfG Robert Schetterer From tss at iki.fi Wed Aug 1 15:58:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 15:58:38 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <50192465.7080805@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> Message-ID: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> On 1.8.2012, at 15.43, Robert Schetterer wrote: >>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >> >> i will try things couldn not get more worst > > ./maildir-size-check.sh -f maildir is an unknown option...? Oh, looks like I forgot to re-upload it after adding that option. It's there now. From tlx at leuxner.net Wed Aug 1 16:31:30 2012 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 1 Aug 2012 15:31:30 +0200 Subject: [Dovecot] can't recieve emails to inbox In-Reply-To: References: Message-ID: <20120801133130.GA6049@nihlus.leuxner.net> On Wed, Aug 01, 2012 at 04:48:01PM +0530, Rafael Nathan wrote: > I am unable to send emails to virtual users I created. Here is my output > for dovecot -n > > I sent an email to user1 at mydomain.com from gmail.com but can view it > anywhere. Your MTA logs will most likely show. Anyway this version is ages old and you should update to a current supported branch. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From robert at schetterer.org Wed Aug 1 16:39:17 2012 From: robert at schetterer.org (Robert Schetterer) Date: Wed, 01 Aug 2012 15:39:17 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected In-Reply-To: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> Message-ID: <50193185.4050309@schetterer.org> Am 01.08.2012 14:58, schrieb Timo Sirainen: > On 1.8.2012, at 15.43, Robert Schetterer wrote: > >>>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >>> >>> i will try things couldn not get more worst >> >> ./maildir-size-check.sh -f maildir is an unknown option...? > > Oh, looks like I forgot to re-upload it after adding that option. It's there now. > looks like working fine, but it has some problems with pathnames with special char and spaces -- Best Regards MfG Robert Schetterer From f.bonnet at esiee.fr Wed Aug 1 16:43:35 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Wed, 01 Aug 2012 15:43:35 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <50191CD3.7010902@esiee.fr> Message-ID: <50193287.10903@esiee.fr> On 08/01/2012 02:19 PM, Timo Sirainen wrote: > On 1.8.2012, at 15.10, Frank Bonnet wrote: > >> On 08/01/2012 02:07 PM, Timo Sirainen wrote: >>> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>>> where the will probably work if you do something like: >>>>> >>>>> a list "" * >>>>> b lsub "" * >>>>> c select inbox >>>>> >>>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>>> I ran it anyway , the output is below >>> All good, except the error didn't happen. So you'd need to look at the >>> IMAP traffic to see which command generates the error. >>> >>> >> we use thunderbird, maybe trying with evolution give some way ? > Something is wrong in Dovecot since it's logging an error. I just can't fix it unless I know what IMAP command causes the error. > do you think imaptest could help ? From tss at iki.fi Wed Aug 1 20:24:36 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 20:24:36 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5018C827.80406@zu-con.org> References: <5018C827.80406@zu-con.org> Message-ID: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> On 1.8.2012, at 9.09, Matthias Rieber wrote: > I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in > a virtual folder dovecot crashes. > > Here's the stacktrace: > > http://pastebin.com/urSDDzku Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad From tss at iki.fi Wed Aug 1 20:58:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 01 Aug 2012 20:58:39 +0300 Subject: [Dovecot] v2.1.9 released Message-ID: <1343843919.18782.22.camel@innu> http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig I've again mostly finished reading and answering most of the mails in Dovecot mailing list. There are a couple annoyingly difficult / time consuming bugreport mails that I haven't replied to yet, but if anyone thinks I should have replied to something already feel free to resend the mail. For the new Redis/memcached dict stuff see http://master.wiki2.dovecot.org/AuthDatabase/Dict and http://master.wiki2.dovecot.org/Quota/Dict I'm thinking about removing the new quota_ignore_save_errors=yes setting in v2.2 and just forcing it enabled always. Thoughts? (I didn't want to change v2.1 behavior by doing this.) The most important changes since v2.1.8: * mail-log plugin: Log mailbox names with UTF-8 everywhere (instead of mUTF-7 in some places and UTF-8 in other places) * director: Changed director_username_hash setting's default from %u to %Lu (= lowercase usernames). This doesn't break any existing installations, but might fix some of them. + doveadm: Added "auth cache flush []" command. + Implemented dict passdb/userdb + Implemented Redis and memcached dict backends, which can be used as auth backends. Redis can also be used as dict-quota backend. + Added plugin { quota_ignore_save_errors=yes } setting to allow saving a mail when quota lookup fails with temporary failure. - Full text search indexing might have failed for some messages, always causing indexer-worker process to run out of memory. - fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC when the header wasn't lowercased. - fts-squat: Fixed crash when searching a virtual mailbox. - pop3: Fixed assert crash when doing UIDL on empty mailbox on some setups. - auth: GSSAPI RFC compliancy and error handling fixes. - Various fixes related to handling shared namespaces From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 21:09:29 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 20:09:29 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> Message-ID: <20120801180929.GA7779@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 7.32, Daniel Parthey wrote: > > >> Do you see any errors in logs? Especially: > >> > >> director: Error: connect(ipc) failed: Permission denied > > > > Looks very familiar to me. > > > > I'm having the same problem as Angel with director move that I have to kick the user logged into the proxy. Plus I'm also getting the ipc permission denied errors you mentioned. > > I added a note about it to http://wiki2.dovecot.org/Director#Other_settings > > doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. > > service ipc { > unix_listener ipc { > user = dovecot > } > } Thanks, Timo. Does this apply to the mailbox config or the director config? Which instance needs to access the ipc socket of which instance? Regards Daniel -- https://plus.google.com/103021802792276734820 From tss at iki.fi Wed Aug 1 21:10:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:10:40 +0300 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: <20120801180929.GA7779@daniel.localdomain> References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: On 1.8.2012, at 21.09, Daniel Parthey wrote: >> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >> >> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >> >> service ipc { >> unix_listener ipc { >> user = dovecot >> } >> } > > Thanks, Timo. > > Does this apply to the mailbox config or the director config? > Which instance needs to access the ipc socket of which instance? director instance needs access to director instance. From ml at smtp.fakessh.eu Wed Aug 1 21:12:58 2012 From: ml at smtp.fakessh.eu (ml) Date: Wed, 01 Aug 2012 20:12:58 +0200 Subject: [Dovecot] v2.1.9 released In-Reply-To: <1343843919.18782.22.camel@innu> References: <1343843919.18782.22.camel@innu> Message-ID: <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> the recurring problems of these minor errors that often appear timesmap. I almost successful make them disappear with an ultra clean install. they appearing more generally for L INBOX Trash Le 2012-08-01 19:58, Timo Sirainen a ?crit?: > http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz > http://dovecot.org/releases/2.1/dovecot-2.1.9.tar.gz.sig > > I've again mostly finished reading and answering most of the mails in > Dovecot mailing list. There are a couple annoyingly difficult / time > consuming bugreport mails that I haven't replied to yet, but if > anyone > thinks I should have replied to something already feel free to resend > the mail. > > For the new Redis/memcached dict stuff see > http://master.wiki2.dovecot.org/AuthDatabase/Dict and > http://master.wiki2.dovecot.org/Quota/Dict > > I'm thinking about removing the new quota_ignore_save_errors=yes > setting > in v2.2 and just forcing it enabled always. Thoughts? (I didn't want > to > change v2.1 behavior by doing this.) > > The most important changes since v2.1.8: > > * mail-log plugin: Log mailbox names with UTF-8 everywhere > (instead of mUTF-7 in some places and UTF-8 in other places) > * director: Changed director_username_hash setting's default from %u > to %Lu (= lowercase usernames). This doesn't break any existing > installations, but might fix some of them. > > + doveadm: Added "auth cache flush []" command. > + Implemented dict passdb/userdb > + Implemented Redis and memcached dict backends, which can be used > as > auth backends. Redis can also be used as dict-quota backend. > + Added plugin { quota_ignore_save_errors=yes } setting to allow > saving > a mail when quota lookup fails with temporary failure. > - Full text search indexing might have failed for some messages, > always causing indexer-worker process to run out of memory. > - fts-lucene: Fixed handling SEARCH HEADER FROM/TO/SUBJECT/CC/BCC > when > the header wasn't lowercased. > - fts-squat: Fixed crash when searching a virtual mailbox. > - pop3: Fixed assert crash when doing UIDL on empty mailbox on some > setups. > - auth: GSSAPI RFC compliancy and error handling fixes. > - Various fixes related to handling shared namespaces -- http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xC2626742 gpg --keyserver pgp.mit.edu --recv-key C2626742 http://about.me/fakessh http://urlshort.eu fakessh @ http://gplus.to/sshfake http://gplus.to/sshswilting http://gplus.to/john.swilting https://lists.fakessh.eu/mailman/ This list is moderated by me, but all applications will be accepted provided they receive a note of presentation From ml-dovecot at zu-con.org Wed Aug 1 21:13:55 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 20:13:55 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> Message-ID: <501971E3.80206@zu-con.org> Hello, Am 01.08.2012 19:24, schrieb Timo Sirainen: > On 1.8.2012, at 9.09, Matthias Rieber wrote: > >> I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in >> a virtual folder dovecot crashes. >> >> Here's the stacktrace: >> >> http://pastebin.com/urSDDzku > > Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: > http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad thanks, but in the meanwhile I moved to Solr, but I've still some, maybe different, crashes. I'll send a report later after upgrading to v2.1.9 (with config and log). Is lucence the better choice? According to the wiki Solr seems to be the most preferred solution. Regards, Matthias From tss at iki.fi Wed Aug 1 21:16:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:16:08 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <501971E3.80206@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501971E3.80206@zu-con.org> Message-ID: <96BC9767-9121-4745-B82D-8A426A94DD53@iki.fi> On 1.8.2012, at 21.13, Matthias Rieber wrote: > Is lucence the better choice? According to the wiki Solr seems to be the most preferred solution. Solr and Lucene both work. Solr has a newer Lucene version, but it requires running a Solr server. From tss at iki.fi Wed Aug 1 21:17:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 21:17:40 +0300 Subject: [Dovecot] v2.1.9 released In-Reply-To: <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> References: <1343843919.18782.22.camel@innu> <8cd4059c12b0826097f50779ec23d286@smtp.fakessh.eu> Message-ID: On 1.8.2012, at 21.12, ml wrote: > the recurring problems of these minor errors that often appear timesmap. I almost successful make them disappear with an ultra clean install. they appearing more generally for L INBOX Trash Sorry, but that doesn't make any sense. What errors? From ml-dovecot at zu-con.org Wed Aug 1 22:21:47 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 21:21:47 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> Message-ID: <501981CB.3030709@zu-con.org> Hi, Am 01.08.2012 19:24, schrieb Timo Sirainen: > On 1.8.2012, at 9.09, Matthias Rieber wrote: > >> I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in >> a virtual folder dovecot crashes. >> >> Here's the stacktrace: >> >> http://pastebin.com/urSDDzku > > Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: > http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad here are the crashes with fts_solr: Configuration ------------- # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-vserver-amd64 x86_64 Debian 5.0.10 auth_master_user_separator = * disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = virtual fts fts_solr zlib acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { hidden = yes inbox = no list = no location = prefix = mail separator = type = private } namespace { hidden = no inbox = yes location = prefix = separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = INBOX. separator = . type = private } namespace { location = maildir:/home/sharedbox/Maildir prefix = shared. separator = . type = public } namespace { list = yes location = maildir:/home/%%n/Maildir prefix = common.%%u. separator = . subscriptions = no type = shared } namespace { hidden = no list = yes location = virtual:~/Maildir/virtual prefix = virtual. separator = . subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes } plugin { acl = vfile:/etc/dovecot/acls:cache_secs=7200 acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db fts = solr fts_solr = url=http://localhost:8983/solr/ sieve_dir = ~/Maildir/sieve } protocols = imap pop3 sieve service imap { executable = imap vsz_limit = 1 G } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = , method=PLAIN, rip=10.0.1.3, lip=10.0.1.3, mpid=18561, TLS, session= Aug 1 21:05:37 smtp dovecot: imap(matthias): Disconnected: Logged out in=689 out=239091 Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head Aug 1 21:05:45 smtp dovecot: imap(matthias): Panic: Leaked t_pop() call Aug 1 21:05:45 smtp dovecot: imap(matthias): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636d71] -> /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] -> /usr/local/lib/dov] Aug 1 21:05:45 smtp dovecot: imap(matthias): Fatal: master: service(imap): child 18507 killed with signal 6 (core dumped) Backtrace: Core was generated by `dovecot/imap'. Program terminated with signal 6, Aborted. [New process 18507] #0 0xf74d6556 in raise () from /lib/libc.so.6 #0 0xf74d6556 in raise () from /lib/libc.so.6 No symbol table info available. #1 0xf74d7d78 in abort () from /lib/libc.so.6 No symbol table info available. #2 0xf7636d85 in default_fatal_finish (type=, status=0) at failures.c:191 backtrace = 0x961f2b0 "/usr/local/lib/dovecot/libdovecot.so.0 [0xf7636d71] -> /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] -> /usr/local/lib/dovecot/l"... #3 0xf7636def in i_internal_fatal_handler (ctx=0xffb97268, format=0xf76620b1 "Leaked t_pop() call", args=0xffb97284 "\024") at failures.c:649 status = 0 #4 0xf76370c4 in i_panic (format=0xf76620b1 "Leaked t_pop() call") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} #5 0xf76348e1 in t_pop_check (id=0xffb972c8) at data-stack.c:271 No locals. #6 0x08056c6a in client_handle_input (client=0x9670768) at imap-client.c:787 _data_stack_cur_id = 3 ret = true remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #7 0x0805765f in client_input (client=0x9670768) at imap-client.c:825 cmd = output = (struct ostream *) 0x9671094 bytes = __FUNCTION__ = "client_input" #8 0xf7644f12 in io_loop_call_io (io=0x96710f8) at ioloop.c:379 ioloop = (struct ioloop *) 0x96273f8 t_id = 2 #9 0xf76460d0 in io_loop_handler_run (ioloop=0x96273f8) at ioloop-epoll.c:213 ctx = (struct ioloop_handler_context *) 0x96275e0 event = (const struct epoll_event *) 0x9627620 list = (struct io_list *) 0x9671128 io = (struct io_file *) 0x6 tv = {tv_sec = 1799, tv_usec = 998952} msecs = ret = 1 i = 0 j = 0 call = false #10 0xf7644ea0 in io_loop_run (ioloop=0x96273f8) at ioloop.c:398 No locals. #11 0xf762d87d in master_service_run (service=0x9627328, callback=0x80607c0 ) at master-service.c:543 No locals. #12 0x08060684 in main (argc=1329791025, argv=0x4749464e) at main.c:389 login_set = {auth_socket_path = 0x961f068 "/usr/local/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x8060960 , failure_callback = 0x8060900 } service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = set_roots = {0x8063340, 0x0} Crash 2 ------- What I did: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot ready. a LOGIN matthias XXXX a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE SEARCH=FUZZY COMPRESS=DEFLATE ACL RIGHTS=texk] Logged in a SELECT virtual.spam.disagree.spamassassin * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 198 EXISTS * 6 RECENT * OK [UNSEEN 1] First unseen. * OK [UIDVALIDITY 1343840294] UIDs valid * OK [UIDNEXT 417] Predicted next UID * OK [NOMODSEQ] No permanent modsequences a OK [READ-WRITE] Select completed. a SEARCH OR HEADER FROM foobar HEADER SUBJECT barfoos (server disconnects) Log: Aug 1 21:10:01 smtp dovecot: imap-login: Login: user=, method=PLAIN, rip=10.0.1.3, lip=10.0.1.3, mpid=20709, TLS, session= Aug 1 21:10:15 smtp dovecot: imap(matthias): Fatal: master: service(imap): child 20642 killed with signal 11 (core dumped) Backtrace: Core was generated by `dovecot/imap'. Program terminated with signal 11, Segmentation fault. [New process 20642] #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 125 for (i = 0; result->box_results[i].box != NULL; i++) { #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 _data_stack_cur_id = 4 #1 0xf734447b in fts_search_lookup (fctx=0x897cfc8) at fts-search.c:350 last_uid = 409 seq1 = 192 seq2 = 198 __FUNCTION__ = "fts_search_lookup" #2 0xf7345dc7 in fts_mailbox_search_init (t=0x897d910, args=0x8995518, sort_program=0x0, wanted_fields=0, wanted_headers=0x0) at fts-storage.c:199 flist = (struct fts_mailbox_list *) 0x8949898 ctx = (struct mail_search_context *) 0x8953068 fctx = (struct fts_search_context *) 0x897cfc8 #3 0xf776cf47 in mailbox_search_init (t=0x897d910, args=0x8995518, sort_program=0x0, wanted_fields=0, wanted_headers=0x0) at mail-storage.c:1402 No locals. #4 0x0805d741 in imap_search_start (ctx=0x894c238, sargs=0x8995518, sort_program=0x0) at imap-search.c:550 cmd = (struct client_command_context *) 0x894c180 #5 0x08053ac6 in cmd_search (cmd=0x894c180) at cmd-search.c:45 ctx = sargs = (struct mail_search_args *) 0x8995518 args = (const struct imap_arg *) 0x894ea88 charset = 0x8061738 "UTF-8" ret = #6 0x08057b03 in command_exec (cmd=0x894c180) at imap-commands.c:148 hook = (const struct command_hook *) 0x8903260 ret = false #7 0x08056a3f in client_command_input (cmd=0x894c180) at imap-client.c:682 client = (struct client *) 0x894b768 command = __FUNCTION__ = "client_command_input" #8 0x08056ae1 in client_command_input (cmd=0x894c180) at imap-client.c:733 client = (struct client *) 0x894b768 command = (struct command *) 0x0 __FUNCTION__ = "client_command_input" #9 0x08056c5d in client_handle_input (client=0x894b768) at imap-client.c:774 _data_stack_cur_id = 3 ret = false remove_io = handled_commands = false __FUNCTION__ = "client_handle_input" #10 0x0805765f in client_input (client=0x894b768) at imap-client.c:825 cmd = output = (struct ostream *) 0x894c094 bytes = __FUNCTION__ = "client_input" #11 0xf76c7f12 in io_loop_call_io (io=0x894c0f8) at ioloop.c:379 ioloop = (struct ioloop *) 0x89023f8 t_id = 2 #12 0xf76c90d0 in io_loop_handler_run (ioloop=0x89023f8) at ioloop-epoll.c:213 ctx = (struct ioloop_handler_context *) 0x89025e0 event = (const struct epoll_event *) 0x8902620 list = (struct io_list *) 0x894c128 io = (struct io_file *) 0x0 tv = {tv_sec = 1789, tv_usec = 618880} msecs = ret = 1 i = 0 j = 0 call = 16 #13 0xf76c7ea0 in io_loop_run (ioloop=0x89023f8) at ioloop.c:398 No locals. #14 0xf76b087d in master_service_run (service=0x8902328, callback=0x80607c0 ) at master-service.c:543 No locals. #15 0x08060684 in main (argc=1329791025, argv=0x4749464e) at main.c:389 login_set = {auth_socket_path = 0x88fa068 "/usr/local/var/run/dovecot/auth-master", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x8060960 , failure_callback = 0x8060900 } service_flags = storage_service_flags = MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT username = 0x0 c = set_roots = {0x8063340, 0x0} Regards, Matthias From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 22:32:09 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 21:32:09 +0200 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: <20120710224947.GA10641@daniel.localdomain> References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> Message-ID: <20120801193209.GA9069@daniel.localdomain> Daniel Parthey wrote: > Timo Sirainen wrote: > > On 29.6.2012, at 19.21, Daniel Parthey wrote: > > > > > Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): > > > Error: user user31 at domain1.example.org: Error reading configuration: > > > net_connect_unix(/var/run/dovecot/config) failed: Permission denied > > > > I've noticed a similar problem happening somewhat randomly, but I still > > haven't looked into why exactly it happens. Anyway the attached patch should > > fix this specific error, but I'm not sure if there isn't another one. Try and > > let me know? :) > > Unfortunately, the problem still persists with dovecot 2.1.8, > which already contains the following code: > > enum master_service_flags service_flags = > MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN; > const char *error; > master_service = master_service_init("doveadm", service_flags, > &argc, &argv, NULL); > if (master_getopt(master_service) > 0) > return FATAL_DEFAULT; > > The command > /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A > still generates the following errors after iterating some dozen users: > > doveadm(nagios at metaways.de): Error: doveadm server failure > doveadm: Error: Failed to iterate through some users > > Which information should I provide to help debugging the problem? The change in 2.1.8 didn't fix it and still does not iterate *all* users. My current workaround is to list all users, run a for-loop over the userlist and flush one mailbox after another via the director. Any hints how to solve this? Regards Daniel -- https://plus.google.com/103021802792276734820 From tss at iki.fi Wed Aug 1 22:45:56 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 22:45:56 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <501981CB.3030709@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> Message-ID: <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> On 1.8.2012, at 22.21, Matthias Rieber wrote: > here are the crashes with fts_solr: .. > Crash 1 > Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 > Crash 2 > #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true) at fts-search.c:125 > 125 for (i = 0; result->box_results[i].box != NULL; i++) { Fixed: http://hg.dovecot.org/dovecot-2.1/rev/323d6ce62567 From tss at iki.fi Wed Aug 1 22:56:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 22:56:39 +0300 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: <20120801193209.GA9069@daniel.localdomain> References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: On 1.8.2012, at 22.32, Daniel Parthey wrote: >>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): >>>> Error: user user31 at domain1.example.org: Error reading configuration: >>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied > The change in 2.1.8 didn't fix it and still does not iterate *all* users. > My current workaround is to list all users, run a for-loop over the userlist > and flush one mailbox after another via the director. > > Any hints how to solve this? The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 464 bytes Desc: not available URL: -------------- next part -------------- From ml-dovecot at zu-con.org Wed Aug 1 23:06:09 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 22:06:09 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> Message-ID: <50198C31.5070902@zu-con.org> Hi, Am 01.08.2012 21:45, schrieb Timo Sirainen: > On 1.8.2012, at 22.21, Matthias Rieber wrote: > >> here are the crashes with fts_solr: > .. >> Crash 1 >> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head > > The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 I thought non-fulltext searches were done by dovecot itself? Matthias From tss at iki.fi Wed Aug 1 23:14:53 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 23:14:53 +0300 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: On 1.8.2012, at 22.56, Timo Sirainen wrote: > On 1.8.2012, at 22.32, Daniel Parthey wrote: > >>>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): >>>>> Error: user user31 at domain1.example.org: Error reading configuration: >>>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied >> The change in 2.1.8 didn't fix it and still does not iterate *all* users. >> My current workaround is to list all users, run a for-loop over the userlist >> and flush one mailbox after another via the director. >> >> Any hints how to solve this? > > The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) Also I wonder if this helps (at least it fixes a crash I managed to cause): http://hg.dovecot.org/dovecot-2.1/rev/476381017ec7 From tss at iki.fi Wed Aug 1 23:16:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 1 Aug 2012 23:16:57 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <50198C31.5070902@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> Message-ID: <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> On 1.8.2012, at 23.06, Matthias Rieber wrote: >>> here are the crashes with fts_solr: >> .. >>> Crash 1 >>> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head >> >> The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 > > I thought non-fulltext searches were done by dovecot itself? They are, but header searches are part of full text search. From peter at grimmond.org Wed Aug 1 23:22:35 2012 From: peter at grimmond.org (Peter Grimmond) Date: Wed, 1 Aug 2012 20:22:35 +0000 Subject: [Dovecot] Problem with preserving MIME format with Dovecot IMAP and Outlook Message-ID: From ml-dovecot at zu-con.org Wed Aug 1 23:23:59 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Wed, 01 Aug 2012 22:23:59 +0200 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> Message-ID: <5019905F.3010102@zu-con.org> Am 01.08.2012 22:16, schrieb Timo Sirainen: > On 1.8.2012, at 23.06, Matthias Rieber wrote: > >>>> here are the crashes with fts_solr: >>> .. >>>> Crash 1 >>>> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head >>> >>> The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 >> >> I thought non-fulltext searches were done by dovecot itself? > > They are, but header searches are part of full text search. alright. Some resources say that "413 FULL head" means request too large. Maybe that's caused by the pretty big folder virtual.all which contains more than 360000 mails. Matthias From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 1 23:25:02 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 1 Aug 2012 22:25:02 +0200 Subject: [Dovecot] doveadm purge -A via doveadm-proxy director fails after some users In-Reply-To: References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> Message-ID: <20120801202502.GA9951@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 22.32, Daniel Parthey wrote: > > >>>> Jun 29 15:40:31 10.129.3.249 dovecot: doveadm(user31 at domain1.example.org): > >>>> Error: user user31 at domain1.example.org: Error reading configuration: > >>>> net_connect_unix(/var/run/dovecot/config) failed: Permission denied > > The change in 2.1.8 didn't fix it and still does not iterate *all* users. > > My current workaround is to list all users, run a for-loop over the userlist > > and flush one mailbox after another via the director. > > > > Any hints how to solve this? > > The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) Running command on a four host setup with mailbox+director instance each: /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A Output is: doveadm(username at example.org): Error: doveadm server failure doveadm: Error: Failed to iterate through some users Log says: dovecot: doveadm(username at example.org): Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied (euid=501(vmail) egid=123(vmail) missing +r perm: /var/run/dovecot/auth-userdb, we're not in group 122(dovecot), dir owned by 0:0 mode=0755) dovecot: doveadm(username at example.org): Error: purge: User lookup failed: Internal error occurred. Refer to server log for more information. Here are the directory permissions: mail01:~# id vmail uid=501(vmail) gid=123(vmail) groups=123(vmail) mail01:~# id dovecot uid=120(dovecot) gid=122(dovecot) groups=122(dovecot) mail01:~# ls -ld /var/run/dovecot drwxr-xr-x 4 root root 660 2012-07-11 18:35 /var/run/dovecot mail01:~# ls -l /var/run/dovecot total 8 srw------- 1 root root 0 2012-07-10 18:29 anvil srw------- 1 root root 0 2012-07-10 18:29 anvil-auth-penalty srw------- 1 root root 0 2012-07-11 18:35 auth-client srw------- 1 dovecot root 0 2012-07-11 18:35 auth-login srw------- 1 root root 0 2012-07-11 18:35 auth-master srw-rw---- 1 dovecot dovecot 0 2012-07-11 18:35 auth-userdb srw------- 1 dovecot root 0 2012-07-11 18:35 auth-worker srw------- 1 root root 0 2012-07-11 18:35 config srw-rw---- 1 root vmail 0 2012-07-11 18:35 dict srw------- 1 root root 0 2012-07-11 18:35 director-admin srw------- 1 root root 0 2012-07-10 10:19 director-userdb srw-rw-rw- 1 root root 0 2012-07-11 18:35 dns-client srw------- 1 root root 0 2012-07-11 18:35 doveadm-server lrwxrwxrwx 1 root root 25 2012-07-10 18:29 dovecot.conf -> /etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 40 2012-07-10 10:19 empty srw------- 1 root root 0 2012-07-11 18:35 imap-postlogin srw-rw-rw- 1 root root 0 2012-07-11 18:35 indexer srw------- 1 dovecot root 0 2012-07-11 18:35 indexer-worker srw------- 1 root root 0 2012-07-11 18:35 ipc srw-rw-rw- 1 root root 0 2012-07-11 18:35 lmtp srw------- 1 root root 0 2012-07-11 18:35 log-errors drwxr-x--- 2 root nogroup 180 2012-07-11 18:35 login -rw------- 1 root root 5 2012-07-10 18:29 master.pid -rw-r--r-- 1 root root 71 2012-07-10 18:29 mounts srw------- 1 root root 0 2012-07-11 18:35 pop3-postlogin srw------- 1 vmail root 0 2012-07-11 18:35 quota-warning srw------- 1 root root 0 2012-07-11 18:35 replication-notify prw------- 1 root root 0 2012-07-11 18:35 replication-notify-fifo srw------- 1 dovecot root 0 2012-07-11 18:35 replicator srw------- 1 root root 0 2012-07-11 18:35 stats prw------- 1 vmail root 0 2012-08-01 22:20 stats-mail Please see mailbox and director config attached. Any help is appreciated. Regards Daniel -- https://plus.google.com/103021802792276734820 -------------- next part -------------- # 2.1.8: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_verbose = yes auth_verbose_passwords = sha1 deliver_log_format = mailbox: deliver: msgid=%m from=%f: %$ dict { quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = xxx imapc_features = rfc822.size imapc_host = local-mailbox imapc_port = 18143 instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Mailbox login_log_format = mailbox: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "mailbox: mail: %s(%u): " mail_plugins = quota stats mail_privileged_group = vmail mail_uid = vmail managesieve_implementation_string = Sieve managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 50 M mmap_disable = yes passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = dovecot mode = 0660 user = dovecot } } service dict { unix_listener dict { group = vmail mode = 0660 } } service doveadm { inet_listener doveadm-server { port = 19000 } } service imap-login { inet_listener imap { port = 19143 } } service imap-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { address = * port = 19024 } } service managesieve-login { inet_listener sieve { port = 19200 } } service pop3-login { inet_listener pop3 { port = 19110 } } service pop3-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script /usr/local/bin/quota-warning extra_groups = dovecot unix_listener quota-warning { user = vmail } user = vmail } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = quota stats imap_quota imap_stats } protocol lmtp { mail_plugins = quota stats sieve } -------------- next part -------------- # 2.1.8: /etc/dovecot-director/dovecot-director.conf # OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS auth_verbose = yes auth_verbose_passwords = sha1 base_dir = /var/run/dovecot-director deliver_log_format = director: deliver: msgid=%m from=%f: %$ director_doveadm_port = 20000 director_mail_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_user_expire = 2 days disable_plaintext_auth = no doveadm_password = xxx doveadm_proxy_port = 19000 instance_name = dovecot-director lmtp_proxy = yes login_greeting = Mail Balancer login_log_format = director: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "director: mail: %s(%u): " mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes passdb { args = /etc/dovecot-director/conf.d/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { executable = doveadm-server director inet_listener doveadm-server { port = 20000 } } service imap-login { executable = imap-login director inet_listener imap { port = 20143 } inet_listener imaps { port = 20993 ssl = yes } } service lmtp { inet_listener lmtp { address = * port = 20024 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 20200 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 20110 } inet_listener pop3s { port = 20995 ssl = yes } } ssl_cert = References: <53B237A0-3A44-47DC-B41A-82CB5D174254@iki.fi> <20120710224947.GA10641@daniel.localdomain> <20120801193209.GA9069@daniel.localdomain> <20120801202502.GA9951@daniel.localdomain> Message-ID: <98D34C84-B1F4-47B3-9145-06E262FC11D7@iki.fi> On 1.8.2012, at 23.25, Daniel Parthey wrote: >> The error is still the same "config permission denied" shown above? I found that also from my server and added a debug patch, but it hasn't crashed yet. Could you try the attached patch and getting a gdb backtrace from the resulting core file? (Or at least the raw backtrace - getting a core file might be tricky.) > > Running command on a four host setup with mailbox+director instance each: > /usr/bin/doveadm -c /etc/dovecot-director/dovecot-director.conf -D purge -A > > dovecot: doveadm(username at example.org): Error: userdb lookup: connect(/var/run/dovecot/auth-userdb) failed: Permission denied (euid=501(vmail) egid=123(vmail) missing +r perm: /var/run/dovecot/auth-userdb, we're not in group 122(dovecot), dir owned by 0:0 mode=0755) Ah, so the original patch helped! This is a different error. > srw-rw---- 1 dovecot dovecot 0 2012-07-11 18:35 auth-userdb Simplest solution now would be to make this world-rw, see the auth-userdb socket configuration in http://wiki2.dovecot.org/LDA#Virtual_users But I guess this should also be fixed by doveadm-server. Although I don't think this should be happening by default anyway. Maybe this is also solved by the http://hg.dovecot.org/dovecot-2.1/rev/476381017ec7 patch? From peter at grimmond.org Wed Aug 1 23:53:00 2012 From: peter at grimmond.org (Peter Grimmond) Date: Wed, 1 Aug 2012 20:53:00 +0000 Subject: [Dovecot] Problem with preserving MIME format with Dovecot IMAP and MS Outlook client Message-ID: Hello all, Apologies for the repost, but I am really struggling to solve this problem... I have installed Dovecot 2.0.19 on Ubuntu 12.04 LTS. I have set up a very basic IMAP configuration. I have two different laptops running MS Outlook (one MacOS, one Windows 7) and I have configured both to connect to the Dovecot service. My problem is, emails in MIME format that I synchronise from one MS Outlook client are not being correctly decoded as MIME messages on the other client. Instead, the message is rendered in plaintext, starting with the lines: This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. --B_3426360453_22814Content-type: multipart/alternative; boundary="B_3426360453_4099" --B_3426360453_4099Content-type: text/plain; charset="ISO-8859-1"Content-transfer-encoding: quoted-printable Can anyone help me understand why this might be happening? The output from dovecot -n is: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-26-generic-pae i686 Ubuntu 12.04 LTS auth_debug = yes auth_verbose = yes disable_plaintext_auth = no mail_location = maildir:~/Maildir passdb { driver = pam } protocols = " imap" ssl_cert = References: Message-ID: <60F3895B-5FE9-4A8A-9273-4FE661C75285@iki.fi> On 1.8.2012, at 23.53, Peter Grimmond wrote: > have installed Dovecot 2.0.19 on Ubuntu 12.04 LTS. I have set up a > very basic IMAP configuration. I have two different laptops running MS > Outlook (one MacOS, one Windows 7) and I have configured both to connect > to the Dovecot service. My problem is, emails in MIME format that I > synchronise from one MS Outlook client are not being correctly decoded > as MIME messages on the other client. Instead, the message is rendered > in plaintext, starting with the lines: Have you tried other clients? Maybe the mails are actually broken? In any case it doesn't really look like a Dovecot problem. From daniel.parthey at informatik.tu-chemnitz.de Thu Aug 2 01:04:46 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Thu, 2 Aug 2012 00:04:46 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <1343822869.19913.82.camel@hurina> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> Message-ID: <20120801220446.GA12171@daniel.localdomain> Timo Sirainen wrote: > On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: > > > where the will probably work if you do something like: > > > > > > a list "" * > > > b lsub "" * > > > c select inbox > > > > > > if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog > > > > I ran it anyway , the output is below > > All good, except the error didn't happen. So you'd need to look at the > IMAP traffic to see which command generates the error. Frank, please do a plaintext connect on IMAP port 143 from your mail client to dovecot with a changed test password and record your traffic using tcpdump or wireshark, something like this: tcpdump -n -s 0 -w /tmp/pcap.dat -i eth0 tcp port 143 Then view the file pcap.dat with wireshark[1], right click on the TCP connection and select "Follow TCP Stream" from the context menu. Then you'll get the IMAP commands and responses spoken between Thunderbird and Dovecot. Regards Daniel [1] http://www.wireshark.org/ -- https://plus.google.com/103021802792276734820 From robert at schetterer.org Thu Aug 2 10:09:24 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 02 Aug 2012 09:09:24 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> Message-ID: <501A27A4.7000303@schetterer.org> Am 01.08.2012 14:58, schrieb Timo Sirainen: > On 1.8.2012, at 15.43, Robert Schetterer wrote: > >>>> If you don't mind the messages' IMAP UIDs changing, you could give the -f parameter to fix those. >>> >>> i will try things couldn not get more worst >> >> ./maildir-size-check.sh -f maildir is an unknown option...? > > Oh, looks like I forgot to re-upload it after adding that option. It's there now. > Hi Timo, most of the Problems are fixed now many thx for your script , but how to avoid that in future ( Maildir filename has wrong S value ) with Ralf you released a patch diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 @@ -20,6 +20,7 @@ struct mail *mail = mstream->mail; enum mail_lookup_abort orig_lookup_abort; + return FALSE; if (mstream->expected_size != (uoff_t)-1) return TRUE; would it be a good idea to include it in 2.1.9 for me ? as it looks like its not in the public code ? -- Best Regards MfG Robert Schetterer From brad at comstyle.com Thu Aug 2 10:58:45 2012 From: brad at comstyle.com (Brad Smith) Date: Thu, 2 Aug 2012 03:58:45 -0400 Subject: [Dovecot] LZMA2 (xz) support for Dovecot? Message-ID: <20120802075845.GF18868@rox.home.comstyle.com> Timo, Thoughts on adding LZMA2 (xz) support via liblzma to Dovecot? -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. From f.bonnet at esiee.fr Thu Aug 2 11:24:13 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Thu, 02 Aug 2012 10:24:13 +0200 Subject: [Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In-Reply-To: <20120801220446.GA12171@daniel.localdomain> References: <5018D884.7000103@esiee.fr> <50190B6F.7020600@Media-Brokers.com> <50190D16.1090901@esiee.fr> <50190FFD.5060406@Media-Brokers.com> <5019113B.7030509@esiee.fr> <50191A58.8030404@esiee.fr> <1343822869.19913.82.camel@hurina> <20120801220446.GA12171@daniel.localdomain> Message-ID: <501A392D.3070705@esiee.fr> On 08/02/2012 12:04 AM, Daniel Parthey wrote: > Timo Sirainen wrote: >> On Wed, 2012-08-01 at 14:00 +0200, Frank Bonnet wrote: >>>> where the will probably work if you do something like: >>>> >>>> a list "" * >>>> b lsub "" * >>>> c select inbox >>>> >>>> if not, check what IMAP commands your IMAP client sends when it fails. http://wiki2.dovecot.org/Debugging/Rawlog >>> I ran it anyway , the output is below >> All good, except the error didn't happen. So you'd need to look at the >> IMAP traffic to see which command generates the error. > Frank, please do a plaintext connect on IMAP port 143 from your mail client > to dovecot with a changed test password and record your traffic using tcpdump > or wireshark, something like this: > > tcpdump -n -s 0 -w /tmp/pcap.dat -i eth0 tcp port 143 > > Then view the file pcap.dat with wireshark[1], right click on the TCP connection > and select "Follow TCP Stream" from the context menu. Then you'll get the IMAP > commands and responses spoken between Thunderbird and Dovecot. > > Regards > Daniel > > [1] http://www.wireshark.org/ Hello Thanks for your help. well I did but haven't found anything interrestiing in tcpdump log ... and the problem did not happened this morning since I have mail_debug=no in 10-logging.conf file then restart dovecot ... BTW if it matter the users's home directories is a link than point to the real directory. From rrosenfeld at netcologne.de Thu Aug 2 11:42:57 2012 From: rrosenfeld at netcologne.de (Roland Rosenfeld) Date: Thu, 2 Aug 2012 10:42:57 +0200 Subject: [Dovecot] ACL with MySQL dict => full table scans (was: v2.1.9 released) In-Reply-To: <1343843919.18782.22.camel@innu> References: <1343843919.18782.22.camel@innu> Message-ID: <20120802084257.GB23882@sys-241.netcologne.de> On Wed, 01 Aug 2012, Timo Sirainen wrote: > I've again mostly finished reading and answering most of the mails in > Dovecot mailing list. There are a couple annoyingly difficult / time > consuming bugreport mails that I haven't replied to yet, but if anyone > thinks I should have replied to something already feel free to resend > the mail. I'm not sure where my request was annoying or difficult, but I didn't read an answer to it ;-) http://www.dovecot.org/list/dovecot/2012-July/067130.html Maybe you could have a look at it... Tschoeeee Roland -- Roland Rosenfeld - Content Delivery - NED - Technik NetCologne Gesellschaft f?r Telekommunikation mbH - HRB 25580, AG K?ln Am Coloneum 9 50829 K?ln Tel.: +49 221 2222-373 Fax: +49 221 2222-7373 Gesch?ftsf?hrer: Dr. Hans Konle (Sprecher), Karl-Heinz Zankel From tss at iki.fi Thu Aug 2 16:46:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 2 Aug 2012 16:46:13 +0300 Subject: [Dovecot] LZMA2 (xz) support for Dovecot? In-Reply-To: <20120802075845.GF18868@rox.home.comstyle.com> References: <20120802075845.GF18868@rox.home.comstyle.com> Message-ID: On 2.8.2012, at 10.58, Brad Smith wrote: > Thoughts on adding LZMA2 (xz) support via liblzma to Dovecot? If someone sends a patch I'll add it. Apparently its API should be similar to zlib so probably it's just a matter of renaming some functions and such. From bam at miranda.org Thu Aug 2 19:10:17 2012 From: bam at miranda.org (Bret Martin) Date: Thu, 2 Aug 2012 12:10:17 -0400 Subject: [Dovecot] Overriding inbox= in userdb extra fields Message-ID: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Hello, I'm trying to set up an alternate user with a different inbox using passwd-file and userdb extra fields and the extra field settings don't seem to be taking effect. I've used auth_debug and mail_debug and I'm unclear how I can further troubleshoot this. Is it possible to have inbox=yes in one namespace globally and then override this for one user by setting inbox=no for that namespace and then inbox=yes for another? My doveconf -n is below. I would like to have inbox=yes for the inbox namespace, inbox=no for the virtual namespace, and then be able to invert these for selected users using userdb extra fields. My attempt at doing this so far looks like bam-ios:[REDACTED]:500:500::/home/bam::user=bam namespace/inbox/inbox=no namespace/virtual/inbox=yes Changing the user with user= seems to work fine, but the inbox= changes don't. Here is some relevant log data. Aug 2 11:37:29 new-miranda dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file /etc/dovecot/users: Read 1 users in 0 secs Aug 2 11:37:29 new-miranda dovecot: auth: Debug: auth client connected (pid=14967) Aug 2 11:37:29 new-miranda dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=Rgx2MErG4wBAd51y#011lip=216.93.241.245#011rip=64.119.157.114#011lport=993#011rport=38115#011resp= Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file(bam-ios,64.119.157.114,): lookup: user=bam-ios file=/etc/dovecot/users Aug 2 11:37:29 new-miranda dovecot: auth: Debug: auth(bam-ios,64.119.157.114,): username changed bam-ios -> bam Aug 2 11:37:29 new-miranda dovecot: auth: Debug: client out: OK#0111#011user=bam#011namespace/inbox/inbox=no#011namespace/virtual/inbox=yes Aug 2 11:37:29 new-miranda dovecot: auth: Debug: master in: REQUEST#[REDACTED] Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd-file(bam,64.119.157.114,): lookup: user=bam file=/etc/dovecot/users Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup Aug 2 11:37:29 new-miranda dovecot: auth: Debug: master out: USER#0111425670145#011bam#011system_groups_user=bam#011uid=500#011gid=500#011home=/home/bam Aug 2 11:37:29 new-miranda dovecot: imap-login: Login: user=, method=PLAIN, rip=64.119.157.114, lip=216.93.241.245, mpid=14970, TLS, session= Aug 2 11:37:29 new-miranda dovecot: imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 2 11:37:29 new-miranda dovecot: imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_virtual_plugin.so Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Effective uid=500, gid=500, home=/home/bam Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/bam/mdbox Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/mdbox, index=, control=, inbox=, alt= Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace : Using permissions from /srv/mail/bam/mdbox: mode=0700 gid=-1 Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace virtual: type=private, prefix=virtual/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=virtual:/srv/mail/bam/virtual Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/virtual, index=, control=, inbox=, alt= Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: Namespace mdbox: type=private, prefix=mdbox/, sep=/, inbox=no, hidden=yes, list=no, subscriptions=yes location=mdbox:/srv/mail/bam/mdbox Aug 2 11:37:29 new-miranda dovecot: imap(bam): Debug: fs: root=/srv/mail/bam/mdbox, index=, control=, inbox=, alt= I also tried not having inbox=yes anywhere in the global configurations, but then I get Aug 2 11:52:22 new-miranda dovecot: imap(bam): Error: user bam: Initialization failed: namespace configuration error: inbox=yes namespace missing I'm having great luck with the virtual plugin, but I only want to use it for the inbox on some clients. Any ideas on why my inbox=yes/no overrides aren't taking effect? Thanks, --Bret # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 ext4 mail_location = mdbox:/srv/mail/%u/mdbox mail_plugins = " virtual" namespace inbox { inbox = no location = prefix = } namespace mdbox { hidden = yes list = no location = prefix = mdbox/ separator = / } namespace virtual { hidden = yes inbox = yes list = no location = virtual:/srv/mail/%u/virtual prefix = virtual/ separator = / } passdb { args = scheme=SSHA512 username_format=%u /etc/dovecot/users driver = passwd-file } passdb { driver = pam } protocols = " imap" service imap-login { inet_listener imap { port = 0 } } ssl_cert = References: Message-ID: 2012/7/31 Timo Sirainen : > On 18.7.2012, at 4.33, Lazy wrote: > >> I wan't it to stay that way. The problem is that it dosn't update the >> quota rules in Maildir when quota is changed in userdb. >> I have the rules avaiable in qmail-lda's environment, but I need an >> idea on how to feed the quota rule string to quota plugin without >> doing userdb lookup. >> >> What whould be the best way to do this, maybe in >> plugins/quota/quota.c:quota_root_add_rules() ? > > dovecot-lda -o plugin/quota_rule=*:storage=1G > thank You ! This is simple and elegant. Sill I need this to be taken from environment, I produced a simple patch adding one '-o' from an environment variable. If You consider this useful I can try and make it more generic, enable multiple option overriding. Regards, Michal Grzedzicki From tss at iki.fi Fri Aug 3 02:27:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 02:27:01 +0300 Subject: [Dovecot] dovecot-lda setting quota rules In-Reply-To: References: Message-ID: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> On 3.8.2012, at 2.13, Lazy wrote: >> dovecot-lda -o plugin/quota_rule=*:storage=1G >> > > thank You ! > > This is simple and elegant. > > Sill I need this to be taken from environment, I produced a simple > patch adding one '-o' from an environment variable. You can also set environment: PLUGIN/QUOTA_RULE=*:storage=1G and then use dovecot-lda -k parameter. And if even that doesn't work, you could simply create a wrapper script. > If You consider this useful I can try and make it more generic, enable > multiple option overriding. You can also give -o parameter multiple times. From ml-dovecot at zu-con.org Fri Aug 3 09:49:52 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Fri, 03 Aug 2012 08:49:52 +0200 Subject: [Dovecot] Mail deletion and Solr index update Message-ID: <501B7490.1020108@zu-con.org> Hi, I've deleted 10000s emails and it seems that every mail is removed with a single request from Solrs index. This works, but it's quite slow. Is it possible/plans to improve that? Matthias From nikolai at net24.co.nz Fri Aug 3 10:04:36 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Fri, 3 Aug 2012 19:04:36 +1200 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout Message-ID: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> Timo, There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 15: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 16: Disconnected ... dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14492: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14493: Disconnected dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 14494: Disconnected Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, or it should simply reconnect if sees the connection is lost. At the moment the only work around is to increase the POP3 server's idle timeout to a multi hour value, which isn't a good work around as it causes a lot of inactive POP sessions to bank up. Regards, Nikolai. From stephan at rename-it.nl Fri Aug 3 12:28:36 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 03 Aug 2012 11:28:36 +0200 Subject: [Dovecot] managesieve segfault with gold linker In-Reply-To: <5016A0A3.1020201@caf.com.tr> References: <4FFF3326.9060802@caf.com.tr> <4FFFF01A.9020402@rename-it.nl> <500024B8.2020500@caf.com.tr> <5016A0A3.1020201@caf.com.tr> Message-ID: <501B99C4.2070909@rename-it.nl> On 7/30/2012 4:56 PM, Eray Aslan wrote: > On 07/13/2012 04:38 PM, Eray Aslan wrote: >> I'll try to find out more but I will be on vacation for a few days >> so it might not be quick. > Recap: > When linked with gold, pigeonhole-0.3.1 make check fails with: > dovecot-2.1-pigeonhole-0.3.1/src/testsuite/.libs/lt-testsuite: > symbol lookup error: > dovecot-2.1-pigeonhole-0.3.1/src/lib-sieve/.libs/libdovecot-sieve.so.0: > undefined symbol: mail_deliver_get_log_var_expand_table > > Well, /usr/lib64/dovecot/libdovecot-lda.so provides the > mail_deliver_get_log_var_expand_table symbol, but > /usr/lib64/dovecot/libdovecot-sieve.so doesn't link against it. The > following patch works for me: I applied this patch a while back, but I forgot to mail about it after I tested it. It works also for the normal linker, so I guess it is ok. I cannot produce a URL for the commit right now, because the hg server is down for some unexpected maintenance. Regards, Stephan. From lazy404 at gmail.com Fri Aug 3 12:33:27 2012 From: lazy404 at gmail.com (Lazy) Date: Fri, 3 Aug 2012 11:33:27 +0200 Subject: [Dovecot] dovecot-lda setting quota rules In-Reply-To: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> References: <7E9B1F89-F371-4F3F-BD95-AB62055ED76F@iki.fi> Message-ID: it works great. thank You again Regards, Michal Grzedzicki 2012/8/3, Timo Sirainen : > On 3.8.2012, at 2.13, Lazy wrote: > >>> dovecot-lda -o plugin/quota_rule=*:storage=1G >>> >> >> thank You ! >> >> This is simple and elegant. >> >> Sill I need this to be taken from environment, I produced a simple >> patch adding one '-o' from an environment variable. > > You can also set environment: > > PLUGIN/QUOTA_RULE=*:storage=1G > > and then use dovecot-lda -k parameter. > > And if even that doesn't work, you could simply create a wrapper script. > >> If You consider this useful I can try and make it more generic, enable >> multiple option overriding. > > You can also give -o parameter multiple times. > From dgp-dove at corefiling.co.uk Fri Aug 3 14:30:34 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Fri, 03 Aug 2012 12:30:34 +0100 Subject: [Dovecot] Pigeonhole sieve include namespace regression Message-ID: <501BB65A.2090601@corefiling.co.uk> Hi, We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. We provide a selection of global sieve scripts to make users' lives easier and one noticed that some of these have stopped working. I tracked it down to them having personal scripts with the same name. Using a really simple sieve script: require "include"; include :personal "svn"; include :global "svn"; sievec debug output for sieve 0.1.18 (trimmed a bit): * Required extensions: 0: include (16) 1: fileinto (5) * Included personal script 'svn' (block: 3): [script code here] * Included global script 'svn' (block: 4): [script code here] * Main program (block: 1): 00000000: EXTENSIONS [1]: 00000001: include 00000002: INCLUDE: 00000004: script: svn.sieve [ID: 1, BLOCK: 3] 00000006: INCLUDE: 00000008: script: svn.sieve [ID: 2, BLOCK: 4] 0000000a: [End of code] sievec debug output for Pigeonhole 0.3.1: * Required extensions (block: 1): 0: include (id: 16; block: 4) 1: fileinto (id: 5) * Included personal script 'svn' (block: 5): [script code here] * Main program (block: 2): Address Line Code 00000000: DEBUG BLOCK: 3 00000001: EXTENSIONS [1]: 00000002: include 00000003: 2: INCLUDE: 00000005: script: `svn' from /home/notroot/sieve/svn.sieve [ID: 1, BLOCK: 5] 00000007: 3: INCLUDE: 00000009: script: `svn' from /home/notroot/sieve/svn.sieve [ID: 1, BLOCK: 5] 0000000b: 3: [End of code] As can be seen the personal script is included twice. Obvious work around is to rename the personal script. However it'd be nice if namespacing came back. Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From sandro.tosi at dada.eu Fri Aug 3 15:03:28 2012 From: sandro.tosi at dada.eu (Sandro Tosi) Date: Fri, 03 Aug 2012 14:03:28 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages Message-ID: <501BBE10.5040209@dada.eu> Hello, we're setting up a weird platform where every incoming email is passed from the MTA directly to a tool that then uses dovecot LMTP to deliver the message into the user mailbox. We are legally *not* allowed to run antispam on all the incoming messages, but only on some of them, as they are recognized by the aforementioned tool; but given that tool directly uses LMTP to delivers the mail we need to find a way to parse the messages passing thru LMTP and run spamassassin only on those matching some regex on subject and mail body. Is is possible to do that with some dovecot LMTP feature? i've read a lot of documentation about how to possibly implement it and it *seems* there would be a way using pigeonhole sieve and extprograms - what do you think? The idea I have in mind is something like: 1. identify the mails we want to scan with spamassassin (using regex or whatever else to precisely pin-point them) 2. run SA on those 3. in case it's spam, rewrite the subject (or similar) Do you think it's something doable with dovecot? Thanks in advance, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi at register.it From h.reindl at thelounge.net Fri Aug 3 15:09:44 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Aug 2012 14:09:44 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBE10.5040209@dada.eu> References: <501BBE10.5040209@dada.eu> Message-ID: <501BBF88.7080403@thelounge.net> Am 03.08.2012 14:03, schrieb Sandro Tosi: > We are legally *not* allowed to run antispam on all the incoming messages you ARE allowed if you are doing it right right in this context means you have to run the filter pre-queue and REJECT blocked messages, so the sending server knows that you did NOT accept the message and can send a bounce to his user wrong in this context means you accept the message, filter it after that and throw it away while the sender has a confirmed delivery - this is a legal problem in the first front and technically wrong because you risk to become a backscatter by starting active bounes on your server if you are not 100% sure how all the pieces work togehter and how the whole system acts in each situation bringing LMTP and Dovecot in the context of spam-filtering is automatically doing it completly wrong -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From sandro.tosi at dada.eu Fri Aug 3 15:17:57 2012 From: sandro.tosi at dada.eu (Sandro Tosi) Date: Fri, 03 Aug 2012 14:17:57 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBF88.7080403@thelounge.net> References: <501BBE10.5040209@dada.eu> <501BBF88.7080403@thelounge.net> Message-ID: <501BC175.9050005@dada.eu> Hello, thanks for you reply. On 08/03/2012 02:09 PM, Reindl Harald wrote: > > > Am 03.08.2012 14:03, schrieb Sandro Tosi: >> We are legally *not* allowed to run antispam on all the incoming messages > > you ARE allowed if you are doing it right please.. don't consider everyone that writes a junior with no experience, I know what i'm doing :) In a classic mail setup, i'd have done as you described, but the introduction of my email makes it clear this is a particular situation. as I said, we *cannot* do it the "standard way"! we are forced to accept messages if they come in a particular format (yes even spam ones), and we can only run SA on a subset if the incoming mails, as decided by the tool we're passing all the messages to. Now, getting back on topic, is it possible to do what I have in mind? is there some other solutions to achieve my goal? Regards, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi at register.it From robert at schetterer.org Fri Aug 3 15:45:33 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 14:45:33 +0200 Subject: [Dovecot] Antispam only when LMTP delivers some specific messages In-Reply-To: <501BBE10.5040209@dada.eu> References: <501BBE10.5040209@dada.eu> Message-ID: <501BC7ED.1090003@schetterer.org> Am 03.08.2012 14:03, schrieb Sandro Tosi: > Hello, > we're setting up a weird platform where every incoming email is passed > from the MTA directly to a tool that then uses dovecot LMTP to deliver > the message into the user mailbox. > > We are legally *not* allowed to run antispam on all the incoming > messages, but only on some of them, as they are recognized by the > aforementioned tool; but given that tool directly uses LMTP to delivers > the mail we need to find a way to parse the messages passing thru LMTP > and run spamassassin only on those matching some regex on subject and > mail body. > > Is is possible to do that with some dovecot LMTP feature? > > i've read a lot of documentation about how to possibly implement it and > it *seems* there would be a way using pigeonhole sieve and extprograms - > what do you think? > > The idea I have in mind is something like: > > 1. identify the mails we want to scan with spamassassin (using regex or > whatever else to precisely pin-point them) > 2. run SA on those > 3. in case it's spam, rewrite the subject (or similar) > > Do you think it's something doable with dovecot? > > Thanks in advance, you may use global sieve rules perhaps look here for ideas http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples#Spam.2BAC8-Virus_rules -- Best Regards MfG Robert Schetterer From voytek at sbt.net.au Fri Aug 3 16:09:47 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:09:47 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <4FFC1340.6060607@schetterer.org> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: On Tue, July 10, 2012 9:34 pm, Robert Schetterer wrote: > perhaps use daily cron with something like this > > doveadm expunge -A mailbox Junk savedbefore 7d; where am I going wrong ? nothing gets removed: # pwd /var/mail/vhosts/sbt.net.au/spam at sbt.net.au/.spam/cur # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7day # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 5d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 4d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 3d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 2d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1d # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1w # ls | wc 532 532 30884 # doveadm expunge -u spam at sbt.net.au mailbox .spam savedbefore 1w # ls | wc 532 532 30884 ------------- ls -al -rw------- 1 vmail vmail 5921 Jul 9 21:55 1341834948.M445074P17475.geko.sbt.net.au,S=5921,W=6003:2, -rw------- 1 vmail vmail 3021 Jul 9 22:06 1341835577.M701903P17756.geko.sbt.net.au,S=3021,W=3125:2, .... -- Voytek From robert at schetterer.org Fri Aug 3 16:14:05 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 15:14:05 +0200 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: <501BCE9D.5050303@schetterer.org> Am 03.08.2012 15:09, schrieb Voytek Eymont: > > On Tue, July 10, 2012 9:34 pm, Robert Schetterer wrote: > >> perhaps use daily cron with something like this >> >> doveadm expunge -A mailbox Junk savedbefore 7d; > > where am I going wrong ? > > nothing gets removed: > > # pwd > /var/mail/vhosts/sbt.net.au/spam at sbt.net.au/.spam/cur > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7day > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 7d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 5d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 4d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 3d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 2d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1d > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox spam savedbefore 1w > # ls | wc > 532 532 30884 > # doveadm expunge -u spam at sbt.net.au mailbox .spam savedbefore 1w > # ls | wc > 532 532 30884 > > ------------- > ls -al > -rw------- 1 vmail vmail 5921 Jul 9 21:55 > 1341834948.M445074P17475.geko.sbt.net.au,S=5921,W=6003:2, > -rw------- 1 vmail vmail 3021 Jul 9 22:06 > 1341835577.M701903P17756.geko.sbt.net.au,S=3021,W=3125:2, > .... > do you use expire plugin ? http://wiki2.dovecot.org/Plugins/Expire -- Best Regards MfG Robert Schetterer From voytek at sbt.net.au Fri Aug 3 16:24:49 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:24:49 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <501BCE9D.5050303@schetterer.org> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <501BCE9D.5050303@schetterer.org> Message-ID: <6cb5d27e683ddfa9532a8dc0d79aa301.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:14 pm, Robert Schetterer wrote: > do you use expire plugin ? > > http://wiki2.dovecot.org/Plugins/Expire no... I saw this part: "Note that: This command runs fine even without expire plugin loaded." and assumed I didn't have to.... OK, back to drawing board, thanks for your help -- Voytek Eymont From voytek at sbt.net.au Fri Aug 3 16:32:37 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:32:37 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? Message-ID: looking through logs I noticed this today: grep mysql /var/log/maillog | grep fail Aug 3 17:35:25 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:35:57 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:02 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:23 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:40 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:36:50 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:40:04 dovecot: auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:04 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:19 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Aug 3 17:41:38 dovecot: auth-worker(29721): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist looking at mysqld.log, all i see is: 120721 17:58:44 InnoDB: Shutdown completed; log sequence number 0 76814 120721 17:58:44 [Note] /usr/libexec/mysqld: Shutdown complete 120721 17:58:44 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended 120721 17:59:53 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 120721 17:59:54 InnoDB: Initializing buffer pool, size = 8.0M 120721 17:59:54 InnoDB: Completed initialization of buffer pool 120721 17:59:54 InnoDB: Started; log sequence number 0 76814 120721 17:59:54 [Note] Event Scheduler: Loaded 0 events 120721 17:59:54 [Note] /usr/libexec/mysqld: ready for connections. Version: '5.1.61' socket: '/var/lib/mysql/mysql.sock' port: 3306 Source distribution no failure were noticed or reported, except for log items any thoughts ? I might have been importing (phpmyadmin) some 3 or 4 databases around that time, surely that wouldn't cause such issue ? -- Voytek Eymont From h.reindl at thelounge.net Fri Aug 3 16:36:19 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 03 Aug 2012 15:36:19 +0200 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: References: Message-ID: <501BD3D3.7010208@thelounge.net> Am 03.08.2012 15:32, schrieb Voytek Eymont: > grep mysql /var/log/maillog | grep fail > Aug 3 17:35:25 dovecot: auth-worker(28335): Error: mysql: Query failed, > retrying: Table 'postfix.users' doesn't exist states clearly that a table is missing > looking at mysqld.log, all i see is: > no failure were noticed or reported, except for log items > > any thoughts ? why should mysqld report a error if a nonsystem table is mising > I might have been importing (phpmyadmin) some 3 or 4 databases around that > time, surely that wouldn't cause such issue ? what about connect directly to mysqld and look if the table exists and review your import dump-files if they did drop tables? however, this is not a dovecot issue -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From tss at iki.fi Fri Aug 3 16:42:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:42:38 +0300 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: On 3.8.2012, at 16.09, Voytek Eymont wrote: >> doveadm expunge -A mailbox Junk savedbefore 7d; > > where am I going wrong ? > > nothing gets removed: Find out what Dovecot thinks the save dates are: doveadm fetch -u user at domain date.saved mailbox spam I'm pretty sure the problem is simply that the saved date isn't what you expect it to be. With maildir it's initially taken from the file's ctime and added to cache. From voytek at sbt.net.au Fri Aug 3 16:47:55 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 3 Aug 2012 23:47:55 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> Message-ID: <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:42 pm, Timo Sirainen wrote: > On 3.8.2012, at 16.09, Voytek Eymont wrote: > >>> doveadm expunge -A mailbox Junk savedbefore 7d; >> where am I going wrong ? >> nothing gets removed: > Find out what Dovecot thinks the save dates are: > doveadm fetch -u user at domain date.saved mailbox spam Timo, thanks I see... date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 date.saved: 2012-08-03 22:44:09 > I'm pretty sure the problem is simply that the saved date isn't what you > expect it to be. With maildir it's initially taken from the file's ctime > and added to cache. so... what do I need ? -- Voytek Eymont From tss at iki.fi Fri Aug 3 16:51:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:51:49 +0300 Subject: [Dovecot] ACL with MySQL dict => full table scans (was: v2.1.9 released) In-Reply-To: <20120802084257.GB23882@sys-241.netcologne.de> References: <1343843919.18782.22.camel@innu> <20120802084257.GB23882@sys-241.netcologne.de> Message-ID: <1F8B6836-9873-4BA8-A2FF-C9EDCE306895@iki.fi> On 2.8.2012, at 11.42, Roland Rosenfeld wrote: > On Wed, 01 Aug 2012, Timo Sirainen wrote: > >> I've again mostly finished reading and answering most of the mails in >> Dovecot mailing list. There are a couple annoyingly difficult / time >> consuming bugreport mails that I haven't replied to yet, but if anyone >> thinks I should have replied to something already feel free to resend >> the mail. > > I'm not sure where my request was annoying or difficult, but I didn't > read an answer to it ;-) > http://www.dovecot.org/list/dovecot/2012-July/067130.html Yes, it was one of the "annoying" mails. :) The problem is this I think: http://hg.dovecot.org/dovecot-2.1/file/476381017ec7/src/plugins/acl/acl-backend-vfile-acllist.c#l296 I think it does the rebuild simply because the rebuild code was needed to be written anyway, and doing anything else requires adding more code to handle only the specific necessary additions/removals. A nice side effect of this rebuild is also that it makes sure that the dict is fully up to date even if you had manually changed the dovecot-acl files. But I guess a better solution for that would be a "doveadm acl rebuild" command. So .. yes, this definitely should be fixed, but it's not really a high priority right now.. From tss at iki.fi Fri Aug 3 16:53:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:53:38 +0300 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> Message-ID: On 3.8.2012, at 16.47, Voytek Eymont wrote: >> Find out what Dovecot thinks the save dates are: >> doveadm fetch -u user at domain date.saved mailbox spam > > Timo, thanks > > I see... > > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > date.saved: 2012-08-03 22:44:09 > >> I'm pretty sure the problem is simply that the saved date isn't what you >> expect it to be. With maildir it's initially taken from the file's ctime >> and added to cache. > > so... what do I need ? Are those dates changed all the time? The problem should get fixed eventually by itself, unless something else weird is going on. From tss at iki.fi Fri Aug 3 16:56:42 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:56:42 +0300 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: <501A27A4.7000303@schetterer.org> References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> <501A27A4.7000303@schetterer.org> Message-ID: On 2.8.2012, at 10.09, Robert Schetterer wrote: > Hi Timo, most of the Problems are fixed now > many thx for your script > > , but how to avoid that in future ( Maildir filename has wrong S value ) You'd need to find out why it started happening in the first place. What software wrote those filenames? Are new filenames still creating with wrong S value? Does your dovecot.conf use zlib plugin globally (instead of only in some protocol sections, which might cause this kind of trouble)? > you released a patch > > diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c > --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 > +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 > @@ -20,6 +20,7 @@ > struct mail *mail = mstream->mail; > enum mail_lookup_abort orig_lookup_abort; > > + return FALSE; > if (mstream->expected_size != (uoff_t)-1) > return TRUE; > > would it be a good idea to include it in 2.1.9 for me ? > as it looks like its not in the public code ? It's an ugly workaround for the wrong S=size problem when zlib is used. Preferably you wouldn't ever need to use it. From tss at iki.fi Fri Aug 3 16:59:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 16:59:58 +0300 Subject: [Dovecot] Overriding inbox= in userdb extra fields In-Reply-To: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> References: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Message-ID: On 2.8.2012, at 19.10, Bret Martin wrote: > I'm trying to set up an alternate user with a different inbox using passwd-file and userdb extra fields and the extra field settings don't seem to be taking effect. I've used auth_debug and mail_debug and I'm unclear how I can further troubleshoot this. > > Is it possible to have inbox=yes in one namespace globally and then override this for one user by setting inbox=no for that namespace and then inbox=yes for another? Yes. > My doveconf -n is below. I would like to have inbox=yes for the inbox namespace, inbox=no for the virtual namespace, and then be able to invert these for selected users using userdb extra fields. My attempt at doing this so far looks like > > bam-ios:[REDACTED]:500:500::/home/bam::user=bam namespace/inbox/inbox=no namespace/virtual/inbox=yes Problem 1: The userdb fields need to be prefixed in passwd-file with "userdb_" prefix, so "userdb_namespace/inbox/inbox=no". Problem 2: You change the username from bam-ios to bam, which results in: > Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user > Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup So the userdb fields aren't looked up from passwd-file anyway. From voytek at sbt.net.au Fri Aug 3 17:08:18 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 00:08:18 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <501BD3D3.7010208@thelounge.net> References: <501BD3D3.7010208@thelounge.net> Message-ID: <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:36 pm, Reindl Harald wrote: > states clearly that a table is missing > what about connect directly to mysqld and look if the table exists and > review your import dump-files if they did drop tables? auth-worker(28335): Error: mysql: Query failed, retrying: Table 'postfix.users' doesn't exist Reindl , thanks oops, I clearly mis-interpreted what happened... looking at mysql tables, I don't have such table, and, it seems I'm not using it in my sql: grep users dovecot-sql.conf grep users dovecot* conf.d]# grep users auth-sql* auth-sql.conf:# Authentication for SQL users. Included from auth.conf. auth-sql.conf.ext:# Authentication for SQL users. Included from auth.conf. conf.d]# grep users 10-auth.conf # If you want to allow master users to log in by specifying the master # Username to use for users logging in with ANONYMOUS SASL mechanism # allow both system users (/etc/passwd) and virtual users to login without # duplicating the system users into virtual database. where could that be called from ? -- Voytek Eymont From tss at iki.fi Fri Aug 3 17:10:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:10:14 +0300 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <501B7490.1020108@zu-con.org> References: <501B7490.1020108@zu-con.org> Message-ID: <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> On 3.8.2012, at 9.49, Matthias Rieber wrote: > I've deleted 10000s emails and it seems that every mail is removed with > a single request from Solrs index. This works, but it's quite slow. Is > it possible/plans to improve that? Could you try if the attached patch works? It compiles, but didn't test it. -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 2727 bytes Desc: not available URL: -------------- next part -------------- From tss at iki.fi Fri Aug 3 17:12:35 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:12:35 +0300 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> Message-ID: <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> On 3.8.2012, at 17.08, Voytek Eymont wrote: >> states clearly that a table is missing >> what about connect directly to mysqld and look if the table exists and >> review your import dump-files if they did drop tables? > > auth-worker(28335): Error: mysql: Query failed, retrying: Table > 'postfix.users' doesn't exist > > Reindl , thanks > > oops, I clearly mis-interpreted what happened... > looking at mysql tables, I don't have such table, and, it seems I'm not > using it in my sql: .. > where could that be called from ? From the default passdb/userdb sql settings. You haven't set one of password_query, user_query or iterate_query and it's trying to use the default which doesn't of course work with your database. From bam at miranda.org Fri Aug 3 17:13:15 2012 From: bam at miranda.org (Bret Martin) Date: Fri, 3 Aug 2012 10:13:15 -0400 Subject: [Dovecot] Overriding inbox= in userdb extra fields In-Reply-To: References: <216A2D9E-8709-4250-9E03-B8730D884235@miranda.org> Message-ID: <696C86DB-367F-4F93-AA1C-B231D5730A8A@miranda.org> On Aug 3, 2012, at 9:59 AM, Timo Sirainen wrote: [...] > Problem 1: The userdb fields need to be prefixed in passwd-file with "userdb_" prefix, so "userdb_namespace/inbox/inbox=no". Aha! This is what I was missing. The documentation on userdb extra fields even says this, but I missed it even on multiple readings. > Problem 2: You change the username from bam-ios to bam, which results in: > >> Aug 2 11:37:29 new-miranda dovecot: auth: passwd-file(bam,64.119.157.114,): unknown user >> Aug 2 11:37:29 new-miranda dovecot: auth: Debug: passwd(bam,64.119.157.114,): lookup > > So the userdb fields aren't looked up from passwd-file anyway. I discovered this as well after sending my mail. My goal in changing the username was to point at bam's mail storage without having a symlink or something like that. But I solved this instead by adding more userdb extra fields to override namespace/{inbox,mdbox,virtual}/location. Thanks so much! I've now got exactly what I want: a full view of my many folders from desktop IMAP clients, and a collapsed hierarchy using virtual folders for mobile IMAP clients where navigating a huge folder tree can be cumbersome. --Bret From tss at iki.fi Fri Aug 3 17:14:55 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:14:55 +0300 Subject: [Dovecot] virtual folder - crash while searching In-Reply-To: <5019905F.3010102@zu-con.org> References: <5018C827.80406@zu-con.org> <2AF993EE-5501-40CC-A23C-8C0B4411D4B3@iki.fi> <501981CB.3030709@zu-con.org> <182345D6-4CE3-4FBF-8E5D-5D8A5C5C826C@iki.fi> <50198C31.5070902@zu-con.org> <6ED90634-A3FC-46F2-BA72-393B1E9ECD27@iki.fi> <5019905F.3010102@zu-con.org> Message-ID: <381E6606-D4BA-4F8C-8A78-3B78CAA031BA@iki.fi> On 1.8.2012, at 23.23, Matthias Rieber wrote: > alright. Some resources say that "413 FULL head" means request too large. Maybe that's caused by the pretty big folder virtual.all which contains more than 360000 mails. Probably it means that the virtual folder consists of too many real folders. Dovecot's Solr query adds each real folder's GUID to the query. I guess there should be some limit and it would have to send more than one query and merge the results. From tss at iki.fi Fri Aug 3 17:40:27 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 3 Aug 2012 17:40:27 +0300 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> Message-ID: <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> On 3.8.2012, at 10.04, Nikolai Schupbach wrote: > There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. What should happen is: 1. pop3c connects to server 2. issues LIST and UIDL commands 3. IMAP server issues fetch 1:* RFC822.SIZE (or I guess it does this with a ton of separate commands) 4. pop3c attempts to do some TOP commands. > When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): > > dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly > dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected It looks like the 3 step takes a long time. Do you have imapc_features=rfc822.size? Also setting mail_prefetch_count to something between 10..100 should help a lot. And this should also fix it by moving 3 step to 1: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d > Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. Yes, looks like dsync simply continues without assigning POP3 UIDL. Hmm. Perhaps it shouldn't do that on temporary failures.. > Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, This isn't easily possible. > or it should simply reconnect if sees the connection is lost. It should probably do that, yes. From robert at schetterer.org Fri Aug 3 20:17:46 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 03 Aug 2012 19:17:46 +0200 Subject: [Dovecot] zlib plugin maildir broken ?/ Cached message size smaller than expected / with 2.1.9 patch ? In-Reply-To: References: <50184E50.7030907@schetterer.org> <5018C078.9090503@schetterer.org> <501910B3.2030306@schetterer.org> <1343822767.19913.81.camel@hurina> <50191D38.4010908@schetterer.org> <843F2338-D0AF-499D-818C-1AE1871AECB2@iki.fi> <5019201C.3000106@schetterer.org> <50192465.7080805@schetterer.org> <3E87C74F-F79B-4BC1-BE28-B7D08BE119DC@iki.fi> <501A27A4.7000303@schetterer.org> Message-ID: <501C07BA.80004@schetterer.org> Am 03.08.2012 15:56, schrieb Timo Sirainen: > On 2.8.2012, at 10.09, Robert Schetterer wrote: > >> Hi Timo, most of the Problems are fixed now >> many thx for your script >> >> , but how to avoid that in future ( Maildir filename has wrong S value ) > > You'd need to find out why it started happening in the first place. the problem is/was getting maildirs fixed, no time to debug on production system in deed i have no idea why this happend, i found out some broken were old maildirs, so for them i bet coruption by migration 2.0 -2.1 other cuted out attachments imap online with serveral clients on = user fault in my meaning left the cases which i reproduced myself, or some brand new mailboxes it was about compressed mail and nocompressed with wrong message size in one folder What software wrote those filenames? Are new filenames still creating with wrong S value? Does your dovecot.conf use zlib plugin globally (instead of only in some protocol sections, which might cause this kind of trouble)? 10-mail.conf:mail_plugins = $mail_plugins zlib expire virtual fts fts_lucene mail_log autocreate notify acl listescape 20-imap.conf: mail_plugins = imap_acl acl fts fts_lucene mail_log autocreate notify expire virtual quota imap_quota zlib imap_zlib listescape 90-plugin.conf:zlib_save_level = 6 90-plugin.conf:zlib_save = gz should be ok ? > >> you released a patch >> >> diff -r 3599790da3d7 src/lib-storage/index/istream-mail.c >> --- a/src/lib-storage/index/istream-mail.c Wed Mar 21 14:25:12 2012 +0200 >> +++ b/src/lib-storage/index/istream-mail.c Wed Mar 21 17:58:00 2012 +0200 >> @@ -20,6 +20,7 @@ >> struct mail *mail = mstream->mail; >> enum mail_lookup_abort orig_lookup_abort; >> >> + return FALSE; >> if (mstream->expected_size != (uoff_t)-1) >> return TRUE; >> >> would it be a good idea to include it in 2.1.9 for me ? >> as it looks like its not in the public code ? > > It's an ugly workaround for the wrong S=size problem when zlib is used. Preferably you wouldn't ever need to use it. ok , i fixed all mailboxes with your script and one from ralf with compressed maildirs, updated to 2.1.9, using lucene now, disabled stats ( for kernel bugs ), and for now all problems are gone if i cant find any better reason, i go for shit happens, and learned how to fix it, however it were only 6 maildirs from 200 which got broken going trough lot of updates in years , so this is ok in my mind good time for users learn to build some mail archive from time to time however no mail got lost > -- Best Regards MfG Robert Schetterer From stephan at rename-it.nl Fri Aug 3 21:02:28 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Fri, 03 Aug 2012 20:02:28 +0200 Subject: [Dovecot] Pigeonhole sieve include namespace regression In-Reply-To: <501BB65A.2090601@corefiling.co.uk> References: <501BB65A.2090601@corefiling.co.uk> Message-ID: <501C1234.20504@rename-it.nl> On 8/3/2012 1:30 PM, Daniel Piddock wrote: > Hi, > > We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian > Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. > > We provide a selection of global sieve scripts to make users' lives > easier and one noticed that some of these have stopped working. I > tracked it down to them having personal scripts with the same name. > > Using a really simple sieve script: Nice bug report. > As can be seen the personal script is included twice. Obvious work > around is to rename the personal script. However it'd be nice if > namespacing came back. This should fix it: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/6a34eda7924e I also extended the test suite to prevent this situation from occurring again, for file-based scripts anyway. Regards, Stephan. From voytek at sbt.net.au Sat Aug 4 01:33:55 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 08:33:55 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> Message-ID: <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> On Fri, August 3, 2012 11:53 pm, Timo Sirainen wrote: > On 3.8.2012, at 16.47, Voytek Eymont wrote: >>> Find out what Dovecot thinks the save dates are: >>> doveadm fetch -u user at domain date.saved mailbox spam >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> date.saved: 2012-08-03 22:44:09 >> >>> I'm pretty sure the problem is simply that the saved date isn't what >>> you expect it to be. With maildir it's initially taken from the file's >>> ctime and added to cache. >> >> so... what do I need ? > > Are those dates changed all the time? The problem should get fixed > eventually by itself, unless something else weird is going on. thanks. don't know, looking this morning it shows like below, the 00:05:05 is probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to see what gets removed from 'spam' box, before and after each attempt to expunge : date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 00:05:05 date.saved: 2012-08-03 06:45:33 date.saved: 2012-08-03 06:45:33 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 17:42:26 date.saved: 2012-08-03 18:37:25 date.saved: 2012-08-03 18:55:34 date.saved: 2012-08-03 19:51:02 date.saved: 2012-08-04 02:45:21 date.saved: 2012-08-04 06:33:16 -- Voytek From voytek at sbt.net.au Sat Aug 4 01:55:01 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sat, 4 Aug 2012 08:55:01 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> Message-ID: <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> >> where could that be called from ? > > From the default passdb/userdb sql settings. You haven't set one of > password_query, user_query or iterate_query and it's trying to use the > default which doesn't of course work with your database. thanks cd /etc/dovecot grep password_query * dovecot-sql.conf:password_query = SELECT username as user, password, '/var/mail/vhosts/%d/%n@%d' as userdb_home, **TRIM** # grep user_query * dovecot-sql.conf:user_query = SELECT concat('/var/mail/vhosts/', maildir) as home, concat('maildir:/var/mail/vhosts/', maildir) as mail, **TRIM** dovecot-sql.conf:user_query = SELECT '/var/mail/vhosts/%d/%n@%d' as home, 'maildir:/var/mail/vhosts/%d/%n@%d' as mail, **TRIM** OOPS, I seem to have duplicate user_query with my two 'user_query', it's the last one in the file that wins, yes ? so, I should remove the 1st one # grep iterate_query * # none. so, I need some 'iterate_query' inserted in my dovecot-sql.conf ? -- Voytek From ml-dovecot at zu-con.org Sat Aug 4 10:11:24 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Sat, 04 Aug 2012 09:11:24 +0200 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> Message-ID: <501CCB1C.80908@zu-con.org> Hello, Am 03.08.2012 16:10, schrieb Timo Sirainen: > On 3.8.2012, at 9.49, Matthias Rieber wrote: > >> I've deleted 10000s emails and it seems that every mail is removed with >> a single request from Solrs index. This works, but it's quite slow. Is >> it possible/plans to improve that? > > Could you try if the attached patch works? It compiles, but didn't test it. it segfaults: Aug 4 08:55:58 smtp dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for matthias Aug 4 08:55:58 smtp dovecot: indexer-worker(matthias): Fatal: master: service(indexer-worker): child 32503 killed with signal 11 (core not dumped) But I didn't managed to get a core dump. I start dovecot with ulimit -c unlimited and I also set /proc/sys/kernel/core_pattern to world writeable directory. Matthias From teopro at gmail.com Sat Aug 4 16:05:12 2012 From: teopro at gmail.com (Gmail-teopro) Date: Sat, 4 Aug 2012 16:05:12 +0300 Subject: [Dovecot] disable auth-worker logging Message-ID: <1809306900.20120804160512@gmail.com> Hello all, Can someone please give me a hint about how can I disable such messages to be inserted into log file(maillog this case as syslog_facility = mail)? >> dovecot: auth-worker(13377): mysql(localhost): Connected to database postfix All the '_debug' and '_verbose' statements bear the 'no' value. Thank you. -- Best regards, Gmail-teopro mailto:teopro at gmail.com From matthew at atom.net Sat Aug 4 16:30:03 2012 From: matthew at atom.net (Matthew Powell) Date: Sat, 4 Aug 2012 09:30:03 -0400 Subject: [Dovecot] authenticate plain and utf-8 with special chars In-Reply-To: <1343727740.3072.28.camel@hermann.potsdam.securepoint.local> References: <1343727740.3072.28.camel@hermann.potsdam.securepoint.local> Message-ID: <9424CEA0-4105-44BA-80D1-FA28E6950581@atom.net> On 2012-07-31, at 5.42, Matthias Lay wrote: > seems like the mail clients like thunderbird send their base64 string in > ISO- encoding, which doesnt work on my dovecot setup if there are some > Umlauts > > I am not able to login as > "?mer" for example > > If I authenticate from telnet with an base64 encoded utf-8 string like > 'echo -en "\0?mer\0Start12" |base64' > everything works fine This looks like a Thunderbird bug. SASL PLAIN uses UTF-8, not ISO-8859; see RFC 4616. Thunderbird's bug #312593 relates to password handling, but it sounds like there's a similar issue affecting usernames. See https://bugzilla.mozilla.org/show_bug.cgi?id=312593. It might be worth adding a comment there. -- Matthew Powell matthew at atom.net From e-frog at gmx.de Sat Aug 4 16:45:51 2012 From: e-frog at gmx.de (e-frog) Date: Sat, 04 Aug 2012 15:45:51 +0200 Subject: [Dovecot] disable auth-worker logging In-Reply-To: <1809306900.20120804160512@gmail.com> References: <1809306900.20120804160512@gmail.com> Message-ID: <501D278F.2020606@gmx.de> On 04.08.2012 15:05, wrote Gmail-teopro: > Hello all, > > Can someone please give me a hint about how can I disable such messages to > be inserted into log file(maillog this case as syslog_facility = mail)? > >>> dovecot: auth-worker(13377): mysql(localhost): Connected to database postfix > > All the '_debug' and '_verbose' statements bear the 'no' value. > > Thank you. > Hello, I don't think this message can be disabled in dovecot. You can however configure your syslog daemon to ignore the message. The following works for me using rsyslog: $: cat /etc/rsyslog.d/40-dovecot.conf :msg, contains, "mysql(localhost): Connected to database" ~ -- e-frog From daniel.parthey at informatik.tu-chemnitz.de Sun Aug 5 04:08:41 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sun, 5 Aug 2012 03:08:41 +0200 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> Message-ID: <20120805010841.GA13639@daniel.localdomain> Voytek Eymont wrote: > I need some 'iterate_query' inserted in my dovecot-sql.conf ? You only need it if you need to run some doveadm -A command over all users. Regards Daniel -- https://plus.google.com/103021802792276734820 From voytek at sbt.net.au Sun Aug 5 04:21:41 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Sun, 5 Aug 2012 11:21:41 +1000 Subject: [Dovecot] ot: mysql auth worker failure ? In-Reply-To: <20120805010841.GA13639@daniel.localdomain> References: <501BD3D3.7010208@thelounge.net> <436033e76c191fae7dc8aea86c2d94a6.squirrel@geko.sbt.net.au> <522A5DED-D6D0-4532-8CC0-77BBF7D80A3C@iki.fi> <8ade5ba6d19686c1f27ba4e9ee9b87d0.squirrel@geko.sbt.net.au> <20120805010841.GA13639@daniel.localdomain> Message-ID: <20d4d5457e4f22ef3d71210867e962ed.squirrel@geko.sbt.net.au> On Sun, August 5, 2012 11:08 am, Daniel Parthey wrote: > Voytek Eymont wrote: >> I need some 'iterate_query' inserted in my dovecot-sql.conf ? > You only need it if you need to run some doveadm -A command > over all users. Daniel, thanks for explanation, so I got these when I tried my expunge, I was trying also all 'local' users I only have virtual users in mysql, there is no *nix users on this system, so, if I had a properly constructed 'iterate_query' I could use that '-A' option to go against all mysql virtual users, and, not try and fail on '/home/whatevr' as valid users ? -- Voytek From peter at snowweb.co.uk Sun Aug 5 08:22:23 2012 From: peter at snowweb.co.uk (Peter Snow) Date: Sun, 05 Aug 2012 13:22:23 +0800 Subject: [Dovecot] Just trying to make dovecot work. Message-ID: <501E030F.5090209@snowweb.co.uk> Hi, I have to say that Dovecot is certainly the most challenging piece of software I've ever had the pleasure of setting up (due mainly to the reams of largely unhelpful documentation). After 36 almost non-stop hours reading and trying, I finally end up here. :-) I really would appreciate your help - and many thanks in advance! *************************************************************** /var/log/dovecot.info.log (showing unsuccessful login) *************************************************************** Aug 04 21:32:36 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 04 21:32:36 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 04 21:32:36 auth: Debug: passwd-file /usr/local/etc/dovecot.passdb: Read 1 users Aug 04 21:32:36 auth: Debug: auth client connected (pid=24769) Aug 04 21:32:41 auth: Debug: client in: AUTH 1 PLAIN service=imap securedlip=::1 rip=::1 lport=143 rport=52551 resp=AHBldGVyAGZ1YXNpbjU0MTRz Aug 04 21:32:41 auth: Debug: passwd-file(peter,::1): lookup: user=peter file=/usr/local/etc/dovecot.passdb Aug 04 21:32:41 auth: Debug: client out: OK 1 user=peter Aug 04 21:32:41 auth: Debug: master in: REQUEST 1417805825 24769 1 44a3aec60ec6eaec6eff0efb99971eee Aug 04 21:32:41 auth: Debug: master out: USER 1417805825 peter Aug 04 21:32:41 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=24772, secured *************************************************************** END *************************************************************** *************************************************************** /var/log/dovecot.log (showing unsuccessful login) *************************************************************** Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop privileges: User is missing UID (see mail_uid setting) Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to server log for more information. *************************************************************** END *************************************************************** *************************************************************** dovecot -n *************************************************************** # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) ext4 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes disable_plaintext_auth = no first_valid_uid = 1000 info_log_path = /var/log/dovecot.info.log last_valid_uid = 5000 log_path = /var/log/dovecot.log login_trusted_networks = 127.0.0.1 mail_debug = yes mail_location = maildir:/var/mail/%u/Maildir mail_log_prefix = "%Us(%u): " passdb { args = /usr/local/etc/dovecot.passdb driver = passwd-file } protocols = imap ssl = no verbose_proctitle = yes *************************************************************** END *************************************************************** *************************************************************** /usr/local/etc/dovecot.passdb *************************************************************** peter:{CRYPT}BrtgyyOEX33w6:1000:500:Peter Snow:/var/mail/peter:: *************************************************************** END *************************************************************** *************************************************************** cat /etc/passwd | grep peter *************************************************************** peter:x:1000:500::/home/peter:/sbin/nologin *************************************************************** END *************************************************************** Notes: 'peter' does not yet have a system password, since I'm testing this for users which will only be virtual users. I made the password for 'peter' in the dovecot.passdb using "doveadm pw -s crypt" although once I've got it working I'd like to change the encryption to something as strong as possible - any suggestions please? Hope you can help and many thanks. Kind regards, Peter From lists at wildgooses.com Sun Aug 5 12:38:49 2012 From: lists at wildgooses.com (Ed W) Date: Sun, 05 Aug 2012 10:38:49 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501E030F.5090209@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> Message-ID: <501E3F29.9090401@wildgooses.com> On 05/08/2012 06:22, Peter Snow wrote: > Hi, > > I have to say that Dovecot is certainly the most challenging piece of > software I've ever had the pleasure of setting up (due mainly to the > reams of largely unhelpful documentation). After 36 almost non-stop > hours reading and trying, I finally end up here. :-) > > I really would appreciate your help - and many thanks in advance! Phew, haven't you set yourself up for a hostile response..? It's only an opinion, but I would say that the Dovecot docs are rather helpful and thorough? Also dovecot ships with an almost working config out of the box, really you only need to adjust a couple of settings to achieve most setups. OK, reading your log files, I think this is probably the clue? > /var/log/dovecot.log > (showing unsuccessful login) > > *************************************************************** > Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop > privileges: User is missing UID (see mail_uid setting) > Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to > server log for more information. > *************************************************************** I don't use that auth method so I don't want to give you a definitive suggestion, but we can certainly use google to get some ideas: http://lmgtfy.com/?q=dovecot+mail_uid+ Third link down seems to cover your question. Basically says you need to define the setting listed above, but also why. Note, I think it's easy to level critique against dovecot auth, but if you look for a few moments longer you will see that you are probably just criticising flexibility. You can use a very wide array of database types to store your auth information and with that flexibility comes the requirement to actually define your specific choice. Some people run a multi-tennanted system and like to be able to run each user under their own uid, hence that being flexible. Others want to use LDAP or a database to store auth info (I think you can even use both at the same time). It's even possible to use both at the same time I believe, or to lookup users in one db, and passwords in another. Note, I don't know your requirements, but you might want to look at some kind of database for your user storage if you have more than a fairly simple installation? Either LDAP or sql is likely to give you more flexibility than a flat file pwdb, but I don't know your requirements, so just a thought Finally note that there are literally dozens of "how to install dovecot" guides on the internet that will help you get a working setup with various auth db choices. Once you understand the big picture using one of those guides you will be able to customise things to a very specific situation Good luck Ed W From CMarcus at Media-Brokers.com Sun Aug 5 19:23:30 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 05 Aug 2012 12:23:30 -0400 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> Message-ID: <501E9E02.5000203@Media-Brokers.com> On 2012-08-03 6:33 PM, Voytek Eymont wrote: > don't know, looking this morning it shows like below, the 00:05:05 is > probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to > see what gets removed from 'spam' box, before and after each attempt to > expunge : > > date.saved: 2012-08-03 00:05:05 The 'date.saved:' is the date/time that the message was moved into that folder. The clock for these messages is based on the time it was moved into that folder, NOT the date/time the message was received in the message header. Maybe this is what is confusing you? So, if you have issue the command to remove messages older than 7 days, that would be 7 days *since they were moved into the folder*. -- Best regards, Charles From voytek at sbt.net.au Mon Aug 6 01:47:19 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Mon, 6 Aug 2012 08:47:19 +1000 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <501E9E02.5000203@Media-Brokers.com> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> Message-ID: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > The 'date.saved:' is the date/time that the message was moved into that > folder. > > The clock for these messages is based on the time it was moved into that > folder, NOT the date/time the message was received in the message header. > Maybe this is what is confusing you? > So, if you have issue the command to remove messages older than 7 days, > that would be 7 days *since they were moved into the folder*. Charles, thanks these are a user+spam spam basket, the actual messages are either in 'new' or 'cur', depending if a particular user logged to 'spam' basket or not does that mean that say 7 days would clear new messages after 7 days, and, any message that is not 'new' after 7 more days, assuming I run the command daily ? all I want is an auto way to clear +spam baskets after x days -- Voytek Eymont From CMarcus at Media-Brokers.com Mon Aug 6 02:24:54 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sun, 05 Aug 2012 19:24:54 -0400 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> Message-ID: <501F00C6.6030908@Media-Brokers.com> On 2012-08-05 6:47 PM, Voytek Eymont wrote: > > On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > >> The 'date.saved:' is the date/time that the message was moved into that >> folder. >> >> The clock for these messages is based on the time it was moved into that >> folder, NOT the date/time the message was received in the message header. >> Maybe this is what is confusing you? > >> So, if you have issue the command to remove messages older than 7 days, >> that would be 7 days *since they were moved into the folder*. > > Charles, > > thanks > > these are a user+spam spam basket, the actual messages are either in 'new' > or 'cur', depending if a particular user logged to 'spam' basket or not > > does that mean that say 7 days would clear new messages after 7 days, and, > any message that is not 'new' after 7 more days, assuming I run the > command daily ? > > all I want is an auto way to clear +spam baskets after x days I'm not sure I understand your question... Again, the date.saved is the date/tome the message was moved into the folder, and has nothing to do with the date the message was received or the date/time in the message header. So, as long as the date.saved date/time is not older than the date/time you are searching on, then they will not be deleted. -- Best regards, Charles From peter at snowweb.co.uk Mon Aug 6 04:35:49 2012 From: peter at snowweb.co.uk (Peter Snow) Date: Mon, 06 Aug 2012 09:35:49 +0800 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501E3F29.9090401@wildgooses.com> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> Message-ID: <501F1F75.5040906@snowweb.co.uk> Well you can continue to kid yourselves that the documentation is good if you like. The facts say differently. For example, I visit http://wiki.dovecot.org/MainConfig for help with the main config and at the top of the page it tells me that this page is for version 1.x, so I click the link to view the page for 2.x, which takes me to a page saying that the page I want has yet to be created. I therefore have no option but to refer to the version 1.x documentation. I copy "mechanisms = plain" from it but when I restart dovecot, it fails, telling me that it is not recognized! > Finally note that there are literally dozens of "how to install > dovecot" guides on the internet I noticed that also and did indeed follow many of them. Many of them though are for version 1.x but don't say so. Other's just leave you hanging. I could and probably will carry on digging on Google and probably will find a bunch of erroneous documents among the good ones and will have no easy way to tell the difference, but one might expect the official website to have the right information to save me this hassle. By the way, I've now got it running. It wasn't failing due to the user being used to run the processes. It was due to misconfiguration of the way that the virtual users were setup, which in the end I managed to fix by interrogating a server with a working implementation (albeit ver 1.x) which was similar to what I needed and copying parts of it's config. Although mutt now connects to it fine, roundcube doesn't, but don't worry. I'm not planning to bother you further. Kind regards, Peter On 08/05/2012 05:38 PM, Ed W wrote: > On 05/08/2012 06:22, Peter Snow wrote: >> Hi, >> >> I have to say that Dovecot is certainly the most challenging piece of >> software I've ever had the pleasure of setting up (due mainly to the >> reams of largely unhelpful documentation). After 36 almost non-stop >> hours reading and trying, I finally end up here. :-) >> >> I really would appreciate your help - and many thanks in advance! > > Phew, haven't you set yourself up for a hostile response..? > > It's only an opinion, but I would say that the Dovecot docs are rather > helpful and thorough? Also dovecot ships with an almost working > config out of the box, really you only need to adjust a couple of > settings to achieve most setups. > > OK, reading your log files, I think this is probably the clue? > > > >> /var/log/dovecot.log >> (showing unsuccessful login) >> >> *************************************************************** >> Aug 04 21:32:41 IMAP(peter): Error: user peter: Couldn't drop >> privileges: User is missing UID (see mail_uid setting) >> Aug 04 21:32:41 IMAP(peter): Error: Internal error occurred. Refer to >> server log for more information. >> *************************************************************** > > > I don't use that auth method so I don't want to give you a definitive > suggestion, but we can certainly use google to get some ideas: > http://lmgtfy.com/?q=dovecot+mail_uid+ > > Third link down seems to cover your question. Basically says you need > to define the setting listed above, but also why. > > > Note, I think it's easy to level critique against dovecot auth, but if > you look for a few moments longer you will see that you are probably > just criticising flexibility. You can use a very wide array of > database types to store your auth information and with that > flexibility comes the requirement to actually define your specific > choice. > > Some people run a multi-tennanted system and like to be able to run > each user under their own uid, hence that being flexible. Others want > to use LDAP or a database to store auth info (I think you can even use > both at the same time). It's even possible to use both at the same > time I believe, or to lookup users in one db, and passwords in another. > > Note, I don't know your requirements, but you might want to look at > some kind of database for your user storage if you have more than a > fairly simple installation? Either LDAP or sql is likely to give you > more flexibility than a flat file pwdb, but I don't know your > requirements, so just a thought > > Finally note that there are literally dozens of "how to install > dovecot" guides on the internet that will help you get a working setup > with various auth db choices. Once you understand the big picture > using one of those guides you will be able to customise things to a > very specific situation > > Good luck > > Ed W From robert at schetterer.org Mon Aug 6 09:30:00 2012 From: robert at schetterer.org (Robert Schetterer) Date: Mon, 06 Aug 2012 08:30:00 +0200 Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> References: <3ee8ea3983f6abae778115c9c1eda367.squirrel@geko.sbt.net.au> <4FFC1340.6060607@schetterer.org> <7934e03587c4c3f42a64ee0244cb883b.squirrel@geko.sbt.net.au> <900cb9120eb03ab29e19deec395b6d2f.squirrel@geko.sbt.net.au> <501E9E02.5000203@Media-Brokers.com> <0d61e172185d8b3b0eb774b33bb61131.squirrel@geko.sbt.net.au> Message-ID: <501F6468.2050409@schetterer.org> Am 06.08.2012 00:47, schrieb Voytek Eymont: > > On Mon, August 6, 2012 2:23 am, Charles Marcus wrote: > >> The 'date.saved:' is the date/time that the message was moved into that >> folder. >> >> The clock for these messages is based on the time it was moved into that >> folder, NOT the date/time the message was received in the message header. >> Maybe this is what is confusing you? > >> So, if you have issue the command to remove messages older than 7 days, >> that would be 7 days *since they were moved into the folder*. > > Charles, > > thanks > > these are a user+spam spam basket, the actual messages are either in 'new' > or 'cur', depending if a particular user logged to 'spam' basket or not > > does that mean that say 7 days would clear new messages after 7 days, and, > any message that is not 'new' after 7 more days, assuming I run the > command daily ? > > all I want is an auto way to clear +spam baskets after x days > > an ugly workaround maybe is ,thing like this, if using maidir v1.0 cronjob equivalent For Dovecot v1.0, this can be accomplished by running a daily shell script: # delete 30 day old mails find /var/virtualmail/ -regex '.*/\.\(Trash\|Junk\)\(/.*\)?\/\(cur\|new\)/.*' -type f -ctime +30 -delete # or -exec rm '{}' \; instead of -delete Using ctime means that messages are deleted 30 days after they've been moved to Trash. If mtime was used instead, it would mean the message is deleted 30 days after its original creation, which could be immediately. but i recommend expire plugin, also Timos advices should work for sure -- Best Regards MfG Robert Schetterer From acrow at integrafin.co.uk Mon Aug 6 09:30:59 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Mon, 06 Aug 2012 07:30:59 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F1F75.5040906@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> Message-ID: <501F64A3.8090202@integrafin.co.uk> On 06/08/12 02:35, Peter Snow wrote: > Well you can continue to kid yourselves that the documentation is good > if you like. The facts say differently. It would be easier if you started at the correct wiki for the version you have: http://wiki2.dovecot.org/FrontPage I have always found the documentation superb. I think you must have standards to which most other can merely aspire. Alex From jtam.home at gmail.com Mon Aug 6 10:46:45 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 6 Aug 2012 00:46:45 -0700 (PDT) Subject: [Dovecot] getting rid of old spam from +spam Maildir ? In-Reply-To: References: Message-ID: Charles Marcus writes: > On 2012-08-03 6:33 PM, Voytek Eymont wrote: >> don't know, looking this morning it shows like below, the 00:05:05 is >> probably last time I did 'ls'? I was doing 'ls' or web mail refresh, to >> see what gets removed from 'spam' box, before and after each attempt to >> expunge : >> >> date.saved: 2012-08-03 00:05:05 > > The 'date.saved:' is the date/time that the message was moved into that > folder. Perhaps this related thread starting at http://dovecot.org/list/dovecot/2012-July/067199.html and ending with the patch by Timo http://dovecot.org/list/dovecot/2012-July/067423.html may be of interest to the OP. Joseph Tam From lists at wildgooses.com Mon Aug 6 10:48:25 2012 From: lists at wildgooses.com (Ed W) Date: Mon, 06 Aug 2012 08:48:25 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F1F75.5040906@snowweb.co.uk> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> Message-ID: <501F76C9.2080202@wildgooses.com> On 06/08/2012 02:35, Peter Snow wrote: > Well you can continue to kid yourselves that the documentation is good > if you like. The facts say differently. For example, I visit > http://wiki.dovecot.org/MainConfig for help with the main config and > at the top of the page it tells me that this page is for version 1.x, > so I click the link to view the page for 2.x, which takes me to a page > saying that the page I want has yet to be created. I therefore have no > option but to refer to the version 1.x documentation. I copy > "mechanisms = plain" from it Google is *such* a useful tool.. http://lmgtfy.com/?q=dovecot+%22mechanisms+plain%22 > but when I restart dovecot, it fails, telling me that it is not > recognized! No, probably it says something different. Please quote the error message, not your interpretation of the error message? > I noticed that also and did indeed follow many of them. Many of them > though are for version 1.x but don't say so. There are many useful differences between 1.x and 2.x, but its a gradual evolution, not a big change. As such the configuration changed a "large amount" between 1.x and 2.x, in that it's now stored in multiple files rather than a few big files, but for your concern such a change is relatively minor and the configuration options are largely the same. > By the way, I've now got it running. It wasn't failing due to the user > being used to run the processes. It was due to misconfiguration of the > way that the virtual users were setup, which in the end I managed to > fix by interrogating a server with a working implementation (albeit > ver 1.x) which was similar to what I needed and copying parts of it's > config. Please always post details of your problem and solution - us technical folks learn from people's mistakes, but it's not possible to learn and make things better without knowing what your problem and eventual solution were? Additionally note that this is an opensource project and the documentation is written by people like yourself. Please consider clarifying whatever original document put you on the wrong track? > Although mutt now connects to it fine, roundcube doesn't, but don't > worry. I'm not planning to bother you further. Well, IMAP is just IMAP no matter which server you are using, so don't treat this as some big black box that you can't open up and inspect. IMAP is a plain text protocol and it shouldn't scare a technical person to debug things. roundcube is also an extremely flexible beast and you will need to get certain key settings correct before it connects correctly, it likely also feels very "brittle" in that there aren't that many settings to get right, but if any are wrong you will get major breakage Good luck Ed W P.S. You came here with all guns blazing and seems like you are going to leave the same way? Why not try a more softly softly approach? From ngoonee.talk at gmail.com Mon Aug 6 10:57:42 2012 From: ngoonee.talk at gmail.com (Oon-Ee Ng) Date: Mon, 6 Aug 2012 15:57:42 +0800 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: <501F76C9.2080202@wildgooses.com> References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> <501F76C9.2080202@wildgooses.com> Message-ID: On Mon, Aug 6, 2012 at 3:48 PM, Ed W wrote: > > P.S. You came here with all guns blazing and seems like you are going to > leave the same way? Why not try a more softly softly approach? Because the 'customer' has right to throw his weight around =). Especially after paying such a large amount of money for the product..... From rafinathan25 at gmail.com Mon Aug 6 11:09:51 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Mon, 6 Aug 2012 13:39:51 +0530 Subject: [Dovecot] find virtual users Message-ID: Hi, Can sendmail find virtual users in /etc/dovecot/passwd ? If yes, what are the necesary changes I have to make ? Urgent help needed. Thanks in advance. Regards, Rafael From lists at wildgooses.com Mon Aug 6 11:49:19 2012 From: lists at wildgooses.com (Ed W) Date: Mon, 06 Aug 2012 09:49:19 +0100 Subject: [Dovecot] Just trying to make dovecot work. In-Reply-To: References: <501E030F.5090209@snowweb.co.uk> <501E3F29.9090401@wildgooses.com> <501F1F75.5040906@snowweb.co.uk> <501F76C9.2080202@wildgooses.com> Message-ID: <501F850F.2090306@wildgooses.com> On 06/08/2012 08:57, Oon-Ee Ng wrote: > On Mon, Aug 6, 2012 at 3:48 PM, Ed W wrote: >> P.S. You came here with all guns blazing and seems like you are going to >> leave the same way? Why not try a more softly softly approach? > Because the 'customer' has right to throw his weight around =). > Especially after paying such a large amount of money for the > product..... Lets and avoid chasing folks away. Ed From CMarcus at Media-Brokers.com Mon Aug 6 14:09:10 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 06 Aug 2012 07:09:10 -0400 Subject: [Dovecot] find virtual users In-Reply-To: References: Message-ID: <501FA5D6.1040000@Media-Brokers.com> On 2012-08-06 4:09 AM, Rafael Nathan wrote: > Hi, > > Can sendmail find virtual users in /etc/dovecot/passwd ? > If yes, what are the necesary changes I have to make ? > > Urgent help needed. Thanks in advance. This is the dovecot support list. For sendmail support, you should seek an appropriate venue... -- Best regards, Charles From andrzej.filip at gmail.com Mon Aug 6 21:33:27 2012 From: andrzej.filip at gmail.com (Andrzej A. Filip) Date: Mon, 06 Aug 2012 20:33:27 +0200 Subject: [Dovecot] find virtual users [sendmail] In-Reply-To: References: Message-ID: <50200DF7.9060000@gmail.com> On 08/06/2012 10:09 AM, Rafael Nathan wrote: > Can sendmail find virtual users in /etc/dovecot/passwd ? > If yes, what are the necesary changes I have to make ? > > Urgent help needed. Thanks in advance. Sendmail/sendmail.cf can do lookups in passwd like files => It should be possible to check recipient existence before "RCPT TO:" reply. SMTP AUTH is another story. There are a few+ ways to integrate sendmail and dovecot. Which one do you use? From mikeg at rockisland.com Mon Aug 6 21:34:22 2012 From: mikeg at rockisland.com (Mike Greene) Date: Mon, 6 Aug 2012 18:34:22 +0000 Subject: [Dovecot] redirect actions exceeds policy limit Message-ID: <07A08B628EAA1D4F8ADAE2C68D980A9F019B50@mercury.office.rockisland.com> Hello, We have a vacation/mail forwarder plugin in squirrel mail that allows customers to forward email. It has come to my attention that there is a limit (appears to be 5) on the number of addresses that can be specified. I'm now trying to track down where this policy limit is set. This is the error we see in the customers .dovecot.sieve.log file: main_script: line 26: error: number of redirect actions exceeds policy limit. sieve: info: started log at Jul 25 07:02:54. I checked the following for possible settings: /usr/local/etc/dovecot/dovecot.conf /usr/local/etc/sieve/dovecot.sieve /usr/local/etc/sieve/global.sieve I didn't see anything specific to limiting the number of redirects. I'm wondering where else I can look to find where this limit is coming from and adjust it upwards. We are using the following dovecot / pigeonhole versions. dovecot-2.0.7 dovecot-pigeonhole-0.2.1 athena# dovecot -n # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.1-RELEASE amd64 auth_default_realm = rockisland.com auth_mechanisms = plain login cram-md5 auth_username_format = %Lu disable_plaintext_auth = no dotlock_use_excl = yes first_valid_gid = 1000 first_valid_uid = 1000 listen = * mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { quota = maildir quota_rule = *:storage=2G quota_warning = storage=90%% /usr/local/sbin/quota-warning.sh 90 quota_warning2 = storage=80%% /usr/local/sbin/quota-warning.sh 80 sieve = ~/.dovecot.sieve sieve_dir = ~/ sieve_global_dir = /usr/local/etc/sieve/ } protocols = imap pop3 service auth { unix_listener auth-client { mode = 0660 } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service imap-login { service_count = 0 } service pop3-login { service_count = 0 } ssl_cert = References: <07A08B628EAA1D4F8ADAE2C68D980A9F019B50@mercury.office.rockisland.com> Message-ID: In conf.d/90-sieve.conf we have: # The maximum number of redirect actions that can be performed during # a single script execution. #sieve_max_redirects = 4 sieve_max_redirects = 25 I think that's the setting you're looking for. -David Warden On 2012-08-06 14:34, Mike Greene wrote: > Hello, We have a vacation/mail forwarder plugin in squirrel mail that allows customers to forward email. It has come to my attention that there is a limit (appears to be 5) on the number of addresses that can be specified. I'm now trying to track down where this policy limit is set. > > This is the error we see in the customers .dovecot.sieve.log file: > > main_script: line 26: error: number of redirect actions exceeds policy limit. > sieve: info: started log at Jul 25 07:02:54. > > I checked the following for possible settings: > > /usr/local/etc/dovecot/dovecot.conf > /usr/local/etc/sieve/dovecot.sieve > /usr/local/etc/sieve/global.sieve > > I didn't see anything specific to limiting the number of redirects. I'm wondering where else I can look to find where this limit is coming from and adjust it upwards. > > We are using the following dovecot / pigeonhole versions. > > dovecot-2.0.7 > dovecot-pigeonhole-0.2.1 > > athena# dovecot -n > # 2.0.7: /usr/local/etc/dovecot/dovecot.conf > # OS: FreeBSD 8.1-RELEASE amd64 > auth_default_realm = rockisland.com > auth_mechanisms = plain login cram-md5 > auth_username_format = %Lu > disable_plaintext_auth = no > dotlock_use_excl = yes > first_valid_gid = 1000 > first_valid_uid = 1000 > listen = * > mail_location = mbox:~/mail:INBOX=/var/mail/%u > mail_privileged_group = mail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date > passdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > plugin { > quota = maildir > quota_rule = *:storage=2G > quota_warning = storage=90%% /usr/local/sbin/quota-warning.sh 90 > quota_warning2 = storage=80%% /usr/local/sbin/quota-warning.sh 80 > sieve = ~/.dovecot.sieve > sieve_dir = ~/ > sieve_global_dir = /usr/local/etc/sieve/ > } > protocols = imap pop3 > service auth { > unix_listener auth-client { > mode = 0660 > } > unix_listener auth-master { > group = vmail > mode = 0600 > user = vmail > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > user = root > } > service imap-login { > service_count = 0 > } > service pop3-login { > service_count = 0 > } > ssl_cert = ssl_key = userdb { > driver = prefetch > } > userdb { > args = /usr/local/etc/dovecot/dovecot-ldap.conf > driver = ldap > } > verbose_proctitle = yes > protocol imap { > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep > mail_plugins = quota imap_quota > } > protocol pop3 { > mail_plugins = quota > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } > protocol lda { > auth_socket_path = /var/run/dovecot/auth-master > info_log_path = > lda_mailbox_autocreate = no > lda_mailbox_autosubscribe = yes > log_path = > mail_plugins = quota sieve > postmaster_address = postmaster at rockisland.com > sendmail_path = /usr/sbin/sendmail > } > > Mike Greene > Rock Island Technology Solutions, Inc. > San Juan Islands, WA. 360-378-5884 x201 From chris.visser at rtt.co.za Tue Aug 7 10:03:53 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 7 Aug 2012 07:03:53 +0000 Subject: [Dovecot] LDAP auth with AD Message-ID: <1B5F61B24A54E54397345A133BD0A48D07D73EEA@RTTGMBX02.thefuelgroup.com> Hi, I'm struggling to setup LDAP authentication with dovecot against an AD server. When I attempt to bind using the same DN I use to do address lookups in exim and to do searches using ldap search on the command line I get the following in my logs: Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 7 08:55:58 mail-dev dovecot: auth: Debug: auth client connected (pid=1523) Aug 7 08:55:58 mail-dev dovecot: auth: Error: LDAP: binding failed (dn CN=Linux Sync,CN=Users,DC=RTT,DC=co,DC=za): Invalid credentials, 80090308: LdapErr: DSID-0C0903A9, comment: AcceptSecurityContext error, data 52e, v1db1? I'm running CentOS 6 and connect to a Windows 2008 R2 domain. The output from dovecot -n: # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_verbose = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } ssl_cert = Hello, i have a user who is able to do pop3 on port 110 without problems and without limits. There are ~10 real users using same public IP. When switching to port 995 to use pop3s he is limited at connection count. Some people can reach pop3s-server successful, some getting a timeout. I cant find any errors or limits within my config or in my log, there are no differences between using plain text and using tls. Are there some special loglines to grep for at this situation? Maybe i missed some lines... At the moment i dont see server-side problems. Somebody knows some typical clientside problems when this problem occurs? dovecot version is 1.2.11 Thanks, Hajo From robert at schetterer.org Tue Aug 7 10:32:37 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 07 Aug 2012 09:32:37 +0200 Subject: [Dovecot] connectionlimit for pop3s? In-Reply-To: <6FB9BD6F1FC54ADEB52F690E1321ADCA@ai.local> References: <6FB9BD6F1FC54ADEB52F690E1321ADCA@ai.local> Message-ID: <5020C495.5010309@schetterer.org> Am 07.08.2012 09:19, schrieb Hajo Locke: > Hello, > > i have a user who is able to do pop3 on port 110 without problems and without limits. There are ~10 real users using same public IP. > When switching to port 995 to use pop3s he is limited at connection count. Some people can reach pop3s-server successful, some getting a timeout. > I cant find any errors or limits within my config or in my log, there are no differences between using plain text and using tls. > Are there some special loglines to grep for at this situation? Maybe i missed some lines... > At the moment i dont see server-side problems. Somebody knows some typical clientside problems when this problem occurs? > > dovecot version is 1.2.11 > > Thanks, > Hajo > any firewalls involved , some ugly ones have problems with tls ? -- Best Regards MfG Robert Schetterer From stsiol at yahoo.co.uk Tue Aug 7 12:40:34 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Tue, 7 Aug 2012 10:40:34 +0100 (BST) Subject: [Dovecot] error message. Some help please Message-ID: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> Hello all : dovecot -n : # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3 base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-info.log ssl_parameters_regenerate: 48 verbose_ssl: yes login_dir: /var/run/dovecot//login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login login_greeting: * Dovecot ready * login_max_processes_count: 64 mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir mail_plugins: zlib auth default: ? verbose: yes ? debug: yes ? debug_passwords: yes ? passdb: ??? driver: passwd-file ??? args: /etc/dovecot/passwd ? passdb: ??? driver: pam ? userdb: ??? driver: static ??? args: uid=vmail gid=vmail home=/home/vmail/%u ? userdb: ??? driver: passwd From the logs : tail -100 /var/log/dovecot/dovecot | more : ......... Jul 06 13:51:20 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count Jul 18 15:20:32 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count Jul 19 09:16:40 dovecot: Warning: Killed with signal 15 (by pid=3062 uid=0 code=kill) ......... Should I just go ahead and increase login_max_processes_count ? Is it that simple ? Just asking for your feedback and experience chaps. Thank you in advance, Spyros ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From Wiethoff at tfh-bochum.de Tue Aug 7 13:30:15 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Tue, 7 Aug 2012 10:30:15 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue Message-ID: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> Hello everybody, i have a problem with dovecot+Active Directory as Authentication-Service. I am not able to use special characters (???? (german umlaut)) within a password. Normally I would suggest that the ldap-query is done in UTF-8 but as I debugged the auth-process, I have seen that the password is ISO-8859-1 encoded. The "original" query (from roundcube for example) is UTF-8 encoded (I dumped the POST-Query). So far I wasn't able to find my error by myself or by searching the web. Maybe someone of you can give me a hint :-) Thanks and greetings from Germany, Helge ---- dovecot --version 2.0.16 ---- D-AS01:/etc/dovecot # grep -v '^ *\(#.*\)\?$' dovecot-ldap.conf.ext uris = ldap://10.37.5.90 dn = CN=ldap-d-as01,CN=Users,DC=tfh-bochum,DC=de dnpass = xxxx auth_bind = yes ldap_version = 3 base = ou=Benutzer, ou=Lehre, dc=tfh-bochum, dc=de user_attrs = =uid=10000,=gid=10000,=home=/srv/mail/%Ld/%Ln user_filter = mail=%u pass_attrs = =uid=10000,=gid=10000,=home=/srv/mail/%Ld/%Ln pass_filter = (&(mail=%u)(!(extensionAttribute3=*))) ---- dovecot -n # 2.0.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.37.6-0.11-default x86_64 openSUSE 11.4 (x86_64) auth_debug = yes auth_mechanisms = plain login auth_username_translation = %Lu auth_verbose = yes mail_location = maildir:~/Maildir mail_max_userip_connections = 1000 mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes list = yes location = prefix = INBOX/ separator = / subscriptions = yes type = private } namespace { list = yes location = maildir:%%h/Maildir:INDEX=%h/Maildir/shared/%%u:CONTROL=%h/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/srv/mail/shared-mailboxes quota = maildir:Quota quota_rule = *:storage=1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_max_redirects = 10 } protocols = imap pop3 sieve lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0770 user = root } } service imap-login { process_min_avail = 4 service_count = 0 } service managesieve-login { inet_listener sieve { address = * port = 4190 } inet_listener sieve_deprecated { address = * port = 2000 } process_min_avail = 2 service_count = 0 } ssl_ca = References: <501BB65A.2090601@corefiling.co.uk> <501C1234.20504@rename-it.nl> Message-ID: <5020F52B.9060005@corefiling.co.uk> On 03/08/12 19:02, Stephan Bosch wrote: > On 8/3/2012 1:30 PM, Daniel Piddock wrote: >> Hi, >> >> We've recently upgraded from Dovecot 1.2.15 with Sieve 0.1.18 (Debian >> Squeeze) to Dovecot 2.1.8 and Pigeonhole 0.3.1. >> >> We provide a selection of global sieve scripts to make users' lives >> easier and one noticed that some of these have stopped working. I >> tracked it down to them having personal scripts with the same name. >> >> Using a really simple sieve script: > > Nice bug report. > >> As can be seen the personal script is included twice. Obvious work >> around is to rename the personal script. However it'd be nice if >> namespacing came back. > > This should fix it: > > http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/6a34eda7924e > > I also extended the test suite to prevent this situation from > occurring again, for file-based scripts anyway. Hi Stephan, Thank you for the quick patch! Fixes the problem perfectly. Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From tonio at starbridge.org Tue Aug 7 14:47:50 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 13:47:50 +0200 Subject: [Dovecot] pop3 proxying error Message-ID: <50210066.8040205@starbridge.org> Hi Timo, I've got some errors with pop3 proxying and dovecot 2.1.9 I's occured on the proxy side: Aug 7 13:16:47 dev1 dovecot: pop3-login: Fatal: master: service(pop3-login): child 23046 killed with signal 11 (core dumped) Server side shows no error, and runs the same dovecot version. Thanks for your help. Best regards Tonio Buonaguidi Core dump: GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/pop3-login...done. [New LWP 23046] warning: Can't read pathname for load map: Erreur d'entr?e/sortie. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". Core was generated by `dovecot/pop3-login -D'. Program terminated with signal 11, Segmentation fault. #0 settings_parser_dup (old_ctx=0x8783480, new_pool=0x632e6465) at settings-parser.c:1742 1742 pool_ref(new_pool); doveconf -n # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32.2-xxxx-std-ipv6-32 i686 Debian wheezy/sid auth_cache_size = 4 k auth_mechanisms = plain login director_mail_servers = bb.bb.bb.bb cc.cc.cc.cc director_servers = dd.dd.dd.dd aa.aa.aa.aa log_timestamp = %Y-%m-%d %H:%M:%S mail_debug = yes managesieve_notify_capability = mailto managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date spamtest spamtestplus virustest passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0660 user = postfix } unix_listener auth-master { mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0660 user = vmail } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = aa.aa.aa.aa port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 143 } inet_listener imaps { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 993 } process_limit = 256 process_min_avail = 2 service_count = 0 vsz_limit = 256 M } service managesieve-login { inet_listener sieve { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 4190 } vsz_limit = 64 M } service pop3-login { executable = pop3-login -D inet_listener pop3 { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 110 } inet_listener pop3s { address = aa.aa.aa.aa yy.yyy.yy.yy xx.xx.xx.xx port = 995 } service_count = 0 } ssl_ca = good day! I wonder if it is possible to make a chain of replication in dovecot 2.1.9. Now I'm using two way replication(I use proxy to redirect users) and it's working just fine but is it possible to setup replication like this: serverA ---> serverB --> server C <--- I've added additional mail_replica2 on serverB and after restart dovecot didn't complain about errors, with doveconf -n I am able to see two replica's settings but user's mails aren't replicating to server C. no errors in logs. I want to use server C as backup server with lvm snapshots. From Jost.Krieger+dovecot at rub.de Tue Aug 7 15:43:08 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 7 Aug 2012 14:43:08 +0200 Subject: [Dovecot] For the wishlist Message-ID: <20120807124305.GA13644@ruhr-uni-bochum.de> I would like very much to have a "doveadm copy", which probably could be made out of "doveadm move" by removing ca. 2 lines (and changing a few strings from "move" to "copy"). This would make it a lot easier to script quite a few things without using a real imap client. I can run around this by doing an import followed by a move but this will duplicate the mails (even when using mdbox). Mit freundlichen Gr??en Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From tonio at starbridge.org Tue Aug 7 15:54:05 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 14:54:05 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50210066.8040205@starbridge.org> References: <50210066.8040205@starbridge.org> Message-ID: <50210FED.5020508@starbridge.org> Le 07/08/2012 13:47, tonio at starbridge.org a ?crit : > > Hi Timo, > I've got some errors with pop3 proxying and dovecot 2.1.9 > > I's occured on the proxy side: > > Aug 7 13:16:47 dev1 dovecot: pop3-login: Fatal: master: > service(pop3-login): child 23046 killed with signal 11 (core dumped) > > Server side shows no error, and runs the same dovecot version. > > Thanks for your help. > Best regards > Tonio Buonaguidi > > Core dump: > > > GNU gdb (GDB) 7.4.1-debian > Copyright (C) 2012 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show > copying" > and "show warranty" for details. > This GDB was configured as "i486-linux-gnu". > For bug reporting instructions, please see: > ... > Reading symbols from /usr/lib/dovecot/pop3-login...done. > [New LWP 23046] > > warning: Can't read pathname for load map: Erreur d'entr?e/sortie. > [Thread debugging using libthread_db enabled] > Using host libthread_db library > "/lib/i386-linux-gnu/i686/cmov/libthread_db.so.1". > Core was generated by `dovecot/pop3-login -D'. > Program terminated with signal 11, Segmentation fault. > #0 settings_parser_dup (old_ctx=0x8783480, new_pool=0x632e6465) at > settings-parser.c:1742 > 1742 pool_ref(new_pool); > > sorry I've forgot bt full ! (gdb) bt full #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 new_ctx = iter = new_link = links = key = value = i = parser_pool = __FUNCTION__ = "settings_parser_dup" #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) at master-service-settings-cache.c:221 entry = 0xe98b90 pool = 0xe98b70 pool_size = entry_local_name = 0xe98b90 "pop.te.com" #2 master_service_settings_cache_read (cache=0x60ea50, input=, dyn_parsers=, parser_r=0x7ffffe4558b8, error_r=) at master-service-settings-cache.c:297 output = {specific_services = 0x0, service_uses_local = 1, service_uses_remote = 0, used_local = 1, used_remote = 0} new_input = {roots = 0x604500, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x403640 "pop3-login", service = 0x40363b "pop3", username = 0x0, local_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = ".iHb", '\000' , __u6_addr16 = {26926, 25160, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1648912686, 0, 0, 0}}}, ip4 = {s_addr = 1648912686}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = "ZT\220]", '\000' , __u6_addr16 = {21594, 23952, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1569739866, 0, 0, 0}}}, ip4 = {s_addr = 1569739866}}}, local_name = 0x9fa1d0 "pop.te.com"} set = __FUNCTION__ = "master_service_settings_cache_read" #3 0x00007fc7a7a25a1b in login_settings_read (pool=0xbc54e0, local_ip=, remote_ip=, local_name=, other_settings_r=0x7ffffe455908) at login-settings.c:226 input = {roots = 0x604500, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x403640 "pop3-login", service = 0x40363b "pop3", username = 0x0, local_ip = {family = 2, u = {ip6 = { ---Type to continue, or q to quit--- __in6_u = {__u6_addr8 = ".iHb", '\000' , __u6_addr16 = {26926, 25160, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1648912686, 0, 0, 0}}}, ip4 = {s_addr = 1648912686}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = "ZT\220]", '\000' , __u6_addr16 = {21594, 23952, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1569739866, 0, 0, 0}}}, ip4 = {s_addr = 1569739866}}}, local_name = 0x9fa1d0 "pop.te.com"} error = parser = cache_sets = sets = i = count = __FUNCTION__ = "login_settings_read" #4 0x00007fc7a7a28278 in ssl_servername_callback (ssl=0xa0d6e0, al=, context=) at ssl-proxy-openssl.c:1144 ctx = proxy = client = 0xe95b98 host = other_sets = 0x0 #5 0x00007fc7a71c6162 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #6 0x00007fc7a71b2205 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #7 0x00007fc7a71b68c5 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #8 0x00007fc7a71c3103 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #9 0x00007fc7a7a289b9 in ssl_handshake (proxy=0xa185e0) at ssl-proxy-openssl.c:465 ret = #10 ssl_step (proxy=0xa185e0) at ssl-proxy-openssl.c:528 No locals. #11 0x00007fc7a77d6566 in io_loop_call_io (io=0xa15080) at ioloop.c:379 ioloop = 0x60d6e0 t_id = 2 #12 0x00007fc7a77d7237 in io_loop_handler_run (ioloop=) at ioloop-epoll.c:213 ctx = 0x9e6470 events = 0x0 event = 0x9e8030 list = 0x9f8ae0 io = tv = {tv_sec = 179, tv_usec = 999811} msecs = ret = 1 i = call = #13 0x00007fc7a77d5f78 in io_loop_run (ioloop=0x60d6e0) at ioloop.c:398 No locals. #14 0x00007fc7a77c1ee3 in master_service_run (service=0x60d590, callback=) at master-service.c:543 No locals. #15 0x00007fc7a7a266be in login_binary_run (binary=, argc=2, argv=0x60d370) at main.c:406 set_pool = 0x60da20 allow_core_dumps = login_socket = c = #16 0x00007fc7a7419ead in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #17 0x0000000000401fd9 in _start () No symbol table info available. From tss at iki.fi Tue Aug 7 17:57:43 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 7 Aug 2012 17:57:43 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50210FED.5020508@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> Message-ID: <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> On 7.8.2012, at 15.54, tonio at starbridge.org wrote: > #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 > new_ctx = > iter = > new_link = > links = > key = > value = > i = > parser_pool = > __FUNCTION__ = "settings_parser_dup" > #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) > at master-service-settings-cache.c:221 > entry = 0xe98b90 > pool = 0xe98b70 > pool_size = > entry_local_name = 0xe98b90 "pop.te.com" I guess nobody had tried to run Dovecot with many local / remote {} blocks previously. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/2815175a0ffc From tonio at starbridge.org Tue Aug 7 18:16:58 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Tue, 07 Aug 2012 17:16:58 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> Message-ID: <5021316A.4020105@starbridge.org> Le 07/08/2012 16:57, Timo Sirainen a ?crit : > On 7.8.2012, at 15.54, tonio at starbridge.org wrote: > >> #0 settings_parser_dup (old_ctx=0xa26920, new_pool=0x6d6f632e32) at settings-parser.c:1742 >> new_ctx = >> iter = >> new_link = >> links = >> key = >> value = >> i = >> parser_pool = >> __FUNCTION__ = "settings_parser_dup" >> #1 0x00007fc7a77c3ecc in cache_add (parser=0xa26920, output=0x7ffffe4557f0, input=0x7ffffe455790, cache=0x60ea50) >> at master-service-settings-cache.c:221 >> entry = 0xe98b90 >> pool = 0xe98b70 >> pool_size = >> entry_local_name = 0xe98b90 "pop.te.com" > I guess nobody had tried to run Dovecot with many local / remote {} blocks previously. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/2815175a0ffc > Thanks Timo I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? Thanks again for your work ! Regards Tonio From kavish.karkera at yahoo.com Tue Aug 7 18:17:43 2012 From: kavish.karkera at yahoo.com (Kavish Karkera) Date: Tue, 7 Aug 2012 23:17:43 +0800 (SGT) Subject: [Dovecot] Dovecot with Company - level Quota Message-ID: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> Hi Timo, We are using maildir as quota-backend , and performing user level quota, which is working fine.? (using dovecot 2.x ). Now the requirement is to , restrict the quota to client / company level along with user level quota. ?For. eg. We have a mailbox path like /mail/mailstore/10001/kavish.karkera at linoquery.com/Maildir/ where 10001 is Client code (unique number given to very client) instead of domain name. So there would be two quota's one at company level and other user level. Such as 10001(linoquery.com) = 5GB ---> Company Quota kavish.karkera at linoquery.com = 0 ? ---> User Quota If the sum of the user quota under 10001/*? exceeds the 5GB limit then the mails for that particular domain should get bounced. Please Help , if this is possible. Regards, Kavish Karkera From tss at iki.fi Tue Aug 7 18:21:12 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 7 Aug 2012 18:21:12 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <5021316A.4020105@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> Message-ID: On 7.8.2012, at 18.16, tonio at starbridge.org wrote: > I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? Not a bad thing, but it uses up somewhat more memory. From hmoreno at gmv.com Tue Aug 7 18:40:59 2012 From: hmoreno at gmv.com (=?iso-8859-1?Q?H=E9ctor_Moreno_Blanco?=) Date: Tue, 7 Aug 2012 15:40:59 +0000 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> References: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> Message-ID: Hello everybody, We have the same problem with the vacation response. Why dovecot leaves the from empty? Does it something to do with this NULL field? src/deliver/mail-send.c: smtp_client = smtp_client_open(return_addr, NULL, &f); We have tried changing that line for this one, with no success: src/deliver/mail-send.c: smtp_client = smtp_client_open(return_addr, src->fromaddr, &f); We also have tried different versions of dovecot an pigeonhole, but the error persists. Any help would be much appreciated. Thank you very much in advanced. Kind regards- H?ctor Moreno Blanco Divisi?n de Seguridad e Infraestructuras / Security and Infrastructures Division GMV Isaac Newton, 11 P.T.M. Tres Cantos E-28760 Madrid Tel. +34 91 807 21 00 Fax +34 91 807 21 99 www.gmv.com ? ? ? -----Mensaje original----- De: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] En nombre de asier.cidon at externo.uam.es Enviado el: lunes, 30 de julio de 2012 9:06 Para: dovecot at dovecot.org Asunto: [Dovecot] sieve vacation messages trouble FROM:mailman-bounces at dovecot.org DATE:27. hein?kuuta 2012 16.58.35 UTC+3.00 TO:dovecot-owner at dovecot.org SUBJECT:CONTENT FILTERED MESSAGE NOTIFICATION The attached message matched the dovecot mailing list's content filtering rules and was prevented from being forwarded on to the list membership. ?You are receiving the only remaining copy of the discarded message. FROM:Asier Cidon Peria?ez DATE:27. hein?kuuta 2012 16.01.59 UTC+3.00 TO:dovecot at dovecot.org SUBJECT:RE: [DOVECOT] SIEVE VACATION MESSAGES TROUBLE Hi, I have a problem when I define a? Filter SIEVE vacation with Horde, Qmail and Dovecot. When I sent the message vacation for domains external, the log of postfix show <"<>"@mymachine>. I am writing you because I saw the post http://www.dovecot.org/list/dovecot/2009-June/040811.html Can you explain me whqt is the solution? Many Thanks. ______________________ This message including any attachments may contain confidential information, according to our Information Security Management System, and intended solely for a specific individual to whom they are addressed. Any unauthorised copy, disclosure or distribution of this message is strictly forbidden. If you have received this transmission in error, please notify the sender immediately and delete it. ______________________ Este mensaje, y en su caso, cualquier fichero anexo al mismo, puede contener informacion clasificada por su emisor como confidencial en el marco de su Sistema de Gestion de Seguridad de la Informacion siendo para uso exclusivo del destinatario, quedando prohibida su divulgacion copia o distribucion a terceros sin la autorizacion expresa del remitente. Si Vd. ha recibido este mensaje erroneamente, se ruega lo notifique al remitente y proceda a su borrado. Gracias por su colaboracion. ______________________ From admin at sagredo.eu Tue Aug 7 19:20:39 2012 From: admin at sagredo.eu (Roberto Puzzanghera) Date: Tue, 07 Aug 2012 18:20:39 +0200 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> References: <20120730090626.Horde.HxqjJmAflu1QFjJyA8Kia0A@webmail1.ti.uam.es> Message-ID: <7ed42f758c282216bb4ac454314acb8a@sagredo.eu> Il 30.07.2012 09:06 asier.cidon at externo.uam.es ha scritto: > FROM:mailman-bounces at dovecot.org > DATE:27. hein?kuuta 2012 16.58.35 UTC+3.00 > TO:dovecot-owner at dovecot.org > SUBJECT:CONTENT FILTERED MESSAGE NOTIFICATION > > The attached message matched the dovecot mailing list's content > filtering rules and was prevented from being forwarded on to the list > membership. ?You are receiving the only remaining copy of the > discarded message. > > FROM:Asier Cidon Peria?ez > DATE:27. hein?kuuta 2012 16.01.59 UTC+3.00 > TO:dovecot at dovecot.org > SUBJECT:RE: [DOVECOT] SIEVE VACATION MESSAGES TROUBLE > > Hi, > > I have a problem when I define a? Filter SIEVE vacation with Horde, > Qmail > and Dovecot. > > When I sent the message vacation for domains external, the log of > postfix > show <"<>"@mymachine>. > > I am writing you because I saw the post > http://www.dovecot.org/list/dovecot/2009-June/040811.html > > Can you explain me whqt is the solution? > > Many Thanks. Hi, this is a qmail-inject issue. You have to patch qmail-inject. See here for more info http://notes.sagredo.eu/node/133 regards Roberto From mikeg at rockisland.com Tue Aug 7 19:32:12 2012 From: mikeg at rockisland.com (Mike Greene) Date: Tue, 7 Aug 2012 16:32:12 +0000 Subject: [Dovecot] redirect actions exceeds policy limit In-Reply-To: References: Message-ID: <07A08B628EAA1D4F8ADAE2C68D980A9F01A74D@mercury.office.rockisland.com> Thank you David, I saw that in the share/docs but we didn't have the /conf.d/ folder or any of the extra conf files in place. I created that directory, copied the file over, made my changes and all is well again. Not sure why things were setup the way they were, after looking at the other files in conf.d it would appear the previous sysadmin had merged a lot of those bits and pieces into the main dovecot.conf file. Perhaps leftovers from v1.x days. Will likely address that down the road when we update that server. Mike Greene Rock Island Technology Solutions, Inc. San Juan Islands, WA. 360-378-5884 x201 > -----Original Message----- > > Date: Mon, 06 Aug 2012 14:46:22 -0400 > From: David Webmailbeta Warden > To: > Subject: Re: [Dovecot] redirect actions exceeds policy limit > Message-ID: > Content-Type: text/plain; charset="utf-8" > > > > In conf.d/90-sieve.conf we have: > > # The maximum number of redirect > actions that can be performed during > # a single script execution. > > #sieve_max_redirects = 4 > sieve_max_redirects = 25 > > I think that's the > setting you're looking for. > > -David Warden From voytek at sbt.net.au Wed Aug 8 00:06:52 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Wed, 8 Aug 2012 07:06:52 +1000 Subject: [Dovecot] how to duplicate users emails to allow deleted recovery? Message-ID: <7865bbafeaadafa7c712b61d4022c029.squirrel@geko.sbt.net.au> I have a situation where a user deleted emails using iphone, then, wants he sees messages are gone from desktop client, wants them recovered from server, happened several times now is there a way to have all deletes to go to server trash for potential recovery ? off topic: is there a way on iphone to force deletions to server's trash is there a way to have dovecot duplicate all emails to say user_backup at dom.tld mail box ? or should I duplicate emails in postfix ? using dovecot 2 with lmpt and virtual domains thanks -- Voytek From tss at iki.fi Wed Aug 8 00:45:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 08 Aug 2012 00:45:38 +0300 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <501CCB1C.80908@zu-con.org> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> <501CCB1C.80908@zu-con.org> Message-ID: <1344375938.19913.85.camel@hurina> On Sat, 2012-08-04 at 09:11 +0200, Matthias Rieber wrote: > >> I've deleted 10000s emails and it seems that every mail is removed with > >> a single request from Solrs index. This works, but it's quite slow. Is > >> it possible/plans to improve that? > > > > Could you try if the attached patch works? It compiles, but didn't test it. > > it segfaults: This should work: http://hg.dovecot.org/dovecot-2.1/rev/82f59d2139a9 From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 8 01:22:26 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 8 Aug 2012 00:22:26 +0200 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> Message-ID: <20120807222226.GA8406@daniel.localdomain> Wiethoff, Helge wrote: > Hello everybody, > > i have a problem with dovecot+Active Directory as Authentication-Service. I am not able to use special characters (???? (german umlaut)) within a password. Normally I would suggest that the ldap-query is done in UTF-8 but as I debugged the auth-process, I have seen that the password is ISO-8859-1 encoded. > The "original" query (from roundcube for example) is UTF-8 encoded (I dumped the POST-Query). > So far I wasn't able to find my error by myself or by searching the web. Maybe someone of you can give me a hint :-) > > Thanks and greetings from Germany, > Helge Hello Helge, In order to make it work with LDAP, the password transmitted over the IMAP connection needs to be encoded with the same character set as the password used to generate the hash. IMAP does not specify how the mail client should encode the password during the login process. So some older clients use Latin1 and some newer use UTF-8. Probably you are interested in reading the discussion from 2008: http://www.dovecot.org/list/dovecot/2008-November/035263.html Possibly you could reencode your passwords with some IMAP proxy like nginx and the mail and mail_auth modules and detect german umlauts, but such a setup will quickly get complex. I think, a simple and robust solution would be to limit the allowed characters for user passwords in your password management system to 7-bit ASCII characters (only) and reset passwords of all users having any login problems. Greetings, Daniel -- https://plus.google.com/103021802792276734820 From jtam.home at gmail.com Wed Aug 8 01:55:59 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 7 Aug 2012 15:55:59 -0700 (PDT) Subject: [Dovecot] connectionlimit for pop3s? In-Reply-To: References: Message-ID: On Tue, 7 Aug 2012, dovecot-request at dovecot.org wrote: > When switching to port 995 to use pop3s he is limited at connection > count. Some people can reach pop3s-server successful, some getting a > timeout. > ... > Somebody knows some typical clientside problems when this problem > occurs? Do the same user(s) have this problem and/or do each user have their own mail configuration for their mail readers? If yes, I would also check that the port and security protocol matches (i.e. clear/TLS/SSL on ports 110/110/995 respectively). Mismatched configurations could cause what you describe. Log messages could also be helpful here. Joseph Tam From tonio at starbridge.org Wed Aug 8 09:42:06 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Wed, 08 Aug 2012 08:42:06 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> Message-ID: <50220A3E.407@starbridge.org> Le 07/08/2012 17:21, Timo Sirainen a ?crit : > On 7.8.2012, at 18.16, tonio at starbridge.org wrote: > >> I will give it a try ASAP, but is it a bad thing to run dovecot with many local {} ? > Not a bad thing, but it uses up somewhat more memory. > Timo, I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) Director is configured in my dovecot.conf, but I dont use it here. Proxying is made by sql request with static host. (gdb) bt full #0 0xffffe424 in __kernel_vsyscall () No symbol table info available. #1 0xb760d941 in raise () from /lib/i386-linux-gnu/i686/cmov/libc.so.6 No symbol table info available. #2 0xb7610d72 in abort () from /lib/i386-linux-gnu/i686/cmov/libc.so.6 No symbol table info available. #3 0xb77912c0 in default_fatal_finish (type=, status=status at entry=0) at failures.c:191 backtrace = 0xb77de600 "<$\t" #4 0xb7791321 in i_internal_fatal_handler (ctx=0xbfd20944, format=0xb77bd4de "key not found from hash", args=0xbfd20964 "\204\n??Hv\005\b?ey?Wb?m\230v\005\b?\232x?") at failures.c:649 status = 0 #5 0xb7760edd in i_panic ( format=format at entry=0xb77bd4de "key not found from hash") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = 0xbfd20964 "\204\n??Hv\005\b?ey?Wb?m\230v\005\b?\232x?" #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) at hash.c:317 node = hash = 1839751767 #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) at master-service-settings-cache.c:167 No locals. #8 cache_add (parser=0x8b2f388, output=0xbfd209c0, input=0xbfd209c8, cache=0x8057648) at master-service-settings-cache.c:203 entry = pool = 0x8833fc0 pool_size = entry_local_name = #9 master_service_settings_cache_read (cache=0x8057648, input=input at entry=0xbfd20a68, dyn_parsers=dyn_parsers at entry=0x0, parser_r=parser_r at entry=0xbfd20a64, error_r=error_r at entry=0xbfd20a60) at master-service-settings-cache.c:297 output = {specific_services = 0x0, service_uses_local = 1, service_uses_remote = 0, used_local = 1, used_remote = 0} new_input = {roots = 0x804dba0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x804bc38 "imap-login", service = 0x804bc33 "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = {25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = { s_addr = 1839751767}}}, remote_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, local_name = 0x0} set = __FUNCTION__ = "master_service_settings_cache_read" #10 0xb77ef48d in login_settings_read (pool=0x9801dc8, local_ip=local_ip at entry=0xbfd20b1c, remote_ip=remote_ip at entry=0xbfd20b84, local_name=local_name at entry=0x0, other_settings_r=other_settings_r at entry=0xbfd20b18) at login-settings.c:226 input = {roots = 0x804dba0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x804bc38 "imap-login", service = 0x804bc33 "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = {25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = { s_addr = 1839751767}}}, remote_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, local_name = 0x0} error = parser = cache_sets = sets = i = count = __FUNCTION__ = "login_settings_read" #11 0xb77ef833 in client_connected_finish (conn=0xbfd20b78) at main.c:119 client = proxy = local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "Wb?m", '\000' , __u6_addr16 = { 25175, 28072, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1839751767, 0, 0, 0}}}, ip4 = {s_addr = 1839751767}}} set = local_port = 993 pool = 0x9801dc8 fd_ssl = other_sets = #12 0xb778929c in master_service_listen (l=0x834d308) at master-service.c:803 service = 0x8056398 conn = {fd = 155, listen_fd = 11, name = 0x8056585 "imaps", remote_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "[y?c", '\000' , __u6_addr16 = {31067, 25543, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1674017115, 0, 0, 0}}}, ip4 = { s_addr = 1674017115}}}, remote_port = 55451, fifo = 0, ssl = 1, accepted = 1} #13 0xb77a0054 in io_loop_call_io (io=0x834d438) at ioloop.c:379 ioloop = 0x8056468 t_id = 2 #14 0xb77a0ebe in io_loop_handler_run (ioloop=ioloop at entry=0x8056468) at ioloop-epoll.c:213 ctx = 0x834c488 events = 0x0 event = 0x96af618 list = 0x834d468 io = tv = {tv_sec = 45, tv_usec = 831525} events_count = 0 msecs = ret = 1 i = j = call = #15 0xb779f9f0 in io_loop_run (ioloop=0x8056468) at ioloop.c:398 No locals. #16 0xb7788aae in master_service_run (service=0x8056398, callback=callback at entry=0xb77efb60 ) at master-service.c:543 No locals. #17 0xb77f0300 in login_binary_run (binary=0x804bec0, argc=argc at entry=3, argv=0x80561c0, argv at entry=0xbfd20e14) at main.c:406 set_pool = 0x8056630 allow_core_dumps = login_socket = 0x80561e6 "director" c = #18 0x08049b63 in main (argc=3, argv=0xbfd20e14) at client.c:530 No locals. From Juergen.Obermann at hrz.uni-giessen.de Wed Aug 8 09:55:05 2012 From: Juergen.Obermann at hrz.uni-giessen.de (=?UTF-8?Q?J=C3=BCrgen_Obermann?=) Date: Wed, 08 Aug 2012 08:55:05 +0200 Subject: [Dovecot] doveadm import is always verbose Message-ID: Hello, with dovecot versions up to 2.1.9, when I use: doveadm import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all it always sends out info messages for every mail copied like that: doveadm(guser): Info: copy from mymail: box=restore_2012-05-08/mymail, uid=5, msgid=<######>, size=6999462 I had expected to see these info messages only if I add the verbose option to doveadm. And using the option -v with: doveadm -v import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all makes no difference at all, the same messages appear. The verbose option seems to be always on. Is this a bug or intended behaviour? Greetings, J?rgen -- J?rgen Obermann Hochschulrechenzentrum der Justus-Liebig-Universit?t Gie?en Heinrich-Buff-Ring 44 Tel. 0641-9913054 From madduck at madduck.net Wed Aug 8 12:08:10 2012 From: madduck at madduck.net (martin f krafft) Date: Wed, 8 Aug 2012 11:08:10 +0200 Subject: [Dovecot] Running spamc during LMTP delivery Message-ID: <20120808090810.GA9152@fishbowl.rw.madduck.net> Hello list, we are using dovecot-lmtp for delivery to virtual users, and vmm[1] to manage them. 1. http://vmm.localdomain.org/ One nice feature of vmm is that every virtual user has their own UID/GID on the UNIX filesystem. There is no passwd entry, so no shell login, but each user effectively has a home directory and can run commands in isolation and with lowered privileges. This requires dovecot-lmtp because only the LMTP LDA runs with root rights and can drop privileges to become the specific user for which it is delivering mail. We would now like to run SpamAssassin with the possibility of using the antispam plugin to enable virtual users to train their databases. Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an external command as a filter, to be run by the final user? Thanks, -- martin | http://madduck.net/ | http://two.sentenc.es/ "truth is stranger than fiction, but it is because fiction is obliged to stick to possibilities; truth isnt." -- mark twain spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From dgp-dove at corefiling.co.uk Wed Aug 8 13:01:30 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Wed, 08 Aug 2012 11:01:30 +0100 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120808090810.GA9152@fishbowl.rw.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> Message-ID: <502238FA.6040901@corefiling.co.uk> On 08/08/12 10:08, martin f krafft wrote: > Hello list, > > we are using dovecot-lmtp for delivery to virtual users, and vmm[1] > to manage them. > > 1. http://vmm.localdomain.org/ > > One nice feature of vmm is that every virtual user has their own > UID/GID on the UNIX filesystem. There is no passwd entry, so no > shell login, but each user effectively has a home directory and can > run commands in isolation and with lowered privileges. > > This requires dovecot-lmtp because only the LMTP LDA runs with root > rights and can drop privileges to become the specific user for which > it is delivering mail. > > We would now like to run SpamAssassin with the possibility of using > the antispam plugin to enable virtual users to train their > databases. > > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > external command as a filter, to be run by the final user? > > Thanks, Hi Martin, Have you taken a look at Pigeonhole and Sieve? There's experimental support for running spam filters and external commands. You'll need at least 0.3.0 which requires Dovecot 2.1. http://wiki2.dovecot.org/Pigeonhole/Sieve HTH, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From madduck at madduck.net Wed Aug 8 13:46:22 2012 From: madduck at madduck.net (martin f krafft) Date: Wed, 8 Aug 2012 12:46:22 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <502238FA.6040901@corefiling.co.uk> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> Message-ID: <20120808104622.GA16169@albatross.gern.madduck.net> also sprach Daniel Piddock [2012.08.08.1201 +0200]: > Have you taken a look at Pigeonhole and Sieve? There's experimental > support for running spam filters and external commands. You'll need at > least 0.3.0 which requires Dovecot 2.1. > > http://wiki2.dovecot.org/Pigeonhole/Sieve I have found this since and am working on it. Thanks! This looks like the ticket, and I will post back when I know more? -- martin | http://madduck.net/ | http://two.sentenc.es/ "we all know linux is great... it does infinite loops in 5 seconds." -- linus torvalds spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From Wiethoff at tfh-bochum.de Wed Aug 8 14:56:01 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Wed, 8 Aug 2012 11:56:01 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <20120807222226.GA8406@daniel.localdomain> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> Message-ID: <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> Hello Daniel, Daniel Parthey wrote: > Probably you are interested in reading the discussion from 2008: > http://www.dovecot.org/list/dovecot/2008-November/035263.html > > I think, a simple and robust solution would be to limit the > allowed characters for user passwords in your password > management system to 7-bit ASCII characters (only) and > reset passwords of all users having any login problems. Thanks for the link! I think I understood the major problem. But there is one point I couldn?t find out: From the dovecot auth-log I traced a password (T?st1234) with Umlaut: D-AS01:/var/log # grep st1234\) mail | cut -c 127-134 | hexdump -C 00000000 54 e4 73 74 31 32 33 34 0a |T.st1234.| 00000009 As you can see this is ISO-8859-1: e4 --> ? But the first incoming String from the client was UTF-8 encoded!? [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 Anyway... I guess I have to force our users to 7-bit Characters :-( Greetings, Helge ________________________________ Helge Wiethoff Medienzentrum Telefon: +49 (234) 968 8717 Fax: +49 (234) 968 3453 E-Mail: Wiethoff at tfh-bochum.de Technische Fachhochschule Georg Agricola f?r Rohstoff, Energie und Umwelt zu Bochum Staatlich anerkannte Fachhochschule der DMT-Gesellschaft f?r Lehre und Bildung mbH Herner Stra?e 45 44787 Bochum http://www.tfh-bochum.de ________________________________ Tr?ger: DMT-Gesellschaft f?r Lehre und Bildung mbH Sitz der Gesellschaft: Bochum Registergericht: Amtsgericht Bochum Handelsregister: B 4052 Gesch?ftsf?hrung: Prof. Dr. J?rgen Kretschmann (Vorsitzender) Manfred Freitag From andre.groebe at fun.de Wed Aug 8 15:23:00 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Wed, 08 Aug 2012 14:23:00 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict Message-ID: <50225A24.4010109@fun.de> Hi, I am using dovecot (see dovecot -n output below) with metadata plugin in my own plugin. I want to insert and delete some large metadata (>4KiB). It seems, that the delete in a second call of my plugin smashes the file dovecot.dict in users dir: 1st call: *dovecot.dict is empty -delete metadata 1 -delete metadata 2 -insert metadata 1 ~8KiB -insert metadata 2 <1KiB *dovecot.dict contains two entries 2nd call: -delete metadata 1 -delete metadata 2 -insert metadata 1 ~8KiB -insert metadata 2 <1KiB *dovecot.dict contains the two entries + some waste If all eight steps are called together (in the same plugin context) the file dovecot.dict seems to be ok. I have created a test plugin to reproduce this behaviour: . It needs the notify and (patched) metadata plugin to run. To get it work i copy an email from one IMAP folder to another (to trigger the copy notifier). It seems, that there is an issue on writing metadata/dict, can anybody reproduce it or knows what is wrong? TIA -- Andre From andre.groebe at fun.de Wed Aug 8 15:33:03 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Wed, 08 Aug 2012 14:33:03 +0200 Subject: [Dovecot] [bulk]: Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <50225C7F.2070300@fun.de> missing patch and info: metadata patch ============== --- a/src/metadata-backend.c +++ b/src/metadata-backend.c @@ -130,7 +130,8 @@ metadata_set_entry(struct metadata_entry *entry, struct mail_user *user) { if (!metadata_entry_is_valid(entry)) return -METADATA_ERROR_INVALID; - if (strlen(metadata_entry_get_value(entry)) > muser->set->maxsize) + if (metadata_entry_get_value(entry) != NULL + && strlen(metadata_entry_get_value(entry)) > muser->set->maxsize) return -METADATA_ERROR_TOOLARGE; if (count_entries(muser) > muser->set->maxentries) return -METADATA_ERROR_TOOMANY; --- a/Makefile.am +++ b/Makefile.am @@ -1,3 +1,6 @@ ACLOCAL_AMFLAGS = -I m4 SUBDIRS = src + +pkginc_libdir=$(dovecot_pkgincludedir)/metadata +nodist_pkginc_lib_HEADERS = metadata-config.h --- a/src/Makefile.am +++ b/src/Makefile.am @@ -42,7 +42,7 @@ lib90_imap_annotatemore_plugin_la_LIBADD = \ lib80_metadata_plugin.la endif -noinst_HEADERS = \ +headers = \ metadata-backend.h \ metadata-entry.h \ metadata-entry-private.h \ @@ -55,3 +55,6 @@ noinst_HEADERS = \ imap-arg-ext.h \ mailbox-ext.h \ str-ext.h + +pkginc_libdir=$(dovecot_pkgincludedir)/metadata +pkginc_lib_HEADERS = $(headers) dovecot -n ========== # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35-1exp2-intern-k8-kvm x86_64 Debian 6.0.5 ext3 debug_log_path = /var/opt/dovecot/log/dovecot.log default_vsz_limit = 512 M disable_plaintext_auth = no first_valid_uid = 0 info_log_path = /var/opt/dovecot/log/dovecot.log lmtp_check_rcpt = yes lmtp_rcpt_to_parameters { * = i: ignorequota = b:plugin/quota_ignore xtolain = s:plugin/lain xtomsgtype = s:plugin/mailtype_xtomsgtype xtospam = b:plugin/spamflag_xtospam xtovacation = B:plugin/sieve_xtovacation } log_path = /var/opt/dovecot/log/dovecot.log log_timestamp = "%y%m%H%M%S " mail_gid = mail mail_home = /var/spool/dovecot/%2.256Hu/%3.4096Hu/%u mail_location = mdbox:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u mail_plugin_dir = /opt/app/dovecot/lib/dovecot mail_plugins = notify metadata test mail_uid = mail namespace inbox { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = nocache=y /var/spool/dovecot/deny deny = yes driver = passwd-file } passdb { args = nopassword=y driver = static } plugin { acl = vfile autocreate = INBOX.Drafts autocreate2 = INBOX.Sent autocreate3 = INBOX.Trash metadata_dict = file:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u/dovecot.dict metadata_maxsize = 10240 quota = dict:User quota::file:/var/spool/dovecot/%2.256Hu/%3.4096Hu/%u/dovecot.dict quota_rule = *:bytes=999999 quota_rule2 = *:messages=999 quota_rule3 = *:mailboxes=99 quota_rule4 = *:levels=9 quota_rule5 = INBOX.Voicebox:ignore } service anvil { unix_listener anvil { group = dovecot mode = 0660 } } service auth-worker { user = $default_internal_user } service auth { unix_listener auth-userdb { group = dovecot mode = 0660 } } service config { unix_listener config { group = dovecot mode = 0660 } } service dict { unix_listener dict { mode = 0600 user = mail } } service lmtp { inet_listener lmtp { port = 2003 } } ssl = no userdb { args = /opt/app/dovecot/etc/dovecot/dovecot-tdbfcall.conf.ext driver = tdbfcall } protocol imap { mail_plugins = notify metadata test autocreate imap_metadata imap_annotatemore } protocol pop3 { pop3_uidl_format = %v.%u } -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Wed Aug 8 16:09:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:09:09 +0300 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120808090810.GA9152@fishbowl.rw.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> Message-ID: <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> On 8.8.2012, at 12.08, martin f krafft wrote: > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > external command as a filter, to be run by the final user? Use spampd LMTP proxy? From tss at iki.fi Wed Aug 8 16:14:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:14:13 +0300 Subject: [Dovecot] error message. Some help please In-Reply-To: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> References: <1344332434.51556.YahooMailNeo@web132202.mail.ird.yahoo.com> Message-ID: <3B1B423B-AAD3-405A-86EE-31063DD914E0@iki.fi> On 7.8.2012, at 12.40, Spyros Tsiolis wrote: > Jul 06 13:51:20 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count > Jul 18 15:20:32 dovecot: Warning: All login processes are in use. You may need to increase login_max_processes_count > Jul 19 09:16:40 dovecot: Warning: Killed with signal 15 (by pid=3062 uid=0 code=kill) > ......... > > Should I just go ahead and increase login_max_processes_count ? > Is it that simple ? Yes, you probably should just increase it. http://wiki1.dovecot.org/LoginProcess has more info. From tss at iki.fi Wed Aug 8 16:16:17 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:16:17 +0300 Subject: [Dovecot] replication chain In-Reply-To: <213B51F00051AE48A9F0E11288017717B84099@Delta.sc.local> References: <213B51F00051AE48A9F0E11288017717B84099@Delta.sc.local> Message-ID: On 7.8.2012, at 15.04, ???????? ????????? ?????????? wrote: > good day! > > I wonder if it is possible to make a chain of replication in dovecot 2.1.9. > Now I'm using two way replication(I use proxy to redirect users) and it's working just fine but > is it possible to setup replication like this: > > serverA ---> serverB --> server C > <--- > > I've added additional mail_replica2 on serverB > and after restart dovecot didn't complain about errors, > with doveconf -n I am able to see two replica's settings but > user's mails aren't replicating to server C. > no errors in logs. > I want to use server C as backup server with lvm snapshots. The automatic replication currently can replicate to only one other server. And the replication doesn't trigger again when dsync is run. You could do this if you manually run dsync e.g. in a cronjob. From tss at iki.fi Wed Aug 8 16:20:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:20:15 +0300 Subject: [Dovecot] Dovecot with Company - level Quota In-Reply-To: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> References: <1344352663.2482.YahooMailNeo@web193504.mail.sg3.yahoo.com> Message-ID: <5F1A3083-7354-44DA-BBA1-CD7DCE80115C@iki.fi> On 7.8.2012, at 18.17, Kavish Karkera wrote: > We are using maildir as quota-backend , and performing user level quota, which is working fine. (using dovecot 2.x ). > > Now the requirement is to , restrict the quota to client / company level along with user level quota. http://www.dovecot.org/list/dovecot/2010-May/049168.html http://wiki2.dovecot.org/Quota/Dict The quota recalculation (also means setting the initial quota) is still a problem. I guess it could be possible to fix nowadays since you can also script it by doing something like: doveadm quota get -u '*@example.com' and sum up the quota values and update the domain quota. From tss at iki.fi Wed Aug 8 16:21:50 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:21:50 +0300 Subject: [Dovecot] doveadm import is always verbose In-Reply-To: References: Message-ID: <5D3FA231-0235-478B-A375-320FE798844F@iki.fi> On 8.8.2012, at 9.55, J?rgen Obermann wrote: > doveadm(guser): Info: copy from mymail: box=restore_2012-05-08/mymail, uid=5, msgid=<######>, size=6999462 > I had expected to see these info messages only if I add the verbose option to doveadm. And using the option -v with: > doveadm -v import -u guser mbox:/tmp/mbox/guser/restore_2012-05-08 restore_2012-05-08 all > makes no difference at all, the same messages appear. The verbose option seems to be always on. Is this a bug or intended behaviour? Those messages are coming from mail_log plugin. You could do something like: protocol doveadm { plugin { mail_log_events = } } From tss at iki.fi Wed Aug 8 16:41:06 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 16:41:06 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50220A3E.407@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> Message-ID: <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> On 8.8.2012, at 9.42, tonio at starbridge.org wrote: > I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) > > Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) .. > #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) > at hash.c:317 > node = > hash = 1839751767 > #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) > at master-service-settings-cache.c:167 I don't see how this could happen by looking at the code. I also can't reproduce this myself. Can you easily reproduce this? Could you run imap-login via valgrind (it slows things down): service imap-login { executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login } (you may not have/need --vgdb=no, depends on your valgrind version) From asier.cidon at externo.uam.es Wed Aug 8 17:12:52 2012 From: asier.cidon at externo.uam.es (asier.cidon at externo.uam.es) Date: Wed, 08 Aug 2012 16:12:52 +0200 Subject: [Dovecot] sieve vacation messages trouble Message-ID: <20120808161252.79072gldxhycsphc@webmail.uam.es> The problem is solved!!!! In the library "src/lib-sieve/plugins/vacation/cmd-vacation.c", in the package "dovecot-sieve" or "dovecot-pigeonhole" modify: smtp_handle = sieve_smtp_open(senv, reply_to, NULL, &f); smtp_handle = sieve_smtp_open(senv, reply_to, reply_from, &f); You can check the correct operation in your logs. /var/log/maillog postfix/smtpd[27112]: connect from smtp.mydomain.com postfix/smtpd[27112]: A95D2168456: client=smtp.mydomain.com postfix/cleanup[27114]: A95D2168456: message-id= postfix/smtpd[27112]: disconnect from smtp.mydomain.com postfix/qmgr[17010]: A95D2168456: from=, size=7274, nrcpt=1 (queue active) postfix/pipe[27115]: A95D2168456: to=, relay=dovecot, delay=0.09, delays=0.01/0/0/0.08, dsn=2.0.0, status=sent (delivered via dovecot service) postfix/qmgr[17010]: A95D2168456: removed /var/log/dovecot.log dovecot: auth(default): master out: USER 1 asier.cidon at mydomain.com uid=xxx gid=xxx quota_rule=*:bytes=524288000 home=/buzon/asier.cidon dovecot: deliver(asier.cidon at mydomain.com): sieve: msgid=: sent vacation response to dovecot: deliver(asier.cidon at mydomain.com): sieve: msgid=: stored mail into mailbox 'INBOX' /var/log/maillog postfix/pickup[17009]: B221D168458: uid=xxx from= postfix/cleanup[27114]: B221D168458: message-id= postfix/qmgr[17010]: B221D168458: from=, size=661, nrcpt=1 (queue active) postfix/smtp[27195]: B221D168458: to=, relay=smtpinterno.mydomain.com, delay=0.04, delays=0.01/0/0.01/0.01, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as A3A092280B3) postfix/qmgr[17010]: B221D168458: removed From stephan at rename-it.nl Wed Aug 8 17:32:48 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 08 Aug 2012 16:32:48 +0200 Subject: [Dovecot] sieve vacation messages trouble In-Reply-To: <20120808161252.79072gldxhycsphc@webmail.uam.es> References: <20120808161252.79072gldxhycsphc@webmail.uam.es> Message-ID: <50227890.7040107@rename-it.nl> Op 8/8/2012 4:12 PM, asier.cidon at externo.uam.es schreef: > The problem is solved!!!! > > > In the library "src/lib-sieve/plugins/vacation/cmd-vacation.c", in the > package "dovecot-sieve" or "dovecot-pigeonhole" modify: > > smtp_handle = sieve_smtp_open(senv, reply_to, NULL, &f); > smtp_handle = sieve_smtp_open(senv, reply_to, reply_from, &f); As pointed out earlier in this thread, this is a qmail issue. The SMTP MAIL FROM is set to <> on purpose: http://tools.ietf.org/html/rfc3834#section-3.3 http://tools.ietf.org/html/rfc5230#section-5.1 This prevents other automated responders from replying to this message, e.g. an MTA sending a delivery failure. This (among other safeguards) prevents mail loops. The above change is therefore not recommended. Regards, Stephan. From nikolai at net24.co.nz Wed Aug 8 18:28:27 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Thu, 9 Aug 2012 03:28:27 +1200 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> Message-ID: <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> Hi Timo, Thanks for your fix! Just want to confirm that the re-order of connections has fixed the issue. We still have occasional issues with the POP3 server (locking issues and busy timeouts etc). Because dsync reports sync ok, we have parse to output looking for 'Error: pop3_migration' to determine if it was in-fact ok or if we need to do a re-sync. We have seen some IMAP 'Server dsconnected unexpectedly' errors also (on large mailboxes again), but it doesn't appear to cause any issues. Does dsync reconnect if the IMAP connection is lost? Thank you. Regards, Nikolai. On 4/08/2012, at 2:40 AM, Timo Sirainen wrote: > On 3.8.2012, at 10.04, Nikolai Schupbach wrote: > >> There is a problem with the dsync POP3 migration plugin when syncing a large INBOX. What happens is dsync establishes a connection to the POP3 server at the beginning of the sync, but then it sits there idle until it's used to sync the UIDLs. On a very large inbox with many thousands of messages it will be idle for longer than a POP3 server's idle timeout setting. > > What should happen is: > > 1. pop3c connects to server > 2. issues LIST and UIDL commands > 3. IMAP server issues fetch 1:* RFC822.SIZE (or I guess it does this with a ton of separate commands) > 4. pop3c attempts to do some TOP commands. > >> When the UIDL sync occurs dsync produces the following errors (because the connection has been lost due to the POP3 server's inactivity timeout): >> >> dsync(first.last at test.co.nz): Error: pop3c(pop3.test.com): Server disconnected unexpectedly >> dsync(first.last at test.co.nz): Error: pop3_migration: Failed to get header for msg 13: Disconnected > > It looks like the 3 step takes a long time. Do you have imapc_features=rfc822.size? Also setting mail_prefetch_count to something between 10..100 should help a lot. And this should also fix it by moving 3 step to 1: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d > >> Also at the end of the dsync it actually has an exit status of 0, but it shouldn't because the POP3 sync failed, and none of the UIDLs are retained. > > Yes, looks like dsync simply continues without assigning POP3 UIDL. Hmm. Perhaps it shouldn't do that on temporary failures.. > >> Dsync should try to keep the POP3 connection alive, by sending a regular 'NOOP' command to the POP3 server, > > This isn't easily possible. > >> or it should simply reconnect if sees the connection is lost. > > It should probably do that, yes. From tss at iki.fi Wed Aug 8 18:59:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 8 Aug 2012 18:59:07 +0300 Subject: [Dovecot] dsync and pop3 migration plugin fails for large inbox due to idle timeout In-Reply-To: <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> References: <3CA5EA01-FA0A-49F8-B2AB-977215D6175A@net24.co.nz> <54CA4A97-8E88-4794-B006-12EDF2859FB7@iki.fi> <1A4147F4-1686-4233-9D59-48F3C0635F25@net24.co.nz> Message-ID: <8D9C4418-B83E-403C-9669-2A3F0278795A@iki.fi> On 8.8.2012, at 18.28, Nikolai Schupbach wrote: > Hi Timo, > > Thanks for your fix! Just want to confirm that the re-order of connections has fixed the issue. We still have occasional issues with the POP3 server (locking issues and busy timeouts etc). Because dsync reports sync ok, we have parse to output looking for 'Error: pop3_migration' to determine if it was in-fact ok or if we need to do a re-sync. v2.2 dsync gives a real error instead of ignoring the problem. > We have seen some IMAP 'Server dsconnected unexpectedly' errors also (on large mailboxes again), but it doesn't appear to cause any issues. Does dsync reconnect if the IMAP connection is lost? Yes, the imapc backend code does automatic reconnections. From kind at it.uib.no Wed Aug 8 19:13:21 2012 From: kind at it.uib.no (Hans Morten Kind) Date: Wed, 8 Aug 2012 18:13:21 +0200 Subject: [Dovecot] Statistics scripts In-Reply-To: <42DEDB45-6B9A-47BB-BFB1-B82ECC086839@iki.fi> References: <42DEDB45-6B9A-47BB-BFB1-B82ECC086839@iki.fi> Message-ID: <20120808161320.GA1497@alf.uib.no> I guess everybody has spent their holiday looking into the stats features of dovecot-2.1! This is as far as I have got, it is a perl-script using Curses to smooth the screen and capture keystrokes while running. Mostly tested on Solaris but should probably run everywhere setting $base_dir, it does not make use of temporary files. http://half.uib.no/dovtop/dovtop.txt Our site has app 20k users with 4-5k concurrent. We have been using dovecot since 2006 with great success - though a lot of the staff are prefering exhcange to get the calendar ... When running for a while with a sleeptime of 10 or more 'dovtop' should give a reasonable status of current usage? hmk From uros.gruber at gmail.com Wed Aug 8 19:13:42 2012 From: uros.gruber at gmail.com (Uros) Date: Wed, 8 Aug 2012 18:13:42 +0200 Subject: [Dovecot] Quota dict configuration Message-ID: Hi, I have enabled quota dict with mysql following wiki http://wiki2.dovecot.org/Quota/Dict Everything work as expected. I just have a question about query used for updating quota usage. I already check the source file dict-sql.c but i still can't figure it out. I store user info in a mysql table where only left (user) part of an email address is stored with foreign id for domain conected to domain table. The problem is administration because quota table have primary key whole email. Is there even possible to configure quota dict settings to use separate variables %n and %d like in user and password query? -- lp Uro? From acrow at integrafin.co.uk Wed Aug 8 21:19:55 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Wed, 08 Aug 2012 19:19:55 +0100 Subject: [Dovecot] Dsync and SIS Message-ID: <5022ADCB.8060805@integrafin.co.uk> Hi all, Just to clarify, if we back up a dovecot 2 server with SIS for attachments and ALT storage by rsyncing it (including the SIS and ALT storage) to a remote server when it's idle (or at least almost entirely so), and run dovecot on that machine, would it seem feasible to restore backups from that server by using dysnc - specifically for the scenario where someone accidentally deletes emails/folders etc.? I've seen queries about SIS before but nothing specifically about this scenario. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From elias.tamas at vagyok.eu Thu Aug 9 03:34:13 2012 From: elias.tamas at vagyok.eu (_ET_) Date: Wed, 8 Aug 2012 17:34:13 -0700 (PDT) Subject: [Dovecot] maildir to sdbox offline conversion Message-ID: <34274589.post@talk.nabble.com> Hi all. I've just installed dovecot v2.1 in a multihomed, multiinstance setup, It took me two days to convert the old v1.1 configs, now everything works like charm! But. :) I have several maildir mailboxes, I decided to use the sdbox storage type instead. I ran into difficoulties using the dsync util. My virtual users are in an OpenLDAP DB on a differnet machine, and I do not have access to the database (I can authenticate the users from ldap, but cannot change or see anything) So it's not easy to do an "online" conversion and follow the instructions at dsync's wiki. Do you know a way how to simply tell dsync or a similar util the following dsync convert maildir:/data/vmail/domain/user sdbox:/newdata/vmail/domain/user without touching the ldap database, only the files on the disk. I can run this command as root on this mail server, if it is needed, I can run the command for each and every maildir. That's not a problem. any ideas, how this woul?d be the simpliest? -- View this message in context: http://old.nabble.com/maildir-to-sdbox-offline-conversion-tp34274589p34274589.html Sent from the Dovecot mailing list archive at Nabble.com. From matthew at atom.net Thu Aug 9 05:10:30 2012 From: matthew at atom.net (Matthew Powell) Date: Wed, 8 Aug 2012 22:10:30 -0400 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> Message-ID: <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> On 2012-08-08, at 7.56, "Wiethoff, Helge" wrote: > As you can see this is ISO-8859-1: e4 --> ? > But the first incoming String from the client was UTF-8 encoded!? > > [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 > > Anyway... I guess I have to force our users to 7-bit Characters :-( You mentioned Roundcube earlier. I notice this in Roundcube's default main.inc.php: // Password charset. // Use it if your authentication backend doesn't support UTF-8. // Defaults to ISO-8859-1 for backward compatibility $rcmail_config['password_charset'] = 'ISO-8859-1'; ...so changing that to UTF-8 may fix the problem so far as Roundcube is concerned. But you may still face a problem with other clients. We just discussed Thunderbird's behaviour a few days back... -- Matthew Powell matthew at atom.net From ml-dovecot at zu-con.org Thu Aug 9 09:20:17 2012 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Thu, 09 Aug 2012 08:20:17 +0200 Subject: [Dovecot] Mail deletion and Solr index update In-Reply-To: <1344375938.19913.85.camel@hurina> References: <501B7490.1020108@zu-con.org> <9FD010AC-3E99-4BC5-939D-E74083787DC1@iki.fi> <501CCB1C.80908@zu-con.org> <1344375938.19913.85.camel@hurina> Message-ID: Hi, Am 07.08.2012 23:45, schrieb Timo Sirainen: > On Sat, 2012-08-04 at 09:11 +0200, Matthias Rieber wrote: >> >> I've deleted 10000s emails and it seems that every mail is >> removed with >> >> a single request from Solrs index. This works, but it's quite >> slow. Is >> >> it possible/plans to improve that? >> > >> > Could you try if the attached patch works? It compiles, but didn't >> test it. >> >> it segfaults: > > This should work: http://hg.dovecot.org/dovecot-2.1/rev/82f59d2139a9 perfect. I deleted the content of a folder with ~50000 mails, the speed was good. Matthias From stsiol at yahoo.co.uk Thu Aug 9 09:31:26 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Thu, 9 Aug 2012 07:31:26 +0100 (BST) Subject: [Dovecot] dovecot rpm packages for CentOS ? Message-ID: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Hello all again, Has anyone any idea how to get the latest dovecot version for CentOS 5.8 or 6.2 32-bit OS ? I did a quick search and found out that the official version of dovecot for CentOS v5.8 is 1.0.2 (!!). Any repos ? Any ideas :-) ? Thank you all, spyros ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From bmalik at ihlas.net.tr Thu Aug 9 09:10:20 2012 From: bmalik at ihlas.net.tr (Bulend Mali) Date: Wed, 8 Aug 2012 23:10:20 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 Message-ID: <34275123.post@talk.nabble.com> Hello I use dovecot2 on vpopmail,qmail. i want to use login-intranet-imap.sh in order to restrict by emailaddress and ip address. i read it at http://wiki2.dovecot.org/PostLoginScripting. But there is an expression "mail_executable" in conf. but there is no such thing in dovecot2. what is equivalent of it for dovecot2 ? -- View this message in context: http://old.nabble.com/about-postlogin-in-dovecot2-tp34275123p34275123.html Sent from the Dovecot mailing list archive at Nabble.com. From voytek at sbt.net.au Thu Aug 9 09:42:12 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Thu, 9 Aug 2012 16:42:12 +1000 Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> References: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Message-ID: <445039c8e7186d42c3750792f42bd3b5.squirrel@geko.sbt.net.au> On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > Hello all again, > Has anyone any idea how to get the latest dovecot version for CentOS > 5.8 or 6.2 32-bit OS ? > I did a quick search and found out that the official version of dovecot > for CentOS v5.8 is 1.0.2 (!!). > > Any repos ? Any ideas :-) ? I've followed/used the link on dovecot main page, and, ended up with: # dovecot --version 2.1.1 dovecot-2.1.1-2_132.el6.i686.rpm dovecot-2.1.1-2_132.el6.x86_64.rpm -- Voytek Eymont From tonio at starbridge.org Thu Aug 9 10:15:12 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Thu, 09 Aug 2012 09:15:12 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> Message-ID: <50236380.1070703@starbridge.org> Le 08/08/2012 15:41, Timo Sirainen a ?crit : > On 8.8.2012, at 9.42, tonio at starbridge.org wrote: > >> I've just tried this patch, so far pop-login error doesnt shows up , but now I've got this one: (imap-login this time) >> >> Aug 8 08:19:36 eol1 dovecot: imap-login: Fatal: master: service(imap-login): child 31887 killed with signal 6 (core dumped) > .. >> #6 0xb779678d in hash_table_remove (table=0x83596b8, key=0x8833fe0) >> at hash.c:317 >> node = >> hash = 1839751767 >> #7 0xb778adda in setting_entry_detach (entry=0x8833fd0, cache=0x8057648) >> at master-service-settings-cache.c:167 > I don't see how this could happen by looking at the code. I also can't reproduce this myself. Can you easily reproduce this? Could you run imap-login via valgrind (it slows things down): > > service imap-login { > executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login > } > > (you may not have/need --vgdb=no, depends on your valgrind version) > Timo, I can'f find what trigger this error, and it seems only happenig under some load here the error log in mail.log: (by the way, this is not the same server than before, this one running a Debian Wheezy on a 2.6.32.2 linux kernel and 64 bits architecture.) Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EE3D: client_connected_finish (main.c:139) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508C3E4: master_service_listen (master-service.c:803) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA6A: login_settings_read (login-settings.c:226) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x509FC87: io_loop_run (ioloop.c:398) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BB3: settings_parser_get_list (settings-parser.c:255) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EE3D: client_connected_finish (main.c:139) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508C3E4: master_service_listen (master-service.c:803) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA6A: login_settings_read (login-settings.c:226) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41347: ssl_servername_callback (ssl-proxy-openssl.c:1144) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568F161: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567B204: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x567F8C4: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x568C102: ??? (in /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E41AF0: ssl_step (ssl-proxy-openssl.c:465) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0275: io_loop_call_io (ioloop.c:379) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x50A0F06: io_loop_handler_run (ioloop-epoll.c:213) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x509FC87: io_loop_run (ioloop.c:398) Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Aug 9 09:01:37 smtp dovecot: imap-login: Panic: file login-settings.c: line 232 (login_settings_read): assertion failed: (cache_sets[count] == NULL) backtrace on vgcore: gdb /usr/lib/dovecot/imap-login /root/vgcore.27313 GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/lib/dovecot/imap-login...done. warning: core file may not match specified executable file. [New LWP 27313] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `'. Program terminated with signal 6, Aborted. #0 0x0000000005311475 in *__GI_raise (sig=) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 64 ../nptl/sysdeps/unix/sysv/linux/raise.c: Aucun fichier ou dossier de ce type. (gdb) bt full #0 0x0000000005311475 in *__GI_raise (sig=) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 pid = selftid = #1 0x00000000053146f0 in *__GI_abort () at abort.c:92 act = {__sigaction_handler = {sa_handler = 0x4e45130, sa_sigaction = 0x4e45130}, sa_mask = {__val = {34342962424, 84234600, 67249360, 84246240, 4294967295, 86924192, 67250608, 2684328, 4294967295, 34342962672, 1, 2679208, 0, 34342962672, 113514016, 84197376}}, sa_flags = 67164658, sa_restorer = 0x1} sigs = {__val = {32, 0 }} #2 0x0000000005093538 in default_fatal_finish (type=, status=status at entry=0) at failures.c:191 backtrace = 0x76d2364 "\003\003P#`P1" #3 0x000000000509356e in i_internal_fatal_handler (ctx=0x7ff0004e0, format=, args=) at failures.c:649 status = 0 #4 0x0000000005067efa in i_panic (format=format at entry=0x4e45130 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ff0005d0, reg_save_area = 0x7ff000510}} #5 0x0000000004e3ecd4 in login_settings_read (pool=0x8783670, local_ip=local_ip at entry=0xafce3e4, remote_ip=remote_ip at entry=0xafce3f8, local_name=, other_settings_r=other_settings_r at entry=0x7ff000698) at login-settings.c:232 input = {roots = 0x6056c0, config_path = 0x0, preserve_environment = false, preserve_user = false, preserve_home = false, never_exec = false, use_sysexits = false, parse_full_config = false, module = 0x4043b4 "imap-login", service = 0x4043af "imap", username = 0x0, local_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "Wb?e", '\000' , __u6_addr16 = {25175, 26023, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1705468503, 0, 0, 0}}}, ip4 = {s_addr = 1705468503}}}, remote_ip = {family = 2, u = { ip6 = {__in6_u = {__u6_addr8 = ".il?", '\000' , __u6_addr16 = {26926, 53868, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {3530320174, 0, 0, 0}}}, ip4 = {s_addr = 3530320174}}}, local_name = 0x75f1b00 "imap.spamguard.fr"} error = parser = 0x65fc1c0 cache_sets = 0x6c41628 sets = i = count = ---Type to continue, or q to quit--- __FUNCTION__ = "login_settings_read" #6 0x0000000004e41348 in ssl_servername_callback (ssl=0x6cf8c70, al=, context=) at ssl-proxy-openssl.c:1144 ctx = proxy = client = 0xafce360 host = other_sets = 0x1 #7 0x000000000568f162 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #8 0x000000000567b205 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #9 0x000000000567f8c5 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #10 0x000000000568c103 in ?? () from /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 No symbol table info available. #11 0x0000000004e41af1 in ssl_handshake (proxy=0x7010e10) at ssl-proxy-openssl.c:465 ret = #12 ssl_step (proxy=0x7010e10) at ssl-proxy-openssl.c:528 No locals. #13 0x0000000004e420c5 in ssl_proxy_start (proxy=) at ssl-proxy-openssl.c:658 No locals. #14 0x0000000004e3ee3e in client_connected_finish (conn=0x7ff000880) at main.c:139 client = 0xafce360 proxy = 0x7010e10 local_ip = {family = 2, u = {ip6 = {__in6_u = {__u6_addr8 = "Wb?e", '\000' , __u6_addr16 = { 25175, 26023, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {1705468503, 0, 0, 0}}}, ip4 = {s_addr = 1705468503}}} set = 0x87836a8 local_port = 993 pool = 0x8783670 fd_ssl = other_sets = 0x8783698 #15 0x000000000508c3e5 in master_service_listen (l=0x7187990) at master-service.c:803 service = 0x64ef820 ---Type to continue, or q to quit--- conn = {fd = 141, listen_fd = 9, name = 0x64efd3a "imaps", remote_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = ".il?", '\000' , __u6_addr16 = {26926, 53868, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {3530320174, 0, 0, 0}}}, ip4 = {s_addr = 3530320174}}}, remote_port = 34589, fifo = 0, ssl = 1, accepted = 1} #16 0x00000000050a0276 in io_loop_call_io (io=0x7187bd0) at ioloop.c:379 ioloop = 0x64efa10 t_id = 2 #17 0x00000000050a0f07 in io_loop_handler_run (ioloop=ioloop at entry=0x64efa10) at ioloop-epoll.c:213 ctx = 0x7185c80 events = 0x0 event = 0xae5d410 list = 0x7187c50 io = tv = {tv_sec = 54, tv_usec = 854242} events_count = msecs = ret = 1 i = call = #18 0x000000000509fc88 in io_loop_run (ioloop=0x64efa10) at ioloop.c:398 No locals. #19 0x000000000508bd23 in master_service_run (service=0x64ef820, callback=callback at entry=0x4e3f060 ) at master-service.c:543 No locals. #20 0x0000000004e3f6fe in login_binary_run (binary=, argc=2, argv=0x64ef450) at main.c:406 set_pool = 0x64eff90 allow_core_dumps = login_socket = c = #21 0x00000000052fdead in __libc_start_main (main=, argc=, ubp_av=, init=, fini=, rtld_fini=, stack_end=0x7ff000b38) at libc-start.c:228 result = unwind_buf = {cancel_jmp_buf = {{jmp_buf = {0, 4734455784457788985, 4203696, 34342964032, 0, 0, 4736613026474909241, 4734444482055265849}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x4041a0, ---Type to continue, or q to quit--- 0x7ff000b48}, data = {prev = 0x0, cleanup = 0x0, canceltype = 4211104}}} not_first_call = #22 0x00000000004024d9 in _start () No symbol table info available. From tss at iki.fi Thu Aug 9 10:27:06 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 10:27:06 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <50236380.1070703@starbridge.org> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> Message-ID: <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> On 9.8.2012, at 10.15, tonio at starbridge.org wrote: >> Could you run imap-login via valgrind (it slows things down): >> >> service imap-login { >> executable = /usr/bin/valgrind -q --vgdb=no /usr/local/libexec/dovecot/imap-login >> } >> >> (you may not have/need --vgdb=no, depends on your valgrind version) >> > > Timo, > I can'f find what trigger this error, and it seems only happenig under some load > here the error log in mail.log: .. > Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) .. > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) > Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) Thanks. Obviously I shouldn't free cached settings while they're still being used. :) I'll get it fixed tomorrow. For now you could work around it by increasing config_cache_size setting (default is 1M). From c at roessner-network-solutions.com Thu Aug 9 11:14:13 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 9 Aug 2012 10:14:13 +0200 Subject: [Dovecot] some mdbox mails get lost each day Message-ID: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> Hi, I have a strange problem here. I had installed Dovecot-2.1.6 on a customers setup. They have 102 mail accounts on the server. The started using this dovecot version on the 20th June. One mailbox suddenly started expunging mails. Not from the current day, but one week back in the past. First I thought about an Outlook issue. Some filter or archieving thing, but we did a test and on one day, the curstomer did not start Outlook first; instead he checked his mails with the SOGo-webinterface. We saw that mails got deleted again. I checked for sieve filters. None. I upgraded dovecot to 2.1.7, as I have not done any newer packages yet for Ubuntu (using my own PPA). Same problem one day later. I tested with telnet locally. Same result as in the client. I also did doveadm dump -t log and index and saw that there had been expunged mails. Yesterday I asked the customer to backup all his mails in Outlook. After that I renamed the whole mdbox folder of this account on the server and sent one test mail to recreate the mailbox. After that her restored his mail in Outlook. This morning her contacted me and said that all mails are ok right now and no mails have been erased anymore. Coud this been a corrupted index? I also chekced the storage/-folder and see that all mails are still on disk. Now he asked me if there is any way to get all the lost messaged back? It would be okay for him, if all mails since June are sent again, as he can clean his mailbox afterwards. So does somebody have an idea on how to solve this? Maybe scripting something in python and using local sendmail command? Or is there some doveadm voodoo to repair the index or unexpunge all mails? Thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From tss at iki.fi Thu Aug 9 11:20:42 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 11:20:42 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> Message-ID: <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> On 9.8.2012, at 11.14, Christian R??ner wrote: > I have a strange problem here. I had installed Dovecot-2.1.6 on a customers setup. They have 102 mail accounts on the server. The started using this dovecot version on the 20th June. One mailbox suddenly started expunging mails. Not from the current day, but one week back in the past. First I thought about an Outlook issue. Some filter or archieving thing, but we did a test and on one day, the curstomer did not start Outlook first; instead he checked his mails with the SOGo-webinterface. We saw that mails got deleted again. A wrongly used doveadm expunge in a cronjob? mail_log plugin is very helpful when trying to figure out what deletes messages. http://wiki2.dovecot.org/Plugins/MailLog > Yesterday I asked the customer to backup all his mails in Outlook. After that I renamed the whole mdbox folder of this account on the server and sent one test mail to recreate the mailbox. After that her restored his mail in Outlook. This morning her contacted me and said that all mails are ok right now and no mails have been erased anymore. > > Coud this been a corrupted index? Corrupted indexes would log errors in log file. Do you see any errors/warning? > I also chekced the storage/-folder and see that all mails are still on disk. Now he asked me if there is any way to get all the lost messaged back? It would be okay for him, if all mails since June are sent again, as he can clean his mailbox afterwards. So does somebody have an idea on how to solve this? Maybe scripting something in python and using local sendmail command? > > Or is there some doveadm voodoo to repair the index or unexpunge all mails? cp mdbox ~/mdbox-backup rm -rf ~/mdbox-backup/storage/dovecot.map* ~/mdbox-backup/mailboxes/ doveadm import mdbox:~/mdbox-backup all-mails all Now all the mails in m.* files are under all-mails folder. From nikolai at net24.co.nz Thu Aug 9 11:20:56 2012 From: nikolai at net24.co.nz (Nikolai Schupbach) Date: Thu, 9 Aug 2012 20:20:56 +1200 Subject: [Dovecot] dsync \noselect on INBOX.INBOX skips sync of INBOX Message-ID: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> Hi Timo, We have encountered an issue today with a number of migrations. Some customers have mailboxes on the source IMAP server that look like this: 3 LIST "" * * LIST () "." "INBOX" * LIST () "." "INBOX.Statements" * LIST () "." "INBOX.Draft" * LIST () "." "INBOX.Drafts" * LIST () "." "INBOX.Invoices" * LIST (\Noselect) "." "INBOX.INBOX" * LIST () "." "INBOX.Jokes" * LIST () "." "INBOX.Payslips" * LIST () "." "INBOX.Personal" When we run dsync it skips the INBOX presumably because of the Noselect on INBOX.INBOX. and the "imapc_list_prefix = INBOX" setting. Regards, Nikolai. From tss at iki.fi Thu Aug 9 11:30:11 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 9 Aug 2012 11:30:11 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <7AEA5CEE-0738-4723-B7E4-E1D39C72ED8F@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <7AEA5CEE-0738-4723-B7E4-E1D39C72ED8F@roessner-network-solutions.com> Message-ID: On 9.8.2012, at 11.24, Christian R??ner wrote: > I had enabled mail_log and search for any kind of errors. None. Only expunge messages from a imap process. Which I thought was Outlook. But isn't. So there is an imap expunge entry for all of the mails that get lost? You should be able to match that with the IMAP client's IP address by using session IDs, for example: mail_log_prefix = "%s(%u) <%{session}>: " Also you may be able to find out what client is doing it by setting: imap_id_log = * From vlb at isks.ru Thu Aug 9 11:33:39 2012 From: vlb at isks.ru (Vladimir Bukov) Date: Thu, 09 Aug 2012 12:33:39 +0400 Subject: [Dovecot] dovecot rpm packages for CentOS ? Message-ID: <502375E3.7030104@isks.ru> On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > > Hello all again, > > Has anyone any idea how to get the latest dovecot version for CentOS > > 5.8 or 6.2 32-bit OS ? > > I did a quick search and found out that the official version of dovecot > > for CentOS v5.8 is 1.0.2 (!!). > > > > Any repos ? Any ideas :-) ? > http://www.city-fan.org/ftp/contrib/mail/ From Wiethoff at tfh-bochum.de Thu Aug 9 11:47:47 2012 From: Wiethoff at tfh-bochum.de (Wiethoff, Helge) Date: Thu, 9 Aug 2012 08:47:47 +0000 Subject: [Dovecot] dovecot+LDAP/AD encoding issue In-Reply-To: <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> References: <194290040642FB4D952083D79F7F7D1D319417@BOHEMSX2010.rbbk.de> <20120807222226.GA8406@daniel.localdomain> <194290040642FB4D952083D79F7F7D1D319BFB@BOHEMSX2010.rbbk.de> <90D8B580-35E0-45D9-8F61-49F9AA0A84C0@atom.net> Message-ID: <194290040642FB4D952083D79F7F7D1D31A129@BOHEMSX2010.rbbk.de> Hi Matthew, > You mentioned Roundcube earlier. I notice this in Roundcube's default > main.inc.php: > > // Password charset. > // Use it if your authentication backend doesn't support UTF-8. > // Defaults to ISO-8859-1 for backward compatibility > $rcmail_config['password_charset'] = 'ISO-8859-1'; > > ...so changing that to UTF-8 may fix the problem so far as Roundcube is > concerned. > > But you may still face a problem with other clients. We just discussed > Thunderbird's behaviour a few days back... D'oh... This fixed it. I haven't taken this into account yet because of the dumpio log, which told me this is already an UTF-8 encoded string... > > [Tue Aug 07 10:56:37 2012] [debug] mod_dumpio.c(74): mod_dumpio: dumpio_in (data-TRANSIENT): _pass=T%C3%A4st1234 Now the authentication works within Roundcube... Thanks for the hint. Greetings, Helge ________________________________ Helge Wiethoff Medienzentrum Telefon: +49 (234) 968 8717 Fax: +49 (234) 968 3453 E-Mail: Wiethoff at tfh-bochum.de Technische Fachhochschule Georg Agricola f?r Rohstoff, Energie und Umwelt zu Bochum Staatlich anerkannte Fachhochschule der DMT-Gesellschaft f?r Lehre und Bildung mbH Herner Stra?e 45 44787 Bochum http://www.tfh-bochum.de ________________________________ Tr?ger: DMT-Gesellschaft f?r Lehre und Bildung mbH Sitz der Gesellschaft: Bochum Registergericht: Amtsgericht Bochum Handelsregister: B 4052 Gesch?ftsf?hrung: Prof. Dr. J?rgen Kretschmann (Vorsitzender) Manfred Freitag From madduck at madduck.net Thu Aug 9 11:57:34 2012 From: madduck at madduck.net (martin f krafft) Date: Thu, 9 Aug 2012 10:57:34 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <7A777523-B724-4E8F-A791-FCA9A709702B@iki.fi> Message-ID: <20120809085734.GB3929@albatross.gern.madduck.net> also sprach Timo Sirainen [2012.08.08.1509 +0200]: > > Do you have an idea how I could let dovecot-lmtp invoke spamc? Or an > > external command as a filter, to be run by the final user? > > Use spampd LMTP proxy? That's a system-wide filtering daemon, it does not run per-user. Since spam is a subjective classification, especially as soon as you add training to the mix, we require per-user configuration. -- martin | http://madduck.net/ | http://two.sentenc.es/ warning: dates in calendar are closer than they appear. spamtraps: madduck.bogus at madduck.net -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From giles at coochey.net Thu Aug 9 12:27:53 2012 From: giles at coochey.net (Giles Coochey) Date: Thu, 09 Aug 2012 10:27:53 +0100 Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <502375E3.7030104@isks.ru> References: <502375E3.7030104@isks.ru> Message-ID: <50238299.5030404@coochey.net> On 09/08/2012 09:33, Vladimir Bukov wrote: > On Thu, August 9, 2012 4:31 pm, Spyros Tsiolis wrote: > >> > Hello all again, >> > Has anyone any idea how to get the latest dovecot version for CentOS >> > 5.8 or 6.2 32-bit OS ? >> > I did a quick search and found out that the official version of >> dovecot >> > for CentOS v5.8 is 1.0.2 (!!). >> > >> > Any repos ? Any ideas :-) ? > > http://www.city-fan.org/ftp/contrib/mail/ I use the city-fan repo, it's great for a whole variety of Mail related packages. The dovecot rpm's are generally updated within 24-48hours of a new release by Timo. -- Regards, Giles Coochey, CCNA, CCNAS NetSecSpec Ltd +44 (0) 7983 877438 http://www.coochey.net http://www.netsecspec.co.uk giles at coochey.net -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4968 bytes Desc: S/MIME Cryptographic Signature URL: From dgp-dove at corefiling.co.uk Thu Aug 9 13:26:58 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Thu, 09 Aug 2012 11:26:58 +0100 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness Message-ID: <50239072.10607@corefiling.co.uk> Hi, I'm not sure if this is a deliberate design decision or a technical limitation that I've missed. Please briefly explain if so :). Or a bug or feature request? When LMTP receives a mail with a single recipient it adds a Delivered-To header. However if the message is delivered in a batch that header isn't added. At first I thought maybe the LMTP was doing something with hardlinks but that doesn't appear to be the case (for rather obvious reasons.) Sample headers (single recipient): Return-Path: Delivered-To: Received: from mx.domain.test ([127.0.0.1]) by domain.test (Dovecot) with LMTP id ZNTPFX2NI1CcCwAAVMeomg for ; Thu, 09 Aug 2012 11:14:21 +0100 Envelope-to: user at domain.test Delivery-date: Thu, 09 Aug 2012 11:14:21 +0100 Received: from host.domain.test ([172.16.252.1]:44058) by relay.domain.test ([172.16.252.120]:25) with esmtp id 1SzPkz-0000lz-7v (Exim 4.80) for user at domain.test (return-path ); Thu, 09 Aug 2012 11:14:21 +0100 Message-ID: <50238D7D.2000707 at domain.test> Date: Thu, 09 Aug 2012 11:14:21 +0100 From: User To: User Subject: test And an expansion list: Return-Path: Received: from mx.domain.test ([127.0.0.1]) by domain.test (Dovecot) with LMTP id Gf+yBmiNI1CECwAAVMeomg ; Thu, 09 Aug 2012 11:14:00 +0100 Envelope-to: expansion at domain.test Delivery-date: Thu, 09 Aug 2012 11:14:00 +0100 Received: from host.domain.test ([172.16.252.1]:44053) by relay.domain.test ([172.16.252.120]:25) with esmtp id 1SzPkd-0000ls-Qr (Exim 4.80) for expansion at domain.test (return-path ); Thu, 09 Aug 2012 11:13:59 +0100 Message-ID: <50238D67.3090802 at domain.test> Date: Thu, 09 Aug 2012 11:13:59 +0100 From: User To: Expansion Subject: test At the moment we've turned off batch delivery in the exim smtp transport (max_rcpt=1). Cheers, Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From robert at schetterer.org Thu Aug 9 14:04:50 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 09 Aug 2012 13:04:50 +0200 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239072.10607@corefiling.co.uk> References: <50239072.10607@corefiling.co.uk> Message-ID: <50239952.8030206@schetterer.org> Am 09.08.2012 12:26, schrieb Daniel Piddock: > I'm not sure if this is a deliberate design decision or a technical > limitation that I've missed. Please briefly explain if so :). Or a bug > or feature request? as far i remember its a design decide dont know exim but it looks like max_rcpt=1 is the same then i.e postfix lmtp_destination_recipient_limit = 1 guess its the best solution for now, if you strongly need that header there were posts in the postfix and dovecot lists search archives -- Best Regards MfG Robert Schetterer From stsiol at yahoo.co.uk Thu Aug 9 14:08:13 2012 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Thu, 9 Aug 2012 12:08:13 +0100 (BST) Subject: [Dovecot] dovecot rpm packages for CentOS ? In-Reply-To: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> References: <1344493886.38720.YahooMailNeo@web132206.mail.ird.yahoo.com> Message-ID: <1344510493.32546.YahooMailNeo@web132204.mail.ird.yahoo.com> ----- Original Message ----- > Hello all again, > > Has anyone any idea how to get the latest dovecot version for CentOS > 5.8 or 6.2 32-bit OS ? > > I did a quick search and found out that the official version of dovecot > for CentOS v5.8 is 1.0.2 (!!). > > Any repos ? Any ideas :-) ? > > Thank you all, > > spyros Oh "Duh" ! Here I go again :-) http://www.dovecot.org/download.html In front of my eyes, all this time. Thank you all though. s. ? ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis From CMarcus at Media-Brokers.com Thu Aug 9 14:40:54 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 09 Aug 2012 07:40:54 -0400 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239952.8030206@schetterer.org> References: <50239072.10607@corefiling.co.uk> <50239952.8030206@schetterer.org> Message-ID: <5023A1C6.2050706@Media-Brokers.com> On 2012-08-09 7:04 AM, Robert Schetterer wrote: > Am 09.08.2012 12:26, schrieb Daniel Piddock: >> I'm not sure if this is a deliberate design decision or a technical >> limitation that I've missed. Please briefly explain if so :). Or a bug >> or feature request? > as far i remember its a design decide > > dont know exim > > but it looks like max_rcpt=1 > > is the same then i.e postfix > > lmtp_destination_recipient_limit = 1 > > guess its the best solution for now, if you strongly need that header > > there were posts in the postfix and dovecot lists search archives I wonder if this is related or the same problem as the lack of the x-original-to header that was discussed, and that Timo said would be relatively easy to fix in dovecot's LMTP client. If so, it is on his ToDo, he just hasn't gotten to it yet. -- Best regards, Charles From madduck at madduck.net Thu Aug 9 15:23:51 2012 From: madduck at madduck.net (martin f krafft) Date: Thu, 9 Aug 2012 14:23:51 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <502238FA.6040901@corefiling.co.uk> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> Message-ID: <20120809122351.GA26800@albatross.gern.madduck.net> also sprach Daniel Piddock [2012.08.08.1201 +0200]: > Have you taken a look at Pigeonhole and Sieve? There's > experimental support for running spam filters and external > commands. You'll need at least 0.3.0 which requires Dovecot 2.1. Dear list, here is an update. Indeed, the pigeonhole filters suggested by Daniel were the ticket. It took me a while to figure it all out though. Therefore, for posterity, at least for those running Debian systems: First, I compiled the extprograms plugin, running into a segfault, which Stephan helped me solve. Essentially, the extprograms are not in Debian, but everything else is (install dovecot-dev!), so I checked out revision 058de395713a [1], ran ./configure --with-dovecot=/usr/lib/dovecot --with-pigeonhole=/usr/include/dovecot/sieve --with-prefix=/usr/local/stow/pigeonhole-extprograms make make install cd /usr/local/stow/ stow pigeonhole-extprograms 1. http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=684271#10 Since dovecot only allows a single plugin dir to be specified, I had to hack around this by creating a symlink: ln -s /usr/local/lib/dovecot/sieve /usr/lib/dovecot/modules Now, after enabling the following in /etc/dovecot/conf.d/90-sieve: sieve_extensions = +vnd.dovecot.filter sieve_plugins = sieve_extprograms you should see 'vnd.dovecot.filter' in the dovecot -n output: dovecot -n | grep vnd.dovecot managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.filter ^^^^^^^^^^^^^^^^^^ I used sieve_global_extensions instead, because I wanted to enable spamc globally for all users using the dovecot LDA, which includes all virtual users on this machine. I also set (in 90-sieve.conf) sieve_before = /etc/dovecot/sieve.before.d and then put the following sieve script into /etc/dovecot/sieve.before.d/spamassassin.sieve: require [ "vnd.dovecot.filter" ]; filter "spamc" [ "--no-safe-fallback" ]; and then ran sievec spamassassin.sieve && chmod 444 spamassassin.svbin To tell the LDA where to find the spamc filter, I added (to 90-sieve.conf): sieve_filter_bin_dir = /etc/dovecot/sieve-filter and symlinked spamc there ln -s /usr/bin/spamc /etc/dovecot/sieve-filter/spamc So far so good, this now works for real system users, but it would not work for virtual users. The reason for that is that while vmm uses UIDs/GIDs above 70000 to tighten permissions per-virtual-user, spamc and spamd were unable to deal with the lack of libnss integration. Stephan suggested simply to let libnss know about the virtual mail accounts, and I did. After installing libnss-pgsql2 and extending /etc/nsswitch.conf to read passwd: compat pgsql group: compat pgsql I wrote the attached configuration file (/etc/nss-pgsql.conf), which I will submit to the vmm project. The advantage is that now, while the users cannot log in, their UIDs/GIDs on the filesystems are properly mapped, and root *can* /bin/su to them (using -s to override the shell). After a restart of spamd and dovecot, spamc is now run for every user as part of the LDA process before the user's sieve script runs. Thanks to Stephan for his help. Comments welcome. I hope I did not forget anything. PS: I know there are good reasons against running a spamfilter post-queue. There are also several reasons for that. The most important for me is that spam is subjective, especially in combination with training, and I never want to reject spam for fear of false positives, and since I do not want to overload the queues of mail servers (like debian.org) that forward to my account. -- martin | http://madduck.net/ | http://two.sentenc.es/ "the unexamined life is not worth living" -- platon spamtraps: madduck.bogus at madduck.net -------------- next part -------------- connectionstring = hostaddr=127.0.0.1 dbname=vmm user=nss password=5ecr41 connect_timeout=1 getgroupmembersbygid = SELECT local_part||'@'||domainname AS name FROM users JOIN domain_name USING (gid) WHERE gid = $1 AND is_primary = 't' getpwnam = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE local_part = split_part($1, '@', 1) AND domainname = split_part($1, '@', 2) AND is_primary = 't' getpwuid = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE uid = $1 AND is_primary = 't' allusers = SELECT local_part||'@'||domainname AS name, '*' AS passwd, 'vmm virtual mail account' AS gecos, domaindir ||'/'||uid AS homedir, '/bin/true' AS shell, uid, gid FROM users JOIN domain_data USING (gid) JOIN domain_name USING (gid) WHERE is_primary = 't' getgrnam = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE domainname = $1 getgrgid = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE gid = $1 groups_dyn = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE is_primary = 't' allgroups = SELECT domainname, '*' AS passwd, gid, NULL AS members FROM domain_name WHERE is_primary = 't' -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From dgp-dove at corefiling.co.uk Thu Aug 9 15:42:32 2012 From: dgp-dove at corefiling.co.uk (Daniel Piddock) Date: Thu, 09 Aug 2012 13:42:32 +0100 Subject: [Dovecot] Dovecot LMTP - Delivered-To header weirdness In-Reply-To: <50239952.8030206@schetterer.org> References: <50239072.10607@corefiling.co.uk> <50239952.8030206@schetterer.org> Message-ID: <5023B038.40308@corefiling.co.uk> On 09/08/12 12:04, Robert Schetterer wrote: > Am 09.08.2012 12:26, schrieb Daniel Piddock: >> I'm not sure if this is a deliberate design decision or a technical >> limitation that I've missed. Please briefly explain if so :). Or a bug >> or feature request? > as far i remember its a design decide > > dont know exim > > but it looks like max_rcpt=1 > > is the same then i.e postfix > > lmtp_destination_recipient_limit = 1 > > guess its the best solution for now, if you strongly need that header > > there were posts in the postfix and dovecot lists search archives You're right, I should have search a bit harder. I found the thread from Feb 2010 discussing Return-Path and Delivered-To headers http://www.dovecot.org/list/dovecot/2010-February/046401.html . The conclusion there appears to be the suggested addition of an lmtp_headers option. This got me thinking. With the latest versions of Pigeonhole and Dovecot this header can be added using a global sieve script: require ["envelope", "editheader", "variables"]; if allof (not exists "Delivered-To", envelope :matches :all "To" "*") { addheader "Delivered-To" "${1}"; } Dan -- Daniel Piddock, Systems Administrator, CoreFiling Limited http://www.corefiling.com From c at roessner-network-solutions.com Thu Aug 9 16:10:22 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 9 Aug 2012 15:10:22 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> Message-ID: <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> Hi, > cp mdbox ~/mdbox-backup done > rm -rf ~/mdbox-backup/storage/dovecot.map* ~/mdbox-backup/mailboxes/ done > doveadm import mdbox:~/mdbox-backup all-mails all problem I tried so, but this does not work here: doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(root): Debug: Effective uid=0, gid=0, home=/root doveadm(root): Debug: fs: root=/srv/mail/foo.bar at example.com-backup, index=, control=, inbox=, alt= doveadm(root): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com-backup: mode=0700 gid=-1 doveadm(foo.bar at example.com): Debug: Effective uid=5000, gid=5000, home=/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: fs: root=/srv/mail/foo.bar at example.com, index=, control=, inbox=, alt= doveadm(foo.bar at example.com): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com: mode=0700 gid=-1 The mail box is under: /srv/mail/foo.bar at example.com The backup is under: /srv/mail/foo.bar at example.com-backup It does nothing. The command directly returns. No copied mails. So what am I missing here? Current version here is Dovecot 2.1.7. Thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From nmilas at noa.gr Thu Aug 9 17:58:10 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Thu, 09 Aug 2012 17:58:10 +0300 Subject: [Dovecot] HA Mailbox Design Message-ID: <5023D002.6040101@noa.gr> Hi, We would like to implement a Highly Available Mail Server and would like to ask advice on how to architect this. Some details on our setup: Currently we have only one internal mail server (Postfix/Dovecot 2.0 - planning to move to 2.1), receiving mail from a gateway server (filtering spam/viruses) - a Cisco Ironport - which we are considering to replace with one (or a set of) cloud-based Postfix/Amavis-new/SpamAssassin/ClamAV VMs (currently in testing mode). Delivery uses Dovecot LDA. User accounts are LDAP-based. We use Maildir and the load is low (aside spam). Only about 250 users/mailboxes (4G each). All servers are CentOS 5.8 (planning move to 6.3) KVM VMs (on a cloud where we don't have control on the host, but on highly reliable hardware/networks). We can have VMs on two different clouds and we also have at least two different connections (routes) to the cloud(s) (to support HA). Any directions will be appreciated. Hoping to design an HA architecture but aiming to keep it simple and (as much as possible) easily maintainable one. Thanks for your response and help, Nick From lists at luigirosa.com Thu Aug 9 19:16:08 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 18:16:08 +0200 Subject: [Dovecot] Server side Sieve with virtual users Message-ID: <5023E248.3030408@luigirosa.com> Is there a way to implement server-side filters with Dovecot configured with virtual users (userbase in mysql, a single *NIX user account that owns /var/spool/mail and its content)? Thanks Ciao, luigi -- / +--[Luigi Rosa]-- \ A generation which ignores history has no past... and no future. From adrian.minta at gmail.com Thu Aug 9 19:33:34 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 19:33:34 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023E248.3030408@luigirosa.com> References: <5023E248.3030408@luigirosa.com> Message-ID: <5023E65E.8010608@gmail.com> On 08/09/12 19:16, Luigi Rosa wrote: > Is there a way to implement server-side filters with Dovecot > configured with virtual users (userbase in mysql, a single *NIX user > account that owns /var/spool/mail and its content)? > > Thanks > > > Ciao, > luigi > Yes ! From rob at fantinibakery.com Thu Aug 9 20:08:25 2012 From: rob at fantinibakery.com (rob) Date: Thu, 09 Aug 2012 13:08:25 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply Message-ID: <5023EE89.9050904@fantinibakery.com> Hello We are looking for information on how to use Vacation auto-reply . I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few other pages, but have not found how to set it up. We use sogo and thunderbird . Is there a how to or document for this somewhere? This is our configuration information: dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid auth_mechanisms = plain login auth_username_format = %Ln lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:%h/Maildir mail_plugins = " quota" maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_plugins = quota sieve quota = fs:user quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=60%% quota-warning 60 %u quota_warning4 = storage=40%% quota-warning 40 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ } postmaster_address = fbcadmin at fantinibakery.com protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service imap-login { service_count = 0 vsz_limit = 128 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 vsz_limit = 256 M } service quota-warning { executable = script /fbc/bin/mail/quota-warning.sh user = dovecot } ssl = required ssl_ca = References: <5023E248.3030408@luigirosa.com> Message-ID: <5023F070.8090001@luigirosa.com> Luigi Rosa said the following on 09/08/2012 18:16: > Is there a way to implement server-side filters with Dovecot configured with > virtual users (userbase in mysql, a single *NIX user account that owns > /var/spool/mail and its content)? :) And the webpage/wikipage with documentation about this is.... ? Ciao, luigi -- / +--[Luigi Rosa]-- \ Error in operator: add beer. From adrian.minta at gmail.com Thu Aug 9 20:25:17 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 20:25:17 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023EF1B.5030101@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> Message-ID: <5023F27D.10508@gmail.com> On 08/09/12 20:10, Luigi Rosa wrote: > Adrian Minta said the following on 09/08/2012 18:33: > >>> Is there a way to implement server-side filters with Dovecot >>> configured with >>> virtual users (userbase in mysql, a single *NIX user account that owns >>> /var/spool/mail and its content)? > >> Yes ! > > :) > > And the webpage/wikipage with documentation about this is.... ? > > > Ciao, > luigi > First step is to have a mail system that works without sieve. This is the hard part. Depending on your preferred distro here are two nice webpages for this: http://wiki.mediatemple.net/w/(ve):Install_Postfix_with_Dovecot_on_CentOS http://workaround.org/ispmail Second step is to enable sieve, for witch you only need to uncomment the specific lines from dovecot.conf. For dovecot 1.2, you will have something like: protocols = pop3 pop3s imap imaps managesieve protocol lda { ... mail_plugins: quota sieve } protocol managesieve { } plugin { ... sieve=~/.dovecot.sieve sieve_dir=~/sieve } -- Best regards, Adrian Minta From lists at luigirosa.com Thu Aug 9 20:37:00 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 19:37:00 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F27D.10508@gmail.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> Message-ID: <5023F53C.7000509@luigirosa.com> Adrian Minta said the following on 09/08/2012 19:25: > First step is to have a mail system that works without sieve. This is the hard > part. Not for me. I have more than 20 customers with their own Centos Linux with Postfix and Dovecot compiled by me, and Mysql, apache, php from the distribution source and RoundCube. > protocols = pop3 pop3s imap imaps managesieve > protocol lda { > ... > mail_plugins: quota sieve > } > protocol managesieve { > } > plugin { > ... > sieve=~/.dovecot.sieve > sieve_dir=~/sieve > } That's the point: sieve_dir can be the 'root' of the maildir structure? Virtual users do not have their own home (~) directory. If the sieve file is store in the 'root' maildir of each user, Dovecot uses the same single virtual (linux) user to access the maildir? Ciao, luigi -- / +--[Luigi Rosa]-- \ To define recursion, we must first define recursion. From adrian.minta at gmail.com Thu Aug 9 20:46:43 2012 From: adrian.minta at gmail.com (Adrian Minta) Date: Thu, 09 Aug 2012 20:46:43 +0300 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F53C.7000509@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> Message-ID: <5023F783.6090907@gmail.com> On 08/09/12 20:37, Luigi Rosa wrote: >> plugin { >> ... >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> } > > That's the point: sieve_dir can be the 'root' of the maildir > structure? Virtual users do not have their own home (~) directory. > > If the sieve file is store in the 'root' maildir of each user, Dovecot > uses the same single virtual (linux) user to access the maildir? (~) is the account maildir, not the homedir of linux user. -- Best regards, Adrian Minta From lists at luigirosa.com Thu Aug 9 20:47:45 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Thu, 09 Aug 2012 19:47:45 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F783.6090907@gmail.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> <5023F783.6090907@gmail.com> Message-ID: <5023F7C1.6050405@luigirosa.com> Adrian Minta said the following on 09/08/2012 19:46: > (~) is the account maildir, not the homedir of linux user. Ok, thanks! Ciao, luigi -- / +--[Luigi Rosa]-- \ I went to the airport, with my ticket to Los Angeles. I brought three bags and told the Skycap "I want this on to go to Seattle, this one to St. Louis and this one to Chicago." He said "I'm sorry sir, but we can't do that." I said "Why not? You did it last time." --Henny Youngman From robert at schetterer.org Thu Aug 9 21:17:54 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 09 Aug 2012 20:17:54 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023F53C.7000509@luigirosa.com> References: <5023E248.3030408@luigirosa.com> <5023E65E.8010608@gmail.com> <5023EF1B.5030101@luigirosa.com> <5023F27D.10508@gmail.com> <5023F53C.7000509@luigirosa.com> Message-ID: <5023FED2.3060609@schetterer.org> Am 09.08.2012 19:37, schrieb Luigi Rosa: > Adrian Minta said the following on 09/08/2012 19:25: > >> First step is to have a mail system that works without sieve. This is >> the hard >> part. > > Not for me. I have more than 20 customers with their own Centos Linux > with Postfix and Dovecot compiled by me, and Mysql, apache, php from the > distribution source and RoundCube. > >> protocols = pop3 pop3s imap imaps managesieve >> protocol lda { >> ... >> mail_plugins: quota sieve >> } >> protocol managesieve { >> } >> plugin { >> ... >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> } > > That's the point: sieve_dir can be the 'root' of the maildir structure? > Virtual users do not have their own home (~) directory. however they have a dovecot "home", with virtual users all mailboxes belong to i.e system user vmail, and their dovecot "home/mailbox" is taken out of the dovecot config > > If the sieve file is store in the 'root' maildir of each user, Dovecot > uses the same single virtual (linux) user to access the maildir? > > > > > Ciao, > luigi > as far i remember , reading changelog, you can now store sieve rules in mysql too, this should solve any of such problems -- Best Regards MfG Robert Schetterer From stephan at rename-it.nl Thu Aug 9 22:19:03 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 09 Aug 2012 21:19:03 +0200 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5023EE89.9050904@fantinibakery.com> References: <5023EE89.9050904@fantinibakery.com> Message-ID: <50240D27.5080102@rename-it.nl> On 8/9/2012 7:08 PM, rob wrote: > Hello > We are looking for information on how to use Vacation auto-reply . > > I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few > other pages, but have not found how to set it up. > > We use sogo and thunderbird . > > Is there a how to or document for this somewhere? What exactly do you want to know? Regards, Stephan. From rob at fantinibakery.com Thu Aug 9 22:32:05 2012 From: rob at fantinibakery.com (rob) Date: Thu, 09 Aug 2012 15:32:05 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <50240D27.5080102@rename-it.nl> Message-ID: <24a9-50241000-13-11050340@19539233> On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: > On 8/9/2012 7:08 PM, rob wrote: > > Hello > > We are looking for information on how to use Vacation auto-reply . > > > > I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few > > other pages, but have not found how to set it up. > > > > We use sogo and thunderbird . > > > > Is there a how to or document for this somewhere? > > What exactly do you want to know? > > Regards, > > Stephan. > I'd like to know : - If we have Dovecot configured OK for vacation sieve. - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? From tss at iki.fi Fri Aug 10 02:34:56 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 02:34:56 +0300 Subject: [Dovecot] pop3 proxying error In-Reply-To: <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> Message-ID: On 9.8.2012, at 10.27, Timo Sirainen wrote: >> Aug 9 09:01:36 smtp dovecot: imap-login: Error: ==27313== Invalid read of size 4 >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x5069BA1: settings_parser_get_list (settings-parser.c:254) >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x4E3EA7C: login_settings_read (login-settings.c:230) > .. >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== Address 0x65fc1e0 is 96 bytes inside a block of size 8,192 free'd >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== at 0x4C27D4E: free (vg_replace_malloc.c:427) >> Aug 9 09:01:37 smtp dovecot: imap-login: Error: ==27313== by 0x508DC1E: master_service_settings_cache_read (master-service-settings-cache.c:168) > > Thanks. Obviously I shouldn't free cached settings while they're still being used. :) Actually it wasn't that obvious: http://hg.dovecot.org/dovecot-2.1/rev/b082b8260782 plus http://hg.dovecot.org/dovecot-2.1/rev/9d0873cefa08 From tss at iki.fi Fri Aug 10 02:38:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 02:38:18 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> Message-ID: <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> On 9.8.2012, at 16.10, Christian R??ner wrote: >> doveadm import mdbox:~/mdbox-backup all-mails all > > problem > > I tried so, but this does not work here: I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX From stan at hardwarefreak.com Fri Aug 10 04:47:50 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Thu, 09 Aug 2012 20:47:50 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <5023D002.6040101@noa.gr> References: <5023D002.6040101@noa.gr> Message-ID: <50246846.6020606@hardwarefreak.com> On 8/9/2012 9:58 AM, Nikolaos Milas wrote: > Hi, > > We would like to implement a Highly Available Mail Server and would like > to ask advice on how to architect this. > > Some details on our setup: > > Currently we have only one internal mail server (Postfix/Dovecot 2.0 - > planning to move to 2.1), receiving mail from a gateway server > (filtering spam/viruses) - a Cisco Ironport - which we are considering > to replace with one (or a set of) cloud-based > Postfix/Amavis-new/SpamAssassin/ClamAV VMs (currently in testing mode). First, please don't use the term "cloud". That's a marketing buzzword that variously covers many actual network computing architectures. This is a technical mailing list. We use technical terms here, and precise detail of the architecture matters greatly, buzzwords are irrelevant. > Delivery uses Dovecot LDA. User accounts are LDAP-based. > We use Maildir and the load is low (aside spam). Only about 250 > users/mailboxes (4G each). All servers are CentOS 5.8 (planning move to > 6.3) KVM VMs (on a cloud where we don't have control on the host, but on > highly reliable hardware/networks). If you don't control the host you don't control the storage (disks), thus making a traditional "HA" mail server system difficult. You state the "cloud" infrastructure is highly reliable. That begs the question, what is your definition of a "Highly Available Mail Server"? What is it that you actually want to accomplish? In some detail please. Do you mean "POP/IMAP service is always available to clients even when something fails"? > We can have VMs on two different clouds and we also have at least two > different connections (routes) to the cloud(s) (to support HA). Again, please stop talking about "clouds". None of what you just stated above means anything without actual architectural details. When designing/implementing an HA setup, details are absolutely critical, required to make it work. Details, details, details. Also, you've mentioned absolutely nothing about storage. Storage is the pivot pin in an HA setup, the central consideration. HA is built around the storage architecture, not around applications and servers (hosts or VMs). > Any directions will be appreciated. Hoping to design an HA architecture > but aiming to keep it simple and (as much as possible) easily > maintainable one. HA architectures are never simple. That's the nature of the beast. And they're typically not cheap to implement as they absolutely require fault tolerant shared storage of one kind or another, either a disk array with dual active/active controllers and PSUs with a cluster filesystem on Dovecot nodes, or storage appliance that offers full redundancy and NFS protocol for Dovecot node access. This prevents single point of failure, which is what HA is all about. To be quite frank, based upon the level of technical acumen you've demonstrated here, and the general financial position Greece finds itself in, and the fact you're a public institution, it seems you're a much better candidate for a Gmail hosted infrastructure than a VPS infrastructure with some manner of ad hoc software only HA measures bolted on, which is all you can do with VPS servers--you don't control the storage. Gmail hosted mail instantly gives you a high availability email infrastructure for "free". Cost is negligible for your number of mailboxes. Antispam and all the standard stuff is built in and fairly decent. You get both POP and IMAP connectivity options, allowing access with desktop/mobile MUAs. If you prefer a different web interface you can setup a Horde or Roundcube VM at your "cloud" provider and access the Gmail accounts. You'll have less "control" of the system, but it will save far more money than a VPS "cloud" solution, be far easier to administer, and the setup can be done in a day, with almost zero administration required afterward. If you have many users with personal Gmail accounts they'll take to it like a duck to water. If you're looking for a "cloud" based HA email infrastructure at very low cost, you simply can't beat hosted Gmail. Or Google Apps, whatever they call it these days. The downside is it may eliminate your job if you're strictly a dedicated email system administrator. -- Stan From daniel.parthey at informatik.tu-chemnitz.de Fri Aug 10 05:35:25 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 10 Aug 2012 04:35:25 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <34275123.post@talk.nabble.com> References: <34275123.post@talk.nabble.com> Message-ID: <20120810023525.GA14423@daniel.localdomain> Bulend Mali wrote: > i want to use login-intranet-imap.sh in order to restrict by emailaddress and ip address. > i read it at http://wiki2.dovecot.org/PostLoginScripting. > But there is an expression "mail_executable" in [dovecot1] conf. > but there is no such thing in dovecot2. > What is equivalent of it for dovecot2 ? service imap { executable = imap imap-postlogin } or service pop3 { executable = pop3 pop3-postlogin } I assume the exec "$@" in your login-intranet-imap.sh is there to execute the imap binary (or call it "mail executable") which handles the protocol traffic after your post-login script has done its work and granted access to the user. If you would like to deny access, you should not execute the protocol handler, but simply exit 0, see "Denying connection from some IP/User" at http://wiki2.dovecot.org/PostLoginScripting Regards Daniel -- https://plus.google.com/103021802792276734820 From dovecot at noboost.org Fri Aug 10 05:44:44 2012 From: dovecot at noboost.org (dovecot at noboost.org) Date: Fri, 10 Aug 2012 12:44:44 +1000 Subject: [Dovecot] IMAP IDLE - iPhone? Message-ID: <20120810024444.GA16856@noboost.org> Hi All, Probably a very common question now days. I'd like to configure our iPhones at work to go directly to my dovecot server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE (push email) protocol. Has anyone successfully deployed this? If yes, did you have to use an app from the Apple store? For me the IMAP process works, however it's clearly not notifying the client when new email is detected on the server. cya Craig From tss at iki.fi Fri Aug 10 05:48:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 05:48:57 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> Related question that came to my mind: Does anyone know if XAPPLEPUSHSERVICE feature can be implemented by any server, or does it require cooperation between the server and the mobile network operator? I'm guessing the latter.. From lists at luigirosa.com Fri Aug 10 09:26:02 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Fri, 10 Aug 2012 08:26:02 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <5024A97A.8050204@luigirosa.com> dovecot at noboost.org said the following on 10/08/2012 04:44: > Probably a very common question now days. > I'd like to configure our iPhones at work to go directly to my dovecot > server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE > (push email) protocol. I used K-9 client on Android for one year with push, but I had to remove it and go back to integrated email client because it drained the battery. Ciao, luigi -- / +--[Luigi Rosa]-- \ Why do we want intelligent terminals when there are so many stupid users? From robert at schetterer.org Fri Aug 10 09:26:08 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 08:26:08 +0200 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <24a9-50241000-13-11050340@19539233> References: <24a9-50241000-13-11050340@19539233> Message-ID: <5024A980.1080207@schetterer.org> Am 09.08.2012 21:32, schrieb rob: > > On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: > >> On 8/9/2012 7:08 PM, rob wrote: >>> Hello >>> We are looking for information on how to use Vacation auto-reply . >>> >>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few >>> other pages, but have not found how to set it up. >>> >>> We use sogo and thunderbird . >>> >>> Is there a how to or document for this somewhere? >> >> What exactly do you want to know? >> >> Regards, >> >> Stephan. >> > > > > I'd like to know : > - If we have Dovecot configured OK for vacation sieve. > > - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? > sieve in dovecot acts like a server where you can feed sieve rules i.e vacation, some software mostly webmailsers have guis for this, like sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin if you setup dovecot sieve server rightly , you might see in the dovecot logs , and/or send dovecot config to the list, look for manuals on the dovecot site and in www for setup instructions -- Best Regards MfG Robert Schetterer From dovecot at r.paypc.com Fri Aug 10 09:31:46 2012 From: dovecot at r.paypc.com (Robin) Date: Thu, 09 Aug 2012 23:31:46 -0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024A97A.8050204@luigirosa.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> Message-ID: <5024AAD2.3040909@r.paypc.com> On 8/9/2012 11:26 PM, Luigi Rosa wrote: > I used K-9 client on Android for one year with push, but I had to remove > it and go back to integrated email client because it drained the battery. It sounds like "push" was really implemented as a poll. =R= From robert at schetterer.org Fri Aug 10 09:54:41 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 08:54:41 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024A97A.8050204@luigirosa.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> Message-ID: <5024B031.5010707@schetterer.org> Am 10.08.2012 08:26, schrieb Luigi Rosa: > dovecot at noboost.org said the following on 10/08/2012 04:44: > >> Probably a very common question now days. >> I'd like to configure our iPhones at work to go directly to my dovecot >> server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE >> (push email) protocol. so simply do it > > I used K-9 client on Android for one year with push, but I had to remove > it and go back to integrated email client because it drained the battery. > > > > > > Ciao, > luigi > imap idle is often promoted as push mail but tec side it isnt "exactly" the same, in users eyes the result looks nearly equal yes every service which let stay you online, robs power from battery but you can sync only manuall etc ( for sure then push makes no sense anymore ) however its a human related question, if i need mails always and everywhere and in "real time" in my eyes , if its really urgent people should phone together *g -- Best Regards MfG Robert Schetterer From xray at randoman.ru Fri Aug 10 10:08:47 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 14:08:47 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120810024444.GA16856@noboost.org> References: <20120810024444.GA16856@noboost.org> Message-ID: <5024B37F.2040709@randoman.ru> 10.08.2012 09:44, dovecot at noboost.org ?????: > Hi All, > > Probably a very common question now days. > I'd like to configure our iPhones at work to go directly to my dovecot > server (currently dovecot-2.0.9-2.el6_1.1.x86_64). Using the IMAP IDLE > (push email) protocol. > > Has anyone successfully deployed this? If yes, did you have to use an > app from the Apple store? For me the IMAP process works, however it's > clearly not notifying the client when new email is detected on the > server. > > cya > > Craig iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. IMAP IDLE monitor only one selected folder. If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. Sergey S. Kovalev From robert at schetterer.org Fri Aug 10 10:12:09 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 09:12:09 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024B37F.2040709@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> Message-ID: <5024B449.7000005@schetterer.org> Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: > On small mailboxes it's z-push and tine20 for example - they can use > IMAP server as backend. z-push works nice here with android, also the new horde beta has now calender, abook, notes, mail sync -- Best Regards MfG Robert Schetterer From tss at iki.fi Fri Aug 10 09:39:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 09:39:00 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024AAD2.3040909@r.paypc.com> References: <20120810024444.GA16856@noboost.org> <5024A97A.8050204@luigirosa.com> <5024AAD2.3040909@r.paypc.com> Message-ID: <77C53D85-F8E9-49CC-99EC-2904BEA24E4D@iki.fi> On 10.8.2012, at 9.31, Robin wrote: > On 8/9/2012 11:26 PM, Luigi Rosa wrote: >> I used K-9 client on Android for one year with push, but I had to remove >> it and go back to integrated email client because it drained the battery. > > It sounds like "push" was really implemented as a poll. Dovecot has by default: imap_idle_notify_interval = 2 mins So the phone needs to receive and send data every 2 minutes. Increasing this / disabling it entirely should help with power usage. But even then active TCP connections do eat up battery. From c at roessner-network-solutions.com Fri Aug 10 10:29:39 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Fri, 10 Aug 2012 09:29:39 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> Message-ID: <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Hi, > >>> doveadm import mdbox:~/mdbox-backup all-mails all >> >> problem >> >> I tried so, but this does not work here: > > I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: > > doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX > done And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From h.reindl at thelounge.net Fri Aug 10 11:16:17 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 10:16:17 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024B37F.2040709@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> Message-ID: <5024C351.7030101@thelounge.net> Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: > iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. > IMAP IDLE monitor only one selected folder. > If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. > On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. this may be a IPHONE limitation as all the apple clients are buggy like hell since years i have a Android with K9, a lot of folders where messages are stored by sieve-scirpts and on my phone i can actively select which folders should be used for push -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From xray at randoman.ru Fri Aug 10 11:46:50 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 15:46:50 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024C351.7030101@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> Message-ID: <5024CA7A.80006@randoman.ru> 10.08.2012 15:16, Reindl Harald ?????: > > Am 10.08.2012 09:08, schrieb Sergey S. Kovalev: >> iPhone will not notify for new mail in any folder, except INBOX - it's IMAP limitation. >> IMAP IDLE monitor only one selected folder. >> If you need notifying of new mail in copule of mail folders you shold look for ActiveSync realization. >> On small mailboxes it's z-push and tine20 for example - they can use IMAP server as backend. > this may be a IPHONE limitation as all the apple > clients are buggy like hell since years > > i have a Android with K9, a lot of folders where messages are stored > by sieve-scirpts and on my phone i can actively select which folders > should be used for push > Sure, it can do it in two ways: open several connections to imap server (one per folder) or periodically change current directory and get changes. But any of this solution will eat battery very fast, proportionally to count of folders to check. I think that battery life is the reason, why this feature is not implemented in iPhone. It will use only one IMAP connection. Sergey S. Kovalev From arne at drlinux.no Fri Aug 10 11:57:55 2012 From: arne at drlinux.no (Arne K. Haaje) Date: Fri, 10 Aug 2012 10:57:55 +0200 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50246846.6020606@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> Message-ID: <1528826.6G1CvjlpWE@marvin> Torsdag 9. august 2012 20.47.50 skrev Stan Hoeppner: [snip] > To be quite frank, based upon the level of technical acumen you've > demonstrated here, and the general financial position Greece finds > itself in, and the fact you're a public institution, it seems you're a > much better candidate for a Gmail hosted infrastructure than a VPS > infrastructure with some manner of ad hoc software only HA measures > bolted on, which is all you can do with VPS servers--you don't control > the storage. If they are a public institution, then they may be prohibited from hosting on Google, simply because possibly sensitive data would then be hosted in another country. As for HA I agree with Stan in that it is both very expensive and difficult to do right, but I would also ask if do you *really* need it? Arne -- Arne K. Haaje http://www.drlinux.no/ Twitter: drlinuxno LinkedIn: http://no.linkedin.com/pub/arne-haaje/27/189/bb From h.reindl at thelounge.net Fri Aug 10 11:59:49 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 10:59:49 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024CA7A.80006@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> Message-ID: <5024CD85.4020705@thelounge.net> Am 10.08.2012 10:46, schrieb Sergey S. Kovalev: > 10.08.2012 15:16, Reindl Harald ?????: >> i have a Android with K9, a lot of folders where messages are stored >> by sieve-scirpts and on my phone i can actively select which folders >> should be used for push >> > Sure, it can do it in two ways: open several connections to imap server > (one per folder) or periodically change current directory and get changes. typically the client opens a connecton for each folder to check > But any of this solution will eat battery very fast, proportionally > to count of folders to check. and that is why K9 on android let you select which folders are relevant for you on the mobile and which should be completly ignored and display the selected in "common inbox" > I think that battery life is the reason, why this feature is not implemented > in iPhone. It will use only one IMAP connection so it is not "it's IMAP limitation" how does help me "save battery" if i have a folder-structure maintained by sieve if i do not get my new mails? it's a limitation from Apple because they have not the knowledge to implement relieable mail-clients see below the removed posting on apple-support (first paragraphs german but posting and answer from Apple below in english) http://www.rhsoft.net/ -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From xray at randoman.ru Fri Aug 10 12:21:34 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 16:21:34 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024CD85.4020705@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> Message-ID: <5024D29E.5040400@randoman.ru> 10.08.2012 15:59, Reindl Harald ?????: > Am 10.08.2012 10:46, schrieb Sergey S. Kovalev: >> 10.08.2012 15:16, Reindl Harald ?????: >>> i have a Android with K9, a lot of folders where messages are stored >>> by sieve-scirpts and on my phone i can actively select which folders >>> should be used for push >>> >> Sure, it can do it in two ways: open several connections to imap server >> (one per folder) or periodically change current directory and get changes. > typically the client opens a connecton for each folder to check Sure, it's better. > >> But any of this solution will eat battery very fast, proportionally >> to count of folders to check. > and that is why K9 on android let you select which folders > are relevant for you on the mobile and which should be > completly ignored and display the selected in "common inbox" This is not an argument. You can have hundred of folders sorted by sieve and really need to know if there new mail in any of it. >> I think that battery life is the reason, why this feature is not implemented >> in iPhone. It will use only one IMAP connection > so it is not "it's IMAP limitation" As I told - IMAP limitation is to control only one folder. > how does help me "save battery" if i have a folder-structure > maintained by sieve if i do not get my new mails? If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. Imagine if there will 100 folders? Therefore IMAP really have limitation to use it on mobile devices. > it's a limitation from Apple because they have not the > knowledge to implement relieable mail-clients see below > the removed posting on apple-support (first paragraphs > german but posting and answer from Apple below in english) > http://www.rhsoft.net/ I'm not fan of apple anyway, so do not interested in this discussion at all. Sergey S. Kovalev. From tss at iki.fi Fri Aug 10 12:25:35 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 12:25:35 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024D29E.5040400@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> Message-ID: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> On 10.8.2012, at 12.21, Sergey S. Kovalev wrote: >>> I think that battery life is the reason, why this feature is not implemented >>> in iPhone. It will use only one IMAP connection >> so it is not "it's IMAP limitation" > As I told - IMAP limitation is to control only one folder. Assuming NOTIFY extension isn't implemented by both. (Dovecot v2.2 hopefully will have it, and K-9 apparently is interested in adding it too after that.) >> how does help me "save battery" if i have a folder-structure >> maintained by sieve if i do not get my new mails? > If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. > Imagine if there will 100 folders? Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. From ms at mike2k.de Fri Aug 10 12:29:42 2012 From: ms at mike2k.de (Michael Stilkerich) Date: Fri, 10 Aug 2012 11:29:42 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> References: <20120810024444.GA16856@noboost.org> <065C22BF-D406-41F7-AFF2-CCAB68C006BF@iki.fi> Message-ID: <5024D486.40703@mike2k.de> Hi, On 10-Aug-12 4:48, Timo Sirainen wrote: > Related question that came to my mind: Does anyone know if XAPPLEPUSHSERVICE feature can be implemented by any server, or does it require cooperation between the server and the mobile network operator? I'm guessing the latter.. the Apple push service for Mail.app uses the same push notification service as all other push notifications for iOS (APNS, Apple Push Notification Service). The Device retains a persistent connection to Apple's APNS Gateway. To transmit a push notification via APNS, the sender needs a certificate issued by Apple for the receiving application (Mail.app in this case). One can get such a certificate by purchasing Lion Server, which includes such a certificate (I presume Mountain Lion Server does as well). The Lion Server uses dovecot, and Apple's patch for the XAPPLEPUSHSERVICE extension is available on http://www.opensource.apple.com/source/dovecot/dovecot-239/dovecot/src/plugins/push-notify/ It basically works as following: 1) Dovecot advertises the XAPPLEPUSHSERVICE Capability 2) When the device logs in to the IMAP server and sees that it supports this capability, it registers with the server for push notifications and provides its device id and the id of the corresponding mail account on the device. These two ids are required to route a push notification to the device. 3) The server records all registered devices for an account. Upon an incoming mail for the account, it transmits a push notification. 4) The device does not directly unregister; this is done using the feedback mechanism of APNS, which tells a service provider that a device does not wish to receive push notifications any longer. The actual transmission of the push notifications to the APNS server is not part of the dovecot patch but a separate program. One can use the Net::APNS perl module (found on cpan) to fairly easily replicate that program. Apple's original is also available: http://www.opensource.apple.com/source/dovecot/dovecot-239/dovecot.push-notify/daemon -Mike P.S.: I'm not sure if one is allowed to do this, though. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4493 bytes Desc: S/MIME Cryptographic Signature URL: From xray at randoman.ru Fri Aug 10 12:45:15 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Fri, 10 Aug 2012 16:45:15 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> Message-ID: <5024D82B.5040007@randoman.ru> 10.08.2012 16:25, Timo Sirainen ?????: >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? > Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. > I guess, there is no trick, that will change the linear complexity by traffic and by CPU usage. If you can change settings in dovecot - you can set up ActiveSync there. It's more suitable for mobile mailing. From h.reindl at thelounge.net Fri Aug 10 12:57:43 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 10 Aug 2012 11:57:43 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024D29E.5040400@randoman.ru> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> Message-ID: <5024DB17.2080600@thelounge.net> Am 10.08.2012 11:21, schrieb Sergey S. Kovalev: >> and that is why K9 on android let you select which folders >> are relevant for you on the mobile and which should be >> completly ignored and display the selected in "common inbox" > This is not an argument. You can have hundred of folders sorted by > sieve and really need to know if there new mail > in any of it surely IT IS an argument on a non-iPhone you can chosse what is important your agrumentation is even one argument more against iPhone >>> I think that battery life is the reason, why this feature is not implemented >>> in iPhone. It will use only one IMAP connection >> so it is not "it's IMAP limitation" > As I told - IMAP limitation is to control only one folder as proven by other devices there is no limitation >> how does help me "save battery" if i have a folder-structure >> maintained by sieve if i do not get my new mails? > If you open 10 connections to IMAP server and will IDLE on them - your phone > will wake up to reply for ping in every of that 10 connections. > Imagine if there will 100 folders? > Therefore IMAP really have limitation to use it on mobile devices again: how does it help me if I NEED to check them? and no, IMAP has no limitations proven by Android-client my Samsung Galaxy S3 has around 25 push folders no problem with K9 mail to have them in my "common inbox" including my own sent messages while on the desktop i use the folder structure and my battery has a average lifetime of 1.5 days -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From me at junc.org Fri Aug 10 14:03:36 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 13:03:36 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql Message-ID: currently dovecot dict is CREATE TABLE IF NOT EXISTS `quota` ( `username` varchar(100) COLLATE latin1_general_ci NOT NULL, `bytes` bigint(20) NOT NULL DEFAULT '0', `messages` int(11) NOT NULL DEFAULT '0', PRIMARY KEY (`username`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; there is not field that says how much quota each user have, so one cant make a query on how much its left pr user how can i resolve this in dovecot dict ? i like to do an postfix mysql map to temp reject if quota is out of limit -- Benny Pedersen From me at junc.org Fri Aug 10 14:29:21 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 13:29:21 +0200 Subject: [Dovecot] Server side Sieve with virtual users In-Reply-To: <5023E248.3030408@luigirosa.com> References: <5023E248.3030408@luigirosa.com> Message-ID: <760112e9985c43c2ff1bedb08a8444ed@junc.org> Den 2012-08-09 18:16, Luigi Rosa skrev: > Is there a way to implement server-side filters with Dovecot > configured with virtual users (userbase in mysql, a single *NIX user > account that owns /var/spool/mail and its content)? http://wiki1.dovecot.org/ManageSieve if using dovecot 2.x.x there is a seperate wiki From robert at schetterer.org Fri Aug 10 14:44:18 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 10 Aug 2012 13:44:18 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: <5024F412.8090501@schetterer.org> Am 10.08.2012 13:03, schrieb Benny Pedersen: > > currently dovecot dict is > > > CREATE TABLE IF NOT EXISTS `quota` ( > `username` varchar(100) COLLATE latin1_general_ci NOT NULL, > `bytes` bigint(20) NOT NULL DEFAULT '0', > `messages` int(11) NOT NULL DEFAULT '0', > PRIMARY KEY (`username`) > ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; > > > there is not field that says how much quota each user have, so one cant > make a query on how much its left pr user > > how can i resolve this in dovecot dict ? > > i like to do an postfix mysql map to temp reject if quota is out of limit > you may use ideas out of postfixadmin mysql layout -- Best Regards MfG Robert Schetterer From me at junc.org Fri Aug 10 18:18:07 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 17:18:07 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: Den 2012-08-10 13:03, Benny Pedersen skrev: if others need something like this: CREATE TABLE IF NOT EXISTS `quota` ( `username` varchar(100) COLLATE latin1_general_ci NOT NULL, `bytes` bigint(20) NOT NULL DEFAULT '0', `messages` int(11) NOT NULL DEFAULT '0', `quotamax` bigint(20) NOT NULL DEFAULT '0', PRIMARY KEY (`username`) ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; # /etc/postfix/dovecot_quota_maps.cf user = user password = password hosts = localhost dbname = database query = SELECT CONCAT('DEFER_IF_PERMIT Quotas Excceded') FROM quota WHERE username='%s' AND bytes>=quotamax # /etc/postfix/main.cf smtpd_recipient_restrictions = check_recipient_access mysql:/etc/postfix/dovecot_quota_maps.cf enjoy add to wiki if one could do this From duihi77 at gmail.com Fri Aug 10 19:25:43 2012 From: duihi77 at gmail.com (Duane Hill) Date: Fri, 10 Aug 2012 16:25:43 +0000 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: References: Message-ID: <1712023239.20120810162543@gmail.com> On Friday, August 10, 2012 at 15:18:07 UTC, me at junc.org confabulated: > Den 2012-08-10 13:03, Benny Pedersen skrev: > if others need something like this: > CREATE TABLE IF NOT EXISTS `quota` ( > `username` varchar(100) COLLATE latin1_general_ci NOT NULL, > `bytes` bigint(20) NOT NULL DEFAULT '0', > `messages` int(11) NOT NULL DEFAULT '0', > `quotamax` bigint(20) NOT NULL DEFAULT '0', > PRIMARY KEY (`username`) > ) ENGINE=MyISAM DEFAULT CHARSET=latin1 COLLATE=latin1_general_ci; > # /etc/postfix/dovecot_quota_maps.cf > user = user > password = password > hosts = localhost > dbname = database > query = SELECT CONCAT('DEFER_IF_PERMIT Quotas Excceded') FROM quota > WHERE username='%s' AND bytes>=quotamax No need to CONCAT when you are not concatenating anything. Just: SELECT 'DEFER_IF_PERMIT Quotas Exceeded' FROM quota ... > # /etc/postfix/main.cf > smtpd_recipient_restrictions = > check_recipient_access mysql:/etc/postfix/dovecot_quota_maps.cf > enjoy > add to wiki if one could do this -- If at first you don't succeed... ...so much for skydiving. From me at junc.org Fri Aug 10 19:48:32 2012 From: me at junc.org (Benny Pedersen) Date: Fri, 10 Aug 2012 18:48:32 +0200 Subject: [Dovecot] postfix mysql quota map to dovecot dict in mysql In-Reply-To: <1712023239.20120810162543@gmail.com> References: <1712023239.20120810162543@gmail.com> Message-ID: <48ed8ad322ebb709ac8c37a1d70af271@junc.org> Den 2012-08-10 18:25, Duane Hill skrev: > SELECT 'DEFER_IF_PERMIT Quotas Exceeded' FROM quota ... query = SELECT 'DEFER_IF_PERMIT Quotas Excceded' FROM quota WHERE username='%s' AND bytes>=quotamax AND quotamax>'0' so postfixadmin unlimted is supported thanks for suggesting to make to even better From djonas at vitalwerks.com Fri Aug 10 20:05:08 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:05:08 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory Message-ID: <50253F44.9040203@vitalwerks.com> Hello, I have a mailbox with an ungodly number of small messages in it. When new messages are delivered lmtp kicks up an error like the one below. I tried raising the vsz_limit for lmtp but that didn't see to help. Any ideas (besides deleting 400k messages)? Thanks! dovecot: lmtp(6068, user at example.com): Error: mmap() failed with file /home/vmail/domains/example.com/user/Maildir/dovecot.index.cache: Cannot allocate memory # ls -lah dovecot.index.cache -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache # doveadm mailbox status -u user at example.com all inbox INBOX messages=434118 recent=59848 uidnext=434119 uidvalidity=1293568548 unseen=432625 highestmodseq=14023 vsize=1329486283 guid=f8d48232244a1a4dfe2e0000cb0ad7e0 # doveconf -n ... default_vsz_limit = 256 M service lmtp { inet_listener lmtp { port = 24 } vsz_limit = 256 M } -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Fri Aug 10 20:10:21 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 10 Aug 2012 20:10:21 +0300 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <50253F44.9040203@vitalwerks.com> References: <50253F44.9040203@vitalwerks.com> Message-ID: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> On 10.8.2012, at 20.05, David Jonas wrote: > I have a mailbox with an ungodly number of small messages in it. When > new messages are delivered lmtp kicks up an error like the one below. I > tried raising the vsz_limit for lmtp but that didn't see to help. That should help. > # ls -lah dovecot.index.cache > -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache > > default_vsz_limit = 256 M > service lmtp { > inet_listener lmtp { > port = 24 > } > vsz_limit = 256 M > } Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. From djonas at vitalwerks.com Fri Aug 10 20:13:20 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:13:20 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> References: <50253F44.9040203@vitalwerks.com> <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> Message-ID: <50254130.3040209@vitalwerks.com> On Fri Aug 10 10:10:21 2012, Timo Sirainen wrote: > On 10.8.2012, at 20.05, David Jonas wrote: > >> I have a mailbox with an ungodly number of small messages in it. When >> new messages are delivered lmtp kicks up an error like the one below. I >> tried raising the vsz_limit for lmtp but that didn't see to help. > > That should help. > >> # ls -lah dovecot.index.cache >> -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache >> >> default_vsz_limit = 256 M >> service lmtp { >> inet_listener lmtp { >> port = 24 >> } >> vsz_limit = 256 M >> } > > Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. > I haven't tried higher. I'll make the change now though. Is there a way to test it besides delivering a new message? -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From djonas at vitalwerks.com Fri Aug 10 20:19:59 2012 From: djonas at vitalwerks.com (David Jonas) Date: Fri, 10 Aug 2012 10:19:59 -0700 Subject: [Dovecot] lmtp: Error: mmap failed with file ... dovecot.index.cache: Cannot allocate memory In-Reply-To: <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> References: <50253F44.9040203@vitalwerks.com> <4CA30AFF-8EB9-478D-A03A-6844D7D11A2A@iki.fi> Message-ID: <502542BF.5040907@vitalwerks.com> On 8/10/12 10:10 AM, Timo Sirainen wrote: > On 10.8.2012, at 20.05, David Jonas wrote: > >> I have a mailbox with an ungodly number of small messages in it. When >> new messages are delivered lmtp kicks up an error like the one below. I >> tried raising the vsz_limit for lmtp but that didn't see to help. > That should help. > >> # ls -lah dovecot.index.cache >> -rw------- 1 vmail vmail 128M Jul 29 20:16 dovecot.index.cache >> >> default_vsz_limit = 256 M >> service lmtp { >> inet_listener lmtp { >> port = 24 >> } >> vsz_limit = 256 M >> } > Did you try higher than 256M? There might be some memory temporarily wasted which causes it to go over. > service lmtp { vsz_limit = 320 M } Yep. That seems to cover it. Delivered a message with lmtp and no error in the logs. dovecot.index.cache timestamp updated too. Thanks! Guess I should have tried something absurdly high before emailing, just to see if that was it. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4933 bytes Desc: S/MIME Cryptographic Signature URL: From rob at fantinibakery.com Fri Aug 10 20:32:13 2012 From: rob at fantinibakery.com (rob) Date: Fri, 10 Aug 2012 13:32:13 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5024A980.1080207@schetterer.org> References: <24a9-50241000-13-11050340@19539233> <5024A980.1080207@schetterer.org> Message-ID: <5025459D.1070403@fantinibakery.com> On 08/10/2012 02:26 AM, Robert Schetterer wrote: > Am 09.08.2012 21:32, schrieb rob: >> >> On Thursday, August 9, 2012 15:19 EDT, Stephan Bosch wrote: >> >>> On 8/9/2012 7:08 PM, rob wrote: >>>> Hello >>>> We are looking for information on how to use Vacation auto-reply . >>>> >>>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a few >>>> other pages, but have not found how to set it up. >>>> >>>> We use sogo and thunderbird . >>>> >>>> Is there a how to or document for this somewhere? >>> What exactly do you want to know? >>> >>> Regards, >>> >>> Stephan. >>> >> >> >> >> I'd like to know : >> - If we have Dovecot configured OK for vacation sieve. >> >> - It looks like we should try to manage the vacation sieve filters using sogo or thunderbird . Is that the normal way to do so? >> > sieve in dovecot acts like a server where you can feed sieve rules i.e > vacation, some software mostly webmailsers have guis for this, like > sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin > > if you setup dovecot sieve server rightly , you might see in the dovecot > logs , and/or send dovecot config to the list, look for manuals on the > dovecot site and in www for setup instructions What I need to know is if we have enabled siege and managesieve correctly in dovecot. The following is out config. : root at mail ~ # dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid auth_mechanisms = plain login auth_username_format = %Ln lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_location = maildir:%h/Maildir mail_plugins = " quota" maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_plugins = quota sieve quota = fs:user quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=60%% quota-warning 60 %u quota_warning4 = storage=40%% quota-warning 40 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/ } postmaster_address = fbcadmin at fantinibakery.com protocols = " imap lmtp sieve" quota_full_tempfail = yes service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service imap-login { service_count = 0 vsz_limit = 128 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 1 service_count = 0 vsz_limit = 256 M } service quota-warning { executable = script /fbc/bin/mail/quota-warning.sh user = dovecot } ssl = required ssl_ca = References: <34275123.post@talk.nabble.com> <20120810023525.GA14423@daniel.localdomain> Message-ID: <34284058.post@talk.nabble.com> my 10-master.conf; service pop3-login { inet_listener pop3 { } service pop3 { executable = pop3 pop3-postlogin } service pop3-postlogin { executable = script-login /usr/local/bin/postlogin_pop3.sh user = root unix_listener pop3-postlogin { } } when i restart dovecot service. i get an error; Aug 11 00:48:27 pop3y dovecot: pop3-postlogin: Error: read: Illegal option -d Aug 11 00:39:56 pop3y dovecot: pop3-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=99386, secured, session= Aug 11 00:39:56 pop3y dovecot: pop3(test at test.com): Post-login script denied access to user test at test.com Aug 11 00:39:56 pop3y dovecot: pop3-postlogin: Fatal: master: service(pop3-postlogin): child 99387 returned error 10 pop3y# ll /usr/local/bin/postlogin_pop3.sh -rwxr-xr-x 1 root wheel 5449 Aug 11 00:46 /usr/local/bin/postlogin_pop3.sh i use freebsd8.2 -- View this message in context: http://old.nabble.com/about-postlogin-in-dovecot2-tp34275123p34284058.html Sent from the Dovecot mailing list archive at Nabble.com. From ncjeffgus at zimage.com Sat Aug 11 00:54:02 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Fri, 10 Aug 2012 14:54:02 -0700 Subject: [Dovecot] dsync backup gets stuck... fails Message-ID: <1344635642.23239.8.camel@maclinux> More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same problem with both versions. I'm getting an error 75 on about 40 boxes out of 1800. It is the same list of boxes every time we use 'dsync backup' to backup the server. dsync seems to stop communicating to the backup box (over ssh). strace just shows it sitting at a epoll_wait. Once the program quits (times out?), a 'du' shows the destination is smaller (200kbyte in one case). Has anyone else seen an exit code of 75? Nothing in the documentation mentions what exit code 75 could mean. What can I do to help the developers locate the bug? ...Jeff From xray at randoman.ru Sat Aug 11 00:55:49 2012 From: xray at randoman.ru (Sergey S. Kovalev) Date: Sat, 11 Aug 2012 04:55:49 +0700 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <5024DB17.2080600@thelounge.net> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <5024DB17.2080600@thelounge.net> Message-ID: <50258365.4060504@randoman.ru> 10.08.2012 16:57, Reindl Harald ?????: > surely IT IS an argument > > on a non-iPhone you can chosse what is important > your agrumentation is even one argument more against iPhone If we now talking about android vs iPhone now... Imagine Android default email client. It have no many features, that iPhone's default have (Note: i do not use iPhone, i'm not fan of Apple). Then return to thing I wanna tell in previous letter - the situation, when you really NEED to follow ALL of hundred of mail dirs. >>>> I think that battery life is the reason, why this feature is not implemented >>>> in iPhone. It will use only one IMAP connection >>> so it is not "it's IMAP limitation" >> As I told - IMAP limitation is to control only one folder > as proven by other devices there is no limitation Can't you distinguish the protocol itself with limitation to follow only one dir and the realization with workaround to create many connections to follow all required dirs? Just imagine that ActiveSync have no that limitation - it use only one connection for any count of mail dirs and therefore it's scalability is very good! >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone >> will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? >> Therefore IMAP really have limitation to use it on mobile devices > again: how does it help me if I NEED to check them? Sure! If you NEED to check them - I guess you can find some app in Apple Store. > and no, IMAP has no limitations proven by Android-client > my Samsung Galaxy S3 has around 25 push folders Yes, it has. The workaround is something else, that limitation itself. > no problem with K9 mail to have them in my "common inbox" > including my own sent messages while on the desktop i > use the folder structure and my battery has a average > lifetime of 1.5 days Android's power consumption is a result of very many factors. Spherical 1.5 days is something that have no any sense. From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 00:58:02 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Fri, 10 Aug 2012 23:58:02 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <34284058.post@talk.nabble.com> References: <34275123.post@talk.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> Message-ID: <20120810215802.GA11509@daniel.localdomain> Bulend Mali wrote: > service pop3-postlogin { > executable = script-login /usr/local/bin/postlogin_pop3.sh > } > > when i restart dovecot service. i get an error; > Aug 11 00:48:27 pop3y dovecot: pop3-postlogin: Error: read: Illegal option -d Seems like you are calling a command with argument -d in your script while the command does not recognize any argument -d. Can you post your script "postlogin_pop3.sh" for review please? Regards Daniel -- https://plus.google.com/103021802792276734820 From bmalik at ihlas.net.tr Sat Aug 11 01:14:12 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Fri, 10 Aug 2012 15:14:12 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810215802.GA11509@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> Message-ID: <1344636852565-7786.post@n4.nabble.com> i can manage read -d problem changing -p what should be user rights of the postlogin_pop3.sh ? i use vpopmail the pop3script; #!/bin/sh # 30-jul-2007 # # Author: # Oliver Schulze L. # Contact: http://tinymailto.com/oliver # Paraguay INTRANET_NETS="127.0.0.1 10." # users that can login from the Internet INTERNET_USERS="user1 user2 user3 user4 test at test.com" DEBUG=0 # variables setup by dovecot: IP USER # configure the dovecot binary to run based on the name of the script, so # this script can be used for imap and pop3 just by making a link SCRIPT_BASE="postlogin" DOVECOT_EXEC="" if [ "$(basename $0)" = "${SCRIPT_BASE}_imap.sh" ] ; then DOVECOT_EXEC="/usr/local/libexec/dovecot/imap" elif [ "$(basename $0)" = "${SCRIPT_BASE}_pop3.sh" ] ; then DOVECOT_EXEC="/usr/local/libexec/dovecot/pop3" else MSG="Please edit the file $(basename $0) and change the SCRIPT_BASE variable" /usr/bin/logger "$MSG" # display a message to the user echo "* OK [ALERT] $MSG" # cancel the current imap request echo "* NO $MSG" exit 1 fi # debug if [ $DEBUG -eq 1 ] ; then # TEST data DEBUG=1 # intranet test, any user can login #IP=192.168.1.23 #USER=user222 # internet test, only user user2 can login #IP=200.85.32.2 #USER=user2 fi if [ -z "$IP" ] ; then echo "$(basename $0): IP variable is empty" exit 2 fi if [ -z "$USER" ] ; then echo "$(basename $0): USER variable is empty" exit 3 fi # FLAGS IN_INTRANET=0 INTERNET_ALLOWED=0 DOVECOT_ALLOW=0 # Create this file in a RAM based directory in order to gain performance FILE_TMP=$(mktemp /tmp/login-intranet-dovecot.tmp.XXXXXX) # ------------------------------------------------------------------------------ # check if the IP is from the Intranet # always use a tmp file in while in order to modify this script variables echo "$INTRANET_NETS " > $FILE_TMP # cicle all intranets while read -p ' ' net_intranet ; do net_grep=$(echo $net_intranet | sed -e 's/\./\\\./g') echo $IP | grep $net_grep 2>/dev/null 1>/dev/null RES=$? if [ $DEBUG -eq 1 ] ; then echo " net_intranet: $net_intranet -> RES: $RES" fi if [ $RES -eq 0 ] ; then # the IP is from the intranet, stop processing and allow login IN_INTRANET=1 break fi done < $FILE_TMP # ------------------------------------------------------------------------------ # if the user is connecting from outside the intranet, check if it is allowed # to do so if [ $IN_INTRANET -eq 0 ] ; then # always use a tmp file in while echo "$INTERNET_USERS " > $FILE_TMP # cicle all allowed internet users while read -p ' ' user_inet ; do if [ $DEBUG -eq 1 ] ; then echo " $USER == $user_inet" fi if [ "$USER" = "$user_inet" ] ; then # the user is conecting from the Internet and is allowed, stop # processing and allow login INTERNET_ALLOWED=1 break fi done < $FILE_TMP fi if [ $DEBUG -eq 1 ] ; then echo "IN_INTRANET : $IN_INTRANET" echo "INTERNET_ALLOWED: $INTERNET_ALLOWED" fi # delete temp file rm -f $FILE_TMP if [ $IN_INTRANET -eq 1 ] ; then # the user is conecting from the intranet DOVECOT_ALLOW=1 elif [ $IN_INTRANET -eq 0 ] && [ $INTERNET_ALLOWED -eq 1 ] ; then # the user is conecting from the internet and is an allowed internet user DOVECOT_ALLOW=1 fi # check if the user can login if [ $DOVECOT_ALLOW -eq 1 ] ; then # the user can login, run the imap or pop3 server if [ $DEBUG -eq 1 ] ; then echo "exec $DOVECOT_EXEC" else # this script ends here exec $DOVECOT_EXEC fi else # user is not allowed to login, inform the user and system log #MSG="El usuario '$USER' no puede conectarse desde Internet" MSG="User '$USER' not allowed to connect from the Internet [$IP]" /usr/bin/logger "$(basename $0): $MSG" # display a message to the user echo "* OK [ALERT] $MSG" # cancel the current imap request echo "* NO $MSG" exit 10 fi exec $@ -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p7786.html Sent from the Dovecot mailing list archive at Nabble.com. From rob at fantinibakery.com Sat Aug 11 01:15:23 2012 From: rob at fantinibakery.com (rob) Date: Fri, 10 Aug 2012 18:15:23 -0400 Subject: [Dovecot] looking for information on Vacation auto-reply In-Reply-To: <5025459D.1070403@fantinibakery.com> References: <24a9-50241000-13-11050340@19539233> <5024A980.1080207@schetterer.org> <5025459D.1070403@fantinibakery.com> Message-ID: <502587FB.6090300@fantinibakery.com> On 08/10/2012 01:32 PM, rob wrote: > On 08/10/2012 02:26 AM, Robert Schetterer wrote: >> Am 09.08.2012 21:32, schrieb rob: >>> >>> On Thursday, August 9, 2012 15:19 EDT, Stephan >>> Bosch wrote: >>> >>>> On 8/9/2012 7:08 PM, rob wrote: >>>>> Hello >>>>> We are looking for information on how to use Vacation auto-reply . >>>>> >>>>> I've read http://wiki2.dovecot.org/Pigeonhole/Sieve/Usage and a >>>>> few >>>>> other pages, but have not found how to set it up. >>>>> >>>>> We use sogo and thunderbird . >>>>> >>>>> Is there a how to or document for this somewhere? >>>> What exactly do you want to know? >>>> >>>> Regards, >>>> >>>> Stephan. >>>> >>> >>> >>> >>> I'd like to know : >>> - If we have Dovecot configured OK for vacation sieve. >>> >>> - It looks like we should try to manage the vacation sieve filters >>> using sogo or thunderbird . Is that the normal way to do so? >>> >> sieve in dovecot acts like a server where you can feed sieve rules i.e >> vacation, some software mostly webmailsers have guis for this, like >> sogo, roundcube, horde ,squirrelmail also thunderbird has a sieve plugin >> >> if you setup dovecot sieve server rightly , you might see in the dovecot >> logs , and/or send dovecot config to the list, look for manuals on the >> dovecot site and in www for setup instructions > > What I need to know is if we have enabled siege and managesieve > correctly in dovecot. The following is out config. : > > root at mail ~ # dovecot -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-2-amd64 x86_64 Debian wheezy/sid > auth_mechanisms = plain login > auth_username_format = %Ln > lda_mailbox_autocreate = yes > lda_mailbox_autosubscribe = yes > mail_location = maildir:%h/Maildir > mail_plugins = " quota" > maildir_very_dirty_syncs = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > namespace { > inbox = yes > location = > prefix = INBOX. > separator = . > type = private > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > mail_plugins = quota sieve > quota = fs:user > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > quota_warning3 = storage=60%% quota-warning 60 %u > quota_warning4 = storage=40%% quota-warning 40 %u > sieve = ~/.dovecot.sieve > sieve_before = /etc/dovecot/sieve/spam.sieve > sieve_dir = ~/sieve > sieve_global_dir = /etc/dovecot/sieve/ > } > postmaster_address = fbcadmin at fantinibakery.com > protocols = " imap lmtp sieve" > quota_full_tempfail = yes > service auth-worker { > user = $default_internal_user > } > service auth { > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > unix_listener auth-userdb { > group = postfix > mode = 0600 > user = postfix > } > } > service imap-login { > service_count = 0 > vsz_limit = 128 M > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0660 > user = postfix > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > process_min_avail = 1 > service_count = 0 > vsz_limit = 256 M > } > service quota-warning { > executable = script /fbc/bin/mail/quota-warning.sh > user = dovecot > } > ssl = required > ssl_ca = ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol lmtp { > mail_plugins = quota sieve > } > protocol imap { > mail_max_userip_connections = 30 > mail_plugins = " quota imap_quota" > plugin { > antispam_backend = spool2dir > antispam_signature = X-DSPAM-Signature > antispam_spam = Junk > antispam_spool2dir_notspam = /var/spamtrain/not-spam/%%020lu-%u-%%05 > antispam_spool2dir_spam = /var/spamtrain/spam/%%020lu-%u-%%05 > antispam_trash = Trash > antispam_verbose_debug = 1 > } > } > protocol sieve { > mail_debug = yes > managesieve_implementation_string = Dovecot Pigeonhole > } > > Best regards and thank you for the help! > Rob > OK It looks like our dovecot setup is ok: gnutls-cli --starttls -p 4190 127.0.0.1 Processed 152 CA certificate(s). Resolving '127.0.0.1'... Connecting to '127.0.0.1:4190'... |<1>| Note that the security level of the Diffie-Hellman key exchange has been lowered to 512 bits and this may allow decryption of the session data - Simple Client Mode: "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 01:46:38 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 00:46:38 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344636852565-7786.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> Message-ID: <20120810224638.GA11918@daniel.localdomain> bmalik wrote: > i can manage read -d problem changing -p You should not do that, since the semantics of -d and -p are completely different. Argument -d ' ' sets the delimiter for reading words to space, while -p enables password mode in order to disable input echo. By simply replacing -d with -p you will most probably break the functionality of the original script. On freeBSD you're using a different default shell (sh) than the original author, so your "read" command provided by the shell behaves differently. Install bash or some other compatible shell which supports read -d and try to replace the first line of the script with #!/bin/bash or the corresponding shell executable to use another shell for the execution of the script. > what should be user rights of the postlogin_pop3.sh? The flags r (read) and x (execute) should be allowed for dovecot group, so that the mailserver can read and execute the script. Others do not need access to the script. I've set permissions for the "post-login" script as follows: -rwxr-x--- root dovecot Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 01:56:22 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 00:56:22 +0200 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <20120810225621.GA12297@daniel.localdomain> Hi Jeff, Jeff Gustafson wrote: > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > problem with both versions. > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > list of boxes every time we use 'dsync backup' to backup the server. > dsync seems to stop communicating to the backup box (over ssh). strace > just shows it sitting at a epoll_wait. Once the program quits (times > out?), a 'du' shows the destination is smaller (200kbyte in one case). > What can I do to help the developers locate the bug? Please start by following the instructions at http://dovecot.org/bugreport.html and post your 'doveconf -n' output in order to provide possibly important information about your system and configs. Regards Daniel -- https://plus.google.com/103021802792276734820 From bmalik at ihlas.net.tr Sat Aug 11 04:33:51 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Fri, 10 Aug 2012 18:33:51 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810224638.GA11918@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> Message-ID: <1344648831922-25969.post@n4.nabble.com> I started to use bash in the script and changed read -d instead of -p. Also I get the script 's rights root:dovecot I get an error; -ERR pop3 binary must not be started from inetd, use pop3-login instead. Connection closed by foreign host. Aug 11 04:30:05 pop3y dovecot: pop3(test at test.com): Post-login script denied access to user test at test.com Aug 11 04:30:05 pop3y dovecot: pop3-postlogin: Fatal: master: service(pop3-postlogin): child 15837 returned error 1 -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p25969.html Sent from the Dovecot mailing list archive at Nabble.com. From ncjeffgus at zimage.com Sat Aug 11 04:50:16 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Fri, 10 Aug 2012 18:50:16 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <20120810225621.GA12297@daniel.localdomain> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> Message-ID: <1344649816.23239.13.camel@maclinux> On Sat, 2012-08-11 at 00:56 +0200, Daniel Parthey wrote: > Hi Jeff, > Please start by following the instructions at > http://dovecot.org/bugreport.html > and post your 'doveconf -n' output in order to provide > possibly important information about your system and configs. Storage is local hardware-based RAID (SATA drives). FS is ext4. No core dump that I know of. Command used (mailbox is over 2GB): # su vmail -c "dsync -u user at domain.com backup ssh vmail at bk05 dsync -c /etc/dovecot/dovecot.conf -u user at domain.com" Config file: # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 CentOS release 6.2 (Final) auth_mechanisms = plain login default_client_limit = 15000 default_process_limit = 10000 disable_plaintext_auth = no listen = * mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib quota stats mail_uid = vmail mmap_disable = yes namespace { inbox = yes location = prefix = INBOX. separator = . } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User noenforcing quota::file:%h/dovecot-quota stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz } protocols = imap pop3 service auth { client_limit = 10000 unix_listener auth-userdb { mode = 0666 } } service imap-postlogin { executable = script-login /usr/bin/postlogin-imap.sh user = $default_internal_user } service imap { drop_priv_before_exec = yes executable = imap process_limit = 10000 } service pop3-postlogin { executable = script-login /usr/bin/postlogin-pop.sh user = $default_internal_user } service pop3 { drop_priv_before_exec = yes executable = pop3 process_limit = 2500 } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = Hello, is it possible to use the Solr full text search plugin for indexing mail attachments? I found a very old patch and some hints regarding a fts_decoder script that I don't understand. Making Solr indexing PDF or Office files shouldn't be that difficult, but how can I enable the plugin to transfer the attachments to Solr? Best regards, Sebastian From bmalik at ihlas.net.tr Sat Aug 11 12:36:21 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Sat, 11 Aug 2012 02:36:21 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120810224638.GA11918@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> Message-ID: <1344677781012-37034.post@n4.nabble.com> is there another post-login script that i can use on freebsd ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37034.html Sent from the Dovecot mailing list archive at Nabble.com. From rafinathan25 at gmail.com Sat Aug 11 13:11:55 2012 From: rafinathan25 at gmail.com (Rafael Nathan) Date: Sat, 11 Aug 2012 15:41:55 +0530 Subject: [Dovecot] Exim and Dovecot Message-ID: Hi, I am installing Exim and Dovecot through yum on my Centos 5 x86_64 machine. Exim is unable to find the virtual users. Is there a full-fledged guide to get the two working. Any help is highly appreciated. Regards, Rafael From nmilas at noa.gr Sat Aug 11 16:02:39 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Sat, 11 Aug 2012 16:02:39 +0300 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50246846.6020606@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> Message-ID: <502657EF.2090600@noa.gr> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: > That begs the question, > what is your definition of a "Highly Available Mail Server"? What is it > that you actually want to accomplish? In some detail please. OK, I'll make it as much as possible accurate. Let's skip all the network stuff and see a particular scenario (as we have drafted it). We have an incoming gateway server (gw.example.com) accepting mail and filtering viruses/spam. Then it relays all (clean) mail to mail1.example.com, which uses Postfix/Dovecot (2.0 or 2.1) and provides Maildir mailboxes (POP/IMAP) to users. Now, let us assume we are deploying another server, mail2.example.com (also Postfix/Dovecot), which we want to function as follows: 1. Under normal conditions, mail2.example.com is a full mirror of mail1.example.com; when any mail message is added/viewed/moved/removed etc. to any user's folder or any folder is added/viewed/moved/removed etc. at mail1.example.com, we want it to be automatically and directly (in real time) added/viewed/moved/removed etc. to mail2.example.com too. In other words, we need continuous, real-time sync. 2. If mail1.example.com for some reason is unavailable, then we will be able to manually redirect relaying (of incoming messages) to mail2.example.com. Then, users will be able to use mail2.example.com to access their mail. Now, when mail1.example.com becomes available again, we want to: a. inform users (by sending them a mail on mail2.example.com) that mail1.example.com is available again, b. stop relaying to mail2.example.com c. sync once mailboxes on mail1.example.com to mail2.example.com (because mail2.example.com is now more current) d. redirect relaying to mail1.example.com e. switch to normal operation (see ?1 above) Can I do this and how? I would call this pseudo-HA, since users have to switch servers in case of failures. To use the above as "true" HA (as I view it), there could be a mail.example.com functioning as a proxy and automatically redirecting users to mail1 or mail2, depending on admins' choice. Can I do this too? (How?) [Google mail is not an option, we don't want external hosting. We can have as many high-performance, highly-reliable VMs as we want for free on our ISP's network - it's a service to the Greek educational/research community. They use two different specialized high-end enterprise-grade dedicated virtualization clusters of host hardware (which I -not being very accurate- called clouds) on their networks, each of which uses dedicated high-end enterprise-grade SAN-based storage. Practically we have never had VM outages due to hardware failures, only due to software (rarely) or network (mainly) ones. mail1.example.com would be deployed on the main virtualization cluster and mail2.example.com would be on the the other cluster. KVM is used as host virtualization software.] Alternative suggestions on design approaches would be welcome. Thanks and regards, Nick From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 16:50:13 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 15:50:13 +0200 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344649816.23239.13.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> <1344649816.23239.13.camel@maclinux> Message-ID: <20120811135012.GA18601@daniel.localdomain> Jeff Gustafson wrote: > On Sat, 2012-08-11 at 00:56 +0200, Daniel Parthey wrote: > > Hi Jeff, > > Please start by following the instructions at > > http://dovecot.org/bugreport.html > > and post your 'doveconf -n' output in order to provide > > possibly important information about your system and configs. > > Storage is local hardware-based RAID (SATA drives). FS is ext4. > No core dump that I know of. > Command used (mailbox is over 2GB): > > # su vmail -c "dsync -u user at domain.com backup ssh vmail at bk05 dsync -c /etc/dovecot/dovecot.conf -u user at domain.com" > > Config file: > # 2.1.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-220.17.1.el6.x86_64 x86_64 CentOS release 6.2 > (Final) Maybe you have run into the epoll kernel bug under RHEL/CentOS: http://dovecot.org/oldnews.html Thu Mar 22 14:38:53 EET 2012 Red Hat/CentOS users: A recent kernel update causes Dovecot to start failing after it has reached 1000 child processes. To fix this, downgrade your kernel until Red Hat releases a fixed kernel. See also: https://bugzilla.redhat.com/show_bug.cgi?id=681578 You should try another kernel: https://rhn.redhat.com/errata/RHSA-2012-1129.html Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 18:19:20 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 17:19:20 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344677781012-37034.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> Message-ID: <20120811151920.GA19891@daniel.localdomain> bmalik wrote: > is there another post-login script that i can use on freebsd ? You can use virtually any executable for post-login if they communicate as expected. First you should start simple and create a post-login script consisting of just a few lines which just covers the case of "access always granted to any user". Once you got this working, you will be able to extend your script with the required denial features. Why are you executing any $DOVECOT_EXEC anyways? The example scripts at http://wiki2.dovecot.org/PostLoginScripting are just doing a exec "$@" to exec chained scripts. It seems that dovecot already executes the service binary, which then communicates with the script-login process from "imap-postlogin" service via its "imap-postlogin" socket: service imap { # tell imap to do post-login lookup using a socket called "imap-postlogin" executable = imap imap-postlogin } # The service name below doesn't actually matter. service imap-postlogin { # all post-login scripts are executed via script-login binary executable = script-login /usr/local/bin/postlogin.sh # the script process runs as the user specified here (v2.0.14+): user = $default_internal_user # this UNIX socket listener must use the same name as given to imap executable unix_listener imap-postlogin { } } Regards Daniel -- https://plus.google.com/103021802792276734820 From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 11 19:52:45 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 11 Aug 2012 18:52:45 +0200 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502657EF.2090600@noa.gr> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> Message-ID: <20120811165245.GA21206@daniel.localdomain> Nikolaos Milas wrote: > On 10/8/2012 4:47 ??, Stan Hoeppner wrote: > > >That begs the question, > >what is your definition of a "Highly Available Mail Server"? What is it > >that you actually want to accomplish? In some detail please. > > 1. Under normal conditions, mail2.example.com is a full mirror of > mail1.example.com; when any mail message is > added/viewed/moved/removed etc. to any user's folder or any folder > is added/viewed/moved/removed etc. at mail1.example.com, we want it > to be automatically and directly (in real time) > added/viewed/moved/removed etc. to mail2.example.com too. In other > words, we need continuous, real-time sync. > > Can I do this and how? You might have a look at DRBD (distributed replicated block device) which provides a high available block device with fully synchronous mirroring: http://www.drbd.org/home/mirroring Dovecot can then simply work with the filesystem residing on the highly avilable DRBD volume. Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Sat Aug 11 20:11:46 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 11 Aug 2012 12:11:46 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502657EF.2090600@noa.gr> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> Message-ID: <50269252.8060508@hardwarefreak.com> On 8/11/2012 8:02 AM, Nikolaos Milas wrote: > 1. Under normal conditions, mail2.example.com is a full mirror of > mail1.example.com; when any mail message is added/viewed/moved/removed > etc. to any user's folder or any folder is added/viewed/moved/removed > etc. at mail1.example.com, we want it to be automatically and directly > (in real time) added/viewed/moved/removed etc. to mail2.example.com too. > In other words, we need continuous, real-time sync. There are 3 ways to do this, all require a form of shared storage: 1. A cluster filesystem atop shared storage 2. DRBD mirroring with a cluster filesystem atop 3. NFS #1 won't work in a VPS "cloud" unless the provider gives you direct access to an iSCSI SAN LUN. #2 might but you'll be in uncharted waters. #3 will work in a VPS cloud, but the host serving NFS is a single point of failure. DRBD mirroring is typically done with an X-over cable between the two nodes. If the packets must traverse a WAN link, or an internal network that experiences any packet loss, DRBD will have problems. You'll need to make sure fencing is working properly which entails lots of testing before going into production. http://www.drbd.org/ Pick DRBD expert's brains to determine if doing it over a VPS LAN is possible/feasible. > 2. If mail1.example.com for some reason is unavailable, then we will be > able to manually redirect relaying (of incoming messages) to > mail2.example.com. When setup properly no manual intervention is necessary. Everything is automatic. If one of the two Dovecot/DRBD nodes is down mail is automatically relayed to the other. This is done by putting putting a Postfix instance on each cluster node with equal priority MX records for both. So instead of having two MX relay/AS/AV servers and two Dovecot mailbox servers, you have once instance of everything on each of two nodes. I.e. Postfix+amavisd+SA+Dovecot+etc on each node. Equal priority MX will route inbound mail fairly evenly between both nodes. If one MX is unreachable, remote SMTP clients will retry the other MX. It's fully automatic. You may want to install Dovecot director on one of the nodes so IMAP connections are spread evenly and to avoid mailbox locking/delay issues. > Then, users will be able to use mail2.example.com to > access their mail. Now, when mail1.example.com becomes available again, > we want to: > a. inform users (by sending them a mail on mail2.example.com) that > mail1.example.com is available again, > b. stop relaying to mail2.example.com > c. sync once mailboxes on mail1.example.com to mail2.example.com > (because mail2.example.com is now more current) > d. redirect relaying to mail1.example.com > e. switch to normal operation (see ?1 above) Again, all of this is unnecessary, as it's fully automatic when done properly. > Can I do this and how? Writing you a complete design document for doing this is beyond the scope of a mailing list thread. There exists plenty of documentation on the web. You will have to do your own research, but I've pointed you in the right direction. There are people on this list using a configuration almost identical to this, but not with VPS, though I am not one of them. When you are far enough along in the process and have specific questions I'm sure others will be glad to help. > I would call this pseudo-HA, since users have to switch servers in case > of failures. To use the above as "true" HA (as I view it), there could > be a mail.example.com functioning as a proxy and automatically > redirecting users to mail1 or mail2, depending on admins' choice. Can I > do this too? (How?) See Dovecot director: http://wiki2.dovecot.org/Director > [Google mail is not an option, we don't want external hosting. We can > have as many high-performance, highly-reliable VMs as we want for free > on our ISP's network - it's a service to the Greek educational/research > community. They use two different specialized high-end enterprise-grade > dedicated virtualization clusters of host hardware (which I -not being > very accurate- called clouds) on their networks, each of which uses > dedicated high-end enterprise-grade SAN-based storage. Practically we > have never had VM outages due to hardware failures, only due to software > (rarely) or network (mainly) ones. mail1.example.com would be deployed > on the main virtualization cluster and mail2.example.com would be on the > the other cluster. KVM is used as host virtualization software.] The approach I outlined above may work, as long as the network is reliable enough to keep DRBD happy. Once built you will obviously want to test the setup with a simulated real world workload for a few weeks to a month in order to confirm the network is reliable enough to support DRBD, before attempting full live deployment. But this is true of any new back end services deployment. I dunno if Eric Rostetter is still around. He's got a very similar setup running at UT Austin, but on two dedicated servers, not VPS. He could probably give you some pointers if you run into design/config trouble: http://www.ph.utexas.edu/person/rostetter_eric I'm sure there are others with a very similar setup on this list. -- Stan From stan at hardwarefreak.com Sat Aug 11 20:18:18 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 11 Aug 2012 12:18:18 -0500 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <20120811165245.GA21206@daniel.localdomain> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <20120811165245.GA21206@daniel.localdomain> Message-ID: <502693DA.7020202@hardwarefreak.com> On 8/11/2012 11:52 AM, Daniel Parthey wrote: > Nikolaos Milas wrote: >> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: >> >>> That begs the question, >>> what is your definition of a "Highly Available Mail Server"? What is it >>> that you actually want to accomplish? In some detail please. >> >> 1. Under normal conditions, mail2.example.com is a full mirror of >> mail1.example.com; when any mail message is >> added/viewed/moved/removed etc. to any user's folder or any folder >> is added/viewed/moved/removed etc. at mail1.example.com, we want it >> to be automatically and directly (in real time) >> added/viewed/moved/removed etc. to mail2.example.com too. In other >> words, we need continuous, real-time sync. >> >> Can I do this and how? > > You might have a look at DRBD (distributed replicated block device) > which provides a high available block device with fully synchronous > mirroring: > > http://www.drbd.org/home/mirroring > > Dovecot can then simply work with the filesystem residing on > the highly avilable DRBD volume. But to be clear, for a true HA setup with full active/active nodes, this must be a cluster filesystem (GFS2/OCFS2). -- Stan From rob at fantinibakery.com Sat Aug 11 20:43:52 2012 From: rob at fantinibakery.com (rob) Date: Sat, 11 Aug 2012 13:43:52 -0400 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <502693DA.7020202@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <20120811165245.GA21206@daniel.localdomain> <502693DA.7020202@hardwarefreak.com> Message-ID: <502699D8.3050306@fantinibakery.com> On 08/11/2012 01:18 PM, Stan Hoeppner wrote: > On 8/11/2012 11:52 AM, Daniel Parthey wrote: >> Nikolaos Milas wrote: >>> On 10/8/2012 4:47 ??, Stan Hoeppner wrote: >>> >>>> That begs the question, >>>> what is your definition of a "Highly Available Mail Server"? What is it >>>> that you actually want to accomplish? In some detail please. >>> 1. Under normal conditions, mail2.example.com is a full mirror of >>> mail1.example.com; when any mail message is >>> added/viewed/moved/removed etc. to any user's folder or any folder >>> is added/viewed/moved/removed etc. at mail1.example.com, we want it >>> to be automatically and directly (in real time) >>> added/viewed/moved/removed etc. to mail2.example.com too. In other >>> words, we need continuous, real-time sync. >>> >>> Can I do this and how? >> You might have a look at DRBD (distributed replicated block device) >> which provides a high available block device with fully synchronous >> mirroring: >> >> http://www.drbd.org/home/mirroring >> >> Dovecot can then simply work with the filesystem residing on >> the highly avilable DRBD volume. > But to be clear, for a true HA setup with full active/active nodes, this > must be a cluster filesystem (GFS2/OCFS2). > A good solution for kvm + drbd is this: http://pve.proxmox.com/wiki/Two-Node_High_Availability_Cluster From bmalik at ihlas.net.tr Sun Aug 12 16:44:43 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Sun, 12 Aug 2012 06:44:43 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120811151920.GA19891@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> Message-ID: <1344779083953-37043.post@n4.nabble.com> Thank you I wrote a loginscript in bash. it works well. I can restrict a user by IP. Well , how can i restrict a particular email address by tcp port ? I want a particular mail address to be forced to use pop3s/imaps. I use vpopmail / dovecot2 -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37043.html Sent from the Dovecot mailing list archive at Nabble.com. From madduck at debian.org Sun Aug 12 20:26:10 2012 From: madduck at debian.org (martin f krafft) Date: Sun, 12 Aug 2012 19:26:10 +0200 Subject: [Dovecot] Running spamc during LMTP delivery In-Reply-To: <20120809122351.GA26800@albatross.gern.madduck.net> References: <20120808090810.GA9152@fishbowl.rw.madduck.net> <502238FA.6040901@corefiling.co.uk> <20120809122351.GA26800@albatross.gern.madduck.net> Message-ID: <20120812172610.GA2741@fishbowl.rw.madduck.net> also sprach martin f krafft [2012.08.09.1423 +0200]: > and then put the following sieve script into /etc/dovecot/sieve.before.d/spamassassin.sieve: > > require [ "vnd.dovecot.filter" ]; > filter "spamc" [ "--no-safe-fallback" ]; > > and then ran > > sievec spamassassin.sieve && chmod 444 spamassassin.svbin > > To tell the LDA where to find the spamc filter, I added (to > 90-sieve.conf): > > sieve_filter_bin_dir = /etc/dovecot/sieve-filter > > and symlinked spamc there > > ln -s /usr/bin/spamc /etc/dovecot/sieve-filter/spamc Btw, this won't work reliably. The reason is that vnd.dovecot.filter currently requires the filter executable to soak up all of the input before it even bothers reading its output. Under certain conditions, however ? for instance when the input is larger than the SpamAssassin max_size setting, spamc just pipes input to output, without buffering. This would yield a deadlock because vnd.dovecot.filter would not be reading output yet but still be writing input, whereas spamc would no longer be willing to handle input while its output was not being read. Stephan Bosch has indicated a solution to this problem (asynchronous IO), but until that's in place, I simply put the following shell script in place: -----8<----8<----8<----- #!/bin/sh set -eu TMPFILE=$(tempfile -p spamc) cleanup() { rm -f $TMPFILE; trap - EXIT; } trap cleanup EXIT cat > $TMPFILE spamc -x < $TMPFILE cleanup -----8<----8<----8<----- This is ugly because Dovecot itself may already have spooled the mail message to disk (if it was too large for in-memory buffering), and now we're spooling it a second time. Asynchronous IO will alleviate this need for the second roundtrip via the filesystem. Hope this helps, -- .''`. martin f. krafft Related projects: : :' : proud Debian developer http://debiansystem.info `. `'` http://people.debian.org/~madduck http://vcs-pkg.org `- Debian - when you have better things to do than fixing systems -------------- next part -------------- A non-text attachment was scrubbed... Name: digital_signature_gpg.asc Type: application/pgp-signature Size: 1124 bytes Desc: Digital signature (see http://martin-krafft.net/gpg/sig-policy/999bbcc4/current) URL: From daniel.parthey at informatik.tu-chemnitz.de Mon Aug 13 02:13:07 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Mon, 13 Aug 2012 01:13:07 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344779083953-37043.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> Message-ID: <20120812231307.GA11093@daniel.localdomain> bmalik wrote: > I wrote a loginscript in bash. it works well. I can restrict a user by IP. > how can i restrict a particular email address by tcp port ? > I want a particular mail address to be forced to use pop3s/imaps. What's your doveconf -n output, please? Are you using SQL or LDAP for user lookup? You probably should do the filtering already in your userdb/authdb lookup queries, since Variable %a or %{lport} which contains the local port is only available in Dovecot-Auth according to http://wiki2.dovecot.org/Variables Regards Daniel -- https://plus.google.com/103021802792276734820 From ibrahim.harrani at gmail.com Mon Aug 13 11:24:57 2012 From: ibrahim.harrani at gmail.com (Ibrahim Harrani) Date: Mon, 13 Aug 2012 11:24:57 +0300 Subject: [Dovecot] master user auth problem Message-ID: Hi, I tried to setup a master auth authentication. I also use auth_pop3wrapper to authenticate from qmail-ldap. But I could not login with master user. Here is the config. auth_master_user_separator = * passdb { driver = passwd-file args = /usr/local/etc/dovecot/passwd.masterusers master = yes pass = yes } passdb { # Path for checkpassword binary driver = checkpassword args = /var/qmail/bin/auth_popwrapper } userdb { driver = prefetch } cat /opt/surmail/etc/dovecot/passwd.masterusers user:{SHA}W6ph5Mm5Pz8GgiULbPgzG37mj9g= The log: #telnet localhost 143 Trying 0.0.0.0... Connected to 0. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] SurGATE Messaging Suite POP3/IMAP ready. o login user at domain.com*user password o NO [AUTHORIZATIONFAILED] Authorization failed Aug 09 16:17:44 auth: Debug: auth(user,127.0.0.1,master,): Master user lookup for login: user at domain.com Aug 09 16:17:44 auth: Debug: passwd-file(user,127.0.0.1,master,): lookup: user=user file= /usr/local/etc/dovecot/passwd.masterusers Aug 09 16:17:44 auth: Info: passdb(user,127.0.0.1,master,): Master user logging in as user at domain.com Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): execute: /var/qmail/bin/auth_popwrapper /usr/local/dovecot/libexec/dovecot/checkpassword-reply Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): Received input: Aug 09 16:17:44 auth: Debug: checkpassword(user at domain.com,127.0.0.1,): exit_status=3 Aug 09 16:17:44 auth: Info: checkpassword(user at domain.com,127.0.0.1,): Login failed (status=3) Aug 09 16:17:46 auth: Debug: client out: FAIL 1 user=user at domain.com authz Aug 09 16:18:08 auth: Debug: client in: AUTH 2 PLAIN service=imap secured session=KmGNDdXGrwB/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=48047 resp= From bmalik at ihlas.net.tr Mon Aug 13 12:54:43 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 02:54:43 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <1344851683428-37047.post@n4.nabble.com> hello how can i do a login script by tcp port ? I use cdb database my dovecot.conf -n; # doveconf -n # 2.1.8: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.2-RELEASE amd64 auth_mechanisms = plain login digest-md5 cram-md5 apop disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 login_greeting = Dovecot ready2. mail_gid = 89 mail_plugin_dir = /usr/lib/dovecot mail_uid = 89 namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = webmail=127.0.0.1 driver = vpopmail } protocols = imap pop3 service pop3-postlogin { executable = script-login /usr/local/bin/postlogin_pop3.sh user = root } service pop3 { executable = pop3 pop3-postlogin } ssl = no userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol imap { mail_max_userip_connections = 20 } protocol pop3 { mail_max_userip_connections = 20 } -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37047.html Sent from the Dovecot mailing list archive at Nabble.com. From CMarcus at Media-Brokers.com Mon Aug 13 13:27:25 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 13 Aug 2012 06:27:25 -0400 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <5028D68D.5090604@Media-Brokers.com> On 2012-08-12 7:13 PM, Daniel Parthey wrote: > bmalik wrote: >> I wrote a loginscript in bash. it works well. I can restrict a user by IP. >> how can i restrict a particular email address by tcp port ? >> I want a particular mail address to be forced to use pop3s/imaps. > What's your doveconf -n output, please? > Are you using SQL or LDAP for user lookup? > > You probably should do the filtering already in your > userdb/authdb lookup queries, since Variable %a or %{lport} > which contains the local port is only available in > Dovecot-Auth according to http://wiki2.dovecot.org/Variables Or you could use something like: http://wiki2.dovecot.org/Authentication/RestrictAccess -- Best regards, Charles From voytek at sbt.net.au Mon Aug 13 14:12:14 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Mon, 13 Aug 2012 21:12:14 +1000 Subject: [Dovecot] imap-login process_limit (100) reached, client connections are being dropped Message-ID: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> noticed this in the log today, after about 11 warning IMAP appears to have not worked, 'service dovecot reload' got it going again question: what to check/alter ? ---------------- # grep process_limit /var/log/maillog Aug 13 15:31:44 geko dovecot: master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped ''' Aug 13 20:45:35 geko dovecot: master: Warning: service(imap-login): process_limit (100) reached, client connections are being dropped # doveconf -n | grep limit # # dovecot --version 2.1.1 # ps ax | grep imap | wc 109 546 4693 # ps ax | grep imap-login | wc 57 286 2619 # doveadm who | wc 16 122 1531 centos 6, 20 virtual domains, 100 users -- Voytek Eymont From bmalik at ihlas.net.tr Mon Aug 13 14:34:44 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 04:34:44 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <5028D68D.5090604@Media-Brokers.com> References: <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> <5028D68D.5090604@Media-Brokers.com> Message-ID: <1344857684827-37050.post@n4.nabble.com> Ok where do i have to locate the passwd-file in dovecot2 i use vpopmail and dovecot2. -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37050.html Sent from the Dovecot mailing list archive at Nabble.com. From nmilas at noa.gr Mon Aug 13 15:08:14 2012 From: nmilas at noa.gr (Nikolaos Milas) Date: Mon, 13 Aug 2012 15:08:14 +0300 Subject: [Dovecot] HA Mailbox Design In-Reply-To: <50269252.8060508@hardwarefreak.com> References: <5023D002.6040101@noa.gr> <50246846.6020606@hardwarefreak.com> <502657EF.2090600@noa.gr> <50269252.8060508@hardwarefreak.com> Message-ID: <5028EE2E.9040305@noa.gr> On 11/8/2012 8:11 ??, Stan Hoeppner wrote: > Writing you a complete design document for doing this is beyond the > scope of a mailing list thread. There exists plenty of documentation on > the web. You will have to do your own research, but I've pointed you in > the right direction. Thank you Stan and everyone else who contributed on this subject. I'll research further. Your info has been very enlightening. Thanks again, Nick From tss at iki.fi Mon Aug 13 15:40:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 13 Aug 2012 15:40:58 +0300 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more Message-ID: <1344861658.13571.10.camel@hurina> v2.2 hg now has support for NOTIFY extension. The only thing missing is support for SubscriptionChange events. Now would be a good time for IMAP clients to start implementing and testing it. :) I remember K9 developers at least said they were just waiting for Dovecot to support it first. v2.2 implements some other extensions also: BINARY, CATENATE and MOVE. Stephan has also implemented URLAUTH pretty far. Hopefully it gets finished in time for v2.2.0. I'll also try to implement the rest of the LEMONADE extensions: CONVERT, CONTEXT=SORT and URLAUTH=BINARY. I'm also considering implementing an SMTP submission server, which works only as a proxy to the real SMTP server. The benefits of it would mainly be: * It could support BURL command and other extensions required by LEMONADE. The real SMTP server would see only regular DATA commands. * Would make SMTP AUTH easy to implement regardless of what the real SMTP server is. From tonio at starbridge.org Mon Aug 13 18:40:03 2012 From: tonio at starbridge.org (tonio at starbridge.org) Date: Mon, 13 Aug 2012 17:40:03 +0200 Subject: [Dovecot] pop3 proxying error In-Reply-To: References: <50210066.8040205@starbridge.org> <50210FED.5020508@starbridge.org> <4099152F-5AAB-4D45-9E69-3B220F47B222@iki.fi> <5021316A.4020105@starbridge.org> <50220A3E.407@starbridge.org> <8A788394-7439-42AB-800F-3F5748B31806@iki.fi> <50236380.1070703@starbridge.org> <3FD66FB3-39E1-44AC-8F87-5BDEDEDFEBC1@iki.fi> Message-ID: <50291FD3.30908@starbridge.org> Le 10/08/2012 01:34, Timo Sirainen a ?crit : > Actually it wasn't that obvious: > http://hg.dovecot.org/dovecot-2.1/rev/b082b8260782 plus > http://hg.dovecot.org/dovecot-2.1/rev/9d0873cefa08 Thanks Timo, it's working fine now Best regards Tonio Buonaguidi From p.pridt at chello.at Mon Aug 13 18:18:05 2012 From: p.pridt at chello.at (ppridt) Date: Mon, 13 Aug 2012 08:18:05 -0700 (PDT) Subject: [Dovecot] Permission denied on dovecot.lda-dupes Message-ID: <1344871085776-37053.post@n4.nabble.com> Hi, I have converted my Imap Server from Courier to Dovecot in order to use sieve support. Everything works fine with the exception that the sender always gets the vacation msg since there is a permission error on writing of dovecot.lda-dupes. I've tried several version of permissions including 777 to both home and maildir - always the same result. I also googled for hours .. Any help will be appreciated. Paul This is the debug log: ----------------------------------------------------------------------------------------------------- Aug 13 14:51:26 Srv dovecot: deliver(pp): Loading modules from directory: /usr/lib/dovecot/modules/lda Aug 13 14:51:26 Srv dovecot: deliver(pp): Module loaded: /usr/lib/dovecot/modules/lda/lib90_sieve_plugin.so Aug 13 14:51:26 Srv dovecot: deliver(pp): Home dir not found: Aug 13 14:51:26 Srv dovecot: deliver(pp): maildir: data=/Daten/Vmail/pp/Maildir Aug 13 14:51:26 Srv dovecot: deliver(pp): maildir++: root=/Daten/Vmail/pp/Maildir, index=, control=, inbox=/Daten/Vmail/pp/Maildir Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: using sieve path for user's script: /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: opening script /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): sieve: executing compiled script /Daten/Vmail/pp/.dovecot.sieve Aug 13 14:51:26 Srv dovecot: deliver(pp): Namespace : Using permissions from /Daten/Vmail/pp/Maildir: mode=0700 gid=-1 Aug 13 14:51:26 Srv dovecot: deliver(pp): file_dotlock_create(/.dovecot.lda-dupes) failed: Permission denied ----------------------------------------------------------------------------------------------------- This ist my dovecot.conf: ----------------------------------------------------------------------------------------------------- protocols = imap imaps managesieve mail_debug = yes log_path = info_log_path = disable_plaintext_auth = no # Authentication configuration: mail_location = maildir:/Daten/Vmail/%u/Maildir auth_verbose = yes mail_nfs_storage = no mail_nfs_index = no nfs_check = no lock_method = dotlock mail_uid = vmail mail_gid = vmail auth default { mechanisms = plain login passdb pam { } userdb passwd { args = uid=vmail gid=vmail home=/home/%u mail=maildir:/Daten/Vmail/%u/Maildir } socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 user = vmail } } } protocol lda { postmaster_address = admin at ppridt.dnsalias.org mail_plugins = sieve auth_socket_path = /var/run/dovecot/auth-master } protocol managesieve { login_executable = /usr/lib/dovecot/managesieve-login mail_executable = /usr/lib/dovecot/managesieve managesieve_implementation_string = Cyrus timsieved v2.2.13 } plugin { sieve=/Daten/Vmail/%u/.dovecot.sieve sieve_dir=/Daten/Vmail/%u/.sieve } ----------------------------------------------------------------------------------------------------- This is the exim delivery transport: ----------------------------------------------------------------------------------------------------- dovecot_lda: driver = pipe command = /usr/lib/dovecot/deliver message_prefix = message_suffix = log_output delivery_date_add envelope_to_add return_path_add user = vmail group = vmail temp_errors = 64 : 69 : 70: 71 : 72 : 73 : 74 : 75 : 78 ----------------------------------------------------------------------------------------------------- -- View this message in context: http://dovecot.2317879.n4.nabble.com/Permission-denied-on-dovecot-lda-dupes-tp37053.html Sent from the Dovecot mailing list archive at Nabble.com. From c at roessner-network-solutions.com Mon Aug 13 21:15:45 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Mon, 13 Aug 2012 20:15:45 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Message-ID: Hi, >>>> doveadm import mdbox:~/mdbox-backup all-mails all >>> >>> problem >>> >>> I tried so, but this does not work here: >> >> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >> >> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >> > done > > And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? > I tested today with Dovecot 2.1.9. Still not getting mails imported :-( How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? Many thanks in advance -Christian R??ner --- R??ner-Network-Solutions Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 7882340-0 F: +49 6631 7882340-9 M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From p at state-of-mind.de Mon Aug 13 21:27:37 2012 From: p at state-of-mind.de (Patrick Ben Koetter) Date: Mon, 13 Aug 2012 20:27:37 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <1344861658.13571.10.camel@hurina> References: <1344861658.13571.10.camel@hurina> Message-ID: <20120813182736.GB11223@state-of-mind.de> * Timo Sirainen : > I'm also considering implementing an SMTP submission server, which works > only as a proxy to the real SMTP server. The benefits of it would mainly > be: > > * It could support BURL command and other extensions required by > LEMONADE. The real SMTP server would see only regular DATA commands. > * Would make SMTP AUTH easy to implement regardless of what the real > SMTP server is. Nice move! Especially since I recall Wietse being not very inclined to implement anything alike. p at rick -- state of mind () http://www.state-of-mind.de Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Amtsgericht M?nchen Partnerschaftsregister PR 563 From CMarcus at Media-Brokers.com Mon Aug 13 21:52:11 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 13 Aug 2012 14:52:11 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <20120813182736.GB11223@state-of-mind.de> References: <1344861658.13571.10.camel@hurina> <20120813182736.GB11223@state-of-mind.de> Message-ID: <50294CDB.2010800@Media-Brokers.com> On 2012-08-13 2:27 PM, Patrick Ben Koetter

wrote: > * Timo Sirainen: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: >> >> * It could support BURL command and other extensions required by >> LEMONADE. The real SMTP server would see only regular DATA commands. >> * Would make SMTP AUTH easy to implement regardless of what the real >> SMTP server is. > > Nice move! Especially since I recall Wietse being not very inclined to > implement anything alike. Amen to that! This is a feature request I made a long time ago (I called it the dovecot LSA for Local Submission Agent), and I'm *very* glad that soon I'll be able to tell all my clients they can uncheck the 'Save copy of Sent messages' option for good... :) Thanks Timo!! -- Best regards, Charles From ncjeffgus at zimage.com Mon Aug 13 22:17:47 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Mon, 13 Aug 2012 12:17:47 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <20120811135012.GA18601@daniel.localdomain> References: <1344635642.23239.8.camel@maclinux> <20120810225621.GA12297@daniel.localdomain> <1344649816.23239.13.camel@maclinux> <20120811135012.GA18601@daniel.localdomain> Message-ID: <1344885467.19606.3.camel@maclinux> On Sat, 2012-08-11 at 15:50 +0200, Daniel Parthey wrote: > Maybe you have run into the epoll kernel bug under RHEL/CentOS: > :) Yeah... been there, done that. We found that bug within *minutes* of ksplice updating the kernel. I don't think this is an epoll thing because, if it was, customers wouldn't be able to connect to our services. I think there is something else going on. I think it is a bug, but I suppose it could be a setting somewhere. Something is timing out or getting stuck. ...Jeff From chris at arachsys.com Mon Aug 13 19:12:51 2012 From: chris at arachsys.com (Chris Webb) Date: Mon, 13 Aug 2012 17:12:51 +0100 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting Message-ID: <20120813161251.GB14149@arachsys.com> Sharing an installed copy of dovecot between several users each running a daemon within their own account (or using the same binaries for a system daemon and a user daemon) is difficult because the compile-time directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the location of things like the ssl-parameters.dat file and the replicator database. Replace all these uses of PKG_STATEDIR with a state_dir setting which defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the same way base_dir can be used to override PKG_RUNDIR. Signed-off-by: --- src/config/Makefile.am | 1 - src/doveadm/doveadm-instance.c | 10 ++++------ src/doveadm/doveadm-mount.c | 3 +-- src/doveadm/doveadm-settings.c | 2 -- src/doveadm/doveadm-settings.h | 1 - src/lib-master/master-instance.h | 2 ++ src/lib-master/master-service-settings.c | 2 -- src/lib-master/master-service-settings.h | 1 - src/lib-master/master-service.c | 6 ++---- src/login-common/ssl-proxy-openssl.c | 3 ++- src/master/main.c | 11 ++++------- src/master/master-settings.c | 6 ++---- src/master/master-settings.h | 1 - src/replication/replicator/replicator-settings.c | 2 -- src/replication/replicator/replicator-settings.h | 1 - src/replication/replicator/replicator.c | 16 +++++----------- src/ssl-params/main.c | 5 ++--- src/ssl-params/ssl-params-settings.c | 2 -- src/ssl-params/ssl-params-settings.h | 1 - 19 files changed, 24 insertions(+), 52 deletions(-) diff --git a/src/config/Makefile.am b/src/config/Makefile.am --- a/src/config/Makefile.am +++ b/src/config/Makefile.am @@ -9,6 +9,7 @@ -I$(top_srcdir)/src/lib-settings \ -I$(top_srcdir)/src/lib-master \ -DPKG_RUNDIR=\""$(rundir)"\" \ + -DPKG_STATEDIR=\""$(statedir)"\" \ -DPKG_LIBEXECDIR=\""$(pkglibexecdir)"\" \ -DEXAMPLE_CONFIG_DIR=\""$(exampledir)"\" \ -DMODULEDIR=\""$(moduledir)"\" \ diff --git a/src/doveadm/doveadm-instance.c b/src/doveadm/doveadm-instance.c --- a/src/doveadm/doveadm-instance.c +++ b/src/doveadm/doveadm-instance.c @@ -48,7 +48,7 @@ struct master_instance_list *list; struct master_instance_list_iter *iter; const struct master_instance *inst; - const char *pidfile_path; + const char *instance_path, *pidfile_path; bool show_config = FALSE; int c; @@ -71,7 +71,8 @@ doveadm_print_header_simple("running"); } - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(doveadm_settings->state_dir, "/instances", NULL); + list = master_instance_list_init(instance_path); iter = master_instance_list_iterate_init(list); while ((inst = master_instance_iterate_list_next(iter)) != NULL) { if (argv[0] != NULL && strcmp(argv[0], inst->name) != 0) @@ -99,13 +100,14 @@ { struct master_instance_list *list; const struct master_instance *inst; - const char *base_dir; + const char *base_dir, *instance_path; int ret; if (argc != 2) instance_cmd_help(cmd_instance_remove); - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(doveadm_settings->state_dir, "/instances", NULL); + list = master_instance_list_init(instance_path); inst = master_instance_list_find_by_name(list, argv[1]); base_dir = inst != NULL ? inst->base_dir : argv[1]; if ((ret = master_instance_list_remove(list, base_dir)) < 0) { diff --git a/src/doveadm/doveadm-mount.c b/src/doveadm/doveadm-mount.c --- a/src/doveadm/doveadm-mount.c +++ b/src/doveadm/doveadm-mount.c @@ -13,7 +13,8 @@ { const char *perm_path, *state_path; - perm_path = t_strconcat(PKG_STATEDIR"/"MOUNTPOINT_LIST_FNAME, NULL); + perm_path = t_strconcat(doveadm_settings->state_dir, + "/"MOUNTPOINT_LIST_FNAME, NULL); state_path = t_strconcat(doveadm_settings->base_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); return mountpoint_list_init(perm_path, state_path); diff --git a/src/doveadm/doveadm-settings.c b/src/doveadm/doveadm-settings.c --- a/src/doveadm/doveadm-settings.c +++ b/src/doveadm/doveadm-settings.c @@ -53,6 +53,7 @@ static const struct setting_define doveadm_setting_defines[] = { DEF(SET_STR, base_dir), + DEF(SET_STR, state_dir), DEF(SET_STR, mail_plugins), DEF(SET_STR, mail_plugin_dir), DEF(SET_STR, doveadm_socket_path), @@ -70,6 +71,7 @@ const struct doveadm_settings doveadm_default_settings = { .base_dir = PKG_RUNDIR, + .state_dir = PKG_STATEDIR, .mail_plugins = "", .mail_plugin_dir = MODULEDIR, .doveadm_socket_path = "doveadm-server", diff --git a/src/doveadm/doveadm-settings.h b/src/doveadm/doveadm-settings.h --- a/src/doveadm/doveadm-settings.h +++ b/src/doveadm/doveadm-settings.h @@ -3,6 +3,7 @@ struct doveadm_settings { const char *base_dir; + const char *state_dir; const char *mail_plugins; const char *mail_plugin_dir; const char *doveadm_socket_path; diff --git a/src/lib-master/master-instance.h b/src/lib-master/master-instance.h --- a/src/lib-master/master-instance.h +++ b/src/lib-master/master-instance.h @@ -1,8 +1,6 @@ #ifndef MASTER_INSTANCE_H #define MASTER_INSTANCE_H -#define MASTER_INSTANCE_PATH PKG_STATEDIR"/instances" - struct master_instance_list; struct master_instance { diff --git a/src/lib-master/master-service-settings.c b/src/lib-master/master-service-settings.c --- a/src/lib-master/master-service-settings.c +++ b/src/lib-master/master-service-settings.c @@ -33,6 +33,7 @@ master_service_settings_check(void *_set, pool_t pool, const char **error_r); static const struct setting_define master_service_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_STR, log_path), DEF(SET_STR, info_log_path), DEF(SET_STR, debug_log_path), @@ -47,6 +48,7 @@ }; static const struct master_service_settings master_service_default_settings = { + .state_dir = PKG_STATEDIR, .log_path = "syslog", .info_log_path = "", .debug_log_path = "", diff --git a/src/lib-master/master-service-settings.h b/src/lib-master/master-service-settings.h --- a/src/lib-master/master-service-settings.h +++ b/src/lib-master/master-service-settings.h @@ -7,6 +7,7 @@ struct master_service; struct master_service_settings { + const char *state_dir; const char *log_path; const char *info_log_path; const char *debug_log_path; diff --git a/src/lib-master/master-service.c b/src/lib-master/master-service.c --- a/src/lib-master/master-service.c +++ b/src/lib-master/master-service.c @@ -332,9 +332,11 @@ { struct master_instance_list *list; const struct master_instance *inst; - const char *path; + const char *instance_path, *path; - list = master_instance_list_init(MASTER_INSTANCE_PATH); + instance_path = t_strconcat(master_service->set->state_dir, + "/instances", NULL); + list = master_instance_list_init(instance_path); inst = master_instance_list_find_by_name(list, name); if (inst != NULL) { path = t_strdup_printf("%s/dovecot.conf", inst->base_dir); diff --git a/src/login-common/ssl-proxy-openssl.c b/src/login-common/ssl-proxy-openssl.c --- a/src/login-common/ssl-proxy-openssl.c +++ b/src/login-common/ssl-proxy-openssl.c @@ -152,8 +152,7 @@ static void ssl_params_corrupted(void) { - i_fatal("Corrupted SSL parameters file: " - PKG_STATEDIR"/ssl-parameters.dat"); + i_fatal("Corrupted SSL parameters file: ssl-parameters.dat"); } static void read_next(struct ssl_parameters *params, void *data, size_t size) diff --git a/src/master/main.c b/src/master/main.c --- a/src/master/main.c +++ b/src/master/main.c @@ -311,7 +311,7 @@ struct mountpoint_list *mountpoints; const char *perm_path, *state_path; - perm_path = t_strconcat(PKG_STATEDIR"/"MOUNTPOINT_LIST_FNAME, NULL); + perm_path = t_strconcat(set->state_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); state_path = t_strconcat(set->base_dir, "/"MOUNTPOINT_LIST_FNAME, NULL); mountpoints = mountpoint_list_init(perm_path, state_path); @@ -340,9 +340,12 @@ instance_update_now, list); } -static void instance_update(void) +static void instance_update(const struct master_settings *set) { - instances = master_instance_list_init(MASTER_INSTANCE_PATH); + const char *path; + + path = t_strconcat(set->state_dir, "/instances", NULL); + instances = master_instance_list_init(path); instance_update_now(instances); } @@ -538,7 +541,7 @@ create_pid_file(pidfile_path); create_config_symlink(set); mountpoints_update(set); - instance_update(); + instance_update(set); services_monitor_start(services); } diff --git a/src/master/master-settings.c b/src/master/master-settings.c --- a/src/master/master-settings.c +++ b/src/master/master-settings.c @@ -171,6 +171,7 @@ static const struct setting_define master_setting_defines[] = { DEF(SET_STR, base_dir), + DEF(SET_STR, state_dir), DEF(SET_STR, libexec_dir), DEF(SET_STR, instance_name), DEF(SET_STR, import_environment), @@ -211,6 +212,7 @@ static const struct master_settings master_default_settings = { .base_dir = PKG_RUNDIR, + .state_dir = PKG_STATEDIR, .libexec_dir = PKG_LIBEXECDIR, .instance_name = PACKAGE, .import_environment = "TZ" ENV_SYSTEMD ENV_GDB, @@ -737,8 +739,8 @@ } /* Make sure our permanent state directory exists */ - if (mkdir_parents(PKG_STATEDIR, 0750) < 0 && errno != EEXIST) { - i_error("mkdir(%s) failed: %m", PKG_STATEDIR); + if (mkdir_parents(set->state_dir, 0750) < 0 && errno != EEXIST) { + i_error("mkdir(%s) failed: %m", set->state_dir); return FALSE; } diff --git a/src/master/master-settings.h b/src/master/master-settings.h --- a/src/master/master-settings.h +++ b/src/master/master-settings.h @@ -5,6 +5,7 @@ struct master_settings { const char *base_dir; + const char *state_dir; const char *libexec_dir; const char *instance_name; const char *import_environment; diff --git a/src/replication/replicator/replicator-settings.c b/src/replication/replicator/replicator-settings.c --- a/src/replication/replicator/replicator-settings.c +++ b/src/replication/replicator/replicator-settings.c @@ -49,6 +49,7 @@ { type, #name, offsetof(struct replicator_settings, name), NULL } static const struct setting_define replicator_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_STR, auth_socket_path), DEF(SET_STR, doveadm_socket_path), @@ -59,6 +60,7 @@ }; const struct replicator_settings replicator_default_settings = { + .state_dir = PKG_STATEDIR, .auth_socket_path = "auth-userdb", .doveadm_socket_path = "doveadm-server", diff --git a/src/replication/replicator/replicator-settings.h b/src/replication/replicator/replicator-settings.h --- a/src/replication/replicator/replicator-settings.h +++ b/src/replication/replicator/replicator-settings.h @@ -2,6 +2,7 @@ #define REPLICATOR_SETTINGS_H struct replicator_settings { + const char *state_dir; const char *auth_socket_path; const char *doveadm_socket_path; diff --git a/src/replication/replicator/replicator.c b/src/replication/replicator/replicator.c --- a/src/replication/replicator/replicator.c +++ b/src/replication/replicator/replicator.c @@ -13,7 +13,6 @@ #define REPLICATOR_AUTH_SERVICE_NAME "replicator" #define REPLICATOR_DB_DUMP_INTERVAL_MSECS (1000*60*15) -#define REPLICATOR_DB_PATH PKG_STATEDIR"/replicator.db" static struct replicator_queue *queue; static struct replicator_brain *brain; @@ -32,7 +31,7 @@ struct auth_master_user_list_ctx *ctx; struct auth_user_info user_info; struct replicator_user *user; - const char *username; + const char *db_path, *username; auth_conn = auth_master_init(set->auth_socket_path, AUTH_MASTER_FLAG_NO_IDLE_TIMEOUT); @@ -53,12 +52,16 @@ auth_master_deinit(&auth_conn); /* add updates from replicator db, if it exists */ - (void)replicator_queue_import(queue, REPLICATOR_DB_PATH); + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_import(queue, db_path); } static void replicator_dump_timeout(void *context ATTR_UNUSED) { - (void)replicator_queue_export(queue, REPLICATOR_DB_PATH); + const char *db_path; + + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_export(queue, db_path); } static void main_init(void) @@ -77,10 +80,13 @@ static void main_deinit(void) { + const char *db_path; + notify_connections_destroy_all(); replicator_brain_deinit(&brain); timeout_remove(&to_dump); - (void)replicator_queue_export(queue, REPLICATOR_DB_PATH); + db_path = t_strconcat(set->state_dir, "replicator.db", NULL); + (void)replicator_queue_export(queue, db_path); replicator_queue_deinit(&queue); } diff --git a/src/ssl-params/main.c b/src/ssl-params/main.c --- a/src/ssl-params/main.c +++ b/src/ssl-params/main.c @@ -112,11 +112,12 @@ static void main_init(const struct ssl_params_settings *set) { + const char *filename; lib_signals_set_handler(SIGCHLD, LIBSIG_FLAGS_SAFE, sig_chld, NULL); ssl_params = buffer_create_dynamic(default_pool, 1024); - param = ssl_params_init(PKG_STATEDIR"/"SSL_BUILD_PARAM_FNAME, - ssl_params_callback, set); + filename = t_strconcat(set->state_dir, "/"SSL_BUILD_PARAM_FNAME, NULL); + param = ssl_params_init(filename, ssl_params_callback, set); } static void main_deinit(void) diff --git a/src/ssl-params/ssl-params-settings.c b/src/ssl-params/ssl-params-settings.c --- a/src/ssl-params/ssl-params-settings.c +++ b/src/ssl-params/ssl-params-settings.c @@ -58,12 +58,14 @@ { type, #name, offsetof(struct ssl_params_settings, name), NULL } static const struct setting_define ssl_params_setting_defines[] = { + DEF(SET_STR, state_dir), DEF(SET_TIME, ssl_parameters_regenerate), SETTING_DEFINE_LIST_END }; static const struct ssl_params_settings ssl_params_default_settings = { + .state_dir = PKG_STATEDIR, .ssl_parameters_regenerate = 3600*24*7 }; diff --git a/src/ssl-params/ssl-params-settings.h b/src/ssl-params/ssl-params-settings.h --- a/src/ssl-params/ssl-params-settings.h +++ b/src/ssl-params/ssl-params-settings.h @@ -4,6 +4,7 @@ struct master_service; struct ssl_params_settings { + const char *state_dir; unsigned int ssl_parameters_regenerate; }; From chris at arachsys.com Mon Aug 13 19:14:25 2012 From: chris at arachsys.com (Chris Webb) Date: Mon, 13 Aug 2012 17:14:25 +0100 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting In-Reply-To: <20120813161251.GB14149@arachsys.com> References: <20120813161251.GB14149@arachsys.com> Message-ID: <20120813161425.GC14149@arachsys.com> Chris Webb writes: > Sharing an installed copy of dovecot between several users each running > a daemon within their own account (or using the same binaries for a > system daemon and a user daemon) is difficult because the compile-time > directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the > location of things like the ssl-parameters.dat file and the replicator > database. > > Replace all these uses of PKG_STATEDIR with a state_dir setting which > defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the > same way base_dir can be used to override PKG_RUNDIR. A little background to this patch: I run a shell account box on which a number of users want to do customized things with their own IMAP servers, and they previously ran their own copy of Dovecot 1.0, using the system installed copy of dovecot but with their own dovecot.conf overrode base_dir, used passwd-file, etc. I've been looking at upgrading this machine, and encouraging SSL imap at the same point, but replicating these users' setups with Dovecot 2.1.9 was harder than I expected because of hard-coded references to /var/lib/dovecot that their config files couldn't override. This patch fixes that problem: they just create a ~/dovecot/dovecot.conf with something like base_dir = /home/foo/dovecot/run state_dir = /home/foo/dovecot/state [...] run dovecot -c ~/dovecot/dovecot.conf as they did before, and they're away with a completely self-contained IMAP server without having to compile a complete separate copy of Dovecot each. Best wishes, Chris. From jtam.home at gmail.com Tue Aug 14 01:39:06 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 13 Aug 2012 15:39:06 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: References: Message-ID: writes: > where do i have to locate the passwd-file in dovecot2 For what purpose? Master user? Password/user lookup? passdb { driver = passwd-file master = yes args = /anywhere/you/want/master-users pass = yes } passdb { driver = passwd-file args = /anywhere/you/want/passwd } userdb { driver = passwd-file args = /anywhere/you/want/passwd } Joseph Tam From bmalik at ihlas.net.tr Tue Aug 14 09:11:00 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 23:11:00 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: References: <1344636852567-5993.post@n4.nabble.com> Message-ID: <1344924660889-37062.post@n4.nabble.com> My purpose is to restrict a particular email address 's reach for dovecot services such as pop3/imap. how can i restrict a particular email address by tcp port ? I want a particular mail address to be forced to use pop3s/imaps. I use vpopmail / dovecot2. How can i do a script for that ? cat auth-vpopmail.conf.ext passdb { driver = vpopmail args = webmail=127.0.0.1 } userdb { driver = vpopmail args = quota_template=quota_rule=*:backend=%q } -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37062.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Tue Aug 14 09:15:19 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 09:15:19 +0300 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344924660889-37062.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> Message-ID: <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> On 14.8.2012, at 9.11, bmalik wrote: > how can i restrict a particular email address by tcp port ? > I want a particular mail address to be forced to use pop3s/imaps. > I use vpopmail / dovecot2. > How can i do a script for that ? > > userdb { > driver = vpopmail > args = quota_template=quota_rule=*:backend=%q args = secured=%c quota... In post-login script see if $SECURED = secured. From bmalik at ihlas.net.tr Tue Aug 14 09:26:04 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Mon, 13 Aug 2012 23:26:04 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> Message-ID: <1344925564701-37064.post@n4.nabble.com> But I 'll do that for only some email addresses. How can i do that ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37064.html Sent from the Dovecot mailing list archive at Nabble.com. From koshikov at gmail.com Tue Aug 14 09:49:38 2012 From: koshikov at gmail.com (Nikita Koshikov) Date: Tue, 14 Aug 2012 09:49:38 +0300 Subject: [Dovecot] Libdovecot-sieve segfaults Message-ID: <20120814094938.6977cc9d@jimbo> Hello Stephan, Preface - one of my users went to vacation and changed his sieve script to run autoreply vacation message, after that - I have noticed some annoying errors in system log, like: dovecot-lda[2400]: segfault at 3eb3333f ip b7446c7a sp bfaab050 error 4 in libdovecot-sieve.so.0.0.0[b7429000+5b000] Dovecot-error log is empty, but in exim log(exim runs dovecot-lda) I got: 2012-08-13 09:35:27 1T0oFK-0000aW-6j ** sr at domain.com (sr at domain.com, root at domain.com) F=<59942270813 at mymail.in.ua> R=ldap_accept T=local_delivery: Child process of local_delivery transport (running command "/usr/libexec/dovecot/dovecot-lda -e -d $local_part@$domain") was terminated by signal 11 (Segmentation fault) sr at domain.com - is the user, who created such sieve-script, which cause segfaults. I have tried run the same message over this script from sieve-test utility - but result is success. Can you please, take a look to this sieve script and check is it ok, I'll send it to you privately since it contains user's data. Also I'll attach message.eml which triggers segfault. Dovecot version - 2.0.21, Sieve version - 0.2.6. Relevant to sieve dovecot config section: plugin { sieve = ~/.dovecot.sieve sieve_after = /etc/dovecot/sieve/default-after.sieve sieve_dir = ~/sieve sieve_extensions = +notify +spamtest sieve_spamtest_max_value = 10 sieve_spamtest_status_header = X-Spam-Scan-Score sieve_spamtest_status_type = score } Hope you'll help. From lists at wildgooses.com Tue Aug 14 10:47:42 2012 From: lists at wildgooses.com (Ed W) Date: Tue, 14 Aug 2012 08:47:42 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <20120813182736.GB11223@state-of-mind.de> References: <1344861658.13571.10.camel@hurina> <20120813182736.GB11223@state-of-mind.de> Message-ID: <502A029E.9000309@wildgooses.com> On 13/08/2012 19:27, Patrick Ben Koetter wrote: > * Timo Sirainen : >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: >> >> * It could support BURL command and other extensions required by >> LEMONADE. The real SMTP server would see only regular DATA commands. >> * Would make SMTP AUTH easy to implement regardless of what the real >> SMTP server is. > Nice move! Especially since I recall Wietse being not very inclined to > implement anything alike. > Annoyingly Apple implemented burl for postfix, submitted the patch, but Wietse declined it (for reasons I would need to remind myself of - I think some implementation concerns, but mainly "who is using it, lets see the clients first") I would also be very interested to see BURL support appear. It appears to offer bandwidth reductions (my customers are all on slow dialup links), and at least some apple clients (IOS?) support it Cheers Ed W From lists at wildgooses.com Tue Aug 14 11:04:22 2012 From: lists at wildgooses.com (Ed W) Date: Tue, 14 Aug 2012 09:04:22 +0100 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> Message-ID: <502A0686.30309@wildgooses.com> On 10/08/2012 10:25, Timo Sirainen wrote: >>> how does help me "save battery" if i have a folder-structure >>> maintained by sieve if i do not get my new mails? >> If you open 10 connections to IMAP server and will IDLE on them - your phone will wake up to reply for ping in every of that 10 connections. >> Imagine if there will 100 folders? > Like mentioned previously in this thread, you can disable the "ping"s in Dovecot. And even when they happen Dovecot makes them happen at the same time. So I think the power usage difference between 1 connection and 100 connections isn't much. The battery consumption problem seems common, but understanding of it is poor... The situation is simply: - Waking up a 3G radio is expensive on power - So prefer to do it less frequently and do a chunk of stuff, rather than doing a small amount of data quite frequently - Every 30 mins is only 48 times a day. Every 15 seconds is massively more - Different 3G networks have different parameters set which will dramatically affect battery life. ie they wait longer/shorter before allowing the radio to go idle once woken up. I don't know a good online resource to see these settings, my old Nokia had a utility to investigate things... - Firewalls impose challenges on being silent for 30 mins at a time and may drop any NAT mappings - The 3G network will almost certainly have a NAT in the way which guarantees you have a (probably very short) NAT timeout (perhaps 10 mins or perhaps less) - Then there is tcp keepalive. Does Dovecot enable these? (Sorry, I should look in the code...). However, applications which enable it (eg optional in SSH) will trigger a default (I think) 75 second network packet As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? But of course if your emails turn up every few seconds, then you will be triggering wakeups every few seconds also. I think if you tune things with that in mind, it's very possible to get very low battery usage. Using tcpdump on your mobile client to help tune things is a great help. Basically every stray packet is a killer for battery, hunt them down. Cheers Ed W From tss at iki.fi Tue Aug 14 11:18:18 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 11:18:18 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <502A0686.30309@wildgooses.com> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: On 14.8.2012, at 11.04, Ed W wrote: > - Then there is tcp keepalive. Does Dovecot enable these? (Sorry, I should look in the code...). Yes. > However, applications which enable it (eg optional in SSH) will trigger a default (I think) 75 second network packet It's something like 2 hours by default in Linux. > As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) > But of course if your emails turn up every few seconds, then you will be triggering wakeups every few seconds also. Maybe Dovecot could make this somehow smarter some day.. Or create a plugin that allows that. From ngoonee.talk at gmail.com Tue Aug 14 11:41:15 2012 From: ngoonee.talk at gmail.com (Oon-Ee Ng) Date: Tue, 14 Aug 2012 16:41:15 +0800 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: On Tue, Aug 14, 2012 at 4:18 PM, Timo Sirainen wrote: > Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) I for one welcome our new Dovecot overlords Sorry for the noise. From andre.groebe at fun.de Tue Aug 14 13:07:59 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 14 Aug 2012 12:07:59 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225C7F.2070300@fun.de> References: <50225A24.4010109@fun.de> <50225C7F.2070300@fun.de> Message-ID: <502A237F.4060308@fun.de> On reading 'big' metadata entries i got a similiar behaviour (metadata_maxsize = 10240). The command getmetadata returns no data. I have created a dovecot.dict with a single entry (key=priv/mailbox/fba9aa2cf41721501f340000d6254462/private/vendor/test/10458d10cf1f2a5023750000d6254462/2) to reproduce that. I expected to get the value with command: . getmetadata inbox /private/vendor/test/10458d10cf1f2a5023750000d6254462/2 . OK Completed. It seems to me that there is a bug in metadata plugin. Anyone any ideas? TIA Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: dovecot.dict.bz2 Type: application/x-bzip Size: 7405 bytes Desc: not available URL: From klimenko.n at theitidea.ru Tue Aug 14 15:23:55 2012 From: klimenko.n at theitidea.ru (=?UTF-8?B?0J3QuNC60L7Qu9Cw0Lkg0JrQu9C40LzQtdC90LrQvg==?=) Date: Tue, 14 Aug 2012 16:23:55 +0400 Subject: [Dovecot] vacation and field FROM Message-ID: <502A435B.7090909@theitidea.ru> Hi to all Here is the following scheme: Dovecot in a link with AD. For LDA and IMAP different views are used in a base. For example there is a user with such e-mail type - 1.name at domain.ltd with the name of authorization auth_1.name. Incoming male folds up in /var/mail/domain/auth_1.name When vacation is on, the letters from 1.name at domain.ltd are sent in a following way auth_1.name at domain.ltd I guess the problem is in two different data-base queries. Could you please tell me how to solve this problem and to make the answer to be sent from the same adress it is comes to. part of dovecot.conf protocol lda { mail_plugins = sieve acl hostname = domain.ltd postmaster_address = auth_socket_path = /var/run/dovecot/auth-master_lda log_path = /var/log/dovecot-deliver.log } auth default { verbose = no debug = no debug_passwords = no mechanisms = plain user = dovecot passdb passwd-file { args = /etc/dovecot/passwd.masterusers master = yes } passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb static { args = uid=20000 gid=20000 home=/opt/mail/user_mailbox/%Lu allow_all_users=yes } socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = vmail } client { path = /var/spool/postfix/private/dovecot-auth mode = 0660 user = postfix group = postfix } } } auth auth_lda { verbose = no debug = no debug_passwords = no mechanisms = plain user = dovecot passdb ldap { args = /etc/dovecot/dovecot-ldap_lda.conf } userdb ldap { args = /etc/dovecot/dovecot-ldap_lda.conf } socket listen { master { path = /var/run/dovecot/auth-master_lda mode = 0660 user = vmail group = vmail } part of dovecot-ldap.conf (filter options) pass_attrs = sAMAccountName=user pass_filter = (&(sAMAccountName=%u)(objectClass=user)(!(userAccountControl:1.2.840.113556.1.4.803:=2))) part of dovecot-ldap_lda.conf user_attrs = sAMAccountName=user user_filter = (mail=%u) pass_attrs = sAMAccountName=user pass_filter = (mail=%u) -- From ncjeffgus at zimage.com Tue Aug 14 23:01:58 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 13:01:58 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <1344974518.25701.6.camel@maclinux> I ran a rsync on the mailboxes that I was having issues with. I re-ran rsync until I had a full sync with no further updates. Then I ran a dsync. dsync was able to run without issue. If I wipe out the target directory and re-run dsync, I'm back to dsync getting stuck. Running rsync on mdbox files is not optimal. What else can I do to track down the issue? I've contacted Timo's company about payed support so we can get a fix for this issue. I hope to hear from them soon. ...Jeff From tss at iki.fi Tue Aug 14 23:23:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 14 Aug 2012 23:23:39 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344635642.23239.8.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> Message-ID: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> On 11.8.2012, at 0.54, Jeff Gustafson wrote: > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > problem with both versions. > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > list of boxes every time we use 'dsync backup' to backup the server. > dsync seems to stop communicating to the backup box (over ssh). strace > just shows it sitting at a epoll_wait. So you can easily reproduce this by running dsync for a specific user? > Once the program quits (times > out?), a 'du' shows the destination is smaller (200kbyte in one case). As in, some of the mails didn't get synced? (doveadm fetch could be used to do a better comparison, file sizes don't necessarily mean anything.) > Has anyone else seen an exit code of 75? Nothing in the documentation > mentions what exit code 75 could mean. "temporary failure". > What can I do to help the developers locate the bug? Those hangs are a little bit annoying to debug, and the whole code has been rewritten for v2.2 already in a way that should make the hangs pretty much impossible. Annoyingly v2.2 isn't ready yet.. From bmalik at ihlas.net.tr Wed Aug 15 01:01:40 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Tue, 14 Aug 2012 15:01:40 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120812231307.GA11093@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <20120810023525.GA14423@daniel.localdomain> <34284058.post@talk.nabble.com> <20120810215802.GA11509@daniel.localdomain> <1344636852565-7786.post@n4.nabble.com> <20120810224638.GA11918@daniel.localdomain> <1344677781012-37034.post@n4.nabble.com> <20120811151920.GA19891@daniel.localdomain> <1344779083953-37043.post@n4.nabble.com> <20120812231307.GA11093@daniel.localdomain> Message-ID: <1344981700620-37074.post@n4.nabble.com> is there a solution ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37074.html Sent from the Dovecot mailing list archive at Nabble.com. From durket at highwire.stanford.edu Wed Aug 15 01:12:59 2012 From: durket at highwire.stanford.edu (Michael Durket) Date: Tue, 14 Aug 2012 15:12:59 -0700 Subject: [Dovecot] Listen on multiple ports possible using same protocol? Message-ID: Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: protocol imap { listen = *:143 listen = *:10143 ssl_listen = *:993 ssl_listen = *:10993 for example. Or is this more preferably done by pointing dovecot at different configuration files? From ncjeffgus at zimage.com Wed Aug 15 01:33:47 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 15:33:47 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> Message-ID: <1344983627.25701.10.camel@maclinux> On Tue, 2012-08-14 at 23:23 +0300, Timo Sirainen wrote: > On 11.8.2012, at 0.54, Jeff Gustafson wrote: > > > More dsync issues. We were running 2.1.7 and we updated to 2.1.9. Same > > problem with both versions. > > I'm getting an error 75 on about 40 boxes out of 1800. It is the same > > list of boxes every time we use 'dsync backup' to backup the server. > > dsync seems to stop communicating to the backup box (over ssh). strace > > just shows it sitting at a epoll_wait. > > So you can easily reproduce this by running dsync for a specific user? Yes. There is a subset of mailboxes that always time out. > > Once the program quits (times > > out?), a 'du' shows the destination is smaller (200kbyte in one case). > > As in, some of the mails didn't get synced? (doveadm fetch could be > used to do a better comparison, file sizes don't necessarily mean > anything.) True, I will dump out the mailboxes and see if it truly was incomplete. > Those hangs are a little bit annoying to debug, and the whole code has > been rewritten for v2.2 already in a way that should make the hangs > pretty much impossible. Annoyingly v2.2 isn't ready yet.. I have found a manual work around. I use rsync to get the files over to the backup machines, then I let the backup script keep things up to date. It is not the best way to go, but at least I have backups. I suppose I can check the log and continue to rsync things over until 2.2 comes out. ...Jeff From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 15 02:04:03 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 15 Aug 2012 01:04:03 +0200 Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <1344925564701-37064.post@n4.nabble.com> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> <1344925564701-37064.post@n4.nabble.com> Message-ID: <20120814230403.GA11246@daniel.localdomain> bmalik wrote: > But I 'll do that for only some email addresses. I assume that by "email addresses" you mean "user names". > How can i do that ? The $SECURED variable contains "secured" if a user tries to log in via SSL/TLS, so if an insecure connection is found, the script should check whether the user is in the list if users which are forced to use encryption: ############################################################################## if [ "$SECURED" == "secure" ] then :# handle secure connections here else :# handle insecure connections here if grep -q "$USER" in /etc/users-with-forced-encryption then printf "* NO [ALERT] You are not allowed to connect without encryption\r\n" exit 0 fi fi ############################################################################## Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Wed Aug 15 02:56:10 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Tue, 14 Aug 2012 18:56:10 -0500 Subject: [Dovecot] Listen on multiple ports possible using same protocol? In-Reply-To: References: Message-ID: <502AE59A.2040504@hardwarefreak.com> On 8/14/2012 5:12 PM, Michael Durket wrote: > Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: > > protocol imap { > listen = *:143 > listen = *:10143 > ssl_listen = *:993 > ssl_listen = *:10993 > > > for example. Or is this more preferably done by pointing dovecot at different configuration files? Did you test it? -- Stan From ncjeffgus at zimage.com Wed Aug 15 05:41:58 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Tue, 14 Aug 2012 19:41:58 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> Message-ID: <1344998518.25701.13.camel@maclinux> On Tue, 2012-08-14 at 23:23 +0300, Timo Sirainen wrote: > On 11.8.2012, at 0.54, Jeff Gustafson wrote: > > What can I do to help the developers locate the bug? > > Those hangs are a little bit annoying to debug, and the whole code has > been rewritten for v2.2 already in a way that should make the hangs > pretty much impossible. Annoyingly v2.2 isn't ready yet.. I have an issue related to this problem. dsync returns an error 75 when it detects the source mailbox is empty (client probably pop3'd all of their email). It also returns an error 75 when I get the timeout error. For not I am parsing the error to find out which is which and act accordingly. It would be much nicer if dsync returned a different error code for empty source mailboxes. ...Jeff From bmalik at ihlas.net.tr Wed Aug 15 09:24:59 2012 From: bmalik at ihlas.net.tr (bmalik) Date: Tue, 14 Aug 2012 23:24:59 -0700 (PDT) Subject: [Dovecot] about postlogin in dovecot2 In-Reply-To: <20120814230403.GA11246@daniel.localdomain> References: <1344636852567-5993.post@n4.nabble.com> <1344924660889-37062.post@n4.nabble.com> <06712416-A68F-4153-9F07-4412B43DA3E8@iki.fi> <1344925564701-37064.post@n4.nabble.com> <20120814230403.GA11246@daniel.localdomain> Message-ID: <1345011899792-37080.post@n4.nabble.com> Thanks a lot. the script you gave works . -- View this message in context: http://dovecot.2317879.n4.nabble.com/about-postlogin-in-dovecot2-tp5993p37080.html Sent from the Dovecot mailing list archive at Nabble.com. From cpservicespb at gmail.com Wed Aug 15 09:51:09 2012 From: cpservicespb at gmail.com (CpServiceSPb) Date: Wed, 15 Aug 2012 10:51:09 +0400 Subject: [Dovecot] Thread sorting problem Message-ID: Hi. How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later cost ? Artyom. From tss at iki.fi Wed Aug 15 12:27:27 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:27:27 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1344998518.25701.13.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> Message-ID: <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> On 15.8.2012, at 5.41, Jeff Gustafson wrote: > I have an issue related to this problem. dsync returns an error 75 when > it detects the source mailbox is empty (client probably pop3'd all of > their email). It also returns an error 75 when I get the timeout error. You mean this? dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run backup in wrong direction. Source is empty and destination is not. Maybe it needs a force setting, or change the detection somehow.. From tss at iki.fi Wed Aug 15 12:28:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:28:45 +0300 Subject: [Dovecot] Listen on multiple ports possible using same protocol? In-Reply-To: References: Message-ID: On 15.8.2012, at 1.12, Michael Durket wrote: > Is it possible to have multiple Listen directives in a dovecot configuration file for the same protocol? I am running dovecot-1.2.11 and I want to be able to use the "standard port" as well as a test port: > > protocol imap { > listen = *:143 > listen = *:10143 I think this works: listen = *:143, *:10143 I think dovecot-example.conf says something about it. From tss at iki.fi Wed Aug 15 12:30:33 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 12:30:33 +0300 Subject: [Dovecot] Thread sorting problem In-Reply-To: References: Message-ID: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> On 15.8.2012, at 9.51, CpServiceSPb wrote: > How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later > cost ? What do you need it for? There is THREAD=REFERENCES that is superior to it in most situations. From svoop at delirium.ch Wed Aug 15 13:14:39 2012 From: svoop at delirium.ch (Sven Schwyn) Date: Wed, 15 Aug 2012 12:14:39 +0200 Subject: [Dovecot] bcrypt again Message-ID: Hi I'd like Dovecot to consume a list of users exported from an external application which stores bcrypted passwords. This has been asked in the past, however, I'm not sure how to read the following reply: > If you are using Dovecot< 2.0 you can also use any of the algorithms > supported by your system's libc. But then you have to prefix the hashes > with {CRYPT} - not {{BLF,SHA256,SHA512}-CRYPT}. I'm on Dovecot 2.0.19. Does this mean that only the hashes listed with "doveadm pw -l" are supported and even if glibc can do bcrypt, the CRYPT scheme won't do the trick anymore? Thanks for your help! From tss at iki.fi Wed Aug 15 13:43:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 13:43:40 +0300 Subject: [Dovecot] Thread sorting problem In-Reply-To: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> References: <1E7A0D0D-5BCC-4679-9CFB-CD4A0ED82D63@iki.fi> Message-ID: <85B6A78B-DFB4-4775-A212-0530669DA84E@iki.fi> On 15.8.2012, at 12.30, Timo Sirainen wrote: > On 15.8.2012, at 9.51, CpServiceSPb wrote: > >> How much may implementing of THREAD=ORDEREDSUBJECT to Dovecot 2.1.x or later >> cost ? > > What do you need it for? There is THREAD=REFERENCES that is superior to it in most situations. Well, anyway, here you go: http://hg.dovecot.org/dovecot-2.1/rev/670f467ff5c5 From tss at iki.fi Wed Aug 15 13:54:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 15 Aug 2012 13:54:03 +0300 Subject: [Dovecot] bcrypt again In-Reply-To: References: Message-ID: <6750912E-4BBE-490E-9BAE-429468C20B7F@iki.fi> On 15.8.2012, at 13.14, Sven Schwyn wrote: > I'd like Dovecot to consume a list of users exported from an external application which stores bcrypted passwords. > > This has been asked in the past, however, I'm not sure how to read the following reply: > >> If you are using Dovecot< 2.0 you can also use any of the algorithms >> supported by your system's libc. But then you have to prefix the hashes >> with {CRYPT} - not {{BLF,SHA256,SHA512}-CRYPT}. > > I'm on Dovecot 2.0.19. Does this mean that only the hashes listed with "doveadm pw -l" are supported and even if glibc can do bcrypt, the CRYPT scheme won't do the trick anymore? {CRYPT} means that the password is put through libc's crypt() function. If your libc's crypt() supports bcrypt, then Dovecot supports bcrypt. I don't know why (whoever) said "<2.0". From ncjeffgus at zimage.com Wed Aug 15 22:23:34 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Wed, 15 Aug 2012 12:23:34 -0700 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> Message-ID: <1345058614.25701.20.camel@maclinux> On Wed, 2012-08-15 at 12:27 +0300, Timo Sirainen wrote: > On 15.8.2012, at 5.41, Jeff Gustafson wrote: > > > I have an issue related to this problem. dsync returns an error 75 when > > it detects the source mailbox is empty (client probably pop3'd all of > > their email). It also returns an error 75 when I get the timeout error. > > You mean this? > > dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run > backup in wrong direction. Source is empty and destination is not. That's the one! > Maybe it needs a force setting, or change the detection somehow.. That would be nice. A backup script is executing the command, so it should never do it in the wrong direction. A force setting might be the simplest way to go. ...Jeff From listas at adminlinux.com.br Wed Aug 15 23:01:16 2012 From: listas at adminlinux.com.br (3.listas@adminlinux.com.br) Date: Wed, 15 Aug 2012 17:01:16 -0300 Subject: [Dovecot] Mdbox corruption Message-ID: <502C000C.9060206@adminlinux.com.br> Hi, I have a "ubuntu10.04 + ext4-filesystem + dovecot-2.0.13 +mdbox" configuration in my server. It works fine with ~50k accounts. Recently happened a filesystem corruption in a device of StMailLocation and I fix with fsck.ext4. After this crash, one account began to show access timeout and errors like this on force-resync: # doveadm force-resync -u account INBOX doveadm(account): Warning: mdbox /path-to-mdbox/storage: rebuilding indexes doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) doveadm(account): Warning: dbox: Copy of the broken file saved to /path-to-mdbox/storage/m.83.broken doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) doveadm(account): Error: mdbox rebuild: Failed to fix file /path-to-mdbox/storage/m.83 doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.92 (around offset=7): Invalid dbox version ... Should I worry about the m.X.broken files ? How I fix these broken mdboxes ? Thanks. -- Thiago Henrique adminlinux.com.br From mailadmin at cubixys.com Thu Aug 16 03:52:40 2012 From: mailadmin at cubixys.com (Fasil) Date: Thu, 16 Aug 2012 03:52:40 +0300 Subject: [Dovecot] Dovecot: pipe() failed: Too many open files Message-ID: <502C4458.8090808@cubixys.com> Dear all, Thank you all for such a wonderful support. Hats off to all :) Few times I came across imap login issues where new users will not be allowed to login. /var/log/mail.err shows the error below Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 # ulimit -Hn 1024 # ulimit -Sn 1024 # cat /proc/sys/fs/file-max 1238548 # cat /proc/`pidof dovecot`/limits | grep 'Max open' Max open files 1024 1024 files Please advice how to get rid off this. Fasil. From manu at netbsd.org Thu Aug 16 04:07:20 2012 From: manu at netbsd.org (Emmanuel Dreyfus) Date: Thu, 16 Aug 2012 03:07:20 +0200 Subject: [Dovecot] Auth worker max line size In-Reply-To: <20090624144545.GF13977@NetBSD.org> Message-ID: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> Hi 38 month ago, I submitted a patch to increase AUTH_WORKER_MAX_LINE_LENGTH to use exotic authentication scheme (see message below). The patch was accepted, but now I upgrade to dovecot 2.1.7, I face the same problem with MASTER_AUTH_MAX_DATA_SIZE. I had to increase it from 1024 to 4096. Is it safe to do so? Would such a change be accepted upstream? The patch is below. (please Cc: me, I'm not subscribed ot the list) --- src/lib-master/master-auth.h.orig +++ src/lib-master/master-auth.h @@ -13,9 +13,9 @@ /* Authentication client process's cookie size */ #define MASTER_AUTH_COOKIE_SIZE (128/8) /* LOGIN_MAX_INBUF_SIZE should be based on this.*/ -#define MASTER_AUTH_MAX_DATA_SIZE 1024 +#define MASTER_AUTH_MAX_DATA_SIZE 4096 #define MASTER_AUTH_ERRMSG_INTERNAL_FAILURE \ "Internal error occurred. Refer to server log for more information." Emmanuel Dreyfus wrote: > Hello > > I have been playing with some exotic authentication scheme with Dovecot > and PAM. That involves sending really large base64 encoded data as > the IMAP password, and I have hit a line limit in Dovecot, with > AUTH_WORKER_MAX_LINE_LENGTH set to 1024. > > This limit is especially frustrating since other parts of the software > use much larger limits: > MAX_INBUF_SIZE 4096 > MAX_IMAP_LINE 8192 > AUTH_CLIENT_MAX_LINE_LENGTH 8192 > > I had to make the patch attached below to get my authentication working. > I can live with this local patch, but given the much more liberal limits > of MAX_INBUF_SIZE at 4096 makes we wonder if this 1024 limit on > AUTH_WORKER_MAX_LINE_LENGTH could not be a bug. Or is there a security > concern at using more than 1kB? > > Opinions? (please Cc: me, I'm not subscribed ot the list) > > --- src/auth/auth-worker-client.h.orig 2009-06-23 18:32:15.000000000 +0200 > +++ src/auth/auth-worker-client.h 2009-06-23 18:32:33.000000000 +0200 > @@ -1,8 +1,8 @@ > #ifndef AUTH_WORKER_CLIENT_H > #define AUTH_WORKER_CLIENT_H > > -#define AUTH_WORKER_MAX_LINE_LENGTH 1024 > +#define AUTH_WORKER_MAX_LINE_LENGTH 4096 > > struct auth_worker_client *auth_worker_client_create(struct auth *auth, int fd); > void auth_worker_client_destroy(struct auth_worker_client **client); > void auth_worker_client_unref(struct auth_worker_client **client); -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz manu at netbsd.org From f.bonnet at esiee.fr Thu Aug 16 09:17:14 2012 From: f.bonnet at esiee.fr (Frank Bonnet) Date: Thu, 16 Aug 2012 08:17:14 +0200 Subject: [Dovecot] Dovecot: pipe() failed: Too many open files In-Reply-To: <502C4458.8090808@cubixys.com> References: <502C4458.8090808@cubixys.com> Message-ID: <5B19308C-D60C-4CBD-9CD2-519C98DFCC5B@esiee.fr> hello here some useful informations http://posidev.com/blog/2009/06/04/set-ulimit-parameters-on-ubuntu/ Envoy? de mon iPhone. Le 16 ao?t 2012 ? 02:52, Fasil a ?crit : > Dear all, > > Thank you all for such a wonderful support. Hats off to all :) > > Few times I came across imap login issues where new users will not be allowed to login. > /var/log/mail.err shows the error below > Aug 12 07:57:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 07:57:46 mail dovecot: dovecot: Temporary failure in creating login processes, slowing down for now > Aug 12 07:58:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 07:59:46 mail dovecot: dovecot: pipe() failed: Too many open files > Aug 12 08:00:46 mail dovecot: dovecot: pipe() failed: Too many open files > > I have a dovecot (V 1.2.9) +postfix (V 2.7.0) setup on ubuntu 10.04 > > # ulimit -Hn > 1024 > > # ulimit -Sn > 1024 > > # cat /proc/sys/fs/file-max > 1238548 > > # cat /proc/`pidof dovecot`/limits | grep 'Max open' > Max open files 1024 1024 files > > Please advice how to get rid off this. > > Fasil. From cor at xs4all.nl Thu Aug 16 10:02:47 2012 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 16 Aug 2012 09:02:47 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <1344861658.13571.10.camel@hurina> References: <1344861658.13571.10.camel@hurina> Message-ID: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> > > I'm also considering implementing an SMTP submission server, which works > only as a proxy to the real SMTP server. The benefits of it would mainly > be: What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. Cor From lists at wildgooses.com Thu Aug 16 10:59:07 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 08:59:07 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> Message-ID: <502CA84B.6080500@wildgooses.com> On 16/08/2012 08:02, Cor Bosman wrote: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: > What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. > Postfix allows you to write policy agents very simply. I wrote a small perl utility which uses a database to count the number of emails a user has sent in the last 1 and 24 hours. Based on that we throttle users (I have some fudging for recipients per email also). If you like the idea then it's about 10 lines of perl (+ a decent chunk of boiler plate). Ed From tss at iki.fi Thu Aug 16 11:00:01 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:00:01 +0300 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> Message-ID: <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> On 16.8.2012, at 10.02, Cor Bosman wrote: >> I'm also considering implementing an SMTP submission server, which works >> only as a proxy to the real SMTP server. The benefits of it would mainly >> be: > > What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) From cor at xs4all.nl Thu Aug 16 11:11:31 2012 From: cor at xs4all.nl (Cor Bosman) Date: Thu, 16 Aug 2012 10:11:31 +0200 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> Message-ID: <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> >> What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. > > > The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) > > Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) They would indeed need to share the state, this is what the commercial system does (Cloudmark Gateway). The idea is to prevent senders to send email beyond certain limits that are configurable. Lets say, 200 emails in a minute, or 500 an hour, or whatever. Of course allowing for whitelists. With ever increasing speeds of residential connections (we have hundreds of fiber connections now, growing rapidly), these become very fast spam sources without something to keep them in check. It's easy on 1 server, not so easy if you have dozens of smtp servers. But yes, something for a distant future :) And CM has other features as well, so it may not be so easy to replace :) Cor From c at roessner-network-solutions.com Thu Aug 16 11:15:34 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 10:15:34 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> Message-ID: <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> Hi, >>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>> >>>> problem >>>> >>>> I tried so, but this does not work here: >>> >>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>> >>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>> >> done >> >> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >> > I tested today with Dovecot 2.1.9. Still not getting mails imported :-( > > How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? > > Many thanks in advance sorry for bumping, but I am stuck at the moment. -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From amateo at um.es Thu Aug 16 11:20:13 2012 From: amateo at um.es (Angel L. Mateo) Date: Thu, 16 Aug 2012 10:20:13 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <502CAD3D.90004@um.es> El 01/08/12 20:10, Timo Sirainen escribi?: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > >>> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >>> >>> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >>> >>> service ipc { >>> unix_listener ipc { >>> user = dovecot >>> } >>> } >> >> Thanks, Timo. >> >> Does this apply to the mailbox config or the director config? >> Which instance needs to access the ipc socket of which instance? > > director instance needs access to director instance. > Hello, Sorry for the delay, I've been on vacation these days. I'm going to try it. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From tss at iki.fi Thu Aug 16 11:20:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:20:23 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> Message-ID: <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> On 16.8.2012, at 11.15, Christian R??ner wrote: >>>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>>> >>>>> problem >>>>> >>>>> I tried so, but this does not work here: >>>> >>>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>>> >>>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>>> >>> done >>> >>> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >>> >> I tested today with Dovecot 2.1.9. Still not getting mails imported :-( >> >> How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? >> >> Many thanks in advance > > > sorry for bumping, but I am stuck at the moment. 1) Can you read mails from the resynced mdbox? For example: doveadm -o mail=mdbox:/anothermdbox fetch uid all 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? From jeremy.jarry at admin.gmessaging.net Thu Aug 16 11:41:36 2012 From: jeremy.jarry at admin.gmessaging.net (=?iso-8859-1?B?IkpBUlJZIErpculteSI=?=) Date: Thu, 16 Aug 2012 10:41:36 +0200 Subject: [Dovecot] Postfix & Dovecot: Client certificate authentication Message-ID: <5af13c674a81dc56.502cce60@admin.gmessaging.net> Hello, I would like to set up an authentication using certificate with Dovecot: A user sends mail to Postfix and Dovecot authentication is valid only if certificate is trusted. So, I enable the parameter auth_ssl_require_client_cert in dovecot configuration but it is not running. Here are the postfix logs: Aug 16 09:51:48 myserver dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 16 09:51:48 myserver dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 16 09:51:48 myserver dovecot: auth: Debug: auth client connected (pid=6922) Aug 16 09:51:51 myserver dovecot: auth: Debug: client in: AUTH?????? 1?????? PLAIN?? service=smtp??? nologin lip=127.0.0.1?? rip=127.0.0.1?????? secured resp=xxx Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL PLAIN authentication failed: Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: PLAIN(?,127.0.0.1): Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client out: FAIL????? 1?????? reason=Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client in: AUTH?????? 2?????? LOGIN?? service=smtp??? nologin lip=127.0.0.1?? rip=127.0.0.1?????? secured Aug 16 09:51:51 myserver dovecot: auth: LOGIN(?,127.0.0.1): Client didn't present valid SSL certificate Aug 16 09:51:51 myserver dovecot: auth: Debug: client out: FAIL????? 2?????? reason=Client didn't present valid SSL certificate Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL LOGIN authentication failed: Client didn't present valid SSL certificate It seems Postfix doesn't send the client certificat to Dovecot. What do you think ? What is wrong ? Below are some information about my configuration: OS: RHEL5 Postfix: 2.7.3 Dovecot: 2.0.14 Dovecot config: auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_ssl_require_client_cert = yes auth_ssl_username_from_cert = yes auth_verbose = yes mail_debug = yes passdb { ? args = /etc/dovecot/dovecot-ldap.conf ? driver = ldap } protocols = none service auth { ? unix_listener /data/postfix/private/auth { ??? group = postfix ??? mode = 0660 ??? user = postfix ? } ? user = root } ssl = required ssl_ca = URL: From tss at iki.fi Thu Aug 16 11:54:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 11:54:49 +0300 Subject: [Dovecot] Postfix & Dovecot: Client certificate authentication In-Reply-To: <5af13c674a81dc56.502cce60@admin.gmessaging.net> References: <5af13c674a81dc56.502cce60@admin.gmessaging.net> Message-ID: On 16.8.2012, at 11.41, JARRY J?r?my wrote: > I would like to set up an authentication using certificate with Dovecot: A user sends mail to Postfix and Dovecot authentication is valid only if certificate is trusted. > > So, I enable the parameter auth_ssl_require_client_cert in dovecot configuration but it is not running. Here are the postfix logs: .. > Aug 16 09:51:51 myserver postfix/smtpd[6922]: warning: localhost.localdomain[127.0.0.1]: SASL LOGIN authentication failed: Client didn't present valid SSL certificate > > It seems Postfix doesn't send the client certificat to Dovecot. What do you think ? What is wrong ? Correct. Postfix doesn't send it to Dovecot, so you can't do this currently. I'm not sure if this would require about 2 lines of code or hundreds to Postfix. From lists at wildgooses.com Thu Aug 16 14:12:31 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 12:12:31 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> Message-ID: <502CD59F.9030705@wildgooses.com> On 16/08/2012 09:11, Cor Bosman wrote: >>> What would be really cool is if you also kept statistics on certain metrics, like how many emails a specific sender has sent. If this is done right, it could become a centralised spam sender back-off system over multiple smtp servers. Maybe something for the future. We now pay $$$$ for a commercial system that implements this. >> >> The submission servers would need to share state with each others to make this reliable. Some nosql database would work for that I guess (memcached?) >> >> Can you describe more fully what you would want it to do and/or what the current system does? Probably not something I'll implement soon, but would be good to know for future :) > They would indeed need to share the state, this is what the commercial system does (Cloudmark Gateway). The idea is to prevent senders to send email beyond certain limits that are configurable. Lets say, 200 emails in a minute, or 500 an hour, or whatever. Of course allowing for whitelists. With ever increasing speeds of residential connections (we have hundreds of fiber connections now, growing rapidly), these become very fast spam sources without something to keep them in check. It's easy on 1 server, not so easy if you have dozens of smtp servers. > > But yes, something for a distant future :) And CM has other features as well, so it may not be so easy to replace :) > My opinion is that this is very easily to implement in at least Postfix and probably other servers, hence I would suggest this is a function for the MTA, not for the Dovecot relay? What MTA are you using? If Postfix then there are several off the shelf solutions which control sending rates. As I said in a previous email, I wanted the rate to be configurable per user, and so we store the rates in our user database. It's then fairly trivial to write a small "policy server" to enforce whatever policies you wish, eg as well as rate limiting we have some control over whether users can "forge" their FROM address, etc. This all gets implemented in a small Perl based policy server Effectively Postfix talks to a network socket for every email, passes a bunch of detail about the email and asks for a yes/no answer. Caveat the boiler plate to listen to a network socket the rest is just a couple of lines of code. Distributed, re-entrant, simple. Give it some consideration. I doubt the time to implement a complete prototype solution would be more than half a day for your IT guy and if that's attractive then perhaps you have grounds to look at replacing CM? Good luck Ed W From c at roessner-network-solutions.com Thu Aug 16 14:13:00 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 13:13:00 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> Message-ID: <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> Am 16.08.2012 um 10:20 schrieb Timo Sirainen: > On 16.8.2012, at 11.15, Christian R??ner wrote: > >>>>>>> doveadm import mdbox:~/mdbox-backup all-mails all >>>>>> >>>>>> problem >>>>>> >>>>>> I tried so, but this does not work here: >>>>> >>>>> I thought I'd make things easier by skipping the index rebuild, because I thought doveadm import does it automatically, but I guess it doesn't notice the problem: >>>>> >>>>> doveadm -o mail=mdbox:~/mdbox-backup force-resync INBOX >>>>> >>>> done >>>> >>>> And this created several folders under mailboxes again, but still the import command does not import anything. What am I missing here? >>>> >>> I tested today with Dovecot 2.1.9. Still not getting mails imported :-( >>> >>> How can I see, if the force-resync stuff was successful? Is there any doveadm dump -t index/log variable name that tells me, there do exist XYZ number of mails in the backup mail folder? >>> >>> Many thanks in advance >> >> >> sorry for bumping, but I am stuck at the moment. > > 1) Can you read mails from the resynced mdbox? For example: > > doveadm -o mail=mdbox:/anothermdbox fetch uid all > doveadm -o mail=mdbox:/srv/mail/foo.bar at example.com-backup fetch uid all | grep uid | wc -l 949 There seem to be mails. At least I get several lines with uid: > 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? It seems, it is just the import thing. doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so doveadm(root): Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(root): Debug: Effective uid=0, gid=0, home=/root doveadm(root): Debug: fs: root=/srv/mail/foo.bar at example.com-backup, index=, control=, inbox=, alt= doveadm(root): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com-backup: mode=0700 gid=-1 doveadm(foo.bar at example.com): Debug: Effective uid=5000, gid=5000, home=/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/srv/mail/foo.bar at example.com doveadm(foo.bar at example.com): Debug: fs: root=/srv/mail/foo.bar at example.com, index=, control=, inbox=, alt= doveadm(foo.bar at example.com): Debug: Namespace : Using permissions from /srv/mail/foo.bar at example.com: mode=0700 gid=-1 Thanks in advance -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From CMarcus at Media-Brokers.com Thu Aug 16 14:24:09 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 16 Aug 2012 07:24:09 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CD59F.9030705@wildgooses.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> Message-ID: <502CD859.6030709@Media-Brokers.com> On 2012-08-16 7:12 AM, Ed W wrote: > My opinion is that this is very easily to implement in at least Postfix > and probably other servers, hence I would suggest this is a function for > the MTA, not for the Dovecot relay? Well, true enough for simpler installations, but integrating something like this in dovecot that can be applied across large dovecot director based farms might be a good thing. Actually, maybe (and maybe not, I honestly haven't thought this through at all, and this might be a really dumb idea), instead of specific support for this one feature, I wonder if it would make more sense to actually build in support for a policy server (ie, amavisd-new) like postfix has... -- Best regards, Charles From claus.rosenberger at rocnet.de Thu Aug 16 14:30:56 2012 From: claus.rosenberger at rocnet.de (Claus Rosenberger) Date: Thu, 16 Aug 2012 13:30:56 +0200 Subject: [Dovecot] Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators) In-Reply-To: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> References: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> Message-ID: <502CD9F0.1060801@rocnet.de> Could i send some more informations about this topic? I'm not sure whats happening here but i think it has something to do with the shared mailboxes. With cyrus i had following folder structure: user1 -> inbox -> subfolders -> user -> user1 -> user2 With dovecot the folder structure look like: user1 -> inbox -> subfolders -> shared -> user1 -> inbox -> user2 -> inbox is there any way to show inbox directly in user1/user2 folder without having an inbox subfolder? Am 22.07.2012 00:04, schrieb Claus Rosenberger: > Hi, > > with fetching the folder structure with the webclient Tine i can see following error messages inside of the logfiles: > > Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) > > Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x448fa) [0x7f70036db8fa] -> /usr/lib/dovecot/libdovecot.so.0(+0x44946) [0x7f70036db946] -> /usr/lib/dovecot/libdovecot.so.0(+0x1b8ca) [0x7f70036b28ca] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open_stream+0) [0x7f70039a1550] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f70039a156f] -> dovecot/imap(cmd_select_full+0x14a) [0x40db1a] -> dovecot/imap(command_exec+0x3d) [0x41160d] -> dovecot/imap() [0x41058e] -> dovecot/imap() [0x41066d] -> dovecot/imap(client_handle_input+0x135) [0x410895] -> dovecot/imap(client_input+0x5f) [0x4111bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f70036e7ea6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f70036e8f2f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f70036e7e48] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f70036d4103] -> dovecot/imap(main+0x2a5) [0x419695] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f7003353c8d] -> dovecot/imap() [0x408f49] > > Fatal: master: service(imap): child 21152 killed with signal 6 (core dumps disabled) > From lazy404 at gmail.com Thu Aug 16 14:58:35 2012 From: lazy404 at gmail.com (Lazy) Date: Thu, 16 Aug 2012 13:58:35 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: <1337453839.4384.141.camel@innu> References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: 2012/5/19 Timo Sirainen : > On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >> failed: Read-only file system > > Does the attached patch help? > >> maybe it will be easier to move all dovecot metadata to separate (non >> snapshot) location ? > > It could also be a bit problematic. At least message keywords (=custom > flags) wouldn't work because the dovecot-keywords file exists only in > the snapshot dir. Moving metadata helped, but now archived inbox is unsubscribed. Is there a way to make all folders in an namespace subscribed by default ? Regards, Michal Grzedzicki From lists at wildgooses.com Thu Aug 16 14:58:59 2012 From: lists at wildgooses.com (Ed W) Date: Thu, 16 Aug 2012 12:58:59 +0100 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CD859.6030709@Media-Brokers.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> <502CD859.6030709@Media-Brokers.com> Message-ID: <502CE083.3030103@wildgooses.com> On 16/08/2012 12:24, Charles Marcus wrote: > On 2012-08-16 7:12 AM, Ed W wrote: >> My opinion is that this is very easily to implement in at least Postfix >> and probably other servers, hence I would suggest this is a function for >> the MTA, not for the Dovecot relay? > > Well, true enough for simpler installations, but integrating something > like this in dovecot that can be applied across large dovecot director > based farms might be a good thing. > > Actually, maybe (and maybe not, I honestly haven't thought this > through at all, and this might be a really dumb idea), instead of > specific support for this one feature, I wonder if it would make more > sense to actually build in support for a policy server (ie, > amavisd-new) like postfix has... > I'm really missing the key point here? The proposal was (I think?): Have Dovecot accept emails and feed them to the MTA (eg Postfix) This means you have access to all the MTA features (hence why I was pointing out these features exist today). Further, by centralising this function you don't need to duplicate the functionality depending on whether an email was sent via Dovecot or SMTP. So I don't see that policy servers are necessary in Dovecot for this particular requirement - I think most ideas we can come up with would benefit from delegating policy to the MTA so that it's centralised? I might be missing the point, so see above for my understanding of the problem? Ed W From CMarcus at Media-Brokers.com Thu Aug 16 15:38:00 2012 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 16 Aug 2012 08:38:00 -0400 Subject: [Dovecot] v2.2 status update: IMAP NOTIFY extension and more In-Reply-To: <502CE083.3030103@wildgooses.com> References: <1344861658.13571.10.camel@hurina> <8036F761-0F83-478F-9F78-7DF37DB64D65@xs4all.nl> <8F0D37D7-DC62-400F-AA5C-E5EB13AFB556@iki.fi> <26813A87-F3FF-4717-882B-46B20EFA6DF1@xs4all.nl> <502CD59F.9030705@wildgooses.com> <502CD859.6030709@Media-Brokers.com> <502CE083.3030103@wildgooses.com> Message-ID: <502CE9A8.5060203@Media-Brokers.com> On 2012-08-16 7:58 AM, Ed W wrote: > On 16/08/2012 12:24, Charles Marcus wrote: >> Actually, maybe (and maybe not, I honestly haven't thought this >> through at all, and this might be a really dumb idea), instead of >> specific support for this one feature, I wonder if it would make more >> sense to actually build in support for a policy server (ie, >> amavisd-new) like postfix has... > I'm really missing the key point here? > > The proposal was (I think?): Have Dovecot accept emails and feed them to > the MTA (eg Postfix) > > This means you have access to all the MTA features (hence why I was > pointing out these features exist today). Further, by centralising this > function you don't need to duplicate the functionality depending on > whether an email was sent via Dovecot or SMTP. > > So I don't see that policy servers are necessary in Dovecot for this > particular requirement - I think most ideas we can come up with would > benefit from delegating policy to the MTA so that it's centralised? But doing it in dovecot would mean that it wouldn't matter what MTA you were using, or even what OS/platform said MTAs were running on, you would handle all said policies for your entire (dovecot-director) infrastructure in one place (dovecot)... Also, this would only be for *outbound* policies, so would provide a degree of separation with your *inbound* policies... which could be a good or bad thing I guess depending on your needs and requirements. Like I said, I haven't thought it completely through and it may indeed be a bad idea... -- Best regards, Charles From tomislav.mihalicek at gmail.com Thu Aug 16 16:27:52 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Thu, 16 Aug 2012 06:27:52 -0700 (PDT) Subject: [Dovecot] dovecot 2.1 Master account Error Message-ID: <1345123672440-37109.post@n4.nabble.com> HI I am running parallel dovecot 1.2 for main accounts and 2.1 for test accounts, and for some reason when i try to login with master user on dovecot 2.1 service errors. However the normal user logins and rest works flawlesly Here is the debug Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: auth client connected (pid=27557) Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=pop3#011secured#011no-penalty#011session=ZOcF2GHHdQAKVCKD#011lip=10.84.34.122#011rip=10.84.34.131#011lport=110#011rport=60021 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client out: CONT#0111#011 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client in: CONT Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: auth(migration at example.net,10.84.34.131,master,): Master user lookup for login: tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: passwd-file(migration at example.net,10.84.34.131,master,): lookup: user=migration at example.net file=/etc/dovecot/master-users Aug 16 15:15:56 mailstore-node-02 dovecot: auth: passdb(migration at example.net,10.84.34.131,master,): Master user logging in as tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): pass search: base=ou=accounts,dc=example,dc=net scope=subtree filter=(&(objectClass=mailUser)(accountService=mail)(accountService=pop3secured)(|(mail=tomislav.mihalicek at example.net)(mailAlternateAddress=tomislav.mihalicek at example.net))) fields=mail,userPassword Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): result: mail=tomislav.mihalicek at example.net userPassword= Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: client out: OK#0111#011user=tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: master in: REQUEST#0113563585537#01127557#0111#0118ccf2bab093bd33a4b93958c99236471 Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): user search: base=ou=accounts,dc=example,dc=net scope=subtree filter=(&(objectClass=mailUser)(accountService=mail)(accountService=pop3secured)(|(mail=tomislav.mihalicek at example.net)(mailAlternateAddress=tomislav.mihalicek at example.net))) fields=mail,homeDirectory,mailQuotaSize Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: ldap(tomislav.mihalicek at example.net,10.84.34.131,): result: mail=tomislav.mihalicek at example.net mailQuotaSize=4294967296 homeDirectory=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek Aug 16 15:15:56 mailstore-node-02 dovecot: auth: Debug: master out: USER#0113563585537#011tomislav.mihalicek at example.net#011home=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek#011quota_rule=*:bytes=4294967296#011master_user=migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3-login: Login: user=, method=PLAIN, rip=10.84.34.131, lip=10.84.34.122, mpid=27558, secured, session= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib01_acl_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_expire_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_mail_log_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_virtual_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_zlib_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_stats_plugin.so Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Added userdb setting: plugin/master_user=migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3: Debug: Added userdb setting: plugin/quota_rule=*:bytes=4294967296 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Effective uid=10101, gid=10101, home=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota root: name=user backend=dict args=:proxy::quota Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota rule: root=user mailbox=* bytes=4294967296 messages=0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=4080218931 (95%) messages=0 reverse=no command=quota-warning 95 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=3650722201 (85%) messages=0 reverse=no command=quota-warning 85 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Quota warning: bytes=3006477107 (70%) messages=0 reverse=no command=quota-warning 70 tomislav.mihalicek at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: dict quota: user=tomislav.mihalicek at example.net, uri=proxy::quota, noenforcing=0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:~/sdbox:INDEX=~/index Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: fs: root=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox, index=/mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/index, control=, inbox=, alt= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: initializing backend with data: vfile:/etc/dovecot/global-acls:cache_secs=300 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: acl username = migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: owner = 0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: Global ACL directory: /etc/dovecot/global-acls Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: Namespace : type=shared, prefix=X-Share/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=maildir:%h/Maildir:INDEX=~/index/Shared/%u Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: shared: root=/var/run/dovecot, index=, control=, inbox=, alt= Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: initializing backend with data: vfile:/etc/dovecot/global-acls:cache_secs=300 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: acl username = migration at example.net Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl: owner = 0 Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: Global ACL directory: /etc/dovecot/global-acls Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /etc/dovecot/global-acls/INBOX not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox/mailboxes/INBOX/dbox-Mails/dovecot-acl not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /etc/dovecot/global-acls/ not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Debug: acl vfile: file /mailbox/maildirs/example.net/t/o/m/tomislav.mihalicek/sdbox/mailboxes/dovecot-acl not found Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Error: Failed to autocreate mailbox INBOX: Permission denied Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Error: Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2012-08-16 15:15:56] Aug 16 15:15:56 mailstore-node-02 dovecot: pop3(tomislav.mihalicek at example.net): Couldn't open INBOX top=0/0, retr=0/0, del=0/0, size=0 -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-2-1-Master-account-Error-tp37109.html Sent from the Dovecot mailing list archive at Nabble.com. From merrickville at gmail.com Thu Aug 16 19:01:59 2012 From: merrickville at gmail.com (Merrickville) Date: Thu, 16 Aug 2012 09:01:59 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding Message-ID: <1345132919122-37110.post@n4.nabble.com> Trying to figure out hostname based IMAP proxy forwarding. I have two mail servers: mail.example.com mail.fakedomain.ca proxy server running dovecat/IMAPS, facing the Internet. *Both* names are DNS resolve(able), but.., both are the *same IP address.* For example: Joe configures his email client username: joe at example.com IMAP Addr: mail.example.com For example: Jane configures her email client username: jane at fakedomain.ca IMAP Addr: mail.fakedomain.ca So, now all clients must change their user-name in their email client to their full email address, because there is a Jane & Joe on "both" servers and..., dovecot proxies based on 'user name' Is there a way to proxy based on the host name the client has configured in his/her email client? (Like Apache VirtualHosts) This would be ideal, as the clients can then go back to using just their name as the username. Thanks Rick -- View this message in context: http://dovecot.2317879.n4.nabble.com/Hostname-Based-forwarding-tp37110.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Thu Aug 16 19:21:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 16 Aug 2012 19:21:45 +0300 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> Message-ID: <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> On 16.8.2012, at 14.13, Christian R??ner wrote: >> 1) Can you read mails from the resynced mdbox? For example: >> >> doveadm -o mail=mdbox:/anothermdbox fetch uid all >> > doveadm -o mail=mdbox:/srv/mail/foo.bar at example.com-backup fetch uid all | grep uid | wc -l > 949 > > There seem to be mails. At least I get several lines with uid: > >> 2) Is the problem just the doveadm import? Can you import anything to anything at all? What does it say with -v parameter? > > > It seems, it is just the import thing. > > doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL I find this strange. Does the mdbox size on filesystem get increased at all? (You sure it's not just that they're not visible in your IMAP client?) From c at roessner-network-solutions.com Thu Aug 16 19:42:54 2012 From: c at roessner-network-solutions.com (=?iso-8859-1?Q?Christian_R=F6=DFner?=) Date: Thu, 16 Aug 2012 18:42:54 +0200 Subject: [Dovecot] some mdbox mails get lost each day In-Reply-To: <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> References: <1EF61BB9-111C-4E60-95CA-538F3A6ED1A6@roessner-network-solutions.com> <1FD399AD-E671-449F-A26D-957B15A7BE76@iki.fi> <6AFCC0F1-7C07-4667-9AC8-A8252B687D5E@roessner-network-solutions.com> <4687B81B-B3DE-493A-9E72-6D397DD5E4AD@iki.fi> <395280C7-50EB-4EE6-A797-54E6DEABFF5B@roessner-network-solutions.com> <511B43C3-9EB6-4186-90F2-29D70DD259E3@roessner-network-solutions.com> <4EF4732D-7079-4F07-AF53-C5DCC20122F7@iki.fi> <1865D7F3-8E1C-474B-B0D7-439436C09C08@roessner-network-solutions.com> <7FBDE8DE-4B63-4F68-A7A2-64FE8B88836E@iki.fi> Message-ID: Hi, >> doveadm -Dv import -u foo.bar at example.com mdbox:/srv/mail/foo.bar at example.com-backup all-mails ALL > > I find this strange. Does the mdbox size on filesystem get increased at all? (You sure it's not just that they're not visible in your IMAP client?) > I find that strange, either :-) I have done: tree . ??? Drafts ? ??? dbox-Mails ? ??? dovecot.index.log ??? Gel&APY-schte Elemente ? ??? dbox-Mails ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? Gesendete Elemente ? ??? dbox-Mails ? ??? dovecot.index ? ??? dovecot.index.backup ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? INBOX ? ??? dbox-Mails ? ??? dovecot.index ? ??? dovecot.index.backup ? ??? dovecot.index.cache ? ??? dovecot.index.log ??? Junk ? ??? dbox-Mails ? ??? dovecot.index.log ??? Junk-E-Mail ? ??? dbox-Mails ? ??? dovecot.index.log ??? Sent ? ??? dbox-Mails ? ??? dovecot.index.log ??? Trash ??? dbox-Mails ??? dovecot.index.log 16 directories, 15 files So at least I should see a folder called all-mail, don't I? If nothing helps, I create a new user called foo.bar at example.com-backup and ask the customer to include that account as well just for importing stuff, he still needs. On the perspective of being a developer, too, I am interested why this does not work. So if you like to dig deeper into this, I gonna help you as much as I can. -Christian R??ner --- Bachelor of Science Informatik Erlenwiese 14, 36304 Alsfeld T: +49 6631 78823400, F: +49 6631 78823409, M: +49 176 93118939 USt-IdNr.: DE225643613, http://www.roessner-network-solutions.com -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3880 bytes Desc: not available URL: From tss at iki.fi Fri Aug 17 09:18:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 17 Aug 2012 09:18:15 +0300 Subject: [Dovecot] dsync backup gets stuck... fails In-Reply-To: <1345058614.25701.20.camel@maclinux> References: <1344635642.23239.8.camel@maclinux> <5A9AFFAF-B75F-4234-8664-6366451FFAF0@iki.fi> <1344998518.25701.13.camel@maclinux> <9C5F8A5C-8076-4BA9-8D32-6357662E7D8F@iki.fi> <1345058614.25701.20.camel@maclinux> Message-ID: <01AB0F8C-CEA1-48F8-B197-E8E8137B427E@iki.fi> On 15.8.2012, at 22.23, Jeff Gustafson wrote: >> dsync-local(tss): Fatal: dsync backup: Looks like you're trying to run >> backup in wrong direction. Source is empty and destination is not. > > That's the one! > >> Maybe it needs a force setting, or change the detection somehow.. > > That would be nice. A backup script is executing the command, so it > should never do it in the wrong direction. A force setting might be the > simplest way to go. This should do it: http://hg.dovecot.org/dovecot-2.1/rev/5f280c1ec9fd From dof at projektfabrik.com Fri Aug 17 13:06:38 2012 From: dof at projektfabrik.com (dof at projektfabrik.com) Date: Fri, 17 Aug 2012 12:06:38 +0200 Subject: [Dovecot] =?utf-8?q?antispam=5Fplugin_prevents_IMAP_login_=28erro?= =?utf-8?b?ciAzKSBbRG92ZWNvdCAyLjAuMTld?= Message-ID: <22a789efa29d55b6725759b7ee4b5bd0@webmail.projektfabrik.com> Hi everybody, trying to get the Dovecot antispam_plugin to work and I must be doing something wrong, because as soon as it is enabled with a certain backend, imap logins do not work anymore (the session is immediately closed after a successful login). Interestingly, pipe and spool2dir are working (that is, the session won't be closed), dspam-exec and crm114-exec are not. If this happens, mail_debug output is as follows: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10420, secured imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib90_antispam_plugin.so imap(dof): Debug: Effective uid=23244, gid=8, home=/var/spool/dovecot/userdata/dof imap(dof): Debug: Home dir not found: /var/spool/dovecot/userdata/dof master: Error: service(imap): child 10420 returned error 3 Without the plugin I get: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=10469, secured imap: Debug: Loading modules from directory: /usr/lib/dovecot/modules imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_autocreate_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so imap: Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so imap(dof): Debug: Effective uid=23244, gid=8, home=/var/spool/dovecot/userdata/dof imap(dof): Debug: Home dir not found: /var/spool/dovecot/userdata/dof imap(dof): Debug: fs: root=/var/spool/dovecot/mail/dof, index=, control=, inbox=/var/spool/dovecot/mail/dof/INBOX, alt= imap(dof): Debug: Namespace : Using permissions from /var/spool/dovecot/mail/dof: mode=0755 gid=-1 Hopefully this is just a configuration problem. I tried the plugin in the Ubuntu repository (I'm using LTS 12.04) and even checked out the source from git and compiled it myself, but to no avail. Thanks a lot in advance and best regards, Florian ------------------- dovecot -n output: auth_cache_size = 128 k auth_cache_ttl = 20 mins auth_failure_delay = 10 secs auth_mechanisms = plain login disable_plaintext_auth = no login_greeting = Projektfabrik IMAP ready. mail_gid = mail mail_home = /var/spool/dovecot/userdata/%u mail_location = maildir:/var/spool/dovecot/mail/%u:INBOX=/var/spool/dovecot/mail/%u/INBOX:LAYOUT=fs mail_uid = dovemail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { antispam_backend = dspam-exec antispam_dspam_binary = /usr/bin/dspam antispam_signature = X-DSPAM-Signature antispam_signature_missing = error antispam_spam = Spam antispam_trash = trash;Trash;Deleted Items; Deleted Messages autocreate = INBOX/Sent Mail autocreate2 = INBOX/Spam autocreate3 = INBOX/Trash autosubscribe = INBOX/Sent Mail autosubscribe2 = INBOX/Spam autosubscribe3 = INBOX/Trash fts = squat sieve = /var/spool/dovecot/sieve/%u/defaultbc sieve_before = /etc/dovecot/sieve/spam.sieve sieve_dir = /var/spool/dovecot/sieve/%u } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0600 user = postfix } unix_listener auth-userdb { mode = 0600 user = dovemail } user = dovenull } service imap-login { inet_listener imap { address = localhost port = 143 } inet_listener imaps { address = localhost XX.XXX.XX.XXX port = 993 } service_count = 1 user = dovenull } service managesieve-login { inet_listener sieve { address = localhost port = 2000 } service_count = 1 user = dovenull } service pop3-login { inet_listener pop3 { address = localhost port = 110 } inet_listener pop3s { address = XX.XXX.XX.XXX port = 995 } service_count = 1 user = dovenull } ssl_ca = Maybe it's fixed, but the last "interesting" text in the Changelog was before 2.1.6. Most of our users still have mboxes in the classical layout, so you can't have subfolders and messages in the same folder, *except for the INBOX*, as it is physically separate. Someone complained that he saw subfolders in roundcube he couldn't delete, because they didn't show up in the subscription view. Before hitting on roundcube, I mperformed a few checks and got the following: root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/*' root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/test1' INBOX/test1 messages=0 This is mysterious. It doesn't happen with my account, that is in a mdbox: root at cx-y-z qmail # doveadm mailbox status -u kriegjcb messages 'INBOX/*' INBOX/test1 messages=1 Our setup is a bit complicated, but most of it shouldn't be relevant to the problem. # 2.1.6: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-103.ELsmp i686 Red Hat Enterprise Linux AS release 4 (Nahant Update 9) auth_first_valid_uid = 100 auth_master_user_separator = * dict { quota = mysql:/usr/local/dovecot/etc/dovecot-dict-mysql.conf } disable_plaintext_auth = no first_valid_uid = 100 lda_mailbox_autocreate = yes log_path = /dev/stderr log_timestamp = mail_access_groups = nofiles mail_location = mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/Index mail_plugins = " quota zlib mail_log notify virtual stats" mdbox_rotate_size = 5 M namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes inbox = no list = children location = maildir:~/Maildir prefix = "#MD/" separator = / type = private } namespace { hidden = yes list = no location = virtual:~/Maildir/Virtual prefix = Virtual/ separator = / type = private } namespace { hidden = yes list = no location = virtual:/usr/local/dovecot/etc/virtuell:INDEX=~/Virtuell prefix = Virtuell/ separator = / subscriptions = no type = private } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { acl = vfile mail_log_events = undelete mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota quota2 = fs:Disk quota stats_refresh = 30 secs stats_track_cmds = yes } protocols = pop3 imap service auth { client_limit = 4300 user = root } service dict { unix_listener dict { group = nofiles mode = 0666 } } service doveadm { inet_listener { port = 542 } } service imap-login { inet_listener imap { address = 134.147.64.38 port = 143 } service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = 134.147.64.38 port = 110 } service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } service stats { fifo_listener stats-mail { mode = 0666 user = dovenull } } ssl = no stats_command_min_time = 5 mins stats_domain_min_time = 1 hours stats_ip_min_time = 1 hours stats_memory_limit = 64 M userdb { args = /usr/local/dovecot/etc/dovecot-mysql.conf driver = sql } userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota zlib mail_log notify virtual stats imap_quota imap_zlib imap_stats" } Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From kryol at bigmir.net Fri Aug 17 14:24:09 2012 From: kryol at bigmir.net (Oleksii Krykun) Date: Fri, 17 Aug 2012 14:24:09 +0300 Subject: [Dovecot] Expire-tool does not delete duplicate messages (dovecot-1.2.17) Message-ID: Trying to implement expire plugin. expire-tool works fine. This delete expunged messages but not all of them. I have duplicate messages in appropriate folder. These messages are from expanding postfix aliases (e.g. postmaster@, hostmaster@, abuse@ etc. points to same mailbox and spam often sent to all of them. If duplicate message is received only one entry in dovecot-uidlist is created and only first of duplicates is deleted with expire-tool. Rest of duolicates are not deleted. Any suggestions. Thanks, Kryol From tss at iki.fi Fri Aug 17 19:32:24 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 17 Aug 2012 19:32:24 +0300 Subject: [Dovecot] Expire-tool does not delete duplicate messages (dovecot-1.2.17) In-Reply-To: References: Message-ID: On 17.8.2012, at 14.24, Oleksii Krykun wrote: > Trying to implement expire plugin. > expire-tool works fine. This delete expunged messages but not all of them. > I have duplicate messages in appropriate folder. These messages are from > expanding postfix aliases (e.g. postmaster@, hostmaster@, abuse@ etc. > points to same mailbox and spam often sent to all of them. > If duplicate message is received only one entry in dovecot-uidlist is > created and only first of duplicates is deleted with expire-tool. Rest of > duolicates are not deleted. > > Any suggestions. No idea, but if it's a bug, it won't be fixed anymore in v1.2. The whole thing has been rewritten in v2.x. I suggest upgrade. From tresh_dovecot at lefoyer.ru Fri Aug 17 21:37:08 2012 From: tresh_dovecot at lefoyer.ru ((Dovecot) Sergey Sidlyarenko) Date: Fri, 17 Aug 2012 22:37:08 +0400 Subject: [Dovecot] Problem use localized prefix in namespace Message-ID: dovecot --version 2.1.7 uname -a Linux ns 3.2.0-2-amd64 #1 SMP Mon Jun 11 17:24:18 UTC 2012 x86_64 GNU/Linux Debian sid Problem with localized prefix in namespace. Create namespace namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/mail/%d%n/test1:LAYOUT=fs:DIRNAME=maildirfolder:UTF-8 mailbox next { auto = subscribe special_use = } prefix = ????1/ separator = / subscriptions = yes type = private } namespace { hidden = no ignore_on_failure = no inbox = no list = yes location = maildir:/var/mail/%d%n/test2:LAYOUT=fs:DIRNAME=maildirfolder:UTF-8 mailbox next { auto = subscribe special_use = } prefix = &BCIENQRBBEI-2/ separator = / subscriptions = yes type = private } result A0002 NAMESPACE * NAMESPACE (("" "/")("links/" "/")({10} ????1/ "/")("&BCIENQRBBEI-2/" "/")) NIL NIL A0002 OK Namespace completed. A0003 LIST "" "*" ... cut * LIST (\Noselect \HasChildren) "/" "&BCIENQRBBEI-1" * LIST (\HasNoChildren) "/" "&BCIENQRBBEI-1/next" * LIST (\Noselect \HasChildren) "/" "&-BCIENQRBBEI-2" * LIST (\HasNoChildren) "/" "&-BCIENQRBBEI-2/next" * LIST (\HasNoChildren) "/" "&BCIENQRBBEI-1/next" * LIST (\HasNoChildren) "/" "&-BCIENQRBBEI-2/next" A0002 OK List completed. A0003 LSUB "" "*" ... cut * LSUB () "/" "&-BCIENQRBBEI-2/next" * LSUB () "/" "&BCIENQRBBEI-1/next" * LSUB () "/" "&BCIENQRBBEI-1/next" * LSUB () "/" "&-BCIENQRBBEI-2/next" A0003 OK Lsub completed. A0004 SELECT "&BCIENQRBBEI-1/next" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1344240572] UIDs valid * OK [UIDNEXT 1] Predicted next UID * OK [NOMODSEQ] No permanent modsequences A0004 OK [READ-WRITE] Select completed. A0005 SELECT "&BCIENQRBBEI-2/next" Connection closed by foreign host. in error log 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4413a) [0x7f8d6bcc613a] -> /usr/lib/dovecot/libdovecot.so.0(+0x4417e) [0x7f8d6bcc617e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8d6bc9d82a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x7e506) [0x7f8d6bf8e506] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0x18) [0x7f8d6bf8e538] -> dovecot/imap(cmd_select_full+0x13e) [0x40ddbe] -> dovecot/imap(command_exec+0x3c) [0x4118dc] -> dovecot/imap() [0x4109ae] -> dovecot/imap() [0x410a5a] -> dovecot/imap(client_handle_input+0x11d) [0x410cad] -> dovecot/imap(client_input+0x62) [0x411552] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f8d6bcd2ff6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f8d6bcd3ca7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f8d6bcd2a08] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8d6bcbf483] -> dovecot/imap(main+0x285) [0x409265] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f8d6b919ead] -> dovecot/imap() [0x4093d5] 2012-08-17 22:19:17 imap(admin at lefoyer.ru): Fatal: master: service(imap): child 20040 killed with signal 6 (core dumps disabled) -- Best regards, Sidlyarenko Sergey Aleksandrovish +7(495)509-42-07 tresh_dovecot at lefoyer.ru mailto:tresh_dovecot at lefoyer.ru From Lutz.Pressler at SerNet.DE Sat Aug 18 00:12:14 2012 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Fri, 17 Aug 2012 23:12:14 +0200 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: <1291312192.5119.455.camel@kurkku.sapo.corppt.com> References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: Hello Timo, virtual file with "inthread/younger" (other dynamic searches?) in it and indexes leading to too many (or too few?) search results. On Do, 02 Dez 2010, Timo Sirainen wrote: > On Thu, 2010-12-02 at 11:08 +0100, Lutz Pre?ler wrote: > > > inthread refs younger 604800 > > > > This works as expected for the first time. But later on, also older messages/ > > threads are included until I delete the virtual/.week/dovecot.index*. > > I know there are problems related to this with INTHREAD, but they aren't > very easy to solve and for now I've more important things to do.. If it > seemed to work before, it was due to luck or due to some bug causing an > unnecessary index rebuild. You could set :INDEX=MEMORY to work around > this, but I don't know how much worse the performance would become. Or > you could just manually delete the virtual indexes once a week. Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ enhance now? Any estimate how much effort it would be? Thanks again for your work, Lutz From jtam.home at gmail.com Sat Aug 18 03:29:49 2012 From: jtam.home at gmail.com (Joseph Tam) Date: Fri, 17 Aug 2012 17:29:49 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding In-Reply-To: References: Message-ID: Merrickville writes: > Is there a way to proxy based on the host name the client has configured in > his/her email client? (Like Apache VirtualHosts) I doubt it; the virtual name is not part of the IMAP protocol as it is in HTTP. The IMAP server is not told which hostname was mapped to its IP. You'll either have to add the @domain, or perhaps multi-home your host, remap one of your domains to the new IP, and add another running instance of dovecot to listen on that interface. Joseph Tam From daniel.parthey at informatik.tu-chemnitz.de Sat Aug 18 04:16:01 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sat, 18 Aug 2012 03:16:01 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <20120818011601.GA12947@daniel.localdomain> Timo Sirainen wrote: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > > http://wiki2.dovecot.org/Director#Other_settings > > doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. > > service ipc { > unix_listener ipc { > user = dovecot > } > } > > director instance needs access to director instance. With the above configuration, ipc works correctly between our directors and kicks the moved users which had been connected via proxy. Thanks a lot! Regards Daniel -- https://plus.google.com/103021802792276734820 From me at junc.org Sat Aug 18 05:36:24 2012 From: me at junc.org (Benny Pedersen) Date: Sat, 18 Aug 2012 04:36:24 +0200 Subject: [Dovecot] =?utf-8?q?Listen_on_multiple_ports_possible_using_same_?= =?utf-8?q?protocol=3F?= In-Reply-To: References: Message-ID: <9d88e2853396bae613dc925a02f5dbb5@junc.org> Den 2012-08-15 00:12, Michael Durket skrev: > for example. Or is this more preferably done by pointing dovecot at > different configuration files? listen = wan-ip:143 listen = 127.0.0.2:143 ssl_listen = wan-ip:993 ssl_listen = 127.0.0.3:993 just examples since it dont understand what you like to test :) From tss at iki.fi Sun Aug 19 05:57:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 05:57:16 +0300 Subject: [Dovecot] Search extensions Message-ID: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": a search or x-anyheader application/pdf x-anyheader .pdf b fetch $ bodystructure The client can verify the results with the fetch. The "x-anyheader" can already be implemented without changes to full text search plugin, because all backends store message/MIME headers and body text separately. So, questions for the list, especially client developers: 1) What's a better name for x-anyheader? :) 2) Any other ideas about search extensions you'd want to see? Maybe I could get this standardized at some point. I think one other thing missing has been "show me messages that have attachments". I've thought about maybe creating a $hasattachments keyword for that, which the server could automatically set for new mails that it thinks has attachments (and clients can set/unset the keyword if wanted). From kamath at moltingpenguin.com Sun Aug 19 09:47:36 2012 From: kamath at moltingpenguin.com (Sean Kamath) Date: Sat, 18 Aug 2012 23:47:36 -0700 Subject: [Dovecot] Search extensions In-Reply-To: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: On Aug 18, 2012, at 7:57 PM, Timo Sirainen wrote: > I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": > > a search or x-anyheader application/pdf x-anyheader .pdf > b fetch $ bodystructure > > The client can verify the results with the fetch. The "x-anyheader" can already be implemented without changes to full text search plugin, because all backends store message/MIME headers and body text separately. > > So, questions for the list, especially client developers: > > 1) What's a better name for x-anyheader? :) > > 2) Any other ideas about search extensions you'd want to see? Maybe I could get this standardized at some point. > > I think one other thing missing has been "show me messages that have attachments". I've thought about maybe creating a $hasattachments keyword for that, which the server could automatically set for new mails that it thinks has attachments (and clients can set/unset the keyword if wanted). At work we've flipped to Google mail (I run Dovecot at home). 99.9% of the time I just cry. Once feature of their search capability that sometimes is nice is the ability to not only see if it has an attachment (has:attachment) but the ability to search for the attachments by a specific name (filename:). That can be, and has proven, useful. I suspect this could turn into a nightmare, however. Ditto something like "has N attachments" (sometime I dearly wish I had at times -- I want to find that damn message with like 10 attachments). Or math around number of attachments. My $0.02. Sean From trashcan at odo.in-berlin.de Sun Aug 19 12:51:08 2012 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Sun, 19 Aug 2012 11:51:08 +0200 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <1331206534.2081.101.camel@innu> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> Message-ID: <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> On 08.03.2012, at 12:35, Timo Sirainen wrote: > On Thu, 2012-03-08 at 11:26 +0100, Michael Grimm wrote: >> Now some observations regarding replicator: >> >> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >> >> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >> >> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >> >> JFTR: I do have mail_log plugin activated. > > Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? Regards, Michael From tss at iki.fi Sun Aug 19 14:10:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 14:10:09 +0300 Subject: [Dovecot] Search extensions In-Reply-To: References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: <66CC9348-E96F-48D9-9B56-25FF10E1F1E8@iki.fi> On 19.8.2012, at 9.47, Sean Kamath wrote: >> I'm thinking about adding at least one new SEARCH command extension to Dovecot: ability to search from any headers in the mail, including MIME headers in the body. So the idea is that you could somewhat quickly ask e.g. "show me all mails with pdf attachments": >> >> a search or x-anyheader application/pdf x-anyheader .pdf >> b fetch $ bodystructure >> >> The client can verify the results with the fetch. > Once feature of their search capability that sometimes is nice is the ability to not only see if it has an attachment (has:attachment) but the ability to search for the attachments by a specific name (filename:). That can be, and has proven, useful. I suspect this could turn into a nightmare, however. Ditto something like "has N attachments" (sometime I dearly wish I had at times -- I want to find that damn message with like 10 attachments). Or math around number of attachments. Actually searching by attachment filename was also in my requirements list, but I forgot to mention it. It can anyway be done the same way as the pdf example above. The bodystructure reply includes attachment filenames. Of course you'll still need a client that can give a nice UI for those.. From tss at iki.fi Sun Aug 19 18:08:47 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:08:47 +0300 Subject: [Dovecot] Dsync and SIS In-Reply-To: <5022ADCB.8060805@integrafin.co.uk> References: <5022ADCB.8060805@integrafin.co.uk> Message-ID: <4F899205-CEF9-4C9F-8FAC-ADD59E566811@iki.fi> On 8.8.2012, at 21.19, Alex Crow wrote: > Just to clarify, if we back up a dovecot 2 server with SIS for attachments and ALT storage by rsyncing it (including the SIS and ALT storage) to a remote server when it's idle (or at least almost entirely so), and run dovecot on that machine, would it seem feasible to restore backups from that server by using dysnc - specifically for the scenario where someone accidentally deletes emails/folders etc.? dsync over ssh should work for that, yes. (Locally if you use doveadm import it's going to use the same SIS storage unless you override the settings.) From tss at iki.fi Sun Aug 19 18:09:57 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:09:57 +0300 Subject: [Dovecot] maildir to sdbox offline conversion In-Reply-To: <34274589.post@talk.nabble.com> References: <34274589.post@talk.nabble.com> Message-ID: On 9.8.2012, at 3.34, _ET_ wrote: > So it's not easy to do an "online" conversion and follow the instructions at > dsync's wiki. Do you know a way how to simply tell dsync or a similar util > the following > > dsync convert maildir:/data/vmail/domain/user > sdbox:/newdata/vmail/domain/user > > without touching the ldap database, only the files on the disk. I can run > this command as root on this mail server, if it is needed, I can run the > command for each and every maildir. That's not a problem. > > any ideas, how this woul?d be the simpliest? doveadm -o mail=maildir:/data/... sync sdbox:/newdata/... From tss at iki.fi Sun Aug 19 18:22:30 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:22:30 +0300 Subject: [Dovecot] dsync \noselect on INBOX.INBOX skips sync of INBOX In-Reply-To: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> References: <22BE3095-C543-4813-A2FF-4F430BC3ED50@net24.co.nz> Message-ID: <8C1B93D0-C743-4340-BFE7-160B17212002@iki.fi> On 9.8.2012, at 11.20, Nikolai Schupbach wrote: > We have encountered an issue today with a number of migrations. Some customers have mailboxes on the source IMAP server that look like this: > > 3 LIST "" * > * LIST () "." "INBOX" > * LIST () "." "INBOX.Statements" > * LIST () "." "INBOX.Draft" > * LIST () "." "INBOX.Drafts" > * LIST () "." "INBOX.Invoices" > * LIST (\Noselect) "." "INBOX.INBOX" > * LIST () "." "INBOX.Jokes" > * LIST () "." "INBOX.Payslips" > * LIST () "." "INBOX.Personal" > > When we run dsync it skips the INBOX presumably because of the Noselect on INBOX.INBOX. and the "imapc_list_prefix = INBOX" setting. Does the attached patch help? -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 968 bytes Desc: not available URL: From tss at iki.fi Sun Aug 19 18:26:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:26:10 +0300 Subject: [Dovecot] Full text search in attachments In-Reply-To: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> Message-ID: <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> On 11.8.2012, at 5.28, Mailing wrote: > is it possible to use the Solr full text search plugin for indexing mail attachments? I found a very old patch and some hints regarding a fts_decoder script that I don't understand. > > Making Solr indexing PDF or Office files shouldn't be that difficult, but how can I enable the plugin to transfer the attachments to Solr? I updated the wiki with: * See the decode2text.sh script included in Dovecot for how to use this. From tss at iki.fi Sun Aug 19 18:28:30 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:28:30 +0300 Subject: [Dovecot] imap-login process_limit (100) reached, client connections are being dropped In-Reply-To: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> References: <8d4db6a4128067ca8621acc16be1c1c4.squirrel@geko.sbt.net.au> Message-ID: On 13.8.2012, at 14.12, Voytek Eymont wrote: > noticed this in the log today, after about 11 warning IMAP appears to have > not worked, 'service dovecot reload' got it going again > > question: what to check/alter ? http://wiki2.dovecot.org/LoginProcess Easiest/safest is to just increase process_limit. From tss at iki.fi Sun Aug 19 18:33:34 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:33:34 +0300 Subject: [Dovecot] Permission denied on dovecot.lda-dupes In-Reply-To: <1344871085776-37053.post@n4.nabble.com> References: <1344871085776-37053.post@n4.nabble.com> Message-ID: <0098E449-2043-4CEB-B617-2F3C2D561F67@iki.fi> On 13.8.2012, at 18.18, ppridt wrote: > Hi, > I have converted my Imap Server from Courier to Dovecot in order to use > sieve support. > Everything works fine with the exception that the sender always gets the > vacation msg since there is a permission error on writing of > dovecot.lda-dupes. .. > Aug 13 14:51:26 Srv dovecot: deliver(pp): Home dir not found: The dupe file is written to home dir, but you have no home dir. > file_dotlock_create(/.dovecot.lda-dupes) failed: Permission denied So it's trying to write to the root directory. But I find these messages strange. They shouldn't happen at least newer Dovecots. What version are you using? From tss at iki.fi Sun Aug 19 18:36:39 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:36:39 +0300 Subject: [Dovecot] Mdbox corruption In-Reply-To: <502C000C.9060206@adminlinux.com.br> References: <502C000C.9060206@adminlinux.com.br> Message-ID: <8AB4531A-2EE3-4F6B-A3BF-9DBF79A2EC31@iki.fi> On 15.8.2012, at 23.01, 3.listas at adminlinux.com.br wrote: > I have a "ubuntu10.04 + ext4-filesystem + dovecot-2.0.13 +mdbox" configuration in my server. It works fine with ~50k accounts. > Recently happened a filesystem corruption in a device of StMailLocation and I fix with fsck.ext4. > After this crash, one account began to show access timeout and errors like this on force-resync: > > # doveadm force-resync -u account INBOX > doveadm(account): Warning: mdbox /path-to-mdbox/storage: rebuilding indexes > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) > doveadm(account): Warning: dbox: Copy of the broken file saved to /path-to-mdbox/storage/m.83.broken > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.83 (around offset=16): EOF reading msg header (got 0/30 bytes) > doveadm(account): Error: mdbox rebuild: Failed to fix file /path-to-mdbox/storage/m.83 > doveadm(account): Error: Corrupted dbox file /path-to-mdbox/storage/m.92 (around offset=7): Invalid dbox version > ... > > Should I worry about the m.X.broken files ? > How I fix these broken mdboxes ? Dovecot fixed the mdbox files automatically and wrote m.*.broken files that contain the originals, just in case the fixing didn't do something correctly so you could manually look at them. Now, if doveadm force-resync keeps finding errors all the time it's a bug. I'd first try the latest v2.1 though, may be fixed already. From tss at iki.fi Sun Aug 19 18:39:04 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:39:04 +0300 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: On 16.8.2012, at 14.58, Lazy wrote: > 2012/5/19 Timo Sirainen : >> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>> failed: Read-only file system >> >> Does the attached patch help? >> >>> maybe it will be easier to move all dovecot metadata to separate (non >>> snapshot) location ? >> >> It could also be a bit problematic. At least message keywords (=custom >> flags) wouldn't work because the dovecot-keywords file exists only in >> the snapshot dir. > > Moving metadata helped, but now archived inbox is unsubscribed. Is > there a way to make all folders in an namespace subscribed by default > ? Nope. I could try to get the snapshots fixed at some point when I have more time, but I'm not going to add a feature to subscribe everything by default. People might try to start using it. From tss at iki.fi Sun Aug 19 18:43:47 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 18:43:47 +0300 Subject: [Dovecot] dovecot 2.1 Master account Error In-Reply-To: <1345123672440-37109.post@n4.nabble.com> References: <1345123672440-37109.post@n4.nabble.com> Message-ID: <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> On 16.8.2012, at 16.27, tmihalicek wrote: > I am running parallel dovecot 1.2 for main accounts and 2.1 for test > accounts, and for some reason when i try to login with master user on > dovecot 2.1 service errors. http://wiki2.dovecot.org/Authentication/MasterUsers#ACLs From andre.rodier at gmail.com Sun Aug 19 19:03:39 2012 From: andre.rodier at gmail.com (Andre Rodier) Date: Sun, 19 Aug 2012 17:03:39 +0100 Subject: [Dovecot] case insensitive acl Message-ID: <50310E5B.9010908@gmail.com> Hello, I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. Because I use LDAP, the name of the users is case insensitive. Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? This would be useful with some ACL managers, like roundcube ACL plugin, that uses an LDAP query to autocomplete the user name for the ACL. Kind regards, Andr? From tss at iki.fi Sun Aug 19 19:25:22 2012 From: tss at iki.fi (Timo Sirainen) Date: Sun, 19 Aug 2012 19:25:22 +0300 Subject: [Dovecot] case insensitive acl In-Reply-To: <50310E5B.9010908@gmail.com> References: <50310E5B.9010908@gmail.com> Message-ID: <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> On 19.8.2012, at 19.03, Andre Rodier wrote: > I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. > > Because I use LDAP, the name of the users is case insensitive. Translate the username to lowercase. It's the default nowadays: auth_username_format = %Lu > Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? No. From andre.rodier at gmail.com Sun Aug 19 19:51:41 2012 From: andre.rodier at gmail.com (Andre Rodier) Date: Sun, 19 Aug 2012 17:51:41 +0100 Subject: [Dovecot] case insensitive acl In-Reply-To: <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> References: <50310E5B.9010908@gmail.com> <112107B7-168A-40AB-AAFE-E282043F1D11@iki.fi> Message-ID: <5031199D.9010809@gmail.com> On 19/08/12 17:25, Timo Sirainen wrote: > On 19.8.2012, at 19.03, Andre Rodier wrote: > >> I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. >> >> Because I use LDAP, the name of the users is case insensitive. > Translate the username to lowercase. It's the default nowadays: > > auth_username_format = %Lu > >> Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? > No. > Thanks, Timo. Thanks for your huge work on Dovecot. From maillist at endfertig.de Sun Aug 19 21:57:51 2012 From: maillist at endfertig.de (Mailing) Date: Sun, 19 Aug 2012 20:57:51 +0200 Subject: [Dovecot] Full text search in attachments In-Reply-To: <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> Message-ID: <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> Hi Timo, Am 19.08.2012 17:26, schrieb Timo Sirainen: > On 11.8.2012, at 5.28, Mailing wrote: > I updated the wiki with: > > * See the decode2text.sh script included in Dovecot for how to use > this. I want to send the complete attachments (unparsed) to solr server and let solr do the parsing work. Is it maybe possible to use a decode2text like script together with curl to send the attachments to the sold server? But in this case I would have to know additional informations in the script like message id and the mailbox name. Best regards, Sebastian From tss at iki.fi Mon Aug 20 08:16:02 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 08:16:02 +0300 Subject: [Dovecot] Full text search in attachments In-Reply-To: <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> References: <5c94df43d1892d24cbb1a7a1ce8b3cc2@xenoserver.net> <8F46133D-9E1A-41DB-B57C-C1EBB5A5EBE2@iki.fi> <657edacac3bc1e3b1fd6cf2f83acf856@xenoserver.net> Message-ID: On 19.8.2012, at 21.57, Mailing wrote: > Am 19.08.2012 17:26, schrieb Timo Sirainen: >> On 11.8.2012, at 5.28, Mailing wrote: >> I updated the wiki with: >> >> * See the decode2text.sh script included in Dovecot for how to use this. > > I want to send the complete attachments (unparsed) to solr server and let solr do the parsing work. Is it maybe possible to use a decode2text like script together with curl to send the attachments to the sold server? > > But in this case I would have to know additional informations in the script like message id and the mailbox name. It can't work like that, because all the text from one message (text & all attachments) has to go to one document. From dof at projektfabrik.com Mon Aug 20 12:14:43 2012 From: dof at projektfabrik.com (dof at projektfabrik.com) Date: Mon, 20 Aug 2012 11:14:43 +0200 Subject: [Dovecot] =?utf-8?q?SOLVED_antispam=5Fplugin_prevents_IMAP_login_?= =?utf-8?b?KGVycm9yIDMpIFtEb3ZlY290IDIuMC4xOV0=?= Message-ID: <02e97d2e165b7b33b947c615d71724b7@webmail.projektfabrik.com> On 17.08.2012 12:06, dof at projektfabrik.com wrote: > Hi everybody, > > trying to get the Dovecot antispam_plugin to work and I must be doing > something wrong, because as soon as it is enabled with a certain > backend, imap logins do not work anymore (the session is immediately > closed after a successful login). Interestingly, pipe and spool2dir > are working (that is, the session won't be closed), dspam-exec and > crm114-exec are not. If this happens, mail_debug output is as > follows: > > [...] Hi again, how embarrassing. I should use the correct name for the backend type. :\ So everything works as expected, sorry for spamming the mailing list. Best regards, Florian From amateo at um.es Mon Aug 20 11:33:55 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 10:33:55 +0200 Subject: [Dovecot] userdb multiple databases Message-ID: <5031F673.8040702@um.es> Hello, I'm trying to configure per user plugins. My original passdb and userdb is in a ldap directory (using userdb with prefetch). To configure per user plugins (in fact, I want to enable quota plugin for some users) I need to configure mail_plugins attribute in the userdb. The problem is that I don't know any ldap attribute to store this information (is there any schema with includes an attribute for this). So I want to configure it in a passwd-file file. My problem is that I don't know if I can chain userdb databases. I know I can configure multiple databases, but as far as I know, they are looked in order, so if the user is found in the first one, then is no look for the user in the second one, so I have to configure all user's attributes in the passwd-file database. Is there any way to chain these lookups? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 11:38:26 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 10:38:26 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 Message-ID: <5031F782.9010802@um.es> Hello, I am configuring quota plugin per user, not for the whole system. As documentation says (http://wiki2.dovecot.org/Quota), I have to add "quota" to the global mail_plugins and "imap_quota" to mail_plugins for protocol imap, but I don't know how to configure this in a userdb. I'm using a passwd-file in the way: :{plain}password::::::userdb_mail_plugins=quota,imap_quota but this activate both plugins in the global mail_plugins option. The problem with this is that if the user tries to connect via pop3 instead of imap (a thing that I permit, although the user shouldn't do it) I have the error: Aug 20 10:04:18 myotis30 dovecot: pop3: Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline is there any way to solve this problem? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 13:56:48 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 12:56:48 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <5031F782.9010802@um.es> References: <5031F782.9010802@um.es> Message-ID: <503217F0.3090609@um.es> Hi again, Another problem I'm having with this is that quota (maildirsize) is not updated when mail is delivered. According to http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be sure that dovecot-lda is run with -d option, but in my configuration I'm receiving mail via lmtp and (I think) dovecot-lda is not running at all. So the problem (I think) is that quota plugin is not used in the lmtp process. Is there any way to configure that lmtp processes use the mail_plugins in the userdb database? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From amateo at um.es Mon Aug 20 14:07:57 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 20 Aug 2012 13:07:57 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <503217F0.3090609@um.es> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> Message-ID: <50321A8D.5000702@um.es> El 20/08/12 12:56, Angel L. Mateo escribi?: > Hi again, > > Another problem I'm having with this is that quota (maildirsize) is > not updated when mail is delivered. > > According to > http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be > sure that dovecot-lda is run with -d option, but in my configuration I'm > receiving mail via lmtp and (I think) dovecot-lda is not running at all. > > So the problem (I think) is that quota plugin is not used in the > lmtp process. Is there any way to configure that lmtp processes use the > mail_plugins in the userdb database? > I forgot to attach doveconf -n -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.4.0-030400-generic x86_64 Ubuntu 12.04 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_verbose = yes default_process_limit = 1000 disable_plaintext_auth = no log_timestamp = %Y-%m-%d %H:%M:%S login_trusted_networks = 155.54.211.176/28 mail_debug = yes mail_fsync = always mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_nfs_storage = yes mail_privileged_group = mail maildir_stat_dirs = yes mdbox_rotate_size = 20 M passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = session=yes dovecot driver = pam } plugin { lazy_expunge = .EXPUNGED/ .DELETED/ .DELETED/.EXPUNGED/ quota = maildir:User quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at um.es service anvil { client_limit = 2003 } service auth { client_limit = 3000 unix_listener auth-userdb { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap { process_limit = 5120 process_min_avail = 2 vsz_limit = 512 M } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3 { process_min_avail = 2 } ssl = no ssl_cert = References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> Message-ID: <503223EE.3030801@um.es> El 20/08/12 12:56, Angel L. Mateo escribi?: > Hi again, > > Another problem I'm having with this is that quota (maildirsize) is > not updated when mail is delivered. > > According to > http://wiki2.dovecot.org/Quota/Configuration#Per-user_quota I must be > sure that dovecot-lda is run with -d option, but in my configuration I'm > receiving mail via lmtp and (I think) dovecot-lda is not running at all. > > So the problem (I think) is that quota plugin is not used in the > lmtp process. Is there any way to configure that lmtp processes use the > mail_plugins in the userdb database? > I have discovered the origin of my problem, but not the solution. The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. Any idea? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From Jost.Krieger+dovecot at rub.de Mon Aug 20 16:06:18 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 20 Aug 2012 15:06:18 +0200 Subject: [Dovecot] Is it possible to save only some messages compressed to mdbox? (2.1.6) Message-ID: <20120820130617.GT24203@ruhr-uni-bochum.de> I'm trying to save some messages as compressed (via zlib plugin) and it doesn't seem to work. Here's a log line (I'm logging to stderr): d k 1345467448.705591500 1345467448.705596500 1345467448.974808500 1650 local.jost.krieger+hirn at ruhr-uni-bochum.de 10909 80 Extra: -o plugin/zlib_save_level=9 -o plugin/zlib_save=bz2 lda(kriegjcb): Info: msgid=<20120820125728.58CC9172B6C at c2-4-7.noc.ruhr-uni-bochum.de>: saved mail to Hirn-2012-08 did 0+0+1 This probably doesn't make much sense to anyone except the last line but 1. It is a somewhat complicated qmail/maildrop/dovecot setup, which works for the standard cases. The Extra gets interpolated into the lda command and this works because an incorrect option blows up the delivery. The mails arrive uncompressed. So here's the questions: 1. Is it possible to have compressed/uncompressed mails mixed in an mdbox? 2. Will it work via "-o" in lda delivery? I tried to find out in the source but found it hard to see which options are pulled in when. Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From andre.groebe at fun.de Mon Aug 20 16:35:55 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Mon, 20 Aug 2012 15:35:55 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <50323D3B.1030701@fun.de> Hi it seems to me, that it depends on how dovecot handles line reading. Dovecot presumes that a line is of max length of IO_BLOCK_SIZE (=8192) Bytes. Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? Regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From acrow at integrafin.co.uk Mon Aug 20 18:21:30 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Mon, 20 Aug 2012 16:21:30 +0100 Subject: [Dovecot] Variables in LDAP userdb Message-ID: <503255FA.9080300@integrafin.co.uk> Hi Timo, Is it OK to have dovecot variables in entries in an LDAP userdb? Say I wanted to set the mail userdb parameter to override mail_location, would it work by having an entry in LDAP (eg for mailMessageStore attrib) like: mdbox:/home/email/%d/%n:INDEX=/home/indexes/%d/%1n/%n:ALT=/home/email_archive/%d/%1n/%n and those % variables will still be expanded by dovecot? Or would I be required to replace them in the LDAP directory with their actual values? Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From merrickville at gmail.com Mon Aug 20 19:22:59 2012 From: merrickville at gmail.com (Merrickville) Date: Mon, 20 Aug 2012 09:22:59 -0700 (PDT) Subject: [Dovecot] Hostname Based forwarding In-Reply-To: References: <1345132919122-37110.post@n4.nabble.com> Message-ID: <1345479779161-37150.post@n4.nabble.com> Thanks for the info. That unfortunately does not make it as flexible as name based hosting, too bad. -- View this message in context: http://dovecot.2317879.n4.nabble.com/Hostname-Based-forwarding-tp37110p37150.html Sent from the Dovecot mailing list archive at Nabble.com. From tss at iki.fi Mon Aug 20 21:22:58 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 21:22:58 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50323D3B.1030701@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> Message-ID: On 20.8.2012, at 16.35, Andre Gr?be wrote: > it seems to me, that it depends on how dovecot handles line reading. Dovecot presumes that a line is of max length of IO_BLOCK_SIZE (=8192) Bytes. > > Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE with (size_t)-1. From tss at iki.fi Mon Aug 20 21:25:24 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 20 Aug 2012 21:25:24 +0300 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: <503255FA.9080300@integrafin.co.uk> References: <503255FA.9080300@integrafin.co.uk> Message-ID: On 20.8.2012, at 18.21, Alex Crow wrote: > Is it OK to have dovecot variables in entries in an LDAP userdb? Say I wanted to set the mail userdb parameter to override mail_location, would it work by having an entry in LDAP (eg for mailMessageStore attrib) like: > > mdbox:/home/email/%d/%n:INDEX=/home/indexes/%d/%1n/%n:ALT=/home/email_archive/%d/%1n/%n > > and those % variables will still be expanded by dovecot? No. Otherwise it would break paths that actually contain % characters. > Or would I be required to replace them in the LDAP directory with their actual values? Yes. If you really wanted to avoid that and you have only a few different values, you could create some namespaces in dovecot.conf and enable/disable them as needed in the ldap fields. Although I guess that's not a whole lot better since there's currently no simple "enabled" setting for namespaces, maybe I should add one.. From tomislav.mihalicek at gmail.com Mon Aug 20 21:39:03 2012 From: tomislav.mihalicek at gmail.com (tmihalicek) Date: Mon, 20 Aug 2012 11:39:03 -0700 (PDT) Subject: [Dovecot] dovecot 2.1 Master account Error In-Reply-To: <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> References: <1345123672440-37109.post@n4.nabble.com> <07D4B97C-2664-44AB-8B9B-B55EAC34DB34@iki.fi> Message-ID: <1345487943866-37153.post@n4.nabble.com> Thanks Timo, after i read the ACL stuff i have another question. I would like to use a third solution which is assigning master_user=%u in userdb lookup. Should i use? userdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf.ext # Default fields can be used to specify defaults that LDAP may override default_fields = uid=vmail gid=vmail allow_all_users=yes master_user=%u } -- View this message in context: http://dovecot.2317879.n4.nabble.com/dovecot-2-1-Master-account-Error-tp37109p37153.html Sent from the Dovecot mailing list archive at Nabble.com. From kavish.karkera at yahoo.com Tue Aug 21 08:42:39 2012 From: kavish.karkera at yahoo.com (Kavish Karkera) Date: Tue, 21 Aug 2012 13:42:39 +0800 (SGT) Subject: [Dovecot] Error: Couldn't open INBOX: Timeout while waiting for lock Message-ID: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> Hi , My users are frequetly getting the below error, Aug 21 00:04:18 blade6 dovecot: pop3-login: proxy(hgl_dipak): Login failed to 192.168.1.43:110: [IN-USE] Couldn't open INBOX: Timeout while waiting for lock. We are proxing pop connections from one pop server (dovecot version 1.1.20) i.e 192.168.1.39 to the other pop Server (Dovecot version 2.0.16 ) i.e 192.168.1.4. We have set? pop3_lock_session = yes and dont want to disable it. Please Help !! :) K.K From acrow at integrafin.co.uk Tue Aug 21 11:44:34 2012 From: acrow at integrafin.co.uk (Alex Crow) Date: Tue, 21 Aug 2012 09:44:34 +0100 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: References: <503255FA.9080300@integrafin.co.uk> Message-ID: <50334A72.2020908@integrafin.co.uk> Timo, Thanks, I scripted replacing the correct entries in LDAP. To clarify, what happens in these case with regard to the default mail_location set in the config files (ie is it used or overridden): 1. The LDAP attribute referenced in the userdb lookup exists but is empty 2. The LDAP attribute is not present for the user. Cheers Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856) From andre.groebe at fun.de Tue Aug 21 13:10:17 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 21 Aug 2012 12:10:17 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> Message-ID: <50335E89.9010104@fun.de> Hi Timo, thx for reply. [tss at iki.fi; Mo 20 Aug 2012 20:22:58 CEST] >> Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? > > Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE > with (size_t)-1. Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. Best regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Tue Aug 21 13:22:04 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 21 Aug 2012 13:22:04 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50335E89.9010104@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> Message-ID: On 21.8.2012, at 13.10, Andre Gr?be wrote: > [tss at iki.fi; Mo 20 Aug 2012 20:22:58 CEST] >>> Is there a fix so dovecot reads a line until EOL or EOF (if this is the real reason)? >> >> Without having actually looked at the code, I'd guess you can just replace IO_BLOCK_SIZE > > with (size_t)-1. > > Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. Does the attached patch fix it? (not a very good fix) -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 449 bytes Desc: not available URL: From andre.groebe at fun.de Tue Aug 21 14:16:17 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Tue, 21 Aug 2012 13:16:17 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> Message-ID: <50336E01.6000909@fun.de> Hi Timo, [tss at iki.fi; Di 21 Aug 2012 12:22:04 CEST] >> Unfortunatly this can't be a fix because in file_set_size() dovecot defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the default block size is predestined for file ops. > > Does the attached patch fix it? (not a very good fix) No, it doesn't. Still got no response on large metadata and writing destroys the dictionary. Best Regards Andre -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4910 bytes Desc: S/MIME Cryptographic Signature URL: From lazy404 at gmail.com Tue Aug 21 14:22:02 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 13:22:02 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: 2012/8/19, Timo Sirainen : > On 16.8.2012, at 14.58, Lazy wrote: > >> 2012/5/19 Timo Sirainen : >>> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>>> failed: Read-only file system >>> >>> Does the attached patch help? >>> >>>> maybe it will be easier to move all dovecot metadata to separate (non >>>> snapshot) location ? >>> >>> It could also be a bit problematic. At least message keywords (=custom >>> flags) wouldn't work because the dovecot-keywords file exists only in >>> the snapshot dir. >> >> Moving metadata helped, but now archived inbox is unsubscribed. Is >> there a way to make all folders in an namespace subscribed by default >> ? > > Nope. I could try to get the snapshots fixed at some point when I have more > time, but I'm not going to add a feature to subscribe everything by default. > People might try to start using it. If I enable per snapshot subscriptions i see all folders except INBOX, i have tried to subscribe it using mailbox_list_subscription_fill_one() or using imap as bellow without success http://dovecot.org/list/dovecot/2007-October/025965.html suggest that it isn't possible ./imap/.libs/imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as root a subscribe "test" a OK Subscribe completed. a lsub "" "*" imap(root): Warning: Subscriptions file /root/Maildir/subscriptions: Removing invalid entry: * LSUB () "." "Drafts" * LSUB () "." "Sent" * LSUB () "." "Junk" * LSUB () "." "Trash" * LSUB () "." "Deleted Messages" * LSUB () "." "test.Drafts" * LSUB () "." "test.Sent" * LSUB () "." "test.Junk" * LSUB () "." "test.Trash" * LSUB () "." "test.Deleted Messages" a OK Lsub completed. b list "" "*" * LIST (\HasNoChildren) "." "DUpa" * LIST (\HasNoChildren) "." "Deleted Messages" * LIST (\HasNoChildren) "." "Junk" * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "Sent" * LIST (\HasNoChildren) "." "Drafts" * LIST (\HasNoChildren) "." "INBOX" * LIST (\HasChildren) "." "test" * LIST (\HasNoChildren) "." "test.TEst" * LIST (\HasNoChildren) "." "test.Deleted Messages" * LIST (\HasNoChildren) "." "test.Junk" * LIST (\HasNoChildren) "." "test.Trash" * LIST (\HasNoChildren) "." "test.Sent" * LIST (\HasNoChildren) "." "test.Drafts" b OK List completed. From lazy404 at gmail.com Tue Aug 21 15:36:15 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 14:36:15 +0200 Subject: [Dovecot] segfault in mail_user_get_home() Message-ID: gdb ./src/imap/.libs/imap Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. (gdb) run Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7ffff7ffa000 [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". process 1104 is executing new program: /usr/local/dovecot/bin/doveconf [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". process 1104 is executing new program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Program received signal SIGSEGV, Segmentation fault. 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, home_r=0x7fffffffe308) at mail-user.c:310 310 if (user->home_looked_up) { (gdb) bt #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, home_r=0x7fffffffe308) at mail-user.c:310 #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at mdbox-storage.c:90 #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, set=0x7fffffffe4d0) at mdbox-storage.c:113 #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, set=0x7fffffffe4d0) at mail-storage.c:105 #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:180 #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, ns_p=0x645380, error_r=0x7fffffffe6e8) at mail-namespace.c:126 #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, error_r=0x7fffffffe6e8) at mail-namespace.c:289 #8 0x00007ffff7b34a64 in mail_storage_service_init_post (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, mail_user_r=0x7fffffffe7b8, error_r=0x7fffffffe6e8) at mail-storage-service.c:641 #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, user=0x633e08, mail_user_r=0x7fffffffe7b8) at mail-storage-service.c:1114 #10 0x00007ffff7b35efa in mail_storage_service_lookup_next (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, mail_user_r=0x7fffffffe7b8, error_r=0x7fffffffe808) at mail-storage-service.c:1149 #11 0x000000000041f61c in client_create_from_input (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, input_buf=0x0, error_r=0x7fffffffe808) at main.c:202 #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 /usr/local/dovecot/bin/doveconf -n # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.32 x86_64 Debian wheezy/sid namespace test { list = children location = maildir:/root/test prefix = test. subscriptions = yes type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = subscriptions = yes } passdb { driver = pam } ssl = no userdb { driver = passwd } without type = shared there is no segfault, I understand this config might not work (invoking imap directly) but it should't segfault. Regards, Michal Grzedzicki From lazy404 at gmail.com Tue Aug 21 15:45:07 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 14:45:07 +0200 Subject: [Dovecot] segfault in mail_user_get_home() In-Reply-To: References: Message-ID: it was shared namespace with empty location that produced the error so : namespace test { list = children location = prefix = test. subscriptions = yes type = shared } segfaults with location is fine 2012/8/21, Lazy : > gdb ./src/imap/.libs/imap > > Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. > (gdb) run > Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap > warning: no loadable sections found in added symbol-file > system-supplied DSO at 0x7ffff7ffa000 > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > process 1104 is executing new program: /usr/local/dovecot/bin/doveconf > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > process 1104 is executing new program: > /usr/src/dovecot-2.1.9/src/imap/.libs/imap > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". > > Program received signal SIGSEGV, Segmentation fault. > 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, > home_r=0x7fffffffe308) at mail-user.c:310 > 310 if (user->home_looked_up) { > (gdb) bt > #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, > home_r=0x7fffffffe308) at mail-user.c:310 > #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at > mdbox-storage.c:90 > #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, > set=0x7fffffffe4d0) at mdbox-storage.c:113 > #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, > set=0x7fffffffe4d0) at mail-storage.c:105 > #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, > driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) > at mail-storage.c:180 > #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, > driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 > #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, > ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, > ns_p=0x645380, > error_r=0x7fffffffe6e8) at mail-namespace.c:126 > #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, > error_r=0x7fffffffe6e8) at mail-namespace.c:289 > #8 0x00007ffff7b34a64 in mail_storage_service_init_post > (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, > mail_user_r=0x7fffffffe7b8, > error_r=0x7fffffffe6e8) at mail-storage-service.c:641 > #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, > user=0x633e08, mail_user_r=0x7fffffffe7b8) at > mail-storage-service.c:1114 > #10 0x00007ffff7b35efa in mail_storage_service_lookup_next > (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, > mail_user_r=0x7fffffffe7b8, > error_r=0x7fffffffe808) at mail-storage-service.c:1149 > #11 0x000000000041f61c in client_create_from_input > (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, > input_buf=0x0, > error_r=0x7fffffffe808) at main.c:202 > #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 > #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 > > /usr/local/dovecot/bin/doveconf -n > # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf > # OS: Linux 2.6.32 x86_64 Debian wheezy/sid > namespace test { > list = children > location = maildir:/root/test > prefix = test. > subscriptions = yes > type = shared > } > namespace inbox { > inbox = yes > list = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > subscriptions = yes > } > passdb { > driver = pam > } > ssl = no > userdb { > driver = passwd > } > > without type = shared there is no segfault, > > I understand this config might not work (invoking imap directly) but > it should't segfault. > > Regards, > > Michal Grzedzicki > From chris.visser at rtt.co.za Tue Aug 21 15:47:42 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 21 Aug 2012 12:47:42 +0000 Subject: [Dovecot] Spaces in DN with AD auth Message-ID: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> Hi guys, I'm back to fiddling with my Dovecot and AD intergation and I've noticed that if a DN contains spaces, dovecot doesn't bind to the AD server. I'm running: dovecot-2.1.1 exim-4.72 on CentOS 6.3 Exim binds fine with the DNs containing spaces, it's just dovecot that exhibits the symptoms. Chris Visser Linux/Network Infrastructure? ================== Please read our Email Disclaimer : http://www.rtt.co.za/disclaimer.html From me at junc.org Tue Aug 21 15:52:31 2012 From: me at junc.org (Benny Pedersen) Date: Tue, 21 Aug 2012 14:52:31 +0200 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> Message-ID: <05ae0f05a73de2768e0afa089c28ccdf@junc.org> Den 2012-08-21 14:47, Chris Visser skrev: > I'm back to fiddling with my Dovecot and AD intergation and I've > noticed that if a DN contains spaces, dovecot doesn't bind to the AD > server. that means you like to fix this in dovecot since its not AD that make the error in first place ? From chris.visser at rtt.co.za Tue Aug 21 15:59:58 2012 From: chris.visser at rtt.co.za (Chris Visser) Date: Tue, 21 Aug 2012 12:59:58 +0000 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <05ae0f05a73de2768e0afa089c28ccdf@junc.org> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> Message-ID: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Yes. Is it possible? If I try bind with a dn like: CN=Chris Visser,OU=Users,DC=mydomain,DC=com then I can't make the bind to AD, even though I can do it using exim and ldapsearch. Dovecot however binds if I use a dn like: CN=Chris,OU=Users,DC=mydomain,DC=com Chris Visser Linux/Network Infrastructure? -----Original Message----- From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Benny Pedersen Sent: Tuesday, August 21, 2012 2:53 PM To: dovecot at dovecot.org Subject: Re: [Dovecot] Spaces in DN with AD auth Den 2012-08-21 14:47, Chris Visser skrev: > I'm back to fiddling with my Dovecot and AD intergation and I've > noticed that if a DN contains spaces, dovecot doesn't bind to the AD > server. that means you like to fix this in dovecot since its not AD that make the error in first place ? ================== Please read our Email Disclaimer : http://www.rtt.co.za/disclaimer.html From me at junc.org Tue Aug 21 16:15:17 2012 From: me at junc.org (Benny Pedersen) Date: Tue, 21 Aug 2012 15:15:17 +0200 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Message-ID: <7b11ec35394fe151755e6d7b1b42452c@junc.org> Den 2012-08-21 14:59, Chris Visser skrev: > Dovecot however binds if I use a dn like: > CN=Chris,OU=Users,DC=mydomain,DC=com why not use it so ? From lazy404 at gmail.com Tue Aug 21 16:28:08 2012 From: lazy404 at gmail.com (Lazy) Date: Tue, 21 Aug 2012 15:28:08 +0200 Subject: [Dovecot] namespace from snapshots In-Reply-To: References: <4FAD2350.905@ibl.fr> <1337011476.4384.42.camel@innu> <1337453839.4384.141.camel@innu> Message-ID: I managed to get it working using a litle change in sources an extra mailbox_list_subscription_fill_one(dest_list, src_list, "" ); in src/lib-storage/list/mailbox-list-subscriptions.c:mailbox_list_subscriptions_refresh() --- src/lib-storage/list/mailbox-list-subscriptions.c (wersja 494) +++ src/lib-storage/list/mailbox-list-subscriptions.c (kopia robocza) @@ -142,6 +142,9 @@ subsfile_ctx = subsfile_list_init(dest_list, path); if (subsfile_list_fstat(subsfile_ctx, &st) == 0) dest_list->subscriptions_mtime = st.st_mtime; + + mailbox_list_subscription_fill_one(dest_list, src_list, "" ); + while ((name = subsfile_list_next(subsfile_ctx)) != NULL) T_BEGIN { T_BEGIN { ret = mailbox_list_subscription_fill_one(dest_list, now lsub works as expected, namespace root which is an INBOX from a snapshot is subscribed, all the subfolders are also subscribed (from original subscriptions file). It whould be great if one could specify in the namespace mailboxes that whould get autosubscribed or just to autosubscribe root whitch is what You need if You have a copy of Maildir with INBOX. If You think this can be usefull I will try to produce more general patch automagicly subscribing root or any other mailbox in an namespace. Regards, Michal Grzedzicki 2012/8/21, Lazy : > 2012/8/19, Timo Sirainen : >> On 16.8.2012, at 14.58, Lazy wrote: >> >>> 2012/5/19 Timo Sirainen : >>>> On Wed, 2012-05-16 at 12:39 +0200, Lazy wrote: >>>>> May 16 12:11:36 thebe2 dovecot: imap(lazy): Error: >>>>> open(/snapshot/h1/vmail/la/lazy/Maildir/.SPAM/dovecot-uidlist.lock) >>>>> failed: Read-only file system >>>> >>>> Does the attached patch help? >>>> >>>>> maybe it will be easier to move all dovecot metadata to separate (non >>>>> snapshot) location ? >>>> >>>> It could also be a bit problematic. At least message keywords (=custom >>>> flags) wouldn't work because the dovecot-keywords file exists only in >>>> the snapshot dir. >>> >>> Moving metadata helped, but now archived inbox is unsubscribed. Is >>> there a way to make all folders in an namespace subscribed by default >>> ? >> >> Nope. I could try to get the snapshots fixed at some point when I have >> more >> time, but I'm not going to add a feature to subscribe everything by >> default. >> People might try to start using it. > > If I enable per snapshot subscriptions i see all folders except INBOX, > i have tried to subscribe it using > mailbox_list_subscription_fill_one() or using imap as bellow without > success > > http://dovecot.org/list/dovecot/2007-October/025965.html suggest that > it isn't possible > > ./imap/.libs/imap > * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID > ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS > MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED > I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in as root > a subscribe "test" > a OK Subscribe completed. > a lsub "" "*" > imap(root): Warning: Subscriptions file /root/Maildir/subscriptions: > Removing invalid entry: > * LSUB () "." "Drafts" > * LSUB () "." "Sent" > * LSUB () "." "Junk" > * LSUB () "." "Trash" > * LSUB () "." "Deleted Messages" > * LSUB () "." "test.Drafts" > * LSUB () "." "test.Sent" > * LSUB () "." "test.Junk" > * LSUB () "." "test.Trash" > * LSUB () "." "test.Deleted Messages" > a OK Lsub completed. > b list "" "*" > * LIST (\HasNoChildren) "." "DUpa" > * LIST (\HasNoChildren) "." "Deleted Messages" > * LIST (\HasNoChildren) "." "Junk" > * LIST (\HasNoChildren) "." "Trash" > * LIST (\HasNoChildren) "." "Sent" > * LIST (\HasNoChildren) "." "Drafts" > * LIST (\HasNoChildren) "." "INBOX" > * LIST (\HasChildren) "." "test" > * LIST (\HasNoChildren) "." "test.TEst" > * LIST (\HasNoChildren) "." "test.Deleted Messages" > * LIST (\HasNoChildren) "." "test.Junk" > * LIST (\HasNoChildren) "." "test.Trash" > * LIST (\HasNoChildren) "." "test.Sent" > * LIST (\HasNoChildren) "." "test.Drafts" > b OK List completed. > From tss at iki.fi Tue Aug 21 17:37:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 21 Aug 2012 17:37:37 +0300 Subject: [Dovecot] Spaces in DN with AD auth In-Reply-To: <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> References: <1B5F61B24A54E54397345A133BD0A48D07DA256C@RTTGMBX02.thefuelgroup.com> <05ae0f05a73de2768e0afa089c28ccdf@junc.org> <1B5F61B24A54E54397345A133BD0A48D07DA35CF@RTTGMBX02.thefuelgroup.com> Message-ID: On 21.8.2012, at 15.59, Chris Visser wrote: > Yes. Is it possible? > > If I try bind with a dn like: CN=Chris Visser,OU=Users,DC=mydomain,DC=com > then I can't make the bind to AD, even though I can do it using exim and ldapsearch. > > Dovecot however binds if I use a dn like: CN=Chris,OU=Users,DC=mydomain,DC=com Maybe the problem is simply that space isn't in auth_username_chars? If not, show doveconf -n, dovecot-ldap.conf and log output when auth_debug_passwords=yes (with a test user/pass). From slusarz at curecanti.org Tue Aug 21 20:31:46 2012 From: slusarz at curecanti.org (Michael M Slusarz) Date: Tue, 21 Aug 2012 11:31:46 -0600 Subject: [Dovecot] Search extensions In-Reply-To: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> References: <886BC21C-3BD8-4C64-8C50-2301205A30C3@iki.fi> Message-ID: <20120821113146.Horde.yqEaGoF5lbhQM8YCyLWQ2pA@bigworm.curecanti.org> Quoting Timo Sirainen : > The client can verify the results with the fetch. The "x-anyheader" > can already be implemented without changes to full text search > plugin, because all backends store message/MIME headers and body > text separately. > > So, questions for the list, especially client developers: > > 1) What's a better name for x-anyheader? :) Maybe X-ALLHEADERS? X-ANYHEADER seems ok also. Either one, if properly documented, would be easy enough to implement (I know that I personally never implement any IMAP command without staring at the RFCs so if you wanted to name it X-FUZZYWUZZY, that would also be fine). > I think one other thing missing has been "show me messages that have > attachments". I've thought about maybe creating a $hasattachments > keyword for that, which the server could automatically set for new > mails that it thinks has attachments (and clients can set/unset the > keyword if wanted). I think you are entering a *very* slippery slope when it comes to this feature. Because I believe that determination of what is an "attachment" is necessarily a client (read: UI) question, not a server question. See, e.g.: http://markmail.org/message/q4mjgbcxks5j4ue6 michael From zinovik.igor at gmail.com Tue Aug 21 20:51:18 2012 From: zinovik.igor at gmail.com (Igor Zinovik) Date: Tue, 21 Aug 2012 21:51:18 +0400 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section Message-ID: <5033CA96.3080305@gmail.com> Hello. I read on upgrading page that one can use UTF8 mailbox names for plugins. As i understand i do not need to convert UTF8 names to mUTF-7 and can use raw UTF8 in plugins section, e.g.: /etc/dovecot/dovecot.conf ... plugin { ... # Autocreate \Spam folder autocreate = ???? autosubscribe = ???? ... But what about sieve scripts and other configuration sections: 1. Do i need to convert UTF8 mailbox names in `namespace' section? namespace inbox { ... mailbox &BCEEPwQwBDw- { special_use = \Junk } 2. Do i need to convert UTF8 mailbox names in sieve scripts? /etc/dovecot/dovecot_before.sieve ... require ["reject","fileinto"]; # Put all spam into separete IMAP folder if header :contains "X-Spam-Flag" "YES" { fileinto "&BCEEPwQwBDw-"; } From stephan at rename-it.nl Tue Aug 21 22:10:03 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 21 Aug 2012 21:10:03 +0200 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section In-Reply-To: <5033CA96.3080305@gmail.com> References: <5033CA96.3080305@gmail.com> Message-ID: <5033DD0B.90602@rename-it.nl> On 8/21/2012 7:51 PM, Igor Zinovik wrote: > 2. Do i need to convert UTF8 mailbox names in sieve scripts? > /etc/dovecot/dovecot_before.sieve > > require ["reject","fileinto"]; > > # Put all spam into separete IMAP folder > if header :contains "X-Spam-Flag" "YES" { > fileinto "&BCEEPwQwBDw-"; > } The Sieve language only accepts UTF-8, making the above example wrong. That is also what Pigeonhole Sieve requires. The much older cmusieve plugin did use mUTF7, but I'm hoping that very few people are still using that. Regards, Stephan From leamhall at gmail.com Tue Aug 21 22:16:31 2012 From: leamhall at gmail.com (leam hall) Date: Tue, 21 Aug 2012 15:16:31 -0400 Subject: [Dovecot] Ways to poke and prod Dovecot? Message-ID: I'm a newbie and want to learn more about Dovecot. I can install it in a test bed but am not sure how to run it so it shows me what it's doing but i'm not actually mailing stuff. Is there a doc somewhere? Thanks! Leam -- Mind on a Mission From tlx at leuxner.net Tue Aug 21 22:20:12 2012 From: tlx at leuxner.net (Thomas Leuxner) Date: Tue, 21 Aug 2012 21:20:12 +0200 Subject: [Dovecot] Ways to poke and prod Dovecot? In-Reply-To: References: Message-ID: m 21.08.2012 um 21:16 schrieb leam hall : > I'm a newbie and want to learn more about Dovecot. I can install it in a > test bed but am not sure how to run it so it shows me what it's doing but > i'm not actually mailing stuff. Is there a doc somewhere? The Wiki is a good starting point listing several typical configurations: http://wiki2.dovecot.org/HowTo Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4364 bytes Desc: not available URL: From svoop at delirium.ch Tue Aug 21 22:38:48 2012 From: svoop at delirium.ch (Sven Schwyn) Date: Tue, 21 Aug 2012 21:38:48 +0200 Subject: [Dovecot] blf-crypt Message-ID: Hi The blf-crypt password schema mentioned in the docs could be a solution to my auth problem. However, the docs state that actual support depends on the glibc. Mine apparently doesn't. Does support depend on the glibc's version (mine is 2.15-r2)? Maybe someone with access to a box with a good enough glibc could do the following and post the hash for the plain password "test"? doveadm pw -s BLF-CRYPT Enter new password: test With this I could verify whether the BLF-CRYPT scheme would solve my problem in the first place without going through the hassle of upping the glibc. Thanks a bunch! From zucca at systemschmiede.com Wed Aug 22 02:44:00 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 22 Aug 2012 01:44:00 +0200 Subject: [Dovecot] Imap Ghost folder Message-ID: <50341D40.9090001@systemschmiede.com> Hi list, i have a strange "ghost" folder in my subscription list and just can't find out how to get rid of it. It seems to be someones Inbox, but it doesn't tell me whose. Here's a screenshot of Open-Xchanges Web-GUI: /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg / As you can see there is an unamed folder just under Freigaben (Shares). In Thunderbird: /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ Now the Folder is "INBOX"...But it is noones Inbox, as the corresponding user (amazon e.g.) should be a prefix-folder right before the share. some output over Telnet: 1 lsub "" "*" * LSUB () "/" "INBOX" * LSUB () "/" "INBOX/Amazon" * LSUB () "/" "INBOX/Bestellung" * LSUB () "/" "Drafts" * LSUB () "/" "Sent Items" * LSUB () "/" "Spam" * LSUB () "/" "Trash" * LSUB () "/" "Freigaben/amazon/INBOX" 1 OK Lsub completed. 1 list "" "*" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Sent Items" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasNoChildren) "/" "INBOX/Amazon" * LIST (\HasNoChildren) "/" "INBOX/Bestellung" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Drafts" * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" 1 OK List completed. This looks a bit strange to me: * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" But i don't know really if that is the ghostfolder. finally here's the interesting part in my dovecot.conf: / namespace private { separator = / prefix = #location defaults to mail_location. inbox = yes } namespace shared { separator = / prefix = Freigaben/%%n/ location = maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ subscriptions = no list = children inbox = no } / Any idea how to banish the ghost in the machine? Thank you very much Sascha -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From amateo at um.es Wed Aug 22 11:01:08 2012 From: amateo at um.es (Angel L. Mateo) Date: Wed, 22 Aug 2012 10:01:08 +0200 Subject: [Dovecot] exclude a folder for lazy expunge (move to trash) Message-ID: <503491C4.7030208@um.es> Hello, I'm configuring lazy expunge plugin to act as a kind of backup of my user's emails. I'm getting a little problem because a lot of my users use "move to trash" behaviour in their email client (most of them are using thunderbird which has no option to hide deleted messages and is a hassle working with mark as deleted with it). The problem combining move to trash with lazy expunge is that messages are stored in the expunge namespace twice, first when it was deleted from the original folder and the second when is deleted from the trash. So... is there any way to exclude trash folder from lazy expunge plugin, so mails are stored in the expunge namespace only when they are deleted from their original folder and not from the trash? Another idea... We are purging trash folders with a cron running "doveadm purge" commands. Is there any way to run this command disabling lazy expunge plugin? Any other idea not to duplicate these emails? -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From tss at iki.fi Wed Aug 22 16:56:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 16:56:20 +0300 Subject: [Dovecot] [PATCH] Replace hard-coded PKG_STATEDIR with state_dir setting In-Reply-To: <20120813161251.GB14149@arachsys.com> References: <20120813161251.GB14149@arachsys.com> Message-ID: <1345643780.13571.33.camel@hurina> On Mon, 2012-08-13 at 17:12 +0100, Chris Webb wrote: > Sharing an installed copy of dovecot between several users each running > a daemon within their own account (or using the same binaries for a > system daemon and a user daemon) is difficult because the compile-time > directory PKG_STATEDIR (typically /var/lib/dovecot) is hard-coded as the > location of things like the ssl-parameters.dat file and the replicator > database. > > Replace all these uses of PKG_STATEDIR with a state_dir setting which > defaults to PKG_STATEDIR but can be overridden in dovecot.conf, in the > same way base_dir can be used to override PKG_RUNDIR. Committed to v2.2 with some changes: http://hg.dovecot.org/dovecot-2.2/rev/543852ebb327 From david at wordshell.net Wed Aug 22 09:56:04 2012 From: david at wordshell.net (David Anderson) Date: Wed, 22 Aug 2012 09:56:04 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users Message-ID: <50348284.8050609@wordshell.net> Self-explanatory, I hope (note the period on the end of the username); sieve/pigeonhole does not allow you to have senders which end with a period, which means that any UNIX users with such usernames who send mail have it rejected by sieve: # useradd testuser. # su - testuser. $ mail david at example.com -s 'testing' 123 . [testuser. at levi ~]$ logout # less /var/log/maillog Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: envelope sender address 'testuser. at myhost.example.com' is unparsable Versions: dovecot-pigeonhole-0.2.6-21.el5 dovecot-managesieve-0.2.6-21.el5 dovecot-2.0.18-1_134.el5 Why would anyone have a UNIX username ending in a period? For one, web hosting companies may use your domain name as your username - but be subject to a 32-character limit, so your domain name gets truncated. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From tss at iki.fi Wed Aug 22 17:36:34 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 17:36:34 +0300 Subject: [Dovecot] How dovecot treats UTF8 mailbox names in sieve scripts and `namespace' section In-Reply-To: <5033CA96.3080305@gmail.com> References: <5033CA96.3080305@gmail.com> Message-ID: <1345646194.13571.34.camel@hurina> On Tue, 2012-08-21 at 21:51 +0400, Igor Zinovik wrote: > I read on upgrading page that one can use UTF8 mailbox names for > plugins. As i understand i do not need to convert UTF8 names to mUTF-7 > and can use raw UTF8 in plugins section, e.g.: > /etc/dovecot/dovecot.conf You couldn't need to use mUTF7 anywhere at all anymore. If you do, it's a bug. From lgb at lgb.hu Wed Aug 22 18:16:25 2012 From: lgb at lgb.hu (=?iso-8859-1?B?R+Fib3IgTOlu4XJ0?=) Date: Wed, 22 Aug 2012 17:16:25 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: <20120822151624.GC22547@vega.lgb.hu> Hi, On Wed, Aug 22, 2012 at 09:56:04AM +0300, David Anderson wrote: > Self-explanatory, I hope (note the period on the end of the > username); sieve/pigeonhole does not allow you to have senders which > end with a period, which means that any UNIX users with such > usernames who send mail have it rejected by sieve: > > # useradd testuser. > # su - testuser. > $ mail david at example.com -s 'testing' > 123 > . > [testuser. at levi ~]$ logout > > # less /var/log/maillog > > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: > envelope sender address 'testuser. at myhost.example.com' is unparsable Afaik local-part can't have period as the first or the last character by RFC ... But correct me if I am wrong. At least according to wikipedia: The local-part of the email address may use any of these ASCII characters RFC 5322 Section 3.2.3, RFC 6531 permits Unicode beyond the ASCII range: [...] Character . (dot, period, full stop) (ASCII: 46) provided that it is not the first or last character, and provided also that it does not appear two or more times consecutively (e.g. John..Doe at example.com is not allowed.). http://en.wikipedia.org/wiki/Email_address#Local_part I think nowdays it's a bit outdated to have 1:1 mapping between UNIX users and email addresses anyway. Maybe it's OK, but it's surely problematic in case of mass hosting with many users with policies like you mentioned as well. Virtual users (in the sense of MTA/IMAP/etc servers) are much better idea, in my oppinion. It's OK for a small "server" used for own purposes for example. But it's only my opinion ... From david at wordshell.net Wed Aug 22 18:45:17 2012 From: david at wordshell.net (David Anderson) Date: Wed, 22 Aug 2012 18:45:17 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <20120822151624.GC22547@vega.lgb.hu> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> Message-ID: <5034FE8D.2030704@wordshell.net> On 22/08/12 18:16, G?bor L?n?rt wrote: > I think nowdays it's a bit outdated to have 1:1 mapping between UNIX > users and email addresses anyway. Maybe it's OK, but it's surely > problematic in case of mass hosting with many users with policies like > you mentioned as well. Virtual users (in the sense of MTA/IMAP/etc > servers) are much better idea, in my oppinion. It's OK for a small > "server" used for own purposes for example. But it's only my opinion ... There are no incoming mail accounts for those users. The server in question is a webserver. Every website has a unique UNIX user, for security when running scripts. You can't virtualise that. If you run all your scripts under the same UNIX user on a shared server, then it's less secure. Sieve was complaining about the envelope *sender* address being invalid, on a piece of outgoing mail (generated by the website). It wasn't about incoming mail or maintaining accounts. That's a bit academic, though. It think the main points are that: * Many Unixes allow you to set up usernames ending in periods * The MTAs also allow you to send and receive mail using those periods Strictly according to the RFC, the address is invalid. But if the MTA accepts it, why should sieve reject it? Sieve is deployed to apply filters to mail - not to make policy decisions on valid email addresses. That's a layering violation. If my MTA accepts the mail,and then the dovecot LDA does too, I don't want sieve to over-turn the decision. It's not sieve's job to enforce that part of the RFC and over-rule the MTA and LDA. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From lgb at lgb.hu Wed Aug 22 19:20:55 2012 From: lgb at lgb.hu (=?iso-8859-1?B?R+Fib3IgTOlu4XJ0?=) Date: Wed, 22 Aug 2012 18:20:55 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <5034FE8D.2030704@wordshell.net> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> <5034FE8D.2030704@wordshell.net> Message-ID: <20120822162055.GD22547@vega.lgb.hu> On Wed, Aug 22, 2012 at 06:45:17PM +0300, David Anderson wrote: > There are no incoming mail accounts for those users. The server in > question is a webserver. Every website has a unique UNIX user, for > security when running scripts. You can't virtualise that. If you run > all your scripts under the same UNIX user on a shared server, then > it's less secure. > > Sieve was complaining about the envelope *sender* address being > invalid, on a piece of outgoing mail (generated by the website). It > wasn't about incoming mail or maintaining accounts. I guess what an RFC says about "email address syntax" is valid rule for both sender _and_ recipient. Mails are usually filtered to check they are valid, for example a *sender* what you mentioned as an example would not be able to send mails to our ISP since syntax of sender address are checked on the MX MTAs as well. So I don't see too much point to send mails with invalid (by RFC) sender as most mail softwares and/or MTA admin's configuration will reject it, like with your example, check the subject out of your mail. I guess it's a valid decision to reject these. But _again_: I can be wrong here. > That's a bit academic, though. It think the main points are that: > > * Many Unixes allow you to set up usernames ending in periods > * The MTAs also allow you to send and receive mail using those periods > > Strictly according to the RFC, the address is invalid. But if the > MTA accepts it, why should sieve reject it? Sieve is deployed to Which MTA? Our ISP would reject those, for example. It's matter of the kind of the MTA, and also its configuration, but since according to the RFC which says that invalid, it's not so suprising that some people and/or mail related software decide not to accept. For sure, there can be softwares/configs which allows it. It clearly shows that it's better to avoid addresses which are often handled as invalid ("but not always", it depends, yes), especially if "standards" says they are invalid as well. > apply filters to mail - not to make policy decisions on valid email > addresses. That's a layering violation. Well, it's bit out of scope my intent, also I am not instered to start a flame war or so :) I just wanted to point out that it's anyway a very bad idea to use invalid addresses even if it can be said as true that sieve should not reject things if it's MTA's job ... The basic idea is the same: why do you want to use them, if there are problems with these anyway, and sooner or later you will hit a rejection, even if sieve is "fixed" not having this decision as well. Creating a system which use known to be invalid things (even if it works locally, or other similar examples) are a "good" sign to introduce "interesting" and hard-to-track-down problems later, maybe in the more far future only. I can't say anything about sieve itself, to be honest, anyway, and your suggestion that it must be fixed or not. Again, sorry if someone treated my mail as OT/flame/whatever. From zinovik.igor at gmail.com Wed Aug 22 23:01:15 2012 From: zinovik.igor at gmail.com (Igor Zinovik) Date: Thu, 23 Aug 2012 00:01:15 +0400 Subject: [Dovecot] difference between namespace auto=subscribe and autocreate plugin Message-ID: <50353A8B.8000904@gmail.com> Hello. I read docs, but still do not understand difference between following configuration options: namespace inbox { # Create and subscribe to folder mailbox Drafts { auto=subscribe } and `autocreate' plugin plugin { autocreate = inbox.Drafts autosubscribe = inbox.Drafts On wiki page that describes `autocreate' plugin i read: ... mailboxes that must always exist for all users. So even if user delete Drafts IMAP folder on next connection server will create it. Is `mailbox' undocumented feature? I see it only in configuration file, but wiki does not mention it. From tss at iki.fi Wed Aug 22 23:07:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Wed, 22 Aug 2012 23:07:37 +0300 Subject: [Dovecot] difference between namespace auto=subscribe and autocreate plugin In-Reply-To: <50353A8B.8000904@gmail.com> References: <50353A8B.8000904@gmail.com> Message-ID: <732BA52B-944D-465E-8BF4-C851E2E1A8D1@iki.fi> On 22.8.2012, at 23.01, Igor Zinovik wrote: > I read docs, but still do not understand difference between following > configuration options: > > namespace inbox { > # Create and subscribe to folder > mailbox Drafts { auto=subscribe } > > and `autocreate' plugin > > plugin { > autocreate = inbox.Drafts > autosubscribe = inbox.Drafts Zero difference. autocreate plugin is deprecated, the auto=subscribe is the new way, the plugin is simply a small wrapper to it. Yeah, the wiki should be updated to say this. From zucca at systemschmiede.com Wed Aug 22 23:12:34 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 22 Aug 2012 22:12:34 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <50341D40.9090001@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> Message-ID: <50353D32.2080401@systemschmiede.com> If you should need any more info on this, just drop me a line. I am fully stuck! I think that my dovecot.conf is not put together well, only i can't find the problem... Thanx Sascha Am 22.08.2012 01:44, schrieb Sascha Zucca: > Hi list, > i have a strange "ghost" folder in my subscription list and just can't > find out how to get rid of it. > It seems to be someones Inbox, but it doesn't tell me whose. > > Here's a screenshot of Open-Xchanges Web-GUI: > /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg > / > As you can see there is an unamed folder just under Freigaben (Shares). > > > In Thunderbird: > /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ > > Now the Folder is "INBOX"...But it is noones Inbox, as the > corresponding user (amazon e.g.) should be a prefix-folder right > before the share. > > > some output over Telnet: > > 1 lsub "" "*" > * LSUB () "/" "INBOX" > * LSUB () "/" "INBOX/Amazon" > * LSUB () "/" "INBOX/Bestellung" > * LSUB () "/" "Drafts" > * LSUB () "/" "Sent Items" > * LSUB () "/" "Spam" > * LSUB () "/" "Trash" > * LSUB () "/" "Freigaben/amazon/INBOX" > 1 OK Lsub completed. > > > 1 list "" "*" > * LIST (\HasNoChildren) "/" "Trash" > * LIST (\HasNoChildren) "/" "Sent Items" > * LIST (\HasChildren) "/" "INBOX" > * LIST (\HasNoChildren) "/" "INBOX/Amazon" > * LIST (\HasNoChildren) "/" "INBOX/Bestellung" > * LIST (\HasNoChildren) "/" "Spam" > * LIST (\HasNoChildren) "/" "Drafts" > * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" > 1 OK List completed. > > > This looks a bit strange to me: > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > But i don't know really if that is the ghostfolder. > > > finally here's the interesting part in my dovecot.conf: > / > namespace private { > separator = / > prefix = > #location defaults to mail_location. > inbox = yes > } > > namespace shared { > separator = / > prefix = Freigaben/%%n/ > location = > maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ > subscriptions = no > list = children > inbox = no > } > / > > Any idea how to banish the ghost in the machine? > > Thank you very much > Sascha > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From patrickdk at patrickdk.com Thu Aug 23 03:47:54 2012 From: patrickdk at patrickdk.com (Patrick Domack) Date: Wed, 22 Aug 2012 20:47:54 -0400 Subject: [Dovecot] blf-crypt In-Reply-To: References: Message-ID: <20120822204754.Horde.-FZmPpLnE6FQNX26KBNk2GA@mail.patrickdk.com> BLF-CRYPT has been part of glibc for a very very long time. it uses the blowfish crypt version, that have been changed like 4 times now, do to issues with it. I'm not sure why CRYPT wouldn't work for you, seems to work fine in my dovecot installs. I'm not sure where the dovecot < 2.0 can use {CRYPT} came from. I'm using that, since 0.7x? or somewhere around there, all the way up through, and currently 2.1.7 without issue. Quoting Sven Schwyn : > Hi > > The blf-crypt password schema mentioned in the docs could be a > solution to my auth problem. However, the docs state that actual > support depends on the glibc. Mine apparently doesn't. > > Does support depend on the glibc's version (mine is 2.15-r2)? > > Maybe someone with access to a box with a good enough glibc could do > the following and post the hash for the plain password "test"? > > doveadm pw -s BLF-CRYPT > Enter new password: test > > With this I could verify whether the BLF-CRYPT scheme would solve my > problem in the first place without going through the hassle of > upping the glibc. > > Thanks a bunch! From ncjeffgus at zimage.com Thu Aug 23 05:02:36 2012 From: ncjeffgus at zimage.com (Jeff Gustafson) Date: Wed, 22 Aug 2012 19:02:36 -0700 Subject: [Dovecot] more dsync issues Message-ID: <1345687356.3986.11.camel@maclinux> It hit another dsync snag. We have a script that executes a dsync backup command to a remote host. No write should be happening on the remote host (the backup host). The error is: dsync-local(anonymous at domain.com): Error: remote: dsync-remote(anonymous at domain.com): Error: Can't delete mailbox INBOX: INBOX can't be deleted. dsync-remote(anonymous at domain.com): Error: command MSG-SAVE failed dsync-local(anonymous at domain.com): Error: read() from worker server failed: EOF dsync-local(anonymous at domain.com): Error: Unexpected reply from server: dsync-local(anonymous at domain.com): Warning: Mailbox changes caused a desync. You may want to run dsync again. We're currently running 2.1.7 since > 2.1.8 causes a problem with our webmail software. ...Jeff From david at wordshell.net Thu Aug 23 09:46:36 2012 From: david at wordshell.net (David Anderson) Date: Thu, 23 Aug 2012 09:46:36 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <20120822162055.GD22547@vega.lgb.hu> References: <50348284.8050609@wordshell.net> <20120822151624.GC22547@vega.lgb.hu> <5034FE8D.2030704@wordshell.net> <20120822162055.GD22547@vega.lgb.hu> Message-ID: <5035D1CC.9060005@wordshell.net> On 22/08/12 19:20, G?bor L?n?rt wrote: > I guess what an RFC says about "email address syntax" is valid rule for both > sender _and_ recipient. Perhaps it would be best if dovecot applied a policy (whatever policy) consistently. It was a surprise to me to transition from CMU sieve to Pigeonhole sieve and find that Dovecot LDA now was happy to deliver the mail, but that Pigeonhole sieve was unhappy. David -- WordShell - WordPress fast from the CLI - www.wordshell.net From dmalolepszy at optusnet.com.au Thu Aug 23 09:48:20 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Thu, 23 Aug 2012 16:48:20 +1000 Subject: [Dovecot] Dovecot generate file when over quota detected Message-ID: <5035D234.50306@optusnet.com.au> Hi, I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. This means that an MTA can efficiently check for the existence of this 'overquota' file and return a "user at domain.com Mailbox full" TEMPFAIL error early during the SMTP transaction prior to accepting any data. Dominic From amateo at um.es Thu Aug 23 11:38:48 2012 From: amateo at um.es (Angel L. Mateo) Date: Thu, 23 Aug 2012 10:38:48 +0200 Subject: [Dovecot] doveadm director move behaviour In-Reply-To: References: <4FFEB19D.6020105@um.es> <8FC7173E-8C0F-4A9A-B3AD-15000C4D79D3@iki.fi> <179dcbff-6b5a-4cf8-a628-ac2b7e04ff47@email.android.com> <97D41C81-48EF-43C1-B07B-7CFBE768E2E3@iki.fi> <20120801180929.GA7779@daniel.localdomain> Message-ID: <5035EC18.3020807@um.es> El 01/08/12 20:10, Timo Sirainen escribi?: > On 1.8.2012, at 21.09, Daniel Parthey wrote: > >>> I added a note about it to http://wiki2.dovecot.org/Director#Other_settings >>> >>> doveadm director move needs to be able to connect to the ipc socket. Make sure the director process can do it. >>> >>> service ipc { >>> unix_listener ipc { >>> user = dovecot >>> } >>> } >> >> Thanks, Timo. >> >> Does this apply to the mailbox config or the director config? >> Which instance needs to access the ipc socket of which instance? > > director instance needs access to director instance. > With this configuration, doveadm director move now works correctly, kicking user's connection in the old backend server. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From frank at celebrate.de Thu Aug 23 16:37:14 2012 From: frank at celebrate.de (Frank Kirschner) Date: Thu, 23 Aug 2012 15:37:14 +0200 Subject: [Dovecot] MailDir Issue Message-ID: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> Hello List, I'm still running dovecot in version 1.1.7 No I have setup a new installation with dovecot 2.0.9 and had running some tests with a testdomain. Everything is working well. The Maildir has exactly the same structure like ../domain/username/... Can I copy the whole maildir to the new server? Logical that I have also to move the SMTP network configuration to the new machine. best regards Frank From tth at rfa.cz Thu Aug 23 16:40:23 2012 From: tth at rfa.cz (TeTeHacko) Date: Thu, 23 Aug 2012 15:40:23 +0200 Subject: [Dovecot] pop3 migration Message-ID: <503632C7.2070008@rfa.cz> Hi, I have problems with pop3 migration, the server disconect the dovesync when fetching mails after 5 minutes with this error in server log: xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6548 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 47522 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6549 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 355289 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6550 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 9638 octets xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6551 xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 2188 octets xx.xx.xx.xx [28F4] 11:59:05 >>> -ERR Command unrecognized: "" xx.xx.xx.xx [28F4] 11:59:05 *** 6551 477693894 00:12:55 ERROR xx.xx.xx.xx [28F4] 11:59:05 Disconnected and this in dovecot log: dsync(info at istan.cz): Debug: imapc(mail.stable.cz:143): Authenticated successfully dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Looking up IP address dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Connecting to 88.86.120.212:110 dsync(info at istan.cz): Debug: pop3c(mail.stable.cz): Authenticating as info at istan.cz dsync(info at istan.cz): Error: pop3c(mail.stable.cz): Server disconnected unexpectedly dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 1: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 2: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 3: Disconnected dsync(info at istan.cz): Error: pop3_migration: Failed to get header for msg 4: Disconnected is there any timeout in dovecot for 300s? can anybody point me where may be some problem? This error occurs everytime i test it and the mail box has cca 2GB, on small mailboxes is no problem, i try this patch: http://hg.dovecot.org/dovecot-2.1/rev/ab6a4455b27d on dovecot version 2.1.7 but the problem isn't solved. Thanks for help Tomas Herceg From robert at schetterer.org Thu Aug 23 19:24:20 2012 From: robert at schetterer.org (Robert Schetterer) Date: Thu, 23 Aug 2012 18:24:20 +0200 Subject: [Dovecot] MailDir Issue In-Reply-To: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> References: <34E7E32FAE4E49B897B0C11D7AC689A8@CR1> Message-ID: <50365934.5030205@schetterer.org> Am 23.08.2012 15:37, schrieb Frank Kirschner: > Hello List, > > I'm still running dovecot in version 1.1.7 > No I have setup a new installation with dovecot 2.0.9 and had running some > tests with a testdomain. Everything is working well. The Maildir has exactly > the same structure like ../domain/username/... > > Can I copy the whole maildir to the new server? Logical that I have also to > move the SMTP network configuration to the new machine. > > best regards > Frank > you may try , but i would recommand use imapsync etc -- Best Regards MfG Robert Schetterer From adam at rosi-kessel.org Thu Aug 23 19:55:25 2012 From: adam at rosi-kessel.org (Adam Rosi-Kessel) Date: Thu, 23 Aug 2012 12:55:25 -0400 Subject: [Dovecot] Dovecot / Win8 Mail App Folder Subscription Issue Message-ID: <5036607D.8080100@rosi-kessel.org> Win8 RTM Mail App now supports IMAP. I am running Dovecot 1.2.15 on a Debian Stable server. The App works fine except the list of folders displayed seems to be a random subset of all my folders. I can't figure out how it's picking which folders to show, or how to change what's subscribed. Editing the "subscriptions" folder in ~/Maildir/ doesn't seem to have any impact. Any suggestions on how to troubleshoot or narrow done this issue? I posted to a Microsoft forum but was told the Mail App will only support official email providers. From tss at iki.fi Thu Aug 23 21:30:21 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 21:30:21 +0300 Subject: [Dovecot] For the wishlist In-Reply-To: <20120807124305.GA13644@ruhr-uni-bochum.de> References: <20120807124305.GA13644@ruhr-uni-bochum.de> Message-ID: On 7.8.2012, at 15.43, Jost Krieger wrote: > I would like very much to have a "doveadm copy", which probably could be > made out of "doveadm move" by removing ca. 2 lines (and changing a few > strings from "move" to "copy"). OK: http://hg.dovecot.org/dovecot-2.1/rev/9d35aca14c81 From tss at iki.fi Thu Aug 23 21:50:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 21:50:16 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> Message-ID: <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> On 14.8.2012, at 11.18, Timo Sirainen wrote: >> As Timo says, Dovecot tries to be clever and coalesce packets from checking multiple folders, but from memory there are limitations on this if you have multiple *accounts*? I think the hash is per email address and per IP ? > > Yes, doesn't help with multiple accounts, because the hashed username is different (no IP). I guess this could be changed to be per IP just as well. I think I wondered about which one to use previously but didn't see any point in choosing IP over username, but yes, multiple accounts could be a reason, especially after the whole world is using only Dovecot. :) v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c From tss at iki.fi Thu Aug 23 22:00:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:00:10 +0300 Subject: [Dovecot] Auth worker max line size In-Reply-To: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> References: <1kowgeu.1i4eh7t1e3xj5qM%manu@netbsd.org> Message-ID: <19A4E62F-42A0-4FDD-AD68-31C1B26B9E65@iki.fi> On 16.8.2012, at 4.07, Emmanuel Dreyfus wrote: > 38 month ago, I submitted a patch to increase > AUTH_WORKER_MAX_LINE_LENGTH to use exotic authentication scheme (see > message below). The patch was accepted, but now I upgrade to dovecot > 2.1.7, I face the same problem with MASTER_AUTH_MAX_DATA_SIZE. I had to > increase it from 1024 to 4096. > > Is it safe to do so? Would such a change be accepted upstream? The patch > is below. Couldn't you change the client to use AUTHENTICATE PLAIN command instead? The buffer wouldn't be a problem then.. From tss at iki.fi Thu Aug 23 22:22:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:22:45 +0300 Subject: [Dovecot] No status for INBOX/* in mbox NS (2.1.6) In-Reply-To: <20120817094601.GB21534@ruhr-uni-bochum.de> References: <20120817094601.GB21534@ruhr-uni-bochum.de> Message-ID: On 17.8.2012, at 12.46, Jost Krieger wrote: > Most of our users still have mboxes in the classical layout, so you > can't have subfolders and messages in the same folder, *except for the > INBOX*, as it is physically separate. > > Someone complained that he saw subfolders in roundcube he couldn't > delete, because they didn't show up in the subscription view. > > Before hitting on roundcube, I mperformed a few checks and got the > following: > > root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/*' > root at cx-y-z qmail # doveadm mailbox status -u usera messages 'INBOX/test1' > INBOX/test1 messages=0 Fixed & added to regression tests: http://hg.dovecot.org/dovecot-2.1/rev/b8173f8a1447 From tss at iki.fi Thu Aug 23 22:57:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:57:23 +0300 Subject: [Dovecot] Problem use localized prefix in namespace In-Reply-To: References: Message-ID: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> On 17.8.2012, at 21.37, (Dovecot) Sergey Sidlyarenko wrote: > Problem with localized prefix in namespace. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/ade94fde249e From tss at iki.fi Thu Aug 23 22:58:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 22:58:23 +0300 Subject: [Dovecot] Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators) In-Reply-To: <502CD9F0.1060801@rocnet.de> References: <1184100f1800b1ecd29e7f08f873e026c1596784@rocnet.de> <502CD9F0.1060801@rocnet.de> Message-ID: The assert crash I think is fixed already in v2.1.9. The folder structure can be changed with mail_shared_explicit_inbox=no On 16.8.2012, at 14.30, Claus Rosenberger wrote: > Could i send some more informations about this topic? I'm not sure whats > happening here but i think it has something to do with the shared mailboxes. > With cyrus i had following folder structure: > > user1 -> inbox -> subfolders > -> user -> user1 > -> user2 > > > With dovecot the folder structure look like: > > user1 -> inbox -> subfolders > -> shared -> user1 -> inbox > -> user2 -> inbox > > is there any way to show inbox directly in user1/user2 folder without > having an inbox subfolder? > > > > Am 22.07.2012 00:04, schrieb Claus Rosenberger: >> Hi, >> >> with fetching the folder structure with the webclient Tine i can see following error messages inside of the logfiles: >> >> Panic: file mail-storage.c: line 791 (mailbox_check_mismatching_separators): assertion failed: (strncmp(vname, ns->prefix, ns->prefix_len-1) == 0) >> >> Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x448fa) [0x7f70036db8fa] -> /usr/lib/dovecot/libdovecot.so.0(+0x44946) [0x7f70036db946] -> /usr/lib/dovecot/libdovecot.so.0(+0x1b8ca) [0x7f70036b28ca] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open_stream+0) [0x7f70039a1550] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f70039a156f] -> dovecot/imap(cmd_select_full+0x14a) [0x40db1a] -> dovecot/imap(command_exec+0x3d) [0x41160d] -> dovecot/imap() [0x41058e] -> dovecot/imap() [0x41066d] -> dovecot/imap(client_handle_input+0x135) [0x410895] -> dovecot/imap(client_input+0x5f) [0x4111bf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f70036e7ea6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f70036e8f2f] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f70036e7e48] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f70036d4103] -> dovecot/imap(main+0x2a5) [0x419695] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f7003353c8d] -> dovecot/imap() [0x408f49] >> >> Fatal: master: service(imap): child 21152 killed with signal 6 (core dumps disabled) >> > From tss at iki.fi Thu Aug 23 23:00:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:00:00 +0300 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: On 18.8.2012, at 0.12, Lutz Pre?ler wrote: >>> inthread refs younger 604800 >>> >>> This works as expected for the first time. But later on, also older messages/ >>> threads are included until I delete the virtual/.week/dovecot.index*. >> >> I know there are problems related to this with INTHREAD, but they aren't >> very easy to solve and for now I've more important things to do.. If it >> seemed to work before, it was due to luck or due to some bug causing an >> unnecessary index rebuild. You could set :INDEX=MEMORY to work around >> this, but I don't know how much worse the performance would become. Or >> you could just manually delete the virtual indexes once a week. > Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ > enhance now? Any estimate how much effort it would be? Just about the same amount of work I think. I haven't really looked at virtual plugin for a while, so I can't easily say how much work it would be. But my guess is that it wouldn't be easy. From tss at iki.fi Thu Aug 23 23:01:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:01:23 +0300 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> Message-ID: On 19.8.2012, at 12.51, Michael Grimm wrote: >>> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >>> >>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >>> >>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >>> >>> JFTR: I do have mail_log plugin activated. >> >> Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. > > > I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? Not enable mail_log for doveadm: protocol !doveadm { mail_plugins = $mail_plugins = mail_log } or alternatively override it only for the dsync command with doveadm -o mail_plugins=... From tss at iki.fi Thu Aug 23 23:03:00 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:03:00 +0300 Subject: [Dovecot] userdb multiple databases In-Reply-To: <5031F673.8040702@um.es> References: <5031F673.8040702@um.es> Message-ID: <7D274FA9-B3B7-49AB-B12A-7F6932ECA3A9@iki.fi> On 20.8.2012, at 11.33, Angel L. Mateo wrote: > I'm trying to configure per user plugins. My original passdb and userdb is in a ldap directory (using userdb with prefetch). > > To configure per user plugins (in fact, I want to enable quota plugin for some users) I need to configure mail_plugins attribute in the userdb. > > The problem is that I don't know any ldap attribute to store this information (is there any schema with includes an attribute for this). So I want to configure it in a passwd-file file. > > My problem is that I don't know if I can chain userdb databases. I know I can configure multiple databases, but as far as I know, they are looked in order, so if the user is found in the first one, then is no look for the user in the second one, so I have to configure all user's attributes in the passwd-file database. Correct. > Is there any way to chain these lookups? No. You could generate the passwd-file based on data in LDAP. From tss at iki.fi Thu Aug 23 23:05:33 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:05:33 +0300 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <503223EE.3030801@um.es> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> <503223EE.3030801@um.es> Message-ID: <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> On 20.8.2012, at 14.47, Angel L. Mateo wrote: > The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. > > But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error > > Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline > > and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. You can't do it with one passwd-file, you'd have to use multiple per-protocol passwd files.. For example: userdb passwd-file { args = /etc/dovecot/passwd.%s } Yeah, passwd-files aren't very flexible for things like these. Maybe you should look into using sqlite? It probably allows some if() or case() in the query (I haven't used sqlite). From tss at iki.fi Thu Aug 23 23:08:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:08:38 +0300 Subject: [Dovecot] Is it possible to save only some messages compressed to mdbox? (2.1.6) In-Reply-To: <20120820130617.GT24203@ruhr-uni-bochum.de> References: <20120820130617.GT24203@ruhr-uni-bochum.de> Message-ID: On 20.8.2012, at 16.06, Jost Krieger wrote: > So here's the questions: > > 1. Is it possible to have compressed/uncompressed mails mixed in an > mdbox? Yes. Compression is detected on a per-mail basis. > 2. Will it work via "-o" in lda delivery? > > I tried to find out in the source but found it hard to see which options > are pulled in when. -o can override all settings that are handled by the running process itself, so yes that includes compression stuff. From tss at iki.fi Thu Aug 23 23:11:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:11:38 +0300 Subject: [Dovecot] Error: Couldn't open INBOX: Timeout while waiting for lock In-Reply-To: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> References: <1345527759.67171.YahooMailNeo@web193501.mail.sg3.yahoo.com> Message-ID: <8572F459-1569-4FE2-87EA-A7A0C738A876@iki.fi> On 21.8.2012, at 8.42, Kavish Karkera wrote: > My users are frequetly getting the below error, > > Aug 21 00:04:18 blade6 dovecot: pop3-login: proxy(hgl_dipak): Login failed to 192.168.1.43:110: [IN-USE] Couldn't open INBOX: Timeout while waiting for lock. > > We are proxing pop connections from one pop server (dovecot version 1.1.20) i.e 192.168.1.39 to the other pop Server (Dovecot version 2.0.16 ) i.e 192.168.1.4. > > We have set pop3_lock_session = yes and dont want to disable it. Are your users behind bad internet connections that leave dead connections lying around? If so, maybe changing the kernel's TCP keepalive value to something very aggressive (e.g. 10 secs) would fix those. Of course that makes other traffic behave worse. From warren at decoy.co.za Thu Aug 23 23:26:59 2012 From: warren at decoy.co.za (Warren Baker) Date: Thu, 23 Aug 2012 22:26:59 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> Message-ID: On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: > On 14.8.2012, at 11.18, Timo Sirainen wrote: > > v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? -- .warren From tss at iki.fi Thu Aug 23 23:49:44 2012 From: tss at iki.fi (Timo Sirainen) Date: Thu, 23 Aug 2012 23:49:44 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> Message-ID: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> On 23.8.2012, at 23.26, Warren Baker wrote: > On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >> On 14.8.2012, at 11.18, Timo Sirainen wrote: >> >> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c > > Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). From daryl at isletech.net Thu Aug 23 23:57:40 2012 From: daryl at isletech.net (Daryl Richards) Date: Thu, 23 Aug 2012 16:57:40 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <50369944.4050107@isletech.net> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 12-08-23 4:49 PM, Timo Sirainen wrote: > On 23.8.2012, at 23.26, Warren Baker wrote: > >> On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >>> On 14.8.2012, at 11.18, Timo Sirainen wrote: >>> >>> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c >> >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). > Well, here's a "We use it" if you need it.. It probably just makes sense to block all out all RFC1918 addresses.. - -- Daryl Richards Isle Technical Services Inc. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlA2mUMACgkQbMWpShDgLrWMSQCfY9tBtDvgVuQDMjUbbNlyGkUb yNQAn2u1tHOZkZc7dugeXaLQ/mfmBFvP =lQb3 -----END PGP SIGNATURE----- From lists at luigirosa.com Fri Aug 24 07:56:41 2012 From: lists at luigirosa.com (Luigi Rosa) Date: Fri, 24 Aug 2012 06:56:41 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <50370989.3010402@luigirosa.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Timo Sirainen said the following on 23/08/12 22:49: >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > Is it actually used? :) YES! I have a big customer (400 PCs) with 172.16.0.0/16 internal network and a subnet of 192.168.0.0 for DMZ I use it more than 192.168 when I create networks. Ciao, luigi - -- / +--[Luigi Rosa]-- \ Walk softly and carry a megawatt laser. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlA3CYkACgkQ3kWu7Tfl6ZSRaQCgy1YilsGEL7JXIDabKm+zSjZN cvEAoKYqE1ZjbR/g1XTiHUvlfpPuvWAE =RSAO -----END PGP SIGNATURE----- From voytek at sbt.net.au Fri Aug 24 08:18:56 2012 From: voytek at sbt.net.au (Voytek Eymont) Date: Fri, 24 Aug 2012 15:18:56 +1000 Subject: [Dovecot] Disable security for testing? Message-ID: <6fbbd67b-dc1e-4875-826f-e646751d6278@email.android.com> I want to offer 'plain' unsecure pop/imap access, just for temp. testing purpose, do I simply comment out ssl = required ? Voytek -- Swyped on Motrix with K-9 Mail. Please excuse my brevity. From Lutz.Pressler at SerNet.DE Fri Aug 24 10:28:10 2012 From: Lutz.Pressler at SerNet.DE (Lutz =?iso-8859-1?Q?Pre=DFler?=) Date: Fri, 24 Aug 2012 09:28:10 +0200 Subject: [Dovecot] problem with virtual plugin/index files? In-Reply-To: References: <20101029064409.GA2282028@gabi.sernet.de> <1291312192.5119.455.camel@kurkku.sapo.corppt.com> Message-ID: On Thu, 23 Aug 2012, Timo Sirainen wrote: > On 18.8.2012, at 0.12, Lutz Pre?ler wrote: > > >>> inthread refs younger 604800 > >>> > >>> This works as expected for the first time. But later on, also older messages/ > >>> threads are included until I delete the virtual/.week/dovecot.index*. > >> [...] > > Situation with latest 2.1 is unchanged. But maybe it's easier to fix/ > > enhance now? Any estimate how much effort it would be? > > Just about the same amount of work I think. I haven't really looked at virtual plugin for a while, so I can't easily say how much work it would be. But my guess is that it wouldn't be easy. > Thanks. To force MEMORY indexes only (with location option in namespace or forcibly - with warnings - by having empty index files for one mailbox chattr +i'ed (extended attributes immutable flag on Linux filesystems)) disables full text search indexing also. What about regular deletion of main index files. Is this a problem with FTS? "doveadm fts rescan" necessary, too? Btw, with 2.1 search results with or without fts indexes (solr,squat) differ in substring behaviour (http://wiki2.dovecot.org/Plugins/FTS/Squat). Namespaces with INDEX=MEMORY allow for a "slow search view". But then no attachment content is searched... Lutz From andre.groebe at fun.de Fri Aug 24 10:38:49 2012 From: andre.groebe at fun.de (=?UTF-8?B?QW5kcmUgR3LDtmJl?=) Date: Fri, 24 Aug 2012 09:38:49 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50336E01.6000909@fun.de> References: <50225A24.4010109@fun.de> <50323D3B.1030701@fun.de> <50335E89.9010104@fun.de> <50336E01.6000909@fun.de> Message-ID: <50372F89.60301@fun.de> Hi Timo, > [Timo Sirainen; Di 21 Aug 2012 12:22:04 CEST] >>> Unfortunatly this can't be a fix because in file_set_size() dovecot >>> defines an array 'char block[IO_BLOCK_SIZE]'. On the other hand the >>> default block size is predestined for file ops. >> >> Does the attached patch fix it? (not a very good fix) > > No, it doesn't. Still got no response on large metadata and writing > destroys the dictionary. Sorry for bumping - is there a chance to get it work with dovecot 2.1.7? TIA Andre From warren at decoy.co.za Fri Aug 24 11:10:42 2012 From: warren at decoy.co.za (Warren Baker) Date: Fri, 24 Aug 2012 10:10:42 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: On Thu, Aug 23, 2012 at 10:49 PM, Timo Sirainen wrote: >> >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). Yeah as others have mentioned - also not sure whether it is worth the effort to support IPv6's 'private' network (fc00::/7)? I havent seen anyone making use of this for their v6 enabled sites but others may have input here. thanks -- .warren From amateo at um.es Fri Aug 24 13:23:57 2012 From: amateo at um.es (Angel L. Mateo) Date: Fri, 24 Aug 2012 12:23:57 +0200 Subject: [Dovecot] enabling per user quota plugin and problems with pop3 In-Reply-To: <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> References: <5031F782.9010802@um.es> <503217F0.3090609@um.es> <503223EE.3030801@um.es> <2A164AAB-D93A-494E-9634-4BF007F77A8E@iki.fi> Message-ID: <5037563D.8080402@um.es> El 23/08/12 22:05, Timo Sirainen escribi?: > On 20.8.2012, at 14.47, Angel L. Mateo wrote: > >> The origin of the problem why lmtp didn't use user's mail_plugin is that I had it configured it in the pass_attrs option (and read with prefetch) and not in user_attrs, so lmtp didn't get it. >> >> But now the problem is that I can't configure mail_plugins redefinition per user with 'quota,imap_quota' because when it is get it for lmtp, it produces the error >> >> Aug 20 13:38:30 myotis30 dovecot: lmtp(1086): Error: dlopen(/usr/lib/dovecot/modules/lib11_imap_quota_plugin.so) failed: /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so: undefined symbol: client_send_tagline >> >> and if I configure mail_plugins redefinition with just 'quota' then it is no applied for IMAP connections. > > You can't do it with one passwd-file, you'd have to use multiple per-protocol passwd files.. For example: > > userdb passwd-file { > args = /etc/dovecot/passwd.%s > } > I have tried this option. It works, although I have to duplicate this file. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n _o) y las Comunicaciones Aplicadas (ATICA) / \\ http://www.um.es/atica _(___V Tfo: 868887590 Fax: 868888337 From tcsmith1978 at googlemail.com Fri Aug 24 13:53:50 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 11:53:50 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? Message-ID: <50375D3E.50409@googlemail.com> Hi, I didn't know where to post this one so I'll start off with you guys and then try Postfix if I'm barking up the wrong tree! Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! Sorry this is a bit vague but any advice on trying to diagnose the problem would be appreciated. Thanks in advance! Tim From jerry at seibercom.net Fri Aug 24 14:01:40 2012 From: jerry at seibercom.net (Jerry) Date: Fri, 24 Aug 2012 07:01:40 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <20120824070140.09041498@scorpio> On Fri, 24 Aug 2012 10:10:42 +0200 Warren Baker articulated: > Yeah as others have mentioned - also not sure whether it is worth the > effort to support IPv6's 'private' network (fc00::/7)? > I havent seen anyone making use of this for their v6 enabled sites but > others may have input here. I would personally recommend supporting it. If history teaches us anything, it is that sooner or later, and usually sooner, someone will require that block. Being prepared for it in advance would seem like the prudent thing to do. -- Jerry ? Disclaimer: off-list followups get on-list replies or get ignored. Please do not ignore the Reply-To header. __________________________________________________________________ From robert at schetterer.org Fri Aug 24 14:06:06 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 13:06:06 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: <5037601E.5090401@schetterer.org> Am 24.08.2012 12:53, schrieb Tim Smith: > Hi, > > I didn't know where to post this one so I'll start off with you guys and > then try Postfix if I'm barking up the wrong tree! > > Having set up my mail server (Dovecot/Postfix), users are experiencing > long delays (a couple of minutes) when sending mail from mail client > such as Thunderbird - this increases with attachments. Having had a > brief discussion with someone, they mentioned that the reason that this > may be to do with the size of the mailbox. I couldn't see the rationale > behind this unless Dovecot is syncing the mailbox after every sent mail > (due to possibly saving the sent item?) The mail is being delivered > successfully but the amount of time it is taking to complete the action > is far too long! > > Sorry this is a bit vague but any advice on trying to diagnose the > problem would be appreciated. > > Thanks in advance! > > Tim sending mail ist usual smtp ( postfix ), not dovecot if no firewalls/proxies , slow lines , dns problems are involved, there may exist some policy or milter service which slows down smtp out from i.e tb, ask same question with logs and config in the postfix mail list size of mailbox should be not involved in this -- Best Regards MfG Robert Schetterer From tcsmith1978 at googlemail.com Fri Aug 24 14:14:50 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 12:14:50 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037601E.5090401@schetterer.org> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> Message-ID: <5037622A.30808@googlemail.com> Thanks Robert. That's what I thought. I couldn't make the connection. Will try the Postfix list! On 24/08/12 12:06, Robert Schetterer wrote: > Am 24.08.2012 12:53, schrieb Tim Smith: >> Hi, >> >> I didn't know where to post this one so I'll start off with you guys and >> then try Postfix if I'm barking up the wrong tree! >> >> Having set up my mail server (Dovecot/Postfix), users are experiencing >> long delays (a couple of minutes) when sending mail from mail client >> such as Thunderbird - this increases with attachments. Having had a >> brief discussion with someone, they mentioned that the reason that this >> may be to do with the size of the mailbox. I couldn't see the rationale >> behind this unless Dovecot is syncing the mailbox after every sent mail >> (due to possibly saving the sent item?) The mail is being delivered >> successfully but the amount of time it is taking to complete the action >> is far too long! >> >> Sorry this is a bit vague but any advice on trying to diagnose the >> problem would be appreciated. >> >> Thanks in advance! >> >> Tim > sending mail ist usual smtp ( postfix ), not dovecot > if no firewalls/proxies , slow lines , dns problems are involved, there > may exist some policy or milter service which slows down smtp out from > i.e tb, ask same question with logs and config in the postfix mail list > size of mailbox should be not involved in this From matthew at atom.net Fri Aug 24 14:18:41 2012 From: matthew at atom.net (Matthew Powell) Date: Fri, 24 Aug 2012 07:18:41 -0400 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <20120824070140.09041498@scorpio> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: On 2012-08-24, at 7.01, Jerry wrote: > I would personally recommend supporting it. If history teaches us > anything, it is that sooner or later, and usually sooner, someone will > require that block. Being prepared for it in advance would seem like > the prudent thing to do. I wonder whether it would be better to make the exclusion list configurable. As I understand it, the intention is to avoid treating connections through a load balancer or proxy as though they're the same client device. The assumption that private address = proxy is a fair default, but some sites will be using public addresses for their proxies. And that's only going to increase with IPv6. -- Matthew Powell matthew at atom.net From dirk.jahnke-zumbusch at desy.de Fri Aug 24 14:35:32 2012 From: dirk.jahnke-zumbusch at desy.de (Jahnke-Zumbusch, Dirk) Date: Fri, 24 Aug 2012 13:35:32 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037622A.30808@googlemail.com> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> <5037622A.30808@googlemail.com> Message-ID: <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> Hi all, >>> Having set up my mail server (Dovecot/Postfix), users are experiencing >>> long delays (a couple of minutes) when sending mail from mail client >>> such as Thunderbird - this increases with attachments. Having had a While in the first place sending e-mail has to do with SMTP and not IMAP, most mail client programs are configured to save a copy of an e-mail using FCC (file carbon copy) by putting this copy via IMAP into some "Sent" folder. And here you are: this may explain the long delays, esp. if on some asymmetric connection like DSL with low upstream bandwith. Just my 2c Cheers and have a nice weekend -- Dirk Jahnke-Zumbusch Deutsches Elektronen-Synchrotron DESY From h.reindl at thelounge.net Fri Aug 24 14:38:33 2012 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 24 Aug 2012 13:38:33 +0200 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: <503767B9.3090002@thelounge.net> Am 24.08.2012 13:18, schrieb Matthew Powell: > On 2012-08-24, at 7.01, Jerry wrote: > >> I would personally recommend supporting it. If history teaches us >> anything, it is that sooner or later, and usually sooner, someone will >> require that block. Being prepared for it in advance would seem like >> the prudent thing to do. > > I wonder whether it would be better to make the exclusion list configurable. > > As I understand it, the intention is to avoid treating connections through a > load balancer or proxy as though they're the same client device i doubt the ip is generally the wrong value to define something is the same client device, there are millions of networks behind NAT out there with a lot of clients usually connecting to the same mailserver via the same public IP and many of them have a workstation beside a mobile device using the same IMAP account the same device = open connection, nothing else > The assumption that private address = proxy is a fair default in my opinion this is generally the wrong direction i do NOT like it when server software behaves different from my private LAN where services are tested than later after making the service public from the WAN -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 262 bytes Desc: OpenPGP digital signature URL: From robert at schetterer.org Fri Aug 24 14:39:41 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 13:39:41 +0200 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> References: <50375D3E.50409@googlemail.com> <5037601E.5090401@schetterer.org> <5037622A.30808@googlemail.com> <7C0189D0CDB51646B7814F4377D356F504C1C41A@ADXV4.win.desy.de> Message-ID: <503767FD.3030709@schetterer.org> Am 24.08.2012 13:35, schrieb Jahnke-Zumbusch, Dirk: > Hi all, > >>>> Having set up my mail server (Dovecot/Postfix), users are experiencing >>>> long delays (a couple of minutes) when sending mail from mail client >>>> such as Thunderbird - this increases with attachments. Having had a > > While in the first place sending e-mail has to do with SMTP and not IMAP, > most mail client programs are configured to save a copy of an e-mail using > FCC (file carbon copy) by putting this copy via IMAP into some "Sent" > folder. And here you are: this may explain the long delays, esp. if on > some asymmetric connection like DSL with low upstream bandwith. > > Just my 2c > > Cheers and have a nice weekend > > > -- > Dirk Jahnke-Zumbusch Deutsches Elektronen-Synchrotron DESY > very true, but tb should show the copy action, unless its not configured not to do so -- Best Regards MfG Robert Schetterer From sven at svenhartge.de Fri Aug 24 15:02:05 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 14:02:05 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) Message-ID: <692aeic3nov8@mids.svenhartge.de> Hi! I am currently in the process of preparing a migration of our old Courier-based IMAP/POP server setup to a Dovecot-based one. During this process I came across the following problem with the difference Courier and Dovecot handle deleted messages and mail quota. Quote from http://www.courier-mta.org/imap/README.maildirquota.html: ,---- | The default application configuration that uses this maildirquota | library does not count deleted messages, and any contents of the Trash | folder, against the quota. Messages that are marked as deleted (but not | yet actually removed), or messages that are moved to the Trash folder | (which is subject to automatic purging) do not count towards the set | quota. `---- Ignoring the content (or increasing the quota) of the Trash folder is easy and no problem, but ignoring deleted messages seems impossible without changes to the code. While deleted messages are still stored on the server and still take up space until they are expunged, counting them against the quota is somewhat counter-intuitive because most clients don't show those mails and the normal user is unaware the mails he deleted are still there and take up space. Worse yet, if the client uses move-to-Trash, a user deleting mails will double the used space (until Expunge is used) and this may push him over his quota and thus cause any new mail delivery to fail. Unfortunately as our users are used to the courier way of handling the quota this will cause trouble after the migration. And this setup is run at a University, so I don't have any control over the clients a user uses and the behavior of said clients so I am not able to disable the move-to-Trash feature or force an immediate Expunge after a delete. So I propose an additional flag for the quota_rule config option to be able to enable a more lax interpretation of the quota enforcement: quota_rule = *:storage=1G:ignoredeleted quota_rule2 = Trash:storage=+100M Of course I would then have a nightly cronjob which force-expunges all deleted messages so that users can't store mails infinitely in their mailboxes. Thanks for your time and Gr??e, Sven. -- Sigmentation fault. Core dumped. From stan at hardwarefreak.com Fri Aug 24 15:50:39 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 24 Aug 2012 07:50:39 -0500 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: <5037789F.3070500@hardwarefreak.com> On 8/24/2012 5:53 AM, Tim Smith wrote: Hay Tim, > Having set up my mail server (Dovecot/Postfix), users are experiencing > long delays (a couple of minutes) when sending mail from mail client > such as Thunderbird - this increases with attachments. Having had a > brief discussion with someone, they mentioned that the reason that this > may be to do with the size of the mailbox. I couldn't see the rationale > behind this unless Dovecot is syncing the mailbox after every sent mail > (due to possibly saving the sent item?) The mail is being delivered > successfully but the amount of time it is taking to complete the action > is far too long! You probably have multiple factors involved in this mail sending delay issue. One may be that you're not bypassing your Postfix restrictions on your submission service. To fix this, disable your restrictions in the master.cf service definition of your submission service. For example: 587 inet n - n - - smtpd -o smtpd_enforce_tls=yes -o smtpd_sasl_auth_enable=yes -o content_filter= -o smtpd_client_restrictions= -o smtpd_helo_restrictions= -o smtpd_sender_restrictions= -o smtpd_recipient_restrictions=permit_mynetworks,\ permit_sasl_authenticated,reject -o receive_override_options=no_unknown_recipient_checks,\ no_address_mappings,no_header_body_checks This should squash any/all delays in Postfix submission. Another is the fact you're storing the users' Sent folders on the IMAP server. Typically there's nothing wrong with this. I do this and I see zero delay in Tbird. If a good portion of the delay you're seeing is Tbird copying messages to the Sent folder then I'd say you may have a duplex mismatch or some other network layer issue. What is the network topology between these client MUAs and the server? Full duplex fast ethernet? GbE? Or is the server at a remote location, say a colo/VPS server, and your clients are submitting over a shared ADSL/cable circuit to the server? If this is the case you'll always have substantial delays as the real outbound transmission rate of the best ADSL/cable circuits is only 500-1000 Kbps. Sending an attachment over such a pipe is always going to be slow, doubly so if you're copying to an IMAP Sent folder over the same connection, plus sharing it for web browsing, etc, amongst many users. If this is a SOHO environment with shared ADSL/cable the server needs to be on site, with clients connected via ethernet. This will allow instantaneous submission and Sent copying, while pushing the delay to the Postfix outbound queue, where it's invisible to your users. -- Stan From tss at iki.fi Fri Aug 24 16:05:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 24 Aug 2012 16:05:37 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <692aeic3nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> Message-ID: <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> On 24.8.2012, at 15.02, Sven Hartge wrote: > Ignoring the content (or increasing the quota) of the Trash folder is > easy and no problem, but ignoring deleted messages seems impossible > without changes to the code. .. > So I propose an additional flag for the quota_rule config option to be > able to enable a more lax interpretation of the quota enforcement: > > quota_rule = *:storage=1G:ignoredeleted > quota_rule2 = Trash:storage=+100M This can't be implemented race-condition-free without huge changes to code. From sven at svenhartge.de Fri Aug 24 16:13:46 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:13:46 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> Message-ID: <892ajb13nov8@mids.svenhartge.de> Timo Sirainen wrote: > On 24.8.2012, at 15.02, Sven Hartge wrote: >> Ignoring the content (or increasing the quota) of the Trash folder is >> easy and no problem, but ignoring deleted messages seems impossible >> without changes to the code. > .. >> So I propose an additional flag for the quota_rule config option to be >> able to enable a more lax interpretation of the quota enforcement: >> >> quota_rule = *:storage=1G:ignoredeleted >> quota_rule2 = Trash:storage=+100M > This can't be implemented race-condition-free without huge changes to code. Damn, too bad. I know for sure either my users or my 1st level support team are going to kill me if I don't find a solution. Is is possible to forcibly expunge a message at once, directly after a client has marked it as deleted? Kind of the opposite of the lazy_expunge plugin? Gr??e, Sven. -- Sigmentation fault. Core dumped. From robert at schetterer.org Fri Aug 24 16:41:57 2012 From: robert at schetterer.org (Robert Schetterer) Date: Fri, 24 Aug 2012 15:41:57 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <892ajb13nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <503784A5.8080606@schetterer.org> Am 24.08.2012 15:13, schrieb Sven Hartge: > Timo Sirainen wrote: >> On 24.8.2012, at 15.02, Sven Hartge wrote: > >>> Ignoring the content (or increasing the quota) of the Trash folder is >>> easy and no problem, but ignoring deleted messages seems impossible >>> without changes to the code. >> .. >>> So I propose an additional flag for the quota_rule config option to be >>> able to enable a more lax interpretation of the quota enforcement: >>> >>> quota_rule = *:storage=1G:ignoredeleted >>> quota_rule2 = Trash:storage=+100M > >> This can't be implemented race-condition-free without huge changes to code. > > Damn, too bad. > > I know for sure either my users or my 1st level support team are going > to kill me if I don't find a solution. > > Is is possible to forcibly expunge a message at once, directly after a > client has marked it as deleted? Kind of the opposite of the > lazy_expunge plugin? > > Gr??e, > Sven. > hm perhaps as workaround http://wiki2.dovecot.org/Plugins/deleted-to-trash and do often http://wiki2.dovecot.org/Plugins/Expire via cron i.e doveadm expunge -A mailbox Trash savedbefore 1h -- Best Regards MfG Robert Schetterer From haldir.junk at gmail.com Fri Aug 24 16:42:21 2012 From: haldir.junk at gmail.com (Eric Sisolak) Date: Fri, 24 Aug 2012 09:42:21 -0400 Subject: [Dovecot] Vpopmail Dynamic Authentication Module Message-ID: Hello, We currently use qmail with vpopmail for e-mail and are looking to switch from courier-imap to dovecot for IMAP on our RedHat EL 5 systems. Our goal is to use the dovecot RPM supplied by RH (v1.0.7) if at all possible. We can do this if we are able to dynamically load the vpopmail auth module. The wiki (http://wiki.dovecot.org/CompilingSource) notes that this should be possible: Dovecot can also dynamically load authentication modules from the $prefix/lib/dovecot/auth/ directory. Binary packages builders should use them for authentication modules which require external libraries (e. g. LDAP and vpopmail). There is no standard way to build them as modules currently, but something like this should work: gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL \-I../.. -I../lib userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so \-lvpopmail I had to modify the command to build the module, but was able to successfully build it: gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL -I../.. -I../lib -I/home/vpopmail/include -I/home/vpopmail/lib userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so -L/home/vpopmail/lib/libvpopmail.a I am unable to get the module to load properly. Dovecot built with --with-vpopmail works perfectly. When I start dovecot and it tries to load the module it reports: Aug 23 16:48:18 ctd-nix1 dovecot: Dovecot v1.0.7 starting up Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): dlopen(/usr/lib64/dovecot/auth/vpopmail.so) failed: /usr/lib64/dovecot/auth/vpopmail.so: undefined symbol: vclose Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): dlsym(passdb_vpopmail) failed: dovecot-auth: undefined symbol: passdb_vpopmail Aug 23 16:48:18 ctd-nix1 dovecot: auth(default): Unknown passdb driver 'vpopmail' (typo, or Dovecot was built without support for it? Check with dovecot --build-options) Aug 23 16:48:18 ctd-nix1 dovecot: Auth process died too early - shutting down Sometimes instead the last line is replaced with: Aug 23 15:02:45 ctd-nix1 dovecot: child 5412 (auth) returned error 89 Thanks! Eric From tcsmith1978 at googlemail.com Fri Aug 24 16:49:38 2012 From: tcsmith1978 at googlemail.com (Tim Smith) Date: Fri, 24 Aug 2012 14:49:38 +0100 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <5037789F.3070500@hardwarefreak.com> References: <50375D3E.50409@googlemail.com> <5037789F.3070500@hardwarefreak.com> Message-ID: <50378672.70208@googlemail.com> My next guess was the upstream data rate. My router states that the upstream is 10x slower than downstream so I guess this is the culprit. Time to move to a VPS methinks... On 24/08/12 13:50, Stan Hoeppner wrote: > On 8/24/2012 5:53 AM, Tim Smith wrote: > > Hay Tim, > >> Having set up my mail server (Dovecot/Postfix), users are experiencing >> long delays (a couple of minutes) when sending mail from mail client >> such as Thunderbird - this increases with attachments. Having had a >> brief discussion with someone, they mentioned that the reason that this >> may be to do with the size of the mailbox. I couldn't see the rationale >> behind this unless Dovecot is syncing the mailbox after every sent mail >> (due to possibly saving the sent item?) The mail is being delivered >> successfully but the amount of time it is taking to complete the action >> is far too long! > You probably have multiple factors involved in this mail sending delay > issue. > > One may be that you're not bypassing your Postfix restrictions on your > submission service. To fix this, disable your restrictions in the > master.cf service definition of your submission service. For example: > > 587 inet n - n - - smtpd > -o smtpd_enforce_tls=yes > -o smtpd_sasl_auth_enable=yes > -o content_filter= > -o smtpd_client_restrictions= > -o smtpd_helo_restrictions= > -o smtpd_sender_restrictions= > -o smtpd_recipient_restrictions=permit_mynetworks,\ > permit_sasl_authenticated,reject > -o receive_override_options=no_unknown_recipient_checks,\ > no_address_mappings,no_header_body_checks > > This should squash any/all delays in Postfix submission. > > Another is the fact you're storing the users' Sent folders on the IMAP > server. Typically there's nothing wrong with this. I do this and I see > zero delay in Tbird. If a good portion of the delay you're seeing is > Tbird copying messages to the Sent folder then I'd say you may have a > duplex mismatch or some other network layer issue. > > What is the network topology between these client MUAs and the server? > Full duplex fast ethernet? GbE? Or is the server at a remote location, > say a colo/VPS server, and your clients are submitting over a shared > ADSL/cable circuit to the server? If this is the case you'll always > have substantial delays as the real outbound transmission rate of the > best ADSL/cable circuits is only 500-1000 Kbps. Sending an attachment > over such a pipe is always going to be slow, doubly so if you're copying > to an IMAP Sent folder over the same connection, plus sharing it for web > browsing, etc, amongst many users. > > If this is a SOHO environment with shared ADSL/cable the server needs to > be on site, with clients connected via ethernet. This will allow > instantaneous submission and Sent copying, while pushing the delay to > the Postfix outbound queue, where it's invisible to your users. > From sven at svenhartge.de Fri Aug 24 16:53:09 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:53:09 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Robert Schetterer wrote: > Am 24.08.2012 15:13, schrieb Sven Hartge: >> Timo Sirainen wrote: >>> On 24.8.2012, at 15.02, Sven Hartge wrote: >> >>>> Ignoring the content (or increasing the quota) of the Trash folder is >>>> easy and no problem, but ignoring deleted messages seems impossible >>>> without changes to the code. >>>> So I propose an additional flag for the quota_rule config option to be >>>> able to enable a more lax interpretation of the quota enforcement: >>>> >>>> quota_rule = *:storage=1G:ignoredeleted >>>> quota_rule2 = Trash:storage=+100M >>> This can't be implemented race-condition-free without huge changes >>> to code. >> >> Damn, too bad. >> >> I know for sure either my users or my 1st level support team are >> going to kill me if I don't find a solution. >> >> Is is possible to forcibly expunge a message at once, directly after >> a client has marked it as deleted? Kind of the opposite of the >> lazy_expunge plugin? > hm perhaps as workaround > http://wiki2.dovecot.org/Plugins/deleted-to-trash > and do often > http://wiki2.dovecot.org/Plugins/Expire > via cron i.e > doveadm expunge -A mailbox Trash savedbefore 1h I stumbled upon deleted_to_trash 5 minutes ago. This could work, if the code still works with dovecot 2.1. Gr??e, Sven. -- Sigmentation fault. Core dumped. From sven at svenhartge.de Fri Aug 24 16:56:36 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 15:56:36 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Sven Hartge wrote: > Robert Schetterer wrote: >> Am 24.08.2012 15:13, schrieb Sven Hartge: >>> Is is possible to forcibly expunge a message at once, directly after >>> a client has marked it as deleted? Kind of the opposite of the >>> lazy_expunge plugin? >> hm perhaps as workaround >> http://wiki2.dovecot.org/Plugins/deleted-to-trash >> and do often >> http://wiki2.dovecot.org/Plugins/Expire >> via cron i.e >> doveadm expunge -A mailbox Trash savedbefore 1h > I stumbled upon deleted_to_trash 5 minutes ago. This could work, if the > code still works with dovecot 2.1. Nope, does not compile (dovecot-dev headers are installed): cc \ -fPIC -shared -Wall \ -I/usr/include/dovecot \ -I/usr/include/dovecot/src \ -I/usr/include/dovecot/src/lib \ -I/usr/include/dovecot/src/lib-storage \ -I/usr/include/dovecot/src/lib-mail \ -I/usr/include/dovecot/src/lib-imap \ -I/usr/include/dovecot/src/lib-index \ -DHAVE_CONFIG_H \ deleted-to-trash-plugin.c -o lib_deleted_to_trash_plugin.so deleted-to-trash-plugin.c: In function ?mailbox_open_or_create?: deleted-to-trash-plugin.c:79: error: ?MAILBOX_FLAG_KEEP_RECENT? undeclared (first use in this function) deleted-to-trash-plugin.c:79: error: (Each undeclared identifier is reported only once deleted-to-trash-plugin.c:79: error: for each function it appears in.) deleted-to-trash-plugin.c: In function ?copy_deleted_mail_to_trash?: deleted-to-trash-plugin.c:136: warning: passing argument 1 of ?mailbox_keywords_unref? from incompatible pointer type /usr/include/dovecot/mail-storage.h:612: note: expected ?struct mail_keywords **? but argument is of type ?struct mailbox *? deleted-to-trash-plugin.c:136: error: too many arguments to function ?mailbox_keywords_unref? make: *** [lib_deleted_to_trash_plugin.so] Error 1 Gr??e, Sven. -- Sigmentation fault. Core dumped. From sven at svenhartge.de Fri Aug 24 17:29:15 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Aug 2012 16:29:15 +0200 Subject: [Dovecot] Trying to fix delete_to_trash plugin (was: quota: ignore deleted messages (?)) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503784A5.8080606@schetterer.org> Message-ID: Sven Hartge wrote: > Nope, does not compile (dovecot-dev headers are installed): OK, trying to fix this, without having any deeper knowlege of C (anymore): > deleted-to-trash-plugin.c: In function ?mailbox_open_or_create?: > deleted-to-trash-plugin.c:79: error: ?MAILBOX_FLAG_KEEP_RECENT? undeclared (first use in this function) MAILBOX_FLAG_KEEP_RECENT is not present in 2.1, seems to me it was made the default and MAILBOX_FLAG_DROP_RECENT was introduced as its counterpart. I removed the flag from the call to mailbox_alloc() in 72 static struct mailbox * 73 mailbox_open_or_create(struct mailbox_list *list, const char *name, 74 const char **error_r) 75 { 76 struct mailbox *box; 77 enum mail_error error; 78 79 box = mailbox_alloc(list, name, MAILBOX_FLAG_NO_INDEX_FILES); 80 if (mailbox_open(box) == 0) { 81 *error_r = NULL; 82 return box; 83 } 84 and retried to compile: cc \ -fPIC -shared -Wall \ -I/usr/include/dovecot \ -I/usr/include/dovecot/src \ -I/usr/include/dovecot/src/lib \ -I/usr/include/dovecot/src/lib-storage \ -I/usr/include/dovecot/src/lib-mail \ -I/usr/include/dovecot/src/lib-imap \ -I/usr/include/dovecot/src/lib-index \ -DHAVE_CONFIG_H \ deleted-to-trash-plugin.c -o lib_deleted_to_trash_plugin.so deleted-to-trash-plugin.c: In function ?copy_deleted_mail_to_trash?: deleted-to-trash-plugin.c:135: warning: passing argument 1 of ?mailbox_keywords_unref? from incompatible pointer type /usr/include/dovecot/mail-storage.h:612: note: expected ?struct mail_keywords **? but argument is of type ?struct mailbox *? deleted-to-trash-plugin.c:135: error: too many arguments to function ?mailbox_keywords_unref? make: *** [lib_deleted_to_trash_plugin.so] Error 1 _and_ now I am at the end of my wisdom. Pointer magic in C has always been a dark dark mystery to me (I learned programming in Pascal, Ada95 and later Perl ...). Help, anybody? Gr??e, Sven. -- Sigmentation fault. Core dumped. From wagnermazevedo at hotmail.com Fri Aug 24 22:23:43 2012 From: wagnermazevedo at hotmail.com (Wagner Michel Martins de Azevedo) Date: Fri, 24 Aug 2012 16:23:43 -0300 Subject: [Dovecot] Shared mdboxes Message-ID: Hi Timo, I'm trying to share two folders. The first one it's public and the other is per user based, using acl's to control access etc . Dovecot create the folders, but when I'll subscribe using ThunderBird client both of them seens like watermarked and has a "mailboxes" folder inside. I can set up the acl's rules using Thunderbird. Log files like mail.log don't show nothing in special and mail.err has nothing. Here is the config. # 2.1.8 (b4cd382b6606): /etc/dovecot/dovecot.conf# OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.5 /etc/dovecot/conf.d/10.mail.conf namespace { type = public separator = . prefix = public. location = mdbox:/var/mail_shares/public:INDEX=/var/mail_shares/public subscriptions = no}namespace { type = shared separator = . prefix = %h/shared location = mdbox:%h/shared:INDEX=%h/shared subscriptions = no list = children} Thanks, Wagner Azevedo From tss at iki.fi Sat Aug 25 01:04:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 01:04:10 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <892ajb13nov8@mids.svenhartge.de> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: On 24.8.2012, at 16.13, Sven Hartge wrote: >>> quota_rule = *:storage=1G:ignoredeleted >>> quota_rule2 = Trash:storage=+100M > >> This can't be implemented race-condition-free without huge changes to code. > > Damn, too bad. > > I know for sure either my users or my 1st level support team are going > to kill me if I don't find a solution. How about just disabling the quota enforcing and doing a nightly run of some type of enforcing (sending notification email and/or disabling new mail delivery until user has more quota again)? From sven at svenhartge.de Sat Aug 25 01:49:12 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 00:49:12 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: Timo Sirainen wrote: > On 24.8.2012, at 16.13, Sven Hartge wrote: >>>> quota_rule = *:storage=1G:ignoredeleted >>>> quota_rule2 = Trash:storage=+100M >> >>> This can't be implemented race-condition-free without huge changes to code. >> >> Damn, too bad. >> I know for sure either my users or my 1st level support team are >> going to kill me if I don't find a solution. > How about just disabling the quota enforcing and doing a nightly run > of some type of enforcing (sending notification email and/or disabling > new mail delivery until user has more quota again)? As a last resort, yes. If possible, I'd like to keep the feedback about mailbox size as direct as possible. Disabling an account only once per night might be acceptable, but the reenabling of the account, once a user has freed some space, has to be instant or I would get constant complains from the users (the ones with the biggest mailboxes being the professors, which can be quite the pain to work with, if they believe they don't get what they think they are entitled to get). I know, this all sounds a bit "whiny", but I've been working for over 8 years in this position and the harsh reality made me somewhat cautious. So far, the description of the delete_to_trash plugin sounds promising, because I can already ignore the Trash (or add to the total quota for this folder and do a nightly expunge run for it), if only it would compile for dovecot 2.1. Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Sat Aug 25 10:23:31 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 10:23:31 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: On 25.8.2012, at 1.49, Sven Hartge wrote: >> How about just disabling the quota enforcing and doing a nightly run >> of some type of enforcing (sending notification email and/or disabling >> new mail delivery until user has more quota again)? > > As a last resort, yes. If possible, I'd like to keep the feedback about > mailbox size as direct as possible. > > Disabling an account only once per night might be acceptable, but the > reenabling of the account, once a user has freed some space, has to be > instant or I would get constant complains from the users (the ones with > the biggest mailboxes being the professors, which can be quite the pain > to work with, if they believe they don't get what they think they are > entitled to get). You can use quota warning scripts to send warnings and enable account instantly when it goes under 100%. > So far, the description of the delete_to_trash plugin sounds promising, > because I can already ignore the Trash (or add to the total quota for > this folder and do a nightly expunge run for it), if only it would > compile for dovecot 2.1. I don't like the idea behind deleted_to_trash and won't offer any support for it if I don't have to. From tresh_dovecot at lefoyer.ru Sat Aug 25 11:05:39 2012 From: tresh_dovecot at lefoyer.ru ((Dovecot) Sergey Sidlyarenko) Date: Sat, 25 Aug 2012 12:05:39 +0400 Subject: [Dovecot] Problem use localized prefix in namespace In-Reply-To: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> References: <8201FD32-B294-4EA6-9F5C-F2AD7949A147@iki.fi> Message-ID: <23adeb68feb387bd625b1d2d1424a987@lefoyer.ru> Thank you, it works. Timo Sirainen ????? 2012-08-23 23:57: > On 17.8.2012, at 21.37, (Dovecot) Sergey Sidlyarenko wrote: > >> Problem with localized prefix in namespace. > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/ade94fde249e -- Best regards, Sidlyarenko Sergey Aleksandrovish +7(495)509-42-07 tresh_dovecot at lefoyer.ru mailto:tresh_dovecot at lefoyer.ru From tss at iki.fi Sat Aug 25 11:25:10 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 11:25:10 +0300 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> <20120824070140.09041498@scorpio> Message-ID: <7EC6E90E-3757-440B-A6B7-DBFB70D430A2@iki.fi> On 24.8.2012, at 14.18, Matthew Powell wrote: > On 2012-08-24, at 7.01, Jerry wrote: > >> I would personally recommend supporting it. If history teaches us >> anything, it is that sooner or later, and usually sooner, someone will >> require that block. Being prepared for it in advance would seem like >> the prudent thing to do. > > I wonder whether it would be better to make the exclusion list configurable. The reason for this default exclusion list is exactly to avoid behaving badly in unconfigured systems. Normally people should be using Dovecot proxies and login_trusted_networks setting configured to avoid the problem entirely. From zucca at systemschmiede.com Sat Aug 25 14:11:01 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Sat, 25 Aug 2012 13:11:01 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <50353D32.2080401@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> Message-ID: <5038B2C5.3090408@systemschmiede.com> Hi List, i found out the following: The problem with the "ghostfolder" occurs only if i use prefix = shares/%%n/ When using prefix = shares/%%u/ everytung's ok! Only the name of the folder is a little longish this way, so i would really prefer the %%n way. Any ideas now? Thank you Sascha Am 22.08.2012 22:12, schrieb Sascha Zucca: > If you should need any more info on this, just drop me a line. > I am fully stuck! > I think that my dovecot.conf is not put together well, only i can't > find the problem... > > Thanx > Sascha > > Am 22.08.2012 01:44, schrieb Sascha Zucca: >> Hi list, >> i have a strange "ghost" folder in my subscription list and just >> can't find out how to get rid of it. >> It seems to be someones Inbox, but it doesn't tell me whose. >> >> Here's a screenshot of Open-Xchanges Web-GUI: >> /http://s9.postimage.org/6aohh97ov/iehadjhb.jpg >> / >> As you can see there is an unamed folder just under Freigaben (Shares). >> >> >> In Thunderbird: >> /http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg/ >> >> Now the Folder is "INBOX"...But it is noones Inbox, as the >> corresponding user (amazon e.g.) should be a prefix-folder right >> before the share. >> >> >> some output over Telnet: >> >> 1 lsub "" "*" >> * LSUB () "/" "INBOX" >> * LSUB () "/" "INBOX/Amazon" >> * LSUB () "/" "INBOX/Bestellung" >> * LSUB () "/" "Drafts" >> * LSUB () "/" "Sent Items" >> * LSUB () "/" "Spam" >> * LSUB () "/" "Trash" >> * LSUB () "/" "Freigaben/amazon/INBOX" >> 1 OK Lsub completed. >> >> >> 1 list "" "*" >> * LIST (\HasNoChildren) "/" "Trash" >> * LIST (\HasNoChildren) "/" "Sent Items" >> * LIST (\HasChildren) "/" "INBOX" >> * LIST (\HasNoChildren) "/" "INBOX/Amazon" >> * LIST (\HasNoChildren) "/" "INBOX/Bestellung" >> * LIST (\HasNoChildren) "/" "Spam" >> * LIST (\HasNoChildren) "/" "Drafts" >> * LIST (\Noselect \HasChildren) "/" "Freigaben/amazon" >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> * LIST (\HasNoChildren) "/" "Freigaben/amazon/INBOX" >> 1 OK List completed. >> >> >> This looks a bit strange to me: >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> But i don't know really if that is the ghostfolder. >> >> >> finally here's the interesting part in my dovecot.conf: >> / >> namespace private { >> separator = / >> prefix = >> #location defaults to mail_location. >> inbox = yes >> } >> >> namespace shared { >> separator = / >> prefix = Freigaben/%%n/ >> location = >> maildir:/var/mail/vhosts/%%d/%%n/:INDEX=/var/mail/vhosts/%%d/%%n/ >> subscriptions = no >> list = children >> inbox = no >> } >> / >> >> Any idea how to banish the ghost in the machine? >> >> Thank you very much >> Sascha >> >> > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Sat Aug 25 14:53:11 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 14:53:11 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5038B2C5.3090408@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> Message-ID: <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> On 25.8.2012, at 14.11, Sascha Zucca wrote: > Hi List, > i found out the following: > The problem with the "ghostfolder" occurs only if i use > > prefix = shares/%%n/ > > When using > prefix = shares/%%u/ > > everytung's ok! What Dovecot version? From sven at svenhartge.de Sat Aug 25 15:40:22 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 14:40:22 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 1.49, Sven Hartge wrote: >>> How about just disabling the quota enforcing and doing a nightly run >>> of some type of enforcing (sending notification email and/or >>> disabling new mail delivery until user has more quota again)? >> >> As a last resort, yes. If possible, I'd like to keep the feedback >> about mailbox size as direct as possible. >> >> Disabling an account only once per night might be acceptable, but the >> reenabling of the account, once a user has freed some space, has to >> be instant or I would get constant complains from the users (the ones >> with the biggest mailboxes being the professors, which can be quite >> the pain to work with, if they believe they don't get what they think >> they are entitled to get). > You can use quota warning scripts to send warnings and enable account > instantly when it goes under 100%. Warning the user at 95%, 97% and 99% using the warning scripts is easy and was already configured and is working like a charm. Disabling the account in a nightly cronjob will be easy as well. Since I use the Mysql-dict for quota, I can just query that, compare the value to the configured quota from LDAP and act accordingly. But how do I instantly reenable the account when it drops below 100% with the warning scripts? As far as I understand the documentation, they are only triggered if the quota use rises over the configured thresholds. I seem to somehow miss a piece, but I cannot see which one. Gr??e, Sven. -- Sigmentation fault. Core dumped. From zucca at systemschmiede.com Sat Aug 25 15:56:17 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Sat, 25 Aug 2012 14:56:17 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> Message-ID: <5038CB71.5010808@systemschmiede.com> Hi Timo, dovecot --version 1.2.15 It's the stable one for debian squeeze i presume. Thank you for your help. Sascha Am 25.08.2012 13:53, schrieb Timo Sirainen: > On 25.8.2012, at 14.11, Sascha Zucca wrote: > >> Hi List, >> i found out the following: >> The problem with the "ghostfolder" occurs only if i use >> >> prefix = shares/%%n/ >> >> When using >> prefix = shares/%%u/ >> >> everytung's ok! > What Dovecot version? > > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Sat Aug 25 16:06:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 16:06:23 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5038CB71.5010808@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. On 25.8.2012, at 15.56, Sascha Zucca wrote: > Hi Timo, > dovecot --version > 1.2.15 > > It's the stable one for debian squeeze i presume. > > Thank you for your help. > > Sascha > > > Am 25.08.2012 13:53, schrieb Timo Sirainen: >> On 25.8.2012, at 14.11, Sascha Zucca wrote: >> >>> Hi List, >>> i found out the following: >>> The problem with the "ghostfolder" occurs only if i use >>> >>> prefix = shares/%%n/ >>> >>> When using >>> prefix = shares/%%u/ >>> >>> everytung's ok! >> What Dovecot version? >> >> > > > -- > Systemschmiede IT-L?sungen > Zucca & Teves GbR > August-Thyssen-Str. 2-4 > 52511 Geilenkirchen > www.systemschmiede.com > > > Tel.: 02451 - 9088390 > Fax: 02451 - 9124070 > Mobil: 0178 - 4073254 > > Ust.ID: DE248030393 > From tss at iki.fi Sat Aug 25 16:09:40 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 16:09:40 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> On 25.8.2012, at 15.40, Sven Hartge wrote: > Warning the user at 95%, 97% and 99% using the warning scripts is easy > and was already configured and is working like a charm. > > But how do I instantly reenable the account when it drops below 100% > with the warning scripts? As far as I understand the documentation, they > are only triggered if the quota use rises over the configured > thresholds. Setting the warning at -100% would do that I think. In any case "-" before the percentage means "reverse". Yeah, not in wiki, I'll add it there.. From sven at svenhartge.de Sat Aug 25 18:28:49 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 17:28:49 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 15.40, Sven Hartge wrote: >> Warning the user at 95%, 97% and 99% using the warning scripts is >> easy and was already configured and is working like a charm. >> >> But how do I instantly reenable the account when it drops below 100% >> with the warning scripts? As far as I understand the documentation, >> they are only triggered if the quota use rises over the configured >> thresholds. > Setting the warning at -100% would do that I think. In any case "-" > before the percentage means "reverse". Yeah, not in wiki, I'll add it > there.. Ah, very nice. Now I need to put the pieces together and test whether this is a working solution for me. Question: is it possible to enforce the quota for IMAP/POP and have it on noenforcing for LDA/LMTP? LDA would be easy, as I could just add -o "plugin/quota=dict:Benutzer-Quota::noenforcing:proxy::quota" to the command line of dovecot-ldap in my exim4.conf. But because of performance considerations I want to use LMTP to deliver the mails. Would this nested plugin configuration work: (sorry, not at work, cannot test directly) protocol lmtp { mail_plugins = $mail_plugins sieve plugin { quota = dict:Benutzer-Quota::noenforcing:proxy::quota } } Gr??e, Sven. -- Sigmentation fault. Core dumped. From tss at iki.fi Sat Aug 25 18:39:51 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 18:39:51 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: <20B68DD0-7919-4843-9568-B17597656CEE@iki.fi> On 25.8.2012, at 18.28, Sven Hartge wrote: > But because of performance considerations I want to use LMTP to deliver > the mails. Would this nested plugin configuration work: > (sorry, not at work, cannot test directly) > > protocol lmtp { > mail_plugins = $mail_plugins sieve > plugin { > quota = dict:Benutzer-Quota::noenforcing:proxy::quota > } > } That should work, yes. From sven at svenhartge.de Sat Aug 25 18:45:56 2012 From: sven at svenhartge.de (Sven Hartge) Date: Sat, 25 Aug 2012 17:45:56 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> <20B68DD0-7919-4843-9568-B17597656CEE@iki.fi> Message-ID: Timo Sirainen wrote: > On 25.8.2012, at 18.28, Sven Hartge wrote: >> But because of performance considerations I want to use LMTP to deliver >> the mails. Would this nested plugin configuration work: >> (sorry, not at work, cannot test directly) >> >> protocol lmtp { >> mail_plugins = $mail_plugins sieve >> plugin { >> quota = dict:Benutzer-Quota::noenforcing:proxy::quota >> } >> } > That should work, yes. Very good, thank you for your fast answers. Gr??e, Sven. -- Sigmentation fault. Core dumped. From trashcan at odo.in-berlin.de Sat Aug 25 19:09:59 2012 From: trashcan at odo.in-berlin.de (Michael Grimm) Date: Sat, 25 Aug 2012 18:09:59 +0200 Subject: [Dovecot] dsync replication available for testing In-Reply-To: References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> Message-ID: <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> On 23.08.2012, at 22:01, Timo Sirainen wrote: > On 19.8.2012, at 12.51, Michael Grimm wrote: >>>> 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): >>>> >>>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: save: box=INBOX, uid=27, msgid=<3V2JfH5Kv4z7Ft at example.tld>, size=547, from=test at example.tld (admin), flags=() >>>> >>>> | mail dovecot: dsync-local(test): Error: remote: dsync-remote(test): Info: flag_change: box=TEST, uid=27568, msgid=<20120307144810.6360A74F013 at example.tld>, size=435, from=test at example.tld, flags=(\Seen) >>>> >>>> JFTR: I do have mail_log plugin activated. >>> >>> Hmm. Right. I guess all the logging should go to the log files instead of via the ssh pipe. Of course that would also require that dsync has write access to your log files. >> >> >> I'd like to come back to this old thread: What would one need to do to get rid of these lines from mail_log plugin? > > > Not enable mail_log for doveadm: > > protocol !doveadm { > mail_plugins = $mail_plugins = mail_log > } JFTR: That didn't work. > or alternatively override it only for the dsync command with doveadm -o mail_plugins=... But, a ... dsync_remote_cmd = ssh -l%{login} %{host} doveadm -o mail_plugins= dsync-server -u%u -l%{lock_timeout} -n%{namespace} ... did omit those error messages successfully. Thanks and regards, Michael From tss at iki.fi Sat Aug 25 20:16:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 20:16:49 +0300 Subject: [Dovecot] dsync replication available for testing In-Reply-To: <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> References: <4F53479E.40703@iki.fi> <47470ffe12f36af0b969ccd89bc1962a@mx1.enfer-du-nord.net> <1331206534.2081.101.camel@innu> <9FD26C0D-A02E-4E5B-84E8-F39C542EBE2F@odo.in-berlin.de> <14F084A6-55CC-4D01-8B2E-797A14E2FA07@odo.in-berlin.de> Message-ID: <5D96BF6D-31FA-4842-8A14-0E7F76B1C7C3@iki.fi> On 25.8.2012, at 19.09, Michael Grimm wrote: >> Not enable mail_log for doveadm: >> >> protocol !doveadm { >> mail_plugins = $mail_plugins = mail_log >> } > > JFTR: That didn't work. This would omit it from the local dsync. >> or alternatively override it only for the dsync command with doveadm -o mail_plugins=... > > But, a ... > > dsync_remote_cmd = ssh -l%{login} %{host} doveadm -o mail_plugins= dsync-server -u%u -l%{lock_timeout} -n%{namespace} > > ... did omit those error messages successfully. And yes, this would omit it from the remote dsync. From martin.rabl at rablnet.de Sat Aug 25 21:31:29 2012 From: martin.rabl at rablnet.de (Martin Rabl) Date: Sat, 25 Aug 2012 20:31:29 +0200 Subject: [Dovecot] UIDPLUS for Maildir? Message-ID: <50391A01.4030401@rablnet.de> Hi, I found the following comment in the documentation (http://wiki.dovecot.org/FeatUIDPLUS), last edited on 2009-03-15 > Dovecot already supported UIDPLUS at one point for mbox, but implementing it > for Maildir has to be done differently (UIDs are allocated later with Maildir). > So currently the UIDPLUS code is removed until it can be made to > work with Maildir. My question: does this extension now run with maildir? Thank you, Martin From kgc at corp.sonic.net Sat Aug 25 22:14:20 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Sat, 25 Aug 2012 12:14:20 -0700 Subject: [Dovecot] dovecot stats error In-Reply-To: <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> References: <4FE46641.4030801@schetterer.org> <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> Message-ID: <5039240C.1030003@corp.sonic.net> On 6/22/2012 6:34 AM, Timo Sirainen wrote: > Which Dovecot version? I thought I fixed this already.. I'm seeing these errors running 2.1.8 -- Kelsey Cummings - kgc at corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407 From tss at iki.fi Sat Aug 25 22:17:48 2012 From: tss at iki.fi (Timo Sirainen) Date: Sat, 25 Aug 2012 22:17:48 +0300 Subject: [Dovecot] UIDPLUS for Maildir? In-Reply-To: <50391A01.4030401@rablnet.de> References: <50391A01.4030401@rablnet.de> Message-ID: <236BEBF4-CEDD-4E86-9C9A-21BFACF2F027@iki.fi> On 25.8.2012, at 21.31, Martin Rabl wrote: > I found the following comment in the documentation (http://wiki.dovecot.org/FeatUIDPLUS), last edited on 2009-03-15 >> Dovecot already supported UIDPLUS at one point for mbox, but implementing it >> for Maildir has to be done differently (UIDs are allocated later with Maildir). >> So currently the UIDPLUS code is removed until it can be made to >> work with Maildir. > > My question: does this extension now run with maildir? Since v1.1 I think. From kgc at corp.sonic.net Sat Aug 25 22:55:23 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Sat, 25 Aug 2012 12:55:23 -0700 Subject: [Dovecot] dovecot stats error In-Reply-To: <5039240C.1030003@corp.sonic.net> References: <4FE46641.4030801@schetterer.org> <494CA511-4DC1-402B-9A00-D0678BBB1BF4@iki.fi> <5039240C.1030003@corp.sonic.net> Message-ID: <50392DAB.8010303@corp.sonic.net> On 8/25/2012 12:14 PM, Kelsey Cummings wrote: > On 6/22/2012 6:34 AM, Timo Sirainen wrote: >> Which Dovecot version? I thought I fixed this already.. > > I'm seeing these errors running 2.1.8 Examples below, let me know if I can provide any other info Timo. In other news, we're finally migrated to dovecot from courier. WHOOO HOOOO!!!! > Aug 25 12:53:37 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mcache 331 < 332 > Aug 25 12:53:37 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 180435729 < 204849088 > Aug 25 12:53:38 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 50757363 < 62351358 > Aug 25 12:53:38 d dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mlpath 17451 < 20067 > Aug 25 12:53:41 d dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 40483661 < 42086237 > Aug 25 12:53:42 b dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 65540465 < 67974537 > Aug 25 12:53:42 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mlpath 811 < 946 > Aug 25 12:53:43 b dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 220133763 < 221888538 > Aug 25 12:53:47 a dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mcache 13 < 14 > Aug 25 12:53:48 c dovecot: stats: Error: Mail server input error: UPDATE-SESSION: stats shrank: mrbytes 118702153 < 121714865 -- Kelsey Cummings - kgc at corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407 From daniel.parthey at informatik.tu-chemnitz.de Sun Aug 26 02:28:33 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Sun, 26 Aug 2012 01:28:33 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> Message-ID: <20120825232833.GA11297@daniel.localdomain> Sven Hartge wrote: > I want to use LMTP to deliver the mails. > Would this nested plugin configuration work to disable quota: > > protocol lmtp { > mail_plugins = $mail_plugins sieve > plugin { > quota = dict:Benutzer-Quota::noenforcing:proxy::quota > } > } Concerning http://dovecot.org/list/dovecot/2012-June/066298.html I'm using MySQL userdb, but just want to keep things as simple as possible (KISS principle). What would the configuration look like if I want to setup one lmtp service with quota enforcing on port 10024 and another lmtp service without enforcing on port 20024? Especially how to define two "protocol lmtp" sections which are assigned to their specific service? Will this work with two simple 'nested configuration' or will I need to define SQL statements in the userdb lookup which selects "noenforcing" depending on local port? Regards Daniel -- https://plus.google.com/103021802792276734820 From stan at hardwarefreak.com Sun Aug 26 06:55:34 2012 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Sat, 25 Aug 2012 22:55:34 -0500 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50378672.70208@googlemail.com> References: <50375D3E.50409@googlemail.com> <5037789F.3070500@hardwarefreak.com> <50378672.70208@googlemail.com> Message-ID: <50399E36.7030304@hardwarefreak.com> On 8/24/2012 8:49 AM, Tim Smith wrote: > My next guess was the upstream data rate. My router states that the > upstream is 10x slower than downstream so I guess this is the culprit. > Time to move to a VPS methinks... Ok, you stated that you have multiple user PCs that are slow when sending. I guess, asked, if they were all behind the same DSL/Cable line and if the Dovecot server was local or remote. If the user PCs are local, and the server is remote, and the slow outbound speed of your internet connection is the cause of the slow sending, then I fail to see how moving to a VPS will help you. You're not providing sufficient technical details explaining what machines are located where. We need to know that to give you the correct answer(s) to your problem. -- Stan From hawat.thufir at gmail.com Sun Aug 26 18:21:28 2012 From: hawat.thufir at gmail.com (Thufir) Date: Sun, 26 Aug 2012 08:21:28 -0700 Subject: [Dovecot] Java driver for doveadm Message-ID: I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and there a few features I like which javax.mail just doesn't have. Is there maybe a Java driver for doveadm? thanks, Thufir From kernel.picknick at gmail.com Sun Aug 26 18:40:34 2012 From: kernel.picknick at gmail.com (Alex) Date: Sun, 26 Aug 2012 17:40:34 +0200 Subject: [Dovecot] How to configure dovecot for specific mailboxes only? Message-ID: Hi, is it possible to configure dovecot so that it only serves mailboxes of specified users? All other users should be completely ignored so that no indexing of messages or other resource consuming actions take place. Thanks in advance, Alex From Ralf.Hildebrandt at charite.de Sun Aug 26 19:47:37 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Sun, 26 Aug 2012 18:47:37 +0200 Subject: [Dovecot] Recipe for "admin-less restore" Message-ID: <20120826164737.GD29284@charite.de> Is there a way for setting up dovecot in such a way that a user can "jump back in time" to an old mailbox "state" in order to retrieve his accidentially deleted mail? -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From lcaron at lncsa.com Sun Aug 26 22:00:04 2012 From: lcaron at lncsa.com (Laurent CARON) Date: Sun, 26 Aug 2012 21:00:04 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: <503A7234.40800@lncsa.com> On 26/08/2012 18:47, Ralf Hildebrandt wrote: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve his > accidentially deleted mail? Hi, We use snapshots for this namespace snaps-h-2 { prefix = INBOX.EmailBackup.h-2. hidden = no list = yes inbox = no location = maildir:/home/.snapshot/hourly.0/%u/Maildir:INDEX=/var/tmp/dovecot/indexes/hourly.0/%u:CONTROL=/var/tmp/dovecot/control/hourly.0/%u type = private } From me at junc.org Mon Aug 27 06:52:08 2012 From: me at junc.org (Benny Pedersen) Date: Mon, 27 Aug 2012 05:52:08 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: Den 2012-08-26 18:47, Ralf Hildebrandt skrev: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve > his > accidentially deleted mail? disable expunge ? From amateo at um.es Mon Aug 27 09:35:52 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 27 Aug 2012 08:35:52 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> Message-ID: <503B1548.9030605@um.es> El 25/08/12 09:23, Timo Sirainen escribi?: > On 25.8.2012, at 1.49, Sven Hartge wrote: > >>> How about just disabling the quota enforcing and doing a nightly run >>> of some type of enforcing (sending notification email and/or disabling >>> new mail delivery until user has more quota again)? >> >> As a last resort, yes. If possible, I'd like to keep the feedback about >> mailbox size as direct as possible. >> >> Disabling an account only once per night might be acceptable, but the >> reenabling of the account, once a user has freed some space, has to be >> instant or I would get constant complains from the users (the ones with >> the biggest mailboxes being the professors, which can be quite the pain >> to work with, if they believe they don't get what they think they are >> entitled to get). > > You can use quota warning scripts to send warnings and enable account instantly when it goes under 100%. > But, if you still use quota, you are still counting deleted messages in the quota. Aren't you? Is not easier just making users conscious of deleted messages? Many clients that hide deleted messages, show them in a trash folder (although they don't use move to trash) so it's easy for user to expunge deleted messages. And you could also run a cron to expunge old deleted messages from user mailboxes (for example, messages deleted more than 15 days ago) -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 From tss at iki.fi Mon Aug 27 10:00:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:00:09 +0300 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <20120826164737.GD29284@charite.de> References: <20120826164737.GD29284@charite.de> Message-ID: <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> On 26.8.2012, at 19.47, Ralf Hildebrandt wrote: > Is there a way for setting up dovecot in such a way that a user can > "jump back in time" to an old mailbox "state" in order to retrieve his > accidentially deleted mail? http://wiki2.dovecot.org/Plugins/Lazyexpunge is one possibility From tss at iki.fi Mon Aug 27 10:01:37 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:01:37 +0300 Subject: [Dovecot] How to configure dovecot for specific mailboxes only? In-Reply-To: References: Message-ID: On 26.8.2012, at 18.40, Alex wrote: > is it possible to configure dovecot so that it only serves mailboxes > of specified users? All other users should be completely ignored so > that no indexing of messages or other resource consuming actions take > place. You can configure passdb/userdb to give different settings to different users. So maybe for some users you return mail_location with :INDEX=MEMORY and don't accept their passwords. Depends on your setup what exactly you need to do.. From tss at iki.fi Mon Aug 27 10:01:54 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:01:54 +0300 Subject: [Dovecot] Java driver for doveadm In-Reply-To: References: Message-ID: On 26.8.2012, at 18.21, Thufir wrote: > I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and > there a few features I like which javax.mail just doesn't have. Is > there maybe a Java driver for doveadm? You can access doveadm via TCP socket. Would that be enough? From robert at schetterer.org Mon Aug 27 10:02:37 2012 From: robert at schetterer.org (Robert Schetterer) Date: Mon, 27 Aug 2012 09:02:37 +0200 Subject: [Dovecot] Recipe for "admin-less restore" In-Reply-To: <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> References: <20120826164737.GD29284@charite.de> <2DA01EE7-2CF5-436B-AFED-FF7A4D3AB2D3@iki.fi> Message-ID: <503B1B8D.9030705@schetterer.org> Am 27.08.2012 09:00, schrieb Timo Sirainen: > On 26.8.2012, at 19.47, Ralf Hildebrandt wrote: > >> Is there a way for setting up dovecot in such a way that a user can >> "jump back in time" to an old mailbox "state" in order to retrieve his >> accidentially deleted mail? > > http://wiki2.dovecot.org/Plugins/Lazyexpunge is one possibility > also possible you may setup an archive solution i.e with bc copy send to another mail account -- Best Regards MfG Robert Schetterer From tss at iki.fi Mon Aug 27 10:03:15 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 10:03:15 +0300 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: <50375D3E.50409@googlemail.com> References: <50375D3E.50409@googlemail.com> Message-ID: On 24.8.2012, at 13.53, Tim Smith wrote: > Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! Other than the bandwidth others already mentioned, the only reason it could be Dovecot's fault is exactly the size of the Sent mailbox. How large is that and what mailbox format are you using? From sven at svenhartge.de Mon Aug 27 11:59:08 2012 From: sven at svenhartge.de (Sven Hartge) Date: Mon, 27 Aug 2012 10:59:08 +0200 Subject: [Dovecot] quota: ignore deleted messages (?) References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <503B1548.9030605@um.es> Message-ID: <1192i1o63nov8@mids.svenhartge.de> Angel L. Mateo wrote: > El 25/08/12 09:23, Timo Sirainen escribi?: >> On 25.8.2012, at 1.49, Sven Hartge wrote: >> >>>> How about just disabling the quota enforcing and doing a nightly run >>>> of some type of enforcing (sending notification email and/or disabling >>>> new mail delivery until user has more quota again)? >>> >>> As a last resort, yes. If possible, I'd like to keep the feedback about >>> mailbox size as direct as possible. >>> >>> Disabling an account only once per night might be acceptable, but the >>> reenabling of the account, once a user has freed some space, has to be >>> instant or I would get constant complains from the users (the ones with >>> the biggest mailboxes being the professors, which can be quite the pain >>> to work with, if they believe they don't get what they think they are >>> entitled to get). >> You can use quota warning scripts to send warnings and enable account >> instantly when it goes under 100%. >> > But, if you still use quota, you are still counting deleted messages > in the quota. Aren't you? Quota would be noenforcing. So the users still sees "105% of quota used" but this does not result in any mail bouncing at once. Gr??e, Sven. -- Sigmentation fault. Core dumped. From aconraz at gmail.com Mon Aug 27 12:11:48 2012 From: aconraz at gmail.com (Alano Conraz) Date: Mon, 27 Aug 2012 11:11:48 +0200 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins Message-ID: Hello, i don't know if it a the right place to ask my question related to the development of dovecot plugins, please correct me if it is not. I'm trying some dovecot plugin development. I did a little plugin that suit my needs but i'd like to go further now... I would like to know if there is a kind of "getenv" function that I could call to retrieve in my plugin the username of the mailbox being delivered by dovecot-lda or served by imap server. For example, when I use the deliver with "cat file.txt | deliver -d " user at domain.net" -f "me at domain.net" I would like to call a function that could return for me the argument of "-d" or "-f". i'm working with dovecot 2.0.17 by now. Thank you From tss at iki.fi Mon Aug 27 12:15:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 12:15:49 +0300 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: References: Message-ID: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> On 27.8.2012, at 12.11, Alano Conraz wrote: > I'm trying some dovecot plugin development. I did a little plugin that suit > my needs but i'd like to go further now... I would like to know if there is > a kind of "getenv" function that I could call to retrieve in my plugin the > username of the mailbox being delivered by dovecot-lda or served by imap > server. struct mail_user->username has it. How you get to struct mail_user depends on where you want to access it from. Note that each process is capable of handling multiple different users (although it's not commonly done). From amateo at um.es Mon Aug 27 13:32:13 2012 From: amateo at um.es (Angel L. Mateo) Date: Mon, 27 Aug 2012 12:32:13 +0200 Subject: [Dovecot] doveadm commands returning 139 at director servers Message-ID: <503B4CAD.6090908@um.es> Hello, I have configured director in front of dovecot imap/pop/lmtp servers. When I need to manipulate a user mailbox, I use doveadm commands at director server's, with -S option. But some commands return exit code 139 when command returns more than 40 entries (I think). For example, the command: sudo doveadm fetch -u amateo hdr mailbox Trash HEADER Subject "nyctalus11/" executed at the backend server returns 952 mails, but executed at director server with -S option, returns only 40 mails and exit code 139. I'm using dovecot 2.1.5 and I attached doveconf -n at director and backend servers. -- Angel L. Mateo Mart?nez Secci?n de Telem?tica ?rea de Tecnolog?as de la Informaci?n y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868887590 Fax: 868888337 -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.2.19um1 x86_64 Ubuntu 12.04.1 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_verbose = yes default_process_limit = 1024 disable_plaintext_auth = no log_timestamp = %Y-%m-%d %H:%M:%S login_trusted_networks = 155.54.211.176/28 mail_debug = yes mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n mail_privileged_group = mail mdbox_rotate_size = 20 M namespace { inbox = yes location = prefix = separator = . } namespace { hidden = yes list = no location = maildir:~/Maildir/expunged prefix = BORRADOS. separator = . } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = session=yes dovecot driver = pam } plugin { lazy_expunge = BORRADOS. quota = maildir:User quota quota_rule = *:storage=20G quota_rule2 = Trash:storage=+1G sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at um.es service anvil { client_limit = 2051 } service auth { client_limit = 3072 unix_listener auth-userdb { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap { process_limit = 5120 process_min_avail = 6 vsz_limit = 512 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3 { process_min_avail = 6 } ssl = no ssl_cert = } -------------- next part -------------- # 2.1.5: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-24-generic x86_64 Ubuntu 12.04.1 LTS auth_cache_size = 20 M auth_cache_ttl = 1 days auth_debug = yes auth_master_user_separator = * auth_username_format = %n auth_verbose = yes default_process_limit = 1024 director_mail_servers = 155.54.211.161-155.54.211.164 director_servers = 155.54.211.185 155.54.211.186 director_username_hash = %n disable_plaintext_auth = no doveadm_proxy_port = 24245 lmtp_proxy = yes log_timestamp = %Y-%m-%d %H:%M:%S mail_debug = yes passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = proxy=y nopassword=y proxy_timeout=600 driver = static } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +imapflags sieve_max_redirects = 15 } service anvil { client_limit = 2051 } service auth { client_limit = 3072 unix_listener auth-userdb { mode = 0666 } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { inet_listener { port = 24245 } } service imap-login { client_limit = 2206 executable = imap-login director process_limit = 6 process_min_avail = 6 service_count = 0 } service imap { process_limit = 5120 process_min_avail = 6 vsz_limit = 512 M } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 vsz_limit = 512 M } service pop3-login { client_limit = 833 executable = pop3-login director process_limit = 6 process_min_avail = 6 service_count = 0 } service pop3 { process_min_avail = 6 } ssl = no ssl_cert = } From benjamin.guy.thomas at gmail.com Mon Aug 27 13:40:10 2012 From: benjamin.guy.thomas at gmail.com (Benjamin Thomas) Date: Mon, 27 Aug 2012 12:40:10 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects Message-ID: Hi, I'm running a small email server with the help of iRedMail. I can manage sieve scripts from the Rouncube web interface or manually inside the user's personal sieve folder. I have an email account setup to receive automated tasks. Some of these "alerts" occur too often and they have the same subject line, but different senders. This is the rule I am currently using: ##CODE START## # rule:[AutoAlerts] if anyof ( header :matches "Subject" "AutoAlert Type1*", header :matches "Subject" "AutoAlert Type2*", header :matches "Subject" "AutoAlert Type3*" ) { fileinto "INBOX.AutoAlerts"; stop; } ##CODE END## I was wondering if it's possible to gracefully handle duplicate subjects lines (within a given time frame) with sieve filters ? Ideally, I would like the first email of the day with subject ""AutoAlert Type1..." to get moved to the subfolder given above. Subsequent "duplicate" emails would then go into a "duplicate" subfolder. Is this possible with sieve filters ? I could not find anything striking me as obvious while reading the page http://wiki.dovecot.org/LDA/Sieve. Thanks very much for your input. From alessio at skye.it Mon Aug 27 16:33:44 2012 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 27 Aug 2012 15:33:44 +0200 Subject: [Dovecot] Java driver for doveadm In-Reply-To: References: Message-ID: <503B7738.1040308@skye.it> Il 27/08/2012 09:01, Timo Sirainen ha scritto: > On 26.8.2012, at 18.21, Thufir wrote: > >> I've looked at http://wiki2.dovecot.org/Tools/Doveadm/Mailbox and >> there a few features I like which javax.mail just doesn't have. Is >> there maybe a Java driver for doveadm? > You can access doveadm via TCP socket. Would that be enough? > How can I configure doveadm to listen via socket? I'm developing an interface, in Ruby, to manage a mail server and could be useful. Thanks -- Alessio Cecchi is: @ ILS -> http://www.linux.it/~alessice/ on LinkedIn -> http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux -> http://www.cecchi.biz/ @ PLUG -> ex-Presidente, adesso senatore a vita, http://www.prato.linux.it From aconraz at gmail.com Mon Aug 27 16:47:12 2012 From: aconraz at gmail.com (Alano Conraz) Date: Mon, 27 Aug 2012 15:47:12 +0200 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> References: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> Message-ID: > > struct mail_user->username has it. How you get to struct mail_user depends > on where you want to access it from. Note that each process is capable of > handling multiple different users (although it's not commonly done). > i'm not sure to understand the last part. mail_user->username is a char *, right ? What is the content of the string if there is multiple users ? Thanks for your answer btw. From tss at iki.fi Mon Aug 27 16:51:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 16:51:03 +0300 Subject: [Dovecot] plugin development: retrieve username -d -f inside plugins In-Reply-To: References: <894B8830-0204-4348-854A-D20F87B897D5@iki.fi> Message-ID: On 27.8.2012, at 16.47, Alano Conraz wrote: > struct mail_user->username has it. How you get to struct mail_user depends on where you want to access it from. Note that each process is capable of handling multiple different users (although it's not commonly done). > > i'm not sure to understand the last part. mail_user->username is a char *, right ? What is the content of the string if there is multiple users ? > Thanks for your answer btw. Each user has a separate struct mail_user. I was mainly trying to say that that's the reason for why there's no global variable or such where you can get access to the username. From tss at iki.fi Mon Aug 27 16:54:28 2012 From: tss at iki.fi (Timo Sirainen) Date: Mon, 27 Aug 2012 16:54:28 +0300 Subject: [Dovecot] Java driver for doveadm In-Reply-To: <503B7738.1040308@skye.it> References: <503B7738.1040308@skye.it> Message-ID: <74977FCB-7525-42B5-BFFB-DF8B390871FA@iki.fi> On 27.8.2012, at 16.33, Alessio Cecchi wrote: > How can I configure doveadm to listen via socket? I'm developing an interface, in Ruby, to manage a mail server and could be useful. http://wiki2.dovecot.org/Director#Doveadm_server has an example. Now, what the protocol itself looks like isn't documented anywhere currently.. You could look at what doveadm sends when it's talking to a remote doveadm server via -s host:port parameter. Or from code see doveadm-mail-server.c:doveadm_mail_server_handle() From zucca at systemschmiede.com Mon Aug 27 18:05:52 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Mon, 27 Aug 2012 17:05:52 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: <503B8CD0.5070202@systemschmiede.com> Hi Timo, hi list I upgraded: dovecot --version 2.1.7 But still i have this ghostfolder as soon as i want to use prefix = shares/%%n/ all is good, when using prefix = shares/%%u/ Any idea what could be wrong? Thank you very much Sascha Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 Am 25.08.2012 15:06, schrieb Timo Sirainen: > It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. > > On 25.8.2012, at 15.56, Sascha Zucca wrote: > >> Hi Timo, >> dovecot --version >> 1.2.15 >> >> It's the stable one for debian squeeze i presume. >> >> Thank you for your help. >> >> Sascha >> >> >> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>> >>>> Hi List, >>>> i found out the following: >>>> The problem with the "ghostfolder" occurs only if i use >>>> >>>> prefix = shares/%%n/ >>>> >>>> When using >>>> prefix = shares/%%u/ >>>> >>>> everytung's ok! >>> What Dovecot version? >>> >>> >> >> -- >> Systemschmiede IT-L?sungen >> Zucca & Teves GbR >> August-Thyssen-Str. 2-4 >> 52511 Geilenkirchen >> www.systemschmiede.com >> >> >> Tel.: 02451 - 9088390 >> Fax: 02451 - 9124070 >> Mobil: 0178 - 4073254 >> >> Ust.ID: DE248030393 >> From pj.netfilter at gmail.com Tue Aug 28 10:47:41 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 13:17:41 +0530 Subject: [Dovecot] Help with Virtual Plugin Message-ID: Dear Experts, I have configured virtual plugin for my setup which is working as expected but after this dovecot lda is unable to deliver message to any mailbox and showing following error:- Error: user XXXXX: Initialization failed: Namespace 'virtual.': Unknown mail storage driver virtual Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to server log for more information. Here is Namespace setting on my server:- namespace { type = private separator = . prefix = inbox = yes } namespace { prefix = virtual. separator = . location = virtual:~/Maildir/virtual:LAYOUT=maildir++ } Please let me know what could be the issue.. From robert at schetterer.org Tue Aug 28 11:21:57 2012 From: robert at schetterer.org (Robert Schetterer) Date: Tue, 28 Aug 2012 10:21:57 +0200 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: References: Message-ID: <503C7FA5.5020400@schetterer.org> Am 28.08.2012 09:47, schrieb Joy: > Dear Experts, > I have configured virtual plugin for my setup > which is working as expected but after this dovecot lda is unable to > deliver message to any mailbox and showing following error:- > > > Error: user XXXXX: Initialization failed: Namespace 'virtual.': > Unknown mail storage driver virtual > Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to > server log for more information. > > Here is Namespace setting on my server:- > > > namespace { > type = private > separator = . > prefix = > inbox = yes > } > > namespace { > prefix = virtual. > separator = . > location = virtual:~/Maildir/virtual:LAYOUT=maildir++ > } > > > Please let me know what could be the issue.. > have you read http://wiki2.dovecot.org/Plugins/Virtual ? do you load mail_plugins = $mail_plugins virtual ? show you whole setup -- Best Regards MfG Robert Schetterer From zucca at systemschmiede.com Tue Aug 28 11:30:02 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Tue, 28 Aug 2012 10:30:02 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> Message-ID: <503C818A.4010203@systemschmiede.com> another update on this: I have this in my logfile: Debug: Namespace : type=shared, prefix=Freigaben/%u/, sep=/, inbox=no, hidden=yes, list=children, subscriptions=no location=maildir:/var/vmail/%d/%n/Maildir:INDEX=/var/vmail/parrotshop.de/testuser-2/Maildir/shared/%u Though this is in my dovecot.conf: prefix=Freigaben/%%u/ location=maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u How come? And does this behaviour maybe also explain the unnamed folder i have when using prefix=Freigaben/%%n/ instead of %%u ? Thanks for your assistance Sascha > > Hi Timo, hi list > I upgraded: > dovecot --version > 2.1.7 > But still i have this ghostfolder as soon as i want to use > prefix = shares/%%n/ > > all is good, when using > prefix = shares/%%u/ > > > Any idea what could be wrong? > > > Thank you very much > Sascha > > Systemschmiede IT-L?sungen > Zucca & Teves GbR > August-Thyssen-Stra?e 2-4 > 52511 Geilenkirchen > www.systemschmiede.com > > > Tel.: 02451 - 9088390 > Fax: 02451 - 9124070 > Mobil: 0178 - 4073254 > > Ust.ID: DE248030393 > > Am 25.08.2012 15:06, schrieb Timo Sirainen: >> It's very likely that this has been fixed in v2.1. And in any case I'm not fixing non-security bugs anymore for v1.x. You can find v2.x debian packages from backports.org. >> >> On 25.8.2012, at 15.56, Sascha Zucca wrote: >> >>> Hi Timo, >>> dovecot --version >>> 1.2.15 >>> >>> It's the stable one for debian squeeze i presume. >>> >>> Thank you for your help. >>> >>> Sascha >>> >>> >>> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>>> >>>>> Hi List, >>>>> i found out the following: >>>>> The problem with the "ghostfolder" occurs only if i use >>>>> >>>>> prefix = shares/%%n/ >>>>> >>>>> When using >>>>> prefix = shares/%%u/ >>>>> >>>>> everytung's ok! >>>> What Dovecot version? >>>> >>>> >>> >>> -- >>> Systemschmiede IT-L?sungen >>> Zucca & Teves GbR >>> August-Thyssen-Str. 2-4 >>> 52511 Geilenkirchen >>> www.systemschmiede.com >>> >>> >>> Tel.: 02451 - 9088390 >>> Fax: 02451 - 9124070 >>> Mobil: 0178 - 4073254 >>> >>> Ust.ID: DE248030393 >>> > From pj.netfilter at gmail.com Tue Aug 28 14:19:27 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 16:49:27 +0530 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: <503C7FA5.5020400@schetterer.org> References: <503C7FA5.5020400@schetterer.org> Message-ID: I have loaded the module in IMAP file as suggested in wiki. On Tue, Aug 28, 2012 at 1:51 PM, Robert Schetterer wrote: > Am 28.08.2012 09:47, schrieb Joy: >> Dear Experts, >> I have configured virtual plugin for my setup >> which is working as expected but after this dovecot lda is unable to >> deliver message to any mailbox and showing following error:- >> >> >> Error: user XXXXX: Initialization failed: Namespace 'virtual.': >> Unknown mail storage driver virtual >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to >> server log for more information. >> >> Here is Namespace setting on my server:- >> >> >> namespace { >> type = private >> separator = . >> prefix = >> inbox = yes >> } >> >> namespace { >> prefix = virtual. >> separator = . >> location = virtual:~/Maildir/virtual:LAYOUT=maildir++ >> } >> >> >> Please let me know what could be the issue.. >> > > have you read > > http://wiki2.dovecot.org/Plugins/Virtual ? > > do you load > > mail_plugins = $mail_plugins virtual ? > > show you whole setup > > -- > Best Regards > MfG Robert Schetterer From Ralf.Hildebrandt at charite.de Tue Aug 28 14:24:08 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Tue, 28 Aug 2012 13:24:08 +0200 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: References: <503C7FA5.5020400@schetterer.org> Message-ID: <20120828112408.GD14245@charite.de> * Joy : > I have loaded the module in IMAP file as suggested in wiki. But the LDA is throwing the error. Did you add it there as well? > >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to > >> server log for more information. -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From pj.netfilter at gmail.com Tue Aug 28 16:02:08 2012 From: pj.netfilter at gmail.com (Joy) Date: Tue, 28 Aug 2012 18:32:08 +0530 Subject: [Dovecot] Help with Virtual Plugin In-Reply-To: <20120828112408.GD14245@charite.de> References: <503C7FA5.5020400@schetterer.org> <20120828112408.GD14245@charite.de> Message-ID: Thanks .. It helped me .. On Tue, Aug 28, 2012 at 4:54 PM, Ralf Hildebrandt wrote: > * Joy : >> I have loaded the module in IMAP file as suggested in wiki. > > But the LDA is throwing the error. Did you add it there as well? > >> >> Aug 28 12:46:27 lda(XXXXX): Fatal: Invalid user settings. Refer to >> >> server log for more information. > > -- > Ralf Hildebrandt > Gesch?ftsbereich IT | Abteilung Netzwerk > Charit? - Universit?tsmedizin Berlin > Campus Benjamin Franklin > Hindenburgdamm 30 | D-12203 Berlin > Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 > ralf.hildebrandt at charite.de | http://www.charite.de > From no-reply at dropboxmail.com Tue Aug 28 17:13:16 2012 From: no-reply at dropboxmail.com (Dropbox) Date: Tue, 28 Aug 2012 14:13:16 +0000 Subject: [Dovecot] Fabricio Archanjo invited you to check out Dropbox Message-ID: <20120828141316.1902FB408F2@sjc-batch3.sjc.dropbox.com> Fabricio Archanjo wants you to try Dropbox! Dropbox lets you bring all your photos, docs and videos with you anywhere and share them easily. Accept invitation here: http://www.dropbox.com/el/?r=/referrals/NjI1MTc0MTkzODc%3Fsrc%3Dreferrals_bulk9%26eh%3D597a916&b=clk:None:18425774632604476847:789:462&z=AABq5aDvAxIPiLnfMP0QGm4052ThNJIoPgpBWZ7hh8WIpA - The Dropbox Team ____________________________________________________ To stop receiving invites from Dropbox, please go to http://www.dropbox.com/bl/694ad39c033e/dovecot%40dovecot.org From no-reply at dropboxmail.com Tue Aug 28 17:14:16 2012 From: no-reply at dropboxmail.com (Dropbox) Date: Tue, 28 Aug 2012 14:14:16 +0000 Subject: [Dovecot] Fabricio Archanjo invited you to check out Dropbox Message-ID: <20120828141416.3F1F0B40545@sjc-batch3.sjc.dropbox.com> Fabricio Archanjo wants you to try Dropbox! Dropbox lets you bring all your photos, docs and videos with you anywhere and share them easily. Accept invitation here: http://www.dropbox.com/el/?r=/referrals/NjI1MTc0NDM1Mjc%3Fsrc%3Dreferrals_bulk9%26eh%3D597a916&b=clk:None:16632688623146141049:789:462&z=AABGfwc2Hx_ZSAT0TKGYP34S_535s5Wa-UF_hbzBU7FEyA - The Dropbox Team ____________________________________________________ To stop receiving invites from Dropbox, please go to http://www.dropbox.com/bl/694ad39c033e/dovecot%40dovecot.org From aconraz at gmail.com Tue Aug 28 17:38:54 2012 From: aconraz at gmail.com (Alano Conraz) Date: Tue, 28 Aug 2012 16:38:54 +0200 Subject: [Dovecot] use sieve plugin with variable and folders Message-ID: Hello , I'm trying to use the pigeonhole plugin but I'm experiencing configuration problem... Hope you could help me! Firstly : my sieve filter test is the next one : /////////////////// require ["fileinto" , "variables" , "mailbox"]; if address :matches "Delivered-To" "*@*.*" { fileinto :create ".INBOX.iop" ; stop ; } //////////////////// I get in the log the following : "error: msgid=<****>: failed to store into mailbox '.INBOX.iop': Invalid mailbox name" And the email is stored in the INBOX (implicit keep was successful) I checked that "lda_mailbox_autocreate" and "lda_mailbox_autosubscribre" are set to "yes". Then , when this problem be solved, I would like to know if it is possible with the sieve plugin to implement the following algorithm : - extract the address from the header field "Delivered-To" and set the variable $delivto to this previous value. - extract the address from the header field "To" and set the variable $to to this previous value. - compare $delivto and $to : if they are diffrent, then redirect the email in the subfolder .INBOX.iop. Thank you for any help! From ewald.lists at fun.de Tue Aug 28 17:42:13 2012 From: ewald.lists at fun.de (Ewald Dieterich) Date: Tue, 28 Aug 2012 16:42:13 +0200 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <50225A24.4010109@fun.de> References: <50225A24.4010109@fun.de> Message-ID: <503CD8C5.7060907@fun.de> On 08/08/12 14:23, Andre Gr?be wrote: > I am using dovecot (see dovecot -n output below) with metadata plugin in > my own plugin. I want to insert and delete some large metadata (>4KiB). > It seems, that the delete in a second call of my plugin smashes the file > dovecot.dict in users dir: That's an error in dict-file.c, file_dict_refresh(): while ((key = i_stream_read_next_line(input)) != NULL && (value = i_stream_read_next_line(input)) != NULL) { If reading the value requires reading from the stream (because the value doesn't fit into the input buffer), the key is overwritten. The attached patch duplicates the key before reading the value. -------------- next part -------------- A non-text attachment was scrubbed... Name: dict-file.c.patch Type: text/x-diff Size: 665 bytes Desc: not available URL: From stephan at rename-it.nl Tue Aug 28 18:03:41 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:03:41 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects In-Reply-To: References: Message-ID: <503CDDCD.4060407@rename-it.nl> Op 8/27/2012 12:40 PM, Benjamin Thomas schreef: > Hi, > > I was wondering if it's possible to gracefully handle duplicate subjects > lines (within a given time frame) with sieve filters ? > > Ideally, I would like the first email of the day with subject ""AutoAlert > Type1..." to get moved to the subfolder given above. Subsequent "duplicate" > emails would then go into a "duplicate" subfolder. > > Is this possible with sieve filters ? I could not find anything striking me > as obvious while reading the page http://wiki.dovecot.org/LDA/Sieve. It is currently not possible to maintain some sort of custom state information between deliveries, i.e. Sieve invocations. There is the unofficial vnd.dovecot.duplicate extension, but that uses the message-id exclusively and (currently) cannot be used to track duplicate subjects. Regards, Stephan. From benjamin.guy.thomas at gmail.com Tue Aug 28 18:07:01 2012 From: benjamin.guy.thomas at gmail.com (Benjamin Thomas) Date: Tue, 28 Aug 2012 17:07:01 +0200 Subject: [Dovecot] Dovecot sieve and duplicate email subjects In-Reply-To: <503CDDCD.4060407@rename-it.nl> References: <503CDDCD.4060407@rename-it.nl> Message-ID: Ok. Thanks very much for your response! 2012/8/28 Stephan Bosch > Op 8/27/2012 12:40 PM, Benjamin Thomas schreef: > >> Hi, >> >> >> I was wondering if it's possible to gracefully handle duplicate subjects >> lines (within a given time frame) with sieve filters ? >> >> Ideally, I would like the first email of the day with subject ""AutoAlert >> Type1..." to get moved to the subfolder given above. Subsequent >> "duplicate" >> emails would then go into a "duplicate" subfolder. >> >> Is this possible with sieve filters ? I could not find anything striking >> me >> as obvious while reading the page http://wiki.dovecot.org/LDA/**Sieve >> . >> > > It is currently not possible to maintain some sort of custom state > information between deliveries, i.e. Sieve invocations. There is the > unofficial vnd.dovecot.duplicate extension, but that uses the message-id > exclusively and (currently) cannot be used to track duplicate subjects. > > Regards, > > Stephan. > > > -- *Benjamin Thomas* From stephan at rename-it.nl Tue Aug 28 18:08:49 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:08:49 +0200 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: <503CDF01.5040007@rename-it.nl> Op 8/22/2012 8:56 AM, David Anderson schreef: > > Self-explanatory, I hope (note the period on the end of the username); > sieve/pigeonhole does not allow you to have senders which end with a > period, which means that any UNIX users with such usernames who send > mail have it rejected by sieve: > > # useradd testuser. > # su - testuser. > $ mail david at example.com -s 'testing' > 123 > . > [testuser. at levi ~]$ logout > > # less /var/log/maillog > > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: > envelope sender address 'testuser. at myhost.example.com' is unparsable > > Versions: > dovecot-pigeonhole-0.2.6-21.el5 > dovecot-managesieve-0.2.6-21.el5 > dovecot-2.0.18-1_134.el5 > > Why would anyone have a UNIX username ending in a period? For one, web > hosting companies may use your domain name as your username - but be > subject to a 32-character limit, so your domain name gets truncated. I would have expected to see that address escaped as "testuser."@myhost.example.com. I notice that I haven't tested such addresses much with Sieve and I don't actually know in what form MTAs provide such addresses to the LDA. I'll give that a look soon. Regards, Stephan. From stephan at rename-it.nl Tue Aug 28 18:25:54 2012 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 28 Aug 2012 17:25:54 +0200 Subject: [Dovecot] use sieve plugin with variable and folders In-Reply-To: References: Message-ID: <503CE302.4060506@rename-it.nl> Op 8/28/2012 4:38 PM, Alano Conraz schreef: > Hello , > > I'm trying to use the pigeonhole plugin but I'm experiencing configuration > problem... Hope you could help me! > > Firstly : > my sieve filter test is the next one : > /////////////////// > require ["fileinto" , "variables" , "mailbox"]; > > if address :matches "Delivered-To" "*@*.*" { > fileinto :create ".INBOX.iop" ; stop ; > } > //////////////////// > > I get in the log the following : "error: msgid=<****>: failed to store into > mailbox '.INBOX.iop': Invalid mailbox name" > And the email is stored in the INBOX (implicit keep was successful) > I checked that "lda_mailbox_autocreate" and "lda_mailbox_autosubscribre" > are set to "yes". Mailbox name should probably not start with a '.'. I'm assuming it is a maildir storage. The physical mailbox directories in that maildir have a '.' prefix, but the actual mailbox name does not: it should be 'INBOX.iop'. > Then , when this problem be solved, I would like to know if it is possible > with the sieve plugin to implement the following algorithm : > - extract the address from the header field "Delivered-To" and set the > variable $delivto to this previous value. > - extract the address from the header field "To" and set the variable > $to to this previous value. > - compare $delivto and $to : if they are diffrent, then redirect the > email in the subfolder .INBOX.iop. > > > Thank you for any help! Something like this: require ["fileinto", "variables", "mailbox"]; if address :matches "delivered-to" "*" { set "delivto" "${1}"; } if address :matches "to" "*" { set "to" "${1}"; } if not string "${delivto}" "${to}" { fileinto :create "INBOX.iop"; stop; } For reference you can read RFC5229 (http://tools.ietf.org/html/rfc5229). Regards, Stephan. From tss at iki.fi Tue Aug 28 18:48:49 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 18:48:49 +0300 Subject: [Dovecot] Sieve/pigeonhole rejects email addresses for valid UNIX users In-Reply-To: <50348284.8050609@wordshell.net> References: <50348284.8050609@wordshell.net> Message-ID: On 22.8.2012, at 9.56, David Anderson wrote: > Aug 22 07:50:56 levi dovecot: lda(david at example.com): Error: sieve: envelope sender address 'testuser. at myhost.example.com' is unparsable Also is this really rejecting the mail?.. When I looked at it I thought it would simply replace the sender with empty string. From tss at iki.fi Tue Aug 28 18:54:03 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 18:54:03 +0300 Subject: [Dovecot] Deleting metadata smashes file dovecot.dict In-Reply-To: <503CD8C5.7060907@fun.de> References: <50225A24.4010109@fun.de> <503CD8C5.7060907@fun.de> Message-ID: <48AB63AB-A4CF-4B99-AF71-91966896C202@iki.fi> On 28.8.2012, at 17.42, Ewald Dieterich wrote: > On 08/08/12 14:23, Andre Gr?be wrote: >> I am using dovecot (see dovecot -n output below) with metadata plugin in >> my own plugin. I want to insert and delete some large metadata (>4KiB). >> It seems, that the delete in a second call of my plugin smashes the file >> dovecot.dict in users dir: > > That's an error in dict-file.c, file_dict_refresh(): > > while ((key = i_stream_read_next_line(input)) != NULL && > (value = i_stream_read_next_line(input)) != NULL) { > > If reading the value requires reading from the stream (because the value doesn't fit into the input buffer), the key is overwritten. The attached patch duplicates the key before reading the value. Committed: http://hg.dovecot.org/dovecot-2.1/rev/6e53209030f6 From tss at iki.fi Tue Aug 28 19:12:16 2012 From: tss at iki.fi (Timo Sirainen) Date: Tue, 28 Aug 2012 19:12:16 +0300 Subject: [Dovecot] quota: ignore deleted messages (?) In-Reply-To: <20120825232833.GA11297@daniel.localdomain> References: <692aeic3nov8@mids.svenhartge.de> <204E6E94-E35B-4B8A-BD3A-C674AB1DDEAC@iki.fi> <892ajb13nov8@mids.svenhartge.de> <71B054C1-1129-4E74-992C-957894CD9CFD@iki.fi> <20120825232833.GA11297@daniel.localdomain> Message-ID: On 26.8.2012, at 2.28, Daniel Parthey wrote: > What would the configuration look like if I want to setup > one lmtp service with quota enforcing on port 10024 and > another lmtp service without enforcing on port 20024? > Especially how to define two "protocol lmtp" sections > which are assigned to their specific service? You can't. (Maybe you could create another service lmtp2 {} block and override the quota setting with lmtp -o plugin/quota=.. parameter, but I don't know if that would work.) > or will I need to define SQL statements in the userdb > lookup which selects "noenforcing" depending on local port? That would work. From mgc_dovecot at chamberlain.net.au Wed Aug 29 04:07:11 2012 From: mgc_dovecot at chamberlain.net.au (mgc_dovecot at chamberlain.net.au) Date: Wed, 29 Aug 2012 11:07:11 +1000 Subject: [Dovecot] Size of Mailbox affecting the sending of mail? In-Reply-To: References: <50375D3E.50409@googlemail.com> Message-ID: <503D6B3F.4040004@chamberlain.net.au> On 27/08/2012 5:03 PM, Timo Sirainen wrote: > On 24.8.2012, at 13.53, Tim Smith wrote: > >> Having set up my mail server (Dovecot/Postfix), users are experiencing long delays (a couple of minutes) when sending mail from mail client such as Thunderbird - this increases with attachments. Having had a brief discussion with someone, they mentioned that the reason that this may be to do with the size of the mailbox. I couldn't see the rationale behind this unless Dovecot is syncing the mailbox after every sent mail (due to possibly saving the sent item?) The mail is being delivered successfully but the amount of time it is taking to complete the action is far too long! > Other than the bandwidth others already mentioned, the only reason it could be Dovecot's fault is exactly the size of the Sent mailbox. How large is that and what mailbox format are you using? > I missed the original message, but if your users are using Thunderbird I've seen slow sending of email be caused by a large number of temporary files being created by Thunderbird (it doesn't clean up properly), and so when it goes to create a new temporary file it goes very slowly - it may be worth checking the users mailboxes to see if they have a large number of temporary files with a similar name but different number (I forget the name, sorry - it might start with something like "nsmail", but may not). Stop Thunderbird, clear out the temporary files, and sending becomes much faster (if this is the cause of the problem). Regards, Michael. From dmalolepszy at optusnet.com.au Wed Aug 29 05:14:47 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Wed, 29 Aug 2012 12:14:47 +1000 Subject: [Dovecot] Dovecot Director Output buffer full Message-ID: <503D7B17.9020308@optusnet.com.au> Hi, I have been seeing the following messages in logs on all my Dovecot servers each running both a dovecot-director instance and a dovecot pop3/imap backend. These logs appear to relate to problems with the director. Aug 28 16:09:52 dovecot01 dovecot: director: Error: director(10.0.0.2:9090/right): Output buffer full, disconnecting Aug 28 16:10:01 dovecot01 dovecot: director: Error: Ring SYNC appears to have got lost, resending Aug 28 16:10:02 dovecot01 dovecot: director: Error: Director 10.0.0.2:9090/right disconnected Aug 28 16:09:51 dovecot02 dovecot: director: Error: director(10.0.0.3:9090/right): Output buffer full, disconnecting Aug 28 16:09:57 dovecot02 dovecot: director: Error: Ring SYNC appears to have got lost, resending Aug 28 16:10:01 dovecot02 dovecot: director: Error: Director 10.0.0.3:9090/right disconnected Aug 28 16:10:02 dovecot02 dovecot: director: Error: director(10.0.0.1:9090/left): Ping timed out, disconnecting Aug 28 16:13:15 dovecot02 dovecot: director: Warning: Delaying new user requests until ring is synced Note dovecot01 has IP 10.0.0.1 and dovecot02 has IP 10.0.0.2 and so on. This seems to show up when I enable the poolmon script (https://github.com/brandond/poolmon) on all the servers, and all servers start simultaneous logins to each others Dovecot backends. I did notice that the poolmon script has been flapping vhost weights a lot (I am looking at making the script handle transient errors better), which means that it is connecting to the dovecot-director socket every few minutes and changing vhost weights from 100 to 0 and vice-versa. Is there some sort of limit in the Dovecot Director that is being exceeded that should be tweaked? # 2.1.5: /etc/dovecot-director/dovecot.conf # OS: Linux 2.6.32-279.el6.mccqfix.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.3 (Santiago) auth_cache_size = 100 M auth_default_realm = example.com auth_failure_delay = 5 secs auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 auth_worker_max_count = 600 base_dir = /var/run/dovecot-director/ director_mail_servers = 10.0.0.1 10.0.0.2 10.0.0.3 10.0.0.4 10.0.0.5 director_servers = 10.0.0.1 10.0.0.2 10.0.0.3 10.0.0.4 10.0.0.5 disable_plaintext_auth = no instance_name = dovecot-dir passdb { args = /etc/dovecot-director/dovecot-sql.conf driver = sql } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { address = 10.0.0.1 port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director inet_listener imap { address = 10.0.0.1 port = 143 } inet_listener imaps { address = 10.0.0.1 port = 993 ssl = yes } process_min_avail = 100 } service pop3-login { executable = pop3-login director inet_listener pop3 { address = 10.0.0.1 port = 110 } inet_listener pop3s { address = 10.0.0.1 port = 995 ssl = yes } process_min_avail = 100 } verbose_proctitle = yes From zucca at systemschmiede.com Wed Aug 29 12:37:29 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Wed, 29 Aug 2012 11:37:29 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503C818A.4010203@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> Message-ID: <503DE2D9.3080300@systemschmiede.com> Hi all. Sorry, but i can't believe noone has a hint on this one. I guess it's just some stupid detail i am missing. dovecot --version 2.1.7 If in the shared folders part of dovecot.conf i use: *prefix = Freigaben/%%n/ * Then in the subscription menu (and later in shared Folder too) i see http://s9.postimage.org/6aohh97ov/iehadjhb.jpg (Open-Xchange-GUI) http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) all is good, when using *prefix = Freigaben/%%u/ * only the name is very longish then, so i'd really prefer "n". Please help me. Thank you very much Sascha Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Stra?e 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 Am 28.08.2012 10:30, schrieb Sascha Zucca: > another update on this: > > I have this in my logfile: > Debug: Namespace : type=shared, prefix=Freigaben/%u/, sep=/, inbox=no, > hidden=yes, list=children, subscriptions=no > location=maildir:/var/vmail/%d/%n/Maildir:INDEX=/var/vmail/parrotshop.de/testuser-2/Maildir/shared/%u > > Though this is in my dovecot.conf: > > prefix=Freigaben/%%u/ > location=maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u > > > How come? And does this behaviour maybe also explain the unnamed > folder i have when using prefix=Freigaben/%%n/ instead of %%u ? > > Thanks for your assistance > Sascha > > >> >> Hi Timo, hi list >> I upgraded: >> dovecot --version >> 2.1.7 >> But still i have this ghostfolder as soon as i want to use >> prefix = shares/%%n/ >> >> all is good, when using >> prefix = shares/%%u/ >> >> >> Any idea what could be wrong? >> >> >> Thank you very much >> Sascha >> >> Systemschmiede IT-L?sungen >> Zucca & Teves GbR >> August-Thyssen-Stra?e 2-4 >> 52511 Geilenkirchen >> www.systemschmiede.com >> >> >> Tel.: 02451 - 9088390 >> Fax: 02451 - 9124070 >> Mobil: 0178 - 4073254 >> >> Ust.ID: DE248030393 >> >> Am 25.08.2012 15:06, schrieb Timo Sirainen: >>> It's very likely that this has been fixed in v2.1. And in any case >>> I'm not fixing non-security bugs anymore for v1.x. You can find v2.x >>> debian packages from backports.org. >>> >>> On 25.8.2012, at 15.56, Sascha Zucca wrote: >>> >>>> Hi Timo, >>>> dovecot --version >>>> 1.2.15 >>>> >>>> It's the stable one for debian squeeze i presume. >>>> >>>> Thank you for your help. >>>> >>>> Sascha >>>> >>>> >>>> Am 25.08.2012 13:53, schrieb Timo Sirainen: >>>>> On 25.8.2012, at 14.11, Sascha Zucca wrote: >>>>> >>>>>> Hi List, >>>>>> i found out the following: >>>>>> The problem with the "ghostfolder" occurs only if i use >>>>>> >>>>>> prefix = shares/%%n/ >>>>>> >>>>>> When using >>>>>> prefix = shares/%%u/ >>>>>> >>>>>> everytung's ok! >>>>> What Dovecot version? >>>>> >>>>> >>>> >>>> -- >>>> Systemschmiede IT-L?sungen >>>> Zucca & Teves GbR >>>> August-Thyssen-Str. 2-4 >>>> 52511 Geilenkirchen >>>> www.systemschmiede.com >>>> >>>> >>>> Tel.: 02451 - 9088390 >>>> Fax: 02451 - 9124070 >>>> Mobil: 0178 - 4073254 >>>> >>>> Ust.ID: DE248030393 >>>> >> From rrosenfeld at netcologne.de Wed Aug 29 15:44:47 2012 From: rrosenfeld at netcologne.de (Roland Rosenfeld) Date: Wed, 29 Aug 2012 14:44:47 +0200 Subject: [Dovecot] ACL MySQL dict: to_user==from_user entries Message-ID: <20120829124447.GA16592@sys-241.netcologne.de> Hi! We run dovecot 2.1.6 with ACL support and MySQL dict for shared/shared-boxes/user/$to/$from. When a user does a SETACL (via IMAP) to himself he is added as $to and $from to the MySQL dict. Se for example this IMAP conversation: 5 GETACL INBOX * ACL "INBOX" "user at domain" lrwstipekxacd 5 OK Getacl completed. 6 SETACL INBOX user at domain lrwstipekxacd 6 OK Setacl complete. 7 GETACL INBOX * ACL "INBOX" "user at domain" akxeilprwtscd 7 OK Getacl completed. As you can see, user at domain sets the ACL of his INBOX to the same value it was set before (reading it from the server after this idempotent write changed the order but none of the flags). But after "SETACL INBOX user at domain lrwstipekxacd" I see a new entry in my imap_acl_shares table where to_user and from_user both contain the value "user at domain". As far as I can see, this entry does not make much sense in the database, because every user should be able so see its own folders. But adding this line may blow up the database especially according to the full table scan problem for acl dict rebuild mentioned in http://www.dovecot.org/list/dovecot/2012-August/067548.html. Does it make sense to run a daily cron job, that removes all entries with from_user=to_user or may this cause other inconsistencies? If you need to have a look at my complete setup, it's in http://www.dovecot.org/list/dovecot/2012-July/067130.html, so I don't have to clone this here. Tschoeeee Roland From giles at coochey.net Wed Aug 29 18:10:02 2012 From: giles at coochey.net (Giles Coochey) Date: Wed, 29 Aug 2012 16:10:02 +0100 Subject: [Dovecot] IMAP IDLE - iPhone? In-Reply-To: <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> References: <20120810024444.GA16856@noboost.org> <5024B37F.2040709@randoman.ru> <5024C351.7030101@thelounge.net> <5024CA7A.80006@randoman.ru> <5024CD85.4020705@thelounge.net> <5024D29E.5040400@randoman.ru> <233BB0CC-C2DF-4598-A11B-E03EA8A84030@iki.fi> <502A0686.30309@wildgooses.com> <96A22BC3-3D35-41A7-8CE3-72D3D96C9B88@iki.fi> <02409989-96E9-403C-87CE-E5080ADFF529@iki.fi> Message-ID: <503E30CA.7010007@coochey.net> On 23/08/2012 21:49, Timo Sirainen wrote: > On 23.8.2012, at 23.26, Warren Baker wrote: > >> On Thu, Aug 23, 2012 at 8:50 PM, Timo Sirainen wrote: >>> On 14.8.2012, at 11.18, Timo Sirainen wrote: >>> >>> v2.2 has this now: http://hg.dovecot.org/dovecot-2.2/rev/8d7f9e2d726c >> Is there a reason why 172.16.0.0/12 was left out of the change ^^ ? > Is it actually used? :) I've used 192.168 in my home network and all corporate networks I've seen have been 10/8. But yeah, I guess since there aren't more than those 3 I'll just add it (I thought there were more of them, but looks like they're reserved for other purposes). > I specifically use 172.16.0.0/12 because others don't, I also specifically don't use 172.16.0.0/16, because if someone does use 172.16.0.0/12 they usually only use 172.16.0.0/16... It's easy for people to connect to my networks via a VPN connection, and generally not have any IP conflicts with their own RFC1918 ranges and not have to fiddle with NAT issues. -- Regards, Giles Coochey, CCNA, CCNAS NetSecSpec Ltd +44 (0) 7983 877438 http://www.coochey.net http://www.netsecspec.co.uk giles at coochey.net -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 4968 bytes Desc: S/MIME Cryptographic Signature URL: From daniel.parthey at informatik.tu-chemnitz.de Wed Aug 29 23:48:14 2012 From: daniel.parthey at informatik.tu-chemnitz.de (Daniel Parthey) Date: Wed, 29 Aug 2012 22:48:14 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503DE2D9.3080300@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> Message-ID: <20120829204814.GA9265@daniel.localdomain> Hi Sascha, Sascha Zucca wrote: > Sorry, but i can't believe noone has a hint on this one. Sorry, but you forgot to post your complete doveconf -n output and how to exactly reproduce this. > http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) I'm getting the same result when SIEVE sorts Messages into autocreated subfolders inside of folders which do not exist. So it's probably not a ghost folder, it is just an intermediate folder which does not exist itself, but contains existing subfolders. This forces your mail client to display the folder in the tree: INBOX exists (black) INBOX/foo does not exist (grey) INBOX/foo/bar exists (black) HTH and Regards Daniel -- https://plus.google.com/103021802792276734820 From kgc at corp.sonic.net Thu Aug 30 00:47:00 2012 From: kgc at corp.sonic.net (Kelsey Cummings) Date: Wed, 29 Aug 2012 14:47:00 -0700 Subject: [Dovecot] FS Quotas, what am I doing wrong? Message-ID: <20120829214700.GN13924@corp.sonic.net> I'm not able to get the FS quota module to behave as I expect. Depsite having function fs quotas and dovecot apparently configured to use then, the quotas appear to be empty and/or not configured. Any clues? # quota kgc Disk quotas for user kgc (uid 500): Filesystem blocks quota limit grace files quota limit grace /dev/sda3 1229460 7000000 8000000 103776 5000000 6000000 # doveadm quota get -u kgc Quota name Type Value Limit % User user STORAGE 0 - 0 User user MESSAGE 0 - 0 # telnet 0 143 ... A003 GETQUOTAROOT INBOX <- Not sure this is correct A003 OK No quota. imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=6048, secured, session=<1CGqXm7IhwB/AAAB> imap: Debug: Loading modules from directory: /usr/lib64/dovecot imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so imap(kgc): Debug: Effective uid=500, gid=501, home=/home/kgc imap(kgc): Debug: Quota root: name=User user backend=fs args=inode_per_mail:noenforcing imap(kgc): Debug: maildir++: root=/home/kgc/Maildir, index=, control=, inbox=/home/kgc/Maildir, alt= imap(kgc): Debug: fs quota add mailbox dir = /home/kgc/Maildir imap(kgc): Debug: fs quota block device = /dev/sda3 imap(kgc): Debug: fs quota mount point = / imap(kgc): Debug: fs quota mount type = ext4 # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.5.1.el6.x86_64 x86_64 Scientific Linux release 6.0 (Carbon) mail_debug = yes mail_location = maildir:~/Maildir mail_plugins = quota mbox_write_locks = fcntl passdb { driver = pam } plugin { quota = fs:User user:inode_per_mail:noenforcing } ssl_cert = References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> Message-ID: <503F0B77.5030206@systemschmiede.com> Hi! I am very sorry, i thought i had done so before. Well here ist is: dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-14-pve i686 Debian 6.0.5 simfs auth_mechanisms = plain login disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/var/vmail/%%d/%%n/Maildir mail_plugins = acl mail_privileged_group = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes list = children location = maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u prefix = Freigaben/%%n/ separator = / subscriptions = no type = shared } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db quota = dict:user::file:/var/vmail/%d/%n/.quotausage sieve = /var/vmail/%d/%n/.sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } ssl_cert = Hi Sascha, > > Sascha Zucca wrote: >> Sorry, but i can't believe noone has a hint on this one. > Sorry, but you forgot to post your complete doveconf -n output > and how to exactly reproduce this. > >> http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) > I'm getting the same result when SIEVE sorts Messages into autocreated > subfolders inside of folders which do not exist. So it's probably > not a ghost folder, it is just an intermediate folder > which does not exist itself, but contains existing subfolders. > > This forces your mail client to display the folder in the tree: > > INBOX exists (black) > INBOX/foo does not exist (grey) > INBOX/foo/bar exists (black) > > HTH and Regards > Daniel -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From lists at wiesinger.com Thu Aug 30 21:34:36 2012 From: lists at wiesinger.com (Gerhard Wiesinger) Date: Thu, 30 Aug 2012 20:34:36 +0200 Subject: [Dovecot] deliver doesn't update cache index with mbox Message-ID: <503FB23C.5040309@wiesinger.com> Hello Timo, I'm having a problem with mbox that opening folder is slow when new mails are delivered to a folder. I'm delivering through the deliver program. Deliver updates index files but IHMO not completely correct. Therefore I compared index files before and after: 1.) Just delivered 2.) After accessing through imap via Thunderbird diff looks like (stripped down to the relevant things): INDEX: -first recent uid ......... = 25847 +first recent uid ......... = 25848 -log file tail offset ..... = 16468 -log file head offset ..... = 16468 +log file tail offset ..... = 16828 +log file head offset ..... = 16828 - - sync_mtime . = 2012-08-30 19:38:05 + - sync_mtime . = 2012-08-30 20:09:23 - - dirty_flag . = 1 + - dirty_flag . = 0 - - highest_modseq = 11162 + - highest_modseq = 11163 - - log_offset ... = 16468 + - log_offset ... = 16828 CACHE: -used_file_size ....... = 6385696 +used_file_size ....... = 6392132 RECORD: seq=25663, uid=25835, flags=0x00 - - ext 0 keywords : (0000) - - ext 1 modseq : 11156 (942b000000000000) + - ext 0 keywords : (0100) + - ext 1 modseq : 11163 (9b2b000000000000) - ext 2 mbox : 42923286 (16f58e0200000000) - - ext 3 cache : 0 (00000000) + - ext 3 cache : 6385696 (20706100) - ext 4 header-md5: (00000000000000000000000000000000) + - cache offset=6385696 size=488, prev_offset = 0 + - hdr.BCC: + - hdr.CC: + - hdr.CONTENT-TYPE: 18: Content-Type: text/plain; charset=us-ascii + - hdr.DATE: 13: Date: Thu, 30 Aug 2012 19:37:24 +0200 + - size.virtual: 1081 (3904000000000000) Same patterns from record: 25664-25675 What does dirty_flag=1 mean? Why are the cache headers missing and not written by deliver? Any ideas? Config is below. Thank you. Ciao, Gerhard # 2.1.9: /etc/dovecot/dovecot.conf # OS: Linux listen = * mail_full_filesystem_access = yes mail_location = mbox:~:INBOX=/var/mail/%u mbox_lazy_writes = no mbox_write_locks = fcntl passdb { driver = pam } postmaster_address = postmaster at domain protocols = imap service auth { unix_listener auth-userdb { group = users mode = 0660 } } service imap-login { inet_listener imap { port = 0 } } service imap { executable = imap postlogin } service postlogin { executable = script-login -d rawlog } ssl_cert = Hello, So I am trying to construct mail path for my LDAP user lookups, and i need to use two attributes instead of one. For examle, my LDAP directory has two attributes: departmentAttr and userIDAttr, and I want the maildir to reside in /home/${departmentAttr}/${userIDAttr} Unfortunately, I cannot seem to find a way to configure dovecot this way. Right now, I have something like user_attrs = departmentAttr=mail=maildir:/home/%$/%u But %u is the username (which in my environment can easily change, so I cannot use this for maildir location). Any ideas on how to achieve that? So far I have just one brute-force solution - to create an attribute MailDirAttr, and populate it with concatenation of departmentAttr+'/'+userIDAttr by means of a scheduled task. This sounds like unnecessary information duplication, which is usually a very bad practice. So, again - any ideas? Thank you, Anatoly. From adi at ddns.com.au Fri Aug 31 05:51:20 2012 From: adi at ddns.com.au (Adi Pircalabu) Date: Fri, 31 Aug 2012 12:51:20 +1000 Subject: [Dovecot] [Postfix] SASL Auth. using Dovecot with password forwarding proxy configuration Message-ID: <20120831125120.37a3f7cf@adi.ddns.local> Hi, I'm relatively new to Dovecot and I did a bit of search but couldn't find a possible solution for the particular setup I'm working on. Basically I have an SMTP/POP/IMAP proxy setup running Postfix & Dovecot. IMAP/POP authentication is done using the password proxy feature, where the login credentials are passed to the backend server after a db lookup, which does the actual authentication. The POP/IMAP part is working fine. What I'm trying to do is to use Dovecot SASL implementation in Postfix to do SMTP authentication in a similar manner. The problem I have with my current configuration is that SMTP authentication succeeds if only the username matches, because password forwarding works if the authentication succeeds with any given password, as documented at http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy My question is, given the above: is there a way to get SMTP authentication properly in this scenario? The way I see it now, Dovecot SASL accepting the login if only the user matches isn't quite "complete", the auth process should go further and authenticate against the backend server, same as for POP/IMAP connections. Does this requirement make any sense? Maybe I'm missing something in Dovecot configuration to get the SMTP authentication work in password forwarding mode, few pointers will be highly appreciated. PopBSMTP is not an sensible alternative in my case. Here's my configuration, plus some dovecot auth_debug log entries. As you can see, SMTP authentication succeeds with any given password. ---Dovecot--- dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.2.1.el6.centos.plus.x86_64 x86_64 CentOS release 6.3 (Final) auth_cache_size = 4 k auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain mbox_write_locks = fcntl passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } ssl_ca = , method=PLAIN, rip=192.168.1.56, lip=192.168.1.222, TLS [...] (SMTP connection) Aug 31 11:36:14 centos6 postfix/smtpd[11213]: connect from unknown[192.168.1.200] Aug 31 11:36:14 centos6 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: auth client connected (pid=11213) Aug 31 11:36:14 centos6 dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=smtp#011nologin#011lip=192.168.1.222#011rip=192.168.1.200#011resp=AGFAMGFkaXRlc3QubmV0AGFzZA== Aug 31 11:36:14 centos6 dovecot: auth: Debug: cache(a at 0aditest.net,192.168.1.200): miss Aug 31 11:36:14 centos6 dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Aug 31 11:36:14 centos6 dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Aug 31 11:36:14 centos6 dovecot: auth: mysql: Connected to /var/lib/mysql/mysql.sock (postfix) Aug 31 11:36:14 centos6 dovecot: auth: Debug: sql(a at 0aditest.net,192.168.1.200): query: SELECT NULL AS password, 'Y' as nopassword, host, email, 'Y' AS proxy FROM mailbox WHERE email = 'a at 0aditest.net' Aug 31 11:36:14 centos6 dovecot: auth: Debug: client out: OK#0111#011user=a at 0aditest.net#011host=203.63.79.87#011email=a at 0aditest.net#011proxy#011pass=anygivenpassword Aug 31 11:36:14 centos6 postfix/smtpd[11213]: C9620600A9: client=unknown[192.168.1.200], sasl_method=PLAIN, sasl_username=a at 0aditest.net Aug 31 11:36:14 centos6 postfix/cleanup[11219]: C9620600A9: message-id=<20120831113614.72ed32df at adi.ddns.local> [...] ---/var/log/maillog--- -- Adi Pircalabu From amateo at um.es Fri Aug 31 09:43:58 2012 From: amateo at um.es (Angel L. Mateo) Date: Fri, 31 Aug 2012 08:43:58 +0200 Subject: [Dovecot] doveadm commands returning 139 at director servers In-Reply-To: <503B4CAD.6090908@um.es> References: <503B4CAD.6090908@um.es> Message-ID: <50405D2E.6000902@um.es> El 27/08/12 12:32, Angel L. Mateo escribi?: > Hello, > > I have configured director in front of dovecot imap/pop/lmtp > servers. When I need to manipulate a user mailbox, I use doveadm > commands at director server's, with -S option. But some commands return > exit code 139 when command returns more than 40 entries (I think). > > For example, the command: > > sudo doveadm fetch -u amateo hdr mailbox Trash HEADER Subject > "nyctalus11/" > > executed at the backend server returns 952 mails, but executed at > director server with -S option, returns only 40 mails and exit code 139. > > I'm using dovecot 2.1.5 and I attached doveconf -n at director and > backend servers. > Updating from 2.1.5 to 2.1.5 has fixed the problem. From linuxmail at 4lin.net Fri Aug 31 10:55:16 2012 From: linuxmail at 4lin.net (Denny Schierz) Date: Fri, 31 Aug 2012 09:55:16 +0200 Subject: [Dovecot] mail_location / mail_home Message-ID: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> hi, I had a long (upgraded today from 2.0.17 to 2.1.9) time mail_location and mail_home at the same path, which I recognize know, that it wasn't a good idea, idea. On my testsystem I've set: mail_home = /imap/spool/%d/%1u/%u mail_location = maildir:~/:INDEX=~/ otherwise I don't have access to the mails anymore. Is that ok? cu denny From linuxmail at 4lin.net Fri Aug 31 11:15:33 2012 From: linuxmail at 4lin.net (Denny Schierz) Date: Fri, 31 Aug 2012 10:15:33 +0200 Subject: [Dovecot] mail_location / mail_home In-Reply-To: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> References: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> Message-ID: <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> Am 31.08.2012 um 09:55 schrieb Denny Schierz: > > mail_home = /imap/spool/%d/%1u/%u > mail_location = maildir:~/:INDEX=~/ I think, it doesn't make any difference, if I have "~" or a fixed path :-/ On the productive system (also 2.1.9) I get messages like: [...] dovecot.lda-dupes/tmp) failed: Not a directory [...] So, I need a way, to move ~11.000 Maildirs .... any suggestions? From zucca at systemschmiede.com Fri Aug 31 11:16:58 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 10:16:58 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <503F0B77.5030206@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> Message-ID: <504072FA.8020606@systemschmiede.com> Hi! Still noone? strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. Anyways, thanks for any help Sascha Am 30.08.2012 08:43, schrieb Sascha Zucca: > Hi! > I am very sorry, i thought i had done so before. Well here ist is: > > > dovecot -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-14-pve i686 Debian 6.0.5 simfs > auth_mechanisms = plain login > disable_plaintext_auth = no > log_timestamp = "%Y-%m-%d %H:%M:%S " > mail_location = maildir:/var/vmail/%%d/%%n/Maildir > mail_plugins = acl > mail_privileged_group = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date ihave > namespace { > inbox = yes > location = > prefix = > separator = / > type = private > } > namespace { > hidden = yes > list = children > location = > maildir:/var/vmail/%%d/%%n/Maildir:INDEX=/var/vmail/%d/%n/Maildir/shared/%%u > prefix = Freigaben/%%n/ > separator = / > subscriptions = no > type = shared > } > passdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > plugin { > acl = vfile > acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db > quota = dict:user::file:/var/vmail/%d/%n/.quotausage > sieve = /var/vmail/%d/%n/.sieve > } > protocols = imap pop3 sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > user = root > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > protocol pop3 { > mail_plugins = quota > pop3_uidl_format = %08Xu%08Xv > } > protocol lda { > mail_plugins = sieve quota > } > protocol imap { > mail_plugins = quota imap_quota acl imap_acl > } > > > I don't really think, it has anything to do with sieve, as the folder > simply won't show up as soo as i just change prefix = Freigaben/%%n/ > to prefix = Freigaben/%%u/. > And i didn't filter into autocreated folders yet. For now, i created > only one sieve rule, that filters into an folder i created manually. > > > Thank you very much for your help > Sascha > > > > Am 29.08.2012 22:48, schrieb Daniel Parthey: >> Hi Sascha, >> >> Sascha Zucca wrote: >>> Sorry, but i can't believe noone has a hint on this one. >> Sorry, but you forgot to post your complete doveconf -n output >> and how to exactly reproduce this. >> >>> http://s12.postimage.org/z0n82k2u5/bjddgefg.jpg (Thunderbird) >> I'm getting the same result when SIEVE sorts Messages into autocreated >> subfolders inside of folders which do not exist. So it's probably >> not a ghost folder, it is just an intermediate folder >> which does not exist itself, but contains existing subfolders. >> >> This forces your mail client to display the folder in the tree: >> >> INBOX exists (black) >> INBOX/foo does not exist (grey) >> INBOX/foo/bar exists (black) >> >> HTH and Regards >> Daniel > > From Jost.Krieger+dovecot at rub.de Fri Aug 31 11:42:34 2012 From: Jost.Krieger+dovecot at rub.de (Jost Krieger) Date: 31 Aug 2012 10:42:34 +0200 Subject: [Dovecot] Possible mbox corruption if mail is saved with wrong Content-Length header (2.1.6) Message-ID: <20120831084233.GE3002@ruhr-uni-bochum.de> One of our users likes to delete attachments from his mails. He is using roundcube and we installed a plugin for that. He reports that from time to time one of his mails gets corrupted (cut off in the middle). I could verify there is something wrong in the logs: imap(x1234567): Error: Cached message size larger than expected (6796 > 2844) imap(x1234567): Error: Corrupted index cache file /net/mbx3/disc2/home/85/x1234567/Index/.imap/Sent/dovecot.index.cache: Broken physical size for mail UID 5001 imap(x1234567): Error: read(/net/mbx3/disc2/home/85/x1234567/Mail/Sent) failed: Input/output error (FETCH for mailbox Sent UID 5001) imap(x1234567): Info: Disconnected: Internal error occurred. Refer to server log for more information. [2012-08-23 00:00:49] in=1124145 out=1324791 I had a look at the plugin and it works by duplicating the message and leaving out the attachment(s). The headers are also duplicated, including Content-Length. I've fixed that in the plugin, (don't know yet if it helps), but I think it shouldn't cause such breakage in dovecot. # doveconf -n # 2.1.6: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-103.ELsmp i686 Red Hat Enterprise Linux AS release 4 (Nahant Update 9) doveconf: Warning: Dovecot was last started using /usr/local/dovecot/etc/dovecot.conf, but this config is /usr/local/dovecot/etc/dovecot/dovecot.conf auth_master_user_separator = * disable_plaintext_auth = no doveadm_password = (hidden) lda_mailbox_autocreate = yes log_path = /dev/stderr log_timestamp = mail_location = mbox:~/Mail:INBOX=~/Mailbox:INDEX=~/Index mail_plugins = " quota zlib mail_log notify virtual" mdbox_rotate_size = 5 M namespace { hidden = no inbox = yes location = prefix = separator = / type = private } namespace { hidden = yes inbox = no list = children location = maildir:~/Maildir prefix = "#MD/" separator = / type = private } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { acl = vfile mail_log_events = undelete mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = fs:Disk quota } protocols = pop3 imap service auth { client_limit = 4300 user = root } service doveadm { inet_listener { port = 542 } } service imap-login { inet_listener imap { address = 134.147.64.42 port = 143 } service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 4096 vsz_limit = 1 G } service pop3-login { inet_listener pop3 { address = 134.147.64.42 port = 110 } service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } ssl = no userdb { driver = passwd } protocol imap { mail_max_userip_connections = 50 mail_plugins = " quota zlib mail_log notify virtual imap_quota imap_zlib" } Thanks Jost Krieger -- | Helft Spam ausrotten! HTML in Mail ist unh?flich. | | Postmaster, JAPH, manchmal Wahrsager am RZ der RUB | | Wahre Worte sind nicht gef?llig, gef?llige Worte sind nicht wahr.| | Lao Tse, Tao Te King 81 | From Ralf.Hildebrandt at charite.de Fri Aug 31 13:01:06 2012 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 31 Aug 2012 12:01:06 +0200 Subject: [Dovecot] Merge multiple doveadm commands Message-ID: <20120831100106.GU23678@charite.de> Can I merge these three commands into one? doveadm expunge -u %s mailbox \"INBOX.Deleted Messages\" NOT NEW doveadm expunge -u %s mailbox INBOX.Trash NOT NEW doveadm expunge -u %s mailbox INBOX deleted -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From tss at iki.fi Fri Aug 31 13:04:09 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 13:04:09 +0300 Subject: [Dovecot] Merge multiple doveadm commands In-Reply-To: <20120831100106.GU23678@charite.de> References: <20120831100106.GU23678@charite.de> Message-ID: <1000E259-87A8-44CE-BFA4-55F925FDF68F@iki.fi> On 31.8.2012, at 13.01, Ralf Hildebrandt wrote: > Can I merge these three commands into one? > > doveadm expunge -u %s mailbox \"INBOX.Deleted Messages\" NOT NEW > doveadm expunge -u %s mailbox INBOX.Trash NOT NEW > doveadm expunge -u %s mailbox INBOX deleted doveadm expunge -u %s \( mailbox \"INBOX.Deleted Messages\" NOT NEW \) or \( mailbox INBOX.Trash NOT NEW \) or \( mailbox INBOX deleted \) (Does "new" actually work? I'm not sure if that's intentional, or simply a side effect of some IMAP behavior accidentally spilling over.. :) From Hauke.Fuhrmann at funkwerk-it.com Fri Aug 31 15:27:40 2012 From: Hauke.Fuhrmann at funkwerk-it.com (Fuhrmann, Hauke) Date: Fri, 31 Aug 2012 14:27:40 +0200 Subject: [Dovecot] Length of attachment filenames Message-ID: Hi there, I have a beginners question to Dovecot: does it have a restriction on the supported length and character encodings of filenames of attachments? Can filenames be arbitrary large? Cheers, Hauke -- Diese E-Mail kann vertrauliche und/oder rechtlich geschuetzte Informationen enthalten. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtuemlich erhalten haben, informieren Sie bitte sofort den Absender durch eine Antwortmail und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. Wir danken fuer Ihre Kooperation. This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error, you are on notice of its status. Please notify the sender immediately by reply e-mail and delete this e-mail from your systems. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly prohibited. Thank you for your cooperation. From tss at iki.fi Fri Aug 31 16:10:14 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:10:14 +0300 Subject: [Dovecot] Variables in LDAP userdb In-Reply-To: <50334A72.2020908@integrafin.co.uk> References: <503255FA.9080300@integrafin.co.uk> <50334A72.2020908@integrafin.co.uk> Message-ID: <9D363A6A-454B-484B-B7C1-7745DCF30B2C@iki.fi> On 21.8.2012, at 11.44, Alex Crow wrote: > To clarify, what happens in these case with regard to the default mail_location set in the config files (ie is it used or overridden): > > 1. The LDAP attribute referenced in the userdb lookup exists but is empty The value will be overridden as empty, which could be an error. > 2. The LDAP attribute is not present for the user. The value isn't overridden. From tss at iki.fi Fri Aug 31 16:19:38 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:19:38 +0300 Subject: [Dovecot] segfault in mail_user_get_home() In-Reply-To: References: Message-ID: <384C6524-721B-4700-A550-EFEB897A8B24@iki.fi> I couldn't reproduce it with your config, but I figured out the cause of it anyway. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/6b9db780b47d On 21.8.2012, at 15.45, Lazy wrote: > it was shared namespace with empty location that produced the error > so : > namespace test { > list = children > location = > prefix = test. > subscriptions = yes > type = shared > } > > segfaults > > with location is fine > > > > 2012/8/21, Lazy : >> gdb ./src/imap/.libs/imap >> >> Reading symbols from /usr/src/dovecot-2.1.9/src/imap/.libs/imap...done. >> (gdb) run >> Starting program: /usr/src/dovecot-2.1.9/src/imap/.libs/imap >> warning: no loadable sections found in added symbol-file >> system-supplied DSO at 0x7ffff7ffa000 >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> process 1104 is executing new program: /usr/local/dovecot/bin/doveconf >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> process 1104 is executing new program: >> /usr/src/dovecot-2.1.9/src/imap/.libs/imap >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". >> >> Program received signal SIGSEGV, Segmentation fault. >> 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, >> home_r=0x7fffffffe308) at mail-user.c:310 >> 310 if (user->home_looked_up) { >> (gdb) bt >> #0 0x00007ffff7b2a0ff in mail_user_get_home (user=0x0, >> home_r=0x7fffffffe308) at mail-user.c:310 >> #1 0x00007ffff7ad172e in mdbox_storage_find_root_dir (ns=0x648610) at >> mdbox-storage.c:90 >> #2 0x00007ffff7ad180c in mdbox_storage_autodetect (ns=0x648610, >> set=0x7fffffffe4d0) at mdbox-storage.c:113 >> #3 0x00007ffff7b2345d in mail_storage_autodetect (ns=0x648610, >> set=0x7fffffffe4d0) at mail-storage.c:105 >> #4 0x00007ffff7b2369d in mail_storage_get_class (ns=0x648610, >> driver=0x0, list_set=0x7fffffffe4d0, flags=0, error_r=0x7fffffffe5b8) >> at mail-storage.c:180 >> #5 0x00007ffff7b23c90 in mail_storage_create (ns=0x648610, >> driver=0x0, flags=0, error_r=0x7fffffffe5b8) at mail-storage.c:342 >> #6 0x00007ffff7b1c62a in namespace_add (user=0x649be0, >> ns_set=0x64a8c8, unexpanded_ns_set=0x64a1c0, mail_set=0x64a440, >> ns_p=0x645380, >> error_r=0x7fffffffe6e8) at mail-namespace.c:126 >> #7 0x00007ffff7b1ccbb in mail_namespaces_init (user=0x649be0, >> error_r=0x7fffffffe6e8) at mail-namespace.c:289 >> #8 0x00007ffff7b34a64 in mail_storage_service_init_post >> (ctx=0x633460, user=0x633e08, priv=0x7fffffffe6f0, >> mail_user_r=0x7fffffffe7b8, >> error_r=0x7fffffffe6e8) at mail-storage-service.c:641 >> #9 0x00007ffff7b35dd6 in mail_storage_service_next (ctx=0x633460, >> user=0x633e08, mail_user_r=0x7fffffffe7b8) at >> mail-storage-service.c:1114 >> #10 0x00007ffff7b35efa in mail_storage_service_lookup_next >> (ctx=0x633460, input=0x7fffffffe810, user_r=0x7fffffffe7c0, >> mail_user_r=0x7fffffffe7b8, >> error_r=0x7fffffffe808) at mail-storage-service.c:1149 >> #11 0x000000000041f61c in client_create_from_input >> (input=0x7fffffffe810, login_client=0x7fffffffe880, fd_in=0, fd_out=1, >> input_buf=0x0, >> error_r=0x7fffffffe808) at main.c:202 >> #12 0x000000000041f859 in main_stdio_run (username=0x0) at main.c:247 >> #13 0x000000000041fd0a in main (argc=1, argv=0x631370) at main.c:381 >> >> /usr/local/dovecot/bin/doveconf -n >> # 2.1.9: /usr/local/dovecot/etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32 x86_64 Debian wheezy/sid >> namespace test { >> list = children >> location = maildir:/root/test >> prefix = test. >> subscriptions = yes >> type = shared >> } >> namespace inbox { >> inbox = yes >> list = yes >> location = >> mailbox Drafts { >> special_use = \Drafts >> } >> mailbox Junk { >> special_use = \Junk >> } >> mailbox Sent { >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> special_use = \Trash >> } >> prefix = >> subscriptions = yes >> } >> passdb { >> driver = pam >> } >> ssl = no >> userdb { >> driver = passwd >> } >> >> without type = shared there is no segfault, >> >> I understand this config might not work (invoking imap directly) but >> it should't segfault. >> >> Regards, >> >> Michal Grzedzicki >> > From tss at iki.fi Fri Aug 31 16:23:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:23:07 +0300 Subject: [Dovecot] exclude a folder for lazy expunge (move to trash) In-Reply-To: <503491C4.7030208@um.es> References: <503491C4.7030208@um.es> Message-ID: <712399DF-2E5C-4BCF-BF4B-3C8A919D4F9B@iki.fi> On 22.8.2012, at 11.01, Angel L. Mateo wrote: > I'm configuring lazy expunge plugin to act as a kind of backup of my user's emails. > > I'm getting a little problem because a lot of my users use "move to trash" behaviour in their email client (most of them are using thunderbird which has no option to hide deleted messages and is a hassle working with mark as deleted with it). The problem combining move to trash with lazy expunge is that messages are stored in the expunge namespace twice, first when it was deleted from the original folder and the second when is deleted from the trash. > > So... is there any way to exclude trash folder from lazy expunge plugin, so mails are stored in the expunge namespace only when they are deleted from their original folder and not from the trash? Not right now. Maybe it could be automatically done when SPECIAL-USE is enabled and the deletion is from a \Trash mailbox. > Another idea... We are purging trash folders with a cron running "doveadm purge" commands. Is there any way to run this command disabling lazy expunge plugin? doveadm purge shouldn't affect lazy expunge, but you can disable lazy_expunge by using something like doveadm -o mail_plugins=everything,except,lazy_expunge expunge .. From tss at iki.fi Fri Aug 31 16:34:20 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:34:20 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <504072FA.8020606@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> Message-ID: <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> On 31.8.2012, at 11.16, Sascha Zucca wrote: > Hi! > Still noone? > strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. No. I can't reproduce it. What does your LIST "" * reply look like now with v2.1? From tss at iki.fi Fri Aug 31 16:40:44 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:40:44 +0300 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <5035D234.50306@optusnet.com.au> References: <5035D234.50306@optusnet.com.au> Message-ID: <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> On 23.8.2012, at 9.48, Dominic Malolepszy wrote: > I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings From tss at iki.fi Fri Aug 31 16:46:08 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:46:08 +0300 Subject: [Dovecot] pop3 migration In-Reply-To: <503632C7.2070008@rfa.cz> References: <503632C7.2070008@rfa.cz> Message-ID: <984B7F63-322D-430E-B495-88ED2274728A@iki.fi> On 23.8.2012, at 16.40, TeTeHacko wrote: > I have problems with pop3 migration, the server disconect the dovesync when > fetching mails after 5 minutes with this error in server log: > > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6548 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 47522 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6549 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 355289 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6550 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 9638 octets > xx.xx.xx.xx [28F4] 11:54:05 <<< RETR 6551 > xx.xx.xx.xx [28F4] 11:54:05 >>> +OK 2188 octets > xx.xx.xx.xx [28F4] 11:59:05 >>> -ERR Command unrecognized: "" > xx.xx.xx.xx [28F4] 11:59:05 *** 6551 477693894 00:12:55 ERROR > xx.xx.xx.xx [28F4] 11:59:05 Disconnected Looks like a bug. But in Dovecot POP3 client or the POP3 server? Apparently either Dovecot sends an empty line after RETR or the server thinks Dovecot sends it. Can you get the actual TCP traffic logs? and/or set pop3c_rawlog_dir and see if it's there. From tss at iki.fi Fri Aug 31 16:49:52 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:49:52 +0300 Subject: [Dovecot] Vpopmail Dynamic Authentication Module In-Reply-To: References: Message-ID: <8992E740-591B-4572-AE89-5260D40CBB8F@iki.fi> On 24.8.2012, at 16.42, Eric Sisolak wrote: > I had to modify the command to build the module, but was able to > successfully build it: > gcc -shared -fPIC -DHAVE_CONFIG_H -DUSERDB_VPOPMAIL -DPASSDB_VPOPMAIL > -I../.. -I../lib -I/home/vpopmail/include -I/home/vpopmail/lib > userdb-vpopmail.c passdb-vpopmail.c -o vpopmail.so > -L/home/vpopmail/lib/libvpopmail.a -L means a path, pointing it to .a file doesn't do anything useful. By giving the .a file directly probably also fails if libvpopmail.a hasn't been built with -fPIC. > /usr/lib64/dovecot/auth/vpopmail.so: undefined symbol: vclose And that's the reason this fails, because libvpopmail isn't included in vpopmail.so. From tss at iki.fi Fri Aug 31 16:53:51 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:53:51 +0300 Subject: [Dovecot] Length of attachment filenames In-Reply-To: References: Message-ID: <79371183-6453-4A1B-BFCB-377643FD09EF@iki.fi> On 31.8.2012, at 15.27, Fuhrmann, Hauke wrote: > I have a beginners question to Dovecot: does it have a restriction on > the supported length and character encodings of filenames of > attachments? > > Can filenames be arbitrary large? The filenames in IMAP's BODYSTRUCTURE reply probably get truncated somewhere around 8192 bytes (then again, maybe not, depends on the encoding I think). And in any case not all IMAP clients use BODYSTRUCTURE. From tss at iki.fi Fri Aug 31 16:54:45 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:54:45 +0300 Subject: [Dovecot] mail_location / mail_home In-Reply-To: <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> References: <38719C76-8672-4F85-B4EA-8802CF85BE63@4lin.net> <87817242-5739-4FA8-9A52-400E4E7DBA2B@4lin.net> Message-ID: On 31.8.2012, at 11.15, Denny Schierz wrote: > Am 31.08.2012 um 09:55 schrieb Denny Schierz: >> >> mail_home = /imap/spool/%d/%1u/%u >> mail_location = maildir:~/:INDEX=~/ > > I think, it doesn't make any difference, if I have "~" or a fixed path :-/ On the productive system (also 2.1.9) I get messages like: > > [...] dovecot.lda-dupes/tmp) failed: Not a directory [...] Here's a simple fix: maildir_stat_dirs=yes From tss at iki.fi Fri Aug 31 16:56:59 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 16:56:59 +0300 Subject: [Dovecot] LDAP auth and multiple attributes to construct the mail path In-Reply-To: References: Message-ID: On 31.8.2012, at 2.45, Anatoly Ivanov wrote: > So I am trying to construct mail path for my LDAP user lookups, and i need > to use two attributes instead of one. > > For examle, my LDAP directory has two attributes: departmentAttr and > userIDAttr, and I want the maildir to reside in > /home/${departmentAttr}/${userIDAttr} With v2.1: /home/%{ldap:departmentAttr}/%{ldap:userIDAttr} With older versions: you can't. From zucca at systemschmiede.com Fri Aug 31 16:59:08 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 15:59:08 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> Message-ID: <5040C32C.2020706@systemschmiede.com> Hi and thanks for replying! Here's what you asked for: _*with %%n:*_ 1 LIST "" * * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" * LIST (\Noselect \HasChildren) "/" "Freigaben/testuser-1" * LIST (\HasNoChildren) "/" "Freigaben/testuser-1/INBOX/test" 1 OK List completed. _*with %%u:*_ 1 LIST "" * * LIST (\HasNoChildren) "/" "Papierkorb" * LIST (\HasNoChildren) "/" "Gesendete Objekte" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasNoChildren) "/" "Entw&APw-rfe" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "Freigaben/testuser-1 at parrotshop.de" * LIST (\HasNoChildren) "/" "Freigaben/testuser-1 at parrotshop.de/INBOX/test" 1 OK List completed. So i guess * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" is the Problem... Thank you again Sascha Am 31.08.2012 15:34, schrieb Timo Sirainen: > On 31.8.2012, at 11.16, Sascha Zucca wrote: > >> Hi! >> Still noone? >> strange...this must be some easy thing to solve if you're familiar with dovecot, i thought. > No. I can't reproduce it. What does your LIST "" * reply look like now with v2.1? > -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From tss at iki.fi Fri Aug 31 17:06:13 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:06:13 +0300 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <5040C32C.2020706@systemschmiede.com> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> Message-ID: <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> On 31.8.2012, at 16.59, Sascha Zucca wrote: > So i guess > * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" > is the Problem... Yes. The problem is, I don't see it even with v2.1.7. Although I do see that when a user sees zero shared mailboxes, but that has also been fixed with v2.1.9. So I'd try upgrading again.. From tss at iki.fi Fri Aug 31 17:11:07 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:11:07 +0300 Subject: [Dovecot] [Postfix] SASL Auth. using Dovecot with password forwarding proxy configuration In-Reply-To: <20120831125120.37a3f7cf@adi.ddns.local> References: <20120831125120.37a3f7cf@adi.ddns.local> Message-ID: <13A83420-05D7-4DBF-A09B-2D2EE1FE9F48@iki.fi> On 31.8.2012, at 5.51, Adi Pircalabu wrote: > I'm relatively new to Dovecot and I did a bit of search but couldn't > find a possible solution for the particular setup I'm working on. > Basically I have an SMTP/POP/IMAP proxy setup running Postfix & > Dovecot. IMAP/POP authentication is done using the password proxy > feature, where the login credentials are passed to the backend server > after a db lookup, which does the actual authentication. POP/IMAP logs the user in and Dovecot proxies it. > The POP/IMAP part is working fine. What I'm trying to do is to use > Dovecot SASL implementation in Postfix to do SMTP authentication in a > similar manner. The problem I have with my current configuration is that > SMTP authentication succeeds if only the username matches, because > password forwarding works if the authentication succeeds with any given > password, as documented at > http://wiki.dovecot.org/PasswordDatabase/ExtraFields/Proxy Dovecot has no SMTP proxy (currently). And anyway Postfix doesn't use SMTP to do authentication, Postfix authenticates using Dovecot's internal protocol, which replies that Postfix should do the proxying, which it of course doesn't do. > My question is, given the above: is there a way to get SMTP > authentication properly in this scenario? Make Postfix authenticate against the backend Dovecot server. You'll need to setup service auth { inet_listener } to some port for it. From d.caspari at eurodata.de Fri Aug 31 16:51:25 2012 From: d.caspari at eurodata.de (Dirk Caspari) Date: Fri, 31 Aug 2012 15:51:25 +0200 Subject: [Dovecot] How Converting/Using courier-userdb Files ? Message-ID: <5040C15D.4000303@eurodata.de> Hello, how can i convert/use the Original userdb-Files from courier Installation ? The files are looking like a "Special"-DB-Format and are not readable. ----------------- #file /etc/courier/userdb.dat /etc/courier/userdb.dat: GNU dbm 1.x or ndbm database, little endian ----------------- /etc/courier/userdb.dat /etc/courier/userdbshadow.dat These Files was created with the following scripts (Part of "courier-authlib-userdb" Package). ......... /usr/sbin/makeuserdb /usr/sbin/pw2userdb /usr/sbin/userdb .......... Regards D I R K -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 7675 bytes Desc: S/MIME Cryptographic Signature URL: From zucca at systemschmiede.com Fri Aug 31 17:17:45 2012 From: zucca at systemschmiede.com (Sascha Zucca) Date: Fri, 31 Aug 2012 16:17:45 +0200 Subject: [Dovecot] Imap Ghost folder In-Reply-To: <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> Message-ID: <5040C789.8000502@systemschmiede.com> Am 31.08.2012 16:06, schrieb Timo Sirainen: > On 31.8.2012, at 16.59, Sascha Zucca wrote: > >> So i guess >> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >> is the Problem... > Yes. The problem is, I don't see it even with v2.1.7. Although I do see that when a user sees zero shared mailboxes, but that has also been fixed with v2.1.9. So I'd try upgrading again.. > hm, but 2.1.9 is not in backports yet, is it? -- Systemschmiede IT-L?sungen Zucca & Teves GbR August-Thyssen-Str. 2-4 52511 Geilenkirchen www.systemschmiede.com Tel.: 02451 - 9088390 Fax: 02451 - 9124070 Mobil: 0178 - 4073254 Ust.ID: DE248030393 From dmalolepszy at optusnet.com.au Fri Aug 31 17:23:55 2012 From: dmalolepszy at optusnet.com.au (Dominic Malolepszy) Date: Sat, 01 Sep 2012 00:23:55 +1000 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> References: <5035D234.50306@optusnet.com.au> <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> Message-ID: <5040C8FB.7020409@optusnet.com.au> On 31/08/2012 11:40 PM, Timo Sirainen wrote: > On 23.8.2012, at 9.48, Dominic Malolepszy wrote: > >> I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. > Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings > > They appear to trigger during maildelivers say via the LDA, however IMAP mailbox interactions (say deleting an email or copying an email) do not trigger them. I ended up having this patched into the quota plugin and works a treat. From tss at iki.fi Fri Aug 31 17:26:23 2012 From: tss at iki.fi (Timo Sirainen) Date: Fri, 31 Aug 2012 17:26:23 +0300 Subject: [Dovecot] Dovecot generate file when over quota detected In-Reply-To: <5040C8FB.7020409@optusnet.com.au> References: <5035D234.50306@optusnet.com.au> <012395C6-0EFC-407D-9B7A-62FA2BAEC4D7@iki.fi> <5040C8FB.7020409@optusnet.com.au> Message-ID: <03EE8709-B737-497E-A5CC-0026154D33F7@iki.fi> On 31.8.2012, at 17.23, Dominic Malolepszy wrote: > On 31/08/2012 11:40 PM, Timo Sirainen wrote: >> On 23.8.2012, at 9.48, Dominic Malolepszy wrote: >> >>> I am curious if Dovecot can add an empty file into a Maildir folder as soon as a mailbox has exceeded 100% capacity, and later when it detects the quota has fallen below 100% unlink the file. The idea is the Dovecot LDA would deliver the message and if this caused the mailbox to reach 100%+, add a file into the maibox say "username/Maildir/overquota". Interactions via Dovecot IMAP/POP3 that lower the mailbox usage, for example the user popping, or deleting mail from the mailbox would trigger Dovecot to unlink the file. >> Quota warning scripts can do that. http://wiki2.dovecot.org/Quota/Configuration#Quota_warnings >> >> > They appear to trigger during maildelivers say via the LDA, however IMAP mailbox interactions (say deleting an email or copying an email) do not trigger them. I ended up having this patched into the quota plugin and works a treat. The quota plugin, including quota warnings, works identically in LDA and IMAP. So I wonder what your patch does. Of course in IMAP a mail deletion is often a copy+mark as deleted with the expunge happening sometimes later. From sven at svenhartge.de Fri Aug 31 19:40:56 2012 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 31 Aug 2012 18:40:56 +0200 Subject: [Dovecot] Imap Ghost folder References: <50341D40.9090001@systemschmiede.com> <50353D32.2080401@systemschmiede.com> <5038B2C5.3090408@systemschmiede.com> <4CE233FA-2954-4C39-9F79-13C12ADFDCF2@iki.fi> <5038CB71.5010808@systemschmiede.com> <503C818A.4010203@systemschmiede.com> <503DE2D9.3080300@systemschmiede.com> <20120829204814.GA9265@daniel.localdomain> <503F0B77.5030206@systemschmiede.com> <504072FA.8020606@systemschmiede.com> <56D9DD4B-ED96-47C6-96F4-322D6907508C@iki.fi> <5040C32C.2020706@systemschmiede.com> <85E5DEFA-D38E-441E-BFE9-64FC820069E8@iki.fi> <5040C789.8000502@systemschmiede.com> Message-ID: <292te8ob8kv8@mids.svenhartge.de> Sascha Zucca wrote: > Am 31.08.2012 16:06, schrieb Timo Sirainen: >> On 31.8.2012, at 16.59, Sascha Zucca wrote: >>> So i guess >>> * LIST (\Noselect \HasNoChildren) "/" "Freigaben/" >>> is the Problem... >> Yes. The problem is, I don't see it even with v2.1.7. Although I do >> see that when a user sees zero shared mailboxes, but that has also >> been fixed with v2.1.9. So I'd try upgrading again.. >> > hm, but 2.1.9 is not in backports yet, is it? And will not be for some time. 2.1.9 is not even in Unstable and even if it were, it would not migrate to testing (and be an eligible backporting target) due to the freeze before the Wheezy release. Gr??e, Sven. -- Sigmentation fault. Core dumped. From user+dovecot at localhost.localdomain.org Fri Aug 31 20:43:32 2012 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Fri, 31 Aug 2012 19:43:32 +0200 Subject: [Dovecot] How Converting/Using courier-userdb Files ? In-Reply-To: <5040C15D.4000303@eurodata.de> References: <5040C15D.4000303@eurodata.de> Message-ID: <5040F7C4.1050908@localhost.localdomain.org> On 08/31/2012 03:51 PM Dirk Caspari wrote: > Hello, > > how can i convert/use the Original userdb-Files from courier Installation ? > The files are looking like a "Special"-DB-Format and are not readable. > ----------------- > #file /etc/courier/userdb.dat > /etc/courier/userdb.dat: GNU dbm 1.x or ndbm database, little endian > ----------------- > > /etc/courier/userdb.dat > /etc/courier/userdbshadow.dat > > These Files was created with the following scripts (Part of > "courier-authlib-userdb" Package). > ......... > /usr/sbin/makeuserdb > /usr/sbin/pw2userdb > /usr/sbin/userdb > .......... > > Regards > D I R K RTFM: makeuserdb(8) / DESCRIPTION / Format of /etc/courier/userdb http://manpages.ubuntu.com/manpages/natty/man8/makeuserdb.8.html Regards, Pascal -- The trapper recommends today: decade.1224419 at localdomain.org