From adi at ente.limmat.ch Wed Jan 1 19:25:47 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Wed, 01 Jan 2014 18:25:47 +0100 Subject: [Dovecot] LMTP with virtual and system users In-Reply-To: <52C1319A.6070309@zid.tuwien.ac.at> References: <52BA8668.5000502@zid.tuwien.ac.at> <52BC10F6.7070306@ente.limmat.ch> <52C1319A.6070309@zid.tuwien.ac.at> Message-ID: <52C44F9B.5020609@ente.limmat.ch> Hi Philipp You are completely right, the proposed solution doesn't work. It seems exim always qualifies an address without a domain, I believe this is because LMTP requiers to get only qualified addresses (LMTP is based on SMTP and the RFC, if I read it correctly specifies it like this). So, another solution would be to use LDA for your local users and LMTP for the rest. The configuration for exim would be: a router and a transport for your local users using LDA, and your virtual users setup as you have it using LMTP. local_user: debug_print = "R: local_user for $local_part@$domain" driver = accept domains = @ : localhost : ${primary_hostname} check_local_user transport = dovecot_lda cannot_route_message = Unknown user dovecot_lda: driver = pipe command = /usr/lib/dovecot/dovecot-lda \ -f $sender_address \ -a $original_local_part@$original_domain log_output delivery_date_add return_path_add envelope_to_add user = $local_part group = mail temp_errors = 64 : 69 : 70 : 71 : 72 : 73 : 74 : 75 : 78 Please check man dovecot-lda and the dovecot wiki (http://wiki2.dovecot.org/LDA/Exim) for details. Also check the permissions you need for dovecot-lda to write to your mailspool (user and group options from the transport). I haven't tried the above, but I think it works like this ... Best regards, Adrian. Am 30.12.13 09:40 schrieb Philipp Kolmann: > Hi Adrian, > > Am 26.12.2013 12:20, schrieb Adrian Zaugg: >> You can use exim to prepare the address as you wish: only the user name >> for pam users and the full address for virtual users. >> >> Configure a new router to strip the domain part for pam users: >> >> local_pam_users: >> debug_print = "R: strip domain for local pam users" >> driver = redirect >> check_local_user >> domains = @ : localhost : ${primary_hostname} >> data = ${local_part} >> redirect_router = local_user >> >> I'm not 100% sure of the domains condition; it should restrict the >> router to your domain(s) where your pam users receive their email. The >> redirect_router designates the router which routes your local deliveries >> to your lmtp transport. Place the new router to run just before your >> "local_user" router. >> >> Since your config works for your virtual users, you don't need to do >> anything in addition. > > I had tried this once already. I have used your snipplet and attached > the debug output from exim. Sadly it didn't work, because the mtp > process got the foll email again and not just the username. > > thanks > Philipp > > > From phuhimself at phunehehe.net Thu Jan 2 09:45:45 2014 From: phuhimself at phunehehe.net (phuhimself at phunehehe.net) Date: Thu, 02 Jan 2014 15:45:45 +0800 Subject: [Dovecot] Dovecot doesn't seem to read userdb for the first delivery Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hello List, First of all, this is my first post so please bear with me if I miss something. I'm using Postfix with Dovecot 2.0.19 as the LDA. The home directory is of the form `/var/mail/virtual//`. The mail directory is under the home directory and named `mail`. `mail_location` is left empty, and userdb is specified using SQL: user_query = SELECT uid AS uid, \ gid AS gid, \ homedir AS home, \ maildir AS mail \ FROM users WHERE email = '%u' Everything had been fine, until I added a new user. In the log, Dovecot complains that it doesn't have permission to create the mail directory (email address replaced): > Jan 2 05:46:19 mail1 dovecot: lda(test at test.com): Error: user > test at test.com: > Initialization failed: Initializing mail storage from mail_location > setting > failed: mkdir(mail) in directory /var/spool/postfix failed: Permission > denied > (euid=5000(virtual) egid=5000(virtual) missing +w perm: > /var/spool/postfix, > dir owned by 0:0 mode=0755) Sometimes it complains about /run/dovecot instead of /var/spool/postfix, but I think that doesn't really matter. I think not specifying `mail_location` confused Dovecot, as explained in [MailLocation][1]. When I put in the right value for `mail_location` the error went away. What I don't understand is, it is said in the [same document][1] that the userdb field `mail` will override `mail_location` anyway. I would think that I can skip `mail_location` if I specify userdb `mail` for all users. Is the document wrong? Thanks, Phu [1]: http://wiki2.dovecot.org/MailLocation -----BEGIN PGP SIGNATURE----- Version: OpenPGP.js v.1.20131017 Comment: http://openpgpjs.org wsFcBAEBCAAQBQJSxRknCRD8UQvv5Zm+EAAAj68P/iidn6jYSNlhLY2640Qg vPC9xg0lhH/LJLEMMK+oSDnOmF+Hjtm/IMctOVDiTnPfdbvoC9oE4RWnKlL0 /couQQHQKjh2L2mqN50buROjUQyR+pQXGNfVGS+jq74S30299/VnH+gWPUSV xYRb1i6wuKVGCCNRF3vJHZs1eCiEFKpvC4LUiI5yarclCUE4mCtRO97Iadu/ GTaXn3euy5/5dyZEiPvld5IcGJ0BMC5RJiHb89EpN7A5J+4MvlMNUdcPYgcF j+ilwsOCpchj1AfjLnosnpCJRysin8aYj9mxGC+gR2/fAIm242qBNrVpnLQM IjP8G1pKhxKzQx2jFnENvhTKaxDSIWva0u/CSxSiCE3Kepj1b39qsjFlM8k7 0/EzoWf1rxzy0kQQ1qNeoz1Ta93D2cWQkTj6AK6kVmtmt9iaqzjGU+n7w3ae n+hoYs19r8LnhqSrlAX/N10h7/B++SRJG81EUB4tJF+LtRknFJa1qyr7Guh/ mOieUupr9Ks5WlPYaZ77t61FZauI0bK716p+J5C/f75EdWMrUInVumGletk/ FIaILS6nhq+D6SvrqiVseKvhjc+6p4HoeNVotceus+yssNmkniey5j3Hs0H5 EPmmkAT+hNN5R0wcbj2LaErG3VQ6SGMdY/suIJQb1Aq08nymtVaA2mS8Tcnm Z+O+ =pqon -----END PGP SIGNATURE----- -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: pubkey.asc URL: From nmilas at noa.gr Thu Jan 2 15:23:57 2014 From: nmilas at noa.gr (Nikolaos Milas) Date: Thu, 02 Jan 2014 15:23:57 +0200 Subject: [Dovecot] Problem building dovecot 2.2.10 with pigeonhole 0.4.2 Message-ID: <52C5686D.4020209@noa.gr> Hi, I am on CentOS 5.10 x86_64 and I am trying to build RPMs for Dovecot 2.2.10 with pigeonhole 0.4.2. I am getting an error that autogen.sh is missing from pigeonhole 0.4.2 source (as available from: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.2.tar.gz): /var/tmp/rpm-tmp.89185: line 92: /home/mockbuild/rpmbuild/BUILD/dovecot-2.2.10/dovecot-2.2-pigeonhole-0.4.2/autogen.sh: No such file or directory Indeed, the file is missing, as: tar --list -f dovecot-2.2-pigeonhole-0.4.2.tar.gz | grep autogen ...produces no output. However, I managed to use the latest source code: http://hg.rename-it.nl/dovecot-2.2-pigeonhole/shortlog/32beba3bfd8d which does contain an autogen.sh, and this package worked fine. I guess the released source tar pack should be updated? Thanks and regards, Nick From anant.saraswat at techblue.co.uk Thu Jan 2 16:03:29 2014 From: anant.saraswat at techblue.co.uk (Anant) Date: Thu, 02 Jan 2014 19:33:29 +0530 Subject: [Dovecot] How to remove Dovecot (LMTP) information from Email header Message-ID: <52C571B1.8010709@techblue.co.uk> Hello All, I want to remove Dovecot (LMTP) information from Email Header, Please help me. I am using Dovecot 2.0.9 with Exim. Received: from XX.XXblue.co.uk by XX.XXblue.co.uk*(Dovecot) with LMTP id* XIuTJkJFxVLKTwAAG2fxGQ for ; Thu, 02 Jan 2014 10:59:28 +0000 Received: from [210.7.64.2] (helo=[192.168.100.71]) by solo.techblue.co.uk with esmtp (Exim 4.72) (envelope-from ) id 1Vyfzr-0005Oy-7H for anant.saraswat at techblue.co.uk; Thu, 02 Jan 2014 10:59:28 +0000 Thanks & Regards, Anant Saraswat From adi at ente.limmat.ch Thu Jan 2 16:42:44 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Thu, 02 Jan 2014 15:42:44 +0100 Subject: [Dovecot] How to remove Dovecot (LMTP) information from Email header In-Reply-To: <52C571B1.8010709@techblue.co.uk> References: <52C571B1.8010709@techblue.co.uk> Message-ID: <52C57AE4.3010503@ente.limmat.ch> Dear Anant According to RFC 3848 you should not remove those headers. RFC 5321 (SMTP), Section 4.4. also says that trace information is mandatory to add and RFC 2033 (LMTP) makes no exception to this. If you do not like those headers, use LDA for local storage, it doesn't add any headers. Regards, Adrian. On 02/01/14 15:03, Anant wrote: > Hello All, > > I want to remove Dovecot (LMTP) information from Email Header, Please > help me. I am using Dovecot 2.0.9 with Exim. > > Received: from XX.XXblue.co.uk > by XX.XXblue.co.uk*(Dovecot) with LMTP id* XIuTJkJFxVLKTwAAG2fxGQ > for ; Thu, 02 Jan 2014 10:59:28 +0000 > Received: from [210.7.64.2] (helo=[192.168.100.71]) > by solo.techblue.co.uk with esmtp (Exim 4.72) > (envelope-from ) > id 1Vyfzr-0005Oy-7H > for anant.saraswat at techblue.co.uk; Thu, 02 Jan 2014 10:59:28 +0000 > > > > Thanks & Regards, > Anant Saraswat > > From stephan at rename-it.nl Thu Jan 2 17:02:34 2014 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 02 Jan 2014 16:02:34 +0100 Subject: [Dovecot] Problem building dovecot 2.2.10 with pigeonhole 0.4.2 In-Reply-To: <52C5686D.4020209@noa.gr> References: <52C5686D.4020209@noa.gr> Message-ID: <52C57F8A.1070705@rename-it.nl> On 1/2/2014 2:23 PM, Nikolaos Milas wrote: > Hi, > > I am on CentOS 5.10 x86_64 and I am trying to build RPMs for Dovecot > 2.2.10 with pigeonhole 0.4.2. > > I am getting an error that autogen.sh is missing from pigeonhole 0.4.2 > source (as available from: > http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.2.tar.gz): > > > /var/tmp/rpm-tmp.89185: line 92: > /home/mockbuild/rpmbuild/BUILD/dovecot-2.2.10/dovecot-2.2-pigeonhole-0.4.2/autogen.sh: > No such file or directory > > Indeed, the file is missing, as: > > tar --list -f dovecot-2.2-pigeonhole-0.4.2.tar.gz | grep autogen > > ...produces no output. > > However, I managed to use the latest source code: > > http://hg.rename-it.nl/dovecot-2.2-pigeonhole/shortlog/32beba3bfd8d > > which does contain an autogen.sh, and this package worked fine. > > I guess the released source tar pack should be updated? The autogen.sh script is never included in the tarball distribution. It is used to initialize your source tree if you've retrieved the sources through mercurial. As stated in the INSTALL file, when you've downloaded a tarball, you only need to execute configure with the appropriate arguments and subsequently you can perform the usual make and make install. This was no different in previous releases and Dovecot itself. Regards, Stephan. From anant.saraswat at techblue.co.uk Thu Jan 2 17:57:57 2014 From: anant.saraswat at techblue.co.uk (Anant) Date: Thu, 02 Jan 2014 21:27:57 +0530 Subject: [Dovecot] How to remove Dovecot (LMTP) information from Email header In-Reply-To: <52C57AE4.3010503@ente.limmat.ch> References: <52C571B1.8010709@techblue.co.uk> <52C57AE4.3010503@ente.limmat.ch> Message-ID: <52C58C85.7020702@techblue.co.uk> Dear Adrian, Thanks for your reply , But I feel that I am ok with this header then. Regards, Anant Saraswat On Thursday 02 January 2014 08:12 PM, Adrian Zaugg wrote: > Dear Anant > > According to RFC 3848 you should not remove those headers. RFC 5321 > (SMTP), Section 4.4. also says that trace information is mandatory to > add and RFC 2033 (LMTP) makes no exception to this. > If you do not like those headers, use LDA for local storage, it > doesn't add any headers. > > Regards, Adrian. > > On 02/01/14 15:03, Anant wrote: >> Hello All, >> >> I want to remove Dovecot (LMTP) information from Email Header, Please >> help me. I am using Dovecot 2.0.9 with Exim. >> >> Received: from XX.XXblue.co.uk >> by XX.XXblue.co.uk*(Dovecot) with LMTP id* XIuTJkJFxVLKTwAAG2fxGQ >> for ; Thu, 02 Jan 2014 10:59:28 >> +0000 >> Received: from [210.7.64.2] (helo=[192.168.100.71]) >> by solo.techblue.co.uk with esmtp (Exim 4.72) >> (envelope-from ) >> id 1Vyfzr-0005Oy-7H >> for anant.saraswat at techblue.co.uk; Thu, 02 Jan 2014 10:59:28 +0000 >> >> >> >> Thanks & Regards, >> Anant Saraswat >> >> > From CMarcus at Media-Brokers.com Fri Jan 3 15:32:49 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 03 Jan 2014 08:32:49 -0500 Subject: [Dovecot] Allow both SSL/993 and STARTTLS/143 connections (secure only) Message-ID: <52C6BC01.6090109@Media-Brokers.com> Hi all, Ok, up until now, I've only always allowed IMAPS connections to dovecot on port 993. I want to also start allowing clients to user port143+STARTTLS, but I walso want to make sure both ports are locked down to ONLY allow secure connections. So... is disable_plaintext_auth = yes in the main config enough to accomplish this? http://wiki2.dovecot.org/SSL/DovecotConfiguration says: There are a couple of different ways to specify when SSL/TLS is required: * disable_plaintext_auth=yes allows plaintext authentication only when SSL/TLS is used first. * ssl = required requires SSL/TLS also for non-plaintext authentication . * If you have only plaintext mechanisms enabled (auth { mechanisms = plain login } ), you can use either (or both) of the above settings. They behave exactly the same way then and the comments in 10-auth.conf say: # Disable LOGIN command and all other plaintext authentications unless # SSL/TLS is used (LOGINDISABLED capability). Note that if the remote IP # matches the local IP (ie. you're connecting from the same computer), the # connection is considered secure and plaintext authentication is allowed. # See also ssl=required setting. #disable_plaintext_auth = yes These seem to be saying that all I need to do is set either or both (ssl-required and/or disable_plaintext_auth=yes). I'm looking for the simplest, and don't like redundant/unnecessary settings, so... which is the best/preferred way? And what is the difference between ssl=required and disable_plaintext_auth=yes? Thanks, -- Best regards, */Charles/*** From CMarcus at Media-Brokers.com Fri Jan 3 17:08:15 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 03 Jan 2014 10:08:15 -0500 Subject: [Dovecot] Allow both SSL/993 and STARTTLS/143 connections (secure only) In-Reply-To: <52C6BC01.6090109@Media-Brokers.com> References: <52C6BC01.6090109@Media-Brokers.com> Message-ID: <52C6D25F.10004@Media-Brokers.com> On 2014-01-03 8:32 AM, Charles Marcus wrote: > > Ok, up until now, I've only always allowed IMAPS connections to > dovecot on port 993. > > I want to also start allowing clients to user port143+STARTTLS, but I > walso want to make sure both ports are locked down to ONLY allow > secure connections. And I just had an idea, but don't know if it is possible. Can I offer one namespace on one port (ie, SSL/993), and a different namespace on the other port (STARTTLS/143)? This would be a simple and effective way to migrate users from one namespace to another... have them change both the port/security setting and the namespace prefix at the same time, then restart the client... boom. And this suggests it is possible: http://wiki2.dovecot.org/Namespaces The section name in namespaces (e.g. namespace sectionname { .. } is used only internally within configuration. It's not required at all, but it allows you to update an existing namespace (like how 15-mailboxes.conf does) or have userdb override namespace settings for specific users (namespace/sectionname/prefix=foo/). But the question is, how exactly to implement it, and I can't see from the docs exactly how to go about it. -- Best regards, */Charles/* From frank at moltke28.B.Shuttle.DE Fri Jan 3 17:20:07 2014 From: frank at moltke28.B.Shuttle.DE (Frank Elsner) Date: Fri, 3 Jan 2014 16:20:07 +0100 Subject: [Dovecot] Allow both SSL/993 and STARTTLS/143 connections (secure only) In-Reply-To: <52C6D25F.10004@Media-Brokers.com> References: <52C6BC01.6090109@Media-Brokers.com> <52C6D25F.10004@Media-Brokers.com> Message-ID: <20140103162007.b106b7795ef9dae049e24416@moltke28.B.Shuttle.DE> On Fri, 03 Jan 2014 10:08:15 -0500 Charles Marcus wrote: > On 2014-01-03 8:32 AM, Charles Marcus wrote: > > > > Ok, up until now, I've only always allowed IMAPS connections to > > dovecot on port 993. > > > > I want to also start allowing clients to user port143+STARTTLS, but I > > walso want to make sure both ports are locked down to ONLY allow > > secure connections. > > And I just had an idea, but don't know if it is possible. > > Can I offer one namespace on one port (ie, SSL/993), and a different > namespace on the other port (STARTTLS/143)? You dont' need 2 namespaces. In 10-auth.conf set "disable_plaintext_auth = yes" My 10-master.conf contains | service imap-login { | inet_listener imap { | port = 143 | } | inet_listener imaps { | port = 993 | ssl = yes | } And this works. --Frank Elsner -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 836 bytes Desc: not available URL: From CMarcus at Media-Brokers.com Fri Jan 3 18:09:49 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 03 Jan 2014 11:09:49 -0500 Subject: [Dovecot] SOLVED: Re: Allow both SSL/993 and STARTTLS/143 connections (secure only) In-Reply-To: <20140103162007.b106b7795ef9dae049e24416@moltke28.B.Shuttle.DE> References: <52C6BC01.6090109@Media-Brokers.com> <52C6D25F.10004@Media-Brokers.com> <20140103162007.b106b7795ef9dae049e24416@moltke28.B.Shuttle.DE> Message-ID: <52C6E0CD.7070201@Media-Brokers.com> On 2014-01-03 10:20 AM, Frank Elsner wrote: > On Fri, 03 Jan 2014 10:08:15 -0500 Charles Marcus wrote: >> And I just had an idea, but don't know if it is possible. >> >> Can I offer one namespace on one port (ie, SSL/993), and a different >> namespace on the other port (STARTTLS/143)? > You dont' need 2 namespaces. > > In 10-auth.conf set "disable_plaintext_auth = yes" > > > My 10-master.conf contains > > | service imap-login { > | inet_listener imap { > | port = 143 > | } > | inet_listener imaps { > | port = 993 > | ssl = yes > | } > > And this works. And this just totally solved one of the last problems I was facing doing the transition... Adding the above combined with the courier-imap compatibility namespace results in ALL clients looking normal, regardless of which port or namespace prefix they are configured to use. Thanks Frank!! -- Best regards, */Charles/* From CMarcus at Media-Brokers.com Fri Jan 3 22:44:28 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 03 Jan 2014 15:44:28 -0500 Subject: [Dovecot] RFE: IMAP LIST Extension for Special-Use Mailboxes In-Reply-To: <20110311223136.GE32718@state-of-mind.de> References: <20110311215739.GD13492@state-of-mind.de> <4D7A9C2F.7050600@Media-Brokers.com> <20110311223136.GE32718@state-of-mind.de> Message-ID: <52C7212C.6080009@Media-Brokers.com> Sorry for replying to such an old email, but... I'm wondering how 'Templates' got left out? It is a Special folder in Thunderbird that you can't delete - and it is very useful (at least in Thunderbird) as well... I tried adding it in my dovecot (2.2.10) config, but it complained about an unsupported option... On 2011-03-11 5:31 PM, Patrick Ben Koetter

wrote: > A server may, for example, mark a folder as \Sent. > > Any client that connects to such a server can search for a folder that has > been attributed as "Sent". > > No need to create a new folder "Sent Items" if there's a special folder marked > as \Sent. Same goes for clients that insist on calling it "sent" or "Gesendete > Objekte" or ... > > The RFC reserves a list of special use folders: > > \All > This mailbox presents all messages in the user's message store. > Implementations MAY omit some messages, such as, perhaps, those > in \Trash and \Junk. When this special use is supported, it is > almost certain to represent a virtual mailbox. > > \Archive > This mailbox is used to archive messages. The meaning of an > "archival" mailbox is server-dependent; typically, it will be > used to get messages out of the inbox, or otherwise keep them > out of the user's way, while still making them accessible. > > \Drafts > This mailbox is used to hold draft messages -- typically, > messages that are being composed but have not yet been sent. In > some server implementations, this might be a virtual mailbox, > containing messages from other mailboxes that are marked with > the "\Draft" message flag. Alternatively, this might just be > advice that a client put drafts here. > > \Flagged > This mailbox presents all messages marked in some way as > "important". When this special use is supported, it is likely > to represent a virtual mailbox collecting messages (from other > mailboxes) that are marked with the "\Flagged" message flag. > > \Junk > This mailbox is where messages deemed to be junk mail are held. > Some server implementations might put messages here > automatically. Alternatively, this might just be advice to a > client-side spam filter. > > \Sent > This mailbox is used to hold copies of messages that have been > sent. Some server implementations might put messages here > automatically. Alternatively, this might just be advice that a > client save sent messages here. > > \Trash > This mailbox is used to hold messages that have been deleted or > marked for deletion. In some server implementations, this might > be a virtual mailbox, containing messages from other mailboxes From CMarcus at Media-Brokers.com Fri Jan 3 22:52:27 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 03 Jan 2014 15:52:27 -0500 Subject: [Dovecot] disable_plaintext_auth = yes not showing in doveconf -n output? Message-ID: <52C7230B.4060501@Media-Brokers.com> I have it set, but it doesn't show up. However, I noticed that it does show as enabled by default in doveconf -a output. Is this why it doesn't show up in doveconf -n output? -- Best regards, Charles From larryrtx at gmail.com Fri Jan 3 22:54:21 2014 From: larryrtx at gmail.com (Larry Rosenman) Date: Fri, 3 Jan 2014 14:54:21 -0600 Subject: [Dovecot] disable_plaintext_auth = yes not showing in doveconf -n output? In-Reply-To: <52C7230B.4060501@Media-Brokers.com> References: <52C7230B.4060501@Media-Brokers.com> Message-ID: IIRC doveconf -n shows NON-DEFAULT settings :) On Fri, Jan 3, 2014 at 2:52 PM, Charles Marcus wrote: > I have it set, but it doesn't show up. > > However, I noticed that it does show as enabled by default in doveconf -a > output. > > Is this why it doesn't show up in doveconf -n output? > > -- > > Best regards, > > Charles > > > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688 From CMarcus at Media-Brokers.com Fri Jan 3 22:58:42 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 03 Jan 2014 15:58:42 -0500 Subject: [Dovecot] disable_plaintext_auth = yes not showing in doveconf -n output? In-Reply-To: References: <52C7230B.4060501@Media-Brokers.com> Message-ID: <52C72482.3030406@Media-Brokers.com> On 2014-01-03 3:54 PM, Larry Rosenman wrote: > IIRC doveconf -n shows NON-DEFAULT settings :) This I know, but doveconf -n was inspired by postfix's postconf -n feature, and with postfix, if I explicitly set something that is set the same way by default, it still shows up in -n output. It makes it easy to 'clean up' your configs (ie, unset settings that don't need to be explicitly set because they are defaults)... I think this may be an oversight in Timo's implementation... ? > On Fri, Jan 3, 2014 at 2:52 PM, Charles Marcus wrote: > >> I have it set, but it doesn't show up. >> >> However, I noticed that it does show as enabled by default in doveconf -a >> output. >> >> Is this why it doesn't show up in doveconf -n output? From p at sys4.de Fri Jan 3 23:13:07 2014 From: p at sys4.de (Patrick Ben Koetter) Date: Fri, 3 Jan 2014 22:13:07 +0100 Subject: [Dovecot] RFE: IMAP LIST Extension for Special-Use Mailboxes In-Reply-To: <52C7212C.6080009@Media-Brokers.com> References: <20110311215739.GD13492@state-of-mind.de> <4D7A9C2F.7050600@Media-Brokers.com> <20110311223136.GE32718@state-of-mind.de> <52C7212C.6080009@Media-Brokers.com> Message-ID: <20140103211306.GC12726@sys4.de> * Charles Marcus : > Sorry for replying to such an old email, but... Thank you. You just made me feel very old... ;) > I'm wondering how 'Templates' got left out? > > It is a Special folder in Thunderbird that you can't delete - and it > is very useful (at least in Thunderbird) as well... > > I tried adding it in my dovecot (2.2.10) config, but it complained > about an unsupported option... I searched a few minutes, but couldn't find the link to quote here: Special-Use Mailbox names need to be registered. IIRC Templates didn't make it into the first RFC. I am not aware of a discussion that abandoned it either. Probably, if you gave it a try, you can have it added and Timo will add it afterwards... p at rick > On 2011-03-11 5:31 PM, Patrick Ben Koetter

wrote: > >A server may, for example, mark a folder as \Sent. > > > >Any client that connects to such a server can search for a folder that has > >been attributed as "Sent". > > > >No need to create a new folder "Sent Items" if there's a special folder marked > >as \Sent. Same goes for clients that insist on calling it "sent" or "Gesendete > >Objekte" or ... > > > >The RFC reserves a list of special use folders: > > > > \All > > This mailbox presents all messages in the user's message store. > > Implementations MAY omit some messages, such as, perhaps, those > > in \Trash and \Junk. When this special use is supported, it is > > almost certain to represent a virtual mailbox. > > > > \Archive > > This mailbox is used to archive messages. The meaning of an > > "archival" mailbox is server-dependent; typically, it will be > > used to get messages out of the inbox, or otherwise keep them > > out of the user's way, while still making them accessible. > > > > \Drafts > > This mailbox is used to hold draft messages -- typically, > > messages that are being composed but have not yet been sent. In > > some server implementations, this might be a virtual mailbox, > > containing messages from other mailboxes that are marked with > > the "\Draft" message flag. Alternatively, this might just be > > advice that a client put drafts here. > > > > \Flagged > > This mailbox presents all messages marked in some way as > > "important". When this special use is supported, it is likely > > to represent a virtual mailbox collecting messages (from other > > mailboxes) that are marked with the "\Flagged" message flag. > > > > \Junk > > This mailbox is where messages deemed to be junk mail are held. > > Some server implementations might put messages here > > automatically. Alternatively, this might just be advice to a > > client-side spam filter. > > > > \Sent > > This mailbox is used to hold copies of messages that have been > > sent. Some server implementations might put messages here > > automatically. Alternatively, this might just be advice that a > > client save sent messages here. > > > > \Trash > > This mailbox is used to hold messages that have been deleted or > > marked for deletion. In some server implementations, this might > > be a virtual mailbox, containing messages from other mailboxes > > -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From me at junc.eu Fri Jan 3 23:31:46 2014 From: me at junc.eu (Benny Pedersen) Date: Fri, 03 Jan 2014 22:31:46 +0100 Subject: [Dovecot] =?utf-8?q?disable=5Fplaintext=5Fauth_=3D_yes_not_showin?= =?utf-8?q?g_in_doveconf_-n_output=3F?= In-Reply-To: References: <52C7230B.4060501@Media-Brokers.com> Message-ID: <14938eeabacbce4f1621b1942060f164@junc.eu> Larry Rosenman skrev den 2014-01-03 21:54: > IIRC doveconf -n shows NON-DEFAULT settings :) dovecot is not postfix, checking settings in c code ?, eg doing "strings dovecot-lda" ? where is the default settings ? From rs at sys4.de Fri Jan 3 23:37:06 2014 From: rs at sys4.de (Robert Schetterer) Date: Fri, 03 Jan 2014 22:37:06 +0100 Subject: [Dovecot] RFE: IMAP LIST Extension for Special-Use Mailboxes In-Reply-To: <20140103211306.GC12726@sys4.de> References: <20110311215739.GD13492@state-of-mind.de> <4D7A9C2F.7050600@Media-Brokers.com> <20110311223136.GE32718@state-of-mind.de> <52C7212C.6080009@Media-Brokers.com> <20140103211306.GC12726@sys4.de> Message-ID: <52C72D82.2050000@sys4.de> Am 03.01.2014 22:13, schrieb Patrick Ben Koetter: > * Charles Marcus : >> Sorry for replying to such an old email, but... > > Thank you. You just made me feel very old... ;) > >> I'm wondering how 'Templates' got left out? >> >> It is a Special folder in Thunderbird that you can't delete - and it >> is very useful (at least in Thunderbird) as well... >> >> I tried adding it in my dovecot (2.2.10) config, but it complained >> about an unsupported option... > > I searched a few minutes, but couldn't find the link to quote here: > Special-Use Mailbox names need to be registered. IIRC Templates didn't make > it into the first RFC. I am not aware of a discussion that abandoned it > either. Probably, if you gave it a try, you can have it added and Timo will > add it afterwards... > > p at rick looks like there is a draft for "important" http://tools.ietf.org/html/draft-iceman-imap-specialuse-important-02 guess "Templates" was to "Thunderbird" related > >> On 2011-03-11 5:31 PM, Patrick Ben Koetter

wrote: >>> A server may, for example, mark a folder as \Sent. >>> >>> Any client that connects to such a server can search for a folder that has >>> been attributed as "Sent". >>> >>> No need to create a new folder "Sent Items" if there's a special folder marked >>> as \Sent. Same goes for clients that insist on calling it "sent" or "Gesendete >>> Objekte" or ... >>> >>> The RFC reserves a list of special use folders: >>> >>> \All >>> This mailbox presents all messages in the user's message store. >>> Implementations MAY omit some messages, such as, perhaps, those >>> in \Trash and \Junk. When this special use is supported, it is >>> almost certain to represent a virtual mailbox. >>> >>> \Archive >>> This mailbox is used to archive messages. The meaning of an >>> "archival" mailbox is server-dependent; typically, it will be >>> used to get messages out of the inbox, or otherwise keep them >>> out of the user's way, while still making them accessible. >>> >>> \Drafts >>> This mailbox is used to hold draft messages -- typically, >>> messages that are being composed but have not yet been sent. In >>> some server implementations, this might be a virtual mailbox, >>> containing messages from other mailboxes that are marked with >>> the "\Draft" message flag. Alternatively, this might just be >>> advice that a client put drafts here. >>> >>> \Flagged >>> This mailbox presents all messages marked in some way as >>> "important". When this special use is supported, it is likely >>> to represent a virtual mailbox collecting messages (from other >>> mailboxes) that are marked with the "\Flagged" message flag. >>> >>> \Junk >>> This mailbox is where messages deemed to be junk mail are held. >>> Some server implementations might put messages here >>> automatically. Alternatively, this might just be advice to a >>> client-side spam filter. >>> >>> \Sent >>> This mailbox is used to hold copies of messages that have been >>> sent. Some server implementations might put messages here >>> automatically. Alternatively, this might just be advice that a >>> client save sent messages here. >>> >>> \Trash >>> This mailbox is used to hold messages that have been deleted or >>> marked for deletion. In some server implementations, this might >>> be a virtual mailbox, containing messages from other mailboxes >> >> > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From eike at sf-mail.de Wed Jan 1 20:07:26 2014 From: eike at sf-mail.de (Rolf Eike Beer) Date: Wed, 01 Jan 2014 19:07:26 +0100 Subject: [Dovecot] Wrong file accessed after file was renamed because of wrong size Message-ID: <1538917.kpJTmz3ogM@caliban.sf-tec.de> I'm migrating from Courier-IMAP. On first access of folders I get this log (slightly anonymized): Jan 1 18:38:27 mail dovecot: imap(username): Error: Cached message size smaller than expected (1452 < 1668) Jan 1 18:38:27 mail dovecot: imap(username): Error: Maildir filename has wrong S value, renamed the file from /var/vpopmail/domains/domain/username/.maildir/cur/1206559119.14350.mail,S=1452:2,RS to /var/vpopmail/domains/domain/username/.maildir/cur/1206559119.14350.mail,S=1668:2,RS Jan 1 18:38:27 mail dovecot: imap(username): Error: Corrupted index cache file /var/vpopmail/domains/domain/username/.maildir/dovecot.index.cache: Broken physical size for mail UID 161 Jan 1 18:38:27 mail dovecot: imap(username): Error: read(/var/vpopmail/domains/domain/username/.maildir/cur/1206559119.14350.mail,S=1452:2,RS) failed: Invalid argument Jan 1 18:38:27 mail dovecot: imap(username): Disconnected: Internal error occurred. Refer to server log for more information. [2014-01-01 18:38:27] in=135 out=63515 This is the same in 2.2.6 and 2.2.10. Greetings, Eike -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. URL: From user+dovecot at localhost.localdomain.org Sat Jan 4 02:43:06 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Sat, 04 Jan 2014 00:43:06 +0000 Subject: [Dovecot] disable_plaintext_auth = yes not showing in doveconf -n output? In-Reply-To: <52C72482.3030406@Media-Brokers.com> References: <52C7230B.4060501@Media-Brokers.com> <52C72482.3030406@Media-Brokers.com> Message-ID: <52C7591A.7090303@localhost.localdomain.org> On 01/03/2014 08:58 PM Charles Marcus wrote: > On 2014-01-03 3:54 PM, Larry Rosenman wrote: >> IIRC doveconf -n shows NON-DEFAULT settings :) > > This I know, but doveconf -n was inspired by postfix's postconf -n > feature, and with postfix, if I explicitly set something that is set > the same way by default, it still shows up in -n output. > > It makes it easy to 'clean up' your configs (ie, unset settings that > don't need to be explicitly set because they are defaults)... > > I think this may be an oversight in Timo's implementation... ? It works as documented: ,--[ doveconf(1) ]-- | -n Show only settings with non-default values. | | -N Show settings with non-default values and explicitly set default | values. `-- Regards, Pascal -- The trapper recommends today: defaced.1400401 at localdomain.org From CMarcus at Media-Brokers.com Sat Jan 4 03:48:52 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 03 Jan 2014 20:48:52 -0500 Subject: [Dovecot] disable_plaintext_auth = yes not showing in doveconf -n output? In-Reply-To: <52C7591A.7090303@localhost.localdomain.org> References: <52C7230B.4060501@Media-Brokers.com> <52C72482.3030406@Media-Brokers.com> <52C7591A.7090303@localhost.localdomain.org> Message-ID: <268631ae-dc18-45a1-a412-b8fcdef38ab7@email.android.com> Ah, the Pascal... even better... :) Pascal Volk wrote: >On 01/03/2014 08:58 PM Charles Marcus wrote: >> On 2014-01-03 3:54 PM, Larry Rosenman wrote: >>> IIRC doveconf -n shows NON-DEFAULT settings :) >> >> This I know, but doveconf -n was inspired by postfix's postconf -n >> feature, and with postfix, if I explicitly set something that is set > >> the same way by default, it still shows up in -n output. >> >> It makes it easy to 'clean up' your configs (ie, unset settings that >> don't need to be explicitly set because they are defaults)... >> >> I think this may be an oversight in Timo's implementation... ? > > >It works as documented: > >,--[ doveconf(1) ]-- >| -n Show only settings with non-default values. >| >| -N Show settings with non-default values and explicitly set >default >| values. >`-- > > >Regards, >Pascal >-- >The trapper recommends today: defaced.1400401 at localdomain.org -- Sent from my Nexus 4... From jwm at horde.net Sat Jan 4 22:03:25 2014 From: jwm at horde.net (John Morrissey) Date: Sat, 4 Jan 2014 15:03:25 -0500 Subject: [Dovecot] Writing an FTS plugin Message-ID: <20140104200325.GA11543@boost.horde.net> Hi, I'm having some trouble writing an FTS plugin that uses notmuch (http://notmuchmail.org/) as the backend. As a proof of concept, I'm adding a hardcoded UID to the search results in the plugin's lookup handler: seq_range_array_add(&result->definite_uids, 1, 42); but this UID is never returned by IMAP SEARCH commands. I know the plugin is being used, since I'm also syslogging immediately before the call to seq_range_array_add(). Interestingly, SEARCH commands return correct results (based on the mailbox content and the search terms specified), but I'm not sure where those results are coming from. The notmuch plugin is the only configured FTS plugin: mail_plugins = $mail_plugins fts fts_notmuch plugin { fts = notmuch } What might I be doing wrong? Additionally, notmuch returns message filenames, which I'll need to translate to UIDs. I've seen maildir_uidlist_get_uid(), but I'm not sure where to get the struct maildir_uidlist arg it needs. notmuch only supports the Maildir format, so using a maildir_* function seems a reasonably safe assumption, but is there a better way? john -- John Morrissey _o /\ ---- __o jwm at horde.net _-< \_ / \ ---- < \, www.horde.net/ __(_)/_(_)________/ \_______(_) /_(_)__ From mtrainer at westnet.com.au Sun Jan 5 15:06:37 2014 From: mtrainer at westnet.com.au (Murray Trainer) Date: Sun, 05 Jan 2014 21:06:37 +0800 Subject: [Dovecot] Architecture for large Dovecot cluster Message-ID: <52C958DD.6080206@westnet.com.au> Hi All, I am trying to determine whether a mail server cluster based on Dovecot will be capable of supporting 500,000+ mailboxes with about 50,000 IMAP and 5000 active POP3 connections. I have looked at the Dovecot clustering suggestions here: http://blog.dovecot.org/2012/02/dovecot-clustering-with-dsync-based.html and some other Dovecot mailing list threads but I am not sure how many users such a setup will handle. I have a concern about the I/O performance of NFS in the suggested architecture above. One possible option available to us is to split up the mailboxes over multiple clusters with subsets of domains. Is there anyone out there currently running this many users on a Dovecot based mail cluster? Some suggestions or advice on the best way to go would be greatly appreciated. Thanks Murray From rbras at iseg.ulisboa.pt Sun Jan 5 20:53:23 2014 From: rbras at iseg.ulisboa.pt (=?utf-8?b?UmHDumw=?= Massano =?utf-8?b?QnLDoXM=?=) Date: Sun, 05 Jan 2014 18:53:23 +0000 Subject: [Dovecot] Panic: file mailbox-list-maildir.c: line 133: unreached Message-ID: <20140105185323.Horde.sGPDLd9IRNbcLhcDjzoxOw1@mail.iseg.ulisboa.pt> Hi I am using dovecot 2.0.9 on CentOS 6.4 The following error appears in the logs when users connect to the imap server using MACs. All other clients that I tested work fine. ###### BEGIN ERROR ###### Jan 5 18:04:25 mail dovecot: imap(jcf): Panic: file mailbox-list-maildir.c: line 133: unreached Jan 5 18:04:25 mail dovecot: imap(user): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x3ca6a) [0x7f991df2ca6a] -> /usr/lib64/dovecot/libdovecot.so.0(+0x3cab6) [0x7f991df2cab6] -> /usr/lib64/dovecot/libdovecot.so.0(+0x16dba) [0x7f991df06dba] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x3eace) [0x7f991e1aface] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_list_is_valid_pattern+0x26) [0x7f991e1a4f86] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x3c861) [0x7f991e1ad861] -> /usr/lib64/dovecot/libdovecot-storage.so.0(fs_list_iter_next+0x2f) [0x7f991e1ad3ff] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0xa) [0x7f991e1a490a] -> dovecot/imap() [0x40b399] -> dovecot/imap(cmd_list_full+0x426) [0x40c246] -> dovecot/imap() [0x40f8cd] -> dovecot/imap() [0x40f9ba] -> dovecot/imap(client_handle_input+0x135) [0x40fbe5] -> dovecot/imap(client_input+0x5f) [0x41050f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x48) [0x7f991df37e08] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) [0x7f991df38d7f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f991df37d98] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f991df26203] -> dovecot/imap(main+0x2f9) [0x418809] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f991d76fcdd] -> dovecot/imap() [0x408229] ###### END ERROR ###### The dovecot configuration is: ###### BEGIN CONFIG ###### # dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) disable_plaintext_auth = no mail_access_groups = mail mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mbox_write_locks = fcntl namespace { hidden = yes inbox = yes list = yes location = mbox:~/mail:INBOX=/var/spool/mail/%u prefix = "#mbox/" separator = / type = private } namespace { location = maildir:~/Maildir prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } ssl_ca = References: <52C958DD.6080206@westnet.com.au> Message-ID: <52C9B3A1.60308@sys4.de> Am 05.01.2014 14:06, schrieb Murray Trainer: > Hi All, > > I am trying to determine whether a mail server cluster based on Dovecot > will be capable of supporting 500,000+ mailboxes with about 50,000 IMAP > and 5000 active POP3 connections. I have looked at the Dovecot > clustering suggestions here: as long as you have some load balancing and/or proxy/director with few servers on good modern hardware you havent worry about pop3, 5000 pop3 logins per minute should work with small tuning, no idea about asked number of imap cons > > http://blog.dovecot.org/2012/02/dovecot-clustering-with-dsync-based.html good article, but however there are many ways how to goal this,depending what is your budget etc, i.e you dont have to use nfs , you may consider use cluster file systems with drbd and/or ceph or equals, at last there many other pay solutions for solving io storage which is the most sensible part, think about using dbox or mdbox as mailbox format, what mailbox quota you like to offer etc > > and some other Dovecot mailing list threads but I am not sure how many > users such a setup will handle. I have a concern about the I/O > performance of NFS in the suggested architecture above. One possible > option available to us is to split up the mailboxes over multiple > clusters with subsets of domains. Is there anyone out there currently > running this many users on a Dovecot based mail cluster? Some > suggestions or advice on the best way to go would be greatly appreciated. look about list archive for equal setups , ask Timo or other people for paid support, wait for people reporting their big setups > > Thanks > > Murray > > > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From rs at sys4.de Sun Jan 5 21:37:05 2014 From: rs at sys4.de (Robert Schetterer) Date: Sun, 05 Jan 2014 20:37:05 +0100 Subject: [Dovecot] Panic: file mailbox-list-maildir.c: line 133: unreached In-Reply-To: <20140105185323.Horde.sGPDLd9IRNbcLhcDjzoxOw1@mail.iseg.ulisboa.pt> References: <20140105185323.Horde.sGPDLd9IRNbcLhcDjzoxOw1@mail.iseg.ulisboa.pt> Message-ID: <52C9B461.2080809@sys4.de> Am 05.01.2014 19:53, schrieb Ra?l Massano Br?s: > > Hi > > I am using dovecot 2.0.9 on CentOS 6.4 > > The following error appears in the logs when users connect to the imap > server using MACs. All > other clients that I tested work fine. > > ###### BEGIN ERROR ###### > > Jan 5 18:04:25 mail dovecot: imap(jcf): Panic: file > mailbox-list-maildir.c: line 133: unreached > > Jan 5 18:04:25 mail dovecot: imap(user): Error: Raw backtrace: > /usr/lib64/dovecot/libdovecot.so.0(+0x3ca6a) [0x7f991df2ca6a] -> > /usr/lib64/dovecot/libdovecot.so.0(+0x3cab6) [0x7f991df2cab6] -> > /usr/lib64/dovecot/libdovecot.so.0(+0x16dba) [0x7f991df06dba] -> > /usr/lib64/dovecot/libdovecot-storage.so.0(+0x3eace) [0x7f991e1aface] -> > /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_list_is_valid_pattern+0x26) > [0x7f991e1a4f86] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x3c861) > [0x7f991e1ad861] -> > /usr/lib64/dovecot/libdovecot-storage.so.0(fs_list_iter_next+0x2f) > [0x7f991e1ad3ff] -> > /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0xa) > [0x7f991e1a490a] -> dovecot/imap() [0x40b399] -> > dovecot/imap(cmd_list_full+0x426) [0x40c246] -> dovecot/imap() > [0x40f8cd] -> dovecot/imap() [0x40f9ba] -> > dovecot/imap(client_handle_input+0x135) [0x40fbe5] -> > dovecot/imap(client_input+0x5f) [0x41050f] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x48) > [0x7f991df37e08] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x9f) > [0x7f991df38d7f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) > [0x7f991df37d98] -> > /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7f991df26203] -> dovecot/imap(main+0x2f9) [0x418809] -> > /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f991d76fcdd] -> > dovecot/imap() [0x408229] > > ###### END ERROR ###### > > The dovecot configuration is: > > ###### BEGIN CONFIG ###### > > # dovecot -n > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.4 (Final) > disable_plaintext_auth = no > mail_access_groups = mail > mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u > mbox_write_locks = fcntl > namespace { > hidden = yes > inbox = yes > list = yes > location = mbox:~/mail:INBOX=/var/spool/mail/%u > prefix = "#mbox/" > separator = / > type = private > } > namespace { > location = maildir:~/Maildir > prefix = > separator = / > type = private > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > ssl_ca = ssl_cert = ssl_key = syslog_facility = local0 > userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > > ###### END CONFIG ###### > > > I don't know what to do to allow MAC users to use the system. Can anyone > help? > > Thank you, > > > > 2.0.9 is old what about upgrade to recent 2.1.x, 2.2.x the latest patchlevel of 2.0.x is 2.0.21 so minimum try upgrade to this, your problem may allready got fixed Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From amandy_lda at outlook.com Mon Jan 6 11:17:08 2014 From: amandy_lda at outlook.com (ldaamandy) Date: Mon, 6 Jan 2014 09:17:08 +0000 Subject: [Dovecot] What's the parameter -w for dovecot-auth: dovecot -w Message-ID: hello: What's the parameter -w for dovecot-auth: dovecot -w my service of dovecot-auth always activing two: one is" dovecot-auth" , the other is" dovecot-auth -w" i don't know the diffevent between them amandy thanks! From list_dovecot at bluerosetech.com Mon Jan 6 11:39:21 2014 From: list_dovecot at bluerosetech.com (Darren Pilgrim) Date: Mon, 06 Jan 2014 01:39:21 -0800 Subject: [Dovecot] What's the parameter -w for dovecot-auth: dovecot -w In-Reply-To: References: Message-ID: <52CA79C9.9080305@bluerosetech.com> On 1/6/2014 1:17 AM, ldaamandy wrote: > What's the parameter -w for dovecot-auth: dovecot -w my service of > dovecot-auth always activing two: one is" dovecot-auth", the other > is" dovecot-auth -w" i don't know the diffevent between them According to the Dovecot 1.x wiki: 'dovecot-auth -w process is an "authentication worker" process. It's used only with some "blocking" authentication databases, such as MySQL.' http://wiki1.dovecot.org/RunningDovecot From amandy_lda at outlook.com Mon Jan 6 12:02:25 2014 From: amandy_lda at outlook.com (ldaamandy) Date: Mon, 6 Jan 2014 10:02:25 +0000 Subject: [Dovecot] What's the parameter -w for dovecot-auth: dovecot -w In-Reply-To: <52CA79C9.9080305@bluerosetech.com> References: , <52CA79C9.9080305@bluerosetech.com> Message-ID: thank you Darren Pilgrim and what should I do to not let dovecot -w start? i want to keep one dovecot-auth . Is it set in the dovecot.conf ? > Date: Mon, 6 Jan 2014 01:39:21 -0800 > From: list_dovecot at bluerosetech.com > To: amandy_lda at outlook.com; dovecot at dovecot.org > Subject: Re: [Dovecot] What's the parameter -w for dovecot-auth: dovecot -w > > On 1/6/2014 1:17 AM, ldaamandy wrote: > > What's the parameter -w for dovecot-auth: dovecot -w my service of > > dovecot-auth always activing two: one is" dovecot-auth", the other > > is" dovecot-auth -w" i don't know the diffevent between them > > According to the Dovecot 1.x wiki: > > 'dovecot-auth -w process is an "authentication worker" process. It's > used only with some "blocking" authentication databases, such as MySQL.' > > http://wiki1.dovecot.org/RunningDovecot From list_dovecot at bluerosetech.com Mon Jan 6 15:05:15 2014 From: list_dovecot at bluerosetech.com (Darren Pilgrim) Date: Mon, 06 Jan 2014 05:05:15 -0800 Subject: [Dovecot] What's the parameter -w for dovecot-auth: dovecot -w In-Reply-To: References: , <52CA79C9.9080305@bluerosetech.com> Message-ID: <52CAAA0B.7030701@bluerosetech.com> On 1/6/2014 2:02 AM, ldaamandy wrote: > thank you Darren Pilgrim and what should I do to not let > dovecot -w start? i want to keep one dovecot-auth . Is it set in > the dovecot.conf ? You can't make it not start--it's necessary for certain authentication databases. Even if you could, why are you worrying about this? If you really don't want it, you'll need to switch to a different authentication database. I'm pretty sure PostgreSQL doesn't require an authentication worker, but can't verify that as I no longer use Dovecot 1.x. From basseed1 at outlook.com Mon Jan 6 15:44:22 2014 From: basseed1 at outlook.com (Marco Cusano) Date: Mon, 6 Jan 2014 14:44:22 +0100 Subject: [Dovecot] virtual mailboxes folder structure Message-ID: Hi, I am trying to find a way to list my virtual mailboxes hiding the namespace prefix into my imap client. Fore example now my ?All? mailbox is listed under virtual/ as: Inbox Sent Drafts Spam Trash virtual All I would like to list as this: Inbox Sent Drafts Spam Trash All This is my 10-mail.conf: http://pastebin.com/DumEbbmy and this is my 15-mailboxes.conf: http://pastebin.com/QFzWGzyC I thought that the list = children paramenter would do but it did not. Thank you From infoomatic at gmx.at Mon Jan 6 16:46:58 2014 From: infoomatic at gmx.at (Infoomatic) Date: Mon, 6 Jan 2014 15:46:58 +0100 (CET) Subject: [Dovecot] acl, shared folders Message-ID: Hi list, ? After spending quite some time to figure out how users can share folders I now hope someone of you could help me out. I am quite sure its just a stupid mistake/misunderstanding?... I am using Ubuntu 12.04 LTS with the shipped dovecot 2.0.19 When I login via telnet as user1 I get the following: 1 create folder1 1 OK Create completed. 2 setacl folder1 user2 rli 2 OK Setacl complete. 3 getacl folder1 * ACL "folder1" "user2" ilr "user1" lrwstipekxacd 3 OK Getacl completed. ? This seems fine. However, there is nothing listed in the account of user2. I think the mistake is in the namespace configuration of "location" or "prefix" ? Please help! Thanks! ? infoomatic ? # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-45-generic x86_64 Ubuntu 12.04.3 LTS ext4 auth_username_format = %n disable_plaintext_auth = no mail_debug = yes mail_gid = vmail mail_home = /var/lib/vmail/home/%u mail_location = mdbox:/var/lib/vmail/mail/%u mail_plugins = " acl zlib fts fts_solr acl" mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags mdbox_rotate_size = 64 M namespace { ? inbox = yes ? location = ? prefix = ? separator = / ? type = private } namespace { ? list = children ? location = mdbox:/var/lib/vmail/mail/%%n/mailboxes/shared/%n ? prefix = shared/%%n/ ? separator = / ? subscriptions = no ? type = shared } passdb { ? args = /etc/dovecot/dovecot-ldap.conf.ext ? driver = ldap } plugin { ? acl = vfile ? acl_shared_dict = file:/var/lib/vmail/shared-mailboxes ? fts = solr ? fts_solr = break-imap-search url=http://localhost:8080/solr/ ? sieve = ~/.dovecot.sieve ? sieve_dir = ~/sieve ? sieve_extensions = +imapflags ? zlib_save = bz2 ? zlib_save_level = 6 } protocols = " imap sieve pop3" service auth { ? unix_listener /var/spool/postfix/private/auth { ??? group = postfix ??? mode = 0660 ??? user = postfix ? } ? unix_listener auth-userdb { ??? group = vmail ??? user = vmail ? } } service managesieve-login { ? inet_listener sieve_deprecated { ??? port = 2000 ? } } ssl_cert = I am attempting to move imap folders from an Apple Snow Leopard server to a new Apple Mavericks server. Dovecot --version is not working , but I believe the old server is running dovecot 1.1.2 and can confirm the new one is running 2.2.x. I have tried taring and moving folders, but have not been able to get the transfered messages and folders to show up in user accounts (new messages show up fine). I have attempted to recreate index files, but that has not worked either. The last attempt I made to migrate was to use dsync, but it does not exist on the old server and I do not see a way to install it. What method would work best to migrate or move files and folders from the old server and get them to show up for clients on using the new server? -- Raymond Norton LCTN 952.955.7766 Sent from My Desktop From rs at sys4.de Mon Jan 6 18:30:03 2014 From: rs at sys4.de (Robert Schetterer) Date: Mon, 06 Jan 2014 17:30:03 +0100 Subject: [Dovecot] need assistance migrating between apple servers In-Reply-To: <52CAD6EA.1000807@lctn.org> References: <52CAD6EA.1000807@lctn.org> Message-ID: <52CADA0B.2090505@sys4.de> Am 06.01.2014 17:16, schrieb Raymond Norton: > I am attempting to move imap folders from an Apple Snow Leopard server > to a new Apple Mavericks server. Dovecot --version is not working , but > I believe the old server is running dovecot 1.1.2 and can confirm the > new one is running 2.2.x. > > > I have tried taring and moving folders, but have not been able to get > the transfered messages and folders to show up in user accounts (new > messages show up fine). I have attempted to recreate index files, but > that has not worked either. The last attempt I made to migrate was to > use dsync, but it does not exist on the old server and I do not see a > way to install it. > > > What method would work best to migrate or move files and folders from > the old server and get them to show up for clients on using the new server? > > imapsync should work ever Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From CMarcus at Media-Brokers.com Mon Jan 6 20:33:39 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 06 Jan 2014 13:33:39 -0500 Subject: [Dovecot] inotify max_user instances Message-ID: <52CAF703.5040005@Media-Brokers.com> Hello, Timo, last year when you remoted into our server and performed the migration from courier-imap, we ran into this issue, and you solved it by doing: echo 1024 > /proc/sys/fs/inotify/max_user_instances Then you said you were going to solve this permanently by changing the init script... Here is what you said (this is from the skype chat): [2012-06-04 10:40:43 AM] timosirainen: probably put to dovecot init script or something I guess I could manually modify my init script, but I'm clueless as to where.how. The current (gentoo) init script is: > #!/sbin/runscript > # Copyright 1999-2012 Gentoo Foundation > # Distributed under the terms of the GNU General Public License, v2 or > later > # $Header: > /var/cvsroot/gentoo-x86/net-mail/dovecot/files/dovecot.init-r4,v 1.1 > 2012/12/01 10:40:49 eras Exp $ > > extra_started_commands="reload" > > depend() { > need localmount > before postfix > after bootmisc ldap mysql ntp-client ntpd postgresql saslauthd > slapd > use logger net > } > > checkconfig() { > DOVECOT_INSTANCE=${SVCNAME##*.} > if [ -n "${DOVECOT_INSTANCE}" -a "${SVCNAME}" != "dovecot" ]; then > DOVECOT_CONF=/etc/dovecot/dovecot.${DOVECOT_INSTANCE}.conf > else > DOVECOT_CONF=/etc/dovecot/dovecot.conf > fi > if [ ! -e ${DOVECOT_CONF} ]; then > eerror "You will need an ${DOVECOT_CONF} first" > return 1 > fi > if [ -x /usr/sbin/dovecot ]; then > DOVECOT_BASEDIR=$(/usr/sbin/dovecot -c ${DOVECOT_CONF} > -a | grep '^base_dir = ' | sed 's/^base_dir = //') > else > eerror "dovecot not executable" > return 1 > fi > DOVECOT_BASEDIR=${DOVECOT_BASEDIR:-/var/run/dovecot} > DOVECOT_PIDFILE=${DOVECOT_BASEDIR}/master.pid > } > > start() { > checkconfig || return 1 > ebegin "Starting ${SVCNAME}" > start-stop-daemon --start --exec /usr/sbin/dovecot \ > --pidfile "${DOVECOT_PIDFILE}" -- -c "${DOVECOT_CONF}" > eend $? > } > > stop() { > checkconfig || return 1 > ebegin "Stopping ${SVCNAME}" > start-stop-daemon --stop --exec /usr/sbin/dovecot \ > --pidfile "${DOVECOT_PIDFILE}" > eend $? > } > > reload() { > checkconfig || return 1 > ebegin "Reloading ${SVCNAME} configs and restarting auth/login > processes" > start-stop-daemon --signal HUP --exec /usr/sbin/dovecot \ > --pidfile "${DOVECOT_PIDFILE}" > eend $? > } Suggestions? -- Best regards, Charles From CMarcus at Media-Brokers.com Mon Jan 6 21:28:35 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 06 Jan 2014 14:28:35 -0500 Subject: [Dovecot] inotify max_user instances In-Reply-To: <52CAF703.5040005@Media-Brokers.com> References: <52CAF703.5040005@Media-Brokers.com> Message-ID: <52CB03E3.70203@Media-Brokers.com> On 2014-01-06 1:33 PM, Charles Marcus wrote: > Timo, last year when you remoted into our server and performed the > migration from courier-imap, we ran into this issue, and you solved it > by doing: > > echo 1024 > /proc/sys/fs/inotify/max_user_instances > > Then you said you were going to solve this permanently by changing the > init script... > > Here is what you said (this is from the skype chat): > > [2012-06-04 10:40:43 AM] timosirainen: probably put to dovecot init > script or something Actually found this a but later during the chat, which looks much better. I guess when you said 'it looks up a good value from doveconf', that one could specify the value in the config file and it would use whatever was there? Anyway, here is what you said (to refresh your memory): > timosirainen: i can do that. btw i've today been building RPMs for dovecot > timosirainen: and in that init.d script i'm also adding this > timosirainen: i'll make it somewhat automatic though > timosirainen: if [ "$INOTIFY_INSTANCES" != "" ]; then > if [ "$INOTIFY_INSTANCES" = "auto" ]; then > INOTIFY_INSTANCES=`$doveadm config -h service/imap/process_limit` > if [ "$INOTIFY_INSTANCES" = 0 ]; then > INOTIFY_INSTANCES=`$doveadm config -h default_process_limit` > fi > increase_proc_value /proc/sys/fs/inotify/max_user_watches > $INOTIFY_INSTANCES > increase_proc_value /proc/sys/fs/inotify/max_user_instances > $INOTIFY_INSTANCES > fi > fi > timosirainen: it looks up a good value from doveconf From marc at perkel.com Mon Jan 6 22:20:48 2014 From: marc at perkel.com (Marc Perkel) Date: Mon, 06 Jan 2014 12:20:48 -0800 Subject: [Dovecot] Dovecot deliver into folder question Message-ID: <52CB1020.3070604@perkel.com> If I want to user dovecot deliver into a folder that is not at the root level - how do I do that? How do I specify a folder in a folder? From CMarcus at Media-Brokers.com Mon Jan 6 22:23:17 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 06 Jan 2014 15:23:17 -0500 Subject: [Dovecot] Question re: filesystem permissions Message-ID: <52CB10B5.4020904@Media-Brokers.com> Hi all, I want to make sure the filesystems are correct/optimal and secure as possible. This is a virtual hosting setup only (no system users), and dovecot is currently running in high performance mode (I'm thinking I want to change that too, so wondering if that would affect the permissions)... /var/vmail (and everything under it) is owned by vmail:vmail. Current permissions are: /var/vmail 755 /var/vmail/example1.com 777 /var/vmail/example2.com 777 /var/vmail/example1.com/user1 755 (all other user home dirs are the same) /var/vmail/example1.com/user1/Maildir 700 (all other user Maildirs and all subdirs are the same) All files are 600, with the exception of the dovecot-uidvalidity.blahblah files, which are 444 So... is this right? Anything need to be changed? Thanks, -- Best regards, Charles From CMarcus at Media-Brokers.com Mon Jan 6 22:27:14 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 06 Jan 2014 15:27:14 -0500 Subject: [Dovecot] Dovecot deliver into folder question In-Reply-To: <52CB1020.3070604@perkel.com> References: <52CB1020.3070604@perkel.com> Message-ID: <52CB11A2.4020205@Media-Brokers.com> On 2014-01-06 3:20 PM, Marc Perkel wrote: > If I want to user dovecot deliver into a folder that is not at the > root level - how do I do that? How do I specify a folder in a folder? For *all* messages? Or for certain messages? Kind of an incomplete question. -- Best regards, Charles From marc at perkel.com Mon Jan 6 22:33:54 2014 From: marc at perkel.com (Marc Perkel) Date: Mon, 06 Jan 2014 12:33:54 -0800 Subject: [Dovecot] Dovecot deliver into folder question In-Reply-To: <52CB11A2.4020205@Media-Brokers.com> References: <52CB1020.3070604@perkel.com> <52CB11A2.4020205@Media-Brokers.com> Message-ID: <52CB1332.2010208@perkel.com> On 1/6/2014 12:27 PM, Charles Marcus wrote: > On 2014-01-06 3:20 PM, Marc Perkel wrote: >> If I want to user dovecot deliver into a folder that is not at the >> root level - how do I do that? How do I specify a folder in a folder? > > For *all* messages? Or for certain messages? > > Kind of an incomplete question. > Certain messages. I'm talking about the deliver utility - the -m option. Usage: dovecot-lda [-c ] [-a

] [-d ] [-p ] [-f ] [-m ] [-e] [-k] when specifying the mailbox - how do you specify a subfolder? Do you use a / separator? From CMarcus at Media-Brokers.com Mon Jan 6 22:41:06 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 06 Jan 2014 15:41:06 -0500 Subject: [Dovecot] Dovecot deliver into folder question In-Reply-To: <52CB1332.2010208@perkel.com> References: <52CB1020.3070604@perkel.com> <52CB11A2.4020205@Media-Brokers.com> <52CB1332.2010208@perkel.com> Message-ID: <52CB14E2.8000007@Media-Brokers.com> On 2014-01-06 3:33 PM, Marc Perkel wrote: > > On 1/6/2014 12:27 PM, Charles Marcus wrote: >> On 2014-01-06 3:20 PM, Marc Perkel wrote: >>> If I want to user dovecot deliver into a folder that is not at the >>> root level - how do I do that? How do I specify a folder in a folder? >> >> For *all* messages? Or for certain messages? >> >> Kind of an incomplete question. >> > > Certain messages. I'm talking about the deliver utility - the -m option. > > Usage: dovecot-lda [-c ] [-a
] [-d ] > [-p ] > [-f ] [-m ] [-e] [-k] > > when specifying the mailbox - how do you specify a subfolder? Do you > use a / separator? Yeesh, no... Use sieve and plus-addressing. http://wiki2.dovecot.org/Pigeonhole/Sieve/Examples -- Best regards, Charles From wdehoog at exalondelft.nl Mon Jan 6 23:04:33 2014 From: wdehoog at exalondelft.nl (W. de Hoog) Date: Mon, 06 Jan 2014 22:04:33 +0100 Subject: [Dovecot] using OR in doveadm search query Message-ID: <52CB1A61.9090904@exalondelft.nl> Hi, I am trying to create an OR query but no success yet: $ doveadm search mailbox shared/* OR SUBJECT "a" SUBJECT "b" doveadm(neil): Fatal: Use parenthesis when mixing ANDs and ORs $ doveadm search mailbox shared/* OR \(SUBJECT "a"\) \(SUBJECT "b"\) doveadm(neil): Fatal: Unknown argument (SUBJECT $ doveadm search mailbox shared/* \(OR \(SUBJECT "a"\) \(SUBJECT "b"\)\) doveadm(neil): Fatal: Unknown argument (OR What is the correct syntax for such a query? -- Willem-Jan de Hoog From slusarz at curecanti.org Mon Jan 6 23:21:43 2014 From: slusarz at curecanti.org (Michael M Slusarz) Date: Mon, 06 Jan 2014 14:21:43 -0700 Subject: [Dovecot] using OR in doveadm search query In-Reply-To: <52CB1A61.9090904@exalondelft.nl> References: <52CB1A61.9090904@exalondelft.nl> Message-ID: <20140106142143.Horde.rjxn6v5vkAfTFZTYohPvrw1@bigworm.curecanti.org> Quoting "W. de Hoog" : > Hi, > > I am trying to create an OR query but no success yet: > > $ doveadm search mailbox shared/* OR SUBJECT "a" SUBJECT "b" > doveadm(neil): Fatal: Use parenthesis when mixing ANDs and ORs > > $ doveadm search mailbox shared/* OR \(SUBJECT "a"\) \(SUBJECT "b"\) > doveadm(neil): Fatal: Unknown argument (SUBJECT This works for me (at least with tcsh): $ doveadm search mailbox "shared/* OR (SUBJECT a) (SUBJECT b)" michael From gcr+dovecot at tharned.org Mon Jan 6 23:27:41 2014 From: gcr+dovecot at tharned.org (Greg Rivers) Date: Mon, 6 Jan 2014 15:27:41 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve Message-ID: I found this[1] thread that describes the same problem with dovecot-LDA, but the solution (add X-Original-To: header) has no effect with LMTP. My sendmail LMTP configuration: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp') Sendmail's address test indicates that sendmail is providing user+detail to LMTP (see below). Except for this problem, dovecot, LMTP, and sieve are all working perfectly. Is there something I'm missing, or is this a bug? [1] http://dovecot.org/pipermail/dovecot/2012-July/136987.htm Script started on Sun Jan 5 23:25:04 2014 $ doveconf -n # 2.2.9: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.2-STABLE amd64 auth_verbose = yes mail_debug = yes mail_location = mdbox:~/.mdbox mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave editheader vnd.dovecot.debug vnd.dovecot.duplicate imapflags notify vnd.dovecot.pipe vnd.dovecot.filter vnd.dovecot.execute namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = %s driver = pam } plugin { quota = fs:%n@%{hostname} %h %Us %{pid}: quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = ~/sieve/sieve-execute sieve_execute_socket_dir = sieve-execute sieve_extensions = +notify +imapflags +editheader +vnd.dovecot.duplicate +vnd.dovecot.pipe +vnd.dovecot.filter +vnd.dovecot.execute +vnd.dovecot.debug sieve_filter_bin_dir = ~/sieve/sieve-filter sieve_filter_socket_dir = sieve-filter sieve_global_dir = /usr/local/etc/dovecot/sieve sieve_max_actions = 0 sieve_max_redirects = 16 sieve_max_script_size = 0 sieve_pipe_bin_dir = ~/sieve/sieve-pipe sieve_pipe_socket_dir = sieve-pipe sieve_plugins = sieve_extprograms } postmaster_address = postmaster at tharned.org protocols = imap lmtp sieve quota_full_tempfail = yes service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = dovecot } user = dovecot } ssl_cert =
> =M mailer 0 (prog): P=/bin/sh S=EnvFromL/HdrFromL R=EnvToL/HdrToL M=0 U=-1:-1 F=9DFMeloqsu L=0 E=\n T=X-Unix/X-Unix/X-Unix r=100 A=sh -c $u mailer 1 (*file*): P=[FILE] S=parse/parse R=parse/parse M=0 U=-1:-1 F=9DEFMPloqsu L=0 E=\n T=X-Unix/X-Unix/X-Unix r=100 A=FILE $u mailer 2 (*include*): P=/dev/null S=parse/parse R=parse/parse M=0 U=-1:-1 F=su L=0 E=\n T=// r=100 A=INCLUDE $u mailer 3 (local): P=[IPC] S=EnvFromSMTP/HdrFromL R=EnvToL/HdrToL M=0 U=-1:-1 F=/59:@ADFMPSXlmnqswz| L=0 E=\r\n T=DNS/RFC822/SMTP r=100 A=FILE /var/run/dovecot/lmtp mailer 4 (smtp): P=[IPC] S=EnvFromSMTP/HdrFromSMTP R=EnvToSMTP/EnvToSMTP M=0 U=-1:-1 F=DFMXmu L=990 E=\r\n T=DNS/RFC822/SMTP r=100 A=TCP $h mailer 5 (esmtp): P=[IPC] S=EnvFromSMTP/HdrFromSMTP R=EnvToSMTP/EnvToSMTP M=0 U=-1:-1 F=DFMXamu L=990 E=\r\n T=DNS/RFC822/SMTP r=100 A=TCP $h mailer 6 (smtp8): P=[IPC] S=EnvFromSMTP/HdrFromSMTP R=EnvToSMTP/EnvToSMTP M=0 U=-1:-1 F=8DFMXmu L=990 E=\r\n T=DNS/RFC822/SMTP r=100 A=TCP $h mailer 7 (dsmtp): P=[IPC] S=EnvFromSMTP/HdrFromSMTP R=EnvToSMTP/EnvToSMTP M=0 U=-1:-1 F=%DFMXamu L=990 E=\r\n T=DNS/RFC822/SMTP r=100 A=TCP $h mailer 8 (relay): P=[IPC] S=EnvFromSMTP/HdrFromSMTP R=MasqSMTP/MasqSMTP M=0 U=-1:-1 F=8DFMXamu L=2040 E=\r\n T=DNS/RFC822/SMTP r=100 A=TCP $h > /try local gcr+DeTaIl at tharned.org Trying envelope recipient address gcr+DeTaIl at tharned.org for mailer local canonify input: gcr + DeTaIl @ tharned . org Canonify2 input: gcr + DeTaIl < @ tharned . org > Canonify2 returns: gcr + DeTaIl < @ tharned . org . > canonify returns: gcr + DeTaIl < @ tharned . org . > 2 input: gcr + DeTaIl < @ tharned . org . > 2 returns: gcr + DeTaIl < @ tharned . org . > EnvToL input: gcr + DeTaIl < @ tharned . org . > EnvToL returns: gcr + DeTaIl final input: gcr + DeTaIl final returns: gcr + DeTaIl Rcode = 0, addr = gcr+DeTaIl > ^D $ cat .dovecot.sieve require ["envelope", "subaddress", "variables", "vnd.dovecot.debug"]; if envelope :matches "to" "*" { set "to" "${1}"; } if envelope :user :matches "to" "*" { set "user" "${1}"; } if envelope :detail :matches "to" "*" { set "detail" "${1}"; } if envelope :matches "from" "*" { set "from" "${1}"; } debug_log "EnvelopeTo=${to}, EnvelopeFrom=${from}"; debug_log "EnvelopeToUser=${user}, EnvelopeToDetail=${detail}"; $ telnet localhost smtp Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. 220 tharned.org ESMTP Sendmail 8.14.7/8.14.7; Sun, 5 Jan 2014 23:56:22 -0600 (CST) mail from: 250 2.1.0 ... Sender ok rcpt to: 250 2.1.5 ... Recipient ok data 354 Enter mail, end with "." on a line by itself . 250 2.0.0 s065uMYM069381 Message accepted for delivery quit 221 2.0.0 tharned.org closing connection Connection closed by foreign host. $ tail -4 .dovecot.sieve.log sieve: info: started log at Jan 05 23:57:21. main script: line 5: info: DEBUG: EnvelopeTo=gcr, EnvelopeFrom=gcr at tharned.org. main script: line 9: info: DEBUG: EnvelopeToUser=gcr, EnvelopeToDetail=. info: msgid=<201401060557.s065uMYM069381 at tharned.org>: stored mail into mailbox 'INBOX'. $ exit Script done on Sun Jan 5 23:57:55 2014 -- Greg Rivers From lists at wiesinger.com Mon Jan 6 23:40:24 2014 From: lists at wiesinger.com (Gerhard Wiesinger) Date: Mon, 06 Jan 2014 22:40:24 +0100 Subject: [Dovecot] Dovecot quoting problem? Message-ID: <52CB22C8.1020002@wiesinger.com> Hello Timo, I think the following commit makes problems: http://hg.dovecot.org/dovecot-2.2/rev/68a8b650578e # Doesn't work A01 LIST "" ~/Mail/Gesendet # OK with quoted mailbox A02 LIST "" "~/Mail/Gesendet" Details: imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in as user A01 LIST "" ~/Mail/Gesendet A01 BAD Error in IMAP command LIST: literal8 not allowed here A02 LIST "" "~/Mail/Gesendet" * LIST (\NoInferiors \UnMarked) "/" ~/Mail/Gesendet A02 OK List completed. A03 STATUS ~/Mail/Gesendet (MESSAGES UNSEEN RECENT) A03 BAD Error in IMAP command STATUS: literal8 not allowed here A04 STATUS "~/Mail/Gesendet" (MESSAGES UNSEEN RECENT) * STATUS ~/Mail/Gesendet (MESSAGES 0 RECENT 0 UNSEEN 0) A04 OK Status completed. Is this a bug of dovecot or a bug of the IMAP client (roundcube mail)? Thank you Ciao, Gerhard From d.parthey at metaways.de Mon Jan 6 11:25:02 2014 From: d.parthey at metaways.de (Daniel Parthey) Date: Mon, 06 Jan 2014 10:25:02 +0100 Subject: [Dovecot] [SIEVE] Locking Errors with vnd.dovecot.duplicate Extension Message-ID: <52CA766E.4070806@metaways.de> Hi, we are running a 4 host setup which each hosts a director+mailbox which is mounted via NFSv4 from a DRBD cluster. * Dovecot upstream release 2.1.16 * Doveadm batch subcommand fix - http://hg.dovecot.org/dovecot-2.1/raw-rev/850b5d8bbcc9 * Pigeonhole release 0.3.4 Now we would like to remove duplicate Mails using the vnd.dovecot.duplicate extension using a SIEVE script like this: require ["vnd.dovecot.duplicate", "fileinto", "mailbox", "regex", "vacation", "variables"]; if duplicate { fileinto :create "Trash"; } But as soon as we start delivering duplicate mails, we're sometimes getting locking errors from the mailbox (which is responsible for the user) according to the director: Dec 27 16:36:30 10.129.3.213 dovecot: lmtp(27975, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:33 10.129.3.213 dovecot: lmtp(27987, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:35 10.129.3.213 dovecot: lmtp(27994, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:36 10.129.3.213 dovecot: lmtp(28011, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:36 10.129.3.213 dovecot: lmtp(28013, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:38 10.129.3.213 dovecot: lmtp(28017, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:39 10.129.3.213 dovecot: lmtp(28025, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:42 10.129.3.213 dovecot: lmtp(28037, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Dec 27 16:36:43 10.129.3.213 dovecot: lmtp(27973, user001 at example.org): Error: Creating lock file for /mail/dovecot/example.org/user001/.dovecot.lda-dupes timed out in 20 secs Configs and Error log is attached. Any idea how to mitigate these locking issues? Regards Daniel -------------- next part -------------- # 2.1.16: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-56-generic x86_64 Ubuntu 12.04.3 LTS auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_verbose = yes auth_verbose_passwords = sha1 deliver_log_format = mailbox: deliver: msgid=%m from=%f: %$ dict { quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = secret instance_name = dovecot-mailbox lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes login_greeting = Mailbox login_log_format = mailbox: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "mailbox: mail: %s(%u): <%{session}>: " mail_plugins = quota stats mail_privileged_group = vmail mail_uid = vmail managesieve_implementation_string = Sieve managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.duplicate mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 50 M mmap_disable = yes namespace { inbox = yes location = mailbox Archives { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = dovecot user = dovecot } } service dict { unix_listener dict { group = vmail mode = 0660 } } service doveadm { inet_listener doveadm-server { port = 19000 } } service imap-login { inet_listener imap { port = 19143 } } service imap-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp-without-quota { address = * port = 19025 } inet_listener lmtp { address = * port = 19024 } } service managesieve-login { inet_listener sieve { port = 19200 } } service pop3-login { inet_listener pop3 { port = 19110 } } service pop3-postlogin { executable = script-login /usr/local/bin/dovecot-postlogin user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } service quota-warning { executable = script /usr/local/bin/quota-warning extra_groups = dovecot unix_listener quota-warning { user = vmail } user = vmail } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl = no syslog_facility = local1 userdb { driver = prefetch } userdb { args = /etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = quota stats imap_quota imap_stats } protocol lmtp { mail_plugins = quota stats sieve } -------------- next part -------------- # 2.1.16: /etc/dovecot-director/dovecot-director.conf # OS: Linux 3.2.0-56-generic x86_64 Ubuntu 12.04.3 LTS auth_verbose = yes auth_verbose_passwords = sha1 base_dir = /var/run/dovecot-director deliver_log_format = director: deliver: msgid=%m from=%f: %$ director_doveadm_port = 20000 director_mail_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_servers = 10.129.3.193 10.129.3.192 10.129.3.191 10.129.3.190 director_user_expire = 2 days disable_plaintext_auth = no doveadm_password = secret doveadm_proxy_port = 19000 instance_name = dovecot-director lmtp_proxy = yes login_greeting = Mail Balancer login_log_format = director: login: %$: %s login_trusted_networks = 10.129.3.0/24 mail_debug = yes mail_fsync = always mail_gid = vmail mail_home = /mail/dovecot/%d/%n mail_location = mdbox:~/mail mail_log_prefix = "director: mail: %s(%u): <%{session}>: " mail_max_userip_connections = 20 mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vnd.dovecot.duplicate mmap_disable = yes passdb { args = /etc/dovecot-director/conf.d/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { user = dovecot } } service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service doveadm { executable = doveadm-server director inet_listener doveadm-server { port = 20000 } } service imap-login { executable = imap-login director inet_listener imap { port = 20143 } inet_listener imaps { port = 20993 ssl = yes } } service ipc { unix_listener ipc { user = dovecot } } service lmtp { inet_listener lmtp-without-quota { address = * port = 20025 } inet_listener lmtp { address = * port = 20024 } } service managesieve-login { executable = managesieve-login director inet_listener sieve { port = 20200 } } service pop3-login { executable = pop3-login director inet_listener pop3 { port = 20110 } inet_listener pop3s { port = 20995 ssl = yes } } ssl_cert = From basseed at gmail.com Mon Jan 6 15:41:39 2014 From: basseed at gmail.com (Marco Cusano) Date: Mon, 6 Jan 2014 14:41:39 +0100 Subject: [Dovecot] virtual mailboxes folder structure Message-ID: <36346E91E8E542C8A10700D87EB9D63F@XPS> Hi, I am trying to find a way to list my virtual mailboxes hiding the namespace prefix into my imap client. Fore example now my ?All? mailbox is listed under virtual/ as: Inbox Sent Drafts Spam Trash virtual All I would like to list as this: Inbox Sent Drafts Spam Trash All This is my 10-mail.conf: http://pastebin.com/DumEbbmy and this is my 15-mailboxes.conf: http://pastebin.com/QFzWGzyC I thought that the list = children paramenter would do but it did not. Thank you From amandy_lda at outlook.com Tue Jan 7 03:33:31 2014 From: amandy_lda at outlook.com (ldaamandy) Date: Tue, 7 Jan 2014 01:33:31 +0000 Subject: [Dovecot] What's the parameter -w for dovecot-auth: dovecot -w In-Reply-To: <52CAAA0B.7030701@bluerosetech.com> References: , <52CA79C9.9080305@bluerosetech.com> , <52CAAA0B.7030701@bluerosetech.com> Message-ID: ok thanks for your answer . I'will be using Dovecot 2.x myself soon after i get 1.x . thanks amandy > Date: Mon, 6 Jan 2014 05:05:15 -0800 > From: list_dovecot at bluerosetech.com > To: amandy_lda at outlook.com; dovecot at dovecot.org > Subject: Re: [Dovecot] What's the parameter -w for dovecot-auth: dovecot -w > > On 1/6/2014 2:02 AM, ldaamandy wrote: > > thank you Darren Pilgrim and what should I do to not let > > dovecot -w start? i want to keep one dovecot-auth . Is it set in > > the dovecot.conf ? > > You can't make it not start--it's necessary for certain authentication > databases. Even if you could, why are you worrying about this? If you > really don't want it, you'll need to switch to a different > authentication database. I'm pretty sure PostgreSQL doesn't require an > authentication worker, but can't verify that as I no longer use Dovecot 1.x. From skdovecot at smail.inf.fh-brs.de Tue Jan 7 09:19:32 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Jan 2014 08:19:32 +0100 (CET) Subject: [Dovecot] acl, shared folders In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 6 Jan 2014, Infoomatic wrote: > After spending quite some time to figure out how users can share folders I now hope someone of you could help me out. I am quite sure its just a stupid mistake/misunderstanding?... I am using Ubuntu 12.04 LTS with the shipped dovecot 2.0.19 I'm using v2.2, but it should apply to v2.0 as well. > This seems fine. ACLs look fine. > However, there is nothing listed in the account of user2. I think the > mistake is in the namespace configuration of "location" or "prefix" > ? > mail_home = /var/lib/vmail/home/%u > mail_location = mdbox:/var/lib/vmail/mail/%u > namespace { > ? inbox = yes > ? location = > ? prefix = > ? separator = / > ? type = private > } > namespace { > ? list = children > ? location = mdbox:/var/lib/vmail/mail/%%n/mailboxes/shared/%n > ? prefix = shared/%%n/ > ? separator = / > ? subscriptions = no > ? type = shared > } First note, that you use %u in the default location, but %n in the shared namespace definition. IMHO, you must stick to one, as only one is correct in your setup. Second, reread http://wiki2.dovecot.org/SharedMailboxes/Shared Say user1 is sharing to user2, then your second namespace tells Dovecot to look for user1's mailboxes in /var/lib/vmail/mail/user1/mailboxes/shared/user2, you most likely need to replicate the default mail_location there with %'s doubled. Then you must decide, where each user's INDEX and CONTROL information is stored, or if flags are shared as well. - From your current definition I would say, you need: location = mdbox:/var/lib/vmail/mail/%%u:INDEX=~/shared/%%u First part points to the directory of the user sharing the mailboxes, INDEX= places user-specific files of the user accessing shared mailboxes into his/her own hierarchie. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUsuqhV3r2wJMiz2NAQK+lAgAu46HGrSz3h8JGGM7hJpLHsuDkypHD8Xr ThbicfUC5CVOBk1xs3FkXM1gDecb8820f6JrDSe24slg6Lf7WWPdZdGEzc4f0Dnr btL4+ePrRrI+UyuRXtmm7hZu6JaUwJj+h8AOmpzg+swJokHWUGkY73vcFri+O2bt Dfd+HbZqmuCjJ+aauLKclEEGCQ45JHKC/LavxnBFPix48PoCEOrfaVrC3R9mFjGD 7CJbzgi2T2xJIdYzl+pvFRgEu8aT6AtgQo+4BE51PaLz/8XUE4NX5usV/kcLgu9O iz5VQcgKXFFoJ1HD37kcwNVkkAx67yDTVdDyLgvH9j0CYBpvnxDM4g== =WVlL -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Tue Jan 7 09:28:22 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Jan 2014 08:28:22 +0100 (CET) Subject: [Dovecot] Dovecot deliver into folder question In-Reply-To: <52CB1332.2010208@perkel.com> References: <52CB1020.3070604@perkel.com> <52CB11A2.4020205@Media-Brokers.com> <52CB1332.2010208@perkel.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 6 Jan 2014, Marc Perkel wrote: > On 1/6/2014 12:27 PM, Charles Marcus wrote: >> On 2014-01-06 3:20 PM, Marc Perkel wrote: >>> If I want to user dovecot deliver into a folder that is not at the root >>> level - how do I do that? How do I specify a folder in a folder? >> >> For *all* messages? Or for certain messages? >> >> Kind of an incomplete question. >> > > Certain messages. I'm talking about the deliver utility - the -m option. > > Usage: dovecot-lda [-c ] [-a
] [-d ] [-p > ] > [-f ] [-m ] [-e] [-k] > > when specifying the mailbox - how do you specify a subfolder? Do you use a / > separator? You have to experiment a bit. As far as I remember, there had been bug reports in some versions that maybe a mixture of "/" and the configured separator must be used, e.g. prefix = shared. separator = . try: - -m shared.sub1.sub2.sub3 - -m shared.sub1/sub2/sub3 - -m shared/sub1/sub2/sub3 When I used Dovecot LDA, the first variant worked. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUsusll3r2wJMiz2NAQKBqwf+KzT/ZtFMH77EowG9q+dz6eTFnoenDa4C pGIaDhLBVNJlqYZnbQP61HJHnKxXqIvx/zcnPaVbdsXDL+yjAVsY91/fENieQDwv JmG7hvcUeRQxAdi5oqwLm50chvpbNMMmovXcaM55D12/qDwrmS/I/miJEKN8fNNp FMG+aePFcrWDq+zWzXG8wAkMGQOCvLSGy4U470aRWUpaxEBpDd0D2Vh4aG2ovdGE tXaBTA6DiLOdh4ZgoocfFeCiQKbXR0gHkDGo8di9geKmBwad2rZg9rrIUm5JRW0v C++BhpW3o/w0vhZmKNK9U6C1T38m99e5XWGm6GXtAWir5dZIyJdD3w== =2m49 -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Tue Jan 7 10:00:15 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Jan 2014 09:00:15 +0100 (CET) Subject: [Dovecot] how to separate virtual delivery and authentication? In-Reply-To: <1728139.NAVRg0enP2@arhivio> References: <1728139.NAVRg0enP2@arhivio> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 30 Dec 2013, Mihai Badici wrote: > I have a "pure ldap" setting with postfix and dovecot. > When using dovecot delivery, the recipient is checked via ldap. > The same ldap query is used when authenticate. > So, if I want to authenticate with the uid , I can't use a filter like uid=%u > because the delivery will fail. I don't want to use %nor something else > because I could use multiple e-mail addresses on a single account. > > I actually use a filter like ( mail=%u)|(uid=%u) but I think for more complex > situations should be better to have two separate filters, one for > authentication and the other for the delivery. What is your oppinion? There are two filters already: 1) the passdb filter which is used to find users during authentication 2) the userdb filter which is used to get the information about users, e.g. after auth and for delivery The responses of both queries are cached, too. Where / how would you like to have another filter? What is to get better? If you want to make the LDAP search more efficient, you could add another LDAP attribute, index it,& add all writings of the users there, e.g.: dn: uid=user, .... uid: user mail: forename.surname at example.com maildrop: user maildrop: user at host.sub.example.org maildrop: forename.surname at example.com maildrop: forename.surname at example2.com maildrop: forename.oldsurname at example.com maildrop: alias at part.aliasdomain.net However, the values of maildrop must be unique among all users. The passdb filter uses uid only, userdb uses maildrop only. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUsu0D13r2wJMiz2NAQJhEQf/ZJbC3z4XlMHrkae1yeWN4M4sWAFV7K8Y +PewH7IIZMwOvx2uiJXKFdhVqoPkseidwKEYJC2e0mSqAAE+wCiqqRj6Oeo1kAKt tVn6EofgabABf03SCULU3YfCITt2F7GBAyMv4kxEMH1WKxdBiABcTmRXhWJzyWPl aMLc+Z4Jqaedq6m8/efR2JlLsCYflmeeCk8vNNguqXifcnUwqTSRvwGnwn+Ny7Eq lgGCbIYNHZVXcUelRmsJ+F4p1ed6rYX1me/+Q8QgQBCKSWaWiBTslgBLpHhdM4+d ISqIcJcV1djlqT6NA3TpMuicv4RkglzvRl07DbvTKzDmhOB8pKdb6g== =HD5o -----END PGP SIGNATURE----- From wdehoog at exalondelft.nl Tue Jan 7 10:26:18 2014 From: wdehoog at exalondelft.nl (W. de Hoog) Date: Tue, 07 Jan 2014 09:26:18 +0100 Subject: [Dovecot] using OR in doveadm search query In-Reply-To: <20140106142143.Horde.rjxn6v5vkAfTFZTYohPvrw1@bigworm.curecanti.org> References: <52CB1A61.9090904@exalondelft.nl> <20140106142143.Horde.rjxn6v5vkAfTFZTYohPvrw1@bigworm.curecanti.org> Message-ID: <52CBBA2A.1080007@exalondelft.nl> > This works for me (at least with tcsh): > > $ doveadm search mailbox "shared/* OR (SUBJECT a) (SUBJECT b)" doveadm does not complain anymore but it does not find anything. I guess because now the query has become a mailbox name that does not exist. ( I am using dovecot 2.2.9) -- Willem-Jan de Hoog From mihai at badici.ro Tue Jan 7 10:33:54 2014 From: mihai at badici.ro (Mihai Badici) Date: Tue, 07 Jan 2014 10:33:54 +0200 Subject: [Dovecot] how to separate virtual delivery and authentication? In-Reply-To: References: <1728139.NAVRg0enP2@arhivio> Message-ID: <1684871.acnAICY6W1@arhivio> On Tuesday 07 January 2014 09:00:15 you wrote: > On Mon, 30 Dec 2013, Mihai Badici wrote: > > I have a "pure ldap" setting with postfix and dovecot. > > When using dovecot delivery, the recipient is checked via ldap. > > The same ldap query is used when authenticate. > > So, if I want to authenticate with the uid , I can't use a filter like > > uid=%u because the delivery will fail. I don't want to use %nor something > > else because I could use multiple e-mail addresses on a single account. > > > > I actually use a filter like ( mail=%u)|(uid=%u) but I think for more > > complex situations should be better to have two separate filters, one > > for authentication and the other for the delivery. What is your oppinion? > There are two filters already: > > 1) the passdb filter > which is used to find users during authentication > > 2) the userdb filter > which is used to get the information about users, e.g. after auth and for > delivery > The passdb filter uses uid only, userdb uses maildrop only. There is not the efficiency , but the flexibility who interest me. There are two sepparate processes: delivery and authentication. During delivery, dovecot will check if the mailbox exists and where it is located; it is not important how the user is authenticated. During authentication, there is user, pasword and mailbox location, iti is not important if the user has an valid e-mail address. When the filter is accessed by the delivery module, the query string must be the e-mail ( all other solutions will fail when multiple e-mail addresses and non-standard uid are used). When the filter is accessed via the authentication module, the query will contain the username, not the e-mail . So basically there is not the same string provided as argument for the query filter. We need all sort of workarounds to solve this dilema, like the "or" between mail and uid , split the e-mail address as %u and % d and so on.... With two query strings, one for authentication and the other for delivery I think it could be more elegant and clear. > > -- > Steffen Kaiser -- Mihai B?dici http://mihai.badici.ro From skdovecot at smail.inf.fh-brs.de Tue Jan 7 12:04:33 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Jan 2014 11:04:33 +0100 (CET) Subject: [Dovecot] how to separate virtual delivery and authentication? In-Reply-To: <1684871.acnAICY6W1@arhivio> References: <1728139.NAVRg0enP2@arhivio> <1684871.acnAICY6W1@arhivio> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 7 Jan 2014, Mihai Badici wrote: > On Tuesday 07 January 2014 09:00:15 you wrote: >> On Mon, 30 Dec 2013, Mihai Badici wrote: >>> I have a "pure ldap" setting with postfix and dovecot. >>> When using dovecot delivery, the recipient is checked via ldap. >>> The same ldap query is used when authenticate. >>> So, if I want to authenticate with the uid , I can't use a filter like >>> uid=%u because the delivery will fail. I don't want to use %nor something >>> else because I could use multiple e-mail addresses on a single account. >>> >>> I actually use a filter like ( mail=%u)|(uid=%u) but I think for more >>> complex situations should be better to have two separate filters, one >>> for authentication and the other for the delivery. What is your oppinion? >> There are two filters already: >> >> 1) the passdb filter >> which is used to find users during authentication >> >> 2) the userdb filter >> which is used to get the information about users, e.g. after auth and for >> delivery > >> The passdb filter uses uid only, userdb uses maildrop only. > > There is not the efficiency , but the flexibility who interest me. > There are two sepparate processes: delivery and authentication. > During delivery, dovecot will check if the mailbox exists and where it is > located; it is not important how the user is authenticated. > During authentication, there is user, pasword and mailbox location, iti is not > important if the user has an valid e-mail address. > > When the filter is accessed by the delivery module, the query string must be > the e-mail ( all other solutions will fail when multiple e-mail addresses and > non-standard uid are used). > When the filter is accessed via the authentication module, the query will > contain the username, not the e-mail . So basically there is not the same > string provided as argument for the query filter. We need all sort of > workarounds to solve this dilema, like the "or" between mail and uid , split > the e-mail address as %u and % d and so on.... With two query strings, one for > authentication and the other for delivery I think it could be more elegant and > clear. IMHO, exactly that works with the maildrop LDAP attribute. You enumerate all mail addresses into maildrop. Use maildrop in userdb filter only. If you like to use "uid" on command line of doveadm, you need to add the uid to maildrop as well, otherwise have the passdb return another username, e.g. the "mail" LDAP attribute to convert the uid into mail adress. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUsvRMV3r2wJMiz2NAQIMfAf9F1juWY2KOGkYYPeKcpIZXrJqH3goyCX1 D7+a8Vl4vWMimjpGq13sVB4yrRwnOLViGHGQNcuZtx/sI75hFUqrd93WufYsShiv VyfIeOdPbsBE9M0wje2z8conH3GX0clo/5vPhftgFe+NYQTvrJct8is2N2RPyqrE 8p9SzmjH3mhB0dAoZOeCdxeFWIGqNP59uTGSowRWQH5CX4zCi0IJWWiP6I39ffiV mG5OMdY1bbCCLJQDGwfz9VGeRQ5Gpua5LDThq8QJKzASwkw6G3KtKr0wfGUOkijt gXyFIQEI8QeXvd2xLrEwnmlW/HFETVZnyTQk21n9pq/T0c18lIUqXg== =wTnt -----END PGP SIGNATURE----- From rbras at iseg.ulisboa.pt Tue Jan 7 13:01:05 2014 From: rbras at iseg.ulisboa.pt (=?utf-8?b?UmHDumw=?= Massano =?utf-8?b?QnLDoXM=?=) Date: Tue, 07 Jan 2014 11:01:05 +0000 Subject: [Dovecot] Panic: file mailbox-list-maildir.c: line 133: unreached In-Reply-To: <52C9B461.2080809@sys4.de> References: <20140105185323.Horde.sGPDLd9IRNbcLhcDjzoxOw1@mail.iseg.ulisboa.pt> <52C9B461.2080809@sys4.de> Message-ID: <20140107110105.Horde.4lGzLOKpX5xPxPHXYwuSNw1@mail.iseg.ulisboa.pt> Citando Robert Schetterer : > > > 2.0.9 is old what about upgrade to recent 2.1.x, 2.2.x > > the latest patchlevel of 2.0.x is 2.0.21 so minimum try upgrade to this, > your problem may allready got fixed Upgrading to version 2.2.7 solved the problem. Thank you for the advice. Best Regards, -- Ra?l Br?s Instituto Superior de Economia e Gest?o Universidade de Lisboa From kolmann at zid.tuwien.ac.at Tue Jan 7 14:21:46 2014 From: kolmann at zid.tuwien.ac.at (Philipp Kolmann) Date: Tue, 7 Jan 2014 13:21:46 +0100 Subject: [Dovecot] LMTP with virtual and system users In-Reply-To: <52C44F9B.5020609@ente.limmat.ch> References: <52BA8668.5000502@zid.tuwien.ac.at> <52BC10F6.7070306@ente.limmat.ch> <52C1319A.6070309@zid.tuwien.ac.at> <52C44F9B.5020609@ente.limmat.ch> Message-ID: <52CBF15A.6090209@zid.tuwien.ac.at> Hi Adrian, thanks for your reply. I have also thought in this direction already but I didn't want to have lda SUID root... I saw that the Passwd-file passdb supports username_format as argument. Would it be possible to add this feature also to the LMTP passdb driver? thanks Philipp On 01/01/14 18:25, Adrian Zaugg wrote: > Hi Philipp > > You are completely right, the proposed solution doesn't work. It seems > exim always qualifies an address without a domain, I believe this is > because LMTP requiers to get only qualified addresses (LMTP is based on > SMTP and the RFC, if I read it correctly specifies it like this). > > So, another solution would be to use LDA for your local users and LMTP > for the rest. The configuration for exim would be: a router and a > transport for your local users using LDA, and your virtual users setup > as you have it using LMTP. > > local_user: > debug_print = "R: local_user for $local_part@$domain" > driver = accept > domains = @ : localhost : ${primary_hostname} > check_local_user > transport = dovecot_lda > cannot_route_message = Unknown user > > dovecot_lda: > driver = pipe > command = /usr/lib/dovecot/dovecot-lda \ > -f $sender_address \ > -a $original_local_part@$original_domain > log_output > delivery_date_add > return_path_add > envelope_to_add > user = $local_part > group = mail > temp_errors = 64 : 69 : 70 : 71 : 72 : 73 : 74 : 75 : 78 > > > Please check man dovecot-lda and the dovecot wiki > (http://wiki2.dovecot.org/LDA/Exim) for details. Also check the > permissions you need for dovecot-lda to write to your mailspool (user > and group options from the transport). > > I haven't tried the above, but I think it works like this ... > > Best regards, Adrian. > > > Am 30.12.13 09:40 schrieb Philipp Kolmann: >> Hi Adrian, >> >> Am 26.12.2013 12:20, schrieb Adrian Zaugg: >>> You can use exim to prepare the address as you wish: only the user name >>> for pam users and the full address for virtual users. >>> >>> Configure a new router to strip the domain part for pam users: >>> >>> local_pam_users: >>> debug_print = "R: strip domain for local pam users" >>> driver = redirect >>> check_local_user >>> domains = @ : localhost : ${primary_hostname} >>> data = ${local_part} >>> redirect_router = local_user >>> >>> I'm not 100% sure of the domains condition; it should restrict the >>> router to your domain(s) where your pam users receive their email. The >>> redirect_router designates the router which routes your local deliveries >>> to your lmtp transport. Place the new router to run just before your >>> "local_user" router. >>> >>> Since your config works for your virtual users, you don't need to do >>> anything in addition. >> I had tried this once already. I have used your snipplet and attached >> the debug output from exim. Sadly it didn't work, because the mtp >> process got the foll email again and not just the username. >> >> thanks >> Philipp >> >> >> -- ----------------------------------------------------------------------- DI Mag. Philipp Kolmann mail: kolmann at zid.tuwien.ac.at Technische Universitaet Wien web: www.zid.tuwien.ac.at Zentraler Informatikdienst (ZID) tel: +43(1)58801-42011 Wiedner Hauptstr. 8-10, A-1040 Wien DVR: 0005886 ----------------------------------------------------------------------- From mihai at badici.ro Tue Jan 7 14:25:02 2014 From: mihai at badici.ro (Mihai Badici) Date: Tue, 07 Jan 2014 14:25:02 +0200 Subject: [Dovecot] how to separate virtual delivery and authentication? In-Reply-To: References: <1728139.NAVRg0enP2@arhivio> <1684871.acnAICY6W1@arhivio> Message-ID: <11698361.MTN3OYse3R@arhivio> > > IMHO, exactly that works with the maildrop LDAP attribute. You enumerate > all mail addresses into maildrop. Use maildrop in userdb filter only. If > you like to use "uid" on command line of doveadm, you need to add the uid > to maildrop as well, otherwise have the passdb return another username, > e.g. the "mail" LDAP attribute to convert the uid into mail adress. > > -- > Steffen Kaiser This is also a workaround, adding uid to maildrop. Think at, for example, using Active Directory with dovecot ( I do not recommend that :) ) I wonder if I could use only passdb filter for authentication (and let userdb for delivery) , this could be far better.But I think this is a design issue. -- Mihai B?dici http://mihai.badici.ro From skdovecot at smail.inf.fh-brs.de Tue Jan 7 15:01:15 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 7 Jan 2014 14:01:15 +0100 (CET) Subject: [Dovecot] how to separate virtual delivery and authentication? In-Reply-To: <11698361.MTN3OYse3R@arhivio> References: <1728139.NAVRg0enP2@arhivio> <1684871.acnAICY6W1@arhivio> <11698361.MTN3OYse3R@arhivio> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 7 Jan 2014, Mihai Badici wrote: >> IMHO, exactly that works with the maildrop LDAP attribute. You enumerate >> all mail addresses into maildrop. Use maildrop in userdb filter only. If >> you like to use "uid" on command line of doveadm, you need to add the uid >> to maildrop as well, otherwise have the passdb return another username, >> e.g. the "mail" LDAP attribute to convert the uid into mail adress. > > This is also a workaround, adding uid to maildrop. Think at, for example, > using Active Directory with dovecot ( I do not recommend that :) ) I don't know what that means. I wouldn't name it workaround. > I wonder if I could use only passdb filter for authentication (and let userdb > for delivery) , this could be far better.But I think this is a design issue. Remember: passdb is for authentificating users; userdb is for getting user information. When an user auth's for IMAP, passdb verifies the password and probably overrides the username, in the second step the userdb is queried for the user data. If you use prefetch userdb and provide different passdb and userdb queries, I would not expect a clean run. Maybe, it's better you give a detailed example, which makes your idea more visible. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUsv6nF3r2wJMiz2NAQI5NwgApS5GzJh+0Ywg8WIsVKqzK/B6LJxLBH8B WlnfxBo4Vc6+7j3CdgiIPVPxRXHKCgp0N8uNcafbYTAXjkV5kemhrBD2XqTeFeYC Osg1QjQOhuAHB/G/WSSLB1vRaOy/G1gFN/Y4ZWijabBTIJ1hi9VArraE1JPNzR+u MxoRMJneX5nU5dTbvKs3+YErs54jZubeobctsLpr/JpK6erFUaRcccNvmD/ZGJTc rLErV8GojSbayWExYItwDVlxolbXC4d9ZLA64AMHUqpdyULWP4N9WlyhcCXtJ1zz wgvZEzlcoGw7aaq4EPfmrMyFiRNM702KWsa8Ut8w6iSYc38R7M6SOA== =UU93 -----END PGP SIGNATURE----- From tlx at leuxner.net Tue Jan 7 15:42:30 2014 From: tlx at leuxner.net (Thomas Leuxner) Date: Tue, 7 Jan 2014 14:42:30 +0100 Subject: [Dovecot] Question re: filesystem permissions In-Reply-To: <52CB10B5.4020904@Media-Brokers.com> References: <52CB10B5.4020904@Media-Brokers.com> Message-ID: <20140107134230.GA19855@nihlus.leuxner.net> * Charles Marcus 2014.01.06 21:23: Hi Charles, > /var/vmail/example1.com 777 $ ls -al /var/vmail/domains/leuxner.net/ drwx--S--- 4 vmail vmail 4096 Sep 8 18:22 tlx Suffices to have rwx for the 'vmail' user only IMHO. Note the 'setgid bit (2700) inheriting the group 'vmail' across dirs. Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From CMarcus at Media-Brokers.com Tue Jan 7 16:05:01 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 07 Jan 2014 09:05:01 -0500 Subject: [Dovecot] Question re: filesystem permissions In-Reply-To: <20140107134230.GA19855@nihlus.leuxner.net> References: <52CB10B5.4020904@Media-Brokers.com> <20140107134230.GA19855@nihlus.leuxner.net> Message-ID: <52CC098D.4040609@Media-Brokers.com> On 2014-01-07 8:42 AM, Thomas Leuxner wrote: > * Charles Marcus 2014.01.06 21:23: > > Hi Charles, > >> /var/vmail/example1.com 777 > $ ls -al /var/vmail/domains/leuxner.net/ > > drwx--S--- 4 vmail vmail 4096 Sep 8 18:22 tlx > > Suffices to have rwx for the 'vmail' user only IMHO. Note the 'setgid bit (2700) inheriting the group 'vmail' across dirs. Ok, thanks Thomas... but I'm really looking for what Timo says is the correct and proper permissions for a virtual setup like this. I also really think this should be fully documented on the wiki... -- Best regards, Charles From tlx at leuxner.net Tue Jan 7 16:30:58 2014 From: tlx at leuxner.net (Thomas Leuxner) Date: Tue, 7 Jan 2014 15:30:58 +0100 Subject: [Dovecot] Question re: filesystem permissions In-Reply-To: <52CC098D.4040609@Media-Brokers.com> References: <52CB10B5.4020904@Media-Brokers.com> <20140107134230.GA19855@nihlus.leuxner.net> <52CC098D.4040609@Media-Brokers.com> Message-ID: <20140107143058.GB19855@nihlus.leuxner.net> * Charles Marcus 2014.01.07 15:05: > Ok, thanks Thomas... but I'm really looking for what Timo says is > the correct and proper permissions for a virtual setup like this. I suggest you don't start posts 'Hi all' then going forward. Anyway this is the default for Dovecot quite some time, so reckon someone gave it a thought... -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From me at junc.eu Tue Jan 7 18:40:45 2014 From: me at junc.eu (Benny Pedersen) Date: Tue, 07 Jan 2014 17:40:45 +0100 Subject: [Dovecot] Dovecot deliver into folder question In-Reply-To: <52CB1332.2010208@perkel.com> References: <52CB1020.3070604@perkel.com> <52CB11A2.4020205@Media-Brokers.com> <52CB1332.2010208@perkel.com> Message-ID: Marc Perkel skrev den 2014-01-06 21:33: > when specifying the mailbox - how do you specify a subfolder? Do you > use a / separator? try create a folder in webmail, then see how its done in filesystem later, is this clear now ? seperate chars is imho not hardcoded, thats why i answer as above From me at junc.eu Tue Jan 7 18:44:36 2014 From: me at junc.eu (Benny Pedersen) Date: Tue, 07 Jan 2014 17:44:36 +0100 Subject: [Dovecot] Dovecot deliver into folder question In-Reply-To: References: <52CB1020.3070604@perkel.com> <52CB11A2.4020205@Media-Brokers.com> <52CB1332.2010208@perkel.com> Message-ID: <3ebb0b4e027f7e0d77712704fff27681@junc.eu> Steffen Kaiser skrev den 2014-01-07 08:28: > separator = . > - -m shared.sub1.sub2.sub3 > When I used Dovecot LDA, the first variant worked. is separator not a glue here ? :) i think separator = / is a very very bad idea From me at junc.eu Tue Jan 7 19:01:08 2014 From: me at junc.eu (Benny Pedersen) Date: Tue, 07 Jan 2014 18:01:08 +0100 Subject: [Dovecot] =?utf-8?q?inotify_max=5Fuser_instances?= In-Reply-To: <52CAF703.5040005@Media-Brokers.com> References: <52CAF703.5040005@Media-Brokers.com> Message-ID: <5ce591284c8d793957599bc16598bee8@junc.eu> Charles Marcus skrev den 2014-01-06 19:33: > echo 1024 > /proc/sys/fs/inotify/max_user_instances > Suggestions? add this to sysctl.conf no need to hack init scripts :) From debian.roxx at gmail.com Tue Jan 7 19:32:55 2014 From: debian.roxx at gmail.com (Sylvain) Date: Tue, 7 Jan 2014 18:32:55 +0100 Subject: [Dovecot] Assertion failed with imapc after upgrading Dovecot from 2.1.7 to 2.2.9 Message-ID: Hi ! I have an old Courier IMAP and in front of it, I have put a proxy cache with Dovecot/imapc. I use Debian Wheezy (stable) which package Dovecot in version 2.1.7. I have tested the upgrade to Debian Jessie (testing) which package Dovecot in version 2.2.9 but an assertion is thrown : dovecot: imap(xxx): Panic: file imapc-list.c: line 499 (imapc_list_delete_unused_indexes): assertion failed: (strncmp(vname, fs_list->ns->prefix, fs_list->ns->prefix_len) == 0) I have checked source code and have seen that if *imapc_list_prefix* is not set, assertion will not be "walked". It's works but special inbox aren't detected correctly in email clients. If I understand the meaning of *vname* variable, it is because our Courier IMAP send us "INBOX" which is the value of my *imapc_list_prefix* and thus, assertion is thrown. Here some details of my tests : Courier IMAP : * OK [CAPABILITY IMAP4rev1 UIDPLUS CHILDREN NAMESPACE THREAD=ORDEREDSUBJECT THREAD=REFERENCES SORT QUOTA IDLE ACL ACL2=UNION STARTTLS] Courier-IMAP ready. Copyright 1998-2005 Double Precision, Inc. See COPYING for distribution information. a login xxx xxx a OK LOGIN Ok. a list "" "*" * LIST (\HasNoChildren) "." "INBOX.Drafts" * LIST (\HasNoChildren) "." "INBOX.Trash" * LIST (\HasNoChildren) "." "INBOX.test" * LIST (\HasNoChildren) "." "INBOX.Sent" * LIST (\HasNoChildren) "." "INBOX.Junk" * LIST (\Unmarked \HasChildren) "." "INBOX" a OK LIST completed Dovecot version 2.1.7 : * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. a login xxx xxx a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] Logged in a list "" "*" * LIST (\HasChildren) "." "INBOX" * LIST (\HasNoChildren \Drafts) "." "INBOX.Drafts" * LIST (\HasNoChildren \Trash) "." "INBOX.Trash" * LIST (\HasNoChildren) "." "INBOX.test" * LIST (\HasNoChildren \Sent) "." "INBOX.Sent" * LIST (\HasNoChildren \Junk) "." "INBOX.Junk" a OK List completed. Dovecot version 2.2.9 : * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. a login xxx xxx a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in a list "" "*" Connection closed by foreign host. And the dovecot configuration relative to the inbox : imapc_list_prefix = INBOX namespace inbox { inbox = yes separator = . prefix = INBOX. } Any help will be welcome :) Sylvain From CMarcus at Media-Brokers.com Tue Jan 7 20:46:26 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 07 Jan 2014 13:46:26 -0500 Subject: [Dovecot] Question re: filesystem permissions In-Reply-To: <20140107143058.GB19855@nihlus.leuxner.net> References: <52CB10B5.4020904@Media-Brokers.com> <20140107134230.GA19855@nihlus.leuxner.net> <52CC098D.4040609@Media-Brokers.com> <20140107143058.GB19855@nihlus.leuxner.net> Message-ID: <52CC4B82.1020203@Media-Brokers.com> On 2014-01-07 9:30 AM, Thomas Leuxner wrote: > * Charles Marcus 2014.01.07 15:05: > >> Ok, thanks Thomas... but I'm really looking for what Timo says is >> the correct and proper permissions for a virtual setup like this. > I suggest you don't start posts 'Hi all' then going forward. Well, that wasn't really necessary was it? This isn't my personal support line to Timo, it is a mail list. When I said 'what Timo says', I was actually hoping this was already documented somewhere and someone else (without having to bother Timo) could point me to the wiki page where this is laid out. I just don't want to take some $random_user's word for it, if you understand my meaning... no offense intended. > Anyway this is the default for Dovecot quite some time, so reckon someone gave it a thought... *What* is the default. Are you saying all of the permissions I showed are correct except the ones you mentioned? But most importantly - *where is this documented*??? -- Best regards, Charles From megodin at inboxalias.com Tue Jan 7 20:49:29 2014 From: megodin at inboxalias.com (megodin at inboxalias.com) Date: Tue, 7 Jan 2014 13:49:29 -0500 (EST) Subject: [Dovecot] BUG report: doveadm HEADER when concatenating with another Search key Message-ID: Hey there, I'm pretty sure I've found a bug with doveadm when concatenating with another search key. While doveadm HEADER works fine when not using additional search keys, it doesn't work properly when concatenating with other serarch keys - it then simply seems to ignore the additional HEADER search key. It's reproduceable, also with different user accounts on 2 different productive systems. Testing it on latest dovecot-ee 2.2.9.2 and 2.2.5.5. I think it's best explained with showing some examples: doveadm search -u exampleuser SUBJECT Silvester (outputs correctly 10 matches) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 doveadm search -u exampleuser SUBJECT Silvester HEADER Return-Path someuser at example.com (gives exactly the same output - but this is WRONG, as the given Subject AND Return-Path is really only found in 1 Message - uid 15697) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 doveadm search -u exampleuser HEADER Return-Path someuser at example.com (showing that Return-Path as standalone search key is working fine - note that message uid 15697 with subject "Silvester" is also found of course. I manually checked all Mails showing up here, they all contained the Return-Path "someuser at example.com" as they should): 5a09f50926daef51b50e000025ab05f8 14080 5a09f50926daef51b50e000025ab05f8 14814 5a09f50926daef51b50e000025ab05f8 14815 5a09f50926daef51b50e000025ab05f8 14820 5a09f50926daef51b50e000025ab05f8 14825 5a09f50926daef51b50e000025ab05f8 14830 5a09f50926daef51b50e000025ab05f8 14832 5a09f50926daef51b50e000025ab05f8 14833 5a09f50926daef51b50e000025ab05f8 15427 5a09f50926daef51b50e000025ab05f8 15428 5a09f50926daef51b50e000025ab05f8 15430 5a09f50926daef51b50e000025ab05f8 15431 5a09f50926daef51b50e000025ab05f8 15697 Further testing with: doveadm search -u exampleuser HEADER Return-Path completegarbageforsurenotinheaders (Correctly no output was given.) doveadm search -u exampleuser SUBJECT Silvester HEADER Return-Path completegarbageforsurenotinheaders (again ignoring the additional HEADER and showing all uids which just match the SUBJECT) 5a09f50926daef51b50e000025ab05f8 1106 5a09f50926daef51b50e000025ab05f8 1107 5a09f50926daef51b50e000025ab05f8 1579 5a09f50926daef51b50e000025ab05f8 4092 5a09f50926daef51b50e000025ab05f8 5330 5a09f50926daef51b50e000025ab05f8 9773 5a09f50926daef51b50e000025ab05f8 11460 5a09f50926daef51b50e000025ab05f8 12718 5a09f50926daef51b50e000025ab05f8 15653 5a09f50926daef51b50e000025ab05f8 15697 Moreove, when playing with HEADER Reply-To it shows some strange behaviour, note the differences with the ":" : doveadm search -u exampleuser SUBJECT blubbs HEADER Reply-to kacke at example.com f64cf50926daef51b50e000025ab05f8 2231 f64cf50926daef51b50e000025ab05f8 2781 5a09f50926daef51b50e000025ab05f8 13620 5a09f50926daef51b50e000025ab05f8 15763 doveadm search -u exampleuser SUBJECT blubbs HEADER Reply-to: kacke at example.com f64cf50926daef51b50e000025ab05f8 2231 5a09f50926daef51b50e000025ab05f8 13620 Can you please have a look at this and fix it? Thanks in advance, Megodin -- mailstorage @ NFS with nfsvers=3 (NetApp) # 2.2.5.5 (e5350245ad9b): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.4 (Santiago) nfs import_environment = TZ DEBUG_OUTOFMEM DOVECOT_HOSTDOMAIN # 2.2.9.2 (8d71ef248a6e): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 CentOS release 6.5 (Final) nfs _________________________________________________________________ Send and receive anonymous emails to your inbox with InboxAlias. http://www.inboxalias.com From mihai at badici.ro Tue Jan 7 21:36:12 2014 From: mihai at badici.ro (Mihai Badici) Date: Tue, 07 Jan 2014 21:36:12 +0200 Subject: [Dovecot] how to separate virtual delivery and authentication? In-Reply-To: References: <1728139.NAVRg0enP2@arhivio> <11698361.MTN3OYse3R@arhivio> Message-ID: <19318653.gc8oNtEt5s@arhivio> O > > userdb for delivery) , this could be far better.But I think this is a > > design issue. > Remember: passdb is for authentificating users; userdb is for getting user > information. When an user auth's for IMAP, passdb verifies the password > and probably overrides the username, in the second step the userdb is > queried for the user data. If you use prefetch userdb and provide > different passdb and userdb queries, I would not expect a clean run. > > Maybe, it's better you give a detailed example, which makes your idea more > visible. > > -- > Steffen Kaiser Ok, an example is better. let's say I use dovecot with postfix and I have in postfix/master.cf : dovecot unix - n n - - pipe flags=DRhu user=mailbox:mailbox argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${recipient} I use two e-mail addresses, mihai at example.org and mihaib at example.org My uid is mihai.badici ( I choose it not related to e-mail address) So, the deliver service will query ldap in order to find the mailbox. We need to put mail=%u or maildrop=%u, depends on schema. On the other hand, the authentication will fail if I use uid, because it use the same query. I can put |(mail=%u)(uid=%u) and it's work, but is rather strange. I can, indeed, use maildrop to "canonify" the mailbox in postfix before delivery, and I think will work too. But I think is more elegant to separate the delivery query and authentication query. I'm not sure if is not possible to use only passdb query for authentication. -- Mihai B?dici http://mihai.badici.ro From interfasys at gmail.com Wed Jan 8 01:31:30 2014 From: interfasys at gmail.com (=?UTF-8?B?aW50ZXJmYVN5cyBzw6BybA==?=) Date: Wed, 08 Jan 2014 00:31:30 +0100 Subject: [Dovecot] Mailbox autocreate feature cannot create folders Message-ID: <52CC8E52.2060500@gmail.com> Hello, The "new" way of creating default mailboxes doesn't work for us. There seems to be a permission problem. We get this in the logs: imap(testuser at domain.com): Error: nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy That error message has nothing to do with NFS (not used) or /var/mail and appears every time an app is requesting a list of folders via IMAP and only if we enable the autocreate feature. We're using mdbox, emails are delivered via LDA and the folder permissions look like this: # la /home/user/imap/domain.com/testuser/mdbox/mailboxes/ total 5 drwx------ 3 user mail 3B Jan 5 19:33 INBOX drwx------ 3 user mail 3B Jan 5 19:33 . drwx------ 4 user mail 8B Jan 7 02:43 .. The mailbox definitions used come straight from the wiki: http://wiki2.dovecot.org/MailboxSettings I've enabled debugging, but there is no mention of the mailboxes to create: Debug: dict quota... Debug: Namespace : type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox Debug: fs:... Debug: acl:... ... Here is what works: - Autocreate plugin - Creating folders via various clients So, it seems Dovecot can create folders, just not using that feature. If that's not a bug, would there be a way to make it work without altering permissions? Cheers, Olivier From jtam.home at gmail.com Wed Jan 8 01:57:12 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 7 Jan 2014 15:57:12 -0800 (PST) Subject: [Dovecot] using OR in doveadm search query In-Reply-To: References: Message-ID: > > This works for me (at least with tcsh): > > > > $ doveadm search mailbox "shared/* OR (SUBJECT a) (SUBJECT b)" > doveadm does not complain anymore but it does not find anything. I guess > because now the query has become a mailbox name that does not exist. ( I > am using dovecot 2.2.9) Each search token ought to be a command line argument to doveadm, so if you're looking for all message with the string "a" or "b" in the subject in mailboxes shared/*, then this should be the correct syntax, with all arguments sufficiently escaped from shell interpretation: doveadm search mailbox shared/\* \( SUBJECT a OR SUBJECT b \) (Delete "OR" if both strings must be in the subject: expressions are implicitly AND'd if not OR'd. In fact, you can also remove the parenthesis since precedence doesn't matter anymore.) You can check the search query by fetching some values using the same query: doveadm fetch 'mailbox hdr' mailbox shared/\* \( SUBJECT a OR SUBJECT b \) Joseph Tam From interfasys at gmail.com Wed Jan 8 02:13:42 2014 From: interfasys at gmail.com (=?UTF-8?B?aW50ZXJmYVN5cyBzw6BybA==?=) Date: Wed, 08 Jan 2014 01:13:42 +0100 Subject: [Dovecot] Dovecot can't find CLucene's libstemmer on FreeBSD Message-ID: <52CC9836.4040003@gmail.com> Hello, A set of patches was created by Lawrence Chen for the Dovecot2 port so that it could recognise and use libstemmer and libexttextcat. They can't be used as is as he's replacing statements with something that works only on FreeBSD, but I think it would be a good idea to try and include some of his fixes. http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/175813 Cheers, Olivier From gcr+dovecot at tharned.org Wed Jan 8 04:20:57 2014 From: gcr+dovecot at tharned.org (Greg Rivers) Date: Tue, 7 Jan 2014 20:20:57 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: Message-ID: On Mon, 6 Jan 2014, I wrote: > I found this[1] thread that describes the same problem with dovecot-LDA, > but the solution (add X-Original-To: header) has no effect with LMTP. > > My sendmail LMTP configuration: > FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp') > > Sendmail's address test indicates that sendmail is providing user+detail > to LMTP (see below). Except for this problem, dovecot, LMTP, and sieve > are all working perfectly. Is there something I'm missing, or is this a > bug? > > [1] http://dovecot.org/pipermail/dovecot/2012-July/136987.htm > It seems I was mistaken. By tracing the LMTP session between dovecot and sendmail I found that sendmail does _not_ include the +detail in RCPT TO:. I also determined that dovecot LMTP will in fact extract the +detail from a X-Original-To: header, but only if one defines lda_original_recipient_header. So for the archives, to get sieve's "envelope :detail ..." working with sendmail and dovecot LMTP, do the following: 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf 2) Add the following rule to sendmail.mc to add a X-Original-To: header to every message: LOCAL_CONFIG H?${u}?X-Original-To: $u -- Greg Rivers From jtam.home at gmail.com Wed Jan 8 05:14:29 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 7 Jan 2014 19:14:29 -0800 (PST) Subject: [Dovecot] BUG report: doveadm HEADER when concatenating with another Search key In-Reply-To: References: Message-ID: On Wed, 8 Jan 2014, dovecot-request at dovecot.org wrote: > doveadm search -u exampleuser SUBJECT Silvester > (outputs correctly 10 matches) > > ... > > doveadm search -u exampleuser SUBJECT Silvester HEADER Return-Path > someuser at example.com > (gives exactly the same output - but this is WRONG, as the given Subject > AND Return-Path is really only found in 1 Message - uid 15697) I couldn't recreate this with 2.1.16. Also, my version of "doveadm search" does not accept missing header patterns. Is this corroborated by dumping out the header with this same search query? doveadm fetch -u exampleuser hdr SUBJECT Silvester \ HEADER Return-Path someuser at example.com Joseph Tam From skdovecot at smail.inf.fh-brs.de Wed Jan 8 09:40:36 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Jan 2014 08:40:36 +0100 (CET) Subject: [Dovecot] how to separate virtual delivery and authentication? In-Reply-To: <19318653.gc8oNtEt5s@arhivio> References: <1728139.NAVRg0enP2@arhivio> <11698361.MTN3OYse3R@arhivio> <19318653.gc8oNtEt5s@arhivio> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 7 Jan 2014, Mihai Badici wrote: >>> userdb for delivery) , this could be far better.But I think this is a >>> design issue. >> Remember: passdb is for authentificating users; userdb is for getting user >> information. When an user auth's for IMAP, passdb verifies the password >> and probably overrides the username, in the second step the userdb is >> queried for the user data. If you use prefetch userdb and provide >> different passdb and userdb queries, I would not expect a clean run. >> >> Maybe, it's better you give a detailed example, which makes your idea more >> visible. > > Ok, an example is better. > let's say I use dovecot with postfix and I have in postfix/master.cf : > > dovecot unix - n n - - pipe > flags=DRhu user=mailbox:mailbox > argv=/usr/libexec/dovecot/deliver -f ${sender} -d ${recipient} > > I use two e-mail addresses, mihai at example.org and mihaib at example.org > My uid is mihai.badici ( I choose it not related to e-mail address) > > So, the deliver service will query ldap in order to find the mailbox. > We need to put mail=%u or maildrop=%u, depends on schema. > > On the other hand, the authentication will fail if I use uid, because it use > the same query. > I can put |(mail=%u)(uid=%u) and it's work, but is rather strange. > I can, indeed, use maildrop to "canonify" the mailbox in postfix before > delivery, and I think will work too. > But I think is more elegant to separate the delivery query and authentication > query. I'm not sure if is not possible to use only passdb query for > authentication. That's what I meant in my second reply with "otherwise have the passdb return another username, e.g. the "mail" LDAP attribute to convert the uid into mail adress." See: http://wiki2.dovecot.org/PasswordDatabase/ExtraFields?highlight=user You use only "uid" in passdb query, but return a field "user" to override the username, e.g.: pass_attrs = uid=user change "uid" to the attribute that holds your primary address. Use the attribute in the userdb query that enumerate all mail addresses. However, this has the drawback, IMHO, that you need to type a mail address with doveadm's -u switch. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUs0A9F3r2wJMiz2NAQIlDAgArtE42Fn7a2hTt/tqdOHR8NaGCHC3V1Vo LqbXZ0fp3KnZBzyzT+NY6o4j6XbfBVAbYtwxTFe/auD1SI/BEXcnBWx5Yc/beA6Y CbR6UE+AZl1/JatWF0hck/tNveuRwuHxWdJG2cpXInEdQgDC/UNlvahVMbQC1LLN PK0UBebi0vwWZJFXo2ZrrvjHJPYZHkKmgebKEjxkh91vR8uE9+q8F1tbaJBuKifW iKz4fPCf70OfivoLr3G37WtbclDnzA16pqEaJAolQzJKyE4QMcg3vsXzsavpeNP8 5xUCo7cIeOVdk3PTjmFsS/5LBxP8fjdjkd2aLIZ4y5aWIFwsHzmWBw== =e+qJ -----END PGP SIGNATURE----- From yebo at psg.sk Wed Jan 8 10:23:35 2014 From: yebo at psg.sk (Troton_admin) Date: Wed, 8 Jan 2014 09:23:35 +0100 Subject: [Dovecot] nfs flush/fsync config settings problem Message-ID: <201401080923.35386.yebo@psg.sk> Hi, I need to place a maildir storage on a NFS filesystem, so I set up the config like this: mmap_disable = yes mail_nfs_storage = yes mail_nfs_index = yes mail_fsync = always lock_method = dotlock (also tried fcntl - local lockd is running, no success, now using dotlock, to be sure while debugging) The problem is that Dovecot (2.2.9/2.2.10 - the relevant code in mail-index.c is the same) logs a fatal error and quits the session (no daemon crash/coredump). Jan 07 14:13:31 auth: Debug: client in: AUTH 1 PLAIN service=pop3 session=fRCRJGHvbADDUKU9 lip=192.168.100.102 rip=IP_ADDR lport=1110 rport=48236 resp=AHRyb3RvbjEAdHJvdG9uMQ== (previous base64 data may contain sensitive data) Jan 07 14:13:31 auth: Debug: passwd-file(troton1,IP_ADDR,): lookup: user=troton1 file=/usr/local/etc/dovecot/passwd-file Jan 07 14:13:31 auth: Debug: client passdb out: OK 1 user=troton1 Jan 07 14:13:31 auth: Debug: master in: REQUEST 1289355265 29049 1 4f9fdd9e4069fa503e8e6bcc09d4cf30 session_pid=29089 Jan 07 14:13:31 auth: Debug: passwd-file(troton1,IP_ADDR,): lookup: user=troton1 file=/usr/local/etc/dovecot/passwd-file Jan 07 14:13:31 auth: Debug: master userdb out: USER 1289355265 troton1 uid=81 gid=81 home=/home/troton1 mail=maildir:~/Maildir Jan 07 14:13:31 pop3-login: Info: Login: user=, method=PLAIN, rip=IP_ADDR, lip=192.168.100.102, mpid=29089, session= Jan 07 14:13:31 pop3: Debug: Added userdb setting: mail=maildir:~/Maildir Jan 07 14:13:31 pop3(troton1): Debug: Effective uid=81, gid=81, home=/home/troton1 Jan 07 14:13:31 pop3(troton1): Debug: Namespace inbox: type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir Jan 07 14:13:31 pop3(troton1): Debug: maildir++: root=/home/troton1/Maildir, index=, indexpvt=, control=, inbox=/home/troton1/Maildir, alt= Jan 07 14:13:31 pop3(troton1): Info: DEBUG1: fsync_mode=2 , mask=0 Jan 07 14:13:31 pop3(troton1): Info: DEBUG2: fsync_mode=2 flags=85 Jan 07 14:13:31 pop3(troton1): Debug: Namespace : Using permissions from /home/troton1/Maildir: mode=0700 gid=default Jan 07 14:13:31 pop3(troton1): Info: DEBUG2: fsync_mode=0 flags=85 The user/passdb is just a plaintext file, for debugging purposes. But what is strange, the messages system log shows: Jan 7 14:13:31 mailhub2 dovecot: pop3(troton1): Fatal: nfs flush requires mail_fsync=always That is obviously wrong, even its own doveconf -n utility shows the correct value. # doveconf -n | grep -E 'sync|nfs' mail_fsync = always mail_nfs_index = yes mail_nfs_storage = yes maildir_very_dirty_syncs = yes Affected code seems to be in the lib-index/mail-index.c file, mail_index_file function - around line 585 : // my custom debug line i_info("DEBUG2: fsync_mode=%u flags=%u", (unsigned int)(index->fsync_mode),(unsigned int)flags); if ((flags & MAIL_INDEX_OPEN_FLAG_NFS_FLUSH) != 0 && index->fsync_mode != FSYNC_MODE_ALWAYS) i_fatal("nfs flush requires mail_fsync=always"); The first time it sees fsync_mode=2 (which is correct value of FSYNC_MODE_ALWAYS), but next function call is with index->fsync_mode=0 and an error is raised, see the logfile above. Dovecot correctly creates its working files in user's home directory - dovecot-uidlist, dovecot-uidvalidity, dovecot-uidvalidity.52cbfd7b, dovecot.index.log . The complete (testing, not production) doveconf -n is: == # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 7.3-RELEASE-p3 amd64 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = sha1 default_process_limit = 200 disable_plaintext_auth = no first_valid_uid = 81 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep info_log_path = /var/log/dovecot.log last_valid_uid = 81 listen = 192.168.100.102 lock_method = dotlock mail_debug = yes mail_fsync = always mail_gid = 81 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_prefetch_count = 5 mail_uid = 81 mailbox_list_index = yes maildir_stat_dirs = yes maildir_very_dirty_syncs = yes mmap_disable = yes namespace inbox { inbox = yes location = mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . type = private } passdb { args = scheme=plain username_format=%n /usr/local/etc/dovecot/passwd-file driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid subject size } pop3_enable_last = yes pop3_save_uidl = yes protocols = imap pop3 service doveadm { inet_listener { port = 9292 } } service imap-login { inet_listener imap { port = 1143 } } service imap { process_limit = 250 } service pop3-login { inet_listener pop3 { port = 1110 } } service pop3 { process_limit = 200 } ssl = no userdb { args = username_format=%n /usr/local/etc/dovecot/passwd-file default_fields = uid=81 gid=0 home=/home/%n driver = passwd-file } protocol imap { mail_max_userip_connections = 5 } protocol pop3 { mail_max_userip_connections = 5 } == OS: 7.3-RELEASE-p3 FreeBSD 7.3-RELEASE-p3 #1 amd64 Affected Dovecot version: 2.2.9, 2.2.10 How to repeat: Anytime I enter the correct username/pass pair And I tried to place the homedir on a local disk too, and I got the same error as on NFS. Any ideas, what could possibly be wrong ? Is it a feature or a bug ? Thanks for your help. Regards, Troton From megodin at inboxalias.com Wed Jan 8 13:32:09 2014 From: megodin at inboxalias.com (megodin at inboxalias.com) Date: Wed, 8 Jan 2014 06:32:09 -0500 (EST) Subject: [Dovecot] BUG report: doveadm HEADER when concatenating with another Search key Message-ID: Hey Joseph! Thanks for testing. > I couldn't recreate this with 2.1.16. Also, my version of "doveadm > search" does not accept missing header patterns. Is this corroborated > by dumping out the header with this same search query? > > doveadm fetch -u exampleuser hdr SUBJECT Silvester \ > HEADER Return-Path someuser at example.com Yes, it's same phenomenon when dumping with fetch. Of course you can only test this properly when you really have some mails with corresponding existing Header fields. (You can also try out other HEADER fields, like Reply-To, References, X-Spam-Score or whatever - just look at some mail headers of your mails and try it with existing fields.) So E.g. When doing doveadm fetch -u exampleuser hdr SUBJECT Silvester HEADER Return-Path someuser at example.com it initially outputs 13 headers (same as when using with SUBJECT Silvester only) , when piping it to "grep -i 'Return-Path'" it even found only 3 out of 13 headers containing a Return-Path at all, 2 of them different than someuser at example.com - so SAME behaviour as with search. Maybe also relevant, as mail format I'm using sdbox (on a larger user base of 40.000 people). -- (relevant part) of dovecot -n # 2.2.5.5 (e5350245ad9b): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.23.2.el6.x86_64 x86_64 Red Hat Enterprise Linux Server release 6.4 (Santiago) nfs auth_cache_size = 100 M auth_cache_ttl = 10 mins auth_master_user_separator = * auth_mechanisms = plain login auth_username_format = %Ln auth_verbose = yes disable_plaintext_auth = no import_environment = TZ DEBUG_OUTOFMEM DOVECOT_HOSTDOMAIN listen = * lock_method = dotlock mail_fsync = always mail_home = /mnt/nfs/vmails/%u mail_location = sdbox:/mnt/nfs/vmails/%u/mail:ALT=/mnt/archivnfs/vmails/%u/mail mail_plugins = " quota fts fts_lucene" mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes service imap-login { process_limit = 200 process_min_avail = 8 service_count = 0 vsz_limit = 512 M } service imap { client_limit = 1 process_limit = 10000 } service pop3-login { process_limit = 200 process_min_avail = 8 } service pop3 { process_limit = 10000 } verbose_proctitle = yes protocol lda { mail_plugins = " quota fts fts_lucene sieve" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep mail_max_userip_connections = 50 mail_plugins = " quota fts fts_lucene imap_quota" } _________________________________________________________________ Send and receive anonymous emails to your inbox with InboxAlias. http://www.inboxalias.com From CMarcus at Media-Brokers.com Wed Jan 8 14:34:57 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 08 Jan 2014 07:34:57 -0500 Subject: [Dovecot] Question re: filesystem permissions In-Reply-To: <52CC4B82.1020203@Media-Brokers.com> References: <52CB10B5.4020904@Media-Brokers.com> <20140107134230.GA19855@nihlus.leuxner.net> <52CC098D.4040609@Media-Brokers.com> <20140107143058.GB19855@nihlus.leuxner.net> <52CC4B82.1020203@Media-Brokers.com> Message-ID: <52CD45F1.1020203@Media-Brokers.com> On 2014-01-07 1:46 PM, Charles Marcus wrote: >> Anyway this is the default for Dovecot quite some time, so reckon >> someone gave it a thought... > > *What* is the default. Are you saying all of the permissions I showed > are correct except the ones you mentioned? > > But most importantly - *where is this documented*??? For example... There is this wiki page: http://wiki2.dovecot.org/MailboxFormat/Maildir Scroll down to 'Directory Structure' - what dovecot wants/recommends for the filesystem permissions should be addressed right there. Then you also have: http://wiki2.dovecot.org/SharedMailboxes/Permissions As far as I can see, there are only two cases that need to be addressed: a) If dovecot runs as a single UID (ie, vmail), or b) If mail is delivered with each users UID (I guess the argument is it is more secure) The other consideration would be working with Shared Mailboxes, but again, the filesystem permissions should only need to be set one of two ways (depending on a or b above), then dovecot should be able to properly handle everything from there. In my opinion, this needs to be clarified quite a bit. Postfix and Mailman both have a utility to fix the filesystem permissions for the dirs they manage. I know they are not dovecot, but the argument is the same. Even without a utility to actually be able to fix the permissions based on the mode dovecot is running in, they should at least be fully documented. -- Best regards, Charles From basseed1 at outlook.com Wed Jan 8 14:36:24 2014 From: basseed1 at outlook.com (Marco Cusano) Date: Wed, 8 Jan 2014 13:36:24 +0100 Subject: [Dovecot] virtual mailboxes folder structure In-Reply-To: References: , Message-ID: Hi, I am trying to find a way to list my virtual mailboxes hiding the namespace prefix into my imap client. Fore example now my ?All? mailbox is listed under virtual/ as: Inbox Sent Drafts Spam Trash - virtual All I would like to list as this: Inbox Sent Drafts Spam Trash All This is my 10-mail.conf: http://pastebin.com/DumEbbmy and this is my 15-mailboxes.conf: http://pastebin.com/QFzWGzyC I thought that the list = children paramenter would do but it did not. Thank you From skdovecot at smail.inf.fh-brs.de Wed Jan 8 15:06:20 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 8 Jan 2014 14:06:20 +0100 (CET) Subject: [Dovecot] Question re: filesystem permissions In-Reply-To: <52CD45F1.1020203@Media-Brokers.com> References: <52CB10B5.4020904@Media-Brokers.com> <20140107134230.GA19855@nihlus.leuxner.net> <52CC098D.4040609@Media-Brokers.com> <20140107143058.GB19855@nihlus.leuxner.net> <52CC4B82.1020203@Media-Brokers.com> <52CD45F1.1020203@Media-Brokers.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 8 Jan 2014, Charles Marcus wrote: > On 2014-01-07 1:46 PM, Charles Marcus wrote: >>> Anyway this is the default for Dovecot quite some time, so reckon someone >>> gave it a thought... >> >> *What* is the default. Are you saying all of the permissions I showed are >> correct except the ones you mentioned? >> >> But most importantly - *where is this documented*??? When I read your message, I thought about it. But: Dovecot supports virtual and system users, there are POSIX ACLs a.s.o. There are several message storage backends. Each combination might have other "least permissions" or required ones. You can split the files across various file systems, by domain, by users, ... . I think, one can document a "rule of thumb" for some default installations, say virtual users with Maildir with indexes and control files in the same place, ... . Maybe to document the permissions for each mail storage is a great step already. In the end, there is just one rule: The uid/gid Dovecot runs under when accessing the files, must be able to do so. Timo did a great logging _descriptive_ messages, what permission is missing for which file. If you want to get the least permissions for your paritcular situation, you'll need to remove all permissions, perform any action your users are able to do, watch the log file, and add the missing ones. Kind regards, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUs1NTV3r2wJMiz2NAQJU8ggAtUAImb7xjkCJb84194MC5n4RtDkoUl7f 5N/gMWzzG5BjiLfPzGF9geJ8X9rSuG+a3EOSud76y5Ccm9qLT1ilcsbqcFyimQLc BAJyfmvZPzuD89Fv3BYWwOpNfVd4NLlYqCYx0nqcya6CWTF05qQJuJCzzxfD08Zo u1hg2WVe+h+6PvYibq/9GA/zLIOQTU7EWbRzxVhnwe6A4GOApJSbrwfHo0crxhyE jTMAb3lgZk7vukLLJ6yjq6lCX71c/Y0Z3ZIPFgmajtYSHNqOdnjLtwcYcy08Zga7 hNYkJo4GB9zbNEDTP8icxBFcs+IFGU7vYPiew1MyDIxlXjVN41TlGg== =VHQY -----END PGP SIGNATURE----- From CMarcus at Media-Brokers.com Wed Jan 8 15:32:32 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 08 Jan 2014 08:32:32 -0500 Subject: [Dovecot] Dovecot LDA/LMTP vs postfix virtual delivery agent and the x-original-to header In-Reply-To: References: <4F7D972A.8050406@Media-Brokers.com> <4F82DB22.2050201@Media-Brokers.com> Message-ID: <52CD5370.50503@Media-Brokers.com> On 2012-04-09 8:53 AM, Timo Sirainen wrote: > On 9.4.2012, at 15.50, Charles Marcus wrote: >>> LMTP adds a new Delivered-To: header when there is >>> a single RCPT TO. You can force a single RCPT TO from Postfix side by >>> setting lmtp_destination_recipient_limit=1. LMTP doesn't >>> add/remove/change X-Original-To: header. >> Ok, thanks Timo... but... >> >> Are you saying that this 'Delivered-To:' header can somehow be leveraged to provide the same info as the x-original-to header? > I guess X-Original-To is the same address as what Postfix sees as the original RCPT TO address before alias expansion and such? In that case, see my today's mail in Postfix list.. Hi Timo, I just tried to find your email from that day, but don't see it in the archives... Was this ever resolved (getting x-original-to support in LMTP, like it is for the LDA)? If not, since it seemed like it wasn't going to be much work, any chance you can revisit it soon? Thanks, -- Best regards, Charles From adi at ente.limmat.ch Wed Jan 8 16:09:35 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Wed, 08 Jan 2014 15:09:35 +0100 Subject: [Dovecot] LMTP with virtual and system users In-Reply-To: <52CBF15A.6090209@zid.tuwien.ac.at> References: <52BA8668.5000502@zid.tuwien.ac.at> <52BC10F6.7070306@ente.limmat.ch> <52C1319A.6070309@zid.tuwien.ac.at> <52C44F9B.5020609@ente.limmat.ch> <52CBF15A.6090209@zid.tuwien.ac.at> Message-ID: <52CD5C1F.8070703@ente.limmat.ch> Am 07.01.14 13:21 schrieb Philipp Kolmann: > I didn't want to have lda SUID root... Is this necessary? Exim calls the dovecot-lda as user $local_part and if you setup your mail storage to have the right permissions, this should work without SUID. But maybe I'm wrong; anyway in the wiki there is a section on how-to use LDA without setting the process SUIDed. http://wiki2.dovecot.org/LDA/Exim -> towards the end of the page Cheers, Adrian. From marc at perkel.com Wed Jan 8 18:24:03 2014 From: marc at perkel.com (Marc Perkel) Date: Wed, 08 Jan 2014 08:24:03 -0800 Subject: [Dovecot] Dovecot deliver into folder question In-Reply-To: References: <52CB1020.3070604@perkel.com> <52CB11A2.4020205@Media-Brokers.com> <52CB1332.2010208@perkel.com> Message-ID: <52CD7BA3.6020002@perkel.com> On 1/6/2014 11:28 PM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Mon, 6 Jan 2014, Marc Perkel wrote: > >> On 1/6/2014 12:27 PM, Charles Marcus wrote: >>> On 2014-01-06 3:20 PM, Marc Perkel wrote: >>>> If I want to user dovecot deliver into a folder that is not at the >>>> root level - how do I do that? How do I specify a folder in a folder? >>> >>> For *all* messages? Or for certain messages? >>> >>> Kind of an incomplete question. >>> >> >> Certain messages. I'm talking about the deliver utility - the -m option. >> >> Usage: dovecot-lda [-c ] [-a
] [-d ] >> [-p ] >> [-f ] [-m ] [-e] [-k] >> >> when specifying the mailbox - how do you specify a subfolder? Do you >> use a / separator? > > You have to experiment a bit. As far as I remember, there had been bug > reports in some versions that maybe a mixture of "/" and the > configured separator must be used, e.g. > > prefix = shared. > separator = . > > try: > - -m shared.sub1.sub2.sub3 > - -m shared.sub1/sub2/sub3 > - -m shared/sub1/sub2/sub3 > > When I used Dovecot LDA, the first variant worked. Yes - I tried that and it worked with the period. However I think if I weren't using maildir format it might have failed. There should be an official way to do this. From CMarcus at Media-Brokers.com Wed Jan 8 18:46:25 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 08 Jan 2014 11:46:25 -0500 Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: Message-ID: <52CD80E1.608@Media-Brokers.com> On 2014-01-07 9:20 PM, Greg Rivers wrote: > On Mon, 6 Jan 2014, I wrote: > >> I found this[1] thread that describes the same problem with >> dovecot-LDA, but the solution (add X-Original-To: header) has no >> effect with LMTP. >> >> My sendmail LMTP configuration: >> FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp') >> >> Sendmail's address test indicates that sendmail is providing >> user+detail to LMTP (see below). Except for this problem, dovecot, >> LMTP, and sieve are all working perfectly. Is there something I'm >> missing, or is this a bug? >> >> [1] http://dovecot.org/pipermail/dovecot/2012-July/136987.htm > It seems I was mistaken. By tracing the LMTP session between dovecot > and sendmail I found that sendmail does _not_ include the +detail in > RCPT TO:. I also determined that dovecot LMTP will in fact extract the > +detail from a X-Original-To: header, but only if one defines > lda_original_recipient_header. > > So for the archives, to get sieve's "envelope :detail ..." working > with sendmail and dovecot LMTP, do the following: > > 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf > > 2) Add the following rule to sendmail.mc to add a X-Original-To: > header to every message: > > LOCAL_CONFIG > H?${u}?X-Original-To: $u So... this is a hack to get x-original-to header support in LMTP... Hopefully Timo will see this and be able to fix this up so it supports it natively like the LDA does... -- Best regards, Charles From infoomatic at gmx.at Wed Jan 8 19:31:49 2014 From: infoomatic at gmx.at (Infoomatic) Date: Wed, 8 Jan 2014 18:31:49 +0100 (CET) Subject: [Dovecot] acl, shared folders In-Reply-To: References: , Message-ID: Hi, Thanks a lot for the reply! A simple location = mdbox:/var/lib/vmail/mail/%%u was the solution. (my tests before with INDEX files obviously broke some stuff, so I just created empty users and it worked as it should with my initial config) ? best regards, infoomatic ? Gesendet:?Dienstag, 07. Januar 2014 um 08:19 Uhr Von:?"Steffen Kaiser" An:?Infoomatic Cc:?dovecot at dovecot.org Betreff:?Re: [Dovecot] acl, shared folders -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 6 Jan 2014, Infoomatic wrote: > After spending quite some time to figure out how users can share folders I now hope someone of you could help me out. I am quite sure its just a stupid mistake/misunderstanding?... I am using Ubuntu 12.04 LTS with the shipped dovecot 2.0.19 I'm using v2.2, but it should apply to v2.0 as well. > This seems fine. ACLs look fine. > However, there is nothing listed in the account of user2. I think the > mistake is in the namespace configuration of "location" or "prefix" > ? > mail_home = /var/lib/vmail/home/%u > mail_location = mdbox:/var/lib/vmail/mail/%u > namespace { > ? inbox = yes > ? location = > ? prefix = > ? separator = / > ? type = private > } > namespace { > ? list = children > ? location = mdbox:/var/lib/vmail/mail/%%n/mailboxes/shared/%n > ? prefix = shared/%%n/ > ? separator = / > ? subscriptions = no > ? type = shared > } First note, that you use %u in the default location, but %n in the shared namespace definition. IMHO, you must stick to one, as only one is correct in your setup. Second, reread http://wiki2.dovecot.org/SharedMailboxes/Shared Say user1 is sharing to user2, then your second namespace tells Dovecot to look for user1's mailboxes in /var/lib/vmail/mail/user1/mailboxes/shared/user2, you most likely need to replicate the default mail_location there with %'s doubled. Then you must decide, where each user's INDEX and CONTROL information is stored, or if flags are shared as well. - From your current definition I would say, you need: location = mdbox:/var/lib/vmail/mail/%%u:INDEX=~/shared/%%u First part points to the directory of the user sharing the mailboxes, INDEX= places user-specific files of the user accessing shared mailboxes into his/her own hierarchie. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUsuqhV3r2wJMiz2NAQK+lAgAu46HGrSz3h8JGGM7hJpLHsuDkypHD8Xr ThbicfUC5CVOBk1xs3FkXM1gDecb8820f6JrDSe24slg6Lf7WWPdZdGEzc4f0Dnr btL4+ePrRrI+UyuRXtmm7hZu6JaUwJj+h8AOmpzg+swJokHWUGkY73vcFri+O2bt Dfd+HbZqmuCjJ+aauLKclEEGCQ45JHKC/LavxnBFPix48PoCEOrfaVrC3R9mFjGD 7CJbzgi2T2xJIdYzl+pvFRgEu8aT6AtgQo+4BE51PaLz/8XUE4NX5usV/kcLgu9O iz5VQcgKXFFoJ1HD37kcwNVkkAx67yDTVdDyLgvH9j0CYBpvnxDM4g== =WVlL -----END PGP SIGNATURE----- From CMarcus at Media-Brokers.com Wed Jan 8 19:52:09 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 08 Jan 2014 12:52:09 -0500 Subject: [Dovecot] Disallow certain characters in foldernames? Message-ID: <52CD9049.1060000@Media-Brokers.com> Is there a way to do this in dovecot? Similar to how you can When using Maildir and Thunderbird, if a user tries to a create folder named "test.1" or "test/1", dovecot will happily create a folder called "test", with a subfolder called "1". Worse, the top level folder "test" is greyed out, which is how Thunderbird displays a folder that can contain only other folders, not both folders and files. I want to disallow this. Obviously I'd prefer if Thunderbird would display a meaningful error, but most likely dovecot cannot control that. I don't really care if the user just gets some kind of weird generic error or not, I'd just prefer to prevent dovecot from creating the problematic folders, and explain the problem to the user if/when they call about it (after NOT reading my carefully crafted documentation explaining the illegal characters that cannot be used in foldernames). -- Best regards, Charles From rs at sys4.de Wed Jan 8 20:06:41 2014 From: rs at sys4.de (Robert Schetterer) Date: Wed, 08 Jan 2014 19:06:41 +0100 Subject: [Dovecot] Disallow certain characters in foldernames? In-Reply-To: <52CD9049.1060000@Media-Brokers.com> References: <52CD9049.1060000@Media-Brokers.com> Message-ID: <52CD93B1.3010407@sys4.de> Am 08.01.2014 18:52, schrieb Charles Marcus: > Is there a way to do this in dovecot? Similar to how you can > > When using Maildir and Thunderbird, if a user tries to a create folder > named "test.1" or "test/1", dovecot will happily create a folder called > "test", with a subfolder called "1". > > Worse, the top level folder "test" is greyed out, which is how > Thunderbird displays a folder that can contain only other folders, not > both folders and files. > > I want to disallow this. Obviously I'd prefer if Thunderbird would > display a meaningful error, but most likely dovecot cannot control that. > > I don't really care if the user just gets some kind of weird generic > error or not, I'd just prefer to prevent dovecot from creating the > problematic folders, and explain the problem to the user if/when they > call about it (after NOT reading my carefully crafted documentation > explaining the illegal characters that cannot be used in foldernames). > what about, let the user create such folders http://wiki2.dovecot.org/Plugins/Listescape Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From CMarcus at Media-Brokers.com Wed Jan 8 20:35:15 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 08 Jan 2014 13:35:15 -0500 Subject: [Dovecot] Disallow certain characters in foldernames? In-Reply-To: <52CD93B1.3010407@sys4.de> References: <52CD9049.1060000@Media-Brokers.com> <52CD93B1.3010407@sys4.de> Message-ID: <52CD9A63.7080809@Media-Brokers.com> On 2014-01-08 1:06 PM, Robert Schetterer wrote: > Am 08.01.2014 18:52, schrieb Charles Marcus: >> >Is there a way to do this in dovecot? Similar to how you can >> > >> >When using Maildir and Thunderbird, if a user tries to a create folder >> >named "test.1" or "test/1", dovecot will happily create a folder called >> >"test", with a subfolder called "1". >> > >> >Worse, the top level folder "test" is greyed out, which is how >> >Thunderbird displays a folder that can contain only other folders, not >> >both folders and files. >> > >> >I want to disallow this. Obviously I'd prefer if Thunderbird would >> >display a meaningful error, but most likely dovecot cannot control that. >> > >> >I don't really care if the user just gets some kind of weird generic >> >error or not, I'd just prefer to prevent dovecot from creating the >> >problematic folders, and explain the problem to the user if/when they >> >call about it (after NOT reading my carefully crafted documentation >> >explaining the illegal characters that cannot be used in foldernames). > what about, let the user create such folders > > http://wiki2.dovecot.org/Plugins/Listescape Thanks Robert - I did see that and considered asking about it... So, would this be as easy as just adding: mail_plugins = $mail_plugins listescape namespace private { separator = $ inbox = yes } Or whatever I want to use for the separator (I was thinking maybe either the tilde (~) or the backtick (`), since I don't think anyone would ever use one of those... Also - if someone *did* use whatever character was specified - what would happen? The same thing as happens now if they use a '.' or '/'? Thanks again Charles From gcr+dovecot at tharned.org Wed Jan 8 21:27:12 2014 From: gcr+dovecot at tharned.org (Greg Rivers) Date: Wed, 8 Jan 2014 13:27:12 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: <52CD80E1.608@Media-Brokers.com> References: <52CD80E1.608@Media-Brokers.com> Message-ID: On Tue, 7 Jan 2014, Sean Kamath wrote: > Glad to know my "for the archives" message(*) helped. :-) > Indeed it did. Thanks! I was surprised to find that sendmail does not pass +detail during LMTP, even though the default EnvToL rewrite rule declared in the local LMTP mailer definition preserves it. This was my first dovecot setup, so I didn't realize at first that the lda_original_recipient_header in the LDA config file would also take effect for LMTP. Once I figured that out, it was a simple matter to use your LOCAL CONFIG rule to have sendmail add the requisite header. On Wed, 8 Jan 2014, Charles Marcus wrote: > So... this is a hack to get x-original-to header support in LMTP... > > Hopefully Timo will see this and be able to fix this up so it supports > it natively like the LDA does... > Given that LMTP does in fact parse X-Original-To (or any other header of your choice) when lda_original_recipient_header is defined, I think one would say that dovecot LMTP does already support this natively. So it's not really a hack, it's just a matter of setting the dovecot config variable and ensuring that the MTA adds the corresponding header to each message. -- Greg Rivers From CMarcus at Media-Brokers.com Wed Jan 8 21:34:45 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Wed, 08 Jan 2014 14:34:45 -0500 Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: <52CD80E1.608@Media-Brokers.com> Message-ID: <52CDA855.2030906@Media-Brokers.com> On 2014-01-08 2:27 PM, Greg Rivers wrote: > Given that LMTP does in fact parse X-Original-To (or any other header > of your choice) when lda_original_recipient_header is defined, I think > one would say that dovecot LMTP does already support this natively. > > So it's not really a hack, it's just a matter of setting the dovecot > config variable and ensuring that the MTA adds the corresponding > header to each message. Ok, cool... so... if I am getting the header right now, using the dovecot LDA, then obviously the MTA is adding it. Last question on this then - can I add this, then take my time switching from the LDA to LMTP? Or would enabling it while stll using the LDA cause an issue somehow, and I should wait and only enable it after switching to LMTP? Thanks, Charles From rs at sys4.de Wed Jan 8 21:37:32 2014 From: rs at sys4.de (Robert Schetterer) Date: Wed, 08 Jan 2014 20:37:32 +0100 Subject: [Dovecot] Disallow certain characters in foldernames? In-Reply-To: <52CD9A63.7080809@Media-Brokers.com> References: <52CD9049.1060000@Media-Brokers.com> <52CD93B1.3010407@sys4.de> <52CD9A63.7080809@Media-Brokers.com> Message-ID: <52CDA8FC.4050707@sys4.de> Am 08.01.2014 19:35, schrieb Charles Marcus: > On 2014-01-08 1:06 PM, Robert Schetterer wrote: >> Am 08.01.2014 18:52, schrieb Charles Marcus: >>> >Is there a way to do this in dovecot? Similar to how you can >>> > >>> >When using Maildir and Thunderbird, if a user tries to a create folder >>> >named "test.1" or "test/1", dovecot will happily create a folder called >>> >"test", with a subfolder called "1". >>> > >>> >Worse, the top level folder "test" is greyed out, which is how >>> >Thunderbird displays a folder that can contain only other folders, not >>> >both folders and files. >>> > >>> >I want to disallow this. Obviously I'd prefer if Thunderbird would >>> >display a meaningful error, but most likely dovecot cannot control >>> that. >>> > >>> >I don't really care if the user just gets some kind of weird generic >>> >error or not, I'd just prefer to prevent dovecot from creating the >>> >problematic folders, and explain the problem to the user if/when they >>> >call about it (after NOT reading my carefully crafted documentation >>> >explaining the illegal characters that cannot be used in foldernames). > >> what about, let the user create such folders >> >> http://wiki2.dovecot.org/Plugins/Listescape > > Thanks Robert - I did see that and considered asking about it... > > So, would this be as easy as just adding: > > mail_plugins = $mail_plugins listescape > > namespace private { > separator = $ > inbox = yes > } as written in the wiki this should work my setup is different so i did not test that, i only needed Allow '.' characters with Maildir++, cause i wanted to autocreate folders with sieve for mail adresses like man.human at example.com in an archive setup http://sys4.de/de/blog/2013/02/07/mailarchiv-mit-dovecot-und-postfix-sortiert-nach-datum-mailadressen-und-ein-ausgehend-unterordnern/ > > Or whatever I want to use for the separator (I was thinking maybe either > the tilde (~) or the backtick (`), since I don't think anyone would ever > use one of those... > > Also - if someone *did* use whatever character was specified - what > would happen? The same thing as happens now if they use a '.' or '/'? i dont know exactly, but usally as written in the wiki the only ones you should need to take care of are '.' and '/' are very commonly used and should work everywhere '\' is used by Exchange, and should also work everywhere (when specifying this in the separator= setting it must be quoted, so one sets separator = "\\") '^' is used internally by Thunderbird and causes some trouble with it > > Thanks again > > Charles > be aware in some version stages of 2.1.x the plugin was broken, dont no its status in 2.2.x , it works with 2.1.17 in my latest tests Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From miquels at cistron.nl Wed Jan 8 22:12:19 2014 From: miquels at cistron.nl (Miquel van Smoorenburg) Date: Wed, 08 Jan 2014 21:12:19 +0100 Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: <52CD80E1.608@Media-Brokers.com> References: <52CD80E1.608@Media-Brokers.com> Message-ID: <52CDB123.7040408@cistron.nl> On 8-01-14 5:46 PM, Charles Marcus wrote: > On 2014-01-07 9:20 PM, Greg Rivers wrote: >> So for the archives, to get sieve's "envelope :detail ..." working >> with sendmail and dovecot LMTP, do the following: >> >> 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf >> >> 2) Add the following rule to sendmail.mc to add a X-Original-To: >> header to every message: >> >> LOCAL_CONFIG >> H?${u}?X-Original-To: $u This probably only works if there is exactly one RCPT TO in the LMTP session. If there are multiple recipients, sendmail cannot add that header. What should it contain? So you have to limit sendmail to max. one recipient per LMTP session. Hopefully you don't use SIS. Mike. From gcr+dovecot at tharned.org Wed Jan 8 22:54:36 2014 From: gcr+dovecot at tharned.org (Greg Rivers) Date: Wed, 8 Jan 2014 14:54:36 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: <52CDB123.7040408@cistron.nl> References: <52CD80E1.608@Media-Brokers.com> <52CDB123.7040408@cistron.nl> Message-ID: On Wed, 8 Jan 2014, Miquel van Smoorenburg wrote: > On 8-01-14 5:46 PM, Charles Marcus wrote: >> On 2014-01-07 9:20 PM, Greg Rivers wrote: >>> So for the archives, to get sieve's "envelope :detail ..." working >>> with sendmail and dovecot LMTP, do the following: >>> >>> 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf >>> >>> 2) Add the following rule to sendmail.mc to add a X-Original-To: >>> header to every message: >>> >>> LOCAL_CONFIG >>> H?${u}?X-Original-To: $u > > This probably only works if there is exactly one RCPT TO in the LMTP > session. If there are multiple recipients, sendmail cannot add that > header. What should it contain? > > So you have to limit sendmail to max. one recipient per LMTP session. > Hopefully you don't use SIS. > That's a really good point I hadn't considered. Even without this complication, it would obviously be better to have sendmail provide user+deatil via RCPT TO during LMTP. But I don't know to accomplish that. Does anyone else know? -- Greg From gcr at tharned.org Wed Jan 8 22:30:51 2014 From: gcr at tharned.org (Greg Rivers) Date: Wed, 8 Jan 2014 14:30:51 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: <52CDA855.2030906@Media-Brokers.com> References: <52CD80E1.608@Media-Brokers.com> <52CDA855.2030906@Media-Brokers.com> Message-ID: On Wed, 8 Jan 2014, Charles Marcus wrote: > On 2014-01-08 2:27 PM, Greg Rivers wrote: >> Given that LMTP does in fact parse X-Original-To (or any other header >> of your choice) when lda_original_recipient_header is defined, I think >> one would say that dovecot LMTP does already support this natively. >> >> So it's not really a hack, it's just a matter of setting the dovecot >> config variable and ensuring that the MTA adds the corresponding header >> to each message. > > Ok, cool... so... if I am getting the header right now, using the > dovecot LDA, then obviously the MTA is adding it. > > Last question on this then - can I add this, then take my time switching > from the LDA to LMTP? Or would enabling it while stll using the LDA > cause an issue somehow, and I should wait and only enable it after > switching to LMTP? > If I understand you correctly, you're saying that LDA parses X-Original-To even without having the lda_original_recipient_header variable set. If that's the case, I'd think that setting "lda_original_recipient_header = X-Original-To" would be a NOOP as far as LDA is concerned, and you could transition to LMTP at your leisure. -- Greg Rivers From jtam.home at gmail.com Thu Jan 9 05:24:25 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 8 Jan 2014 19:24:25 -0800 (PST) Subject: [Dovecot] BUG report: doveadm HEADER when concatenating with another Search key In-Reply-To: References: Message-ID: > So E.g. When doing > doveadm fetch -u exampleuser hdr SUBJECT Silvester HEADER > Return-Path someuser at example.com > > it initially outputs 13 headers (same as when using with SUBJECT Silvester > only) , when piping it to "grep -i 'Return-Path'" it even found only 3 out > of 13 headers containing a Return-Path at all, 2 of them different than > someuser at example.com - so SAME behaviour as with search. I tried using logical conjections of header searches and it works with my installation of dovecot, so either it's a bug introduced later than 2.1.16, or perhaps it from the different search engine you use (I use the default that comes with dovecot -- squat?). Sorry, can't help you out further. Joseph Tam From marc at perkel.com Thu Jan 9 09:22:20 2014 From: marc at perkel.com (Marc Perkel) Date: Wed, 08 Jan 2014 23:22:20 -0800 Subject: [Dovecot] [OT] cool bash script for cron with seconds resolution Message-ID: <52CE4E2C.1020500@perkel.com> Short bash script to run a program 30 20 15 12 10 6 5 4 3 2 executions per minute. http://wiki.junkemailfilter.com/index.php/How_to_run_a_Linux_script_every_few_seconds_under_cron From skdovecot at smail.inf.fh-brs.de Thu Jan 9 09:27:45 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 9 Jan 2014 08:27:45 +0100 (CET) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 7 Jan 2014, Greg Rivers wrote: > On Mon, 6 Jan 2014, I wrote: >> I found this[1] thread that describes the same problem with dovecot-LDA, >> but the solution (add X-Original-To: header) has no effect with LMTP. >> >> My sendmail LMTP configuration: >> FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp') >> >> Sendmail's address test indicates that sendmail is providing user+detail to >> LMTP (see below). Except for this problem, dovecot, LMTP, and sieve are >> all working perfectly. Is there something I'm missing, or is this a bug? >> >> [1] http://dovecot.org/pipermail/dovecot/2012-July/136987.htm >> > > It seems I was mistaken. By tracing the LMTP session between dovecot and > sendmail I found that sendmail does _not_ include the +detail in RCPT TO:. I > also determined that dovecot LMTP will in fact extract the +detail from a > X-Original-To: header, but only if one defines lda_original_recipient_header. > > So for the archives, to get sieve's "envelope :detail ..." working with > sendmail and dovecot LMTP, do the following: > > 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf > > 2) Add the following rule to sendmail.mc to add a X-Original-To: header to > every message: > > LOCAL_CONFIG > H?${u}?X-Original-To: $u First: This won't work, if the message has two or more recipients, $u is empty then. Do you serialize messages per recipient? Second: My Debian sendmail v8.14.4 does pass +detail to LMTP. Mlocal, P=[IPC], F=lsDFMAw5:/|@qPSXnz9, S=EnvFromSMTP/HdrFromL, R=EnvToL/HdrToL, T=DNS/RFC822/SMTP, A=FILE /var/run/dovecot2.2/lmtp looks like just: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot2.2/lmtp')dnl of my mc-file effects it. The use of forwarding, aliases or virtuser table might strip the detail, you need to do explicitly preserve the +detail with those. Retry with a recipient without any rewriting and from the local host. echo TEST | sendmail -v recpient+detail at yourdomain.tld Received: from ux-2s11.inf.fh-bonn-rhein-sieg.de by ux-2s11.inf.fh-bonn-rhein-sieg.de (Dovecot) with LMTP id aC4NEHRMzlK7dgAALie3fw for ; Thu, 09 Jan 2014 08:15:00 +0100 - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUs5PcV3r2wJMiz2NAQI7PAf/WeQTTHBiXpV+aEHDm2/xkL/oVhyU6i3V iBie5ArGDDTQYN2ga8fvYG6AMnlSJbWIH2jpf5sGIcqsuq89FWDZvt5vPZ7TXVHC uUvIDEotU2pPvXqvs5bsWvdDMkAWT4Cjx2EFn07NZJyPo8tRZhqh8vkUgU7JzIIR Zf3u3lqq+CdHD46QeDpi47yrYglgbO/K1rXdmXcLL8MYKbaPmG6nRd6ea0rPyRd4 vKGrTF1Q6YyabyrbvcFdsM2DHM4gO48g1QsfIG0M/nCjihMKMMizuB9U2IaxnRqy 2WtOMXspECaokRzSXuWSJ9dancKkI6hJB9JJIv0vUXIXAg/j9guE9w== =iBfY -----END PGP SIGNATURE----- From adi at ente.limmat.ch Thu Jan 9 14:27:03 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Thu, 09 Jan 2014 13:27:03 +0100 Subject: [Dovecot] imap auto create mailbox: we're not in group 8(mail) Message-ID: <52CE9597.4020303@ente.limmat.ch> Dear List Somehow I don't understand the intended work flow to have new mailboxes auto created. On login of a new user with no mailbox, I get 2014-01-09 12:53:06 imap(tester): Error: user tester: Initialization failed: Namespace '': mkdir(/var/mail/tester) failed: Permission denied (euid=1016(tester) egid=1016(tester) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0771) The imap process runs as the user the login performed and thus it has only the privileges of that user. This is good and desired, when a mailbox already exists. I do not want to allow all users to write to /var/mail, only they should write to their dirs inside /var/mail. Same story for LMTP, if no mailbox exists yet: 2014-01-09 13:01:47 lmtp(20416, tester): Error: user tester: Initialization failed: Namespace '': mkdir(/var/mail/tester) failed: Permission denied (euid=1016(tester) egid=1016(tester) missing +w perm: /var/mail, we're not in group 8(mail), dir owned by 0:8 mode=0771) How can I configure the auto create mailbox feature that it works and let run LMTP and IMAP process as user %u and group mail and let create the mailboxes in /var/mail as (example user tester) with the following permissions: /var/mail: drwxrwx--x root mail 3072 Dec 18 01:43 . drwx------ tester tester 1024 Jan 09 12:53 tester ...or do I need a different approach? Thank you for helping me. Best regards, Adrian. My setup: ======== * Exim delivers to LMTP socket as user %u, group mail * maildir storage in /var/mail doveconf -n: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.3 ext3 auth_cache_negative_ttl = 0 auth_cache_size = 5 M auth_cache_ttl = 4 hours auth_failure_delay = 3 secs auth_mechanisms = plain login digest-md5 cram-md5 apop rpa auth_username_format = %n auth_verbose = yes auth_worker_max_count = 128 first_valid_gid = 1000 first_valid_uid = 1000 last_valid_gid = 60000 last_valid_uid = 60000 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_location = maildir:/var/mail/./%u/:INDEX=MEMORY mail_prefetch_count = 1024 maildir_stat_dirs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave vacation-seconds namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = scheme=SHA512-CRYPT username_format=%u /etc/cram-md5.pwd driver = passwd-file } plugin { sieve = /var/mail/%u/sieve/.dovecot.sieve sieve_before = /var/mail/%u/sieve/vacation.sieve sieve_dir = /var/mail/%u/sieve sieve_extensions = +vacation +vacation-seconds sieve_max_actions = 1024 sieve_vacation_default_period = 12d sieve_vacation_max_period = 0 sieve_vacation_min_period = 1d } postmaster_address = postmaster at XXXX protocols = " imap lmtp sieve pop3" service auth-worker { user = $default_login_user } service auth { group = mail-security unix_listener auth-client { mode = 0660 user = Debian-exim } unix_listener auth-userdb { mode = 0666 } user = $default_internal_user } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 5 } service lmtp { process_min_avail = 10 unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 vsz_limit = 64 M } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3 { process_limit = 256 } ssl_cert = References: <52CE9597.4020303@ente.limmat.ch> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 9 Jan 2014, Adrian Zaugg wrote: > Somehow I don't understand the intended work flow to have new mailboxes > auto created. On login of a new user with no mailbox, I get > > 2014-01-09 12:53:06 imap(tester): Error: user tester: Initialization > failed: Namespace '': mkdir(/var/mail/tester) failed: Permission denied > (euid=1016(tester) egid=1016(tester) missing +w perm: /var/mail, we're > not in group 8(mail), dir owned by 0:8 mode=0771) The errors says all. 1) See: # Group to enable temporarily for privileged operations. Currently this is # used only with INBOX when either its initial creation or dotlocking fails. # Typically this is set to "mail" to give access to /var/mail. #mail_privileged_group = # Grant access to these supplementary groups for mail processes. Typically # these are used to set up access to shared mailboxes. Note that it may be # dangerous to set these if users can create symlinks (e.g. if "mail" group is # set here, ln -s /var/mail ~/mail/var could allow a user to delete others' # mailboxes, or ln -s /secret/shared/box ~/mail/mybox would allow reading it). #mail_access_groups = 2) chmod 1777 /var/mail 3) pre-create your user dirs - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUs6X0F3r2wJMiz2NAQJpBQf/QKVG5bMRpWC6U2X+IhTzN+QjIAonsVuY KMyyDkFSvDAr+8eBqek7/H/ijUhyaTQZsbZ7ftYYIqQs5ZgFSZNURhbcuJLd8Y6+ OwXX1uCshQg63hYUpsfJsQiAoQ6vxdw2wFgLFUGjASBcXtiI9BtzLObOZMgfhCzT pqsMOWoIjM9BBQt/u5r4JM/3LJccFnVP4yAn8Wmq73Yu3ozw5L+9eMGjm/NnpT3B 62wuhgqY9p3GxenWvnHN/BgfYsWNrBN9E2AKlDmFainUC7lNZD8YeB64oj0KWxz5 tlQiEKia5xMB2WsUPpEhOHOYTfh7vq0Qm0Sxw3DdhWIZnr/DVru84A== =Z2z1 -----END PGP SIGNATURE----- From adi at ente.limmat.ch Thu Jan 9 17:49:26 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Thu, 09 Jan 2014 16:49:26 +0100 Subject: [Dovecot] imap auto create mailbox: we're not in group 8(mail) In-Reply-To: References: <52CE9597.4020303@ente.limmat.ch> Message-ID: <52CEC506.1050808@ente.limmat.ch> Hi Steffen Am 09.01.14 13:36 schrieb Steffen Kaiser: > The errors says all. Almost ... If I understand you correctly, I can chose one of the three options you presented to me, right? If so, 3) I did until now. 2) no way. To 1): I now set mail_privileged_group = mail drwxrwx--x 94 root mail 3072 Dec 18 01:43 /var/mail But I still get the same error. The LMTP and the IMAP process do still get executed under group %u, when they try to create the mailbox. What's wrong? Thank you for your help! Best regards, Adrian. > > 1) See: > # Group to enable temporarily for privileged operations. Currently this is > # used only with INBOX when either its initial creation or dotlocking > fails. > # Typically this is set to "mail" to give access to /var/mail. > #mail_privileged_group = > > # Grant access to these supplementary groups for mail processes. Typically > # these are used to set up access to shared mailboxes. Note that it may be > # dangerous to set these if users can create symlinks (e.g. if "mail" > group is > # set here, ln -s /var/mail ~/mail/var could allow a user to delete others' > # mailboxes, or ln -s /secret/shared/box ~/mail/mybox would allow > reading it). > #mail_access_groups = > > 2) chmod 1777 /var/mail > > 3) pre-create your user dirs From eliezer at ngtech.co.il Thu Jan 9 18:01:21 2014 From: eliezer at ngtech.co.il (Eliezer Croitoru) Date: Thu, 09 Jan 2014 18:01:21 +0200 Subject: [Dovecot] LDA quota rejection In-Reply-To: <1379819819.5593.20.camel@tardis> References: <523D5DF9.2000504@mail.cgilfe.it> <1379819819.5593.20.camel@tardis> Message-ID: <52CEC7D1.2010304@ngtech.co.il> The basic mail systems do need this option.. We are not talking about plain mail.. Once a message was dropped or was not delivered there is a need to know that it was not sent or received. While some will separate internal mail from external it's their preference but once I send an email to a company I would like to know that my system and their system is working properly. In a case that the company do not want to reveal it's computing resources to the outer world it's a matter of security and other policies rather then basic email policies. I do remember that in real mail once the recipient box did not got the mail it was sent back to the original sender as it was paid for this service. Eliezer On 22/09/13 06:16, Noel Butler wrote: > Dovecot should never generate a message to send to sender, this is > classified as backscatter. > Your MTA should get the quota answer from dovecot when the sender > connects, and tries to mail and fail then, it is the MTA (maillog file) > you need to look at to see why your MTA is not tempfailing the > connection. From gcr+dovecot at tharned.org Fri Jan 10 01:25:39 2014 From: gcr+dovecot at tharned.org (Greg Rivers) Date: Thu, 9 Jan 2014 17:25:39 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: Message-ID: On Thu, 9 Jan 2014, Steffen Kaiser wrote: > On Tue, 7 Jan 2014, Greg Rivers wrote: > >> [snip] >> >> So for the archives, to get sieve's "envelope :detail ..." working with >> sendmail and dovecot LMTP, do the following: >> >> 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf >> >> 2) Add the following rule to sendmail.mc to add a X-Original-To: header to >> every message: >> >> LOCAL_CONFIG >> H?${u}?X-Original-To: $u > > First: This won't work, if the message has two or more recipients, $u is > empty then. > Right. Miquel van Smoorenburg pointed that out too earlier in this thread. > Do you serialize messages per recipient? > Yes, to mitigate this issue, I plan to enforce one recipient per LMTP session with: define(`LOCAL_MAILER_MAXMSGS', `1'). This will result in adding "m=1" to the local mailer definition. But I'd really rather have +detail passed via LMTP. > Second: My Debian sendmail v8.14.4 does pass +detail to LMTP. > > Mlocal, P=[IPC], F=lsDFMAw5:/|@qPSXnz9, S=EnvFromSMTP/HdrFromL, > R=EnvToL/HdrToL, > T=DNS/RFC822/SMTP, > A=FILE /var/run/dovecot2.2/lmtp > > looks like just: > > FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot2.2/lmtp')dnl > > of my mc-file effects it. > Now this is a really useful data point! I have exactly the same configuration on FreeBSD running sendmail v8.14.7: FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp') Mlocal, P=[IPC], F=lsDFMAw5:/|@qPSXmnz9, S=EnvFromSMTP/HdrFromL, R=EnvToL/HdrToL, T=DNS/RFC822/SMTP, A=FILE /var/run/dovecot/lmtp > The use of forwarding, aliases or virtuser table might strip the detail, you > need to do explicitly preserve the +detail with those. Retry with a recipient > without any rewriting and from the local host. > > echo TEST | sendmail -v recpient+detail at yourdomain.tld > > Received: from ux-2s11.inf.fh-bonn-rhein-sieg.de > by ux-2s11.inf.fh-bonn-rhein-sieg.de (Dovecot) with LMTP id > aC4NEHRMzlK7dgAALie3fw > for ; Thu, 09 Jan 2014 08:15:00 +0100 > I'm not using any aliases or virtuser table in my tests, yet my sendmail DOES NOT pass +detail to LMTP: $ echo TEST | sendmail -v gcr+detail at badger.tharned.org gcr+detail at badger.tharned.org... Connecting to [127.0.0.1] via relay... 220 badger.tharned.org ESMTP Sendmail 8.14.7/8.14.7; Thu, 9 Jan 2014 16:19:46 -0600 (CST) >>> EHLO badger.tharned.org 250-badger.tharned.org Hello localhost [127.0.0.1], pleased to meet you 250-ENHANCEDSTATUSCODES 250-PIPELINING 250-EXPN 250-VERB 250-8BITMIME 250-SIZE 250-DSN 250-ETRN 250-DELIVERBY 250 HELP >>> VERB 250 2.0.0 Verbose mode >>> MAIL From: SIZE=5 250 2.1.0 ... Sender ok >>> RCPT To: >>> DATA 250 2.1.5 ... Recipient ok 354 Enter mail, end with "." on a line by itself >>> . 050 ... Connecting to /var/run/dovecot/lmtp via local... 050 220 badger.tharned.org Dovecot ready. 050 >>> LHLO badger.tharned.org 050 250-badger.tharned.org 050 250-8BITMIME 050 250-ENHANCEDSTATUSCODES 050 250 PIPELINING 050 >>> MAIL From: 050 250 2.1.0 OK 050 >>> RCPT To: 050 >>> DATA 050 250 2.1.5 OK 050 354 OK 050 >>> . 050 250 2.0.0 OD97EoIgz1L04QAAwQnkQQ Saved 050 ... Sent 250 2.0.0 s09MJkLK057843 Message accepted for delivery gcr+detail at badger.tharned.org... Sent (s09MJkLK057843 Message accepted for delivery) Closing connection to [127.0.0.1] >>> QUIT 221 2.0.0 badger.tharned.org closing connection Return-Path: Delivered-To: Received: from badger.tharned.org by badger.tharned.org (Dovecot) with LMTP id OD97EoIgz1L04QAAwQnkQQ for ; Thu, 09 Jan 2014 16:19:46 -0600 Return-Path: Received: from badger.tharned.org (localhost [127.0.0.1]) by badger.tharned.org (8.14.7/8.14.7) with ESMTP id s09MJkLK057843 for ; Thu, 9 Jan 2014 16:19:46 -0600 (CST) (envelope-from gcr at badger.tharned.org) Received: by badger.tharned.org (8.14.7/8.14.7/Submit) id s09MJjbI057842 for gcr+detail at badger.tharned.org; Thu, 9 Jan 2014 16:19:45 -0600 (CST) (envelope-from gcr) Date: Thu, 9 Jan 2014 16:19:45 -0600 (CST) From: Greg Rivers Message-Id: <201401092219.s09MJjbI057842 at badger.tharned.org> To: undisclosed-recipients:; TEST So I clearly have a sendmail problem. Maybe there's been a regression in sendmail since 8.14.4, or there's some other platform specific issue. This gives me something to go on; thanks a lot for your feedback! -- Greg Rivers From jtam.home at gmail.com Fri Jan 10 01:54:35 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 9 Jan 2014 15:54:35 -0800 (PST) Subject: [Dovecot] imap auto create mailbox: we're not in group 8(mail) In-Reply-To: References: Message-ID: Adrian Zaugg writes: > How can I configure the auto create mailbox feature that it works and > let run LMTP and IMAP process as user %u and group mail and let create > the mailboxes in /var/mail as (example user tester) with the following > permissions: > > /var/mail: > > drwxrwx--x root mail 3072 Dec 18 01:43 . > drwx------ tester tester 1024 Jan 09 12:53 tester This is probably what you need: # Group to enable temporarily for privileged operations. Currently this is # used only with INBOX when either its initial creation or dotlocking fails. # Typically this is set to "mail" to give access to /var/mail. mail_privileged_group = mail > ...or do I need a different approach? You could also chmod 1777 /var/mail but this will allow arbitrary uses who have filesystem access to create their own files here, and maybe DoS a new user from being created (or maybe even anticipate a new mailbox, create one with mode 0777 and wait to intercept mail?). Joseph Tam From skdovecot at smail.inf.fh-brs.de Fri Jan 10 09:24:00 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 10 Jan 2014 08:24:00 +0100 (CET) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 9 Jan 2014, Greg Rivers wrote: > On Thu, 9 Jan 2014, Steffen Kaiser wrote: >> On Tue, 7 Jan 2014, Greg Rivers wrote: >> >>> [snip] >>> >>> So for the archives, to get sieve's "envelope :detail ..." working with >>> sendmail and dovecot LMTP, do the following: >>> >>> 1) Add "lda_original_recipient_header = X-Original-To" to 15-lda.conf >>> >>> 2) Add the following rule to sendmail.mc to add a X-Original-To: header to >>> every message: >>> >>> LOCAL_CONFIG >>> H?${u}?X-Original-To: $u >> >> Second: My Debian sendmail v8.14.4 does pass +detail to LMTP. >> >> Mlocal, P=[IPC], F=lsDFMAw5:/|@qPSXnz9, S=EnvFromSMTP/HdrFromL, >> R=EnvToL/HdrToL, >> T=DNS/RFC822/SMTP, >> A=FILE /var/run/dovecot2.2/lmtp >> >> looks like just: >> >> FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot2.2/lmtp')dnl >> >> of my mc-file effects it. >> > > Now this is a really useful data point! I have exactly the same > configuration on FreeBSD running sendmail v8.14.7: > > FEATURE(`local_lmtp',`[IPC]',`FILE /var/run/dovecot/lmtp') > > Mlocal, P=[IPC], F=lsDFMAw5:/|@qPSXmnz9, S=EnvFromSMTP/HdrFromL, > R=EnvToL/HdrToL, > T=DNS/RFC822/SMTP, > A=FILE /var/run/dovecot/lmtp > >> The use of forwarding, aliases or virtuser table might strip the detail, >> you need to do explicitly preserve the +detail with those. Retry with a >> recipient without any rewriting and from the local host. >> >> echo TEST | sendmail -v recpient+detail at yourdomain.tld >> >> Received: from ux-2s11.inf.fh-bonn-rhein-sieg.de >> by ux-2s11.inf.fh-bonn-rhein-sieg.de (Dovecot) with LMTP id >> aC4NEHRMzlK7dgAALie3fw >> for ; Thu, 09 Jan 2014 08:15:00 +0100 >> > > I'm not using any aliases or virtuser table in my tests, yet my sendmail DOES > NOT pass +detail to LMTP: > > $ echo TEST | sendmail -v gcr+detail at badger.tharned.org try sendmail -bv -d60.5 -d27.2 -d21.12 gcr+detail at badger.tharned.org - -d60.5 - trace map lookups - -d27.2 - traces processing of aliases and forwards - -d21.12 - trace R line processing IMHO: If all map lookups return NOTFOUND, the detail is preserved, otherwise it is the duty of the map to preserve the detail. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUs+gEF3r2wJMiz2NAQJIlAf/QACnGp0vP2xqyCrt9KV4KUdEFrmEGZvg XaKIsY5CtTL3y8UM9iA5YCDTICe3/Gh8vz2G2OBF0zMwSXMiMFuCW6AXQ+YX+S7o 73WyGNmq/omom9uS8D64tbaSXu2BiywMYkg40yr9XyRnWG3MgTRJaighBCtBzQFN wUeL978qol1Z1cGUqcuTry/sVJni2M4thfP+DTlcwK6+xNqrhOB2VdHFhQurDOPq Ib/obPjVYDD3rhjzFpMsJK+M8IxJo4uJecURSOvgEri94iegMqo2fEoew4129SZr fiQniB0CCuOXpic9QKg9lYI3hTujnCBIhMjEFCgYsu+UGmQf9ykxVA== =eT4A -----END PGP SIGNATURE----- From cmreddy at armor5.com Fri Jan 10 10:15:46 2014 From: cmreddy at armor5.com (CM Reddy) Date: Fri, 10 Jan 2014 13:45:46 +0530 Subject: [Dovecot] Message filtering capability at IMAP proxy Message-ID: Hi, I would like process the messages at Dovecot IMAP proxy. In one of the documents, it was mentioned that Dovecot proxy currently supports on the fly message filtering in latest releases. Will it it possible to extend the filtering feature to handle the following requirements. 1. Parse the email at IMAP proxy. 2. Replace the links with some other secure links. 3. Replace the attachments with some other document. It would be great, if any one can provide some pointers to move forward. - Thanks in advance CM Reddy From rs at sys4.de Fri Jan 10 11:39:02 2014 From: rs at sys4.de (Robert Schetterer) Date: Fri, 10 Jan 2014 10:39:02 +0100 Subject: [Dovecot] Message filtering capability at IMAP proxy In-Reply-To: References: Message-ID: <52CFBFB6.2080506@sys4.de> Am 10.01.2014 09:15, schrieb CM Reddy: > Hi, > I would like process the messages at Dovecot IMAP proxy. In one of the > documents, it was mentioned that Dovecot proxy currently supports on the > fly message filtering in latest releases. Will it it possible to extend the > filtering feature to handle the following requirements. dont think this is a a good idea > > 1. Parse the email at IMAP proxy. in general ,might be to much overlay in realtime processing > 2. Replace the links with some other secure links. > 3. Replace the attachments with some other document. this general a job for some virus/antispam scanner etc at smtp/lmtp/lda/sieve income stage, additional you might get conflicting with laws and break signatures etc > > > It would be great, if any one can provide some pointers to move forward. > > - Thanks in advance > CM Reddy > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From ihab_mishriki at hotmail.com Fri Jan 10 16:24:08 2014 From: ihab_mishriki at hotmail.com (ihab) Date: Fri, 10 Jan 2014 06:24:08 -0800 (PST) Subject: [Dovecot] it's possible to send email from the system after the mailbox quota is full Message-ID: <1389363848438-46275.post@n4.nabble.com> it's possible to send email from the system after the mailbox quota is full i don't want warning mail i want something else because when i use warning on 100% or 99% or less some times the last message be too large (so if just 5% is free from quota size and the last msg size is 6% from quota ) after that the mailbox will not receive this message or warning message . -- View this message in context: http://dovecot.2317879.n4.nabble.com/it-s-possible-to-send-email-from-the-system-after-the-mailbox-quota-is-full-tp46275.html Sent from the Dovecot mailing list archive at Nabble.com. From gcr+dovecot at tharned.org Fri Jan 10 21:12:12 2014 From: gcr+dovecot at tharned.org (Greg Rivers) Date: Fri, 10 Jan 2014 13:12:12 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: Message-ID: On Fri, 10 Jan 2014, Steffen Kaiser wrote: > try > sendmail -bv -d60.5 -d27.2 -d21.12 gcr+detail at badger.tharned.org > > - -d60.5 - trace map lookups > - -d27.2 - traces processing of aliases and forwards > - -d21.12 - trace R line processing > > IMHO: If all map lookups return NOTFOUND, the detail is preserved, > otherwise it is the duty of the map to preserve the detail. > If I read the traces (attached) correctly, the +detail makes it unscathed through the maps, aliases, and rule sets. If that's the case, it would indicate that the problem is with sendmail's LMTP code. Do you concur? -- Greg Rivers -------------- next part -------------- A non-text attachment was scrubbed... Name: bv.log.xz Type: application/octet-stream Size: 1988 bytes Desc: sendmail -bv trace output URL: From d.parthey at metaways.de Fri Jan 10 21:33:38 2014 From: d.parthey at metaways.de (Daniel Parthey) Date: Fri, 10 Jan 2014 20:33:38 +0100 Subject: [Dovecot] it's possible to send email from the system after the mailbox quota is full In-Reply-To: <1389363848438-46275.post@n4.nabble.com> References: <1389363848438-46275.post@n4.nabble.com> Message-ID: <9ec0fa60-b15f-4a9c-afc4-a6314eec434f@email.android.com> Hello Ihab please have a look at the quota_grace feature. It allows you to deliver that last mail which brings the user over quota. You will need at least Dovecot 2.2.x for that feature. http://wiki2.dovecot.org/Quota/Configuration#Quota_grace We solved the problem by configuring a second lmtp service on a different port which is not affected by quota limits and is only used to deliver quota notifications. This has been previously discussed on this list. Regards Daniel From ml-dovecot at zu-con.org Fri Jan 10 21:51:58 2014 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Fri, 10 Jan 2014 20:51:58 +0100 Subject: [Dovecot] =?utf-8?q?Possible_to_force_cipher_order=3F?= Message-ID: <9e85eb98fa59db75726942cb828dcedd@ssl.scheff32.de> Hi, is it possible to force the server cipher order instead of the clients preferences? When I connect with openssl using these ciphers: 'RC4-SHA:DHE-RSA-AES256-GCM-SHA384' -> RC4-SHA will be selected and with 'DHE-RSA-AES256-GCM-SHA384:RC4-SHA' -> DHE-RSA-AES256-GCM-SHA384 It seems to be recommended for webservers to override that due to bad clients choices and increasing knowledge, like RC4 vs. BEAST, AES128 better (theoretical) than AES256. Regards, Matthias From ml-dovecot at zu-con.org Fri Jan 10 22:02:56 2014 From: ml-dovecot at zu-con.org (Matthias Rieber) Date: Fri, 10 Jan 2014 21:02:56 +0100 Subject: [Dovecot] =?utf-8?q?Possible_to_force_cipher_order=3F?= In-Reply-To: <9e85eb98fa59db75726942cb828dcedd@ssl.scheff32.de> References: <9e85eb98fa59db75726942cb828dcedd@ssl.scheff32.de> Message-ID: <093dc1c6dc7a275eb4e8d7c033781e97@ssl.scheff32.de> Hi, Am 2014-01-10 20:51, schrieb Matthias Rieber: > Hi, > > is it possible to force the server cipher order instead of the clients > preferences? When I connect with openssl using these ciphers: sorry, dovecot 2.2 has that feature. Matthias From skdovecot at smail.inf.fh-brs.de Sat Jan 11 01:03:05 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen) Date: Sat, 11 Jan 2014 00:03:05 +0100 Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: Message-ID: <52D07C29.50806@smail.inf.fh-brs.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Greg Rivers wrote: > On Fri, 10 Jan 2014, Steffen Kaiser wrote: > >> try sendmail -bv -d60.5 -d27.2 -d21.12 >> gcr+detail at badger.tharned.org >> >> - -d60.5 - trace map lookups - -d27.2 - traces processing of >> aliases and forwards - -d21.12 - trace R line processing >> >> IMHO: If all map lookups return NOTFOUND, the detail is >> preserved, otherwise it is the duty of the map to preserve the >> detail. >> > > If I read the traces (attached) correctly, the +detail makes it > unscathed through the maps, aliases, and rule sets. If that's the > case, it would indicate that the problem is with sendmail's LMTP > code. Do you concur? > I have: ... deliverable: mailer local, user uid+detail instead of "deliverable: mailer local, host detail, user gcr" Hmm, see http://etutorials.org/Server+Administration/Sendmail/Part+I+Build+and+Install/Chapter+4.+Configure+sendmail.cf+with+m4/FEATUREpreserve_local_plus_detail/ My mc-file has this setting commented out (prefixed by dnl). Ah, I see where the processing differs. I had added this: SLocal_localaddr R< $* > $1 Remove <> from address R$+ + $* $: $1 Remove detail from address R$+ $: <$(localuser $1 $: TEMPFAIL $)> $1 Query socket map server, if that's a local user R $* $# ok yes, this preserves detail R $* $# error $@ 5.7.1 $: 550 User unknown R $* $# error $@ TEMPFAIL $: $1 try again later Does it work???? See the R line. The map is to verify if the user is local or not. In my system sendmail cannot do so on its own. Maybe the FEATURE above works for the standard config. - -- Steffen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEVAwUBUtB8KF3r2wJMiz2NAQLE1Af9ELXYfNUUYCpCkn0oI6E8qhqv2Nb8Gr2K fdweCDCnJa1ZBax83oZKZNjNUMgEG5lIaSIqAswrJAvc01ODFgmyosl33XjvsfZu uPWu+cBGoroiHdZPBLD+1+jUVLICQGRM1vNJHmEPr119Vqbi578q5kwaClKCxCzu WyVILI6n+HxTNGRD1/jaGdAwPUlKEK3JLQGfJOrfBAjZtRwpMouzNnVc4mPE5K6Z 2CJYMbVzrNugy6Y0uqusYxa6GdQ6dQ64gpY+YqHBp1RYLcamJRH61TC30Pr6GxIq 2aN3Go/6ZVqb6dAw97bbsYjK0HIFxCRkeOmMaLGhCp8EqwL37EARfw== =+lYn -----END PGP SIGNATURE----- From da-dovecotlist-15 at abelonline.de Sat Jan 11 04:34:06 2014 From: da-dovecotlist-15 at abelonline.de (da-dovecotlist-15 at abelonline.de) Date: Sat, 11 Jan 2014 03:34:06 +0100 (CET) Subject: [Dovecot] Why does dovecot require the {} password sheme even if there is a $ crypt scheme. Message-ID: <20140111023406.AF1718C182@mail.abelonline.de> The wiki[1] says: If all the passwords are in same format, you can use default_pass_scheme to specify it. Otherwise each password needs to be prefixed with "{password-scheme}", for example "{plain}plaintext-password". Why doesn't dovecot recognize the crypt scheme identifier ($1$ for MD5-CRYPT, $6$ for SHA512-CRYPT etc.)? At the moment I have to have the following in my db for dovecot to work: {SHA512-CRYPT}$6$salt$passwordhash [1]http://wiki2.dovecot.org/AuthDatabase/SQL From joe.beaubien at gmail.com Sat Jan 11 05:58:08 2014 From: joe.beaubien at gmail.com (Joe Beaubien) Date: Fri, 10 Jan 2014 22:58:08 -0500 Subject: [Dovecot] error when running fts optimize Message-ID: Since yesterday, when I run "fts optimize", I get an error. Command: doveadm -v fts optimize -u formulaire Error: Jan 10 18:05:20 mba dovecot: indexer-worker(formulaire): Error: lucene index /mba_data/emails/formulaire/lucene-indexes: IndexWriter::optimize() failed (#9): bit out of range Does anyone have any idea what causes this and how to fix it? Thanks, Joe Beaubien From AxelLuttgens at swing.be Sat Jan 11 10:29:18 2014 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Sat, 11 Jan 2014 09:29:18 +0100 Subject: [Dovecot] Dovecot quota with MySQL - username issue In-Reply-To: <36d15e57fcc6f32b543d2b684dbbeeaf@mail.vivid.net.nz> References: <36d15e57fcc6f32b543d2b684dbbeeaf@mail.vivid.net.nz> Message-ID: <05B30AD7-AD99-4616-93AB-8C34D54A8410@swing.be> Le 26 d?c. 2013 ? 10:04, michael a ?crit : > Hi all, > > I'm using Dovecot 2.2.8 with quota using a MySQL backend. The Quota plugin is listed for POP3, IMAP and LDA. > > When it is enabled for LDA, it populates the "username" field in the MySQL table with e mail addresses. I end up with a mixture of email addresses and usernames, which causes things to not fully work. It *should* be just usernames. the LDA SQL statement is: > > [...] > > Can this be fixed? > > Michael > Hello Michael, I'm a bit late on this one... I guess your SELECT should return a quota column, probably something like: CONCAT('dict:user:', mailboxes.username, ':proxy::quotadict') AS quota because your quota definition in dovecot.conf will be filled with the username as known by the service currently making use of it. HTH, Axel From maciej.uhlig at us.edu.pl Sat Jan 11 11:16:43 2014 From: maciej.uhlig at us.edu.pl (Maciej Uhlig) Date: Sat, 11 Jan 2014 10:16:43 +0100 Subject: [Dovecot] Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) Message-ID: <52D10BFB.2060106@us.edu.pl> This is log from dovecot 2.2.10: 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user at domain): Error: Corrupted transaction log file /pracmail/domain/user/mail/.sent-mail/dovecot.index.log seq 16777216: log file shrank (868 < 6144) (sync_offset=6144) 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user at domain): Panic: file buffer.c: line 307 (buffer_set_used_size): assertion failed: (used_size <= buf->alloc) 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user at domain): Error: Raw backtrace: /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x6c2fa) [0x7f0704fa22fa] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x6c366) [0x7f0704fa2366] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f0704f5802f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(+0x67489) [0x7f0704f9d489] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_open+0x2c0) [0x7f07052ed120] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_transaction_log_open+0xb8) [0x7f07052e99b8] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0xc1784) [0x7f07052cf784] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0xf0) [0x7f07052cfac0] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0xac) [0x7f07052c0fac] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x4d43a) [0x7f070525b43a] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x4d50f) [0x7f070525b50f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(+0x84054) [0x7f0705292054] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mailbox_open+0xf) [0x7f070529220f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x4a) [0x7f07052bfc2a] -> /usr/local/dovecot/lib/dovecot/lib10_quota_plugin.so(+0xb8ac) [0x7f0704d1c8ac] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x8c) [0x7f0705291ebc] -> dovecot/imap(imap_status_get+0x7a) [0x42058a] -> dovecot/imap(cmd_status+0x15d) [0x413a0d] -> dovecot/imap(command_exec+0x3d) [0x418acd] -> dovecot/imap() [0x417b10] -> dovecot/imap() [0x417c25] -> dovecot/imap(client_handle_input+0x125) [0x4180b5] -> dovecot/imap(client_input+0x6f) [0x41892f] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f0704fb2c66] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x95) [0x7f0704fb3fd5] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f0704fb2bd8] -> /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f0704f5d483] -> dovecot/imap(main+0x2a7) [0x422807] 2014-01-11T09:55:14+01:00 server/a.b.c.d dovecot: imap(user at domain): Fatal: master: service(imap): child 25125 killed with signal 6 (core dumped) 2014-01-11T09:55:15+01:00 server/a.b.c.d dovecot: imap(user at domain): Error: Transaction log file /pracmail/us.edu.pl/user/mail/.sent-mail/dovecot.index.log: marked corrupted Unfortunately I'm not able to find core file although 'core dumped' is written to the log. MU -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3354 bytes Desc: Kryptograficzna sygnatura S/MIME URL: From Mozek007 at seznam.cz Sun Jan 12 16:13:47 2014 From: Mozek007 at seznam.cz (mozek007) Date: Sun, 12 Jan 2014 15:13:47 +0100 (CET) Subject: [Dovecot] =?utf-8?q?Fwd=3A__problem_with_Error=3A_net=5Fconnect?= =?utf-8?q?=5Funix=28/var/run/dovecot/dict=29_failed=3A_Permission_?= =?utf-8?q?denied?= Message-ID: <1lM.7WuD.3NKgMPLjeFS.1IqgCR@seznam.cz> Hi, $ dovecot --version 2.1.7 afrer i send email: log: tail -f /var/log/* ==> sieve.log <==
Jan 10 20:44:14 lda(test at test.cz): Error: net_connect_unix(/var/run/dovecot/dict) failed: Permission denied (euid=2000(vmail) egid=2000(vmail) missing +r perm: /var/run/dovecot/dict, dir owned by 0:0 mode=0755)
Jan 10 20:44:14 lda(test at test.cz): Error: Internal quota calculation error
Jan 10 20:44:14 lda(test at test.cz): Info: msgid=<1Qg.7WxZ.sdfs.1Iq4r{@seznam.cz>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2014-01-10 20:44:14]
$ cat /etc/dovecot/dovecot.conf | grep -v "^ *#" | grep -v "^ *$"
protocols = pop3 imap sieve
listen = *
mail_uid = 2000
mail_gid = 2000
first_valid_uid = 2000
last_valid_uid = 2000
auth_master_user_separator = *
log_path = /var/log/dovecot.log
disable_plaintext_auth = yes
auth_default_realm = test.cz
plugin {
? ? quota_warning = storage=85%% /usr/local/bin/dovecot-quota-warning.sh 85
? ? quota_warning2 = storage=90%% /usr/local/bin/dovecot-quota-warning.sh 90
? ? quota_warning3 = storage=95%% /usr/local/bin/dovecot-quota-warning.sh 95
}
ssl = required
verbose_ssl = no
ssl_key = ssl_cert = pem
ssl_ca = pem
mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/
plugin {
? ? quota = dict:user::proxy::quotadict
? ? quota_rule = *:storage=0
}
dict {
}
plugin {
? ? auth_socket_path = /var/run/dovecot/auth-master
}
plugin {
? ? sieve = /%Lh/sieve/dovecot.sieve
}
protocol lda {
? ? postmaster_address = root
? ? auth_socket_path = /var/run/dovecot/auth-master
? ? mail_plugins = quota sieve autocreate
? ? log_path = /var/log/sieve.log
}
protocol imap {
? ? mail_plugins = quota imap_quota autocreate
? ? imap_client_workarounds = tb-extra-mailbox-sep
}
protocol pop3 {
? ? mail_plugins = quota
? ? pop3_uidl_format = %08Xu%08Xv
? ? pop3_client_workarounds = outlook-no-nuls oe-ns-eoh
}
service auth {
? ? unix_listener /var/spool/postfix/dovecot-auth {
? ? ? ? user = postfix
? ? ? ? group = postfix
? ? ? ? mode = 0666
? ? }
? ? unix_listener auth-master {
? ? ? ? user = vmail
? ? ? ? group = vmail
? ? ? ? mode = 0666
? ? }
? ? unix_listener auth-userdb {
? ? ? ? user = vmail
? ? ? ? group = vmail
? ? ? ? mode = 0660
? ? }
}
? ? passdb {
? ? ? ? args = /etc/dovecot/dovecot-master-users-password
? ? ? ? master = yes
? ? ? ? driver = passwd-file
? ? }
? ? passdb {
? ? ? ? args = /etc/dovecot/dovecot-mysql.conf
? ? ? ? driver = sql
? ? }
? ? userdb {
? ? ? ? args = /etc/dovecot/dovecot-mysql.conf
? ? ? ? driver = sql
? ? }
plugin {
? ? autocreate = INBOX
? ? autocreate2 = Sent
? ? autocreate3 = Trash
? ? autocreate4 = Drafts
? ? autocreate5 = Junk
? ? autosubscribe = INBOX
? ? autosubscribe2 = Sent
? ? autosubscribe3 = Trash
? ? autosubscribe4 = Drafts
? ? autosubscribe5 = Junk
}
dict {
? ? quotadict = mysql:/etc/dovecot/dovecot-used-quota.conf
}
namespace {
? ? type = private
? ? separator = /
? ? prefix =
? ? inbox = yes
}
namespace {
? ? type = shared
? ? separator = /
? ? prefix = Shared/%%u/
? ? location = maildir:/%%Lh/Maildir/:INDEX=/%%Lh/Maildir/Shared/%%u
? ? subscriptions = yes
? ? list = children
}
plugin {
? ? acl = vfile
? ? acl_shared_dict = proxy::acl
}
dict {
? ? acl = mysql:/etc/dovecot/dovecot-share-folder.conf
}
protocol sieve {
}
plugin {
? ? sieve = /var/vmail/sieve/%Ld/%Ln/dovecot.sieve
? ? sieve_dir = /var/vmail/sieve/%Ld/%Ln
}
$ ll /var/run/dovecot/ | grep dict
srw-------? 1 root? ? root? ? ? 0 led 10 20:52 dict
So, when i change chmod on /var/run/dovecot/dict, after $ /etc/init.d/ dovecot restart is default. So, how i can change user group or user or something other? I'm trying and googling this resolved about 6 hours. No results :( Thanks for any reply. From joe.beaubien at gmail.com Mon Jan 13 04:05:59 2014 From: joe.beaubien at gmail.com (Joe Beaubien) Date: Sun, 12 Jan 2014 21:05:59 -0500 Subject: [Dovecot] dsync error: gz trailer has wrong CRC value Message-ID: A few days ago by dovecot installation started behaving weirdly. First it was doveadm fts optimize which would fail (a thread running about that) and now it's dsync, which means my backups are not working. This all started a few days ago, which I find a little weird, because I haven't messed around with the dovecot setup in months. I've been searching the internet, but didn't find anything useful yet. Would anyone know how to fix the errors in the log below? Thanks, -Joe dovecot version is 2.1.7 Here is the log: dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): gz trailer has wrong CRC value at 16966298 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Error: read(msg input) failed: Invalid argument dsync(archive): Error: zlib.read(/mba_data/emails/archive/storage/m.1885): missing gz header at 16973513 dsync(archive): Panic: file mail-index-transaction-update.c: line 906 (mail_index_update_ext): assertion failed: (seq > 0 && (seq <= mail_index_view_get_messages_count(t->view) || seq <= t->last_new_seq)) dsync(archive): Error: Raw backtrace: /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(+0x4203a) [0x7f3a5150503a] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f3a515050fa] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f3a514dc3f0] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_index_update_ext+0x1c7) [0x7f3a51804927] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa8746) [0x7f3a517f7746] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_cache_transaction_commit+0x4c) [0x7f3a517f7a2c] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa8af3) [0x7f3a517f7af3] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(+0xa2cea) [0x7f3a517f1cea] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x84) [0x7f3a51800754] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x8a) [0x7f3a517f209a] -> /opt/dovec ot/lib/d ovecot/lib20_zlib_plugin.so(+0x3b7a) [0x7f3a4fe8cb7a] -> /opt/dovecot/lib/dovecot/lib20_fts_plugin.so(+0xb481) [0x7f3a5009b481] -> /opt/dovecot-2.1.7/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x3d) [0x7f3a517c9c4d] -> /opt/dovecot/bin/dsync() [0x4297e6] -> /opt/dovecot/bin/dsync() [0x42b222] -> /opt/dovecot/bin/dsync(dsync_worker_select_mailbox+0x2e) [0x4291be] -> /opt/dovecot/bin/dsync() [0x424c75] -> /opt/dovecot/bin/dsync() [0x424db7] -> /opt/dovecot/bin/dsync(dsync_brain_msg_sync_more+0x22c) [0x4245ec] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x459) [0x422fc9] -> /opt/dovecot/bin/dsync() [0x423e61] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x7f1) [0x423361] -> /opt/dovecot/bin/dsync() [0x423cdc] -> /opt/dovecot/bin/dsync(dsync_brain_sync+0x832) [0x4233a2] -> /opt/dovecot/bin/dsync(dsync_brain_sync_all+0x18) [0x423ee8] -> /opt/dovecot/bin/dsync() [0x420f36] -> /opt/dovecot/bin/dsync() [0x4215b2] -> /opt/dovecot/bin/dsync() [0x40e798] From nick.z.edwards at gmail.com Mon Jan 13 04:40:56 2014 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 13 Jan 2014 12:40:56 +1000 Subject: [Dovecot] [OT] cool bash script for cron with seconds resolution In-Reply-To: <52CE4E2C.1020500@perkel.com> References: <52CE4E2C.1020500@perkel.com> Message-ID: what has this to do with dovecot, from someone who purports to be anti-spam you do a good enough job, at spamming. On 1/9/14, Marc Perkel wrote: > Short bash script to run a program > > 30 20 15 12 10 6 5 4 3 2 executions per minute. > > > http://wiki.junkemailfilter.com/index.php/How_to_run_a_Linux_script_every_few_seconds_under_cron > > From nick.z.edwards at gmail.com Mon Jan 13 04:33:51 2014 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Mon, 13 Jan 2014 12:33:51 +1000 Subject: [Dovecot] Why does dovecot require the {} password sheme even if there is a $ crypt scheme. In-Reply-To: <20140111023406.AF1718C182@mail.abelonline.de> References: <20140111023406.AF1718C182@mail.abelonline.de> Message-ID: It does, we use sha512 for long time in sql conf use default_pass_scheme = CRYPT it uses the systen crypt then, (NO - this does NOT mean it uses the ancient 8 char limited crypt) it will use whatever your underlying operating system allows, and unless you are using something thats more than 10 years old, it will handle better. in our sql table $6$68341f21c4d70c67$D9Rbgw.Ecvfdbvfbfgfdbc.....................................etc On 1/11/14, da-dovecotlist-15 at abelonline.de wrote: > The wiki[1] says: > If all the passwords are in same format, you can use default_pass_scheme to > specify it. Otherwise each password needs to be prefixed with > "{password-scheme}", for example "{plain}plaintext-password". > > Why doesn't dovecot recognize the crypt scheme identifier ($1$ for > MD5-CRYPT, $6$ for SHA512-CRYPT etc.)? At the moment I have to have the > following in my db for dovecot to work: > {SHA512-CRYPT}$6$salt$passwordhash > > [1]http://wiki2.dovecot.org/AuthDatabase/SQL > From gcr+dovecot at tharned.org Mon Jan 13 06:40:13 2014 From: gcr+dovecot at tharned.org (Greg Rivers) Date: Sun, 12 Jan 2014 22:40:13 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: <52D07C29.50806@smail.inf.fh-brs.de> References: <52D07C29.50806@smail.inf.fh-brs.de> Message-ID: On Sat, 11 Jan 2014, Steffen wrote: > I have: > ... deliverable: mailer local, user uid+detail > instead of "deliverable: mailer local, host detail, user gcr" > > Hmm, see > http://etutorials.org/Server+Administration/Sendmail/Part+I+Build+and+Install/Chapter+4.+Configure+sendmail.cf+with+m4/FEATUREpreserve_local_plus_detail/ > > My mc-file has this setting commented out (prefixed by dnl). Ah, I see > where the processing differs. I had added this: > > SLocal_localaddr > R< $* > $1 Remove <> from address > R$+ + $* $: $1 Remove detail from address > R$+ $: <$(localuser $1 $: TEMPFAIL $)> $1 Query socket > map server, if that's a local user > R $* $# ok yes, this preserves detail > R $* $# error $@ 5.7.1 $: 550 User unknown > R $* $# error $@ TEMPFAIL $: $1 try again later Does > it work???? > > See the R line. The map is to verify if the user is local or not. > In my system sendmail cannot do so on its own. Maybe the FEATURE above > works for the standard config. > "FEATURE(`preserve_local_plus_detail')" is actually one of the first things I tried when I started working on this problem, but it doesn't quite work with the standard configuration: $ sendmail -bv -d21.12 gcr+XYZZY at badger.tharned.org ... rewrite: ruleset final returns: gcr + XYZZY rewrite: ruleset localaddr input: gcr + xyzzy -----trying rule: $+ -----rule matches: $: $1 $| $> "Local_localaddr" $1 -----skip subr Local_localaddr (197) rewritten as: gcr + xyzzy $| gcr + xyzzy -----trying rule: $+ $| $# ok ----- rule fails -----trying rule: $+ $| $# $* ----- rule fails -----trying rule: $+ $| $* -----rule matches: $: $1 rewritten as: gcr + xyzzy -----trying rule: $+ -----rule matches: $: < > $1 rewritten as: < > gcr + xyzzy -----trying rule: < > $+ -----rule matches: $@ $1 rewritten as: gcr + xyzzy rewrite: ruleset localaddr returns: gcr + xyzzy gcr+XYZZY at badger.tharned.org... User unknown It does preserve the +detail, but according to the trace, it has a problem with Local_localaddr, and apparently fails because it's including the +detail when it does the local account look-up. Here's what my Local_localaddr ruleset looks like with the preserve_local_plus_detail feature: ########################################################################### ### Ruleset 5 -- special rewriting after aliases have been expanded ### ########################################################################### SLocal_localaddr Slocaladdr=5 R$+ $: $1 $| $>"Local_localaddr" $1 R$+ $| $#ok $@ $1 no change R$+ $| $#$* $#$2 R$+ $| $* $: $1 # prepend an empty "forward host" on the front R$+ $: <> $1 R< > $+ $@ $1 R< local : $* > $* $: $>MailerToTriple < local : $1 > $2 no host extension R< error : $* > $* $: $>MailerToTriple < error : $1 > $2 no host extension R< $~[ : $+ > $+ $: $>MailerToTriple < $1 : $2 > $3 < @ $2 > R< $+ > $+ $@ $>MailerToTriple < $1 > $2 < @ $1 > Perhaps I should file this as a bug at sendmail.org? -- Greg From joshua at hybrid.pl Mon Jan 13 10:56:28 2014 From: joshua at hybrid.pl (Jacek Osiecki) Date: Mon, 13 Jan 2014 09:56:28 +0100 (CET) Subject: [Dovecot] Sieve - not functioning for additional email aliases. Message-ID: Hi, On one of my servers (old one, version 1.2.5) user reported that vacation message for basic address works fine, but not for the aliases. I know that this is an old version, but we can't simply switch them to the most current dovecot release without preparing and testing everything... So I'm rather asking for help with debugging the case :) This person has email my.name at olddomain.pl. However, they are switching to new domain - newdomain.pl - and it is becoming their main brand. So temporarily olddomain.pl is still their "home" domain, but there is a domain alias newdomain->olddomain. The sieve file is simple: forward message and reply with vacation: ---- require ["copy","vacation"]; # rule:[redirect] if anyof (true) { redirect :copy "my.boss at newdomain.pl"; vacation :days 1 :addresses ["my.name at olddomain.pl","my.name at newdomain.pl"] text: I'm unavailable now. Please contact my boss: my.boss at newdomain.pl Greetings . ; } ---- When I send email to my.name at olddomain.pl - it is sent to my.boss at newdomain.pl and I receive the vacation message. When I send it to the alias (my.name at newdomain.pl) - none of above is done. Any idea how I can debug it? Running test-sieve does not help - it claims that will simply forward and deliver the message... Greetings, -- Jacek Osiecki joshua at ceti.pl GG:3828944 I don't want something I need. I want something I want. From jernej.porenta at arnes.si Mon Jan 13 11:33:32 2014 From: jernej.porenta at arnes.si (Jernej Porenta) Date: Mon, 13 Jan 2014 10:33:32 +0100 Subject: [Dovecot] 2.2.10 - core dumps Message-ID: <52D3B2EC.8080807@arnes.si> Heya, We are occasionally seeing core dumps with dovecot 2.2.10, which are mostly like this: Jan 11 18:31:08 hostname dovecot: imap(username): Panic: file mail-index-transaction-update.c: line 19 (mail_index_transaction_lookup): assertion failed: (seq >= t->first_new_seq && seq <= t->last_new_seq) Jan 11 18:31:08 hostname dovecot: imap(username): Error: Raw backtrace: /opt/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 [0x2b657523aa3a] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 [0x2b657523aaa6] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 [0x2b6575239b83] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f83458] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f86458] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_cache_decision_state_update+0xbe) [0x2b6574f7605e] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(mail_cache_lookup_headers+0x87) [0x2b6574f77ba7] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f64919] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0(index_mail_get_first_header+0x50) [0x2b6574f64e80] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f5fda1] -> /opt/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 [0x2b6574f5fee9] -> /opt/dovecot-2.2.10/lib/dovecot/libdove Jan 11 18:31:08 hostname dovecot: imap(username): Fatal: master: service(imap): child 13548 killed with signal 6 (core dumps disabled) # dovecot -n is available here: http://pastebin.com/RE91aRi5 other raw traces are available here: http://pastebin.com/M1S33NYn Would you recommend deleting all the index files or rather capturing core dump file for further analysis? Or maybe something completely different ;) thank you in advance, cheers, Jernej From ihab_mishriki at hotmail.com Mon Jan 13 11:36:58 2014 From: ihab_mishriki at hotmail.com (ihab) Date: Mon, 13 Jan 2014 01:36:58 -0800 (PST) Subject: [Dovecot] it's possible to send email from the system after the mailbox quota is full In-Reply-To: <1389363848438-46275.post@n4.nabble.com> References: <1389363848438-46275.post@n4.nabble.com> Message-ID: <1389605818989-46292.post@n4.nabble.com> Thanks Daniel My dovecot version is 1.2.** any other solution . best regards Ihab -- View this message in context: http://dovecot.2317879.n4.nabble.com/it-s-possible-to-send-email-from-the-system-after-the-mailbox-quota-is-full-tp46275p46292.html Sent from the Dovecot mailing list archive at Nabble.com. From cmreddy at armor5.com Mon Jan 13 13:22:53 2014 From: cmreddy at armor5.com (CM Reddy) Date: Mon, 13 Jan 2014 16:52:53 +0530 Subject: [Dovecot] Couldn't drop privileges Message-ID: Hi All, I have configured the dovecot from sources based on the instructions in the following link. http://wiki2.dovecot.org/CompilingSource Tried to test the installation: 1. Started dovecot successfully. 2. Failed to Login command with an error. -Lenovo-G500s:~$ telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Hi Dovecot ready. a login armor5 abc123 * BYE Internal error occurred. Refer to server log for more information. Connection closed by foreign host. Configuration is: ------------------------ Lenovo-G500s:~$ doveconf -n # 2.2.10: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.8.0-29-generic x86_64 Ubuntu 12.04.3 LTS auth_debug = yes auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no login_greeting = Hi Dovecot ready. mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } ssl_cert = Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: auth: Debug: passwd-file(armor5,127.0.0.1,<+CqxJ9jvkgB/AAAB>): lookup: user=armor5 file=/etc/dovecot/users Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: auth: Debug: client passdb out: OK#0111#011user=armor5 Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: auth: Debug: master in: REQUEST#0111108344833#0115166#0111#011d026da1fc2ca16d0208eec7bc369ac2d#011session_pid=5169#011request_auth_token Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: auth: Debug: passwd-file(armor5,127.0.0.1,<+CqxJ9jvkgB/AAAB>): lookup: user=armor5 file=/etc/dovecot/users Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: auth: Debug: master userdb out: USER#0111108344833#011armor5#011uid=1001#011home=/home/armor5#011auth_token=555c47f35a67f94f519da93affe91abef29550fb Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=5169, secured, session=<+CqxJ9jvkgB/AAAB> Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: imap(armor5): Error: user armor5: Couldn't drop privileges: User is missing GID (see mail_gid setting) Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: imap(armor5): Error: Internal error occurred. Refer to server log for more information. Please help in resolving this issue. - Thanks CM Reddy From markus at gekmihesg.de Mon Jan 13 13:48:25 2014 From: markus at gekmihesg.de (Markus Weippert) Date: Mon, 13 Jan 2014 12:48:25 +0100 Subject: [Dovecot] Replication and public namespaces Message-ID: <52D3D289.4040105@gekmihesg.de> Hi, I'm having some issues with replicating public namespaces. Everything seems to work fine for private namespaces, but while importing some huge mailboxes (many small mails) into a public namespace via imapsync, something goes wrong. The expected mail flow is: old-server (imapsync)> new-server1 (replication)> new-server2 But then, dovecot seems to run into race conditions when the replications process tries to sync the same public mailbox under two or more different users at the same time. As a result, messages get duplicated, new-server2 sends those back to new-server1 which then starts to produce duplicates too. If I don't kill the processes in time and delete the faulty mailbox, they start to produce thousands of mails. In fact, server2 should not export messages at all, since it's not productive yet and does not get any mail except from the replication. The only thing getting logged (only few compared to the huge amount of duplicates produced): "dsync-server(user at example.com): Warning: Maildir /...: Expunged message reappeared, giving a new UID" Is there any way to fix this? Regards, Markus doveadm_password = *********** doveadm_port = ***** mail_home = /var/vmail/private/%d/%n mail_location = maildir:~/mail mail_plugins = acl virtual listescape notify replication namespace inbox { inbox = yes location = prefix = separator = / type = private } namespace legacy { alias_for = # ... } namespace ns_public { list = children location = maildir:/var/vmail/public/%d prefix = Public/ separator = / subscriptions = no type = public } namespace virtual { # ... } plugin { mail_replica = tcps:************** } protocols = imap lmtp sieve replication_dsync_parameters = -d -l 60 -N -x virtual -x ns_public -U replication_full_sync_interval = 4 hours replication_max_conns = 20 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service doveadm { inet_listener { port = 8143 ssl = yes } process_min_avail = 5 user = vmail vsz_limit = 4 G } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } From CMarcus at Media-Brokers.com Mon Jan 13 14:22:27 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 13 Jan 2014 07:22:27 -0500 Subject: [Dovecot] Fwd: problem with Error: net_connect_unix(/var/run/dovecot/dict) failed: Permission denied In-Reply-To: <1lM.7WuD.3NKgMPLjeFS.1IqgCR@seznam.cz> References: <1lM.7WuD.3NKgMPLjeFS.1IqgCR@seznam.cz> Message-ID: <52D3DA83.4070709@Media-Brokers.com> On 2014-01-12 9:13 AM, mozek007 wrote: > tail -f/var/log/* > > > ==> sieve.log <==
> Jan 10 20:44:14 lda(test at test.cz): Error: net_connect_unix(/var/run/dovecot/dict) failed: Permission denied (euid=2000(vmail) egid=2000(vmail) missing +r perm: /var/run/dovecot/dict, dir owned by 0:0 mode=0755)
> > Jan 10 20:44:14 lda(test at test.cz): Error: Internal quota calculation error
Jan 10 20:44:14 lda(test at test.cz): Info: msgid=<1Qg.7WxZ.sdfs.1Iq4r{@seznam.cz>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2014-01-10 20:44:14]
Please try again without all the HTML pollution garbage... -- Best regards, Charles From skdovecot at smail.inf.fh-brs.de Mon Jan 13 17:38:27 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 13 Jan 2014 16:38:27 +0100 (CET) Subject: [Dovecot] Fwd: problem with Error: net_connect_unix(/var/run/dovecot/dict) failed: Permission denied In-Reply-To: <1lM.7WuD.3NKgMPLjeFS.1IqgCR@seznam.cz> References: <1lM.7WuD.3NKgMPLjeFS.1IqgCR@seznam.cz> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 12 Jan 2014, mozek007 wrote: > Jan 10 20:44:14 lda(test at test.cz): Error: net_connect_unix(/var/run/dovecot/dict) failed: Permission denied (euid=2000(vmail) egid=2000(vmail) missing +r perm: /var/run/dovecot/dict, dir owned by 0:0 mode=0755)
See http://wiki2.dovecot.org/Services#Service_listeners mode/user/group what values are best for you, depend on your local system. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUtQIc3D1/YhP6VMHAQIEAAf/bhvsyEIGDG7paaNDv0v+cha3ZHPFsyhB H4Vyf1Lnx5dcJkgBMHijWZ80347RZNJltcAXG9hfn/BwUGfrutnW5wSZc0hNuj/P xK2mH3qp0k0iQ5scinx+desAdWTlmbFuGnOkv6jvddMswQZ91hwZCCU/cJrQb3dm CQiYfxNbh+GGswcPf824szEYOs+k5Ut3U75o7Vbot2gkS2+SW7u/1NjQG6GHk8Di 3pyevv/AQU+Sdm/ZCdJHmi0Dx1Qhmk5v3WXz5CBOCFsYCDEusdzTQXkZyUFo4ca7 U04gCNlSbjmKrKGuMmUutZ1IgaUNjOtgpxRTRDLYCb6sToaGzQYatw== =3D/s -----END PGP SIGNATURE----- From maciej.uhlig at us.edu.pl Mon Jan 13 17:44:02 2014 From: maciej.uhlig at us.edu.pl (Maciej Uhlig) Date: Mon, 13 Jan 2014 16:44:02 +0100 Subject: [Dovecot] Fatal: master: service(imap): child n killed with signal 11 (core dumped) - in mail_cache_header_fields_read Message-ID: <52D409C2.6050702@us.edu.pl> This is log from dovecot 2.2.10: 2014-01-13T15:34:39+01:00 server/a.b.c.d dovecot: imap(user at domain): Fatal: master: service(imap): child 6290 killed with signal 11 (core dumped) (gdb) bt full #0 0x00007fe78683aba5 in mail_cache_header_fields_read () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007fe78683890a in mail_cache_open_and_verify () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #2 0x00007fe78683c339 in mail_cache_field_exists () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #3 0x00007fe78683c459 in mail_cache_lookup_field () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #4 0x00007fe786821949 in index_mail_cache_lookup_field () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #5 0x00007fe7868222d6 in index_mail_update_access_parts () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #6 0x00007fe786822676 in index_mail_set_seq () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #7 0x00007fe786829f51 in search_more () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 ---Type to continue, or q to quit--- No symbol table info available. #8 0x00007fe78682a778 in index_storage_search_next_nonblock () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #9 0x00007fe786800257 in mailbox_search_next_nonblock () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #10 0x00007fe7868002b6 in mailbox_search_next () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #11 0x000000000041b637 in imap_fetch_more_int () No symbol table info available. #12 0x000000000041b871 in imap_fetch_more () No symbol table info available. #13 0x000000000040d8ae in cmd_fetch () No symbol table info available. #14 0x0000000000418acd in command_exec () No symbol table info available. #15 0x0000000000417b10 in client_command_input () No symbol table info available. #16 0x0000000000417c25 in client_command_input () No symbol table info available. #17 0x00000000004180b5 in client_handle_input () ---Type to continue, or q to quit--- No symbol table info available. #18 0x000000000041892f in client_input () No symbol table info available. #19 0x00007fe786522c66 in io_loop_call_io () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 No symbol table info available. #20 0x00007fe786523fd5 in io_loop_handler_run () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 No symbol table info available. #21 0x00007fe786522bd8 in io_loop_run () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 No symbol table info available. #22 0x00007fe7864cd483 in master_service_run () from /usr/local/dovecot-2.2.10/lib/dovecot/libdovecot.so.0 No symbol table info available. #23 0x0000000000422807 in main () No symbol table info available. (gdb) MU -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3354 bytes Desc: Kryptograficzna sygnatura S/MIME URL: From ra at rz.uni-frankfurt.de Mon Jan 13 17:58:51 2014 From: ra at rz.uni-frankfurt.de (ra at rz.uni-frankfurt.de) Date: Mon, 13 Jan 2014 16:58:51 +0100 Subject: [Dovecot] Slow authentication performance when switching folder Message-ID: <20140113165851.38436orlxcormxbv@webmail.server.uni-frankfurt.de> Hello, we have a problem with Dovecot 2.2.9 running on an AIX 7.1 and compiled with xlc. At first we configured passdb to use our ldap directory via pam and experienced an Internal login failure like the following one Jan 13 16:20:02 imap-login: Info: Internal login failure (pid=29818948 id=1) (internal failure, 1 successful auths): user=, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=yyy.yyy.yyy.yyy, TLS, session= I read that this error occurs if the last passdb returns a continue and there is no other passdb to ask. We added two more passdb to rule out that pam is the problem. We added ldap directly and as third a fallback passwd file, but we still get the Internal login failure. As far as i can see this only occurs if i switch to another folder and i?m being reauthenticated. Are there any suggestions on what is going wrong? Any push in the right direction would be appreciated. kind regards Manuel PS: This is the dump of our dovecot configuration file: doveconf: Warning: service auth { client_limit=1000 } is lower than required under max. load (32768) doveconf: Warning: service anvil { client_limit=1000 } is lower than required under max. load (24579) # OS: AIX 1 00F7B83D4C00 auth_debug = yes auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890- auth_username_format = %n auth_username_translation = AaBbCcDdEeFfGgHhIiJjKkLlMmNnOoPpQqRrSsTtUuVvWwXxYyZz auth_verbose = yes base_dir = /var/run/dovecot-imap default_process_limit = 8192 disable_plaintext_auth = no first_valid_uid = 100 info_log_path = /mailbase/dovecot/2.2.9/log/dovecot_imap_debug.log log_path = /mailbase/dovecot/2.2.9/log/dovecot_imap.log login_greeting = University-Frankfurt-IMAP-Horde ready. mail_access_groups = mhs mail_debug = yes mail_fsync = never mail_location = mbox:~/:INBOX=/var/spool/mail/%u:INDEX=/var/mail-indexes/%u mailbox_idle_check_interval = 90 secs mbox_write_locks = fcntl namespace { inbox = yes location = prefix = separator = / type = private name = } passdb { args = username_format=%u /mailbase/etc/passwd driver = passwd-file } passdb { args = %s driver = pam } plugin { stats_refresh = 30 secs stats_track_cmds = yes } service replication-notify-fifo { name = aggregator } service anvil-auth-penalty { name = anvil } service auth-worker { name = auth-worker } service auth-client { name = auth } service config { name = config } service dict { name = dict } service login/proxy-notify { name = director } service dns-client { name = dns_client } service doveadm-server { name = doveadm } service { inet_listener { address = * port = 0 name = imap } inet_listener { address = * port = 993 name = imaps } name = imap-login } service imap-urlauth { name = imap-urlauth-login } service imap-urlauth-worker { name = imap-urlauth-worker } service token-login/imap-urlauth { name = imap-urlauth } service login/imap { name = imap } service indexer-worker { name = indexer-worker } service indexer { name = indexer } service ipc { name = ipc } service lmtp { name = lmtp } service log-errors { name = log } service { inet_listener { address = 10.1.1.40 port = 0 name = pop3 } inet_listener { address = * port = 0 name = pop3s } name = pop3-login } service login/pop3 { name = pop3 } service replicator-doveadm { name = replicator } service login/ssl-params { name = ssl-params } service stats-mail { name = stats } ssl_cert = References: Message-ID: <48C1DCEA-F6F0-45E8-8B4F-892A6FBADC07@swing.be> Le 13 janv. 2014 ? 09:56, Jacek Osiecki a ?crit : > Hi, > > On one of my servers (old one, version 1.2.5) user reported that vacation message for basic address works fine, but not for the aliases. > > [...] > > Any idea how I can debug it? Running test-sieve does not help - it claims that will simply forward and deliver the message... Hello Jacek, You could try to add: mail_debug = yes to dovecot's configuration, and also have a look at the release notes for sieve: http://hg.rename-it.nl/dovecot-2.2-pigeonhole/raw-file/0.4.2/NEWS HTH, Axel From user+dovecot at localhost.localdomain.org Mon Jan 13 21:37:49 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Mon, 13 Jan 2014 19:37:49 +0000 Subject: [Dovecot] Couldn't drop privileges In-Reply-To: References: Message-ID: <52D4408D.8090104@localhost.localdomain.org> On 01/13/2014 11:22 AM CM Reddy wrote: > ? > 2. Failed to Login command with an error. > ? > Lenovo-G500s:~$ doveconf -n > # 2.2.10: /usr/local/etc/dovecot/dovecot.conf > # OS: Linux 3.8.0-29-generic x86_64 Ubuntu 12.04.3 LTS > ? > passdb { > args = scheme=CRYPT username_format=%u /etc/dovecot/users > driver = passwd-file > } > ssl_cert = ssl_key = userdb { > args = username_format=%u /etc/dovecot/users > driver = passwd-file > } > > ? > Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: imap(armor5): Error: user > armor5: Couldn't drop privileges: User is missing GID (see mail_gid setting) -> ^^^^^^^^^^^^^^^^^^^ <- You userdb seems to be incomplete. ,--[ http://wiki2.dovecot.org/UserDatabase ]-- | ? | The user database lookup returns these fields: | | * uid ? | * gid ? | * home ? | * mail ? | ? `-- See the last example in . The password line for user armor5 would be: armor5:{plain}abc123:1001:1001::/home/armor5 `mail' can be left blank, since you've configured mail_location. Regards, Pascal -- The trapper recommends today: face1e55.1401320 at localdomain.org From me at electronico.nc Tue Jan 14 03:11:11 2014 From: me at electronico.nc (me at electronico.nc) Date: Tue, 14 Jan 2014 02:11:11 +0100 Subject: [Dovecot] dict ldap Message-ID: Hello everybody, Dovecot 2.2.6 with LDAP auth against AD (Samba4). I would like to know if it's possible to specify an LDAP transport for dict (something like dovecot-dict-ldap.conf.ext). I'm in need to setup shared mailboxes and if I could query LDAP, that would help a lot. IE : user1 user2 user3 are in OU=group1, so group1 (setup as user in AD) would share its mailbox with user1 user2 and user3. Thanks in advance for your time. Nicolas From jtam.home at gmail.com Tue Jan 14 03:21:42 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 13 Jan 2014 17:21:42 -0800 (PST) Subject: [Dovecot] Couldn't drop privileges In-Reply-To: References: Message-ID: From: CM Reddy > userdb { > args = username_format=%u /etc/dovecot/users > driver = passwd-file > } > ... > Log information: > ... > Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: imap(armor5): Error: user > armor5: Couldn't drop privileges: User is missing GID (see mail_gid setting) Fairly self-explanatory, isn't it? It appears your userdb does not specify GID for a user. Either define it, or ... In share/doc/dovecot/example-config/conf.d/10-mail.conf: # System user and group used to access mails. If you use multiple, userdb # can override these by returning uid or gid fields. You can use either numbers # or names. #mail_uid = ... if all your users share the the same GID, set it here. Joseph Tam From kremels at kreme.com Tue Jan 14 04:53:08 2014 From: kremels at kreme.com (LuKreme) Date: Mon, 13 Jan 2014 19:53:08 -0700 Subject: [Dovecot] panic! Message-ID: (I will not make a joke about the streets of Carlyle) Jan 13 19:09:07 mail dovecot: lda(john at example.com): Panic: file mail-transaction-log-file.c: line 1148 (mail_transaction_log_file_get_highest_modseq_at): assertion failed: (offset <= file->sync_offset) Jan 13 19:09:08 mail kernel: pid 8435 (dovecot-lda), uid 89: exited on signal 6 (core dumped) Jan 13 19:14:16 mail dovecot: lda(john at example.com): Panic: file mail-transaction-log-file.c: line 1148 (mail_transaction_log_file_get_highest_modseq_at): assertion failed: (offset <= file->sync_offset) Jan 13 19:14:16 mail kernel: pid 9648 (dovecot-lda), uid 89: exited on signal 6 (core dumped) Just the one user, seems to happen every time he checks mail. I am not using LDA at all. $ doveconf -n # 2.2.5: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 9.1-RELEASE i386 auth_mechanisms = PLAIN LOGIN disable_plaintext_auth = no first_valid_uid = 89 login_log_format_elements = user=<%u> %r %m %c mail_location = maildir:~/Maildir mail_max_userip_connections = 90 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox NotJunk { auto = subscribe } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } ssl_cert = References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 13 Jan 2014, Jacek Osiecki wrote: > The sieve file is simple: forward message and reply with vacation: > ---- > require ["copy","vacation"]; > # rule:[redirect] > if anyof (true) > { > redirect :copy "my.boss at newdomain.pl"; > vacation :days 1 :addresses > ["my.name at olddomain.pl","my.name at newdomain.pl"] text: > I'm unavailable now. > > Please contact my boss: my.boss at newdomain.pl > > Greetings > . > ; > } > ---- > > When I send email to my.name at olddomain.pl - it is sent to > my.boss at newdomain.pl and I receive the vacation message. > > When I send it to the alias (my.name at newdomain.pl) - none of above is done. > > Any idea how I can debug it? Running test-sieve does not help - it claims > that will simply forward and deliver the message... First, try to determine, if the Sieve script runs for newdomain at all, e.g. add a fileinto at the beginning of the script. Second, in v2 there is a dovecot.sieve.log file for Sieve error messages - not syntax, but processing errors. Maybe Sieve cannot send messages with my.name at newdomain.pl sender, check out mail log, too. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUtTuNnD1/YhP6VMHAQLuYAf+LmBpZikSxTMM3IPGjf36FkBPfbNgOANn c8oyS43hv7io3+l7kRfjQZ+Awfb/ha2eYmYDefHNfV2jC+3vx1oPI+kNd8ZjXtqE V1ut/unFZISKVqmF639o2DhJQ51zzH+TM0hGFIuBwj9XBRctmRdCPZax3qfwTK3T ENIR7MYFqA0c+OswM27SVF4oqdi8bLWtLnRkyBW7s10l1o9e5Jh7P2PUCpPFrBOM v9cFoK8dr06/S0YBqkFZIr6I7/UG3h20KbcuFO0xZBN+nu74c/4xSq0Ys9mpKboK GGfP+VcXwPldITatbLRjqQd9vsTeU1JINAZ4Wf8Qr7FXHbz7siA01g== =G9gE -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Tue Jan 14 12:24:35 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 14 Jan 2014 11:24:35 +0100 (CET) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: <52D07C29.50806@smail.inf.fh-brs.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 12 Jan 2014, Greg Rivers wrote: > On Sat, 11 Jan 2014, Steffen wrote: > >> I have: >> ... deliverable: mailer local, user uid+detail >> instead of "deliverable: mailer local, host detail, user gcr" >> >> Hmm, see >> http://etutorials.org/Server+Administration/Sendmail/Part+I+Build+and+Install/Chapter+4.+Configure+sendmail.cf+with+m4/FEATUREpreserve_local_plus_detail/ >> >> My mc-file has this setting commented out (prefixed by dnl). Ah, I see >> where the processing differs. I had added this: >> >> SLocal_localaddr >> R< $* > $1 Remove <> from address >> R$+ + $* $: $1 Remove detail from address >> R$+ $: <$(localuser $1 $: TEMPFAIL $)> $1 Query socket >> map server, if that's a local user >> R $* $# ok yes, this preserves detail >> R $* $# error $@ 5.7.1 $: 550 User unknown >> R $* $# error $@ TEMPFAIL $: $1 try again later Does >> it work???? >> >> See the R line. The map is to verify if the user is local or not. >> In my system sendmail cannot do so on its own. Maybe the FEATURE above >> works for the standard config. >> > > "FEATURE(`preserve_local_plus_detail')" is actually one of the first things I > tried when I started working on this problem, but it doesn't quite work with > the standard configuration: > > $ sendmail -bv -d21.12 gcr+XYZZY at badger.tharned.org > -----rule matches: $@ $1 > rewritten as: gcr + xyzzy > rewrite: ruleset localaddr returns: gcr + xyzzy > gcr+XYZZY at badger.tharned.org... User unknown OK, that rings a bell: the problem is the "w" flag. It checks that a valid system exists. If you remove the "w" flag, you loose the system user validaty check and the .forward feature. You have four ways, IMHO: a) switch to LDA b) add Local_localaddr to validate the user yourself and accept that the .forward feature is not working c) I've patched sendmail's mailbox database code with a Dovecot stub, that queries the UserDB socket for validity of the users. If you use system users, you could probably just patch libsm/mbdb.c: mbdb_pw_lookup(name, user) to cut the +detail, something like: char *detailp; if(detailp = strchr(name, '+')) *detailp = '\0'; pw = getpwnam(name); if(detailp) *detailp = '+'; This code is untested and I don't know, if mbdb_pw_lookup() could get passed in a pointer to a constant, which would throw a SEGV or SIGBUS or whatever signal and dump core. d) try a PAM module in pam.d/sendmail, that strips the +detail before processing the request e) try to file a bug with sendmail. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUtUQY3D1/YhP6VMHAQI6aAf8D6Z+ba8G+PePQqyPmQY+D8ZBjFXm6dqj fT/MvAazs8YZJTs/vvxzZ9IWwQPbnSzBTCUdChouzxtA1NPHUwvO23hkR8oFaLT2 8wtfQCJ4e1BXclfqgGO/COJ632IvE7ygvhMmwAtV5+WHil8Ea1hyjTAwpzXUL4Im btkHvTkGiW/m2CZsaaIJ2keeMGK8ygWgU/7ZCtEi+2M4MF3WhGiGZznRAnAfkfr8 fk7ybicEpLD5VGpRc5+D47XT+KM6ViI/Wou3hVzGJ8MsbPxn6kIeRmZHY24xtPyW 5Q0YoD9nYUZorwN2LNAj15TRNztodwewZH3HUAoFYGAM3YVQWuRxTQ== =ye9c -----END PGP SIGNATURE----- From gcr+dovecot at tharned.org Tue Jan 14 16:14:26 2014 From: gcr+dovecot at tharned.org (Greg Rivers) Date: Tue, 14 Jan 2014 08:14:26 -0600 (CST) Subject: [Dovecot] Dovecot LMTP does not pass envelope recipient +detail to sieve In-Reply-To: References: <52D07C29.50806@smail.inf.fh-brs.de> Message-ID: On Tue, 14 Jan 2014, Steffen Kaiser wrote: >> "FEATURE(`preserve_local_plus_detail')" is actually one of the first things >> I tried when I started working on this problem, but it doesn't quite work >> with the standard configuration: >> >> $ sendmail -bv -d21.12 gcr+XYZZY at badger.tharned.org >> -----rule matches: $@ $1 >> rewritten as: gcr + xyzzy >> rewrite: ruleset localaddr returns: gcr + xyzzy >> gcr+XYZZY at badger.tharned.org... User unknown > > OK, that rings a bell: > the problem is the "w" flag. It checks that a valid system exists. > > If you remove the "w" flag, you loose the system user validaty check and > the .forward feature. > Yes, I had considered that. > You have four ways, IMHO: > > a) switch to LDA > That's what I plan to do in the interim. > b) add Local_localaddr to validate the user yourself and accept that the > .forward feature is not working > I can't do without .forward. > c) I've patched sendmail's mailbox database code with a Dovecot stub, > that queries the UserDB socket for validity of the users. If you use > system users, you could probably just patch libsm/mbdb.c: > mbdb_pw_lookup(name, user) to cut the +detail, something like: > > [snip] > > d) try a PAM module in pam.d/sendmail, that strips the +detail before > processing the request > These would be a last resort. > e) try to file a bug with sendmail. > Actually I did that yesterday. Claus Assmann is looking at it with me, so I'm sure to get more good advise. Thanks for looking at it and for your really useful suggestions. (BTW, options a through e is five ways, not four. :-) I'll keep this thread updated with my findings. -- Greg From morrisonli at 126.com Tue Jan 14 18:42:48 2014 From: morrisonli at 126.com (morrison) Date: Wed, 15 Jan 2014 00:42:48 +0800 (CST) Subject: [Dovecot] SSL/TLS handshake stays forever without timeout Message-ID: <7c8088f4.182fc.14391a248eb.Coremail.morrisonli@126.com> Hi, I am a system admin and I am evaluating using dovecot as our email server. In my test, I found that if I telneted to 993 port and did not do anything or I telneted to 143 port, sent starttls command and then did not do anything, the connection stayed forever without timeout. This will make our mail server vulnerable to DOS attack. I dig into dovecot Wiki and did not find any solution. This seems to me that dovecot does not handle SSL/TLS handshake timeout. I am wondering if this is a known issue and will be fixed in near future. Thanks, From maciej.uhlig at us.edu.pl Tue Jan 14 19:53:52 2014 From: maciej.uhlig at us.edu.pl (Maciej Uhlig) Date: Tue, 14 Jan 2014 18:53:52 +0100 Subject: [Dovecot] Fatal: master: service(lmtp): child n killed with signal 11 (core dumped) - in mail_cache_header_fields_read Message-ID: <52D579B0.8040602@us.edu.pl> This is log from dovecot 2.1.17 (I had to downgrade from 2.2.10 because lot of problems) on CentOS 6.5: 2014-01-14T18:36:03+01:00 server/a.b.c.d dovecot: lmtp(5927): Fatal: master: service(lmtp): child 5927 killed with signal 11 (core dumped) # uname -a Linux server 2.6.32-431.1.2.0.1.el6.x86_64 #1 SMP Fri Dec 13 13:06:13 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux (gdb) bt full #0 0x00007fb14b9b3bb5 in mail_cache_header_fields_read () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #1 0x00007fb14b9b19aa in mail_cache_open_and_verify () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #2 0x00007fb14b9b35bd in mail_cache_register_get_list () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #3 0x00007fb14b9a11a7 in index_mail_parse_header_init () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #4 0x00007fb14b9a1ff8 in index_mail_cache_parse_init () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #5 0x00007fb14b94c982 in maildir_save_add () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #6 0x00007fb14b94ccd8 in maildir_save_begin () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #7 0x00007fb14b031b23 in quota_save_begin () from /usr/local/dovecot/lib/dovecot/lib10_quota_plugin.so ---Type to continue, or q to quit--- No symbol table info available. #8 0x00007fb14b982552 in mailbox_save_begin () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #9 0x00007fb14b97ae8f in mail_storage_copy () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #10 0x00007fb14b948ef6 in maildir_copy () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #11 0x00007fb14ae25551 in notify_copy () from /usr/local/dovecot/lib/dovecot/lib15_notify_plugin.so No symbol table info available. #12 0x00007fb14b031907 in quota_copy () from /usr/local/dovecot/lib/dovecot/lib10_quota_plugin.so No symbol table info available. #13 0x00007fb14b9824aa in mailbox_copy () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #14 0x00007fb14a9d7dc6 in act_store_execute () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #15 0x00007fb14a9ce0f4 in _sieve_result_implicit_keep () ---Type to continue, or q to quit--- from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #16 0x00007fb14a9cfe27 in sieve_result_execute () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #17 0x00007fb14a9df918 in sieve_multiscript_run () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-sieve.so.0 No symbol table info available. #18 0x00007fb14ac2189e in lda_sieve_deliver_mail () from /usr/local/dovecot/lib/dovecot/lib90_sieve_plugin.so No symbol table info available. #19 0x00007fb14bc1d305 in mail_deliver () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot-lda.so.0 No symbol table info available. #20 0x00000000004054c3 in client_input_data_handle () No symbol table info available. #21 0x00007fb14b6ba146 in io_loop_call_io () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot.so.0 No symbol table info available. #22 0x00007fb14b6bb46d in io_loop_handler_run () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot.so.0 No symbol table info available. #23 0x00007fb14b6ba0e8 in io_loop_run () ---Type to continue, or q to quit--- from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot.so.0 No symbol table info available. #24 0x00007fb14b6a4043 in master_service_run () from /usr/local/dovecot-2.1.17/lib/dovecot/libdovecot.so.0 No symbol table info available. #25 0x0000000000404096 in main () No symbol table info available. (gdb) MU -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3354 bytes Desc: Kryptograficzna sygnatura S/MIME URL: From wojciech.giel at cimr.cam.ac.uk Tue Jan 14 21:00:27 2014 From: wojciech.giel at cimr.cam.ac.uk (Wojciech Giel) Date: Tue, 14 Jan 2014 19:00:27 +0000 Subject: [Dovecot] restored mails Message-ID: <52D5894B.9000108@cimr.cam.ac.uk> Hello, I am running dovecot 2.1 on debian wheezy . We are using maildir format. one of our uses deleted content of INBOX folder during xmass. he wants these messages back. I had these mail on tape. I have restored them to his inbox/cur directory but dovecot is not indexing them. Email client shows empty inbox as well. tried manually run: doveadm index -u john -q INBOX no change. deleting indexes didn't help. How to restore these email? thanks Woj my config: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.3 auth_debug = yes auth_mechanisms = plain login cram-md5 auth_verbose = yes listen = * log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = IMAP Server is ready. mail_debug = yes mail_location = maildir:~/Maildir:INDEX=~/dovecot-control/indexes:CONTROL=~/dovecot-control:LAYOUT=fs mail_plugins = " quota trash" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave passdb { driver = pam } passdb { args = scheme=cram-md5 /etc/dovecot/passwd driver = passwd-file } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_mail_sendmail = /usr/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam = Junk;Spam antispam_trash_pattern = Trash;Deleted * antispam_verbose_debug = 0 autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = ~/.dovecot.sieve sieve_default = /var/spool/dovecot/default.sieve sieve_dir = ~/sieve sieve_global_dir = /var/spool/dovecot/ trash = /etc/dovecot/dovecot-trash.conf.ext } protocols = imap sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-master { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 2000 } } service quota-warning { executable = script /usr/bin/dovecot-quota-warning.sh user = postfix } ssl_ca = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags mail_max_userip_connections = 10 mail_plugins = " quota trash imap_quota autocreate antispam" } 1379333576.M520387P21423.pine,S=5016,W=5183:2,S 1389710739.M139355P6177.pine,S=38933,W=39648:2,Sd 1379340386.M670300P24951.pine,S=2282,W=2328:2,S 1389710937.M15977P6316.pine,S=20426,W=20831:2,Sd 1379342173.M207466P25909.pine,S=2649,W=2700:2,S 1389715067.M350398P8795.pine,S=18288,W=18549:2,Sd 1379343332.M808399P26628.pine,S=3862,W=3952:2,S 1389715305.M250290P8929.pine,S=4264,W=4346:2,Sd 1379343742.M248785P27359.pine,S=4772,W=4891:2,RS 1389723554.M26883P13831.pine,S=47655,W=47979:2,d 1379343783.M47728P27388.pine,S=22571,W=23053:2,S root at pine:/home/john/Maildir/INBOX/cur# From kremels at kreme.com Tue Jan 14 21:17:20 2014 From: kremels at kreme.com (LuKreme) Date: Tue, 14 Jan 2014 12:17:20 -0700 Subject: [Dovecot] panic! In-Reply-To: References: Message-ID: <7F8E252B-95BB-44E7-8714-0FC8C62997DA@kreme.com> In our previous episode (Monday, 13-Jan-2014), LuKreme said: > Jan 13 19:09:07 mail dovecot: lda(john at example.com): Panic: file mail-transaction-log-file.c: line 1148 (mail_transaction_log_file_get_highest_modseq_at): assertion failed: (offset <= file->sync_offset) > Jan 13 19:09:08 mail kernel: pid 8435 (dovecot-lda), uid 89: exited on signal 6 (core dumped) > Jan 13 19:14:16 mail dovecot: lda(john at example.com): Panic: file mail-transaction-log-file.c: line 1148 (mail_transaction_log_file_get_highest_modseq_at): assertion failed: (offset <= file->sync_offset) > Jan 13 19:14:16 mail kernel: pid 9648 (dovecot-lda), uid 89: exited on signal 6 (core dumped) No one? -- I mistook thee for thy better Hamlet Act III scene 4 From user+dovecot at localhost.localdomain.org Tue Jan 14 21:26:30 2014 From: user+dovecot at localhost.localdomain.org (Pascal Volk) Date: Tue, 14 Jan 2014 19:26:30 +0000 Subject: [Dovecot] SSL/TLS handshake stays forever without timeout In-Reply-To: <7c8088f4.182fc.14391a248eb.Coremail.morrisonli@126.com> References: <7c8088f4.182fc.14391a248eb.Coremail.morrisonli@126.com> Message-ID: <52D58F66.5030008@localhost.localdomain.org> On 01/14/2014 04:42 PM morrison wrote: > Hi, > > I am a system admin and I am evaluating using dovecot as our email server. In my test, I found that if I telneted to 993 port and did not do anything or I telneted to 143 port, sent starttls command and then did not do anything, the connection stayed forever without timeout. This will make our mail server vulnerable to DOS attack. I dig into dovecot Wiki and did not find any solution. This seems to me that dovecot does not handle SSL/TLS handshake timeout. I am wondering if this is a known issue and will be fixed in near future. > > Thanks, > Please define 'forever' I just did `time openssl s_client -connect mail.example.com:143 -starttls imap` (and nothing else): CONNECTED(00000003) depth=0 CN = mail.? ? . OK Pre-login capabilities listed, post-login capabilities have more. * BYE Disconnected for inactivity. closed real 3m0.377s user 0m0.016s sys 0m0.000s As you can see, Dovecot closed the connection after three minutes. Regards, Pascal -- The trapper recommends today: fabaceae.1401420 at localdomain.org From h.reindl at thelounge.net Tue Jan 14 21:29:31 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Tue, 14 Jan 2014 20:29:31 +0100 Subject: [Dovecot] SSL/TLS handshake stays forever without timeout In-Reply-To: <52D58F66.5030008@localhost.localdomain.org> References: <7c8088f4.182fc.14391a248eb.Coremail.morrisonli@126.com> <52D58F66.5030008@localhost.localdomain.org> Message-ID: <52D5901B.5030308@thelounge.net> Am 14.01.2014 20:26, schrieb Pascal Volk: > Please define 'forever' > > I just did `time openssl s_client -connect mail.example.com:143 > -starttls imap` (and nothing else): > > CONNECTED(00000003) > depth=0 CN = mail.? > ? > . OK Pre-login capabilities listed, post-login capabilities have more. > * BYE Disconnected for inactivity. > closed > > real 3m0.377s > user 0m0.016s > sys 0m0.000s > > As you can see, Dovecot closed the connection after three minutes did you read the "This will make our mail server vulnerable to DOS attack" 3 minutes is *way too long* in case of a DOS attack if no single byte data is received there is no reason not to close the connection at least after 30 seconds -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From adi at ente.limmat.ch Tue Jan 14 21:38:00 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Tue, 14 Jan 2014 20:38:00 +0100 Subject: [Dovecot] SSL/TLS handshake stays forever without timeout In-Reply-To: <52D58F66.5030008@localhost.localdomain.org> References: <7c8088f4.182fc.14391a248eb.Coremail.morrisonli@126.com> <52D58F66.5030008@localhost.localdomain.org> Message-ID: <52D59218.6010208@ente.limmat.ch> Hi Pascal Am 14.01.14 20:26 schrieb Pascal Volk: > On 01/14/2014 04:42 PM morrison wrote: > Please define 'forever' > > I just did `time openssl s_client -connect mail.example.com:143 > -starttls imap` (and nothing else): This is not the test morrison has suggested. Doing his test with telnet and thus not complete the SSL handshake, the connection stays open much longer than 3 Minutes. I closed the connection now manually after a little more than 2 hours. This is on Dovecot 2.1.7. Regards, Adrian. From sca at andreasschulze.de Wed Jan 15 00:54:37 2014 From: sca at andreasschulze.de (Andreas Schulze) Date: Tue, 14 Jan 2014 23:54:37 +0100 Subject: [Dovecot] SSL/TLS handshake stays forever without timeout In-Reply-To: <52D59218.6010208@ente.limmat.ch> References: <7c8088f4.182fc.14391a248eb.Coremail.morrisonli@126.com> <52D58F66.5030008@localhost.localdomain.org> <52D59218.6010208@ente.limmat.ch> Message-ID: <20140114225437.GA25663@solar.andreasschulze.de> Am 14.01.2014 20:38 schrieb Adrian Zaugg: > This is not the test morrison has suggested. Doing his test with telnet > and thus not complete the SSL handshake, the connection stays open much > longer than 3 Minutes. I closed the connection now manually after a > little more than 2 hours. This is on Dovecot 2.1.7. same here with dovecot-2.2.10 $ date; telnet imaphost 143 Di 14. Jan 21:57:59 CET 2014 . starttls . OK Begin TLS negotiation now. ... now it's 23:53 ant the tcp connection is still established. in contrast: postfix-2.11 $ date; telnet mx 25; date Di 14. Jan 23:42:45 CET 2014 ... starttls 220 2.0.0 Ready to start TLS Connection closed by foreign host. Di 14. Jan 23:48:10 CET 2014 looks like postfix handle the timeout smarter. Andreas From ammdispose-dovecot at yahoo.com Wed Jan 15 07:08:25 2014 From: ammdispose-dovecot at yahoo.com (A M) Date: Wed, 15 Jan 2014 13:08:25 +0800 (SGT) Subject: [Dovecot] dsync mbox to maildir migration does not delete, deleted e-mails Message-ID: <1389762505.99939.YahooMailNeo@web194605.mail.sg3.yahoo.com> Hello, I am planning to migrate all users from mbox to maildir. I am trying to do it with minimum downtime. (~100GB data) All users are currently using POP3. Dovecot version is 2.2.10 (latest). Command used is: dsync -u username mirror maildir:~/Maildir Process I plan is: (omitting steps related to sendmail / procmail) 1) keep dovecot running (with mail_location as mbox) 2) dsync for all users (this may take 3-4 hours or more) 3) (downtime starts) stop dovecot and sendmail (to stop new e-mails) 4) block pop3, imap ports on firewall (so users can not connect) 5) start dovecot (still with mbox) 6) dsync again to sync e-mails arrived between step 2 and 3 7) dsync again (just to make sure!) 8) (downtime ends) restart dovecot (with mail_location as maildir) Now, here is my problem. Lets say there is user joe, who has 50 NEW e-mails in mbox (INBOX). Step 2 perfectly syncs his 50 e-mails to 'new' folder of maildir. Now in the mean time, before step 3, he connected via POP3 and downloaded and deleted 50 e-mails. Now when we reach step 6 (re-sync), what I expected was dsync will detect that 50 e-mails are deleted and it will delete 50 e-mails from 'new' directory of maildir. But that is not happening. 50 e-mails are still there. I fear that these e-mails will be re-downloaded on his Outlook once I switch dovecot to maildir. This will happen for each and every user which will cause huge mess. So how to tell, dsync to delete non-existent e-mails which are no more there in mbox (INBOX)? Thanks in advance, Regards, A M From dovecot at pupat-ghestem.net Wed Jan 15 11:03:55 2014 From: dovecot at pupat-ghestem.net (dovecot at pupat-ghestem.net) Date: Wed, 15 Jan 2014 10:03:55 +0100 Subject: [Dovecot] Dovecot service not responding after about a week of uptime In-Reply-To: <51BB3007.6080108@pupat-ghestem.net> References: <514F4685.2020906@pupat-ghestem.net> <78C8CE64-3BFA-4452-B15B-AEF622ED6A36@iki.fi> <514F5B5D.4040304@pupat-ghestem.net> <4FB5DDB4-4388-428E-890B-A84C0CC39608@iki.fi> <514F5D7F.3060802@pupat-ghestem.net> <514F63D3.3030203@pupat-ghestem.net> <6AD39E2D-78BC-46C0-9018-9C948BFB9760@iki.fi> <51BB3007.6080108@pupat-ghestem.net> Message-ID: <52D64EFB.8010009@pupat-ghestem.net> Hello, The issue of dovecot becoming unresponsive happened again but after 16 days instead of just 7 as before. $uptime 09:53:01 up 16 days, 20:23, 1 user, load average: 1.32, 1.01, 0.83 As advised before I tried to login through the IMAP port. Entering an incorrect password gets rejected right away. Entering a correct password just hangs indefinitely. $openssl s_client -connect mail.pupat-ghestem.net:993 -quiet depth=0 CN = mail.pupat-ghestem.net verify error:num=20:unable to get local issuer certificate verify return:1 depth=0 CN = mail.pupat-ghestem.net verify error:num=27:certificate not trusted verify return:1 depth=0 CN = mail.pupat-ghestem.net verify error:num=21:unable to verify the first certificate verify return:1 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN] Dovecot ready. a1 LOGIN wrongUser wrongPassword a1 NO [AUTHENTICATIONFAILED] Authentication failed. a2 LOGIN goodUser goodPassword [HANGS] Jan 15 09:58:58 hebus dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.173.254, lip=192.168.173.2, mpid=29852, TLS, session= After a restart of dovecot everything works fine: systemctl restart dovecot.service Thanks in advance. From bschmidt at cms.hu-berlin.de Wed Jan 15 11:17:54 2014 From: bschmidt at cms.hu-berlin.de (Burckhard Schmidt) Date: Wed, 15 Jan 2014 10:17:54 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 Message-ID: <52D65242.7070306@cms.hu-berlin.de> Hi, forwarding a message with sieve like redirect:copy "me at other.domain"; was working without any problem until dovecot-2.1.17, dovecots lmtp and dovecot-2.1-pigeonhole-0.3.5. Using dovecot-2.2.10 , dovecots lmtp and dovecot-2.2-pigeonhole-0.4.2 the structure of a forwarded message is broken. Content of a message is not displayed or an attachment (for instance pdf) can not be opened by (different) clients. Writing a html mail or plain one makes no different. I have compared two messages and the main different is a missing Content-Type: multipart/alternative; boundary="...." to encapsulate the body of the forwarded message. Was it lost in sieve? Here parts of a "well" forwarded message: Return-Path: ... ... Received: by mails.cms.hu-berlin.de (Postfix, from userid 29) id A78C738734; Tue, 14 Jan 2014 17:10:54 +0100 (CET) X-Sieve: Pigeonhole Sieve 0.3.5 X-Sieve-Redirected-From: schmidt at mails.cms.hu-berlin.de Delivered-To: Received: from mails.cms.hu-berlin.de by suncom1 (Dovecot) with LMTP id p8HoIn9h1VKnTwAA9XuJ/g for ; Tue, 14 Jan 2014 17:10:54 +0100 ... Message-ID: <52D5618D.6050905 at gmail.com> Date: Tue, 14 Jan 2014 17:10:53 +0100 From: xy User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: schmidt at hu-berlin.de Subject: from gmail with attachment Content-Type: multipart/mixed; boundary="------------070108020005050001040207" X-ENVELOPE-TO: This is a multi-part message in MIME format. --------------070108020005050001040207 Content-Type: multipart/alternative; boundary="------------090806050202050708030507" --------------090806050202050708030507 Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 8bit Hallo. text --------------090806050202050708030507 Content-Type: text/html; charset=ISO-8859-15 Content-Transfer-Encoding: 8bit Hallo.

text

P.
--------------090806050202050708030507-- --------------070108020005050001040207 Content-Type: application/pdf; name="auftrag-2014-eng-Hinweise.pdf" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="auftrag-2014-eng-Hinweise.pdf" JVBERi0xLjYNJeLjz9MNCjcyIDAgb2JqDTw ... ... c3RyZWFtDWVuZG9iag1zdGFydHhyZWYNCjExNg0KJSVFT0YNCg== --------------070108020005050001040207-- message end Now a broken message without "Content-Type: multipart/alternative;": Return-Path: ... ... Received: by mail5.cms.hu-berlin.de (Postfix, from userid 29) id 47C4C6D46E; Tue, 14 Jan 2014 17:43:54 +0100 (CET) X-Sieve: Pigeonhole Sieve 0.4.2 X-Sieve-Redirected-From: testuser at mail5.cms.hu-berlin.de Delivered-To: Received: from mail5.cms.hu-berlin.de by suncom5 (Dovecot) with LMTP id mnY0AEpp1VLsaQAA0tuC1A for ; Tue, 14 Jan 2014 17:43:54 +0100 ... Message-ID: <52D56948.1090704 at gmail.com> Date: Tue, 14 Jan 2014 17:43:52 +0100 From: xy User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: testuser at hu-berlin.de Subject: from gmail with attachment Content-Type: multipart/mixed; boundary="------------030506080302040201020604" X-ENVELOPE-TO: This is a multi-part message in MIME format. --------------030506080302040201020604 Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit text. --------------030506080302040201020604 Content-Type: application/pdf; name="auftrag-2014-eng-Hinweise.pdf" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="auftrag-2014-eng-Hinweise.pdf" JVBERi0xLjYNJeLjz... ... c3RyZWFtDWVuZG9iag1zdGFydHhyZWYNCjExNg0KJSVFT0YNCg== --------------030506080302040201020604-- message end -- Mit freundlichen Gr??en --- Burckhard Schmidt Abteilung Systemsoftware und Kommunikation ZE Computer- und Medienservice der Humboldt-Universit?t zu Berlin Postanschrift: Unter den Linden 6, 10099 Berlin Standort: Rudower Chaussee 26; 12489 Berlin Tel.: +49-30-2093-70058 Fax: +49-30-2093-2959 Mail: bschmidt at cms.hu-berlin.de From AxelLuttgens at swing.be Wed Jan 15 14:15:12 2014 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Wed, 15 Jan 2014 13:15:12 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: <52D65242.7070306@cms.hu-berlin.de> References: <52D65242.7070306@cms.hu-berlin.de> Message-ID: <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> Le 15 janv. 2014 ? 10:17, Burckhard Schmidt a ?crit : > Hi, > forwarding a message with sieve like > > redirect:copy "me at other.domain"; > > was working without any problem until dovecot-2.1.17, dovecots lmtp and dovecot-2.1-pigeonhole-0.3.5. > > Using dovecot-2.2.10 , dovecots lmtp and dovecot-2.2-pigeonhole-0.4.2 the structure of a forwarded message is broken. Content of a message is not displayed or an attachment (for instance pdf) can not be opened by (different) clients. Writing a html mail or plain one makes no different. > > I have compared two messages and the main different is a missing > > Content-Type: multipart/alternative; > boundary="...." > > to encapsulate the body of the forwarded message. Was it lost in sieve? Hello Burckhard, Just to be sure. Above excerpt and your two sample messages invariably show "boundary=" items starting at the beginning of a new line. Is this really the case? Axel From bschmidt at cms.hu-berlin.de Wed Jan 15 14:19:37 2014 From: bschmidt at cms.hu-berlin.de (Burckhard Schmidt) Date: Wed, 15 Jan 2014 13:19:37 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> Message-ID: <52D67CD9.7050608@cms.hu-berlin.de> Am 15.01.2014 13:15, schrieb Axel Luttgens: > Le 15 janv. 2014 ? 10:17, Burckhard Schmidt a ?crit : > >> Hi, >> forwarding a message with sieve like >> >> redirect:copy "me at other.domain"; >> >> was working without any problem until dovecot-2.1.17, dovecots lmtp and dovecot-2.1-pigeonhole-0.3.5. >> >> Using dovecot-2.2.10 , dovecots lmtp and dovecot-2.2-pigeonhole-0.4.2 the structure of a forwarded message is broken. Content of a message is not displayed or an attachment (for instance pdf) can not be opened by (different) clients. Writing a html mail or plain one makes no different. >> >> I have compared two messages and the main different is a missing >> >> Content-Type: multipart/alternative; >> boundary="...." >> >> to encapsulate the body of the forwarded message. Was it lost in sieve? > > Hello Burckhard, > > Just to be sure. > Above excerpt and your two sample messages invariably show "boundary=" items starting at the beginning of a new line. > Is this really the case? > > Axel > > Sorry, I lost the leading space by cut/paste. -- Mit freundlichen Gr??en --- Burckhard Schmidt Abteilung Systemsoftware und Kommunikation ZE Computer- und Medienservice der Humboldt-Universit?t zu Berlin Postanschrift: Unter den Linden 6, 10099 Berlin Standort: Rudower Chaussee 26; 12489 Berlin Tel.: +49-30-2093-70058 Fax: +49-30-2093-2959 Mail: bschmidt at cms.hu-berlin.de From ammdispose-dovecot at yahoo.com Wed Jan 15 14:24:26 2014 From: ammdispose-dovecot at yahoo.com (A M) Date: Wed, 15 Jan 2014 20:24:26 +0800 (SGT) Subject: [Dovecot] dsync mbox to maildir migration does not delete, deleted e-mails In-Reply-To: <1389762505.99939.YahooMailNeo@web194605.mail.sg3.yahoo.com> References: <1389762505.99939.YahooMailNeo@web194605.mail.sg3.yahoo.com> Message-ID: <1389788666.52773.YahooMailNeo@web194605.mail.sg3.yahoo.com> I think I have found solution. CONVERTING section of dsync man page suggests to use 'mirror' command. But I think, right command is 'backup' and not 'mirror'. With 'backup' as command, I found that it copies only new e-mails and also deletes DELETED messages (which is exactly what I wanted) 'mirror' is for 2 way syncing but for CONVERTING, in most cases, one needs 1 way syncing (backup) Possibly the dsync man page also needs this change. Hope it helps others. Regards, A M ________________________________ From: A M To: "dovecot at dovecot.org" Sent: Wednesday, 15 January 2014 10:38 AM Subject: [Dovecot] dsync mbox to maildir migration does not delete, deleted e-mails Hello, I am planning to migrate all users from mbox to maildir. I am trying to do it with minimum downtime. (~100GB data) All users are currently using POP3. Dovecot version is 2.2.10 (latest). Command used is: dsync -u username mirror maildir:~/Maildir Process I plan is: (omitting steps related to sendmail / procmail) 1) keep dovecot running (with mail_location as mbox) 2) dsync for all users (this may take 3-4 hours or more) 3) (downtime starts) stop dovecot and sendmail (to stop new e-mails) 4) block pop3, imap ports on firewall (so users can not connect) 5) start dovecot (still with mbox) 6) dsync again to sync e-mails arrived between step 2 and 3 7) dsync again (just to make sure!) 8) (downtime ends) restart dovecot (with mail_location as maildir) Now, here is my problem. Lets say there is user joe, who has 50 NEW e-mails in mbox (INBOX). Step 2 perfectly syncs his 50 e-mails to 'new' folder of maildir. Now in the mean time, before step 3, he connected via POP3 and downloaded and deleted 50 e-mails. Now when we reach step 6 (re-sync), what I expected was dsync will detect that 50 e-mails are deleted and it will delete 50 e-mails from 'new' directory of maildir. But that is not happening. 50 e-mails are still there. I fear that these e-mails will be re-downloaded on his Outlook once I switch dovecot to maildir. This will happen for each and every user which will cause huge mess. So how to tell, dsync to delete non-existent e-mails which are no more there in mbox (INBOX)? Thanks in advance, Regards, A M From AxelLuttgens at swing.be Wed Jan 15 14:52:43 2014 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Wed, 15 Jan 2014 13:52:43 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: <52D67CD9.7050608@cms.hu-berlin.de> References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> <52D67CD9.7050608@cms.hu-berlin.de> Message-ID: Le 15 janv. 2014 ? 13:19, Burckhard Schmidt a ?crit : >> [...] > Sorry, I lost the leading space by cut/paste. Fine, thank you for the clarification. Could you try something along these lines: redirect "me at other.domain"; keep; instead of: redirect:copy "me at other.domain"; and see whether the mime info disappears as well? Axel From bschmidt at cms.hu-berlin.de Wed Jan 15 15:50:46 2014 From: bschmidt at cms.hu-berlin.de (Burckhard Schmidt) Date: Wed, 15 Jan 2014 14:50:46 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> <52D67CD9.7050608@cms.hu-berlin.de> Message-ID: <52D69236.1050605@cms.hu-berlin.de> Am 15.01.2014 13:52, schrieb Axel Luttgens: > Le 15 janv. 2014 ? 13:19, Burckhard Schmidt a ?crit : > >>> [...] >> Sorry, I lost the leading space by cut/paste. > > Fine, thank you for the clarification. > > Could you try something along these lines: > > redirect "me at other.domain"; > keep; > > instead of: > > redirect:copy "me at other.domain"; > > and see whether the mime info disappears as well? > > Axel > That does not help, still missing a Content-Type: multipart/alternative; Burckhard -- Mit freundlichen Gr??en --- Burckhard Schmidt Abteilung Systemsoftware und Kommunikation ZE Computer- und Medienservice der Humboldt-Universit?t zu Berlin Postanschrift: Unter den Linden 6, 10099 Berlin Standort: Rudower Chaussee 26; 12489 Berlin Tel.: +49-30-2093-70058 Fax: +49-30-2093-2959 Mail: bschmidt at cms.hu-berlin.de From slitt at troubleshooters.com Wed Jan 15 15:52:24 2014 From: slitt at troubleshooters.com (Steve Litt) Date: Wed, 15 Jan 2014 08:52:24 -0500 Subject: [Dovecot] Thanks for the help Message-ID: <20140115085224.6b00307d@mydesk> Hi all, I'd like to thank the people on #dovecot, especially jaybe, for helping me fix my Dovecot after a reinstall broke it. Thanks, SteveT Steve Litt * http://www.troubleshooters.com/ Troubleshooting Training * Human Performance From dovecot at lists.wgwh.ch Wed Jan 15 16:14:12 2014 From: dovecot at lists.wgwh.ch (Oli Schacher) Date: Wed, 15 Jan 2014 15:14:12 +0100 Subject: [Dovecot] restored mails In-Reply-To: <52D5894B.9000108@cimr.cam.ac.uk> References: <52D5894B.9000108@cimr.cam.ac.uk> Message-ID: <20140115151412.39c80ec2@lists.wgwh.ch> On Tue, 14 Jan 2014 19:00:27 +0000 Wojciech Giel wrote: > I am running dovecot 2.1 on debian wheezy . We are using maildir > format. one of our uses deleted content of INBOX folder during > xmass. he wants these messages back. > I had these mail on tape. I have restored them to his inbox/cur > directory but dovecot is not indexing them. Email client shows empty > inbox as well. Have you verified the the ownership/permissions of the restored files? Also check for any warnings/errors in your maillog when you access that mailbox. From skdovecot at smail.inf.fh-brs.de Wed Jan 15 16:29:55 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen) Date: Wed, 15 Jan 2014 15:29:55 +0100 Subject: [Dovecot] restored mails In-Reply-To: <52D5894B.9000108@cimr.cam.ac.uk> References: <52D5894B.9000108@cimr.cam.ac.uk> Message-ID: <52D69B63.9020607@smail.inf.fh-brs.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Wojciech Giel wrote: > Hello, I am running dovecot 2.1 on debian wheezy . We are using > maildir format. one of our uses deleted content of INBOX folder > during xmass. he wants these messages back. I had these mail on > tape. I have restored them to his inbox/cur directory but dovecot > is not indexing them. Email client shows empty inbox as well. > tried manually run: > > doveadm index -u john -q INBOX no change. deleting indexes didn't > help. > > How to restore these email? see Oli's advice. Does the user get new mail? Maybe you need to touch the "cur" directory to indicate to Dovecot that an external program changed its content. You could try to create yet another mailbox and move the files there, better: prepare everything outside the Maildir dir, then move the top-directory of the new mailbox in place. - -- Steffen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEVAwUBUtabY3D1/YhP6VMHAQIc+ggApxc4WV+WP+VdV5eQXCBXMaM3zqNJZWV5 y0xBqbGqQp2kvcGqdq1l/KlyVp06s4zQE45lPz3pt7suU9HIImOBps9aSC7jafIN tJXyn9ym2a0RhyAkOZUzN6SN0hajgpe3/EiUfoxf4VjRAL4lmW42CTHzBR1KyYHn PxD25MLv7Vft7s4akwNQz9G8yAlqPnYvlabMHdxsS6s7rS879wWoJo0xRWifq3SI mRqXYIj6nypCSVse/XhB70E/ooIQlBNzgUe6Yt10UbLPKMFd5MO4f73Tbiw1HSV6 IvXDraF3vHQlfISfD6IuGbX9desYSok97NT3U0RE0ReUZ6KXl9L7QQ== =xQDQ -----END PGP SIGNATURE----- From AxelLuttgens at swing.be Wed Jan 15 16:33:05 2014 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Wed, 15 Jan 2014 15:33:05 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: <52D69236.1050605@cms.hu-berlin.de> References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> <52D67CD9.7050608@cms.hu-berlin.de> <52D69236.1050605@cms.hu-berlin.de> Message-ID: Le 15 janv. 2014 ? 14:50, Burckhard Schmidt a ?crit : > Am 15.01.2014 13:52, schrieb Axel Luttgens: >> Le 15 janv. 2014 ? 13:19, Burckhard Schmidt a ?crit : >> >>>> [...] >>> Sorry, I lost the leading space by cut/paste. >> >> Fine, thank you for the clarification. >> >> Could you try something along these lines: >> >> redirect "me at other.domain"; >> keep; >> >> instead of: >> >> redirect:copy "me at other.domain"; >> >> and see whether the mime info disappears as well? >> >> Axel >> > > That does not help, still missing a Content-Type: multipart/alternative; Hello Burckhard, Quickly tried here with dovecot 2.2.8/pigeonhole 0.4.2, and couldn't reproduce the problem with either Content-Type: multipart/alternative; boundary=20cf302234d5b8063c04efcd4318 or Content-Type: multipart/alternative; boundary=20cf302234d5b8063c04efcd4318 in the message headers. The script being a single-line one: redirect "me at other.domain"; I'll try with 2.2.10 as soon as possible. Axel From AxelLuttgens at swing.be Wed Jan 15 17:40:05 2014 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Wed, 15 Jan 2014 16:40:05 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> <52D67CD9.7050608@cms.hu-berlin.de> <52D69236.1050605@cms.hu-berlin.de> Message-ID: Le 15 janv. 2014 ? 15:33, Axel Luttgens a ?crit : > [...] > > I'll try with 2.2.10 as soon as possible. I anyway had to compile 2.2.10. ;-) No more dubious header removal. But but but... Tried again, but now without a leading space at the beginning of the "boundary=" line, i.e. with: Content-Type: multipart/alternative; boundary=20cf302234d5b8063c04efcd4318 I received this one into my mailbox: [...] Content-Type: multipart/alternative; Message-Id: <20140115150454.5A9E28FA2D3 at ALMba.local> Date: Wed, 15 Jan 2014 16:04:49 +0100 (CET) From: me at some.domain X-UID: 287477 Status: X-Keywords: Content-Length: 357 boundary=20cf302234d5b8063c04efcd4318 Subject: sieve test 6 --20cf302234d5b8063c04efcd4318 Content-Type: text/plain; charset=ISO-8859-1 instead of: [...] Content-Type: multipart/alternative; boundary=20cf302234d5b8063c04efcd4318 Subject: sieve test 5 Message-Id: <20140115144803.1C9FB8FA17A at ALMba.local> Date: Wed, 15 Jan 2014 15:47:51 +0100 (CET) From: me at some.domain X-UID: 287476 Status: X-Keywords: Content-Length: 296 --20cf302234d5b8063c04efcd4318 Content-Type: text/plain; charset=ISO-8859-1 [...] So, is could well be that you really are receiving messages without the line-continuation character (the leading white space before "boundary="). On the other hand, I guess the dovecot/pigeonhole behavior isn't the most appropriate one when facing such a malformed message... After removal of the single-line sieve script, thus allowing for direct delivery into the recipient's mailbox, I get a similarly corrupted message. One could thus infer that the source of the message's massaging is on dovecot's side. HTH, Axel From matheus at ghz.com.br Wed Jan 15 18:47:40 2014 From: matheus at ghz.com.br (Matheus Fontes) Date: Wed, 15 Jan 2014 14:47:40 -0200 Subject: [Dovecot] Proxying to MS Exchange 2013 Message-ID: Hi All, I'm new in dovecot list but I already read a thread with same problem: http://www.dovecot.org/list/dovecot/2013-June/091017.html If I try to proxy imap to exchange i got timeout on proxy connection. Someone solved this problem? thanks Matheus Fontes From bschmidt at cms.hu-berlin.de Wed Jan 15 18:56:58 2014 From: bschmidt at cms.hu-berlin.de (Burckhard Schmidt) Date: Wed, 15 Jan 2014 17:56:58 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> <52D67CD9.7050608@cms.hu-berlin.de> <52D69236.1050605@cms.hu-berlin.de> Message-ID: <52D6BDDA.6050205@cms.hu-berlin.de> Am 15.01.2014 16:40, schrieb Axel Luttgens: > Le 15 janv. 2014 ? 15:33, Axel Luttgens a ?crit : > >> [...] >> >> I'll try with 2.2.10 as soon as possible. > > I anyway had to compile 2.2.10. ;-) > > No more dubious header removal. interesting! I tryed to look into the message before and after redirection. I set the message on hold (postfix) to have a look into the original message. I'm not familiar with the format inside the queue: This is shown (using vim) as one line: Subject: 3N^^Content-Type: multipart/mixed;N0 boundary="------------000804020208020000000909"N^@N,This is a mult... between "...mixed;N0 boundary..." is a space like expected. Next view after redirect:copy "..." I have the redirected message in the queue (vim again): ^_X-Sieve: Pigeonhole Sieve 0.4.2N=X-Sieve-Redirected-From:... ... Again, between "...mixed,N0 boundary..." is a space like expected: Subject: 3N^^Content-Type: multipart/mixed;N0 boundary="------------000804020208020000000909"N^@N-This is a multi-part message in MIME format.^MN'--------------000804020208020000000909^MN=Content-Type: text/plain; charset=ISO-8859-15; format=flowed^MN Content-Transfer-Encoding: 7bit^MN^A^MN^Ganbei.^MN^A^MN'--------------000804020208020000000909^MN^_Content-Type: application/pdf;^MN& name="auftrag-2014-eng-Hinweise.pdf"^MN"Content-Transfer-Encoding: base64^MN!Content-Disposition: attachment;^MN* filename="auftrag-2014-eng-Hinweise.pdf"^MN^A^M There is no Content-Type: multipart/alternative; inside the message after redirect. Regards - Burckhard -- Mit freundlichen Gr??en --- Burckhard Schmidt Abteilung Systemsoftware und Kommunikation ZE Computer- und Medienservice der Humboldt-Universit?t zu Berlin Postanschrift: Unter den Linden 6, 10099 Berlin Standort: Rudower Chaussee 26; 12489 Berlin Tel.: +49-30-2093-70058 Fax: +49-30-2093-2959 Mail: bschmidt at cms.hu-berlin.de From fernando.figaro at uol.com.br Wed Jan 15 19:11:09 2014 From: fernando.figaro at uol.com.br (fernando.figaro at uol.com.br) Date: Wed, 15 Jan 2014 15:11:09 -0200 Subject: [Dovecot] possible quota bug ? Message-ID: <52d6c12d677f0_6aff11311301288@a4-weasel5.tmail> Hi, I'm using dovecot 2.2.5 with quota (maildir backend), zlib and expunge plugins. When I list maildirsize file, I get: 1073741824S 17952 16 If I receive a new message (example: 1204 bytes compressed and 2524 bytes plain text), the quota file is write correctly (2524 1 entry). When I move the message to trash folder (or between user custom folders) the file have wrong entries: 1073741824S 17952 16 2524 1 1204 1 (this is the size of the compressed message) -2524 -1 I coudn't find any relation with the config settings causing this problem and checked the changelog since 2.2.5. Had someone had this same problem? Thanks, Fernando ? From skdovecot at smail.inf.fh-brs.de Wed Jan 15 19:28:05 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 15 Jan 2014 18:28:05 +0100 (CET) Subject: [Dovecot] broken message header parsing (was Re: forwarded message is broken in 2.2.10 with pigeonhole-0.4.2) In-Reply-To: References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> <52D67CD9.7050608@cms.hu-berlin.de> <52D69236.1050605@cms.hu-berlin.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 15 Jan 2014, Axel Luttgens wrote: >> I'll try with 2.2.10 as soon as possible. > > I anyway had to compile 2.2.10. ;-) > No more dubious header removal. > > But but but... > > Tried again, but now without a leading space at the beginning of the "boundary=" line, i.e. with: > > Content-Type: multipart/alternative; > boundary=20cf302234d5b8063c04efcd4318 > > I received this one into my mailbox: > > [...] > Content-Type: multipart/alternative; > Message-Id: <20140115150454.5A9E28FA2D3 at ALMba.local> > Content-Length: 357 > > boundary=20cf302234d5b8063c04efcd4318 > Subject: sieve test 6 > > --20cf302234d5b8063c04efcd4318 > Content-Type: text/plain; charset=ISO-8859-1 > > instead of: > > [...] > Content-Type: multipart/alternative; > boundary=20cf302234d5b8063c04efcd4318 > Subject: sieve test 5 > Message-Id: <20140115144803.1C9FB8FA17A at ALMba.local> > > --20cf302234d5b8063c04efcd4318 > Content-Type: text/plain; charset=ISO-8859-1 > [...] > > So, is could well be that you really are receiving messages without the line-continuation character (the leading white space before "boundary="). > > On the other hand, I guess the dovecot/pigeonhole behavior isn't the most appropriate one when facing such a malformed message... Well, you recieve the message text: keyword: body keyword: body nokeyword keyword: body <> message body The line "nokeyword" violates RFC. I wonder why your MTA delivers the message at all. Pigeonhole stops parsing headers at nokeyword, OK. One could probably ignore that broken line instead, but if for some reason the empty line got screwed, one would parse stuff nobody knows where it's from. But if Pigeonhole would believe nokeyword is a continueation of the previous line and unfold it, you open for attacks, IMHO. The message without the leading space in the cont line should look as "raw"/malformed in any mail client. I think Dovecot/Pigeonhole is correct to stop parsing headers after seeing a malformed header line. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUtbFJnD1/YhP6VMHAQKZHggA19M+CJR8p2OeAt16a6XhxmMNrnNT//MD iukjdeRBFBUIR3MNlSVPP0K3L5fRgdc6tUpfnAMTb6i4pbFRCR7jHHp6xpWDyCic 2M3z2xUuo/AAYDWJiWfs7WUADWDAswvXkEtY714JN63e1Pi4374uI1MxJWCZI5xO 2gsEXrkudBwRhGAlG+3q3cXYqu7AzzZq4ZIKM3L9r/BS0Nlv9uCznibHZMhu9uUI C7rq2Gs3fNo5p95RZ30OdFRKRTn85AzBP7jKR5jW2ugN7ILxZYQC8WmQZ7nxEW6H ShR/QigU0pcrLiLC+S/3ZO1R0aSqbC2DNV9VyVGmvLVrC/tD/SnX4Q== =gmoU -----END PGP SIGNATURE----- From da-dovecotlist-15 at abelonline.de Wed Jan 15 21:11:07 2014 From: da-dovecotlist-15 at abelonline.de (da-dovecotlist-15 at abelonline.de) Date: Wed, 15 Jan 2014 20:11:07 +0100 Subject: [Dovecot] Why does dovecot require the {} password sheme even if there is a $ crypt scheme. In-Reply-To: References: <20140111023406.AF1718C182@mail.abelonline.de> Message-ID: <13248549.Ek6S6iQB3N@skynet2> Thanks! It does seem to work. On Monday 13 January 2014 12:33:51 Nick Edwards wrote: > It does, we use sha512 for long time > in sql conf use > default_pass_scheme = CRYPT > > it uses the systen crypt then, (NO - this does NOT mean it uses the > ancient 8 char limited crypt) it will use whatever your underlying > operating system allows, and unless you are using something thats more > than 10 years old, it will handle better. > > in our sql table > > $6$68341f21c4d70c67$D9Rbgw.Ecvfdbvfbfgfdbc.................................. > ...etc > > > On 1/11/14, da-dovecotlist-15 at abelonline.de > > wrote: > > The wiki[1] says: > > If all the passwords are in same format, you can use default_pass_scheme > > to > > specify it. Otherwise each password needs to be prefixed with > > "{password-scheme}", for example "{plain}plaintext-password". > > > > Why doesn't dovecot recognize the crypt scheme identifier ($1$ for > > MD5-CRYPT, $6$ for SHA512-CRYPT etc.)? At the moment I have to have the > > following in my db for dovecot to work: > > {SHA512-CRYPT}$6$salt$passwordhash > > > > [1]http://wiki2.dovecot.org/AuthDatabase/SQL From wojciech.giel at cimr.cam.ac.uk Wed Jan 15 21:19:08 2014 From: wojciech.giel at cimr.cam.ac.uk (Wojciech Giel) Date: Wed, 15 Jan 2014 19:19:08 +0000 Subject: [Dovecot] [SOLVED]Re: restored mails In-Reply-To: <52D69B63.9020607@smail.inf.fh-brs.de> References: <52D5894B.9000108@cimr.cam.ac.uk> <52D69B63.9020607@smail.inf.fh-brs.de> Message-ID: <52D6DF2C.50500@cimr.cam.ac.uk> thanks for advice. found a problem collegue synchonized old version of dovecot.conf so: maildir:~/Maildir:INDEX=~/dovecot-control/indexes:CONTROL=~/dovecot-control:LAYOUT=fs vs maildir:~/Maildir:INBOX=~/Maildir/INBOX:INDEX=~/dovecot-control/indexes:CONTROL=~/dovecot-control:LAYOUT=fs Dovecot was looking in ~Maildir/cur instead of ~/Maildir/INBOX/cur. strange that other users didn't complain. anyway it is working so back in business. thanks for help Wojciech On 15/01/14 14:29, Steffen wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Wojciech Giel wrote: >> Hello, I am running dovecot 2.1 on debian wheezy . We are using >> maildir format. one of our uses deleted content of INBOX folder >> during xmass. he wants these messages back. I had these mail on >> tape. I have restored them to his inbox/cur directory but dovecot >> is not indexing them. Email client shows empty inbox as well. >> tried manually run: >> >> doveadm index -u john -q INBOX no change. deleting indexes didn't >> help. >> >> How to restore these email? > see Oli's advice. > Does the user get new mail? > Maybe you need to touch the "cur" directory to indicate to Dovecot > that an external program changed its content. > You could try to create yet another mailbox and move the files there, > better: prepare everything outside the Maildir dir, then move the > top-directory of the new mailbox in place. > > - -- > Steffen > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.9 (Darwin) > Comment: Using GnuPG with undefined - http://www.enigmail.net/ > > iQEVAwUBUtabY3D1/YhP6VMHAQIc+ggApxc4WV+WP+VdV5eQXCBXMaM3zqNJZWV5 > y0xBqbGqQp2kvcGqdq1l/KlyVp06s4zQE45lPz3pt7suU9HIImOBps9aSC7jafIN > tJXyn9ym2a0RhyAkOZUzN6SN0hajgpe3/EiUfoxf4VjRAL4lmW42CTHzBR1KyYHn > PxD25MLv7Vft7s4akwNQz9G8yAlqPnYvlabMHdxsS6s7rS879wWoJo0xRWifq3SI > mRqXYIj6nypCSVse/XhB70E/ooIQlBNzgUe6Yt10UbLPKMFd5MO4f73Tbiw1HSV6 > IvXDraF3vHQlfISfD6IuGbX9desYSok97NT3U0RE0ReUZ6KXl9L7QQ== > =xQDQ > -----END PGP SIGNATURE----- -- wojciech.giel at cimr.cam.ac.uk JDRF/WT Diabetes and Inflammation Laboratory (DIL) Cambridge Institute for Medical Research (CIMR) University of Cambridge Wellcome Trust/MRC Building Addenbrooke's Hospital Hills Road Cambridge CB2 0XY Tel: 01223 763228 From adi at ente.limmat.ch Wed Jan 15 23:23:19 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Wed, 15 Jan 2014 22:23:19 +0100 Subject: [Dovecot] int/ext mailserver In-Reply-To: References: Message-ID: <52D6FC47.6070003@ente.limmat.ch> Hi Mr.Pine Am 19.12.13 08:59 schrieb Mr.Pine: > 1. I have a root access to ext mail server. But do not know my ext > user password!. How can I use getmail to move ext mail to internal > one?! You better ask this on the getmail mailing list: http://pyropus.ca/software/getmail/documentation.html#mailing-list-users > 2. What is your idea about syncing users password in internal/external > mail server?! I think its needed for getmail! ditto > 3. How can I restrict my internal users to send mail only internally!? This probably is done best in postfix. Your setup seems very weird to me, I suppose I am not the only one - anyway you will have your reasons. Regards, Adrian. From RPlatel at tucows.com Wed Jan 15 23:29:32 2014 From: RPlatel at tucows.com (Richard Platel) Date: Wed, 15 Jan 2014 16:29:32 -0500 Subject: [Dovecot] EAGAIN in dict proxy Message-ID: <1F59D836-B879-4151-BEE2-C0F8076C4171@tucows.com> Hello, We?re using a custom program to manage quotas talking to dovecot via the dovecot dict proxy protocol over a unix socket: plugin { quota = dict:User quota::proxy:/var/run/auth_proxy_dovecot/quotasocket:quota } Dovecot gets slammed with quota requests periodically, seemingly because Thunderbird thought it would be a good idea to hardcode having a quota check at 45 seconds past the minute, and thus every Thunderbird client makes several GETQUOTAROOT requests simultaneously. This causes dovecot to make many client connections to the quota proxy, and many of them fail with EAGAIN. In the log we see: Jan 15 16:52:46 imap25 dovecot: imap(rplatel at tucows.com): Error: net_connect_unix(/var/run/auth_proxy_dovecot/quotasocket) failed: Resource temporarily unavailable And the client gets: * QUOTAROOT Spam "User quota"[0d][0a] * QUOTA "User quota" ()[0d][0a] * BAD Internal quota calculation error[0d][0a] 19 OK Getquotaroot completed.[0d][0a] Thunderbird transparently disconnects and reconnects at this point but obviously this is not ideal. Writing some toy programs, I found that even making a forked server with several processes doing nothing but accept()ing on the listening socket, with a high number for the listen queue, it?s easy to overwhelm it with simultaneous clients who then get EAGAIN. If the clients do indeed immediately try again, they are successful. (An INET listening socket does not seem to have this problem, incidentally) All of this is a long-winded way of saying that I believe in lib-dict/dict-client.c:client_dict_connect() the call to net_connect_unix should be a call to net_connect_unix_with_retries() with a small timeout. It would also be useful for us if an INET socket could be used. From AxelLuttgens at swing.be Thu Jan 16 00:29:17 2014 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Wed, 15 Jan 2014 23:29:17 +0100 Subject: [Dovecot] broken message header parsing (was Re: forwarded message is broken in 2.2.10 with pigeonhole-0.4.2) In-Reply-To: References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> <52D67CD9.7050608@cms.hu-berlin.de> <52D69236.1050605@cms.hu-berlin.de> Message-ID: <40886261-5C46-4235-AC80-EB53E1531529@swing.be> Le 15 janv. 2014 ? 18:28, Steffen Kaiser a ?crit : > [...] > Well, you recieve the message text: > > keyword: body > keyword: body > nokeyword > keyword: body > <> > message body Yes, I was trying to reproduce Burckhard's problem by voluntarily omitting the line-continuation character (hence the above "nokeyword"). > The line "nokeyword" violates RFC. Indeed. ;-) > I wonder why your MTA delivers the message at all. Good question... In fact, I was precisely trying to understand where exactly the massaging could happen, when your message arrived. In my previous trials, I did a "telnet 127.0.0.1 25" for sending my bogus message; that meant: postfix -> dovecot's lmtp -> mailbox I then tried something I should have tried before posting: a telnet directly to lmtp. In that case, the bogus message is delivered *as is*, without spurious re-ordering nor removal. I'm reproducing those trials at the end of this message. So, it looks like postfix could somehow be blamed, not dovecot as I perhaps erroneously wrote. (more precisely, postfix-2.11-20130327, which I should probably replace anyway here on my testbed) My apologies... > Pigeonhole stops parsing headers at nokeyword, OK. Well, yes and no... I've just retried with a redirect to "her at some.domain", still through a telnet against lmtp: lmtp -> mailbox (with sieve redirect) And it appears that the message headers are now mangled, with exactly the same pattern as in the case of: postfix -> dovecot's lmtp -> mailbox (without sieve redirect) Not sure how to interpret such results... But it seems that pigeonhole isn't neutral, and doesn't stop its parsing at the bogus header. > One could probably ignore that broken line instead, but if for some reason the empty line got screwed, one would parse stuff nobody knows where it's from. But if Pigeonhole would believe nokeyword is a continueation of the previous line and unfold it, you open for attacks, IMHO. Agreed, would be quite silly. ;-) > The message without the leading space in the cont line should look as "raw"/malformed in any mail client. I think Dovecot/Pigeonhole is correct to stop parsing headers after seeing a malformed header line. Either I'm doing something terribly wrong, or there's something really worth to be investigated. Something that could be, at least partially, related to the problem described by Burckhard. Axel ========== When talking to postfix: $ telnet 127.0.0.1 25 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. 220 ALMba.local ESMTP Postfix mail from: 250 2.1.0 Ok rcpt to: 250 2.1.5 Ok data 354 End data with . Content-Type: multipart/alternative; boundary=20cf302234d5b8063c04efcd4318 Subject: sieve test 9 --20cf302234d5b8063c04efcd4318 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello --20cf302234d5b8063c04efcd4318 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello! --20cf302234d5b8063c04efcd4318-- . 250 2.0.0 Ok: queued as 288A68FAB93 quit 221 2.0.0 Bye Connection closed by foreign host. this one is written into the mailbox: From her at some.domain Wed Jan 15 18:53:29 2014 Return-Path: Delivered-To: Received: from ALMba.local by almba.local (Dovecot) with LMTP id ibRXLxnL1lIPUgEA5Q0ykw for ; Wed, 15 Jan 2014 18:53:29 +0100 Received: from localhost (localhost [127.0.0.1]) by ALMba.local (Postfix) with SMTP id 288A68FAB93 for ; Wed, 15 Jan 2014 18:52:48 +0100 (CET) Content-Type: multipart/alternative; Message-Id: <20140115175257.288A68FAB93 at ALMba.local> Date: Wed, 15 Jan 2014 18:52:48 +0100 (CET) From: her at some.domain X-UID: 6 Status: X-Keywords: Content-Length: 357 boundary=20cf302234d5b8063c04efcd4318 Subject: sieve test 9 --20cf302234d5b8063c04efcd4318 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello --20cf302234d5b8063c04efcd4318 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello! --20cf302234d5b8063c04efcd4318-- On the other hand, when talking directly to lmtp: $ telnet /_ROOT/var/run/dovecot/lmtp Trying /_ROOT/var/run/dovecot/lmtp... Connected to (null). Escape character is '^]'. 220 almba.local Dovecot ready. mail from: 250 2.1.0 OK rcpt to: 250 2.1.5 OK data 354 OK Content-Type: multipart/alternative; boundary=20cf302234d5b8063c04efcd4318 Subject: sieve test 8 --20cf302234d5b8063c04efcd4318 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello --20cf302234d5b8063c04efcd4318 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello! --20cf302234d5b8063c04efcd4318-- . 250 2.0.0 cKl7H4LH1lKZUQEA5Q0ykw Saved quit 221 2.0.0 OK Connection closed by foreign host. the mailbox receives: From her at some.domain Wed Jan 15 18:39:16 2014 Return-Path: Delivered-To: Received: from missing by almba.local (Dovecot) with LMTP id cKl7H4LH1lKZUQEA5Q0ykw for ; Wed, 15 Jan 2014 18:38:54 +0100 Content-Type: multipart/alternative; boundary=20cf302234d5b8063c04efcd4318 Subject: sieve test 8 X-UID: 5 Status: X-Keywords: Content-Length: 296 --20cf302234d5b8063c04efcd4318 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello --20cf302234d5b8063c04efcd4318 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello! --20cf302234d5b8063c04efcd4318-- Now, telnetting lmtp with a sieve redirect: $ telnet /_ROOT/var/run/dovecot/lmtp Trying /_ROOT/var/run/dovecot/lmtp... Connected to (null). Escape character is '^]'. 220 almba.local Dovecot ready. mail from: 250 2.1.0 OK rcpt to: 250 2.1.5 OK data 354 OK Content-Type: multipart/alternative; boundary=20cf302234d5b8063c04efcd4318 Subject: sieve test 10 --20cf302234d5b8063c04efcd4318 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello --20cf302234d5b8063c04efcd4318 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello! --20cf302234d5b8063c04efcd4318-- . 250 2.0.0 mBR9CJgC11L2UgEA5Q0ykw Saved quit 221 2.0.0 OK Connection closed by foreign host. yields this one into the mailbox: From her at some.domain Wed Jan 15 22:51:09 2014 Return-Path: Delivered-To: Received: from ALMba.local by almba.local (Dovecot) with LMTP id Uc+AFM0C11IGUwEA5Q0ykw for ; Wed, 15 Jan 2014 22:51:09 +0100 Received: by ALMba.local (Postfix, from userid 1003) id 4A8408FAE7B; Wed, 15 Jan 2014 22:51:09 +0100 (CET) X-Sieve: Pigeonhole Sieve 0.4.2 X-Sieve-Redirected-From: me at some.domain Delivered-To: Received: from missing by almba.local (Dovecot) with LMTP id mBR9CJgC11L2UgEA5Q0ykw for ; Wed, 15 Jan 2014 22:50:38 +0100 Content-Type: multipart/alternative; Message-Id: <20140115215109.4A8408FAE7B at ALMba.local> Date: Wed, 15 Jan 2014 22:51:09 +0100 (CET) From: her at some.domain (Dovecot) X-UID: 287478 Status: X-Keywords: Content-Length: 358 boundary=20cf302234d5b8063c04efcd4318 Subject: sieve test 10 --20cf302234d5b8063c04efcd4318 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello --20cf302234d5b8063c04efcd4318 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello! --20cf302234d5b8063c04efcd4318-- From ghariharan at gmail.com Thu Jan 16 07:58:24 2014 From: ghariharan at gmail.com (Ganesh Hariharan) Date: Thu, 16 Jan 2014 11:28:24 +0530 Subject: [Dovecot] Dovecot - not pulling pop3s email from virtual mbox Message-ID: Hi All, I am bit strugging to get this work, and bit perplexed to set the right configuration to get this work, btw: I am using passdb without any DB based auth. the latest logs after debug mode setting is below Jan 16 09:27:04 ns dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/auth/libdriver_sqlite.so Jan 16 09:27:04 ns dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/auth/libmech_gssapi.so Jan 16 09:27:04 ns dovecot: auth: Error: passwd-file /etc/dovecot/users: User info at ghhdomain.com has invalid GID '/var/spool/mail/ghhdomain/info/' Jan 16 09:27:04 ns dovecot: auth: Debug: passwd-file /etc/dovecot/users: Read 0 users Jan 16 09:27:04 ns dovecot: auth: Fatal: No passdbs specified in configuration file. CRAM-MD5 mechanism needs one Jan 16 09:27:04 ns dovecot: master: Error: service(auth): command startup failed, throttling Please see my configs 10-mail.conf mail_location = maildir:/var/spool/mail/%d/%n 10-ssl.conf # SSL/TLS support: yes, no, required. ssl = yes ssl_cert = References: Message-ID: Thanks for your help. On Tue, Jan 14, 2014 at 6:51 AM, Joseph Tam wrote: > > From: CM Reddy > > userdb { >> args = username_format=%u /etc/dovecot/users >> driver = passwd-file >> } >> ... >> Log information: >> ... >> >> Jan 13 16:42:44 cmreddy-Lenovo-G500s dovecot: imap(armor5): Error: user >> armor5: Couldn't drop privileges: User is missing GID (see mail_gid >> setting) >> > > Fairly self-explanatory, isn't it? It appears your userdb does > not specify GID for a user. Either define it, or ... > > In share/doc/dovecot/example-config/conf.d/10-mail.conf: > > # System user and group used to access mails. If you use multiple, > userdb > # can override these by returning uid or gid fields. You can use > either numbers > # or names. > #mail_uid = > > ... if all your users share the the same GID, set it here. > > Joseph Tam > From cmreddy at armor5.com Thu Jan 16 09:13:10 2014 From: cmreddy at armor5.com (cmreddy) Date: Wed, 15 Jan 2014 23:13:10 -0800 (PST) Subject: [Dovecot] mail-filter always results in corrupted indexes In-Reply-To: <52ADA928.30309@gmail.com> References: <52AC76EA.2000704@gmail.com> <52ADA928.30309@gmail.com> Message-ID: <1389856390566-46339.post@n4.nabble.com> Hi I am looking for help in processing the email at Dovecot Proxy (i.e replacing the links and attachments with custom links and attachments at IMAP proxy server). My understanding is that, mail_filter plugin should be hooked at Dovecot IMAP server. Can I integrate mail filter plugin (with some code changes) at Dovecot Proxy ? If so, please suggest the changes required Dovecot core or mail filter plugin ? -- View this message in context: http://dovecot.2317879.n4.nabble.com/mail-filter-always-results-in-corrupted-indexes-tp45954p46339.html Sent from the Dovecot mailing list archive at Nabble.com. From AxelLuttgens at swing.be Thu Jan 16 10:02:52 2014 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Thu, 16 Jan 2014 09:02:52 +0100 Subject: [Dovecot] broken message header parsing (was Re: forwarded message is broken in 2.2.10 with pigeonhole-0.4.2) In-Reply-To: <40886261-5C46-4235-AC80-EB53E1531529@swing.be> References: <52D65242.7070306@cms.hu-berlin.de> <55CCC43D-EB6E-4BC7-A275-E1D882769F24@swing.be> <52D67CD9.7050608@cms.hu-berlin.de> <52D69236.1050605@cms.hu-berlin.de> <40886261-5C46-4235-AC80-EB53E1531529@swing.be> Message-ID: <53647F78-7393-4E98-B236-E9CE32F547F8@swing.be> Le 15 janv. 2014 ? 23:29, Axel Luttgens a ?crit : > [...] > >> Pigeonhole stops parsing headers at nokeyword, OK. > > Well, yes and no... > > I've just retried with a redirect to "her at some.domain", still through a telnet against lmtp: > > lmtp -> mailbox (with sieve redirect) > > And it appears that the message headers are now mangled, with exactly the same pattern as in the case of: > > postfix -> dovecot's lmtp -> mailbox (without sieve redirect) > > Not sure how to interpret such results... I must have been very tired when writing the last sentence. The message went back thru postfix, and has thus been submitted to postfix' parsing rules (depending on its settings). > But it seems that pigeonhole isn't neutral, and doesn't stop its parsing at the bogus header. Or maybe could it be said that it is very neutral, in the sense that the bogus message is passed as is? Axel From rs at sys4.de Thu Jan 16 10:23:02 2014 From: rs at sys4.de (Robert Schetterer) Date: Thu, 16 Jan 2014 09:23:02 +0100 Subject: [Dovecot] mail-filter always results in corrupted indexes In-Reply-To: <1389856390566-46339.post@n4.nabble.com> References: <52AC76EA.2000704@gmail.com> <52ADA928.30309@gmail.com> <1389856390566-46339.post@n4.nabble.com> Message-ID: <52D796E6.1070300@sys4.de> Am 16.01.2014 08:13, schrieb cmreddy: > Hi > > I am looking for help in processing the email at Dovecot Proxy (i.e > replacing the links and attachments with custom links and attachments at > IMAP proxy server). My understanding is that, mail_filter plugin should be > hooked at Dovecot IMAP server. Can I integrate mail filter plugin (with some > code changes) at Dovecot Proxy ? > > If so, please suggest the changes required Dovecot core or mail filter > plugin ? > As written before, this is simply not a good idea, it may generate heavy system overload and manipulate mail content may forbidden at many places filter your mail at smtp level, no need for doing it in imap proxy then > > > -- > View this message in context: http://dovecot.2317879.n4.nabble.com/mail-filter-always-results-in-corrupted-indexes-tp45954p46339.html > Sent from the Dovecot mailing list archive at Nabble.com. > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From skdovecot at smail.inf.fh-brs.de Thu Jan 16 11:05:10 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 16 Jan 2014 10:05:10 +0100 (CET) Subject: [Dovecot] mail-filter always results in corrupted indexes In-Reply-To: <1389856390566-46339.post@n4.nabble.com> References: <52AC76EA.2000704@gmail.com> <52ADA928.30309@gmail.com> <1389856390566-46339.post@n4.nabble.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 15 Jan 2014, cmreddy wrote: > > I am looking for help in processing the email at Dovecot Proxy (i.e > replacing the links and attachments with custom links and attachments at > IMAP proxy server). My understanding is that, mail_filter plugin should be > hooked at Dovecot IMAP server. Can I integrate mail filter plugin (with some > code changes) at Dovecot Proxy ? > > If so, please suggest the changes required Dovecot core or mail filter > plugin ? I seem to remember an identical question a few weeks ago. Someone tried to write a plugin that alters the message. Timo answered that question with: NO, it is not possible with the current plugin code. But try to find thread to get the correct info. ==== However, I find the idea "wrong". I mean, you want to alter the message each time when it is retrieved by the user. It seems to be a time slot, when any delay might cause lots of support calls. I would favour Robert's approach and alter the message when it comes in either through the MTA or before you pass it to the LDA with a wrapper script. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUtegynD1/YhP6VMHAQLRlAf+LzIXlgV4/Z5yNcbVcpSdIeFrlVhE1FUY t9PoteJY3/TtXUY5QVnqTi6csW72YnvsUq39Eu+D5YG5ofqCpeCPe18tC+ibzm7f WpIlP5HDYibTB2FgAwdTNbBq9DBnFDeEaPYOlundWvVJvCip4vN+3jaw0B85oeS2 fGJlol88WF7/kcIgS/PQvMFHRW93hvePOlsxPi2EwGNunyZ90ziasqOwCrBmujCj g09E2oiOONyoUuyb5UOIoS6u7ICKwvtSkmnj1Pck2sym1Xgvy+PNnWXM67mW1l7f Xs+Bppq+Xor7bfMrrYynXDXU3CtOWmQMmMFN8+fhS6qTHMS4ZfqQYw== =E7u9 -----END PGP SIGNATURE----- From frank.bonnet at esiee.fr Thu Jan 16 11:29:13 2014 From: frank.bonnet at esiee.fr (BONNET, Frank) Date: Thu, 16 Jan 2014 10:29:13 +0100 Subject: [Dovecot] Dovecot 2 separate login for POP3 connections ? Message-ID: Hello Is it possible to configure a separate logfile for incoming POP3 connections ( dovecot 2.2.9 ) thanks From bschmidt at cms.hu-berlin.de Thu Jan 16 11:31:32 2014 From: bschmidt at cms.hu-berlin.de (Burckhard Schmidt) Date: Thu, 16 Jan 2014 10:31:32 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: <52D65242.7070306@cms.hu-berlin.de> References: <52D65242.7070306@cms.hu-berlin.de> Message-ID: <52D7A6F4.6030000@cms.hu-berlin.de> Am 15.01.2014 10:17, schrieb Burckhard Schmidt: > Hi, > forwarding a message with sieve like > > redirect:copy "me at other.domain"; > > was working without any problem until dovecot-2.1.17, dovecots lmtp and > dovecot-2.1-pigeonhole-0.3.5. > > Using dovecot-2.2.10 , dovecots lmtp and dovecot-2.2-pigeonhole-0.4.2 > the structure of a forwarded message is broken. Content of a message is > not displayed or an attachment (for instance pdf) can not be opened by > (different) clients. Writing a html mail or plain one makes no different. > I did another test with dovecot-lda instead of lmtp: dovecot 2.2.10, dovcot-lda and pigeonhole-0.4.2 --> Message is forwarded and fully readable. dovecot 2.2.10, lmtp and pigeonhole-0.4.2 --> forwarded message is broken If I compare both messages I see trailing blanks like ... Subject: anhang pdf Content-Type: multipart/mixed; without trailing blank ... X-ENVELOPE-TO: blank line here --> and now every line until the end of the message has one trailing blank, starting with: This is a multi-part message in MIME format. --------------060501050100070603080402 Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit test text --------------060501050100070603080402 Content-Type: application/pdf; name="oxford-google-docs.pdf" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="oxford-google-docs.pdf" JVBERi0xLjQKJeHp69MKMiAwIG9iago8PC9UeXBlIC9DYXRhbG9nCi9QYWdlcyAxIDAgUgo+ ... dGFydHhyZWYKNTMyMzcKJSVFT0Y= --------------060501050100070603080402-- end of message This should be the reason I think. Burckhard -- Mit freundlichen Gr??en --- Burckhard Schmidt Abteilung Systemsoftware und Kommunikation ZE Computer- und Medienservice der Humboldt-Universit?t zu Berlin Postanschrift: Unter den Linden 6, 10099 Berlin Standort: Rudower Chaussee 26; 12489 Berlin Tel.: +49-30-2093-70058 Fax: +49-30-2093-2959 Mail: bschmidt at cms.hu-berlin.de From AxelLuttgens at swing.be Thu Jan 16 12:12:27 2014 From: AxelLuttgens at swing.be (Axel Luttgens) Date: Thu, 16 Jan 2014 11:12:27 +0100 Subject: [Dovecot] Dovecot 2 separate login for POP3 connections ? In-Reply-To: References: Message-ID: Le 16 janv. 2014 ? 10:29, "BONNET, Frank" a ?crit : > Hello > > Is it possible to configure a separate logfile for incoming POP3 > connections ( dovecot 2.2.9 ) Hello Frank, Perhaps by defining log_path in a protocol pop3 { ... } section? Axel From skdovecot at smail.inf.fh-brs.de Thu Jan 16 12:14:20 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 16 Jan 2014 11:14:20 +0100 (CET) Subject: [Dovecot] Dovecot - not pulling pop3s email from virtual mbox In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 16 Jan 2014, Ganesh Hariharan wrote: > Jan 16 09:27:04 ns dovecot: auth: Error: passwd-file /etc/dovecot/users: > User info at ghhdomain.com has invalid GID '/var/spool/mail/ghhdomain/info/' > Jan 16 09:27:04 ns dovecot: auth: Debug: passwd-file /etc/dovecot/users: > Read 0 users > Please see my configs don't grab selected output from the conf files, use doveconf -n > > users file look like this > info at ghhdomain.com: > {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d2cf6:503:503 > Do you have a line with "/var/spool/mail/ghhdomain/info/" in /etc/dovecot/users ? Post that line and, say, three lines before and three after it. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUtew/HD1/YhP6VMHAQLtbwgAjj11c42Ou+tQ5pBglOIIIfU+VrKjq2Av 0Ii2FMcjT/KMH7yHya/Dj6KGUMv1miZGj3FSpGaihcYIilxkjUXKr01noSmEb4Pj BkSHkqciJrzVZulzDtOiWXEl3jsT3VpQcqMKbfMOrAshG9nxz0cTCw6AtIEllJC8 StytjqaaYDBaW5zmRWY7kSjKiLHr8Y3nLQfFLPjrRw1KL1lKTTNm8o2mpA1Yah+3 cBZ1zFBswxbVmORhcug+sJB+vWauiZ9cX5DGgjLjflHFiaL9CXnGnjntdki2ZFjg VAShxwU/RSnTQBrdYvWSvAtD+bXP+3eySuitaHqyGcogHVZFb1bPQQ== =w/kl -----END PGP SIGNATURE----- From h.reindl at thelounge.net Thu Jan 16 12:13:56 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 16 Jan 2014 11:13:56 +0100 Subject: [Dovecot] Dovecot 2 separate login for POP3 connections ? In-Reply-To: References: Message-ID: <52D7B0E4.1010102@thelounge.net> Am 16.01.2014 10:29, schrieb BONNET, Frank: > Is it possible to configure a separate logfile for incoming POP3 > connections (dovecot 2.2.9) thats the job of rsyslog, not the daemon itself example to have dhcpd logs not in /var/log/messages :programname, isequal, "dhcpd" -/var/log/dhcpd.log :programname, isequal, "dhcpd" ~ -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From ghariharan at gmail.com Thu Jan 16 12:34:15 2014 From: ghariharan at gmail.com (Ganesh Hariharan) Date: Thu, 16 Jan 2014 16:04:15 +0530 Subject: [Dovecot] Dovecot - not pulling pop3s email from virtual mbox In-Reply-To: References: Message-ID: Hi Steffen, Please see the dovecot -n output attached I have two files , users and passwd cat /etc/dovecot/users info at ghhdomain.com:501:501:/var/spool/mail/ghhdomain/info/:/bin/false: [sysopminds at ns ~]$ cat /etc/dovecot/passwd info at ghhdomain.com: {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d2cf6:503:503 TIA G On Thu, Jan 16, 2014 at 3:44 PM, Steffen Kaiser < skdovecot at smail.inf.fh-brs.de> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > On Thu, 16 Jan 2014, Ganesh Hariharan wrote: > > Jan 16 09:27:04 ns dovecot: auth: Error: passwd-file /etc/dovecot/users: >> User info at ghhdomain.com has invalid GID '/var/spool/mail/ghhdomain/info/' >> Jan 16 09:27:04 ns dovecot: auth: Debug: passwd-file /etc/dovecot/users: >> Read 0 users >> > > Please see my configs >> > don't grab selected output from the conf files, use doveconf -n > > >> users file look like this >> info at ghhdomain.com: >> {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d >> 2cf6:503:503 >> >> > Do you have a line with "/var/spool/mail/ghhdomain/info/" in > /etc/dovecot/users ? Post that line and, say, three lines before and three > after it. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUtew/HD1/YhP6VMHAQLtbwgAjj11c42Ou+tQ5pBglOIIIfU+VrKjq2Av > 0Ii2FMcjT/KMH7yHya/Dj6KGUMv1miZGj3FSpGaihcYIilxkjUXKr01noSmEb4Pj > BkSHkqciJrzVZulzDtOiWXEl3jsT3VpQcqMKbfMOrAshG9nxz0cTCw6AtIEllJC8 > StytjqaaYDBaW5zmRWY7kSjKiLHr8Y3nLQfFLPjrRw1KL1lKTTNm8o2mpA1Yah+3 > cBZ1zFBswxbVmORhcug+sJB+vWauiZ9cX5DGgjLjflHFiaL9CXnGnjntdki2ZFjg > VAShxwU/RSnTQBrdYvWSvAtD+bXP+3eySuitaHqyGcogHVZFb1bPQQ== > =w/kl > -----END PGP SIGNATURE----- > -------------- next part -------------- # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.i686 i686 CentOS release 6.5 (Final) ext4 auth_debug = yes auth_mechanisms = cram-md5 mail_debug = yes mail_gid = 503 mail_location = maildir:/var/spool/mail/%d/%n mail_uid = 503 mbox_write_locks = fcntl service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = References: Message-ID: let's try :-) *Frank BONNET* Systemes UNIX et Reseaux ESIEE PARIS 01.45.92.66.17 - 06.70.37.37.69 2014/1/16 Axel Luttgens > Le 16 janv. 2014 ? 10:29, "BONNET, Frank" a ?crit > : > > > Hello > > > > Is it possible to configure a separate logfile for incoming POP3 > > connections ( dovecot 2.2.9 ) > > Hello Frank, > > Perhaps by defining log_path in a protocol pop3 { ... } section? > > Axel > > From jeremy at azuria.net Thu Jan 16 04:09:21 2014 From: jeremy at azuria.net (Jeremy SPIESSER) Date: Thu, 16 Jan 2014 03:09:21 +0100 Subject: [Dovecot] [Dovecot auth crash] Message-ID: <52D73F51.9060900@azuria.net> Hi, I have a problem with dovecot auth and i don't know what happen .. running dovecot 2.1.7 When i try a login with user there is a crash in auth process: Jan 16 02:56:52 az-mail14 dovecot: auth: Panic: file auth-request.c: line 618 (auth_request_is_disabled_master_user): assertion failed: (request->requested_login_user != NULL) Jan 16 02:56:52 az-mail14 dovecot: auth: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7fcc4b30d14a] -> /usr/lib/dovecot/libdovecot.so.0(+0x4418e) [0x7fcc4b30d18e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fcc4b2e482a] -> dovecot/auth(+0x14af2) [0x7fcc4b78eaf2] -> dovecot/auth(auth_request_verify_plain+0x22) [0x7fcc4b790102] -> dovecot/auth(+0x1da10) [0x7fcc4b797a10] -> dovecot/auth(auth_request_handler_auth_continue+0xe2) [0x7fcc4b791cf2] -> dovecot/auth(+0x10420) [0x7fcc4b78a420] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7fcc4b31a016] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7fcc4b31acc7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7fcc4b319a28] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fcc4b306483] -> dovecot/auth(main+0x323) [0x7fcc4b788863] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7fcc4a70cead] -> dovecot/auth(+0xea75) [0x7fcc4b788a75] Jan 16 02:56:52 az-mail14 dovecot: auth: Fatal: master: service(auth): child 28622 killed with signal 6 (core dumps disabled) Jan 16 02:56:52 az-mail14 dovecot: imap-login: Warning: Auth connection closed with 1 pending requests (max 0 secs, pid=28621, EOF) Jan 16 02:56:53 az-mail14 dovecot: auth: Panic: file auth-request.c: line 618 (auth_request_is_disabled_master_user): assertion failed: (request->requested_login_user != NULL) Jan 16 02:56:53 az-mail14 dovecot: auth: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f262370d14a] -> /usr/lib/dovecot/libdovecot.so.0(+0x4418e) [0x7f262370d18e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f26236e482a] -> dovecot/auth(+0x14af2) [0x7f2623b8eaf2] -> dovecot/auth(auth_request_verify_plain+0x22) [0x7f2623b90102] -> dovecot/auth(+0x1da10) [0x7f2623b97a10] -> dovecot/auth(+0x127f3) [0x7f2623b8c7f3] -> /usr/lib/dovecot/libdovecot.so.0(+0x390e5) [0x7f26237020e5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f262371a016] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f262371acc7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f2623719a28] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f2623706483] -> dovecot/auth(main+0x323) [0x7f2623b88863] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f2622b0cead] -> dovecot/auth(+0xea75) [0x7f2623b88a75] Jan 16 02:56:53 az-mail14 dovecot: auth: Fatal: master: service(auth): child 28632 killed with signal 6 (core dumps disabled) Jan 16 02:56:53 az-mail14 dovecot: imap-login: Warning: Auth connection closed with 1 pending requests (max 0 secs, pid=28621, EOF) Jan 16 02:57:13 az-mail14 dovecot: imap-login: Disconnected (auth process communication failure): user=<>, method=PLAIN, rip=172.16.21.3, lip=172.16.21.100, TLS, session= Dovecot run with this config file: # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.3 ext4 auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 0 auth_cache_ttl = 1 hours auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_first_valid_uid = 500 auth_gssapi_hostname = auth_krb5_keytab = auth_last_valid_uid = 0 auth_master_user_separator = auth_mechanisms = plain auth_proxy_self = auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = %Lu auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 10000 default_idle_kill = 1 mins default_internal_user = dovecot default_login_user = dovenull default_process_limit = 1000 default_vsz_limit = 1 G deliver_log_format = msgid=%m: %$ dict_db_config = director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins director_username_hash = %u disable_plaintext_auth = yes dotlock_use_excl = no doveadm_allowed_commands = doveadm_password = doveadm_proxy_port = 0 doveadm_socket_path = doveadm-server doveadm_worker_count = 0 dsync_alt_char = _ dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u -l%{lock_timeout} -n%{namespace} first_valid_gid = 1 first_valid_uid = 500 hostname = imap_capability = imap_client_workarounds = imap_id_log = imap_id_send = imap_idle_notify_interval = 2 mins imap_logout_format = in=%i out=%o imap_max_line_length = 64 k imapc_features = imapc_host = imapc_list_prefix = imapc_master_user = imapc_password = imapc_port = 143 imapc_rawlog_dir = imapc_ssl = no imapc_ssl_ca_dir = imapc_ssl_verify = yes imapc_user = %u import_environment = TZ info_log_path = instance_name = dovecot last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = no lda_mailbox_autosubscribe = no lda_original_recipient_header = libexec_dir = /usr/lib/dovecot listen = *, :: lmtp_proxy = no lmtp_save_to_detail_mailbox = no lock_method = fcntl log_path = syslog log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Dovecot ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c session=<%{session}> login_trusted_networks = mail_access_groups = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_cache_fields = flags mail_cache_min_mail_count = 10 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_location = maildir:/data/vmail/%d/%n/Maildir:INDEX=/dev/shm/dovindex/%u mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 10 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib/dovecot/modules mail_plugins = mail_prefetch_count = 100 mail_privileged_group = mail_save_crlf = no mail_shared_explicit_inbox = yes mail_temp_dir = /tmp mail_temp_scan_interval = 1 weeks mail_uid = mailbox_idle_check_interval = 30 secs mailbox_list_index = no maildir_broken_filename_sizes = no maildir_copy_with_hardlinks = yes maildir_stat_dirs = no maildir_very_dirty_syncs = no managesieve_client_workarounds = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_md5 = apop3d mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = dotlock fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = yes passdb { args = /data/vmail/conf/dovecot_shadow default_fields = deny = no driver = passwd-file master = yes override_fields = pass = no } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } pop3_client_workarounds = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_duplicates = allow pop3_uidl_format = %08Xu%08Xv pop3c_host = pop3c_password = pop3c_port = 110 pop3c_rawlog_dir = pop3c_ssl = no pop3c_ssl_ca_dir = pop3c_ssl_verify = yes pop3c_user = %u postmaster_address = protocols = quota_full_tempfail = no recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s replication_full_sync_interval = 12 hours replication_max_conns = 10 replicator_host = replicator replicator_port = 0 sendmail_path = /usr/sbin/sendmail service aggregator { chroot = . client_limit = 0 drop_priv_before_exec = no executable = aggregator extra_groups = fifo_listener replication-notify-fifo { group = mode = 0600 user = } group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replication-notify { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 0 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0666 user = $default_internal_user } unix_listener login/login { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = . client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 143 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 4096 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 1 G } service indexer-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = indexer-worker extra_groups = group = idle_kill = 0 privileged_group = process_limit = 10 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service indexer { chroot = client_limit = 0 drop_priv_before_exec = no executable = indexer extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener indexer { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log unix_listener log-errors { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service managesieve-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = managesieve-login extra_groups = group = idle_kill = 0 inet_listener sieve { address = port = 4190 ssl = no } inet_listener sieve_deprecated { address = port = 2000 ssl = no } privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service managesieve { chroot = client_limit = 1 drop_priv_before_exec = no executable = managesieve extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = sieve service_count = 1 type = unix_listener login/sieve { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service replicator { chroot = client_limit = 0 drop_priv_before_exec = no executable = replicator extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener replicator { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0600 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = prefix et peering -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/jpeg Size: 2123 bytes Desc: not available URL: From ghariharan at gmail.com Thu Jan 16 14:24:18 2014 From: ghariharan at gmail.com (Ganesh Hariharan) Date: Thu, 16 Jan 2014 17:54:18 +0530 Subject: [Dovecot] Dovecot - not pulling pop3s email from virtual mbox In-Reply-To: References: Message-ID: I have come to this level, where I get the error "Jan 16 17:46:38 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): lookup: user=info at ghhdomain.com file=/etc/dovecot/users Jan 16 17:46:38 ns dovecot: auth: Error: password(info at ghhdomain.com,10.0.0.12): Password in passdb is not in expected scheme cram-md5 Jan 16 17:46:40 ns dovecot: auth: Debug: client out: FAIL#0111#011user= info at ghhdomain.com Jan 16 17:47:14 ns dovecot: auth: Debug: client in: AUTH#0112#011CRAM-MD5#011service=pop3#011secured#011lip=10.0.0.12#011rip=10.0.0.12#011lport=995#011rport=52290 Jan 16 17:47:14 ns dovecot: auth: Debug: client out: CONT#0112#011PDY1ODkwNDMyOTE1ODg4NTAuMTM4OTg3NDYzNEBucy5tYXN0ZXItc2VydmVyPg== Jan 16 17:47:14 ns dovecot: auth: Debug: client in: CONT#0112#011aW5mb0BnaGhkb21haW4uY29tIDY0ZGYxZGI4MzVhNzQ0NjJlZjNlZDQwZGRlMDdiZjQ4 Jan 16 17:47:14 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): lookup: user=info at ghhdomain.com file=/etc/dovecot/users Jan 16 17:47:14 ns dovecot: auth: Error: password(info at ghhdomain.com,10.0.0.12): Password in passdb is not in expected scheme cram-md5 Jan 16 17:47:16 ns dovecot: auth: Debug: client out: FAIL#0112#011user= info at ghhdomain.com Jan 16 17:47:17 ns dovecot: pop3-login: Aborted login (auth failed, 2 attempts): user=, method=CRAM-MD5, rip=10.0.0.12, lip=10.0.0.12, TLS" output of dovecot -n , below... # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.i686 i686 CentOS release 6.5 (Final) ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = cram-md5 mail_debug = yes mail_gid = 503 mail_location = mbox:/var/spool/mail/%u mail_uid = 503 mbox_write_locks = fcntl passdb { args = scheme=cram-md5 username_format=%u /etc/dovecot/users driver = passwd-file } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = wrote: > Hi Steffen, > > Please see the dovecot -n output attached > > I have two files , users and passwd > > cat /etc/dovecot/users > info at ghhdomain.com:501:501:/var/spool/mail/ghhdomain/info/:/bin/false: > > [sysopminds at ns ~]$ cat /etc/dovecot/passwd > info at ghhdomain.com: > {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d2cf6:503:503 > > TIA > G > > > > > On Thu, Jan 16, 2014 at 3:44 PM, Steffen Kaiser < > skdovecot at smail.inf.fh-brs.de> wrote: > >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> >> On Thu, 16 Jan 2014, Ganesh Hariharan wrote: >> >> Jan 16 09:27:04 ns dovecot: auth: Error: passwd-file /etc/dovecot/users: >>> User info at ghhdomain.com has invalid GID '/var/spool/mail/ghhdomain/ >>> info/' >>> Jan 16 09:27:04 ns dovecot: auth: Debug: passwd-file /etc/dovecot/users: >>> Read 0 users >>> >> >> Please see my configs >>> >> don't grab selected output from the conf files, use doveconf -n >> >> >>> users file look like this >>> info at ghhdomain.com: >>> {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d >>> 2cf6:503:503 >>> >>> >> Do you have a line with "/var/spool/mail/ghhdomain/info/" in >> /etc/dovecot/users ? Post that line and, say, three lines before and three >> after it. >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1.4.11 (GNU/Linux) >> >> iQEVAwUBUtew/HD1/YhP6VMHAQLtbwgAjj11c42Ou+tQ5pBglOIIIfU+VrKjq2Av >> 0Ii2FMcjT/KMH7yHya/Dj6KGUMv1miZGj3FSpGaihcYIilxkjUXKr01noSmEb4Pj >> BkSHkqciJrzVZulzDtOiWXEl3jsT3VpQcqMKbfMOrAshG9nxz0cTCw6AtIEllJC8 >> StytjqaaYDBaW5zmRWY7kSjKiLHr8Y3nLQfFLPjrRw1KL1lKTTNm8o2mpA1Yah+3 >> cBZ1zFBswxbVmORhcug+sJB+vWauiZ9cX5DGgjLjflHFiaL9CXnGnjntdki2ZFjg >> VAShxwU/RSnTQBrdYvWSvAtD+bXP+3eySuitaHqyGcogHVZFb1bPQQ== >> =w/kl >> -----END PGP SIGNATURE----- >> > > From skdovecot at smail.inf.fh-brs.de Thu Jan 16 14:44:40 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 16 Jan 2014 13:44:40 +0100 (CET) Subject: [Dovecot] Dovecot - not pulling pop3s email from virtual mbox In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 16 Jan 2014, Ganesh Hariharan wrote: > I have two files , users and passwd > > cat /etc/dovecot/users > info at ghhdomain.com:501:501:/var/spool/mail/ghhdomain/info/:/bin/false: > > [sysopminds at ns ~]$ cat /etc/dovecot/passwd > info at ghhdomain.com: > {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d2cf6:503:503 See: http://wiki2.dovecot.org/AuthDatabase/PasswdFile the syntax is: user:password:uid:gid:(gecos):home:(shell):extra_fields so your user file is wrong. But this error would come later. The config shows that you have not configured no passdb. Re-check that you've included the appropriate auth*ext files, e.g. the auth-passwdfile.conf.ext. > On Thu, Jan 16, 2014 at 3:44 PM, Steffen Kaiser < > skdovecot at smail.inf.fh-brs.de> wrote: > >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> >> On Thu, 16 Jan 2014, Ganesh Hariharan wrote: >> >> Jan 16 09:27:04 ns dovecot: auth: Error: passwd-file /etc/dovecot/users: >>> User info at ghhdomain.com has invalid GID '/var/spool/mail/ghhdomain/info/' >>> Jan 16 09:27:04 ns dovecot: auth: Debug: passwd-file /etc/dovecot/users: >>> Read 0 users >>> >> >> Please see my configs >>> >> don't grab selected output from the conf files, use doveconf -n >> >> >>> users file look like this >>> info at ghhdomain.com: >>> {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d >>> 2cf6:503:503 >>> >>> >> Do you have a line with "/var/spool/mail/ghhdomain/info/" in >> /etc/dovecot/users ? Post that line and, say, three lines before and three >> after it. >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1.4.11 (GNU/Linux) >> >> iQEVAwUBUtew/HD1/YhP6VMHAQLtbwgAjj11c42Ou+tQ5pBglOIIIfU+VrKjq2Av >> 0Ii2FMcjT/KMH7yHya/Dj6KGUMv1miZGj3FSpGaihcYIilxkjUXKr01noSmEb4Pj >> BkSHkqciJrzVZulzDtOiWXEl3jsT3VpQcqMKbfMOrAshG9nxz0cTCw6AtIEllJC8 >> StytjqaaYDBaW5zmRWY7kSjKiLHr8Y3nLQfFLPjrRw1KL1lKTTNm8o2mpA1Yah+3 >> cBZ1zFBswxbVmORhcug+sJB+vWauiZ9cX5DGgjLjflHFiaL9CXnGnjntdki2ZFjg >> VAShxwU/RSnTQBrdYvWSvAtD+bXP+3eySuitaHqyGcogHVZFb1bPQQ== >> =w/kl >> -----END PGP SIGNATURE----- >> > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUtfUOXD1/YhP6VMHAQIYYgf9EZJL9VQCUa2Qqf+OoJk+Wo+sizCV/95n q+oaGW3OrgN/kIVLMc6qiVJQThQ6KZUadtIQKY4t987nhqByEnH6ZslNakQKRFz9 2tHMww7TDE/6snQeGw/D83+hnhsu7GapLTuLSE8mjOkGpj3XUQrdsthEXE3rW4Mn ZGjubq3WVmAPxTz041sX7BsTtTqVOZCIT/lMeSUV8YkPEclC8gKzuIE2RKX9z5Ms 3Sj8iskxYhtr9i04D/JZmlMlPrFqcxaveZWoxDwF33YJ09QkhkvKP0+/JpYP4OS9 pxw5D7sjd4V6sYNb1jVt74WAuxRI2ZxKwOm9MZozJEiM99t9Snv56g== =YjUp -----END PGP SIGNATURE----- From CMarcus at Media-Brokers.com Thu Jan 16 15:58:32 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 16 Jan 2014 08:58:32 -0500 Subject: [Dovecot] Received: header showing 127.0.0.1 after switch to dovecot LDA? Message-ID: <52D7E588.4010608@Media-Brokers.com> Hi all, I'm guessing this is correct behavior, but wanted to make sure... I noticed that for locally delivered messages (between 2 local users inside our domain, so they never leave the server), the first Received: header line content changed after I switched to the dovecot LDA. Before, using postfix/virtual for delivery, the header looked like this: Received: from [192.168.1.25] (client.example.com [192.168.1.25]) by smtp.example.com (Postfix) with ESMTPSA id 67E33A20542; Wed, 6 Jun 2012 10:55:55 -0400 (EDT) But now it looks like this: Received: from [127.0.0.1] (client.example.com.com [192.168.1.14]) by smtp.example.com (Postfix) with ESMTPSA id 4EEF7802AF325 for ; Wed, 15 Jan 2014 18:29:17 -0500 (EST) so, 2 questions... 1. Why does it show 127.0.0.1 instead of the client IP, and 2. Why did postfix/virtual include the "for ;" but the dovecot LDA doesn't? Thanks, -- Best regards, Charles From itgeek31 at googlemail.com Thu Jan 16 15:18:50 2014 From: itgeek31 at googlemail.com (IT geek 31) Date: Thu, 16 Jan 2014 14:18:50 +0100 Subject: [Dovecot] Replication file sizes Message-ID: Hi, I'm using Dovecot 2.2.9 to replicate my mailbox to a remote server. My mailbox on ServerA is 235Mb, but on ServerB it ends up being 358Mb. Does anyone know why this is? Shouldn't they be the same size? doveconf -n from ServerA: # 2.2.9: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.2 cobalt auth_mechanisms = plain login doveadm_password = secret doveadm_port = 12345 first_valid_uid = 1003 last_valid_uid = 1020 listen = 192.168.1.1 mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " notify replication" passdb { driver = passwd } plugin { mail_replica = tcp:serverb.test.com } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12345 } } service imap-login { inet_listener imap { port = 0 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = References: <52D7E588.4010608@Media-Brokers.com> Message-ID: <52D84480.7080604@smail.inf.fh-brs.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Charles Marcus wrote: > Hi all, > > I'm guessing this is correct behavior, but wanted to make sure... > > I noticed that for locally delivered messages (between 2 local > users inside our domain, so they never leave the server), the first > Received: header line content changed after I switched to the > dovecot LDA. > > Before, using postfix/virtual for delivery, the header looked like > this: > > Received: from [192.168.1.25] (client.example.com [192.168.1.25]) > by smtp.example.com (Postfix) with ESMTPSA id 67E33A20542; Wed, 6 > Jun 2012 10:55:55 -0400 (EDT) > > But now it looks like this: > > Received: from [127.0.0.1] (client.example.com.com [192.168.1.14]) > by HELO-string (TCP info derived from IP) The double .com.com is from your anonymiziation, I guess. The client uses 127.0.0.1 as HELO > smtp.example.com (Postfix) with ESMTPSA id 4EEF7802AF325 for > ; Wed, 15 Jan 2014 18:29:17 -0500 (EST) just a single recipient - -- Steffen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEVAwUBUthEgHD1/YhP6VMHAQLFHggAvYZuywHBxQIQkzdEcej0ENLCTzsU+SgF 02L3WH2cJ5cxtESInrbAoXs/kmD3/dZBu/1LGh4ZndPMX7zSa2nj56XIQLdHGKVi 1ly6Rj95fkNX1q5sF5zT1Fb8Hq3tjaeuKtxK1/p2T0zAuzjSCAdMhgTcHR36kndf tnQYjgUuzH6/lvRVkVZTVpKOIh17SK98nF6BydUWQON2ErqDRsn+rXIyAFW/2DEb aD0MMesNHwgSzOMfezrXQ/HM26K+KFyJM824Jf7kSr4wDSGXGy9NtI1k2nD8bBcg g20ccFvJ3Iu/UyYd+k4Rc+JrhoWi93I2Tr+dV16T6FxiTZhWP1j0Zg== =vGY4 -----END PGP SIGNATURE----- From mtrainer at westnet.com.au Fri Jan 17 02:56:06 2014 From: mtrainer at westnet.com.au (Murray Trainer) Date: Fri, 17 Jan 2014 08:56:06 +0800 Subject: [Dovecot] Sizing MTA servers Message-ID: <886a24b529de09eea58ecc562049ab96665fe200@webmail.westnet.com.au> Hi All, This is probably a bit off-topic but does anyone have any idea about sizing MTA servers.?? We have about 200,000 emails/hr? incoming and outgoing.? I am intending using Exim and Spamassassin on each MTA.? How many servers using recent hardware would I need to cope with this mail throughput?? What is more important on the servers, CPU or RAM?? Should I have mail going both directions on each server or dedicate a pair each for incoming and outgoing mail> Thanks for any feedback. Murray From dev+dovecot at psyrium.com.au Fri Jan 17 04:20:49 2014 From: dev+dovecot at psyrium.com.au (Julian PG) Date: Fri, 17 Jan 2014 13:20:49 +1100 Subject: [Dovecot] Getting more out of the %w variable. Message-ID: <52D89381.1000507@psyrium.com.au> Hello Dovecot community, I have a backend database application that handles all system wide user authentication (from web to mail and more). Passwords are not stored in plain text. So I would like to support more than PLAIN. Perhaps at least CRAM-MD5 or DIGEST-MD5 for example. Even though connections over TLS are encouraged (and even enforced). Some MUA and users still think its a better idea than PLAIN (even sent over an encrypted session). I have a vague memory of getting some warnings with thunderbird in regards to the use of PLAIN. Of course the %w variable would have to include the challenge as well as the response. Or perhaps even a seperate variable for the challenge? Or course at the moment the %w variable is an empty string for anything other than PLAIN. This would make some users and MUAs happy (even though pointless over TLS - I agree). Your thoughts would be appreciated. Regards, Julian. -- Not time for sigs! From slusarz at curecanti.org Fri Jan 17 05:02:58 2014 From: slusarz at curecanti.org (Michael M Slusarz) Date: Thu, 16 Jan 2014 20:02:58 -0700 Subject: [Dovecot] Getting more out of the %w variable. In-Reply-To: <52D89381.1000507@psyrium.com.au> References: <52D89381.1000507@psyrium.com.au> Message-ID: <20140116200258.Horde.QTQ5948Hqe0piP0MhrqDmQ1@bigworm.curecanti.org> Quoting Julian PG : > So I would like to support more than PLAIN. Perhaps at least > CRAM-MD5 or DIGEST-MD5 for example. DIGEST-MD5 is obsolete. See RFC 6331. michael From stan at hardwarefreak.com Fri Jan 17 11:53:56 2014 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 17 Jan 2014 03:53:56 -0600 Subject: [Dovecot] Sizing MTA servers In-Reply-To: <886a24b529de09eea58ecc562049ab96665fe200@webmail.westnet.com.au> References: <886a24b529de09eea58ecc562049ab96665fe200@webmail.westnet.com.au> Message-ID: <52D8FDB4.7030105@hardwarefreak.com> On 1/16/2014 6:56 PM, Murray Trainer wrote: > This is probably a bit off-topic but does anyone have any idea about > sizing MTA servers. We have about 200,000 emails/hr incoming and > outgoing. I am intending using Exim and Spamassassin on each MTA. > How many servers using recent hardware would I need to cope with this > mail throughput? The number of boxen is irrelevant to the question of msg rate, as is the CPU. You can easily do your 56 msgs/sec with one box containing a 10 year old 2GHz single core CPU, as long as you have enough memory for the concurrent TCP connections, and sufficient IOPS. The only thing in this scenario needing CPU is spamassassin, unless you forgot to mention clamav. > What is more important on the servers, CPU or > RAM? Should I have mail going both directions on each server or > dedicate a pair each for incoming and outgoing mail> MTA = disk. Always has always will. Disk throughput is always the critical factor for queue performance, and an MTA is little more than a queue. Which makes it surprising that so many people ignore disk when talking about mail servers, as you have done here. ~200K msgs/hour / 3600 seconds = ~56 msgs/second Any 10 year old single core server can handle this msg load, and much more, with sufficient IOPS in the storage subsystem. Queue throughput requires very little CPU, miniscule. But, every inbound message will generate the following seeks at the disk through the relay phase. I'm assuming successful delivery here. Inbound Relay --------------------------------------- fs journal write read queue file create inode fs journal write write queue file unlink inode fs journal write fs journal write update log file inode update log inode append log file append log Each message generates 12 random seeks in the disks from ingestion to delivery. If your host OS is Linux and you use XFS for the queue and log filesystems it will dramatically reduce the number of journal write IOs at the disks via the relogging feature. If using Linux, you need to use XFS for a mail queue workload due to parallel performance. Neither EXT, JFS, ZFS, nor BTRFS come close. For now lets assume worst case scenario of 12 seeks. A msg rate of 56/sec will generate 672 seeks/sec. Typical maximum drive performance: Drive type peak random seeks/sec ------------------------------------- 7.2K SATA 150 10K SAS 225 15K SAS 300 SSD 10-50K 672/sec is an average based on your 200K/hour average. You will obviously see spikes of at least double this, likely 4 times. You need to account for future msg rate growth as well so you need to design your storage accordingly. The minimum you should design for is 672*4=2688 seeks/sec. You can easily achieve this using a mirrored pair of 'enterprise' class SSDs at minimal cost. Two 100GB units should be fine unless your mailbox servers or net connection go down for extended periods of time, causing a million+ messages to be queued. If using disk you'll need 18x 15K SAS drives in RAID10 to achieve 2700 seeks/sec, and you'll want these on a BBWC RAID controller. This will cost many thousands of dollars. Mirrored SSD is much more attractive here from a cost standpoint. Even if you end up requiring 200GB units to meet spooling needs you're looking at only a few hundred dollars. Again, MTAs don't need CPU horsepower to queue and relay mail. They require storage horsepower. Spamassassin and ClamAV need the CPU horsepower. Whether you will need 4 or more cores depends almost entirely on your spamassassin and ClamAV configurations and your msg load. If you enable Bayes, and surely you will, that obviously increases your CPU burn dramatically. If you optimize for speed, setting time_limit, the various shortcircuits, and make use of whitelists, etc, this will reduce your CPU burn. Configuring Exim to kill as many spam connections as possible will also decrease SA CPU burn. If you don't mind having separate and different Bayes databases yielding different scoring, you'd go with two servers, each with an 8 core CPU, 8GB RAM, and two mirrored 100-200GB SSDs. Each can handle the entire load when the other goes down, or is taken down for maintenance. You'd configure both as inbound and outbound relays, with equal MX priority. Another option is two low end dual core servers, 2GB RAM each, and the mirrored SSDs in each. You'd use a 3rd server with an 8 core CPU, 4GB RAM, two cheap mirrored SATA disks. You'd pipe each msg over a TCP socket from Exim to Amavisd-new which runs the message through one of 8 resident SA processes, then pipes the message back to Exim. This works fine on Postfix, so I assume Exim can do it as well. If not, use Postfix--it's superior anyway. The 3 box method gives you: 1. Consistent Bayes scoring 2. Lowest cost MTA boxen 3. A low cost "CPU server" for spam analysis 4. Total cost should be similar to the 2 box solution This does have a "single point of failure" of sorts for MX inbound mail in the event the spam analysis server goes down. In this situation, Postfix simply defers the messages until the SA server is back up. You should be able to configure Exim to do the same, if it doesn't by default. Outbound mail will go through just fine, assuming you don't intend to scan outbound mail with SA. -- Stan From raabe at froglogic.com Fri Jan 17 12:04:01 2014 From: raabe at froglogic.com (Frerich Raabe) Date: Fri, 17 Jan 2014 11:04:01 +0100 Subject: [Dovecot] Sizing MTA servers In-Reply-To: <52D8FDB4.7030105@hardwarefreak.com> References: <886a24b529de09eea58ecc562049ab96665fe200@webmail.westnet.com.au> <52D8FDB4.7030105@hardwarefreak.com> Message-ID: <6c296be3a8178bdba0cfae1095031886@roundcube.froglogic.com> On 2014-01-17 10:53, Stan Hoeppner wrote: > On 1/16/2014 6:56 PM, Murray Trainer wrote: > >> This is probably a bit off-topic but does anyone have any idea about >> sizing MTA servers. We have about 200,000 emails/hr incoming and >> outgoing. I am intending using Exim and Spamassassin on each MTA. >> How many servers using recent hardware would I need to cope with >> this >> mail throughput? > > The number of boxen is irrelevant to the question of msg rate, as is > the > CPU. You can easily do your 56 msgs/sec with one box containing a 10 > year old 2GHz single core CPU, as long as you have enough memory for > the > concurrent TCP connections, and sufficient IOPS. The only thing in > this > scenario needing CPU is spamassassin, unless you forgot to mention > clamav. [..] Stan, I just wanted to mention that even though I didn't ask the question (nor is the answer to it relevant to me in practice, right now) I greatly appreciated your elaborate response and the insight. It's pearls like this one which keep me on the list despite the occasional flamewar. ;-) -- Frerich Raabe - raabe at froglogic.com www.froglogic.com - Multi-Platform GUI Testing From adi at ente.limmat.ch Fri Jan 17 16:53:37 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Fri, 17 Jan 2014 15:53:37 +0100 Subject: [Dovecot] Sizing MTA servers In-Reply-To: <52D8FDB4.7030105@hardwarefreak.com> References: <886a24b529de09eea58ecc562049ab96665fe200@webmail.westnet.com.au> <52D8FDB4.7030105@hardwarefreak.com> Message-ID: <52D943F1.50505@ente.limmat.ch> Am 17.01.14 10:53 schrieb Stan Hoeppner: > On 1/16/2014 6:56 PM, Murray Trainer wrote: > MTA = disk. Always has always will. Disk throughput is always the > critical factor for queue performance, and an MTA is little more than a > queue. Which makes it surprising that so many people ignore disk when > talking about mail servers, as you have done here. Exim tries to deliver every message without queueing it first. Exim writes only those messages to the queue, which can't be delivered immediately or if too many connections are coming in at a time. This doesn't invalidate what Stan said, it should just clarify that under "normal" operation the disks won't be stressed that much under exim. It will be much more of a challenge to design the whole infrastructure for reliability and to make the right decisions on your mail storage and those machines than your mail frontend. Regards, Adrian. From CMarcus at Media-Brokers.com Fri Jan 17 17:00:12 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 17 Jan 2014 10:00:12 -0500 Subject: [Dovecot] Changing user specific configs one at a time using userdb text file to override defaults... Message-ID: <52D9457C.4010805@Media-Brokers.com> Hi all, Ok, I'm now interested in testing converting users one at a time to mdbox+SIS, but want to make sure I understand how to do this. It appears the best way - for smaller installations at least - is to just use a simple text file userdb to override the defaults, then once all of the users have been converted, change the defaults and remove the userdb txt file overrides. So, would love to hear details from others who have done something like this. Thx! -- Best regards, Charles From ninja.ak at gmail.com Fri Jan 17 17:19:28 2014 From: ninja.ak at gmail.com (=?UTF-8?B?4pmlIE5pTkpBIOKZgg==?=) Date: Fri, 17 Jan 2014 07:19:28 -0800 Subject: [Dovecot] Use dovecot for enterprise Message-ID: Hi guys I like to know is it possible to create Unlimited number of email accounts with Unlimited Storage in each email ? Does anybody do it ? Does dovecot good enough for having more than millions of users ? Thanks :-) From jordan at packethouse.com Fri Jan 17 17:27:02 2014 From: jordan at packethouse.com (Jordan Cook) Date: Fri, 17 Jan 2014 15:27:02 +0000 Subject: [Dovecot] Use dovecot for enterprise In-Reply-To: References: Message-ID: <7225EDDE-59AB-4E08-AD6F-135046843979@packethouse.com> Hi, If you have enough resources to handle that many users then dovecot can manage it perfectly. Not sure about unlimited storage though, I've not seen unlimited hard drives for sale just yet :) - but you can have as much storage as you need Regards, Jordan Cook Sent from my iPhone > On 17 Jan 2014, at 15:19, ? NiNJA ? wrote: > > Hi guys > I like to know is it possible to create Unlimited number of email accounts > with Unlimited Storage in each email ? > > Does anybody do it ? > Does dovecot good enough for having more than millions of users ? > > Thanks :-) -- Packet House Limited is a company registered in England and Wales. Registered number: 07602377. Registered office: 40 Preston Avenue, Alfreton, Derbyshire, DE55 7JY This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Packet House Limited. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. From rs at sys4.de Fri Jan 17 18:51:01 2014 From: rs at sys4.de (Robert Schetterer) Date: Fri, 17 Jan 2014 17:51:01 +0100 Subject: [Dovecot] Use dovecot for enterprise In-Reply-To: References: Message-ID: <52D95F75.2060600@sys4.de> Am 17.01.2014 16:19, schrieb ? NiNJA ?: > Hi guys > I like to know is it possible to create Unlimited number of email accounts > with Unlimited Storage in each email ? > > Does anybody do it ? > Does dovecot good enough for having more than millions of users ? > > Thanks :-) > Storage is a different not dovecot theme, dovecot is good enough for unlimited setups if you have unlimited resources to host it *g Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From cmreddy at armor5.com Fri Jan 17 19:09:00 2014 From: cmreddy at armor5.com (CM Reddy) Date: Fri, 17 Jan 2014 22:39:00 +0530 Subject: [Dovecot] Dovecot IMAP proxy for gmail IMAP server Message-ID: Hi All, I am experimenting to use Dovecot as an IMAP proxy to GMAIL server. I would like configure my localhost as an Dovecot IMAP proxy and trying to access my GMAIL using the Thunderbird email client. Please share the steps to configure and access my mails from GMAIL server. - Thanks CM Reddy From h.reindl at thelounge.net Fri Jan 17 19:25:12 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 17 Jan 2014 18:25:12 +0100 Subject: [Dovecot] Dovecot IMAP proxy for gmail IMAP server In-Reply-To: References: Message-ID: <52D96778.5050401@thelounge.net> Am 17.01.2014 18:09, schrieb CM Reddy: > I am experimenting to use Dovecot as an IMAP proxy to GMAIL server. I would > like configure my localhost as an Dovecot IMAP proxy and trying to access > my GMAIL using the Thunderbird email client. Please share the steps to > configure and access my mails from GMAIL server http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy but what is the benfit? you can configure encryption and whatnot different but that does not change the connection between your proxy and the final destination - the weakest part stays as problem independent what you do in the middle of the connection -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From morrisonli at 126.com Fri Jan 17 19:38:38 2014 From: morrisonli at 126.com (morrison) Date: Sat, 18 Jan 2014 01:38:38 +0800 (CST) Subject: [Dovecot] imap abort after upgrade from 2.2.4 to 2.2.7 Message-ID: <5cd09a69.a8a4.143a1487cbb.Coremail.morrisonli@126.com> Hi, I used to use dovecot 2.2.4. I saw lots of warnings saying 'Extension header update points outside header size'. I upgraded to dovecot 2.2.7, based on the discussion in mail list. Now, I see lots of imap aborts around: src/lib-index/mail-index-transaction-export.c:203: i_assert(u32.offset + u32.size <= ext_hdr_size); I also noticed, in some mailbox, imap process kept abort until all index files in the mailbox were manually deleted. Did someone run into the same problem and any solution to this? Thanks, From rs at sys4.de Fri Jan 17 19:47:42 2014 From: rs at sys4.de (Robert Schetterer) Date: Fri, 17 Jan 2014 18:47:42 +0100 Subject: [Dovecot] imap abort after upgrade from 2.2.4 to 2.2.7 In-Reply-To: <5cd09a69.a8a4.143a1487cbb.Coremail.morrisonli@126.com> References: <5cd09a69.a8a4.143a1487cbb.Coremail.morrisonli@126.com> Message-ID: <52D96CBE.2050201@sys4.de> Am 17.01.2014 18:38, schrieb morrison: > Hi, > > I used to use dovecot 2.2.4. I saw lots of warnings saying 'Extension header update points outside header size'. > I upgraded to dovecot 2.2.7, based on the discussion in mail list. Now, I see lots of imap aborts around: > > src/lib-index/mail-index-transaction-export.c:203: i_assert(u32.offset + u32.size <= ext_hdr_size); > > I also noticed, in some mailbox, imap process kept abort until all index files in the mailbox were manually deleted. > > Did someone run into the same problem and any solution to this? > > Thanks, > why you didnt upgrade to recent 2.2.10 version, the problem may allready get fixed there Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From h.reindl at thelounge.net Fri Jan 17 19:49:39 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 17 Jan 2014 18:49:39 +0100 Subject: [Dovecot] imap abort after upgrade from 2.2.4 to 2.2.7 In-Reply-To: <5cd09a69.a8a4.143a1487cbb.Coremail.morrisonli@126.com> References: <5cd09a69.a8a4.143a1487cbb.Coremail.morrisonli@126.com> Message-ID: <52D96D33.4040208@thelounge.net> Am 17.01.2014 18:38, schrieb morrison: > I used to use dovecot 2.2.4. I saw lots of warnings saying 'Extension header update points outside header size'. > I upgraded to dovecot 2.2.7, based on the discussion in mail list why? current is 2.2.10 http://www.dovecot.org/download.html i don't get why someone makes a upgrade and not ue the last recent minor version which exists at all because 2.2.7, 2.2.8 and 2.2.9 had bugs - so the first step in case of trouble is *always* update to the last recent minor version -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From me at junc.eu Fri Jan 17 19:52:32 2014 From: me at junc.eu (Benny Pedersen) Date: Fri, 17 Jan 2014 18:52:32 +0100 Subject: [Dovecot] imap abort after upgrade from 2.2.4 to 2.2.7 In-Reply-To: <52D96CBE.2050201@sys4.de> References: <5cd09a69.a8a4.143a1487cbb.Coremail.morrisonli@126.com> <52D96CBE.2050201@sys4.de> Message-ID: Robert Schetterer skrev den 2014-01-17 18:47: > why you didnt upgrade to recent 2.2.10 version, the problem may > allready get fixed there package maintainers are seldom ahead of realeases From h.reindl at thelounge.net Fri Jan 17 19:54:51 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 17 Jan 2014 18:54:51 +0100 Subject: [Dovecot] imap abort after upgrade from 2.2.4 to 2.2.7 In-Reply-To: References: <5cd09a69.a8a4.143a1487cbb.Coremail.morrisonli@126.com> <52D96CBE.2050201@sys4.de> Message-ID: <52D96E6B.1060908@thelounge.net> Am 17.01.2014 18:52, schrieb Benny Pedersen: > Robert Schetterer skrev den 2014-01-17 18:47: > >> why you didnt upgrade to recent 2.2.10 version, the problem may allready get fixed there > > package maintainers are seldom ahead of realeases then i would call the maintainer names and ask him to help in case of troubles or build my own package -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From sven at svenhartge.de Fri Jan 17 20:36:04 2014 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 17 Jan 2014 19:36:04 +0100 Subject: [Dovecot] Sizing MTA servers References: <886a24b529de09eea58ecc562049ab96665fe200@webmail.westnet.com.au> <52D8FDB4.7030105@hardwarefreak.com> <52D943F1.50505@ente.limmat.ch> Message-ID: <9aceho8mmjv8@mids.svenhartge.de> Adrian Zaugg wrote: > Am 17.01.14 10:53 schrieb Stan Hoeppner: >> On 1/16/2014 6:56 PM, Murray Trainer wrote: >> MTA = disk. Always has always will. Disk throughput is always the >> critical factor for queue performance, and an MTA is little more than a >> queue. Which makes it surprising that so many people ignore disk when >> talking about mail servers, as you have done here. > Exim tries to deliver every message without queueing it first. The documentation says something different: http://www.exim.org/exim-html-current/doc/html/spec_html/ch-how_exim_receives_and_delivers_mail.html ,----[ 6. Handling an incoming message | When Exim accepts a message, it writes two files in its spool directory. | The first contains the envelope information, the current status of the | message, and the header lines, and the second contains the body of the | message. The names of the two spool files consist of the message id, | followed by -H for the file containing the envelope and header, and -D | for the data file. `---- and ,----[ 7. Life of a message | A message remains in the spool directory until it is completely | delivered to its recipients or to an error address, or until it is | deleted by an administrator or by the user who originally created it. In | cases when delivery cannot proceed ? for example, when a message can | neither be delivered to its recipients nor returned to its sender, the | message is marked ?frozen? on the spool, and no more deliveries are | attempted. `---- So exim4 _always_ writes a message to disk first and _then_ tries to deliver the mail. But: there is a new delivery mode available since Exim 4.82, named "cutthrough delivery", set via as a control item in the RCPT ACL: http://www.exim.org/exim-html-current/doc/html/spec_html/ch-access_control_lists.html#SECTcontrols ,---- | control = cutthrough_delivery | | This option requests delivery be attempted while the item is being | received. It is usable in the RCPT ACL and valid only for | single-recipient mails forwarded from one SMTP connection to another. If | a recipient-verify callout connection is requested in the same ACL it is | held open and used for the data, otherwise one is made after the ACL | completes. Note that routers are used in verify mode. | | Should the ultimate destination system positively accept or reject the | mail, a corresponding indication is given to the source system and | nothing is queued. If there is a temporary error the item is queued for | later delivery in the usual fashion. If the item is successfully | delivered in cutthrough mode the log line is tagged with ">>" rather | than "=>" and appears before the acceptance "<=" line. | | Delivery in this mode avoids the generation of a bounce mail to a | (possibly faked) sender when the destination system is doing | content-scan based rejection. `---- Gr??e, Sven. -- Sigmentation fault. Core dumped. From sca at andreasschulze.de Sat Jan 18 00:28:17 2014 From: sca at andreasschulze.de (Andreas Schulze) Date: Fri, 17 Jan 2014 23:28:17 +0100 Subject: [Dovecot] doveconf base_dir Message-ID: <20140117232817.Horde.pDXBDfE4SBCwKRHbOxef6w1@horde.andreasschulze.de> Hello, today I run the command "doveadm auth cache flush" for the first time. # doveadm auth cache flush doveadm(root): Error: userdb lookup: connect(/var/run/dovecotauth-master) failed: No such file or directory 0 cache entries flushed # base_dir was the only item contain 'run' and it did not end with a / So I tried to set base_dir to /var/run/dovecot/ and could now rerun "doveadm auth cache flush" without problems. I compile dovecot from source and found --with-rundir=/var/run/dovecot as an option to configure. I changed to /var/run/dovecot/, recompile and removed the base_dir setting in dovecot.conf again. Now "doveadm auth cache flush" work out of the box. doveconf -d base_dir is var/run/dovecot/. Finaly I compiled dovecot with --localstatedir=/var and removed --with-rundir from configure. The resulting package had again base_dir = /var/run/dovecot so "doveadm auth cache flush" don't work. looks like somewhere the missing / should be added in case base_dir has no trailing / without special configuration. Andreas From stan at hardwarefreak.com Sat Jan 18 00:28:57 2014 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 17 Jan 2014 16:28:57 -0600 Subject: [Dovecot] Sizing MTA servers In-Reply-To: <9aceho8mmjv8@mids.svenhartge.de> References: <886a24b529de09eea58ecc562049ab96665fe200@webmail.westnet.com.au> <52D8FDB4.7030105@hardwarefreak.com> <52D943F1.50505@ente.limmat.ch> <9aceho8mmjv8@mids.svenhartge.de> Message-ID: <52D9AEA9.1060602@hardwarefreak.com> On 1/17/2014 12:36 PM, Sven Hartge wrote: ... > http://www.exim.org/exim-html-current/doc/html/spec_html/ch-access_control_lists.html#SECTcontrols > > ,---- > | control = cutthrough_delivery > | > | This option requests delivery be attempted while the item is being > | received. It is usable in the RCPT ACL and valid only for > | single-recipient mails forwarded from one SMTP connection to another. If > | a recipient-verify callout connection is requested in the same ACL it is > | held open and used for the data, otherwise one is made after the ACL > | completes. Note that routers are used in verify mode. > | > | Should the ultimate destination system positively accept or reject the > | mail, a corresponding indication is given to the source system and > | nothing is queued. If there is a temporary error the item is queued for > | later delivery in the usual fashion. If the item is successfully > | delivered in cutthrough mode the log line is tagged with ">>" rather > | than "=>" and appears before the acceptance "<=" line. > | > | Delivery in this mode avoids the generation of a bounce mail to a > | (possibly faked) sender when the destination system is doing > | content-scan based rejection. > `---- The OP is obviously making accept/reject decisions at the gateway MTAs using the usual SMTP connection and header analysis methods, and -then- doing his SA scoring. So this cutthrough mode simply won't work. The mail must be accepted and queued, piped to SA for analysis, re-queued, then relayed to his mailbox servers. -- Stan From ghariharan at gmail.com Sat Jan 18 15:04:10 2014 From: ghariharan at gmail.com (Ganesh Hariharan) Date: Sat, 18 Jan 2014 18:34:10 +0530 Subject: [Dovecot] Dovecot - not pulling pop3s email from virtual mbox In-Reply-To: References: Message-ID: Hi, Client is able to authenticate to the dovecot server using cram-md5 password, and I can see the file being created by dovecot server under /var/spool/mail/ghhdomain.com/info/Inbox, having said it is 0 byte file and no mails are found any help is appreciated.. logs as below Jan 18 17:22:53 ns dovecot: auth: Debug: auth client connected (pid=5162) Jan 18 17:22:53 ns dovecot: auth: Debug: client in: AUTH#0111#011CRAM-MD5#011service=pop3#011secured#011lip=10.0.0.12#011rip=10.0.0.12#011lport=995#011rport=60156 Jan 18 17:22:53 ns dovecot: auth: Debug: client out: CONT#0111#011PDA0NDM3NzgzNDMyODE4MzMuMTM5MDA0NTk3M0Bucy5tYXN0ZXItc2VydmVyPg== Jan 18 17:22:53 ns dovecot: auth: Debug: client in: CONT#0111#011aW5mb0BnaGhkb21haW4uY29tIGJhMGYwMGEzZmZkMjU5YWJjZDA4ZTI5ZmIwZDY4Y2Mw Jan 18 17:22:53 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): lookup: user=info at ghhdomain.com file=/etc/dovecot/users Jan 18 17:22:53 ns dovecot: auth: Debug: password(info at ghhdomain.com,10.0.0.12): Credentials: 8314fef5923bb513c7e8be9e663501bbc56ce1012aae68e4c68852be5ab8da76 Jan 18 17:22:53 ns dovecot: auth: Debug: client out: OK#0111#011user= info at ghhdomain.com Jan 18 17:22:53 ns dovecot: auth: Debug: master in: REQUEST#011931659777#0115162#0111#011ec6a642974dcbb984952b19eb208d849 Jan 18 17:22:53 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): lookup: user=info at ghhdomain.com file=/etc/dovecot/users Jan 18 17:22:53 ns dovecot: auth: Debug: master out: USER#011931659777# 011info at ghhdomain.com#011uid=503#011gid=503#011home=/bin/false Jan 18 17:22:53 ns dovecot: pop3-login: Login: user=, method=CRAM-MD5, rip=10.0.0.12, lip=10.0.0.12, mpid=5163, TLS Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Debug: Effective uid=503, gid=503, home=/bin/false Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Error: chdir(/bin/false) failed: Not a directory Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Debug: mbox: INBOX defaulted to /var/spool/mail/info at ghhdomain.com/inbox the current config as below # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.el6.i686 i686 CentOS release 6.5 (Final) ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = cram-md5 mail_debug = yes mail_full_filesystem_access = yes mail_gid = 503 mail_location = mbox:/var/spool/mail/ghhdomain.com/%n mail_uid = 503 mbox_write_locks = fcntl passdb { args = scheme=cram-md5 username_format=%u /etc/dovecot/users driver = passwd-file } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 16 Jan 2014, Ganesh Hariharan wrote: > > I have two files , users and passwd >> >> cat /etc/dovecot/users >> info at ghhdomain.com:501:501:/var/spool/mail/ghhdomain/info/:/bin/false: >> >> [sysopminds at ns ~]$ cat /etc/dovecot/passwd >> info at ghhdomain.com: >> {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d >> 2cf6:503:503 >> > > See: http://wiki2.dovecot.org/AuthDatabase/PasswdFile > the syntax is: user:password:uid:gid:(gecos):home:(shell):extra_fields > so your user file is wrong. But this error would come later. > > The config shows that you have not configured no passdb. Re-check that > you've included the appropriate auth*ext files, e.g. the > auth-passwdfile.conf.ext. > > > On Thu, Jan 16, 2014 at 3:44 PM, Steffen Kaiser < >> skdovecot at smail.inf.fh-brs.de> wrote: >> >> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> >>> On Thu, 16 Jan 2014, Ganesh Hariharan wrote: >>> >>> Jan 16 09:27:04 ns dovecot: auth: Error: passwd-file /etc/dovecot/users: >>> >>>> User info at ghhdomain.com has invalid GID '/var/spool/mail/ghhdomain/ >>>> info/' >>>> Jan 16 09:27:04 ns dovecot: auth: Debug: passwd-file /etc/dovecot/users: >>>> Read 0 users >>>> >>>> >>> Please see my configs >>> >>>> >>>> don't grab selected output from the conf files, use doveconf -n >>> >>> >>> users file look like this >>>> info at ghhdomain.com: >>>> {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d >>>> 2cf6:503:503 >>>> >>>> >>>> Do you have a line with "/var/spool/mail/ghhdomain/info/" in >>> /etc/dovecot/users ? Post that line and, say, three lines before and >>> three >>> after it. >>> >>> - -- Steffen Kaiser >>> -----BEGIN PGP SIGNATURE----- >>> Version: GnuPG v1.4.11 (GNU/Linux) >>> >>> iQEVAwUBUtew/HD1/YhP6VMHAQLtbwgAjj11c42Ou+tQ5pBglOIIIfU+VrKjq2Av >>> 0Ii2FMcjT/KMH7yHya/Dj6KGUMv1miZGj3FSpGaihcYIilxkjUXKr01noSmEb4Pj >>> BkSHkqciJrzVZulzDtOiWXEl3jsT3VpQcqMKbfMOrAshG9nxz0cTCw6AtIEllJC8 >>> StytjqaaYDBaW5zmRWY7kSjKiLHr8Y3nLQfFLPjrRw1KL1lKTTNm8o2mpA1Yah+3 >>> cBZ1zFBswxbVmORhcug+sJB+vWauiZ9cX5DGgjLjflHFiaL9CXnGnjntdki2ZFjg >>> VAShxwU/RSnTQBrdYvWSvAtD+bXP+3eySuitaHqyGcogHVZFb1bPQQ== >>> =w/kl >>> -----END PGP SIGNATURE----- >>> >>> >> > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUtfUOXD1/YhP6VMHAQIYYgf9EZJL9VQCUa2Qqf+OoJk+Wo+sizCV/95n > q+oaGW3OrgN/kIVLMc6qiVJQThQ6KZUadtIQKY4t987nhqByEnH6ZslNakQKRFz9 > 2tHMww7TDE/6snQeGw/D83+hnhsu7GapLTuLSE8mjOkGpj3XUQrdsthEXE3rW4Mn > ZGjubq3WVmAPxTz041sX7BsTtTqVOZCIT/lMeSUV8YkPEclC8gKzuIE2RKX9z5Ms > 3Sj8iskxYhtr9i04D/JZmlMlPrFqcxaveZWoxDwF33YJ09QkhkvKP0+/JpYP4OS9 > pxw5D7sjd4V6sYNb1jVt74WAuxRI2ZxKwOm9MZozJEiM99t9Snv56g== > =YjUp > -----END PGP SIGNATURE----- > From ghariharan at gmail.com Sat Jan 18 15:13:38 2014 From: ghariharan at gmail.com (Ganesh Hariharan) Date: Sat, 18 Jan 2014 18:43:38 +0530 Subject: [Dovecot] Dovecot - not pulling pop3s email from virtual mbox In-Reply-To: References: Message-ID: *Please ignore the previous logs, The latest logs is like this* Jan 18 18:24:20 ns dovecot: pop3(info at ghhdomain.com): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0 Jan 18 18:24:21 ns dovecot: auth: Debug: auth client connected (pid=6565)uth: Debug: Module loaded: /usr/lib/dovecot/auth/libdriver_sqlite.so Jan 18 18:24:20 ns dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/auth/libmech_gssapi.so Jan 18 18:24:20 ns dovecot: auth: Debug: passwd-file /etc/dovecot/users: Read 1 users Jan 18 18:24:20 ns dovecot: auth: Debug: auth client connected (pid=6557) Jan 18 18:24:20 ns dovecot: auth: Debug: client in: AUTH#0111#011CRAM-MD5#011service=pop3#011secured#011lip=10.0.0.12#011rip=10.0.0.12#011lport=995#011rport=60220 Jan 18 18:24:20 ns dovecot: auth: Debug: client out: CONT#0111#011PDkyMTUxNjk0NjcyMTczNTguMTM5MDA0OTY2MEBucy5tYXN0ZXItc2VydmVyPg== Jan 18 18:24:20 ns dovecot: auth: Debug: client in: CONT#0111#011aW5mb0BnaGhkb21haW4uY29tIGQxYWQ3YjFjZGJhNzgzYThlZTE0YjFmYTQzZWRhNWYy Jan 18 18:24:20 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): lookup: user=info at ghhdomain.com file=/etc/dovecot/users Jan 18 18:24:20 ns dovecot: auth: Debug: password(info at ghhdomain.com,10.0.0.12): Credentials: 8314fef5923bb513c7e8be9e663501bbc56ce1012aae68e4c68852be5ab8da76 Jan 18 18:24:20 ns dovecot: auth Jan 18 18:24:21 ns dovecot: auth: Debug: client in: AUTH#0111#011CRAM-MD5#011service=pop3#011secured#011lip=10.0.0.12#011rip=10.0.0.12#011lport=995#011rport=60221 Jan 18 18:24:21 ns dovecot: auth: Debug: client out: CONT#0111#011PDgzODc1MDY2NDY4MTI4NDIuMTM5MDA0OTY2MUBucy5tYXN0ZXItc2VydmVyPg== Jan 18 18:24:21 ns dovecot: auth: Debug: client in: CONT#0111#011aW5mb0BnaGhkb21haW4uY29tIDQxZGNhMjZhNWFiNDE4Nzc3OWMyNjA4YWZjZTZlM2U3 Jan 18 18:24:21 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): lookup: user=info at ghhdomain.com file=/etc/dovecot/users Jan 18 18:24:21 ns dovecot: auth: Debug: password(info at ghhdomain.com,10.0.0.12): Credentials: 8314fef5923bb513c7e8be9e663501bbc56ce1012aae68e4c68852be5ab8da76 Jan 18 18:24:21 ns dovecot: auth: Debug: client out: OK#0111#011user= info at ghhdomain.com Jan 18 18:24:21 ns dovecot: auth: Debug: master in: REQUEST#0113064463361#0116565#0111#0113f28733155b91b94914b425475b79851 Jan 18 18:24:21 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): lookup: user=info at ghhdomain.com file=/etc/dovecot/users Jan 18 18:24:21 ns dovecot: auth: Debug: master out: USER#0113064463361# 011info at ghhdomain.com#011uid=503#011gid=503 Jan 18 18:24:21 ns dovecot: pop3-login: Login: user=, method=CRAM-MD5, rip=10.0.0.12, lip=10.0.0.12, mpid=6566, TLS Jan 18 18:24:21 ns dovecot: pop3(info at ghhdomain.com): Debug: Effective uid=503, gid=503, home= Jan 18 18:24:21 ns dovecot: pop3(info at ghhdomain.com): Debug: mbox: INBOX defaulted to /var/spool/mail/ghhdomain.com/info/inbox Jan 18 18:24:21 ns dovecot: pop3(info at ghhdomain.com): Debug: fs: root=/var/spool/mail/ghhdomain.com/info, index=, control=, inbox=/var/spool/mail/ghhdomain.com/info/inbox On Sat, Jan 18, 2014 at 6:34 PM, Ganesh Hariharan wrote: > Hi, > > Client is able to authenticate to the dovecot server using cram-md5 > password, and I can see the file being created by dovecot server under > /var/spool/mail/ghhdomain.com/info/Inbox, having said it is 0 byte file > and no mails are found > > > any help is appreciated.. > > > logs as below > Jan 18 17:22:53 ns dovecot: auth: Debug: auth client connected (pid=5162) > Jan 18 17:22:53 ns dovecot: auth: Debug: client in: > AUTH#0111#011CRAM-MD5#011service=pop3#011secured#011lip=10.0.0.12#011rip=10.0.0.12#011lport=995#011rport=60156 > Jan 18 17:22:53 ns dovecot: auth: Debug: client out: > CONT#0111#011PDA0NDM3NzgzNDMyODE4MzMuMTM5MDA0NTk3M0Bucy5tYXN0ZXItc2VydmVyPg== > Jan 18 17:22:53 ns dovecot: auth: Debug: client in: > CONT#0111#011aW5mb0BnaGhkb21haW4uY29tIGJhMGYwMGEzZmZkMjU5YWJjZDA4ZTI5ZmIwZDY4Y2Mw > Jan 18 17:22:53 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): > lookup: user=info at ghhdomain.com file=/etc/dovecot/users > Jan 18 17:22:53 ns dovecot: auth: Debug: password(info at ghhdomain.com,10.0.0.12): > Credentials: > 8314fef5923bb513c7e8be9e663501bbc56ce1012aae68e4c68852be5ab8da76 > Jan 18 17:22:53 ns dovecot: auth: Debug: client out: OK#0111#011user= > info at ghhdomain.com > Jan 18 17:22:53 ns dovecot: auth: Debug: master in: > REQUEST#011931659777#0115162#0111#011ec6a642974dcbb984952b19eb208d849 > Jan 18 17:22:53 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): > lookup: user=info at ghhdomain.com file=/etc/dovecot/users > Jan 18 17:22:53 ns dovecot: auth: Debug: master out: USER#011931659777# > 011info at ghhdomain.com#011uid=503#011gid=503#011home=/bin/false > Jan 18 17:22:53 ns dovecot: pop3-login: Login: user=, > method=CRAM-MD5, rip=10.0.0.12, lip=10.0.0.12, mpid=5163, TLS > Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Debug: Effective > uid=503, gid=503, home=/bin/false > Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Error: > chdir(/bin/false) failed: Not a directory > Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Debug: mbox: INBOX > defaulted to /var/spool/mail/info at ghhdomain.com/inbox > > > the current config as below > # 2.0.9: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-431.el6.i686 i686 CentOS release 6.5 (Final) ext4 > auth_debug = yes > auth_debug_passwords = yes > auth_mechanisms = cram-md5 > mail_debug = yes > mail_full_filesystem_access = yes > mail_gid = 503 > mail_location = mbox:/var/spool/mail/ghhdomain.com/%n > mail_uid = 503 > mbox_write_locks = fcntl > passdb { > args = scheme=cram-md5 username_format=%u /etc/dovecot/users > driver = passwd-file > } > service pop3-login { > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/users > driver = passwd-file > } > userdb { > args = username_format=%u /etc/dovecot/users > driver = passwd-file > } > > > > Thanks! > > > On Thu, Jan 16, 2014 at 6:14 PM, Steffen Kaiser < > skdovecot at smail.inf.fh-brs.de> wrote: > >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Thu, 16 Jan 2014, Ganesh Hariharan wrote: >> >> I have two files , users and passwd >>> >>> cat /etc/dovecot/users >>> info at ghhdomain.com:501:501:/var/spool/mail/ghhdomain/info/:/bin/false: >>> >>> [sysopminds at ns ~]$ cat /etc/dovecot/passwd >>> info at ghhdomain.com: >>> {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d >>> 2cf6:503:503 >>> >> >> See: http://wiki2.dovecot.org/AuthDatabase/PasswdFile >> the syntax is: user:password:uid:gid:(gecos):home:(shell):extra_fields >> so your user file is wrong. But this error would come later. >> >> The config shows that you have not configured no passdb. Re-check that >> you've included the appropriate auth*ext files, e.g. the >> auth-passwdfile.conf.ext. >> >> >> On Thu, Jan 16, 2014 at 3:44 PM, Steffen Kaiser < >>> skdovecot at smail.inf.fh-brs.de> wrote: >>> >>> -----BEGIN PGP SIGNED MESSAGE----- >>>> Hash: SHA1 >>>> >>>> >>>> On Thu, 16 Jan 2014, Ganesh Hariharan wrote: >>>> >>>> Jan 16 09:27:04 ns dovecot: auth: Error: passwd-file >>>> /etc/dovecot/users: >>>> >>>>> User info at ghhdomain.com has invalid GID '/var/spool/mail/ghhdomain/ >>>>> info/' >>>>> Jan 16 09:27:04 ns dovecot: auth: Debug: passwd-file >>>>> /etc/dovecot/users: >>>>> Read 0 users >>>>> >>>>> >>>> Please see my configs >>>> >>>>> >>>>> don't grab selected output from the conf files, use doveconf -n >>>> >>>> >>>> users file look like this >>>>> info at ghhdomain.com: >>>>> {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d >>>>> 2cf6:503:503 >>>>> >>>>> >>>>> Do you have a line with "/var/spool/mail/ghhdomain/info/" in >>>> /etc/dovecot/users ? Post that line and, say, three lines before and >>>> three >>>> after it. >>>> >>>> - -- Steffen Kaiser >>>> -----BEGIN PGP SIGNATURE----- >>>> Version: GnuPG v1.4.11 (GNU/Linux) >>>> >>>> iQEVAwUBUtew/HD1/YhP6VMHAQLtbwgAjj11c42Ou+tQ5pBglOIIIfU+VrKjq2Av >>>> 0Ii2FMcjT/KMH7yHya/Dj6KGUMv1miZGj3FSpGaihcYIilxkjUXKr01noSmEb4Pj >>>> BkSHkqciJrzVZulzDtOiWXEl3jsT3VpQcqMKbfMOrAshG9nxz0cTCw6AtIEllJC8 >>>> StytjqaaYDBaW5zmRWY7kSjKiLHr8Y3nLQfFLPjrRw1KL1lKTTNm8o2mpA1Yah+3 >>>> cBZ1zFBswxbVmORhcug+sJB+vWauiZ9cX5DGgjLjflHFiaL9CXnGnjntdki2ZFjg >>>> VAShxwU/RSnTQBrdYvWSvAtD+bXP+3eySuitaHqyGcogHVZFb1bPQQ== >>>> =w/kl >>>> -----END PGP SIGNATURE----- >>>> >>>> >>> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1.4.11 (GNU/Linux) >> >> iQEVAwUBUtfUOXD1/YhP6VMHAQIYYgf9EZJL9VQCUa2Qqf+OoJk+Wo+sizCV/95n >> q+oaGW3OrgN/kIVLMc6qiVJQThQ6KZUadtIQKY4t987nhqByEnH6ZslNakQKRFz9 >> 2tHMww7TDE/6snQeGw/D83+hnhsu7GapLTuLSE8mjOkGpj3XUQrdsthEXE3rW4Mn >> ZGjubq3WVmAPxTz041sX7BsTtTqVOZCIT/lMeSUV8YkPEclC8gKzuIE2RKX9z5Ms >> 3Sj8iskxYhtr9i04D/JZmlMlPrFqcxaveZWoxDwF33YJ09QkhkvKP0+/JpYP4OS9 >> pxw5D7sjd4V6sYNb1jVt74WAuxRI2ZxKwOm9MZozJEiM99t9Snv56g== >> =YjUp >> -----END PGP SIGNATURE----- >> > > From markus at gekmihesg.de Sat Jan 18 15:25:40 2014 From: markus at gekmihesg.de (Markus Weippert) Date: Sat, 18 Jan 2014 14:25:40 +0100 Subject: [Dovecot] Replication and public namespaces In-Reply-To: <52D3D289.4040105@gekmihesg.de> References: <52D3D289.4040105@gekmihesg.de> Message-ID: <52DA80D4.3000900@gekmihesg.de> On 13.01.2014 12:48, Markus Weippert wrote: > Hi, > > I'm having some issues with replicating public namespaces. Everything > seems to work fine for private namespaces, but while importing some huge > mailboxes (many small mails) into a public namespace via imapsync, > something goes wrong. > > The expected mail flow is: > old-server (imapsync)> new-server1 (replication)> new-server2 > > But then, dovecot seems to run into race conditions when the > replications process tries to sync the same public mailbox under two or > more different users at the same time. As a result, messages get > duplicated, new-server2 sends those back to new-server1 which then > starts to produce duplicates too. If I don't kill the processes in time > and delete the faulty mailbox, they start to produce thousands of mails. > In fact, server2 should not export messages at all, since it's not > productive yet and does not get any mail except from the replication. > > The only thing getting logged (only few compared to the huge amount of > duplicates produced): > "dsync-server(user at example.com): Warning: Maildir /...: Expunged message > reappeared, giving a new UID" > > Is there any way to fix this? > > Regards, > Markus I looked into this a bit more. The problem seems to be, replication locking is only done at user level. For public namespaces, this allows two replication processes to sync the same mailbox in parallel. So I did a (poor) implementation for mailbox level locking. It locks the mailbox with a lock file in the control directory on both sides (not sure if that's necessary) and skips locked mailboxes instantly, because they are currently being synced anyway. It actually works in my setup. The duplicate messages are gone. It logs some warnings when two replication processes try to access the same mailbox at once, which seems to happen quite frequently in public namespaces. Maybe someone more experienced can clean this up and adopt it to upstream? I really like the replication idea and it would be nice if it were as stable for shared/public namespaces as it is for private ones... Regards, Markus P.S.: > replication_dsync_parameters = -d -l 60 -N -x virtual -x ns_public -U Typo, actually looks like this: replication_dsync_parameters = -d -l 60 -N -x virtual -x legacy -U -------------- next part -------------- A non-text attachment was scrubbed... Name: dsync-lock.patch Type: text/x-patch Size: 5672 bytes Desc: not available URL: From dovecot at voidptr.de Sat Jan 18 16:12:19 2014 From: dovecot at voidptr.de (dovecot at voidptr.de) Date: Sat, 18 Jan 2014 15:12:19 +0100 Subject: [Dovecot] Dovecot doesn't seem to report all subfolders to Thunderbird Message-ID: <20140118141219.GA12060@voidptr.de> Hi, I've recently migrated my emails from a Yahoo account to my own mailserver on a VPS. Ever since then, Thunderbird seems to have issues with the mailbox's directory structure: When I start Thunderbird, it immediately deletes the local copies of all 3rd-level folders (i.e. subfolders of a subfolder of a folder in the mailbox root). Since that didn't happen with the Yahoo account, I assume it's some kind of error or misconfiguration of Dovecot. Here's an example of the mailbox structure: voidptr.de '-> University '-> IEEE '-> Conference "University" and "IEEE" work without problems, but "Conference" gets deleted locally every time I start Thunderbird. When I collapse and re-expand "University" in the folder panel, all subfolders (including "Conference") reappear, but Thunderbird has to re-download the contents of "Conference", since it deleted the local copies earlier. It looks as if Dovecot only reported the topmost two folder levels when Thunderbird requests a folder list... Is there any way I can change that behavior? Nils $ doveconf -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab078.22 x86_64 Debian 7.3 auth_verbose = yes mail_location = maildir:~/Maildir:LAYOUT=fs namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes } passdb { args = scheme=SHA512-CRYPT username_format=%n /etc/dovecot/users driver = passwd-file } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imaps { port = 0 } } ssl = required ssl_cert = References: <20140118141219.GA12060@voidptr.de> Message-ID: <52DA95BC.7040605@sys4.de> Am 18.01.2014 15:12, schrieb dovecot at voidptr.de: > Hi, > > I've recently migrated my emails from a Yahoo account to my own > mailserver on a VPS. > > Ever since then, Thunderbird seems to have issues with the mailbox's > directory structure: When I start Thunderbird, it immediately deletes > the local copies of all 3rd-level folders (i.e. subfolders of a > subfolder of a folder in the mailbox root). > Since that didn't happen with the Yahoo account, I assume it's some kind > of error or misconfiguration of Dovecot. > > Here's an example of the mailbox structure: > voidptr.de > '-> University > '-> IEEE > '-> Conference > "University" and "IEEE" work without problems, but "Conference" gets > deleted locally every time I start Thunderbird. When I collapse and > re-expand "University" in the folder panel, all subfolders (including > "Conference") reappear, but Thunderbird has to re-download the contents > of "Conference", since it deleted the local copies earlier. > > It looks as if Dovecot only reported the topmost two folder levels when > Thunderbird requests a folder list... > > Is there any way I can change that behavior? > > Nils > > > > $ doveconf -n > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-042stab078.22 x86_64 Debian 7.3 > auth_verbose = yes > mail_location = maildir:~/Maildir:LAYOUT=fs why LAYOUT=fs ?, try without http://wiki2.dovecot.org/MailboxFormat/Maildir Directory Structure By default Dovecot uses Maildir++ directory layout for organizing mailbox directories. This means that all the folders are directly inside ~/Maildir directory: ~/Maildir/new, ~/Maildir/cur and ~/Maildir/tmp directories contain the messages for INBOX. The tmp directory is used during delivery, new messages arrive in new and read shall be moved to cur by the clients. ~/Maildir/.folder/ is a mailbox folder ~/Maildir/.folder.subfolder/ is a subfolder of a folder (ie. "folder/subfolder") You can also optionally use the "fs" layout by appending :LAYOUT=fs to mail_location. This makes the folder structure look like: ~/Maildir/new, ~/Maildir/cur and ~/Maildir/tmp directories contain the messages for INBOX, just like with Maildir++. ~/Maildir/folder/ is a mailbox folder ~/Maildir/folder/subfolder/ is a subfolder of a folder or use http://wiki2.dovecot.org/Clients?highlight=%28thunderbird%29 Thunderbird If you're using mbox, dbox or Maildir with :LAYOUT=fs , You should enable tb-extra-mailbox-sep workaround for IMAP. > namespace { > inbox = yes > location = > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Junk { > auto = subscribe > special_use = \Junk > } > mailbox Sent { > auto = subscribe > special_use = \Sent > } > mailbox Trash { > auto = subscribe > special_use = \Trash > } > prefix = > subscriptions = yes > } > passdb { > args = scheme=SHA512-CRYPT username_format=%n /etc/dovecot/users > driver = passwd-file > } > protocols = " imap" > service auth { > unix_listener /var/spool/postfix/private/auth { > mode = 0666 > } > } > service imap-login { > inet_listener imaps { > port = 0 > } > } > ssl = required > ssl_cert = ssl_key = userdb { > args = username_format=%n /etc/dovecot/users > default_fields = home=/home/%n > driver = passwd-file > } > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From ghariharan at gmail.com Sat Jan 18 17:41:42 2014 From: ghariharan at gmail.com (Ganesh Hariharan) Date: Sat, 18 Jan 2014 21:11:42 +0530 Subject: [Dovecot] Dovecot - not pulling pop3s email from virtual mbox In-Reply-To: References: Message-ID: I made it work ... changed the path in mail_location and it started working Thanks On Sat, Jan 18, 2014 at 6:43 PM, Ganesh Hariharan wrote: > *Please ignore the previous logs, The latest logs is like this* > > Jan 18 18:24:20 ns dovecot: pop3(info at ghhdomain.com): Disconnected: > Logged out top=0/0, retr=0/0, del=0/0, size=0 > Jan 18 18:24:21 ns dovecot: auth: Debug: auth client connected > (pid=6565)uth: Debug: Module loaded: > /usr/lib/dovecot/auth/libdriver_sqlite.so > Jan 18 18:24:20 ns dovecot: auth: Debug: Module loaded: > /usr/lib/dovecot/auth/libmech_gssapi.so > Jan 18 18:24:20 ns dovecot: auth: Debug: passwd-file /etc/dovecot/users: > Read 1 users > Jan 18 18:24:20 ns dovecot: auth: Debug: auth client connected (pid=6557) > Jan 18 18:24:20 ns dovecot: auth: Debug: client in: > AUTH#0111#011CRAM-MD5#011service=pop3#011secured#011lip=10.0.0.12#011rip=10.0.0.12#011lport=995#011rport=60220 > Jan 18 18:24:20 ns dovecot: auth: Debug: client out: > CONT#0111#011PDkyMTUxNjk0NjcyMTczNTguMTM5MDA0OTY2MEBucy5tYXN0ZXItc2VydmVyPg== > Jan 18 18:24:20 ns dovecot: auth: Debug: client in: > CONT#0111#011aW5mb0BnaGhkb21haW4uY29tIGQxYWQ3YjFjZGJhNzgzYThlZTE0YjFmYTQzZWRhNWYy > Jan 18 18:24:20 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): > lookup: user=info at ghhdomain.com file=/etc/dovecot/users > Jan 18 18:24:20 ns dovecot: auth: Debug: password(info at ghhdomain.com,10.0.0.12): > Credentials: > 8314fef5923bb513c7e8be9e663501bbc56ce1012aae68e4c68852be5ab8da76 > Jan 18 18:24:20 ns dovecot: auth > Jan 18 18:24:21 ns dovecot: auth: Debug: client in: > AUTH#0111#011CRAM-MD5#011service=pop3#011secured#011lip=10.0.0.12#011rip=10.0.0.12#011lport=995#011rport=60221 > Jan 18 18:24:21 ns dovecot: auth: Debug: client out: > CONT#0111#011PDgzODc1MDY2NDY4MTI4NDIuMTM5MDA0OTY2MUBucy5tYXN0ZXItc2VydmVyPg== > Jan 18 18:24:21 ns dovecot: auth: Debug: client in: > CONT#0111#011aW5mb0BnaGhkb21haW4uY29tIDQxZGNhMjZhNWFiNDE4Nzc3OWMyNjA4YWZjZTZlM2U3 > Jan 18 18:24:21 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): > lookup: user=info at ghhdomain.com file=/etc/dovecot/users > Jan 18 18:24:21 ns dovecot: auth: Debug: password(info at ghhdomain.com,10.0.0.12): > Credentials: > 8314fef5923bb513c7e8be9e663501bbc56ce1012aae68e4c68852be5ab8da76 > Jan 18 18:24:21 ns dovecot: auth: Debug: client out: OK#0111#011user= > info at ghhdomain.com > Jan 18 18:24:21 ns dovecot: auth: Debug: master in: > REQUEST#0113064463361#0116565#0111#0113f28733155b91b94914b425475b79851 > Jan 18 18:24:21 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): > lookup: user=info at ghhdomain.com file=/etc/dovecot/users > Jan 18 18:24:21 ns dovecot: auth: Debug: master out: USER#0113064463361# > 011info at ghhdomain.com#011uid=503#011gid=503 > Jan 18 18:24:21 ns dovecot: pop3-login: Login: user=, > method=CRAM-MD5, rip=10.0.0.12, lip=10.0.0.12, mpid=6566, TLS > Jan 18 18:24:21 ns dovecot: pop3(info at ghhdomain.com): Debug: Effective > uid=503, gid=503, home= > Jan 18 18:24:21 ns dovecot: pop3(info at ghhdomain.com): Debug: mbox: INBOX > defaulted to /var/spool/mail/ghhdomain.com/info/inbox > Jan 18 18:24:21 ns dovecot: pop3(info at ghhdomain.com): Debug: fs: > root=/var/spool/mail/ghhdomain.com/info, index=, control=, > inbox=/var/spool/mail/ghhdomain.com/info/inbox > > > On Sat, Jan 18, 2014 at 6:34 PM, Ganesh Hariharan wrote: > >> Hi, >> >> Client is able to authenticate to the dovecot server using cram-md5 >> password, and I can see the file being created by dovecot server under >> /var/spool/mail/ghhdomain.com/info/Inbox, having said it is 0 byte file >> and no mails are found >> >> >> any help is appreciated.. >> >> >> logs as below >> Jan 18 17:22:53 ns dovecot: auth: Debug: auth client connected (pid=5162) >> Jan 18 17:22:53 ns dovecot: auth: Debug: client in: >> AUTH#0111#011CRAM-MD5#011service=pop3#011secured#011lip=10.0.0.12#011rip=10.0.0.12#011lport=995#011rport=60156 >> Jan 18 17:22:53 ns dovecot: auth: Debug: client out: >> CONT#0111#011PDA0NDM3NzgzNDMyODE4MzMuMTM5MDA0NTk3M0Bucy5tYXN0ZXItc2VydmVyPg== >> Jan 18 17:22:53 ns dovecot: auth: Debug: client in: >> CONT#0111#011aW5mb0BnaGhkb21haW4uY29tIGJhMGYwMGEzZmZkMjU5YWJjZDA4ZTI5ZmIwZDY4Y2Mw >> Jan 18 17:22:53 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): >> lookup: user=info at ghhdomain.com file=/etc/dovecot/users >> Jan 18 17:22:53 ns dovecot: auth: Debug: password(info at ghhdomain.com,10.0.0.12): >> Credentials: >> 8314fef5923bb513c7e8be9e663501bbc56ce1012aae68e4c68852be5ab8da76 >> Jan 18 17:22:53 ns dovecot: auth: Debug: client out: OK#0111#011user= >> info at ghhdomain.com >> Jan 18 17:22:53 ns dovecot: auth: Debug: master in: >> REQUEST#011931659777#0115162#0111#011ec6a642974dcbb984952b19eb208d849 >> Jan 18 17:22:53 ns dovecot: auth: Debug: passwd-file(info at ghhdomain.com,10.0.0.12): >> lookup: user=info at ghhdomain.com file=/etc/dovecot/users >> Jan 18 17:22:53 ns dovecot: auth: Debug: master out: USER#011931659777# >> 011info at ghhdomain.com#011uid=503#011gid=503#011home=/bin/false >> Jan 18 17:22:53 ns dovecot: pop3-login: Login: user=, >> method=CRAM-MD5, rip=10.0.0.12, lip=10.0.0.12, mpid=5163, TLS >> Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Debug: Effective >> uid=503, gid=503, home=/bin/false >> Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Error: >> chdir(/bin/false) failed: Not a directory >> Jan 18 17:22:53 ns dovecot: pop3(info at ghhdomain.com): Debug: mbox: INBOX >> defaulted to /var/spool/mail/info at ghhdomain.com/inbox >> >> >> the current config as below >> # 2.0.9: /etc/dovecot/dovecot.conf >> # OS: Linux 2.6.32-431.el6.i686 i686 CentOS release 6.5 (Final) ext4 >> auth_debug = yes >> auth_debug_passwords = yes >> auth_mechanisms = cram-md5 >> mail_debug = yes >> mail_full_filesystem_access = yes >> mail_gid = 503 >> mail_location = mbox:/var/spool/mail/ghhdomain.com/%n >> mail_uid = 503 >> mbox_write_locks = fcntl >> passdb { >> args = scheme=cram-md5 username_format=%u /etc/dovecot/users >> driver = passwd-file >> } >> service pop3-login { >> inet_listener pop3 { >> port = 110 >> } >> inet_listener pop3s { >> port = 995 >> ssl = yes >> } >> } >> ssl_cert = > ssl_key = > userdb { >> args = /etc/dovecot/users >> driver = passwd-file >> } >> userdb { >> args = username_format=%u /etc/dovecot/users >> driver = passwd-file >> } >> >> >> >> Thanks! >> >> >> On Thu, Jan 16, 2014 at 6:14 PM, Steffen Kaiser < >> skdovecot at smail.inf.fh-brs.de> wrote: >> >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> On Thu, 16 Jan 2014, Ganesh Hariharan wrote: >>> >>> I have two files , users and passwd >>>> >>>> cat /etc/dovecot/users >>>> info at ghhdomain.com:501:501:/var/spool/mail/ghhdomain/info/:/bin/false: >>>> >>>> [sysopminds at ns ~]$ cat /etc/dovecot/passwd >>>> info at ghhdomain.com: >>>> {CRAM-MD5}e02d374fde0dc75a17a557039a3a5338c7743304777dccd376f332bee68d >>>> 2cf6:503:503 >>>> >>> >>> See: http://wiki2.dovecot.org/AuthDatabase/PasswdFile >>> the syntax is: user:password:uid:gid:(gecos):home:(shell):extra_fields >>> so your user file is wrong. But this error would come later. >>> >>> The config shows that you have not configured no passdb. Re-check that >>> you've included the appropriate auth*ext files, e.g. the >>> auth-passwdfile.conf.ext. >>> >>> >>> On Thu, Jan 16, 2014 at 3:44 PM, Steffen Kaiser < >>>> skdovecot at smail.inf.fh-brs.de> wrote: >>>> >>>> -----BEGIN PGP SIGNED MESSAGE----- >>>>> Hash: SHA1 >>>>> >>>>> >>>>> On Thu, 16 Jan 2014, Ganesh Hariharan wrote: >>>>> >>>>> Jan 16 09:27:04 ns dovecot: auth: Error: passwd-file >>>>> /etc/dovecot/users: >>>>> >>>>>> User info at ghhdomain.com has invalid GID '/var/spool/mail/ghhdomain/ >>>>>> info/' >>>>>> Jan 16 09:27:04 ns dovecot: auth: Debug: passwd-file >>>>>> /etc/dovecot/users: >>>>>> Read 0 users >>>>>> >>>>>> >>>>> Please see my configs >>>>> >>>>>> >>>>>> don't grab selected output from the conf files, use doveconf -n >>>>> >>>>> >>>>> users file look like this >>>>>> info at ghhdomain.com: >>>>>> {CRAM-MD5}e02d374fde0dc75a17a557039a3a53 >>>>>> 38c7743304777dccd376f332bee68d >>>>>> 2cf6:503:503 >>>>>> >>>>>> >>>>>> Do you have a line with "/var/spool/mail/ghhdomain/info/" in >>>>> /etc/dovecot/users ? Post that line and, say, three lines before and >>>>> three >>>>> after it. >>>>> >>>>> - -- Steffen Kaiser >>>>> -----BEGIN PGP SIGNATURE----- >>>>> Version: GnuPG v1.4.11 (GNU/Linux) >>>>> >>>>> iQEVAwUBUtew/HD1/YhP6VMHAQLtbwgAjj11c42Ou+tQ5pBglOIIIfU+VrKjq2Av >>>>> 0Ii2FMcjT/KMH7yHya/Dj6KGUMv1miZGj3FSpGaihcYIilxkjUXKr01noSmEb4Pj >>>>> BkSHkqciJrzVZulzDtOiWXEl3jsT3VpQcqMKbfMOrAshG9nxz0cTCw6AtIEllJC8 >>>>> StytjqaaYDBaW5zmRWY7kSjKiLHr8Y3nLQfFLPjrRw1KL1lKTTNm8o2mpA1Yah+3 >>>>> cBZ1zFBswxbVmORhcug+sJB+vWauiZ9cX5DGgjLjflHFiaL9CXnGnjntdki2ZFjg >>>>> VAShxwU/RSnTQBrdYvWSvAtD+bXP+3eySuitaHqyGcogHVZFb1bPQQ== >>>>> =w/kl >>>>> -----END PGP SIGNATURE----- >>>>> >>>>> >>>> >>> - -- Steffen Kaiser >>> -----BEGIN PGP SIGNATURE----- >>> Version: GnuPG v1.4.11 (GNU/Linux) >>> >>> iQEVAwUBUtfUOXD1/YhP6VMHAQIYYgf9EZJL9VQCUa2Qqf+OoJk+Wo+sizCV/95n >>> q+oaGW3OrgN/kIVLMc6qiVJQThQ6KZUadtIQKY4t987nhqByEnH6ZslNakQKRFz9 >>> 2tHMww7TDE/6snQeGw/D83+hnhsu7GapLTuLSE8mjOkGpj3XUQrdsthEXE3rW4Mn >>> ZGjubq3WVmAPxTz041sX7BsTtTqVOZCIT/lMeSUV8YkPEclC8gKzuIE2RKX9z5Ms >>> 3Sj8iskxYhtr9i04D/JZmlMlPrFqcxaveZWoxDwF33YJ09QkhkvKP0+/JpYP4OS9 >>> pxw5D7sjd4V6sYNb1jVt74WAuxRI2ZxKwOm9MZozJEiM99t9Snv56g== >>> =YjUp >>> -----END PGP SIGNATURE----- >>> >> >> > From dovecot at voidptr.de Sat Jan 18 17:43:24 2014 From: dovecot at voidptr.de (dovecot at voidptr.de) Date: Sat, 18 Jan 2014 16:43:24 +0100 Subject: [Dovecot] Dovecot doesn't seem to report all subfolders to Thunderbird In-Reply-To: <52DA95BC.7040605@sys4.de> References: <20140118141219.GA12060@voidptr.de> <52DA95BC.7040605@sys4.de> Message-ID: <20140118154324.GA12754@voidptr.de> On Sat, Jan 18, 2014 at 03:54:52PM +0100, Robert Schetterer wrote: > Am 18.01.2014 15:12, schrieb dovecot at voidptr.de: > > mail_location = maildir:~/Maildir:LAYOUT=fs > > why LAYOUT=fs ?, try without Some of my folder names contain dots, so that won't work. Or am I missing something there? Also, is there a reason not to? At least the wiki page [1] you linked doesn't seem to mention anything. > http://wiki2.dovecot.org/Clients?highlight=%28thunderbird%29 > > Thunderbird > > If you're using mbox, dbox or Maildir with :LAYOUT=fs , > > You should enable tb-extra-mailbox-sep workaround for IMAP. Thanks for the hint. It doesn't seem to be related to the vanishing folder problem, but it's helpful to know. Nils [1] http://wiki2.dovecot.org/MailboxFormat/Maildir From rs at sys4.de Sat Jan 18 18:49:08 2014 From: rs at sys4.de (Robert Schetterer) Date: Sat, 18 Jan 2014 17:49:08 +0100 Subject: [Dovecot] Dovecot doesn't seem to report all subfolders to Thunderbird In-Reply-To: <20140118154324.GA12754@voidptr.de> References: <20140118141219.GA12060@voidptr.de> <52DA95BC.7040605@sys4.de> <20140118154324.GA12754@voidptr.de> Message-ID: <52DAB084.7060705@sys4.de> Am 18.01.2014 16:43, schrieb dovecot at voidptr.de: > On Sat, Jan 18, 2014 at 03:54:52PM +0100, Robert Schetterer wrote: >> Am 18.01.2014 15:12, schrieb dovecot at voidptr.de: >>> mail_location = maildir:~/Maildir:LAYOUT=fs >> >> why LAYOUT=fs ?, try without > > Some of my folder names contain dots, so that won't work. use http://wiki2.dovecot.org/Plugins/Listescape to solve that Or am I > missing something there? > Also, is there a reason not to? At least the wiki page [1] you linked > doesn't seem to mention anything. > >> http://wiki2.dovecot.org/Clients?highlight=%28thunderbird%29 >> >> Thunderbird >> >> If you're using mbox, dbox or Maildir with :LAYOUT=fs , >> >> You should enable tb-extra-mailbox-sep workaround for IMAP. > > Thanks for the hint. It doesn't seem to be related to the vanishing > folder problem, but it's helpful to know. > > Nils > > > [1] http://wiki2.dovecot.org/MailboxFormat/Maildir > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From dieterknopf at googlemail.com Sun Jan 19 05:59:18 2014 From: dieterknopf at googlemail.com (Dieter Knopf) Date: Sun, 19 Jan 2014 04:59:18 +0100 Subject: [Dovecot] Shared Folters with LDA/Sieve In-Reply-To: References: Message-ID: Thanks again for the help. (after a long time) But i still don't get this working :-( I tried the way via mysql (http://wiki2.dovecot.org/SharedMailboxes/Shared) but nothing happens. I can't see (or subscribe) the shared folders. I inserted (to the mysql table): from_user=info at foo.tld to_users=name at foo.tld But the user name at foo.tld can't subscribe/see anything. I added shared namespace to the config: namespace { type = shared separator = / prefix = shared/%%d/%%n/ location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = no list = children } Not sure if this is the right way if i use virtual users: mail_location = maildir:/home/vmail/%d/%n:INDEX=/home/vmail-indexes/%d/%n:LAYOUT=fs namespace { type = private separator = / prefix = inbox = yes ... Thanks! 2013/11/18 Steffen Kaiser > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > On Sun, 17 Nov 2013, Dieter Knopf wrote: > > I need global email addresses like: >> info at foo.tld >> contact at foo.tld >> help at foo.tld >> >> Every address with own Sieve-rules for filtering and sorting of incoming >> mails. >> >> Now every user needs access to this folders, but how? How should i create >> the "global" addresses? >> >> I already found http://wiki2.dovecot.org/SharedMailboxes/Public , but >> that's just a public namespace. >> >> Is there any FAQ available for this? >> > > IMHO, you should use: > http://wiki2.dovecot.org/SharedMailboxes/Shared > http://wiki2.dovecot.org/ACL > > setup those three recipient as their own accounts with Sieve filter a.s.o. > Then install ACLs to share to anyone - or create a group for all users. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUonFbl3r2wJMiz2NAQLJCgf5AcAEk8UjRYai47jEqvMbQIKsyyvMrOPA > 9fidoA3joBs6JzCfcXKGNtJHNwWrRA9g/kFR4KbPs6DlR0cXv4Do+ZcSRtMSGAkk > TdW3Rngs0on0cH1qelbaVK+f8BqSQ/YUC+0FUg+Rk23xINve5C4TkWAzn+48zN/h > qqgdet5FqchoPHUzbJxpRpXd5dRj9Kw1EjUXvVolZbmZGTRWgks9oCKuQrpSZ1VS > eViLcg59J0Dn9WhvFaLk0s3ud8teIl2hRGeInTOPBloa1C5ysyYbs72mcb00bSOt > GBZsbmZmSVdlhcsVaaL3KqCkAZTPzfGRNxOy9zLcHGw402yUDOq+XA== > =TrwU > -----END PGP SIGNATURE----- > From skdovecot at smail.inf.fh-brs.de Sun Jan 19 18:20:57 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen) Date: Sun, 19 Jan 2014 17:20:57 +0100 Subject: [Dovecot] Shared Folters with LDA/Sieve In-Reply-To: References: Message-ID: <52DBFB69.8010308@smail.inf.fh-brs.de> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Dieter Knopf wrote: > I tried the way via mysql > (http://wiki2.dovecot.org/SharedMailboxes/Shared) but nothing > happens. I can't see (or subscribe) the shared folders. > > I inserted (to the mysql table): from_user=info at foo.tld > to_users=name at foo.tld > > But the user name at foo.tld can't subscribe/see anything. Did you've read http://wiki2.dovecot.org/ACL ? The entry in the database is not the source of sharing information. > I added shared namespace to the config: namespace { type = shared > separator = / prefix = shared/%%d/%%n/ location = > maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = no > list = children } You have just copied the example into your config, haven't you? Do you get error messages about not finding the mailbox? You should enabled logging for testing: http://wiki2.dovecot.org/Logging > > Not sure if this is the right way if i use virtual users: > mail_location = > maildir:/home/vmail/%d/%n:INDEX=/home/vmail-indexes/%d/%n:LAYOUT=fs In > the shared namespace you've configured Dovecot to look in the sharing user's home directory for Maildir, but the default location points to somewhere else, no Maildir at all. Where are the mailboxes located? IMHO, the correct location for most shared namespaces would be the location of the user with %'s doubled and INDEXes per user. E.g. if above default mail_location is correct: location = maildir:/home/vmail/%%d/%%n:INDEX=/home/vmail-indexes/%d/%n/shared/%%u:LAYOUT=fs In a shared namespace %%u applies to the sharing user and %u to the current user, therefore that config defines the same as the default location, but with user-specific indexes, see http://wiki2.dovecot.org/IndexFiles if you prefer user-specific vs. mailbox-specific indexes. > namespace { type = private separator = / prefix = inbox = yes ... > > Thanks! > > > > 2013/11/18 Steffen Kaiser > > > On Sun, 17 Nov 2013, Dieter Knopf wrote: > > I need global email addresses like: >>>> info at foo.tld contact at foo.tld help at foo.tld >>>> >>>> Every address with own Sieve-rules for filtering and sorting >>>> of incoming mails. >>>> >>>> Now every user needs access to this folders, but how? How >>>> should i create the "global" addresses? >>>> >>>> I already found >>>> http://wiki2.dovecot.org/SharedMailboxes/Public , but that's >>>> just a public namespace. >>>> >>>> Is there any FAQ available for this? >>>> > > IMHO, you should use: > http://wiki2.dovecot.org/SharedMailboxes/Shared > http://wiki2.dovecot.org/ACL > > setup those three recipient as their own accounts with Sieve filter > a.s.o. Then install ACLs to share to anyone - or create a group for > all users. - -- Steffen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) Comment: Using GnuPG with undefined - http://www.enigmail.net/ iQEVAwUBUtv7aXD1/YhP6VMHAQL/BQf/W9M0ZbH04qs/8hNeO+b6scqLFYXIYRdt YI9Hno3RoIrB5KlfHpK+Mf6dZolGG4wAneJxd5mXkye+IgKIZXDCNjGp2gCRezX6 qSANzQUe2JsZFgrjiMQs/sTJB5qFhsjpHIpmQaJYCXtDdTvMe8Z01IxG8IqVAsCU p3bEb9rF/3cBd0MW2hCPAhHeoBEKZxG16ElDBPMZBj497e+I860Ulj5DaF8PZHXM EyycYNE18WanQTba1BvtlwIb9ye9EfdFOMQLojZ/coSeGkoY2LbbfbZCRURAUf9p I05ER6uzJVflVZu1LL94VBPuGRehzMdk5P6OdeIumelRFBOr3T9iew== =+bJZ -----END PGP SIGNATURE----- From sottilette at rfx.it Sun Jan 19 23:36:38 2014 From: sottilette at rfx.it (Paolo) Date: Sun, 19 Jan 2014 22:36:38 +0100 (CET) Subject: [Dovecot] mail check Message-ID: Is there some simple script that parsing the dovecot.info.log can give me a list of the mail checks for a user (better if reports also the type (POP/IMAP), and result of the sessions (Ok/Fail/Error/...))? Regards, Paolo From slitt at troubleshooters.com Mon Jan 20 00:11:28 2014 From: slitt at troubleshooters.com (Steve Litt) Date: Sun, 19 Jan 2014 17:11:28 -0500 Subject: [Dovecot] New document on troubleshooting Dovecot IMAP Message-ID: <20140119171128.396cb145@mydesk> Hi all, Check out my new document on troubleshooting Dovecot IMAP: http://www.troubleshooters.com/emailtech/imap_troubleshooting.htm Thank you to all those, on this mailing list and on the #dovecot IRC channel, for helping me with this. Thanks, SteveT Steve Litt * http://www.troubleshooters.com/ Troubleshooting Training * Human Performance From voytek at sbt.net.au Mon Jan 20 00:55:12 2014 From: voytek at sbt.net.au (voytek at sbt.net.au) Date: Mon, 20 Jan 2014 09:55:12 +1100 Subject: [Dovecot] New document on troubleshooting Dovecot IMAP In-Reply-To: <20140119171128.396cb145@mydesk> References: <20140119171128.396cb145@mydesk> Message-ID: On Mon, January 20, 2014 9:11 am, Steve Litt wrote: > Check out my new document on troubleshooting Dovecot IMAP: > http://www.troubleshooters.com/emailtech/imap_troubleshooting.htm Steve, thanks for that, interesting page, thanks for shareing (I've been meaning for a while to self document some things, you're saving me some effort, and, motivating) V From rs at sys4.de Mon Jan 20 10:07:22 2014 From: rs at sys4.de (Robert Schetterer) Date: Mon, 20 Jan 2014 09:07:22 +0100 Subject: [Dovecot] mail check In-Reply-To: References: Message-ID: <52DCD93A.2020406@sys4.de> Am 19.01.2014 22:36, schrieb Paolo: > > Is there some simple script that parsing the dovecot.info.log can give > me a list of the mail checks for a user (better if reports also the type > (POP/IMAP), and result of the sessions (Ok/Fail/Error/...))? > > Regards, Paolo > Logwatch may help you http://sourceforge.net/projects/logwatch/ short way may using something like i.e. grep -i "user" dovecot.info.log etc Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From urushkin at telros.ru Mon Jan 20 15:29:04 2014 From: urushkin at telros.ru (Sergey Urushkin) Date: Mon, 20 Jan 2014 17:29:04 +0400 Subject: [Dovecot] =?utf-8?q?auth=5Fdefault=5Frealm=2C_pam=5Fkrb5=2C_gssap?= =?utf-8?q?i?= Message-ID: Hi, Just writing here my note about auth_default_realm, pam_krb5 and gssapi. It seems that 'pam' passdb and 'gssapi' auth_mechanism doesn't honor 'auth_default_realm' setting, at least in several setups I deal with. Here is a part of the config: passdb { args = max_requests=100 cache_key=%u%r dovecot driver = pam } auth_default_realm = REALM.COM auth_mechanisms = plain login apop gssapi auth_username_format = %Uu The problem is that pam_krb5 strips default realm from username (by default), even if auth_default_realm is specified and even if user logs in as 'user1 at realm.com' (with domain part). A part of auth.log: mail auth: pam_krb5(dovecot:auth): user USER1 authenticated as USER1 at REALM.COM The same for GSSAPI auth, if specified authorization name doesn't contain domain part. A part of mail.log: mail dovecot: imap-login: Login: user=, method=GSSAPI, rip=172.16.0.1, lip=192.168.1.1, mpid=5828, TLS, session= For several reasons I do need username inside dovecot to contain domain part. So, I found a solution to this problem - modifying /etc/krb5.conf this way: [libdefaults] default_realm = REALM.COM [realms] REALM.COM = { auth_to_local = RULE:[1:$1@$0] } This will add realm part to the local username despite using default realm. Maybe it's better to put this example to the wiki? Tested with ubuntu 12.04 and dovecot 2.2.10, mit kerberos 1.10, amd64. Taking the opportunity, I'd like to ask, is there a way to make usernames case insensitive while using GSSAPI. The case: klist shows: Principal: user1 at REALM.COM username in thunderbird 'uSer1 at REALM.COM'. Dovecot gives me this message (I use auth_username_format=%Uu for pam_krb5 to be able to login with lowercase realm): dovecot: auth: gssapi(USER1 at REALM.COM,172.16.0.1,): User not authorized to log in as USER1 at REALM.COM As I know kerberos usernames are case insensitive (user part), at least kinit and windows against AD works that way. Seems that k5credentials passdb extra field will not help here too. Does anyone have an idea? Thanks. -- Best regards, Sergey Urushkin From sottilette at rfx.it Mon Jan 20 16:13:38 2014 From: sottilette at rfx.it (Paolo) Date: Mon, 20 Jan 2014 15:13:38 +0100 (CET) Subject: [Dovecot] mail check In-Reply-To: <52DCD93A.2020406@sys4.de> References: <52DCD93A.2020406@sys4.de> Message-ID: On Mon, 20 Jan 2014, Robert Schetterer wrote: > Am 19.01.2014 22:36, schrieb Paolo: >> >> Is there some simple script that parsing the dovecot.info.log can give >> me a list of the mail checks for a user (better if reports also the type >> (POP/IMAP), and result of the sessions (Ok/Fail/Error/...))? >> >> Regards, Paolo > > Logwatch may help you > > http://sourceforge.net/projects/logwatch/ I am using CentOS 6.x with default dovecot-2.0.16 and logwatch-7.3.6 In default config it don't give any useful info. Tried to update the docevot script with other from the net and modifing the logs reference, but also using a specified call to it like: logwatch --service dovecot --debug 10 --logfile dovecot I obtain nothing or a complete list of sessions disabling OnlyService = (imap-login|pop3-login|dovecot) in the dovecot.conf file Probably there is some bug or I am missing something. Nothing interesting n the archive list. > short way may using something like i.e. > > grep -i "user" dovecot.info.log etc That is what I am using now. Hoped in someone that had write something that summarize this output better :-) Regards, Paolo From morrisonli at 126.com Mon Jan 20 17:35:27 2014 From: morrisonli at 126.com (morrison) Date: Mon, 20 Jan 2014 23:35:27 +0800 (CST) Subject: [Dovecot] imap abort after upgrade from 2.2.4 to 2.2.7 Message-ID: <78c42c33.1ce64.143b04ac84a.Coremail.morrisonli@126.com> When I did upgrade, 2.2.7 was the latest release. When I ran into the problem, I checked back and found 2.2.8 and 2.2.9 were released shortly one after another. It seemed these releases were sort of buggy. I would like to know if what I described in my previous email was an known issue and was addressed before upgrade to 2.2.10. We are using dovecot as our internal mail service. So stable is most important to us. Regards, From interfasys at gmail.com Mon Jan 20 23:01:09 2014 From: interfasys at gmail.com (=?UTF-8?B?aW50ZXJmYVN5cyBzw6BybA==?=) Date: Mon, 20 Jan 2014 22:01:09 +0100 Subject: [Dovecot] A variable for the unix user or home path would be useful in some cases Message-ID: <52DD8E95.1030204@gmail.com> Hello, In our hosting environment, we let users share mailboxes across all their domains and think it's best if the shared mailbox listing (in a file) stays in their unix home path. That would be: /home/USER/imap/shared-mailboxes.db Unfortunately, it seems there is no way to generate that path using a variable. Something like this would be convenient: acl_shared_dict = file:%v/imap/shared-mailboxes.db Instead, we have to use something like this: acl_shared_dict = file:~/../../../shared-mailboxes.db which only works for virtual users. Did somebody solve this another way? Could we have the unix user or home path as a variable? Or could we have a modifier giving us the path or the unix user based on the unix UID? Cheers, Olivier From rgelfand2 at gmail.com Tue Jan 21 01:22:15 2014 From: rgelfand2 at gmail.com (Roman Gelfand) Date: Mon, 20 Jan 2014 18:22:15 -0500 Subject: [Dovecot] Sieve Filter based on Email Body Message-ID: Is it possible to file emails based on the contents of email body? If yes, can you point me to an example. Thanks in advance From me at junc.eu Tue Jan 21 01:27:10 2014 From: me at junc.eu (Benny Pedersen) Date: Tue, 21 Jan 2014 00:27:10 +0100 Subject: [Dovecot] Sieve Filter based on Email Body In-Reply-To: References: Message-ID: <5cbcec8df8b3b70cce35d3b3f3c91bf5@junc.eu> On 2014-01-21 00:22, Roman Gelfand wrote: > Is it possible to file emails based on the contents of email body? If > yes, can you point me to an example. http://sieve.info/ From CMarcus at Media-Brokers.com Tue Jan 21 15:07:49 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Tue, 21 Jan 2014 08:07:49 -0500 Subject: [Dovecot] Dovecot doesn't seem to report all subfolders to Thunderbird In-Reply-To: <52DAB084.7060705@sys4.de> References: <20140118141219.GA12060@voidptr.de> <52DA95BC.7040605@sys4.de> <20140118154324.GA12754@voidptr.de> <52DAB084.7060705@sys4.de> Message-ID: <52DE7125.7040602@Media-Brokers.com> On 2014-01-18 11:49 AM, Robert Schetterer wrote: > Am 18.01.2014 16:43, schrieb dovecot at voidptr.de: >> Some of my folder names contain dots, so that won't work. > use > > http://wiki2.dovecot.org/Plugins/Listescape > > to solve that Ok, I want to enable this, but am curious about what character others are using... I want to use a character that is highly unlikely anyone would ever use in a folder name... so, I'm thinking something like ~, or maybe ^... So, what characters are others using? Also, is \ the only character that would need to be escaped (the wiki page suggests that is the case)? Last - to enable this, all I need to do is: 1. Add mail_plugins = $mail_plugins listescape to the main config, then 2. Add separator = ~ to my namespace, then 3. Restart dovecot? Thx -- Best regards, Charles From bschmidt at cms.hu-berlin.de Tue Jan 21 15:58:32 2014 From: bschmidt at cms.hu-berlin.de (Burckhard Schmidt) Date: Tue, 21 Jan 2014 14:58:32 +0100 Subject: [Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2 In-Reply-To: <52D7A6F4.6030000@cms.hu-berlin.de> References: <52D65242.7070306@cms.hu-berlin.de> <52D7A6F4.6030000@cms.hu-berlin.de> Message-ID: <52DE7D08.4020106@cms.hu-berlin.de> Am 16.01.2014 10:31, schrieb Burckhard Schmidt: > Am 15.01.2014 10:17, schrieb Burckhard Schmidt: >> Hi, >> forwarding a message with sieve like >> >> redirect:copy "me at other.domain"; >> >> was working without any problem until dovecot-2.1.17, dovecots lmtp and >> dovecot-2.1-pigeonhole-0.3.5. >> >> Using dovecot-2.2.10 , dovecots lmtp and dovecot-2.2-pigeonhole-0.4.2 >> the structure of a forwarded message is broken. Content of a message is >> not displayed or an attachment (for instance pdf) can not be opened by >> (different) clients. Writing a html mail or plain one makes no different. >> > Finally I switched to a newer version of postfix. This solved my problem. I happened with version 2.8.9, 2.9.4. works now. Thanks to Alex for support! Burckhard -- Mit freundlichen Gr??en --- Burckhard Schmidt Abteilung Systemsoftware und Kommunikation ZE Computer- und Medienservice der Humboldt-Universit?t zu Berlin Postanschrift: Unter den Linden 6, 10099 Berlin Standort: Rudower Chaussee 26; 12489 Berlin Tel.: +49-30-2093-70058 Fax: +49-30-2093-2959 Mail: bschmidt at cms.hu-berlin.de From ath at b-one.net Tue Jan 21 17:44:44 2014 From: ath at b-one.net (Anders Th=?iso-8859-1?Q?=F8?=gersen) Date: Tue, 21 Jan 2014 15:44:44 GMT Subject: [Dovecot] RFC 5267 Contexts for IMAP4 PARTIAL results Message-ID: <1390319084586.4619.622@webmail8> Hello, I am looking at PARTIAL responses using a dovecot version 2.2.5 and am running into an inconsistency with the RFC which I would like to ask about. The following section http://tools.ietf.org/html/rfc5267#section-4.4 lists client requests and server responses which I have tried running against a folder, specifying the ranges that fit the contents of the folder I have selected. The Last of the?listed client requests returns a response that?is not as I would expect: C: A04 UID SEARCH RETURN (PARTIAL 24000:24500) UNDELETED UNKEYWORD $Junk should return S: * ESEARCH (TAG "A04") UID PARTIAL (24000:24500 NIL) // No results are present, this is beyond the end of the results. S: A04 OK Completed. according to the RFC, but instead of NIL in the PARTIAL result I see the full range of UIDs that are in the folder, as in: C:?A02 UID SEARCH RETURN (PARTIAL 23500:24000) UNDELETED S: * ESEARCH (TAG "A02") UID PARTIAL (23500:24000 1:9) S: A02 OK Search completed (0.000 secs). The folder that is selected contains 9 emails with the UIDs 1-9. Should the server return NIL Instead of returning 1:9? Thanks! Anders From buzz-dee at riseup.net Tue Jan 21 18:31:15 2014 From: buzz-dee at riseup.net (Sebastian Schlatow) Date: Tue, 21 Jan 2014 17:31:15 +0100 Subject: [Dovecot] Shared mailboxes / IMAP folder performance Message-ID: <52DEA0D3.4020902@riseup.net> Hello, how performant is an IMAP shared folder / mailbox if it contains 2 million mails? Is it possible two have such a quantity of mails in a shared folder? Is it possible to search that shared folder for mails in a fast way? Regards Sebastian From rs at sys4.de Tue Jan 21 18:51:28 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 21 Jan 2014 17:51:28 +0100 Subject: [Dovecot] Shared mailboxes / IMAP folder performance In-Reply-To: <52DEA0D3.4020902@riseup.net> References: <52DEA0D3.4020902@riseup.net> Message-ID: <52DEA590.9060203@sys4.de> Am 21.01.2014 17:31, schrieb Sebastian Schlatow: > Hello, > > how performant is an IMAP shared folder / mailbox if it contains 2 > million mails? Is it possible two have such a quantity of mails in a > shared folder? Is it possible to search that shared folder for mails in > a fast way? > > Regards > Sebastian > there might no ultimate answer for this ,cause it might not depend on the number of mails only, there might be other complex setup stuff involved, at the end with which client you like to search, why not simply test it with a test server, shouldnt take much time Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From buzz-dee at riseup.net Tue Jan 21 19:09:32 2014 From: buzz-dee at riseup.net (Sebastian Schlatow) Date: Tue, 21 Jan 2014 18:09:32 +0100 Subject: [Dovecot] Shared mailboxes / IMAP folder performance In-Reply-To: <52DEA590.9060203@sys4.de> References: <52DEA0D3.4020902@riseup.net> <52DEA590.9060203@sys4.de> Message-ID: <52DEA9CC.2020808@riseup.net> Am 21.01.2014 17:51, schrieb Robert Schetterer: > Am 21.01.2014 17:31, schrieb Sebastian Schlatow: >> Hello, >> >> how performant is an IMAP shared folder / mailbox if it contains 2 >> million mails? Is it possible two have such a quantity of mails in a >> shared folder? Is it possible to search that shared folder for mails in >> a fast way? >> >> Regards >> Sebastian >> > there might no ultimate answer for this ,cause it might not depend on > the number of mails only, there might be other complex setup stuff > involved, at the end with which client you like to search, why not > simply test it with a test server, shouldnt take much time > > > Best Regards > MfG Robert Schetterer > Thanks for your quick reply. As a client Thunderbird, Evolution and Outlook should be used. In rare cases maybe mobile clients on iOS and Android. So it is principle possible to have it performant? I asked because I wanted to know if it makes sense to setup a test system for that. From rs at sys4.de Tue Jan 21 19:36:44 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 21 Jan 2014 18:36:44 +0100 Subject: [Dovecot] Shared mailboxes / IMAP folder performance In-Reply-To: <52DEA9CC.2020808@riseup.net> References: <52DEA0D3.4020902@riseup.net> <52DEA590.9060203@sys4.de> <52DEA9CC.2020808@riseup.net> Message-ID: <52DEB02C.7010004@sys4.de> Am 21.01.2014 18:09, schrieb Sebastian Schlatow: > Am 21.01.2014 17:51, schrieb Robert Schetterer: >> Am 21.01.2014 17:31, schrieb Sebastian Schlatow: >>> Hello, >>> >>> how performant is an IMAP shared folder / mailbox if it contains 2 >>> million mails? Is it possible two have such a quantity of mails in a >>> shared folder? Is it possible to search that shared folder for mails in >>> a fast way? >>> >>> Regards >>> Sebastian >>> >> there might no ultimate answer for this ,cause it might not depend on >> the number of mails only, there might be other complex setup stuff >> involved, at the end with which client you like to search, why not >> simply test it with a test server, shouldnt take much time >> >> >> Best Regards >> MfG Robert Schetterer >> > Thanks for your quick reply. As a client Thunderbird, Evolution and > Outlook should be used. In rare cases maybe mobile clients on iOS and > Android. So it is principle possible to have it performant? I asked > because I wanted to know if it makes sense to setup a test system for that. > speculate ,in an "ideal" dove server setup, the clients will get your bottlenecks Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From buzz-dee at riseup.net Tue Jan 21 21:31:44 2014 From: buzz-dee at riseup.net (Sebastian Schlatow) Date: Tue, 21 Jan 2014 20:31:44 +0100 Subject: [Dovecot] IMAP ANNOTATE Extension RFC5257 Message-ID: <52DECB20.2090902@riseup.net> Hello, Does Dovecot support the IMAP ANNOTATE Extension RFC5257 http://tools.ietf.org/html/rfc5257? If not, are there any plans to implement the extension? If not, why there is no plan to implement this feature? Regards Sebastian From rs at sys4.de Tue Jan 21 21:49:44 2014 From: rs at sys4.de (Robert Schetterer) Date: Tue, 21 Jan 2014 20:49:44 +0100 Subject: [Dovecot] IMAP ANNOTATE Extension RFC5257 In-Reply-To: <52DECB20.2090902@riseup.net> References: <52DECB20.2090902@riseup.net> Message-ID: <52DECF58.9090004@sys4.de> Am 21.01.2014 20:31, schrieb Sebastian Schlatow: > Hello, > > Does Dovecot support the IMAP ANNOTATE Extension RFC5257 > http://tools.ietf.org/html/rfc5257? If not, are there any plans to > implement the extension? If not, why there is no plan to implement this > feature? > > Regards > Sebastian > not sure about how up2date these are, and whats allready done http://dovecot.org/list/dovecot/2013-February/088305.html http://www.imapwiki.org/Specs http://wiki2.dovecot.org/Roadmap http://hg.dovecot.org/dovecot-metadata-plugin Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From marc at perkel.com Tue Jan 21 22:31:22 2014 From: marc at perkel.com (Marc Perkel) Date: Tue, 21 Jan 2014 12:31:22 -0800 Subject: [Dovecot] master password Message-ID: <52DED919.6040105@perkel.com> This is probably easy but how would a set a secret static master password so that if I typed it in for any login it would be happy? I can't use the * separator method in this case because it screws up squirrelmail. From adi at ente.limmat.ch Tue Jan 21 22:58:22 2014 From: adi at ente.limmat.ch (Adrian Zaugg) Date: Tue, 21 Jan 2014 21:58:22 +0100 Subject: [Dovecot] master password In-Reply-To: <52DED919.6040105@perkel.com> References: <52DED919.6040105@perkel.com> Message-ID: <52DEDF6E.1060602@ente.limmat.ch> http://wiki2.dovecot.org/Authentication/MasterUsers Regards, Adrian. Am 21.01.14 21:31 schrieb Marc Perkel: > This is probably easy but how would a set a secret static master > password so that if I typed it in for any login it would be happy? I > can't use the * separator method in this case because it screws up > squirrelmail. > From voytek at sbt.net.au Wed Jan 22 09:01:10 2014 From: voytek at sbt.net.au (voytek at sbt.net.au) Date: Wed, 22 Jan 2014 18:01:10 +1100 Subject: [Dovecot] beginners sieve: copy not move to subfolder? Message-ID: <0e029dec39af82e2bcaa05600073e864.squirrel@emu.sbt.net.au> I'm trying to learn how do basic stuff with sieve; I pasted this from a tutorial, it works fine, mail is delivered to 'friends' BUT, what should I do to keep mail in main inbasket as well as, copy to subbasket ? tried 'copy' but failed so far main_script: line 6: error: unknown command 'copy' (only reported once at first occurence). even after I added 'copy' to 'require' still failed ? ------------------------------------ require ["fileinto", "reject"]; # Daffy Duck is a good friend of mine. if address :is "from" "daffy.duck at example.com" { fileinto "friends"; } From skdovecot at smail.inf.fh-brs.de Wed Jan 22 09:36:45 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 22 Jan 2014 08:36:45 +0100 (CET) Subject: [Dovecot] beginners sieve: copy not move to subfolder? In-Reply-To: <0e029dec39af82e2bcaa05600073e864.squirrel@emu.sbt.net.au> References: <0e029dec39af82e2bcaa05600073e864.squirrel@emu.sbt.net.au> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 22 Jan 2014, voytek at sbt.net.au wrote: > I'm trying to learn how do basic stuff with sieve; > > I pasted this from a tutorial, it works fine, mail is delivered to 'friends' > > BUT, what should I do to keep mail in main inbasket as well as, copy to > subbasket ? > > tried 'copy' but failed so far > main_script: line 6: error: unknown command 'copy' (only reported once at > first occurence). http://wiki2.dovecot.org/Pigeonhole/Sieve then follow the link of "copy". > even after I added 'copy' to 'require' still failed ? > > ------------------------------------ > require ["fileinto", "reject"]; > > # Daffy Duck is a good friend of mine. > if address :is "from" "daffy.duck at example.com" > { > fileinto "friends"; > } > > > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUt91DXD1/YhP6VMHAQI49AgAvrCouC9OBQhpOdFPEiqecdSYJjNi3T65 dvNMi4Wul83TRlLw39ZsqvNRwM0sgUHmSP188Ec51+RV70P5KrDXs/CiHUByXBap vDpWihFBK4r8ea/992CZejfJAQj+HfXqUOowYif3VgUFrXsDO5z1u1jTxBjf5rLA zNPMY8hWFgMrgNhn6WLdWwL0WAZMdGb9kLXoq/Jq1uMYhuL/M3qMlyi/uBYRr1s3 xtyzp30ACFrGRx5DCDtn7xSJNj+X3m9vhp4pslWGA3i9X40HwznElmBi0LaLVlca UqXl7r8k3gpMUPok5uKZn530+azRD4TTWyEiMbgnpwqb3TWPOJCZ8A== =M8qK -----END PGP SIGNATURE----- From rcpt.dmitry at gmail.com Wed Jan 22 14:39:51 2014 From: rcpt.dmitry at gmail.com (Dmitry) Date: Wed, 22 Jan 2014 16:39:51 +0400 Subject: [Dovecot] Problem with LDA. When vacation auto-reply sent, the field from=<>. Message-ID: <20140122163951.74e7d665a4bfa9705cf9d47f@gmail.com> Hi, My problem is that when vacation auto-reply sent the field from=<> Because of this does not work "sender_dependent_relayhost_maps" in postfix. My scheme is: There are several postfix on different machines 1.1.1.1 - domain1 2.2.2.2 - domain2 3.3.3.3 - domain3 All they send messages to one server virtual_transport = lmtp:10.10.10.10:24 where mail is stored. In 10.10.10.10 installed dovecot 2.2.9, dovecot-pigeonhole 0.4.2 and another posfix In postfix inet_interfaces = 10.10.10.10 sender_dependent_relayhost_maps = hash:$config_directory/relayhost_maps relayhost_maps @domain1 [1.1.1.1] @domain2 [2.2.2.2] @domain3 [3.3.3.3] Sieve script make from Roundcube require ["vacation"]; # rule:[autoreply] if true { vacation :days 1 :subject "Test." "Test."; } (if add [":from" string] nothing changes) The letter comes, script fulfills, vacation auto-reply sent. But either /usr/sbin/sendmail -i -f <> -- user at senddomain or, if write in 15-lda.conf submission_host = 10.10.10.10:25 postfix log Jan 1 00:00:00 mail pf-OUT/cleanup[6098]: 4CD104A8A4: message-id= Jan 1 00:00:00 mail pf-OUT/qmgr[5950]: 4CD104A8A4: from=<>, size=693, nrcpt=1 (queue active) How to make dovecot and dovecot-pigeonhole write in field MAIL FROM:? Also, I noticed that does not work protocol lda { .. # remember to give proper permissions for these files as well log_path = /var/log/dovecot-lda-errors.log info_log_path = /var/log/dovecot-lda.log } from http://wiki2.dovecot.org/LDA Logs are not written. Thanks and regards, Dmitry From h.reindl at thelounge.net Wed Jan 22 15:18:26 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 22 Jan 2014 14:18:26 +0100 Subject: [Dovecot] Problem with LDA. When vacation auto-reply sent, the field from=<>. In-Reply-To: <20140122163951.74e7d665a4bfa9705cf9d47f@gmail.com> References: <20140122163951.74e7d665a4bfa9705cf9d47f@gmail.com> Message-ID: <52DFC522.7020802@thelounge.net> Am 22.01.2014 13:39, schrieb Dmitry: > My problem is that when vacation auto-reply sent the field from=<> > Because of this does not work "sender_dependent_relayhost_maps" in postfix <> is correct in case of auto-responders why? to prevent mail-loops if both sides have a responder well, there are special headers too for this but they rely on be respected by the final destination while null sender never get bounces and replies http://en.wikipedia.org/wiki/Bounce_message Bounce messages in SMTP are sent with the envelope sender address <>, known as the null sender address. They are frequently sent with a From: header address of MAILER-DAEMON at the recipient site. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From rcpt.dmitry at gmail.com Wed Jan 22 16:39:55 2014 From: rcpt.dmitry at gmail.com (Dmitry) Date: Wed, 22 Jan 2014 18:39:55 +0400 Subject: [Dovecot] Problem with LDA. When vacation auto-reply sent, the field from=<>. In-Reply-To: <52DFC522.7020802@thelounge.net> References: <20140122163951.74e7d665a4bfa9705cf9d47f@gmail.com> <52DFC522.7020802@thelounge.net> Message-ID: <20140122183955.a174f5e63b71f4a76ce253b4@gmail.com> Thanks for your quick reply. Can I least make dovecot write from=? How can I make "sender_dependent_relayhost_maps" works in postfix? Best Regards Dmitry On Wed, 22 Jan 2014 14:18:26 +0100 Reindl Harald wrote: > Am 22.01.2014 13:39, schrieb Dmitry: > > My problem is that when vacation auto-reply sent the field from=<> > > Because of this does not work "sender_dependent_relayhost_maps" in postfix > > <> is correct in case of auto-responders > > why? > to prevent mail-loops if both sides have a responder > > well, there are special headers too for this but they > rely on be respected by the final destination while > null sender never get bounces and replies > > http://en.wikipedia.org/wiki/Bounce_message > > Bounce messages in SMTP are sent with the envelope sender address <>, > known as the null sender address. They are frequently sent with a From: > header address of MAILER-DAEMON at the recipient site. > From h.reindl at thelounge.net Wed Jan 22 16:46:52 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Wed, 22 Jan 2014 15:46:52 +0100 Subject: [Dovecot] Problem with LDA. When vacation auto-reply sent, the field from=<>. In-Reply-To: <20140122183955.a174f5e63b71f4a76ce253b4@gmail.com> References: <20140122163951.74e7d665a4bfa9705cf9d47f@gmail.com> <52DFC522.7020802@thelounge.net> <20140122183955.a174f5e63b71f4a76ce253b4@gmail.com> Message-ID: <52DFD9DC.4000608@thelounge.net> do not mix the "From: header address of MAILER-DAEMON" with the envelope from= would be the problem described below why in the world do you need "sender_dependent_relayhost_maps" for vacation? you should try to explain your problem and not how to implement a solution http://www.catb.org/~esr/faqs/smart-questions.html Am 22.01.2014 15:39, schrieb Dmitry: > Thanks for your quick reply. > > Can I least make dovecot write from=? > How can I make "sender_dependent_relayhost_maps" works in postfix? > > On Wed, 22 Jan 2014 14:18:26 +0100 > Reindl Harald wrote: > >> Am 22.01.2014 13:39, schrieb Dmitry: >>> My problem is that when vacation auto-reply sent the field from=<> >>> Because of this does not work "sender_dependent_relayhost_maps" in postfix >> >> <> is correct in case of auto-responders >> >> why? >> to prevent mail-loops if both sides have a responder >> >> well, there are special headers too for this but they >> rely on be respected by the final destination while >> null sender never get bounces and replies >> >> http://en.wikipedia.org/wiki/Bounce_message >> >> Bounce messages in SMTP are sent with the envelope sender address <>, >> known as the null sender address. They are frequently sent with a From: >> header address of MAILER-DAEMON at the recipient site. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From lists at buschor.ch Wed Jan 22 17:21:49 2014 From: lists at buschor.ch (Thomas) Date: Wed, 22 Jan 2014 16:21:49 +0100 Subject: [Dovecot] Dovecot on Solaris 10 Segmentation Fault Message-ID: <52DFE20D.6030205@buschor.ch> Hello, make check on Solaris 10 throws a segmentation fault. The error is independent of the compiler (SunStudio/GCC) and processor architecture (SPARC/x86) and 32 or 64 bit binary. Dovecot Version: 2.2.10 OS: Solaris 10/SPARC & x86 SunStudion Compiler cc: Sun C 5.10 SunOS_sparc Patch 141861-10 2012/11/07 GCC gcc version 3.4.3 (csl-sol210-3_4-branch+sol_rpath) The error occurs first in: src/lib-http/test-http-url Line 317/318: test_out(t_strdup_printf("url->user = %s", urlp->user), urlp->user == urlt->user); (if commenting out these lines, then it segfaults just in the next test) %make check <--- cut out lot of good output ---> http date invalid [42]: parse Sun Nov 6 08:49:37 0000 ............... : ok http date invalid [42] ............................................... : ok 0 / 150 tests failed http url valid [0]: http_url_parse(http://localhost) ................. : ok http url valid [0]: url->host_name = localhost ....................... : ok http url valid [0]: url->port = (unspecified) ........................ : ok http url valid [0]: url->host_ip = (unspecified) ..................... : ok /bin/bash: line 1: 28764 Segmentation Fault (core dumped) ./$bin gmake[2]: *** [check-test] Error 1 gmake[2]: Leaving directory `/data/obj/dovecot-2.2.10/src/lib-http' gmake[1]: *** [check-recursive] Error 1 gmake[1]: Leaving directory `/data/obj/dovecot-2.2.10/src' gmake: *** [check-recursive] Error 1 % pstack /var/core/core.test-http-url.28764 core '/var/core/core.test-http-url.28764' of 28764: ./test-http-url ff122d50 strlen (3365e, ffbff6fc, ffbfecf9, 0, 0, 0) + 50 ff191c3c vsnprintf (4a638, 10e, 33650, ffbff6f8, 7ffffc00, 2400) + 6c 0002be0c t_strdup_printf (4a638, 2340, 48118, 2e, 48110, e) + 6c 0001635c ???????? (0, 0, 47800, 335c4, 80000000, 40000000) 0001924c test_run (fffd3268, 2cc00, ffbff94c, 2380, 2000, 47e94) + 6c 00016008 _start (0, 0, 0, 0, 0, 0) + 108 % dbx test-http-url /var/core/core.test-http-url.28884 (dbx) examine 0xff122d5c: strlen+0x005c: 0x98132101 (dbx) regs current frame: [1] g0-g1 0x00000000 0x00000000 0x00000000 0x0004a638 g2-g3 0x00000000 0x0004a3bc 0x00000000 0x0004a3b8 g4-g5 0x00000000 0x0004a3c8 0x00000000 0x00000270 g6-g7 0x00000000 0x00000000 0x00000000 0xff272a00 o0-o1 0x00000000 0x00000000 0x00000000 0xfffffaf0 o2-o3 0x00000000 0x00000000 0x00000000 0xffbff798 o4-o5 0x00000000 0x00000000 0x00000000 0x0000002b o6-o7 0x00000000 0xffbfe920 0x00000000 0xff18f498 l0-l1 0x00000000 0x00000073 0x00000000 0x00000000 l2-l3 0x00000000 0x00000000 0x00000000 0x00001000 l4-l5 0x00000000 0x00000000 0x00000000 0x00000000 l6-l7 0x00000000 0xff236c99 0x00000000 0x00000000 i0-i1 0x00000000 0x0003365e 0x00000000 0xffbff8dc i2-i3 0x00000000 0xffbfeed9 0x00000000 0x00000000 i4-i5 0x00000000 0x00000000 0x00000000 0x00000000 i6-i7 0x00000000 0xffbff7b0 0x00000000 0xff191c3c y 0x00000000 0x00000000 ccr 0x00000000 0xfe401005 pc 0x00000000 0xff122d50:strlen+0x50 ld [%o2], %o1 npc 0x00000000 0xff122d54:strlen+0x54 sethi %hi(0x1010000), %o4 (dbx) dis 0xff122d3c 0xff122d3c: strlen+0x003c: be,pn %icc,strlen+0xcc ! 0xff122dcc 0xff122d40: strlen+0x0040: btst 255, %o1 0xff122d44: strlen+0x0044: be,pn %icc,strlen+0xcc ! 0xff122dcc 0xff122d48: strlen+0x0048: inc %o2 0xff122d4c: strlen+0x004c: inc %o2 0xff122d50: strlen+0x0050: ld [%o2], %o1 0xff122d54: strlen+0x0054: sethi %hi(0x1010000), %o4 0xff122d58: strlen+0x0058: sethi %hi(0x80808000), %o5 0xff122d5c: strlen+0x005c: bset 257, %o4 0xff122d60: strlen+0x0060: bset 128, %o5 % truss -f ./test-http-url <--- cut out the beginning of output ---> 28884: open("/platform/SUNW,SPARC-Enterprise-T5220/lib/libc_psr.so.1", O_RDONLY) = 3 28884: mmap(0x00010000, 9244, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_ALIGN, 3, 0) = 0xFF0E0000 28884: munmap(0xFF0E2000, 1052) = 0 28884: close(3) = 0 28884: getpid() = 28884 [28883] 28884: brk(0x0004A3A8) = 0 28884: brk(0x000543A8) = 0 28884: sysinfo(SI_HOSTNAME, "badile", 255) = 7 28884: getpid() = 28884 [28883] 28884: ioctl(1, TCGETA, 0xFFBFF664) = 0 28884: fstat64(1, 0xFFBFF580) = 0 http url valid [0]28884: write(1, " h t t p u r l v a l".., 18) = 18 : http_url_parse(http://localhost)28884: write(1, " : h t t p _ u r l _ p".., 34) = 34 ................. : ok 28884: write(1, " . . . . . . . . . . .".., 24) = 24 http url valid [0]28884: write(1, " h t t p u r l v a l".., 18) = 18 : url->host_name = localhost28884: write(1, " : u r l - > h o s t _".., 28) = 28 ....................... : ok 28884: write(1, " . . . . . . . . . . .".., 30) = 30 http url valid [0]28884: write(1, " h t t p u r l v a l".., 18) = 18 : url->port = (unspecified)28884: write(1, " : u r l - > p o r t ".., 27) = 27 ........................ : ok 28884: write(1, " . . . . . . . . . . .".., 31) = 31 http url valid [0]28884: write(1, " h t t p u r l v a l".., 18) = 18 : url->host_ip = (unspecified)28884: write(1, " : u r l - > h o s t _".., 30) = 30 ..................... : ok 28884: write(1, " . . . . . . . . . . .".., 28) = 28 28884: Incurred fault #6, FLTBOUNDS %pc = 0xFF122D50 28884: siginfo: SIGSEGV SEGV_MAPERR addr=0x00000000 28884: Received signal #11, SIGSEGV [default] 28884: siginfo: SIGSEGV SEGV_MAPERR addr=0x00000000 % apptrace -f ./test-http-url <--- cut out the beginning of output ---> 28897:-> test-http-url -> libc.so.1:int fputs(const char * = 0x33618 "url->host_ip = (unspecified)", FILE * = 0xfef2759c) : url->host_ip = (unspecified) 28897:<- test-http-url -> libc.so.1:fputs() = 0x1c 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x20, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x20 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0x2e, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0x2e 28897:-> test-http-url -> libc.so.1:size_t fwrite(const void * = 0x33e28, size_t = 0x1, size_t = 0x3, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:fwrite() = 0x3 28897:-> test-http-url -> libc.so.1:size_t fwrite(const void * = 0x33e2c, size_t = 0x1, size_t = 0x2, FILE * = 0xfef2759c) 28897:<- test-http-url -> libc.so.1:fwrite() = 0x2 28897:-> test-http-url -> libc.so.1:int __flsbuf(int = 0xa, FILE * = 0xfef2759c) ..................... : ok 28897:<- test-http-url -> libc.so.1:__flsbuf() = 0xa 28897:-> test-http-url -> libc.so.1:int vsnprintf(char * = 0x4a638 "", size_t = 0x10e, const char * = 0x33650 "url->user = %s", va_list = 0xffbff998) apptrace: ./test-http-url: Segmentation Fault(Core dump) Any help about this? Cheers Thomas From normalperson at yhbt.net Tue Jan 21 10:03:57 2014 From: normalperson at yhbt.net (Eric Wong) Date: Tue, 21 Jan 2014 08:03:57 +0000 Subject: [Dovecot] IDLE dropping EXISTS events on mass message arrival Message-ID: <20140121080357.GA17920@dcvr.yhbt.net> Hi, I'm not sure if this is some throttling/DoS protection or a bug. I didn't see notice anything like it mentioned looking at the NEWS file from hg, this is on 2.1.7 on Debian stable. I have a client doing IDLE on INBOX.vomiteer. When individual messages arrive with some time interval in between them, I get EXISTS events for each message as expected. However, when I store a bunch of messages at once (via tag + mass copy in mutt on a fast-ish connection), I get a few EXISTS events (sometimes one, sometimes two) even though I copied a lot of new messages over. I expected to get an EXISTS event for each message which arrived, but perhaps there's some sort of DoS/throttling mechanism. strace -t -s4096 output of the dovecot process below: fd=13 is inotify, you'll see large read(13, ... indicating multiple filenames from inotify. However, only one EXISTS message got written to the socket. I've filtered out the gettimeofday syscalls for brevity. 07:30:02 epoll_wait(9, {}, 6, 3937) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/cur", {st_mode=S_IFDIR|0700, st_size=12288, ...}) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/cur", {st_mode=S_IFDIR|0700, st_size=12288, ...}) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=25920, ...}) = 0 07:30:06 fstat64(10, {st_mode=S_IFREG|0600, st_size=25920, ...}) = 0 07:30:06 epoll_wait(9, {}, 6, 7865) = 0 07:30:14 setsockopt(11, SOL_TCP, TCP_CORK, [1], 4) = 0 07:30:14 write(11, "* OK Still here\r\n", 17) = 17 07:30:14 setsockopt(11, SOL_TCP, TCP_CORK, [0], 4) = 0 07:30:14 time(NULL) = 1390289414 07:30:14 epoll_wait(9, {{EPOLLIN, {u32=4159555408, u64=4159555408}}}, 6, 22124) = 1 07:30:17 read(13, "\2\0\0\0\200\0\0\0\t\365\r\0000\0\0\0001390289417.M94623P14841.dcvr,S=1580,W=1619:2,S\0\0\2\0\0\0\200\0\0\0\n\365\r\0000\0\0\0001390289417.M94624P14841.dcvr,S=1580,W=1619:2,S\0\0\2\0\0\0\200\0\0\0\v\365\r\0000\0\0\0001390289417.M94625P14841.dcvr,S=1422,W=1460:2,S\0\0\2\0\0\0\200\0\0\0\f\365\r\0000\0\0\0001390289417.M94626P14841.dcvr,S=1422,W=1460:2,S\0\0\2\0\0\0\200\0\0\0\r\365\r\0000\0\0\0001390289417.M94627P14841.dcvr,S=1861,W=1907:2,S\0\0\2\0\0\0\200\0\0\0\16\365\r\0000\0\0\0001390289417.M94628P14841.dcvr,S=1861,W=1907:2,S\0\0\2\0\0\0\200\0\0\0\17\365\r\0000\0\0\0001390289417.M94629P14841.dcvr,S=4732,W=4854:2,S\0\0\2\0\0\0\200\0\0\0\20\365\r\0000\0\0\0001390289417.M94630P14841.dcvr,S=4732,W=4854:2,S\0\0\2\0\0\0\200\0\0\0\21\365\r\0000\0\0\0001390289417.M94631P14841.dcvr,S=4028,W=4128:2,S\0\0\2\0\0\0\200\0\0\0\22\365\r\0000\0\0\0001390289417.M94632P14841.dcvr,S=4028,W=4128:2,S\0\0\2\0\0\0\200\0\0\0\23\365\r\0000\0\0\0001390289417.M94633P14841.dcvr,S=3865,W=3968:2,S\0\0\2\0\0\0\200\0\0\0\24\365\r\0000\0\0\0001390289417.M94634P14841.dcvr,S=3865,W=3968:2,S\0\0", 32768) = 768 07:30:17 epoll_wait(9, {{EPOLLIN, {u32=4159555408, u64=4159555408}}}, 6, 499) = 1 07:30:17 read(13, "\2\0\0\0\200\0\0\0\25\365\r\0000\0\0\0001390289417.M94635P14841.dcvr,S=4092,W=4189:2,S\0\0\2\0\0\0\200\0\0\0\26\365\r\0000\0\0\0001390289417.M94636P14841.dcvr,S=4092,W=4189:2,S\0\0\2\0\0\0\200\0\0\0\27\365\r\0000\0\0\0001390289417.M94637P14841.dcvr,S=1517,W=1552:2,S\0\0\2\0\0\0\200\0\0\0\30\365\r\0000\0\0\0001390289417.M94638P14841.dcvr,S=1517,W=1552:2,S\0\0", 32768) = 256 07:30:17 epoll_wait(9, {}, 6, 498) = 0 07:30:17 stat64("/home/ew/.maildir/.INBOX.vomiteer/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 07:30:17 stat64("/home/ew/.maildir/.INBOX.vomiteer/cur", {st_mode=S_IFDIR|0700, st_size=12288, ...}) = 0 07:30:17 stat64("/home/ew/.maildir/.INBOX.vomiteer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=26328, ...}) = 0 07:30:17 fstat64(10, {st_mode=S_IFREG|0600, st_size=26328, ...}) = 0 07:30:17 pread64(10, "\200\200\200\207@\0\0\20\0\0\0\0\0\0\0\0$\0\0\0\0\0\0\0\1\0\0\0\200\200\200\214\0\1\0\20\0\0$\0\337!\336R\344\231\2L\0\0\0\0\t\"\336R\t\"\336R\0\0\0\0\t\"\336R\0\0\0\0007\n\0\0\200\200\200\204 \0\0\20@\0\4\0\234e\0\0\200\200\200\242\2\0\0\20\317\0\0\0\10\0\0\0\320\0\0\0\10\0\0\0\321\0\0\0\10\0\0\0\322\0\0\0\10\0\0\0\323\0\0\0\10\0\0\0\324\0\0\0\10\0\0\0\325\0\0\0\10\0\0\0\326\0\0\0\10\0\0\0\327\0\0\0\10\0\0\0\330\0\0\0\10\0\0\0\331\0\0\0\10\0\0\0\332\0\0\0\10\0\0\0\333\0\0\0\10\0\0\0\334\0\0\0\10\0\0\0\335\0\0\0\10\0\0\0\336\0\0\0\10\0\0\0\200\200\200\207@\0\0\20\1\0\0\0\0\260\2L\0\0\0\0\4\0\4\0\1\0\0\0\200\200\200\242\0\2\0\20\317\0\0\0\250\275\0\0\320\0\0\0\234\277\0\0\321\0\0\0|\301\0\0\322\0\0\0|\304\0\0\323\0\0\0\200\307\0\0\324\0\0\0|\312\0\0\325\0\0\0h\315\0\0\326\0\0\0\\\320\0\0\327\0\0\0\224\323\0\0\330\0\0\0\210\325\0\0\331\0\0\0h\327\0\0\332\0\0\0h\332\0\0\333\0\0\0l\335\0\0\334\0\0\0h\340\0\0\335\0\0\0T\343\0\0\336\0\0\0H\346\0\0\200\200\200\204 \0\0\0200\0\4\0\337\0\0\0", 8192, 25920) = 408 07:30:17 pread64(10, "", 8192, 26328) = 0 07:30:17 stat64("/home/ew/.maildir/.INBOX.vomiteer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=26328, ...}) = 0 07:30:17 fstat64(10, {st_mode=S_IFREG|0600, st_size=26328, ...}) = 0 07:30:17 time(NULL) = 1390289417 07:30:17 setsockopt(11, SOL_TCP, TCP_CORK, [1], 4) = 0 07:30:17 write(11, "* 32 EXISTS\r\n", 13) = 13 07:30:17 setsockopt(11, SOL_TCP, TCP_CORK, [0], 4) = 0 07:30:17 epoll_wait(9, (Nothing happened after this) # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.9.2-x86_64-xxxxxx x86_64 Debian 7.3 auth_mechanisms = plain login log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = never mail_location = maildir:~/.maildir mail_max_userip_connections = 666 mail_privileged_group = mail passdb { driver = shadow } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { inet_listener imap { address = 127.0.0.1 port = 1434 } process_limit = 10 process_min_avail = 1 } service imap { process_limit = 32 } service pop3-login { process_limit = 10 process_min_avail = 1 } service pop3 { process_limit = 32 } ssl = no userdb { driver = passwd } protocol lda { postmaster_address = postmaster at dcvr.yhbt.net } -- Eric Wong From andrew at freedomlives.net Tue Jan 21 17:08:02 2014 From: andrew at freedomlives.net (Andrew Ray) Date: Tue, 21 Jan 2014 16:08:02 +0100 Subject: [Dovecot] Failure in doveconf Message-ID: <52DE8D52.7080602@freedomlives.net> I ran into a problem while configuring dovecot. Quickly reading the paragraph below, I saw "yes" as one of the options, and put that into the config, as below: # In case of password mismatches, log the attempted password. Valid values are # no, plain and sha1. sha1 can be useful for detecting brute force password # attempts vs. user simply trying the same password over and over again. # You can also truncate the value to n chars by appending ":n" (e.g. sha1:6). auth_verbose_passwords = yes The result from doveconf -n was: doveconf: Error: x?? doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: 0p? (where the error message was always a changing, apparently random set of characters.) So I managed, by going back through the config file and commenting out options, to find this was the problem and then finally read what are the acceptable values. Any other place that I have tried to give a non acceptable value I get a reasonable error message with line number and problem. Well, now I fixed my original problem, but something needs to be adjusted in the error handling code. Sincerely, Andrew Ray -- Andrew Ray +1 404-418-5443 +421 (0) 917 832 253 http://guns.freedomlives.net/ From pug at felsing.net Wed Jan 22 18:52:52 2014 From: pug at felsing.net (Christian Felsing) Date: Wed, 22 Jan 2014 17:52:52 +0100 Subject: [Dovecot] AD Kerberos and Dovecot Message-ID: <52DFF764.1070709@felsing.net> Hello, I got stucked on Kerberos auth with Dovecot: Jan 22 17:48:36 test dovecot: auth: Error: LDAP: binding failed (dn cn=AUTH\_ldap): Local error, SASL(-1): generic failure: GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (Credentials cache file '/tmp/krb5cc_1003' not found) kinit and and ldapsearch with gssapi auth are working. Are there instructions how to set up Kerberos auth with Dovecot and Active Directory? How does Dovecot handle Kerberos tickets? best regards Christian From slusarz at curecanti.org Wed Jan 22 21:12:05 2014 From: slusarz at curecanti.org (Michael M Slusarz) Date: Wed, 22 Jan 2014 12:12:05 -0700 Subject: [Dovecot] IDLE dropping EXISTS events on mass message arrival In-Reply-To: <20140121080357.GA17920@dcvr.yhbt.net> References: <20140121080357.GA17920@dcvr.yhbt.net> Message-ID: <20140122121205.Horde.Gk5p5kAF6HrsbQHIzJY6CA2@bigworm.curecanti.org> Quoting Eric Wong : > Hi, I'm not sure if this is some throttling/DoS protection or a bug. I > didn't see notice anything like it mentioned looking at the NEWS file > from hg, this is on 2.1.7 on Debian stable. > > I have a client doing IDLE on INBOX.vomiteer. When individual messages > arrive with some time interval in between them, I get EXISTS events for > each message as expected. > > However, when I store a bunch of messages at once (via tag + mass copy > in mutt on a fast-ish connection), I get a few EXISTS events (sometimes > one, sometimes two) even though I copied a lot of new messages over. > > I expected to get an EXISTS event for each message which arrived, but > perhaps there's some sort of DoS/throttling mechanism. This is correct IMAP behavior. EXISTS is defined as enumerating the current number of messages in the mailbox. Nowhere in the RFC does it say that a separate EXISTS is needed for every message added. michael From pw at wk-serv.de Wed Jan 22 21:37:19 2014 From: pw at wk-serv.de (Patrick Westenberg) Date: Wed, 22 Jan 2014 20:37:19 +0100 Subject: [Dovecot] dovecot produces messages dupes after nfs problems Message-ID: <52E01DEF.1000303@wk-serv.de> Hi everyone, some days ago I had trouble with my NFS-Server (high delays) which caused dovecot lmtp to deliver the same message several times (up to 10x). I recognized some old/unused .nfsXXXX files in the maildirs which seemed to be index files. I deleted them and everything was fine again. However, there are still 2-3 mailboxen where mails (old and new ones) are delivered multiple times. All duplicates have no "received from" headers. Seperate lmtp log shows only one delivery. Any hint or advice what might be wrong? Regards Patrick # 2.2.2: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.1 auth_mechanisms = plain login disable_plaintext_auth = no dotlock_use_excl = no hostname = mb02.wk-serv.net listen = 172.17.1.2 log_path = /var/log/dovecot.log login_trusted_networks = 172.17.1.3 172.17.1.4 mail_fsync = always mail_gid = vmail mail_home = /var/mail/%d/%n mail_location = maildir:~/Maildir mail_plugins = quota mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spamverdacht { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::file:%h/Maildir/dovecot-quota quota_rule2 = INBOX.Trash:ignore quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve/sieve_after.sieve sieve_default = /usr/local/etc/dovecot/sieve/default.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service lmtp { executable = lmtp -L inet_listener lmtp { address = 172.17.1.2 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/etc/dovecot/quota_warning.sh unix_listener quota-warning { user = vmail } user = root } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = quota imap_quota } From voytek at sbt.net.au Wed Jan 22 22:53:31 2014 From: voytek at sbt.net.au (Voytek) Date: Thu, 23 Jan 2014 07:53:31 +1100 Subject: [Dovecot] beginners sieve: copy not move to subfolder? In-Reply-To: References: <0e029dec39af82e2bcaa05600073e864.squirrel@emu.sbt.net.au> Message-ID: <9e210521-774f-4993-878b-0483526abe20@email.android.com> Steffen Kaiser wrote: > >http://wiki2.dovecot.org/Pigeonhole/Sieve >then follow the link of "copy". > >> even after I added 'copy' to 'require' still failed ? >> Thanks! 'keep;' kept the email, moving slowly forward, V -- Sent from Kaiten Mail. Please excuse my brevity. From rcpt.dmitry at gmail.com Wed Jan 22 22:51:51 2014 From: rcpt.dmitry at gmail.com (Dmitry) Date: Thu, 23 Jan 2014 00:51:51 +0400 Subject: [Dovecot] Problem with LDA. When vacation auto-reply sent, the field from=<>. In-Reply-To: <52DFD9DC.4000608@thelounge.net> References: <20140122163951.74e7d665a4bfa9705cf9d47f@gmail.com> <52DFC522.7020802@thelounge.net> <20140122183955.a174f5e63b71f4a76ce253b4@gmail.com> <52DFD9DC.4000608@thelounge.net> Message-ID: <20140123005151.b5627447f79ded57ee881a36@gmail.com> > you should try to explain your problem and not how to implement a solution Sorry. I know English bad. I tried to describe the problem in the first letter. I'll try again. My Dovecot receive mail from many different domains (around 30) from many different machines. 1.1.1.1 - domain1 2.2.2.2 - domain2 3.3.3.3 - domain3 ... with different postfix with virtual_transport = lmtp:10.10.10.10:24 in their main.cf 10.10.10.10 - machine with my dovecot. Users imap - 10.10.10.10:143 User smtp - 10.10.10.10:25 10.10.10.10:25 - postfix with sender_dependent_relayhost_maps = hash:$config_directory/relayhost_maps in relayhost_maps @domain1 [1.1.1.1] @domain2 [2.2.2.2] @domain3 [3.3.3.3] for example user at domain2 receive mail: inet -> 2.2.2.2:25 -> 10.10.10.10:24 -> saved to disk user at domain2 connect to 10.10.10.10:143 and read it. for example user at domain2 sends mail: user at domain2 connect to 10.10.10.10:25 because in relayhost_maps written @domain2 [2.2.2.2] postfix sends it in 2.2.2.2 10.10.10.10:25 -> 2.2.2.2:25 -> inet Everything works fine until the case comes to vacation auto-reply with dovecot-pigeonhole plugin :( Because the domain of the sender is unknown, postfix 10.10.10.10 does not understand where to forward mail. Where relay for domain2. I do not know what to do ... On Wed, 22 Jan 2014 15:46:52 +0100 Reindl Harald wrote: > do not mix the "From: header address of MAILER-DAEMON" with the envelope > from= would be the problem described below > why in the world do you need "sender_dependent_relayhost_maps" for vacation? > > you should try to explain your problem and not how to implement a solution > http://www.catb.org/~esr/faqs/smart-questions.html > > Am 22.01.2014 15:39, schrieb Dmitry: > > Thanks for your quick reply. > > > > Can I least make dovecot write from=? > > How can I make "sender_dependent_relayhost_maps" works in postfix? > > > > On Wed, 22 Jan 2014 14:18:26 +0100 > > Reindl Harald wrote: > > > >> Am 22.01.2014 13:39, schrieb Dmitry: > >>> My problem is that when vacation auto-reply sent the field from=<> > >>> Because of this does not work "sender_dependent_relayhost_maps" in postfix > >> > >> <> is correct in case of auto-responders > >> > >> why? > >> to prevent mail-loops if both sides have a responder > >> > >> well, there are special headers too for this but they > >> rely on be respected by the final destination while > >> null sender never get bounces and replies > >> > >> http://en.wikipedia.org/wiki/Bounce_message > >> > >> Bounce messages in SMTP are sent with the envelope sender address <>, > >> known as the null sender address. They are frequently sent with a From: > >> header address of MAILER-DAEMON at the recipient site. > From slusarz at curecanti.org Wed Jan 22 23:14:20 2014 From: slusarz at curecanti.org (Michael M Slusarz) Date: Wed, 22 Jan 2014 14:14:20 -0700 Subject: [Dovecot] IMAP ANNOTATE Extension RFC5257 In-Reply-To: <52DECF58.9090004@sys4.de> References: <52DECB20.2090902@riseup.net> <52DECF58.9090004@sys4.de> Message-ID: <20140122141420.Horde.hZy397QeXGOPqTVOPC30Rw1@bigworm.curecanti.org> Quoting Robert Schetterer : > Am 21.01.2014 20:31, schrieb Sebastian Schlatow: >> Hello, >> >> Does Dovecot support the IMAP ANNOTATE Extension RFC5257 >> http://tools.ietf.org/html/rfc5257? If not, are there any plans to >> implement the extension? If not, why there is no plan to implement this >> feature? >> >> Regards >> Sebastian >> > > not sure about how up2date these are, and whats allready done > > http://dovecot.org/list/dovecot/2013-February/088305.html > http://www.imapwiki.org/Specs > http://wiki2.dovecot.org/Roadmap > http://hg.dovecot.org/dovecot-metadata-plugin And FWIW, that RFC is classified as Experimental. Hasn't been a bunch of momentum behind it, at least in terms of adoption/implementations. Mailbox metadata seems to be the more interesting development at this time (RFC 5464). michael From buzz-dee at riseup.net Thu Jan 23 00:00:00 2014 From: buzz-dee at riseup.net (Sebastian Schlatow) Date: Wed, 22 Jan 2014 23:00:00 +0100 Subject: [Dovecot] IMAP ANNOTATE Extension RFC5257 In-Reply-To: <20140122141420.Horde.hZy397QeXGOPqTVOPC30Rw1@bigworm.curecanti.org> References: <52DECB20.2090902@riseup.net> <52DECF58.9090004@sys4.de> <20140122141420.Horde.hZy397QeXGOPqTVOPC30Rw1@bigworm.curecanti.org> Message-ID: <1390428000.4929.0.camel@buzzdee-asus-1011px.briese.net> On Mi, 2014-01-22 at 14:14 -0700, Michael M Slusarz wrote: > Quoting Robert Schetterer : > > > Am 21.01.2014 20:31, schrieb Sebastian Schlatow: > >> Hello, > >> > >> Does Dovecot support the IMAP ANNOTATE Extension RFC5257 > >> http://tools.ietf.org/html/rfc5257? If not, are there any plans to > >> implement the extension? If not, why there is no plan to implement this > >> feature? > >> > >> Regards > >> Sebastian > >> > > > > not sure about how up2date these are, and whats allready done > > > > http://dovecot.org/list/dovecot/2013-February/088305.html > > http://www.imapwiki.org/Specs > > http://wiki2.dovecot.org/Roadmap > > http://hg.dovecot.org/dovecot-metadata-plugin > > And FWIW, that RFC is classified as Experimental. Hasn't been a bunch > of momentum behind it, at least in terms of adoption/implementations. > Mailbox metadata seems to be the more interesting development at this > time (RFC 5464). > > michael > Yes, I know, but for groupware collaboration on mails, it is an useful feature. Especially in companies, where an extreme group based workflow is used. From sca at andreasschulze.de Thu Jan 23 00:14:38 2014 From: sca at andreasschulze.de (Andreas Schulze) Date: Wed, 22 Jan 2014 23:14:38 +0100 Subject: [Dovecot] Problem with LDA. When vacation auto-reply sent, the field from=<>. In-Reply-To: <20140123005151.b5627447f79ded57ee881a36@gmail.com> References: <20140122163951.74e7d665a4bfa9705cf9d47f@gmail.com> <52DFC522.7020802@thelounge.net> <20140122183955.a174f5e63b71f4a76ce253b4@gmail.com> <52DFD9DC.4000608@thelounge.net> <20140123005151.b5627447f79ded57ee881a36@gmail.com> Message-ID: <20140122231438.Horde.LlXEksc7IB0RjxtP70FXEA1@horde.andreasschulze.de> Zitat von Dmitry : > Users imap - 10.10.10.10:143 > User smtp - 10.10.10.10:25 > 10.10.10.10:25 - postfix with > sender_dependent_relayhost_maps = hash:$config_directory/relayhost_maps Dmitry, just an untested idea: leave the RFC5321.MAILFROM empty. That's fine as it avoid loops. let the user set a RFC5322.From via sieve: vacation :addresses "user at domain1 :from "user at domain1" "vacation message" Now you could filter using header_checks (http://www.postfix.org/header_checks.5.html) /From: .*@domain1/ FILTER transport1:[1.1.1.1] ... Andreas From CMarcus at Media-Brokers.com Thu Jan 23 14:23:53 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 23 Jan 2014 07:23:53 -0500 Subject: [Dovecot] dovecot produces messages dupes after nfs problems In-Reply-To: <52E01DEF.1000303@wk-serv.de> References: <52E01DEF.1000303@wk-serv.de> Message-ID: <52E109D9.2010606@Media-Brokers.com> On 2014-01-22 2:37 PM, Patrick Westenberg wrote: > All duplicates have no "received from" headers. Seperate lmtp log shows > only one delivery. As when troubleshooting anything like this, FULL logs for an event exhibiting the problem is in order. So, a full transaction log of a delivery that resulted in duplicates. Not just the LMTP logs, ALL logs (including the postfix logs). > Any hint or advice what might be wrong? Since you are using NFS, and there are well known potential issues when using NFS under certain circumstances, a more detailed description of your (NFS) setup is in order. Ie - are you using Director? -- Best regards, Charles From rcpt.dmitry at gmail.com Thu Jan 23 18:30:08 2014 From: rcpt.dmitry at gmail.com (Dmitry) Date: Thu, 23 Jan 2014 20:30:08 +0400 Subject: [Dovecot] Problem with LDA. When vacation auto-reply sent, the field from=<>. In-Reply-To: <20140122231438.Horde.LlXEksc7IB0RjxtP70FXEA1@horde.andreasschulze.de> References: <20140122163951.74e7d665a4bfa9705cf9d47f@gmail.com> <52DFC522.7020802@thelounge.net> <20140122183955.a174f5e63b71f4a76ce253b4@gmail.com> <52DFD9DC.4000608@thelounge.net> <20140123005151.b5627447f79ded57ee881a36@gmail.com> <20140122231438.Horde.LlXEksc7IB0RjxtP70FXEA1@horde.andreasschulze.de> Message-ID: <20140123203008.9e0f3801100fecc558702cb8@gmail.com> > Now you could filter using header_checks > (http://www.postfix.org/header_checks.5.html) > /From: .*@domain1/ FILTER transport1:[1.1.1.1] Big thanks for idea! I don't really like it, but I have not found anything better... I made 10025 inet n - n - - smtpd -o cleanup_service_name=clup_ar clup_ar unix n - n - 0 cleanup -o header_checks=regexp:/etc/postfix/header_checks in postfix for auto-reply submission_host = 10.10.10.10:10025 in dovecot and this really work Best Regards Dmitry From lists at wildgooses.com Thu Jan 23 18:57:22 2014 From: lists at wildgooses.com (Ed W) Date: Thu, 23 Jan 2014 16:57:22 +0000 Subject: [Dovecot] Architecture for large Dovecot cluster (employ an expert!) In-Reply-To: <52C9B3A1.60308@sys4.de> References: <52C958DD.6080206@westnet.com.au> <52C9B3A1.60308@sys4.de> Message-ID: <52E149F2.8030905@wildgooses.com> Hi >> and some other Dovecot mailing list threads but I am not sure how many >> users such a setup will handle. I have a concern about the I/O >> performance of NFS in the suggested architecture above. One possible >> option available to us is to split up the mailboxes over multiple >> clusters with subsets of domains. Is there anyone out there currently >> running this many users on a Dovecot based mail cluster? Some >> suggestions or advice on the best way to go would be greatly appreciated. > look about list archive for equal setups , ask Timo or other people for > paid support, wait for people reporting their big setups It's difficult for me (on the outside) to gauge how many people do pay Timo, et al for services. However, just to put a stake in the ground, I have "employed" Timo on a couple of occasions, just for small projects, but in my case to add new features or fix bugs which are specific to my requirements. I will very positively recommend this, I found Timo extremely helpful and although I only paid an affordable amount to have a feature added, he has kindly continued to maintain these features as part of the core software (for which I am extremely grateful) I'm very satisfied and have to highly recommend Timo. His prices were extremely reasonable and he offered service excellent. This is obviously a glowing endorsement, take that as you wish. However, I suspect that sometimes we are all guilty of forgetting that there are humans on the far side of these projects and for relatively affordable sums we can employ them to both help us out (and possibly benefit all users of the software). I don't have big pockets, but I have successfully asked for enhancements to several open source projects (dovecot/dnsmasq/shorewall/squid and some others) and the whole experience has worked very well for me. Please feel encouraged to employ Timo if you use Dovecot! Good luck Ed W From lists at wildgooses.com Thu Jan 23 19:02:08 2014 From: lists at wildgooses.com (Ed W) Date: Thu, 23 Jan 2014 17:02:08 +0000 Subject: [Dovecot] IMAP ANNOTATE Extension RFC5257 In-Reply-To: <1390428000.4929.0.camel@buzzdee-asus-1011px.briese.net> References: <52DECB20.2090902@riseup.net> <52DECF58.9090004@sys4.de> <20140122141420.Horde.hZy397QeXGOPqTVOPC30Rw1@bigworm.curecanti.org> <1390428000.4929.0.camel@buzzdee-asus-1011px.briese.net> Message-ID: <52E14B10.8080200@wildgooses.com> Hi >> And FWIW, that RFC is classified as Experimental. Hasn't been a bunch >> of momentum behind it, at least in terms of adoption/implementations. >> Mailbox metadata seems to be the more interesting development at this >> time (RFC 5464). >> >> michael >> > Yes, I know, but for groupware collaboration on mails, it is an useful > feature. Especially in companies, where an extreme group based workflow > is used. Is this the extension necessary to make Kolab work correctly? I would be interested to see further implementation on that? I think Kolab has the most "legs" at the moment for me to use to extend our services with extra groupware features (I think I would prefer to implement filesystem based storage of DAV files, but apart from that it looks good and seems to be heading in the right direction) Anyone want to pitch in fund development in this area? Cheers Ed W From CMarcus at Media-Brokers.com Thu Jan 23 19:04:22 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Thu, 23 Jan 2014 12:04:22 -0500 Subject: [Dovecot] Architecture for large Dovecot cluster (employ an expert!) In-Reply-To: <52E149F2.8030905@wildgooses.com> References: <52C958DD.6080206@westnet.com.au> <52C9B3A1.60308@sys4.de> <52E149F2.8030905@wildgooses.com> Message-ID: <52E14B96.1050901@Media-Brokers.com> On 2014-01-23 11:57 AM, Ed W wrote: > I'm very satisfied and have to highly recommend Timo. His prices were > extremely reasonable and he offered service excellent. > ...snip... > Please feel encouraged to employ Timo if you use Dovecot! I will add a hearty 'seconded!' to this endorsement. Timo helped migrate our old courier-imap setup and dis so quickly and efficiently. A few legacy config issues prevented us from switching to the dovecot LDA at the time, but he explained in detail what I needed to do, and when I migrated our old bare metal gentoo mail server to a shiny new virtualized one, I made the changes and everything just worked (with a few minor issues I had to fix, also related to the same legacy config issues)... I just wish my boss was more open to spending money on technology so I could engage Timo to do a few more things... -- Best regards, Charles From slusarz at curecanti.org Thu Jan 23 20:11:07 2014 From: slusarz at curecanti.org (Michael M Slusarz) Date: Thu, 23 Jan 2014 11:11:07 -0700 Subject: [Dovecot] IMAP ANNOTATE Extension RFC5257 In-Reply-To: <52E14B10.8080200@wildgooses.com> References: <52DECB20.2090902@riseup.net> <52DECF58.9090004@sys4.de> <20140122141420.Horde.hZy397QeXGOPqTVOPC30Rw1@bigworm.curecanti.org> <1390428000.4929.0.camel@buzzdee-asus-1011px.briese.net> <52E14B10.8080200@wildgooses.com> Message-ID: <20140123111107.Horde.D5ebi5E1V3LWQr-7Ccp_dQ3@bigworm.curecanti.org> Quoting Ed W : > Hi > >>> And FWIW, that RFC is classified as Experimental. Hasn't been a bunch >>> of momentum behind it, at least in terms of adoption/implementations. >>> Mailbox metadata seems to be the more interesting development at this >>> time (RFC 5464). >>> >>> michael >>> >> Yes, I know, but for groupware collaboration on mails, it is an useful >> feature. Especially in companies, where an extreme group based workflow >> is used. > > Is this the extension necessary to make Kolab work correctly? IIRC, No. Kolab uses the mailbox-level METADATA extension instead (RFC 5464). michael From alec at alec.pl Thu Jan 23 20:22:49 2014 From: alec at alec.pl (A.L.E.C) Date: Thu, 23 Jan 2014 19:22:49 +0100 Subject: [Dovecot] IMAP ANNOTATE Extension RFC5257 In-Reply-To: <20140123111107.Horde.D5ebi5E1V3LWQr-7Ccp_dQ3@bigworm.curecanti.org> References: <52DECB20.2090902@riseup.net> <52DECF58.9090004@sys4.de> <20140122141420.Horde.hZy397QeXGOPqTVOPC30Rw1@bigworm.curecanti.org> <1390428000.4929.0.camel@buzzdee-asus-1011px.briese.net> <52E14B10.8080200@wildgooses.com> <20140123111107.Horde.D5ebi5E1V3LWQr-7Ccp_dQ3@bigworm.curecanti.org> Message-ID: <52E15DF9.4030704@alec.pl> On 01/23/2014 07:11 PM, Michael M Slusarz wrote: > IIRC, No. Kolab uses the mailbox-level METADATA extension instead (RFC > 5464). RFC5257 is for message annotations (not folder/mailbox annotations), so it is a different thing. Kolab does not use it. Anyway there are not many servers supporting RFC5257. -- Aleksander 'A.L.E.C' Machniak LAN Management System Developer [http://lms.org.pl] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From michael at bigmichi1.de Thu Jan 23 21:19:18 2014 From: michael at bigmichi1.de (Michael Cramer) Date: Thu, 23 Jan 2014 20:19:18 +0100 Subject: [Dovecot] questions about SETQUOTA Message-ID: <20140123201918.Horde.enGoHu383XWuoDXu3xxJhg3@horde.bigmichi1.de> hi, i tried to setup my configuration to use the?SETQUOTA command but the only thing i got is: 3 setquota "User quota" (storage 12345) 3 OK Setquota completed. but nothing is changed in database. i modified the password_query and the user_query to return the admin and userdb_admin field, both set to y. all other changes that are done are like in the wiki http://wiki2.dovecot.org/Quota/Configuration enabling debug doesn't show anything in debug.log From jwm at horde.net Thu Jan 23 21:30:42 2014 From: jwm at horde.net (John Morrissey) Date: Thu, 23 Jan 2014 14:30:42 -0500 Subject: [Dovecot] Writing an FTS plugin In-Reply-To: <20140104200325.GA11543@boost.horde.net> References: <20140104200325.GA11543@boost.horde.net> Message-ID: <20140123193042.GA20410@boost.horde.net> On Sat, Jan 04, 2014 at 03:03:25PM -0500, John Morrissey wrote: > Hi, I'm having some trouble writing an FTS plugin that uses notmuch > (http://notmuchmail.org/) as the backend. > > As a proof of concept, I'm adding a hardcoded UID to the search results in > the plugin's lookup handler: > > seq_range_array_add(&result->definite_uids, 1, 42); > > but this UID is never returned by IMAP SEARCH commands. I know the plugin is > being used, since I'm also syslogging immediately before the call to > seq_range_array_add(). > > Interestingly, SEARCH commands return correct results (based on the mailbox > content and the search terms specified), but I'm not sure where those > results are coming from. The notmuch plugin is the only configured FTS > plugin: > > mail_plugins = $mail_plugins fts fts_notmuch > plugin { > fts = notmuch > } > > What might I be doing wrong? > > Additionally, notmuch returns message filenames, which I'll need to > translate to UIDs. I've seen maildir_uidlist_get_uid(), but I'm not sure > where to get the struct maildir_uidlist arg it needs. notmuch only supports > the Maildir format, so using a maildir_* function seems a reasonably safe > assumption, but is there a better way? I haven't made much progress on this, and I'd love if someone knowledgeable about this part of the code base could point me in the right direction. I'm obv. more than happy to submit the final plugin, but I need a hand getting past this. john -- John Morrissey _o /\ ---- __o jwm at horde.net _-< \_ / \ ---- < \, www.horde.net/ __(_)/_(_)________/ \_______(_) /_(_)__ From sca at andreasschulze.de Thu Jan 23 22:45:24 2014 From: sca at andreasschulze.de (Andreas Schulze) Date: Thu, 23 Jan 2014 21:45:24 +0100 Subject: [Dovecot] doveadm stats top exit with error Message-ID: <20140123204524.GA19612@solar.andreasschulze.de> Hello, looks like a cosmetical problem but I like to mention it though: doveadm stats top is interactive. To exit I press as usual CTRL+C and get ^Cdoveadm(root): Error: close(-1[doveadm-stats.c:496]) failed: Interrupted system call It's dovecot-2.2.10. Andreas From nick.z.edwards at gmail.com Fri Jan 24 04:38:23 2014 From: nick.z.edwards at gmail.com (Nick Edwards) Date: Fri, 24 Jan 2014 12:38:23 +1000 Subject: [Dovecot] dovecot produces messages dupes after nfs problems In-Reply-To: <52E109D9.2010606@Media-Brokers.com> References: <52E01DEF.1000303@wk-serv.de> <52E109D9.2010606@Media-Brokers.com> Message-ID: On 1/23/14, Charles Marcus wrote: > On 2014-01-22 2:37 PM, Patrick Westenberg wrote: >> All duplicates have no "received from" headers. Seperate lmtp log shows >> only one delivery. > > As when troubleshooting anything like this, FULL logs for an event > exhibiting the problem is in order. > doubt that would work in this case > > > Since you are using NFS, and there are well known potential issues when > using NFS under certain circumstances, a more detailed description of > your (NFS) setup is in order. > > never had any probems with NFS, but we dont use lmtp, we use dovecot-lda and we dont use director either From skdovecot at smail.inf.fh-brs.de Fri Jan 24 09:44:22 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 24 Jan 2014 08:44:22 +0100 (CET) Subject: [Dovecot] questions about SETQUOTA In-Reply-To: <20140123201918.Horde.enGoHu383XWuoDXu3xxJhg3@horde.bigmichi1.de> References: <20140123201918.Horde.enGoHu383XWuoDXu3xxJhg3@horde.bigmichi1.de> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 23 Jan 2014, Michael Cramer wrote: > i tried to setup my configuration to use the?SETQUOTA command but the only > thing i got is: > > 3 setquota "User quota" (storage 12345) > 3 OK Setquota completed. > > but nothing is changed in database. > > i modified the password_query and the user_query to return the admin and > userdb_admin field, both set to y. > > all other changes that are done are like in the wiki > http://wiki2.dovecot.org/Quota/Configuration Please post your doveconf -n - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUuIZ1nD1/YhP6VMHAQKVCwgAgS9VVyagJLyw/1EPb/IqpQDOx20yVnzM nX9mu0mvVpuMrCS22VXsEssMQhD2xJ7X+0fL/3eeajXHUdcbAFwTnupndf37U90y qdi0OGzorbgzltUYDXhPx1wwTPRUs62t4PB3Nbhca/zgT5JeH0Jy2L6q9+CXsYlV l/rA111qGNptxjjtsPACbuquctXJ1bFf3IKKmLn2GbJCruZEbFm47m3YctN3FewC tHaTP+3j9oVu+vKlFxTo7NL60lkxPfDzi4B2fPXI3eUvP/BTrAcwgVMbvMJp0DyT U6Mb4il1ReSsgOdqa6iwp9vff1R+FoYMUz4E6wuR7f08pGMu8n8UIw== =xlbQ -----END PGP SIGNATURE----- From alex at receptiveit.com.au Fri Jan 24 11:40:41 2014 From: alex at receptiveit.com.au (Alex Ferrara) Date: Fri, 24 Jan 2014 20:40:41 +1100 Subject: [Dovecot] Shared mailbox ACL Message-ID: Hi everyone, I am having some trouble with shared folders in trying to replicate how we use them with a Cyrus backend. The auth database is Samba4 active directory, so I am using an LDAP lookup to authenticate and forcing the UID and GID to be all the same. I have a post-login script that sets the group ACL, and this seems to be working fine. /mnt/mail is an NFS mount to a FreeNAS machine, and there is only one Dovecot server connecting to that NFS share. I have been able to get the inbox of the shared mailbox to appear in Thunderbird, but I would like to allow all subfolders to have the same ACLs. Is there a way to do this without having an ACL entry for each folder in the dovecot-acl file? I also cannot seem to create folders under the shared inbox. Thanks. Below is the output of /mnt/mail/acl/shared-mailboxes shared/shared-boxes/group/accounting/accounting 1 shared/shared-boxes/group/team1/team1 1 shared/shared-boxes/group/team2/team2 1 Below is the output of dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-22-pve x86_64 Debian 7.3 nfs auth_mechanisms = plain login auth_username_format = %n mail_debug = yes mail_location = maildir:/mnt/mail/mailboxes/%n/Maildir:INDEX=/var/local/dovecot-indexes/%n mail_plugins = acl mail_shared_explicit_inbox = no managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = yes location = maildir:/mnt/mail/mailboxes/%%n/Maildir:INDEX=/var/local/dovecot-shared/%%n prefix = ZGroup/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_defaults_from_inbox = yes acl_shared_dict = file:/mnt/mail/acl/shared-mailboxes sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap lmtp sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-postlogin { executable = script-login /usr/local/bin/postlogin.py user = vmail } service imap { executable = imap imap-postlogin } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } ssl_cert = References: <52E01DEF.1000303@wk-serv.de> <52E109D9.2010606@Media-Brokers.com> Message-ID: <52E2525C.9040200@Media-Brokers.com> On 2014-01-23 9:38 PM, Nick Edwards wrote: > On 1/23/14, Charles Marcus wrote: >> On 2014-01-22 2:37 PM, Patrick Westenberg wrote: >>> All duplicates have no "received from" headers. Seperate lmtp log shows >>> only one delivery. >> As when troubleshooting anything like this, FULL logs for an event >> exhibiting the problem is in order. > doubt that would work in this case Really? Without full logs, how would you then troubleshoot ANY problem? >> Since you are using NFS, and there are well known potential issues when >> using NFS under certain circumstances, a more detailed description of >> your (NFS) setup is in order. > never had any probems with NFS, but we dont use lmtp, we use dovecot-lda > and we dont use director either If you have read the dovecot wiki (and the list archives), then you also know that with NFS, the problems are all related to setups where the NFS mailstore is being accessed by more than one dovecot server at a time. That is what I was hinting at by 'a more detailed description of his (NFS) setup'... From stan at hardwarefreak.com Fri Jan 24 14:10:01 2014 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 24 Jan 2014 06:10:01 -0600 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: <52C958DD.6080206@westnet.com.au> References: <52C958DD.6080206@westnet.com.au> Message-ID: <52E25819.9090405@hardwarefreak.com> Sven, why didn't you chime in? Your setup is similar scale and I think your insights would be valuable here. Or maybe you could repost your last on this topic. Or was that discussion off list? I can't recall. Anyway, I missed this post Murray. Thanks Ed for drudging this up. Maybe this will give you some insight, or possibly confuse you. :) On 1/5/2014 7:06 AM, Murray Trainer wrote: > Hi All, > > I am trying to determine whether a mail server cluster based on Dovecot > will be capable of supporting 500,000+ mailboxes with about 50,000 IMAP > and 5000 active POP3 connections. I have looked at the Dovecot > clustering suggestions here: > > http://blog.dovecot.org/2012/02/dovecot-clustering-with-dsync-based.html > > and some other Dovecot mailing list threads but I am not sure how many > users such a setup will handle. I have a concern about the I/O > performance of NFS in the suggested architecture above. One possible > option available to us is to split up the mailboxes over multiple > clusters with subsets of domains. Is there anyone out there currently > running this many users on a Dovecot based mail cluster? Some > suggestions or advice on the best way to go would be greatly appreciated. As with MTAs Dovecot requires miniscule CPU power for most tasks. Body searches are the only operations that eat meaningful CPU, and only when indexes aren't up to date. As with MTAs, mailbox server performance is limited by disk IO, but it is also limited by memory capacity as IMAP connections are long lived, unlike an MTA where each lasts a few seconds. Thus, very similar to the advice I gave you WRT MTAs, you can do this with as few as two hosts in the cluster, or as many as you want. You simply need sufficient memory for concurrent user connections, and sufficient disk IO. The architecture of the IO subsystem depends greatly on which mailbox format you plan to use. Maildir is extremely metadata heavy and thus does not perform all that well with cluster filesystems such as OCFS or GFS, no matter how fast the SAN array controller and disks may be. It can work well with NFS. Mdbox isn't metadata heavy and works much better with cluster filesystems. Neither NFS nor a cluster filesystem setup can match the performance of a standalone filesystem on direct attached disk or a SAN LUN. But standalone filesystems make less efficient use of total storage capacity. And if using DAS failover, resiliency, etc are far less than optimal. With correct mail routing from your MTAs to your Dovecot servers, and with Dovecot director, you can use any of these architectures. Which one you choose boils down to: 1. Ease of management 2. Budget 3. Storage efficiency The NFS and cluster filesystem solutions are generally significantly more expensive than filesystem on DAS, because the NFS server and SAN array required for 500,000 mailboxes are costly. If you go NFS you better get a NetApp filer. Not just for the hardware, snapshots, etc, but for the engineering support expertise. They know NFS better than the Pope knows Jesus and can get you tuned for max performance. Standalone servers/filesystems with local disk give you dramatically more bang for the buck. You can handle the same load with fewer servers and with quicker response times. You can use SAN storage instead of direct attach, but at cost equivalent to the cluster filesystem architecture. You'll then benefit from storage efficiency, PIT snapshots, etc. Again, random disk IOPS is the most important factor wil mailbox storage. With 50K logged in IMAP users and 5K POP3 users, we simply have to guesstimate IOPS if you don't already have this data. I assume you don't as you didn't provide it. It is the KEY information required to size your architecture properly, and in the most cost effective manner. Lets assume for argument sake that your 50K concurrent IMAP users and your 5K POP users generate 8,000 IOPS, which is probably a high guess. 10K SAS drives do ~225 IOPS. 8000/225= 36 disks * 2 for RAID10 = 72 So as a wild ass guesstimate you'd need approximately 72 SAS drives in multiple at 10K spindle speed for this workload. If you need to use high cap 7.2K SATA or SAS drives to meet your offered mailbox capacity you'll need 144 drives. Whether you go NFS, cluster on SAN, or standalone filesystems on SAN, VMware with HA, Vmotion, etc, is a must, as it gives you instant host failover and far easier management that KVM, Xen, etc. On possible hardware solution consists of: Qty 1. HP 4730 SAN controller with 25x 600GB 10K SAS drives Qty 3. Expansion chassis for 75 drives, 45TB raw capacity, 21.6TB net after one spare per chassis and RAID10, 8100 IOPS. Qty 2. Dell PowerEdge 320, 4 core Xeon and 96GB RAM, Dovecot Qty 1. HP ProLiant DL320e with 8GB RAM running Dovecot Director You'd run ESX on each Dell with one Linux guest per physical box. Each guest would be allocated 46GB of RAM to facilitate failover. This much RAM is rather costly, but Vmware licenses are far more, so it saves money using a beefy 2 box cluster vs a 3/4 box cluster of weaker machines. You'd create multiple RAID10 arrays using a 32KB strip size on the 4730 of equal numbers of disks, and span the RAID sets into 2 volumes. You'd export each volume as a LUN to both ESX hosts. You'd create an RDM of each LUN and assign one RDM to each of your guests. Each guest would format its RDM with ~# mkfs.xfs "-d agcount=24" /dev/[device] giving you 24 allocation groups for parallelism. Do -not- align XFS (sunit/swidth) with a small file random IO workload. It will murder performance. You get two 10TB filesystems, each for 250,000 mailboxes, or ~44MB average per mailbox. If that's not enough storage, buy the 900GB drives for 66MB/mailbox. If that's still not enough, use more expansion chassis and more RAID sets per volume, or switch to a large cap SAS/SATA model. With 50K concurrent users, don't even think about using RAID5/6. The RMW will murder performance and then urinate on its grave. With HA configured, if one box or one guest dies, the guest will automatically be restarted on the remaining host. Since both hosts see both LUNs, and RDMs, the guest boots up and has its filesystem. This is an infinitely better solution than a single shared cluster filesystem. The dual XFS filesystems will be much faster. If the CFS gets corrupted all your users are down--with two local filesystems only half the users are down. Check/repair of a 20TB GFS2/OCFS2 filesystem will take -much- longer than xfs_repair on a 10TB FS, possibly hours one you have all 500K mailboxes on it. Etc, etc. -- Stan From javierdemiguel-ext at us.es Fri Jan 24 14:24:50 2014 From: javierdemiguel-ext at us.es (=?UTF-8?Q?Javier_de_Miguel_Rodr=C3=ADguez?=) Date: Fri, 24 Jan 2014 13:24:50 +0100 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: <52E25819.9090405@hardwarefreak.com> References: <52C958DD.6080206@westnet.com.au> <52E25819.9090405@hardwarefreak.com> Message-ID: <8659091cd2975a704f20270826150004@us.es> Great mail, Stan Another trick: you can save storage (both space & iops) using mdox and compression. CPU power is far cheaper than iops , the less data you read/write, the fewer iops. You can use gzip,bzip2 or even LZMA/xz compression for LDA. If you also use Single Instace Storage and Alternate (cheap) storage for old mail, you can save a lot of money in storage. Also consider using mdbox + ssd for indexes (hp storevirtual VSA+ a couple of ESXi with ssd disks will give you real-time replicated ssd iscsi lun for indexes) Just my 2 cents. Regards Javier From sven at svenhartge.de Fri Jan 24 14:42:59 2014 From: sven at svenhartge.de (Sven Hartge) Date: Fri, 24 Jan 2014 13:42:59 +0100 Subject: [Dovecot] Architecture for large Dovecot cluster References: <52C958DD.6080206@westnet.com.au> <52E25819.9090405@hardwarefreak.com> Message-ID: <0ad0b8lt9iv8@mids.svenhartge.de> Stan Hoeppner wrote: > Sven, why didn't you chime in? Your setup is similar scale and I > think your insights would be valuable here. Or maybe you could repost > your last on this topic. Or was that discussion off list? I can't > recall. Rather busy right now with a large scale Identity Management+AD rollout here, so unfortunately not too much time to elaborate my setup in great detail. But after testing the nothing-shared-6-node-cluster setup with imapc as the backend for shared folders I concluded that this does not scale very well (the imapc-part, that is) and changed my plans to an director-based NFS-backed (Netapp 3240) setup, which is much more common. I reckoned I'd be nearly the only one on this planet to be so crazy to try to use a backwards-normal-user-as-master-user-for-imapc setup for shared folders and that having anyone other than me understanding that setup, let alone getting support for it, would be to big a hassle. So I put the mdbox storage on two 15k-SAS-NetApp with 1TB FlashCache, connected with 2x 10GBit to the SAN, using NFS to mount the volumes in my 6 backend-dovecot servers, putting 2 director-dovecots in front, which will sit behind a Linux IPVS loadbalancer. All systems are VMs on ESX. I recently added two more shelves with SATA drives to the NetApp to use as storage for the alt-storage feature of dovecot to automatically migrate mails older than 180 days to less expensive storage. As of now, the system is not yet live (see IDM rollout above), I hope to resume my migration in late spring, early summer. But during initial synthetic benchmarks have show that this setup will be more than sufficient to provide the needed oompf for my 15k users, with enough room to grow. Interesting datapoint: NetApp Deduplication did only recover about 1% of storage space with mdbox-based mail storage, while on an maildir-based mail storage, the rate was about 15%. (This was tested with a copy of real user data, so is accurate for my workload.) Gr??e, Sven. -- Sigmentation fault. Core dumped. From bind at enas.net Fri Jan 24 17:09:23 2014 From: bind at enas.net (Urban Loesch) Date: Fri, 24 Jan 2014 16:09:23 +0100 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: <52C958DD.6080206@westnet.com.au> References: <52C958DD.6080206@westnet.com.au> Message-ID: <52E28223.9040909@enas.net> Hi, > and some other Dovecot mailing list threads but I am not sure how many users such a setup will handle. I have a concern about the I/O performance of > NFS in the suggested architecture above. One possible option available to us is to split up the mailboxes over multiple clusters with subsets of > domains. Is there anyone out there currently running this many users on a Dovecot based mail cluster? Some suggestions or advice on the best way to > go would be greatly appreciated. > we only have running a setup with 35k Users (2000 imap and 300 pop3 sessions simultaneous). But we split all users and domains accross 9 virtual containers. Until now all containers are running on 1 bare metal machine, because the server is fast enough and quite new. In front of our backend servers we use two imap/pop3 proxies which gets their static routing informations for imap/pop3/smtp/lmtp from dedicated mysql-databases (master-master mode, also multiple slaves are possible). Same for smtp relay. This setup allows us to scale out as wide we need. In theory it's possible to use for each account a separate storage backend scaled out on multiple servers. Connections beetween proxies and backends are made by IPv6 on layer2. No routers between. So we have no problems with tight ipv4 space :-) Some info on storage backends: - Mailbox format is mdbox with zlib plugin. Each file hax a max of 10MB. - Dovecot internal caches for authentication etc. doing a good job. Without the caches the database becomes busy. - Central administration functions are implemented on our internal admin frontend to for example clear caches, change account password or get/change user quota. - Mailindexes are stored on RAID 1 SSD SLC disks (about 20GB now) - Maildata is stored on RAID 10 SATA 7.2k rpm disks (10 disks) - Incomming Mailqueue and OS for the containers on RAID 1 SAS disks (10k rpm) - all Backends are in HA with a passive machine and DRBD with 10GBIT Cross Links IMAP/POP3/SMTP Proxies are running on 2 dedicated mid range servers (HA): - IMAP/POP3 Proxies are clustered and load balanced with the IPTable ClusterIP Module (poor man's load balancer) - Same on SMTP relay server for outgoing email. - MX Servers for incomming mail are load balanced by DNS priority as usual. Each setup has his advantages and disadvantages. For example no idea how can we use shared folders within one domain if the accounts are spread out on multiple backends. But at the moment we don't need that. For our needs this setup works very good. Also thanks to Timo for his great work on dovecot. Regards Urban From rick at havokmon.com Fri Jan 24 17:15:59 2014 From: rick at havokmon.com (Rick Romero) Date: Fri, 24 Jan 2014 09:15:59 -0600 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: <52E28223.9040909@enas.net> References: <52C958DD.6080206@westnet.com.au> <52E28223.9040909@enas.net> Message-ID: <20140124091559.Horde.rY00FIxRzsH6-ieKDWYOJg4@www.vfemail.net> Quoting Urban Loesch : > Hi, > >> and some other Dovecot mailing list threads but I am not sure how many >> users such a setup will handle.? I have a concern about the I/O >> performance of >> NFS in the suggested architecture above.? One possible option available >> to us is to split up the mailboxes over multiple clusters with subsets >> of >> domains.? Is there anyone out there currently running this many users >> on a Dovecot based mail cluster?? Some suggestions or advice on the >> best way to >> go would be greatly appreciated. > > we only have running a setup with 35k Users (2000 imap and 300 pop3 > sessions simultaneous). > But we split all users and domains accross 9 virtual containers. Until > now all containers are running on 1 bare metal machine, because > the server is fast enough and quite new. > > - all Backends are in HA with a passive machine and DRBD with 10GBIT > Cross Links > ? How do you do backups? From ebroch at whitehorsetc.com Fri Jan 24 17:25:45 2014 From: ebroch at whitehorsetc.com (Eric Broch) Date: Fri, 24 Jan 2014 08:25:45 -0700 Subject: [Dovecot] outlook will not sync Message-ID: <52E285F9.4000000@whitehorsetc.com> Dovecot users list, I started having problems with Outlook not syncing with Dovecot a public imap folder upon issuing a send/receive in the client; eventually Outlook timed out, and I received the following error in the Dovecot log. Jan 23 09:20:23 imap(user at mydom.com): Error: FETCH [] for mailbox projects.myfolder UID 120 got too little data: 7744 vs 7759 Jan 23 09:20:23 imap(user at mydom.com): Error: Maildir filename has wrong W value: /home/vpopmail/domains/mydom.com/shared/projects/.myfolder/cur/1384292337.M440452P9788.mail.mydom.com,S=265901,W=269597:2,Sc Jan 23 09:20:23 imap(user at mydom.com): Error: Corrupted index cache file /home/vpopmail/domains/mydom.com/shared/projects/.myfolder/dovecot.index.cache: Broken virtual size for mail UID 120 Jan 23 09:20:23 imap(user at mydom): Info: Disconnected: FETCH failed bytes=175/270387 However, I've since removed the file manually, deleted the old folder and recreated it and Outlook will still not sync even in the absence of the above error. Has anyone seen this issue--slow to no Outlook performance with dovecot--before, and/or does anyone have a solution or point me in the right direction? Thanks! Eric I'm using dovecot 2.0.17 with the following configuration # 2.0.17 (684381041dc4+): /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-371.1.2.el5 x86_64 CentOS release 5.10 (Final) auth_anonymous_username = anonymous auth_cache_negative_ttl = 1 hours auth_cache_size = 32 M auth_cache_ttl = 1 hours auth_debug = no auth_debug_passwords = no auth_default_realm = auth_failure_delay = 2 secs auth_first_valid_uid = 500 auth_gssapi_hostname = auth_krb5_keytab = auth_last_valid_uid = 0 auth_master_user_separator = auth_mechanisms = plain login digest-md5 cram-md5 auth_realms = auth_socket_path = auth-userdb auth_ssl_require_client_cert = no auth_ssl_username_from_cert = no auth_use_winbind = no auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_username_format = %Lu auth_username_translation = auth_verbose = no auth_verbose_passwords = no auth_winbind_helper_path = /usr/bin/ntlm_auth auth_worker_max_count = 30 base_dir = /var/run/dovecot config_cache_size = 1 M debug_log_path = default_client_limit = 1000 default_idle_kill = 60 default_internal_user = dovecot default_login_user = dovenull default_process_limit = 100 default_vsz_limit = 256 M deliver_log_format = msgid=%m: %$ dict_db_config = director_doveadm_port = 0 director_mail_servers = director_servers = director_user_expire = 15 mins disable_plaintext_auth = yes dotlock_use_excl = yes doveadm_allowed_commands = doveadm_password = doveadm_proxy_port = 0 doveadm_socket_path = doveadm-server doveadm_worker_count = 0 first_valid_gid = 1 first_valid_uid = 89 hostname = imap_capability = imap_client_workarounds = imap_id_log = imap_id_send = imap_idle_notify_interval = 2 mins imap_logout_format = bytes=%i/%o imap_max_line_length = 64 k import_environment = TZ info_log_path = last_valid_gid = 0 last_valid_uid = 0 lda_mailbox_autocreate = no lda_mailbox_autosubscribe = no lda_original_recipient_header = libexec_dir = /usr/libexec/dovecot listen = *, :: lmtp_proxy = no lmtp_save_to_detail_mailbox = no lock_method = fcntl log_path = /var/log/dovecot.log log_timestamp = "%b %d %H:%M:%S " login_access_sockets = login_greeting = Dovecot toaster ready. login_log_format = %$: %s login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c login_trusted_networks = mail_access_groups = mail_attachment_dir = mail_attachment_fs = sis posix mail_attachment_hash = %{sha1} mail_attachment_min_size = 128 k mail_cache_fields = flags mail_cache_min_mail_count = 0 mail_chroot = mail_debug = no mail_fsync = optimized mail_full_filesystem_access = no mail_gid = mail_home = mail_location = mail_log_prefix = "%s(%u): " mail_max_keyword_length = 50 mail_max_lock_timeout = 0 mail_max_userip_connections = 20 mail_never_cache_fields = imap.envelope mail_nfs_index = no mail_nfs_storage = no mail_plugin_dir = /usr/lib64/dovecot mail_plugins = mail_privileged_group = mail_save_crlf = no mail_temp_dir = /tmp mail_uid = mailbox_idle_check_interval = 30 secs mailbox_list_index_disable = no maildir_copy_with_hardlinks = yes maildir_stat_dirs = no maildir_very_dirty_syncs = no master_user_separator = mbox_dirty_syncs = yes mbox_dotlock_change_timeout = 2 mins mbox_lazy_writes = yes mbox_lock_timeout = 5 mins mbox_min_index_size = 0 mbox_read_locks = fcntl mbox_very_dirty_syncs = no mbox_write_locks = dotlock fcntl mdbox_preallocate_space = no mdbox_rotate_interval = 0 mdbox_rotate_size = 2 M mmap_disable = no namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. separator = . subscriptions = yes type = private } namespace { hidden = no inbox = no list = yes location = maildir:/home/vpopmail/domains/acemt.com/shared/projects prefix = projects. separator = . subscriptions = yes type = public } passdb { args = cache_key=%u webmail=127.0.0.1 deny = no driver = vpopmail master = no pass = no } plugin { quota = maildir } pop3_client_workarounds = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no pop3_save_uidl = no pop3_uidl_format = %08Xu%08Xv postmaster_address = protocols = imap quota_full_tempfail = no recipient_delimiter = + rejection_reason = Your message to <%t> was automatically rejected:%n%r rejection_subject = Rejected: %s sendmail_path = /usr/sbin/sendmail service anvil { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = anvil extra_groups = group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 1 protocol = service_count = 0 type = anvil unix_listener anvil-auth-penalty { group = mode = 0600 user = } unix_listener anvil { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service auth-worker { chroot = client_limit = 1 drop_priv_before_exec = no executable = auth -w extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener auth-worker { group = mode = 0600 user = $default_internal_user } user = vsz_limit = 18446744073709551615 B } service auth { chroot = client_limit = 4096 drop_priv_before_exec = no executable = auth extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener auth-client { group = mode = 0600 user = } unix_listener auth-login { group = mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mode = 0600 user = } unix_listener auth-userdb { group = mode = 0600 user = } unix_listener login/login { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service config { chroot = client_limit = 0 drop_priv_before_exec = no executable = config extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = config unix_listener config { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service dict { chroot = client_limit = 1 drop_priv_before_exec = no executable = dict extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dict { group = mode = 0600 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service director { chroot = client_limit = 0 drop_priv_before_exec = no executable = director extra_groups = fifo_listener login/proxy-notify { group = mode = 00 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener director-admin { group = mode = 0600 user = } unix_listener login/director { group = mode = 00 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service dns_client { chroot = client_limit = 1 drop_priv_before_exec = no executable = dns-client extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = unix_listener dns-client { group = mode = 0666 user = } unix_listener login/dns-client { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service doveadm { chroot = client_limit = 1 drop_priv_before_exec = no executable = doveadm-server extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 1 type = unix_listener doveadm-server { group = mode = 0600 user = } user = vsz_limit = 18446744073709551615 B } service imap-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = imap-login extra_groups = group = idle_kill = 0 inet_listener imap { address = port = 143 ssl = no } inet_listener imaps { address = port = 993 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = imap service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service imap { chroot = client_limit = 1 drop_priv_before_exec = no executable = imap extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = imap service_count = 1 type = unix_listener login/imap { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service ipc { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = ipc extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = mode = 0600 user = $default_login_user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service lmtp { chroot = client_limit = 1 drop_priv_before_exec = no executable = lmtp extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = lmtp service_count = 0 type = unix_listener lmtp { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service log { chroot = client_limit = 0 drop_priv_before_exec = no executable = log extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = log user = vsz_limit = 18446744073709551615 B } service pop3-login { chroot = login client_limit = 0 drop_priv_before_exec = no executable = pop3-login extra_groups = group = idle_kill = 0 inet_listener pop3 { address = port = 110 ssl = no } inet_listener pop3s { address = port = 995 ssl = yes } privileged_group = process_limit = 0 process_min_avail = 0 protocol = pop3 service_count = 1 type = login user = $default_login_user vsz_limit = 18446744073709551615 B } service pop3 { chroot = client_limit = 1 drop_priv_before_exec = no executable = pop3 extra_groups = group = idle_kill = 0 privileged_group = process_limit = 1024 process_min_avail = 0 protocol = pop3 service_count = 1 type = unix_listener login/pop3 { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } service ssl-params { chroot = client_limit = 0 drop_priv_before_exec = no executable = ssl-params extra_groups = group = idle_kill = 0 privileged_group = process_limit = 0 process_min_avail = 0 protocol = service_count = 0 type = startup unix_listener login/ssl-params { group = mode = 0666 user = } user = vsz_limit = 18446744073709551615 B } shutdown_clients = yes ssl = yes ssl_ca = ssl_cert = References: <52C958DD.6080206@westnet.com.au> <52E28223.9040909@enas.net> <20140124091559.Horde.rY00FIxRzsH6-ieKDWYOJg4@www.vfemail.net> Message-ID: <52E286CC.9010204@enas.net> Am 24.01.2014 16:15, schrieb Rick Romero: >> >> - all Backends are in HA with a passive machine and DRBD with 10GBIT >> Cross Links >> > > How do you do backups? > The underlying storage is based on lvm. So we can take a daily snapshot on the passive server, mount them readonly and have no load impact on the active machine during the backuptime. Maildata etc. is synced via rsync to a small storagesystem in a seperate datacenter over a dedicated 1Gbit dark fiber link. Works very well for us and is within our budget. From h.reindl at thelounge.net Fri Jan 24 17:30:11 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Fri, 24 Jan 2014 16:30:11 +0100 Subject: [Dovecot] outlook will not sync In-Reply-To: <52E285F9.4000000@whitehorsetc.com> References: <52E285F9.4000000@whitehorsetc.com> Message-ID: <52E28703.9030105@thelounge.net> Am 24.01.2014 16:25, schrieb Eric Broch: > However, I've since removed the file manually, deleted the old folder > and recreated it and Outlook will still not sync even in the absence of > the above error. > > Has anyone seen this issue--slow to no Outlook performance with > dovecot--before, and/or does anyone have a solution or point me in the > right direction? Thanks! i had a situation where a dbmail-bugs which was long resolved leaded to no longer see any new message in Outlook, frankly even messages from a different folder in the one which was displayed empty disappeared the only solution: remove the complete account and configure it from scratch in Outlook -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From asai at globalchangemusic.org Fri Jan 24 17:51:47 2014 From: asai at globalchangemusic.org (Asai) Date: Fri, 24 Jan 2014 08:51:47 -0700 Subject: [Dovecot] Dsync Errors Message-ID: <52E28C13.4030207@globalchangemusic.org> Greetings, I've seen something like this in another thread, about a month ago, but we're running into this error pretty frequently when we run dsync backup. Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0 [0x39ccc5f1c0] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x35) [0x39ccc5f2a5] -> /usr/lib64/dovecot/libdovecot.so.0 [0x39ccc5ebb3] -> dsync(dsync_brain_mailbox_tree_sync_change+0x41c) [0x42cc0c] -> dsync(dsync_brain_recv_mailbox_tree_deletes+0x10a) [0x42be7a] -> dsync(dsync_brain_run+0x4fc) [0x429cdc] -> dsync [0x42885b] -> dsync [0x4119ff] -> dsync(doveadm_mail_try_run+0x269) [0x411e09] -> dsync(main+0x358) [0x41a2c8] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x3f4281d994] -> dsync [0x4111c9] We're running Dovecot 2.2.4 and the dsync command is this: dsync -u backup maildir:/mnt/backups/// When this happens to a particular users account I delete the backup and let it rebuild, which works for awhile, but then it happens again, and it seems to happen to particular users. Can you point me in the right direction to start troubleshooting this? Thanks. -- --Asai From weclassen at gmail.com Fri Jan 24 11:24:18 2014 From: weclassen at gmail.com (Sayajin) Date: Fri, 24 Jan 2014 01:24:18 -0800 (PST) Subject: [Dovecot] Dovecot imap-postlogin failed Message-ID: <1390555458330-46436.post@n4.nabble.com> *** This is 2 posts combined into one which I had asked on linuxquestions.org and never got an answer *** Hi, In short I am trying to run a bash script which will then update a mysql database with the last login date/time & last IP for each mailbox. I have searched google dead but still cant figure out what im doing wrong or if there is some issue with the centos 6 rpm's for dovecot. -- - 1st i had the default dovecot in the centos 6 repo's which is version: 2.0.9 - I read that there was an issue with the script-login binary which was fixed in version 2.0.14, so i updated dovecot to version 2.2.7. - This sadly did not fix my issue with the bash script excecuting. In my /etc/dovecot/conf.d/10-master.conf i have the following service imap { executable = imap imap-postlogin } service imap-postlogin { executable = script-login /var/www/lighttpd/mail-admin/scripts/lastLogin.sh } But when i try login i still get the same error as with the previous version: - Nov 27 14:44:36 dovecot: imap(MaIlBoX at DoMaIn.co.za): Error: net_connect_unix(/var/run/dovecot/imap-postlogin) failed: No such file or directory - One thing i did notice on the one site was that someone had a ls of their /var/run/dovecot directory, and in there was a binary called imap-postlogin. - But i dont have that binary anywhere on my server, with the old or new version of dovecot. Please any help would be appreciated. ===================================================== ===================================================== Ok well i tried a few other things and got it working a bit more. So the variables that i needed are now being set correctly etc, but im getting authentication errors now which I was not before. my setup in 10-master.conf now looks like the following: service imap-postlogin { executable = script-login /var/www/lighttpd/mail-admin/scripts/lastLogin.sh unix_listener imap-postlogin { user = root } } service imap { executable = imap imap-postlogin } My lastLogin.sh bash script has the following in it for debugging echo "$(date +%Y.%m.%d-%H:%M:%S)"; echo "User: ${USER}" >> /tmp/tracking.log 2>&1; echo "Home: ${HOME}" >> /tmp/tracking.log 2>&1; echo "Client IP: ${IP}" >> /tmp/tracking.log 2>&1; echo "Server IP: ${LOCAL_IP}" >> /tmp/tracking.log 2>&1; The output to my /tmp/tracker.log is the following User: user at domain.com Home: /var/spool/mail/domain.com/user Client IP: x.x.x.x Server IP: y.y.y.y The Authentication Error I am getting now dovecot: auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_pgsql.so dovecot: auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so dovecot: auth: Debug: Read auth token secret from /var/run/dovecot//auth-token-secret.dat dovecot: auth: Debug: auth client connected (pid=25865) dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=VPOQpNvsPwDELro2#011lip=X.X.X.X#011rip=Y.Y. Y.Y#011lport=143#011rport=58175 dovecot: auth: Debug: client passdb out: CONT#0111#011 dovecot: auth: Debug: client in: CONT#0111#011AHN1cHBvcnRAYmxhY2tsaXN0Ym94LmNvbQBzQHlAajFu (previous base64 data may contain sensitive data) dovecot: auth-worker(25868): Debug: Loading modules from directory: /usr/lib64/dovecot/auth dovecot: auth-worker(25868): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so dovecot: auth-worker(25868): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_pgsql.so dovecot: auth-worker(25868): Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so dovecot: auth-worker(25868): Debug: sql(user=user at domain.com,Y.Y.Y.Y): query: SELECT CONCAT(mailboxes.local_part,'@',domains.fqdn) as `user`, mailboxes.password AS `password`,'/var/spool/mail/domain.com/user' AS `userdb_home`, 8 AS `userdb_uid`, 12 AS `userdb_gid` FROM `mailboxes`, `domains` WHERE mailboxes.local_part = 'user' AND mailboxes.active = 1 AND mailboxes.domain_name = domains.fqdn AND domains.fqdn = 'domain.com' AND domains.active = 1 dovecot: auth: Debug: client passdb out: OK#0111#011user=user at domain.com dovecot: auth: Debug: master in: REQUEST#0112408185857#01125865#0111#0117b2d33b66e121f24e5393e87c3ae855f#011session_pid=25870#011requ est_auth_token dovecot: auth-worker(25868): Debug: sql(user=user at domain.com,Y.Y.Y.Y): SELECT '/var/spool/mail/domain.com/user' AS `home`, 8 AS `uid`, 12 AS `gid` dovecot: auth: Debug: master userdb out: USER#0112408185857#011user=user at domain.com#011home=/var/spool/mail/domain.com/user#011uid=8#011gid=12#011auth_token=505201029f52ca4318f4a283c1ad5449afd407d3 dovecot: imap-login: Login: user=, method=PLAIN, rip=Y.Y.Y.Y, lip=X.X.X.X, mpid=25870, TLS, session= dovecot: imap(user=user at domain.com): Debug: Effective uid=8, gid=12, home=/var/spool/mail/domain.com/user dovecot: imap(user=user at domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/var/spool/mail/domain.com/user dovecot: imap(user=user at domain.com): Debug: maildir++: root=/var/spool/mail/domain.com/user, index=, indexpvt=, control=, inbox=/var/spool/mail/domain.com/user, alt= -- View this message in context: http://dovecot.2317879.n4.nabble.com/Dovecot-imap-postlogin-failed-tp46436.html Sent from the Dovecot mailing list archive at Nabble.com. From ben at electricembers.coop Fri Jan 24 19:02:25 2014 From: ben at electricembers.coop (Benjamin Connelly) Date: Fri, 24 Jan 2014 09:02:25 -0800 (PST) Subject: [Dovecot] passphrases Message-ID: Is there any way to configure the dovecot-sql.conf.ext "connect =" line to use a password= string that contains spaces? (I've tried single quotes, double quotes, escaping the space with backslash. . .) Ben From michael at bigmichi1.de Fri Jan 24 20:57:34 2014 From: michael at bigmichi1.de (Michael Cramer) Date: Fri, 24 Jan 2014 19:57:34 +0100 Subject: [Dovecot] questions about SETQUOTA In-Reply-To: References: <20140123201918.Horde.enGoHu383XWuoDXu3xxJhg3@horde.bigmichi1.de> Message-ID: <20140124195734.Horde.1c90v7fPbzMkJRsmrnrE3Q9@horde.bigmichi1.de> Zitat von Steffen Kaiser : > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 23 Jan 2014, Michael Cramer wrote: > >> i tried to setup my configuration to use the?SETQUOTA command but >> the only thing i got is: >> >> 3 setquota "User quota" (storage 12345) >> 3 OK Setquota completed. >> >> but nothing is changed in database. >> >> i modified the password_query and the user_query to return the >> admin and userdb_admin field, both set to y. >> >> all other changes that are done are like in the wiki >> http://wiki2.dovecot.org/Quota/Configuration > > Please post your doveconf -n > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUuIZ1nD1/YhP6VMHAQKVCwgAgS9VVyagJLyw/1EPb/IqpQDOx20yVnzM > nX9mu0mvVpuMrCS22VXsEssMQhD2xJ7X+0fL/3eeajXHUdcbAFwTnupndf37U90y > qdi0OGzorbgzltUYDXhPx1wwTPRUs62t4PB3Nbhca/zgT5JeH0Jy2L6q9+CXsYlV > l/rA111qGNptxjjtsPACbuquctXJ1bFf3IKKmLn2GbJCruZEbFm47m3YctN3FewC > tHaTP+3j9oVu+vKlFxTo7NL60lkxPfDzi4B2fPXI3eUvP/BTrAcwgVMbvMJp0DyT > U6Mb4il1ReSsgOdqa6iwp9vff1R+FoYMUz4E6wuR7f08pGMu8n8UIw== > =xlbQ > -----END PGP SIGNATURE----- # 2.2.10 (6b8ae0ba5959): /etc/dovecot/dovecot.conf # OS: Linux 3.11.0-15-generic x86_64 Ubuntu 13.10 ext4 auth_master_user_separator = * auth_mechanisms = plain login debug_log_path = /var/log/dovecot/debug.log dict { acl = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = pgsql:/etc/dovecot/dovecot-dict-sql.conf.ext } first_valid_gid = 8 first_valid_uid = 8 imap_metadata = yes info_log_path = /var/log/dovecot/info.log last_valid_gid = 8 last_valid_uid = 8 log_path = /var/log/dovecot/error.log mail_attribute_dict = file:/srv/vmail/dovecot/metadata/%d/%n/attributes mail_gid = 8 mail_location = mdbox:/srv/vmail/dovecot/mail/%d/%n:INDEX=/srv/vmail/dovecot/indexes/shared/%d/%n mail_plugins = quota zlib acl expire virtual fts fts_solr mail_log notify stats mail_uid = 8 mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mdbox_preallocate_space = yes mdbox_rotate_size = 10 M namespace { list = children location = mdbox:/srv/vmail/dovecot/mail/%%d/%%n:INDEX=/srv/vmail/dovecot/indexes/shared/%%d/%%n:INDEXPVT=/srv/vmail/dovecot/indexes/private/%d/%n/shared/%%u prefix = Shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } mailbox virtual/All { auto = subscribe special_use = \All } mailbox virtual/Flagged { auto = subscribe special_use = \Flagged } prefix = separator = / type = private } namespace virtual { location = virtual:/srv/vmail/dovecot/virtual:INDEX=/srv/vmail/dovecot/indexes/shared/%d/%n/virtual prefix = virtual/ separator = / } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } plugin { acl = vfile:/srv/vmail/dovecot/acl:cache_secs=300 acl_anyone = allow acl_shared_dict = proxy::acl expire = Trash expire1 = Trash/* expire2 = Spam expire_dict = proxy::expire fts = solr fts_autoindex = yes fts_solr = break-imap-search url=http://localhost:8080/solr/dovecot/ quota = dict:User quota::proxy::quota quota_set = dict:proxy::quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = -storage=100%% quota-warning below %u sieve = /srv/vmail/dovecot/sieve/%d/%n/.dovecot.sieve sieve_default = /srv/vmail/dovecot/sieve/default.sieve sieve_dir = /srv/vmail/dovecot/sieve/%d/%n/user sieve_extensions = +notify +imapflags sieve_global_dir = /srv/vmail/dovecot/sieve/global stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } postmaster_address = postmaster at domain.com protocols = " imap lmtp sieve" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0666 user = mail } } service dict { unix_listener dict { group = mail mode = 0660 user = mail } } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = mail } user = dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl_cert = References: Message-ID: <52E2BDB7.1010009@localhost.localdomain.org> On 01/24/2014 05:02 PM Benjamin Connelly wrote: > Is there any way to configure the dovecot-sql.conf.ext "connect =" line to > use a password= string that contains spaces? > > (I've tried single quotes, double quotes, escaping the space with > backslash. . .) > The wiki mentions passwords containing '#'. Maybe that works also for passwords that contains spaces. (I didn't test it.) Regards, Pascal -- The trapper recommends today: face1e55.1402420 at localdomain.org From wib at qrv.uni-kiel.de Fri Jan 24 22:04:23 2014 From: wib at qrv.uni-kiel.de (Willi Burmeister) Date: Fri, 24 Jan 2014 21:04:23 +0100 Subject: [Dovecot] Dovecot on Solaris 10 Segmentation Fault In-Reply-To: <52DFE20D.6030205@buschor.ch> References: <52DFE20D.6030205@buschor.ch> Message-ID: <20140124200423.GA19913@eden.cs.uni-kiel.de> Hi Thomas, > make check on Solaris 10 throws a segmentation fault. in src/lib-http/test-http-url.c you will find several of these: if (urlp->host_name == NULL || urlt->host_name == NULL) { test_out(t_strdup_printf("url->host_name = %s", urlp->host_name), t_strdup_printf is called with urlp->host_name which value is NULL. So printf is called with a NULL pointer. Linux printf is mapping the NULL pointer to the string "(null)". Solaris does the right thing and dumps core. I will send 3 patch files in privat email. With these it will compile on Solaris. I dont understand the logic of the if clauses. Maybe Timo is able to explain :-) Greetings Willi From stan at hardwarefreak.com Sat Jan 25 02:49:09 2014 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 24 Jan 2014 18:49:09 -0600 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: <8659091cd2975a704f20270826150004@us.es> References: <52C958DD.6080206@westnet.com.au> <52E25819.9090405@hardwarefreak.com> <8659091cd2975a704f20270826150004@us.es> Message-ID: <52E30A05.3090206@hardwarefreak.com> On 1/24/2014 6:24 AM, Javier de Miguel Rodr?guez wrote: > > > Great mail, Stan > > Another trick: you can save storage (both space & iops) using mdox and > compression. CPU power is far cheaper than iops , the less data you > read/write, the fewer iops. Yeah, the cost of enterprise storage is insane. But I'd be wary of using compression on primary storage with 50K concurrent IMAP users plus 5K POP users. Even with dozens of cores of horsepower it'll still add latency. For alt storage sure. Using compression on primary storage would make system sizing much more difficult WRT core counts, clock speed, and memory requirements. And it would need much load testing. > You can use gzip,bzip2 or even LZMA/xz compression for LDA. If you also > use Single Instace Storage and Alternate (cheap) storage for old mail, > you can save a lot of money in storage. Also consider using mdbox + ssd > for indexes (hp storevirtual VSA+ a couple of ESXi with ssd disks will > give you real-time replicated ssd iscsi lun for indexes) I don't know how much SIS would benefit an Australian service provider. I don't know the culture, people's "forwarding" habits. If it's like parts of The States it may help some. Alt storage definitely would. To me your SSD suggestion just puts extra write wear on the SSDs. A form of SAN flash cache would be better. In the case of the VSAs they have tons of memory, 12 slots, to having fast hot indexes probably wouldn't be an issue. But obviously the HP gear isn't the only game in town. -- Stan From stan at hardwarefreak.com Sat Jan 25 05:23:26 2014 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Fri, 24 Jan 2014 21:23:26 -0600 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: <08BDB448-3435-4F86-9120-649E27BC9ECE@terramar.net> References: <52C958DD.6080206@westnet.com.au> <52E25819.9090405@hardwarefreak.com> <08BDB448-3435-4F86-9120-649E27BC9ECE@terramar.net> Message-ID: <52E32E2E.4090200@hardwarefreak.com> This went to me only so bringing back on list. On 1/24/2014 11:09 AM, Tom Johnson wrote: > Is anybody using the Object Storage plugin for large-scale > installations? I've not used it. > We're considering it, but are thinking of an in-house > S3 storage system (riak, or ceph, or ?) Looking to support perhaps > 300k users. I was thinking that if we use a bank of dovecot servers > (with director) with ssds as cache, we might be able to consolidate > all the storage on something like a riak cluster, which would make > scaling simple and inexpensive - certainly much less than a NetApp > solution. Everything costs less than a NetApp...except an EMC. > If anyone has any first-hand experience (or even > off-the-top-of-their-head thoughts), I'd love to hear them) Distributed filesystems give you the advantage of a single filesystem namespace with massive amounts of storage, fairly easy addition of storage space, and distributed replication to allow failure of a storage node without service interruption. Replication mitigates node failure, but not disk failure, so you still need RAID in each node. So you have RAID6 in a node and filesystem block mirroring amongst nodes. Thus storage utilization is -worse- than direct attach, CFS on SAN, or NFS head attached RAID10 and far worse than RAID6 in these 3 setups. And if using large SSD cache you'd surely use RAID6 with DAS, CFS, or NFS. You'd need half as many disk drives vs DFS. Each DFS expansion, assuming the typical model, entails the cost of a server, RAID HBA (unless using md) and disks, not strictly buying disks as with DAS, CFS/SAN, or NFS filer. Then you also need more switch ports, more power connections, greater UPS capacity due to all the CPUs, RAM, etc in the nodes. And you'll have a higher electric bill. So while a distributed filesystem storage architecture may seem less expensive it may not be. And just as one can build a DIY DFS cluster, one can also build a DIY NFS cluster instead of buying a NetApp, saving significant cash on the front end box and on disks since you'd need half as many vs a distributed filesystem architecture, though failure of one node may not be quite as graceful as with a NetApp losing a controller board. -- Stan From pw at wk-serv.de Sat Jan 25 11:30:02 2014 From: pw at wk-serv.de (Patrick Westenberg) Date: Sat, 25 Jan 2014 10:30:02 +0100 Subject: [Dovecot] dovecot produces messages dupes after nfs problems In-Reply-To: <52E2525C.9040200@Media-Brokers.com> References: <52E01DEF.1000303@wk-serv.de> <52E109D9.2010606@Media-Brokers.com> <52E2525C.9040200@Media-Brokers.com> Message-ID: <52E3841A.6000208@wk-serv.de> Hi, this seems to be a problem with Outlook 2013 and not NFS. Regards Patrick From dovecot at lists.dedilink.eu Sat Jan 25 12:56:45 2014 From: dovecot at lists.dedilink.eu (Kevin Holly) Date: Sat, 25 Jan 2014 11:56:45 +0100 Subject: [Dovecot] Panic: file index-mailbox-check.c: line 75 (index_mailbox_check_add): assertion failed: (box->notify_min_interval > 0) Message-ID: <52E3986D.8020207@lists.dedilink.eu> Hey guys, i have a weird problem i'm trying to fix since 5 months now, but i really couldn't find any explanation, why this happens and how it can be fixed. My client is Thunderbird, my dovecot version is 2.1.7-7 from the official Debian repo. If you want to see my config i'll grab all the fils together and send it to you. This is the error i'm always getting when my client tries to get new mails, which i want to get rid off: http://sprunge.us/NZhf Jan 25 11:49:30 old dovecot: auth-worker(15979): Debug: sql(root at hallowe.lt,81.217.212.85): query: SELECT password FROM mailbox WHERE username = 'root at hallowe.lt' Jan 25 11:49:30 old dovecot: auth: Debug: client out: OK#0111#011user=root at hallowe.lt Jan 25 11:49:30 old dovecot: auth-worker(15979): Debug: sql(root at hallowe.lt,81.217.212.85): SELECT CONCAT('maildir:/var/vmail/',maildir) AS mail, 1000 AS uid, 1000 AS gid FROM mailbox WHERE username = 'root at hallowe.lt' Jan 25 11:49:30 old dovecot: auth: Debug: master out: USER#0113983671297#011root at hallowe.lt#011mail=maildir:/var/vmail/hallowe.lt/root/#011uid=1000#011gid=1000 Jan 25 11:49:30 old dovecot: imap-login: Login: user=, method=PLAIN, rip=81.217.212.85, lip=10.111.56.107, mpid=17606, TLS, session= Jan 25 11:49:30 old dovecot: imap(root at hallowe.lt): Debug: Effective uid=1000, gid=1000, home= Jan 25 11:49:30 old dovecot: imap(root at hallowe.lt): Debug: quota: No quota setting - plugin disabled Jan 25 11:49:30 old dovecot: imap(root at hallowe.lt): Debug: maildir++: root=/var/vmail/hallowe.lt/root, index=, control=, inbox=/var/vmail/hallowe.lt/root, alt= Jan 25 11:49:30 old dovecot: imap(root at hallowe.lt): Panic: file index-mailbox-check.c: line 75 (index_mailbox_check_add): assertion failed: (box->notify_min_interval > 0) Jan 25 11:49:30 old dovecot: imap(root at hallowe.lt): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f858118714a] -> /usr/lib/dovecot/libdovecot.so.0(+0x4418e) [0x7f858118718e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f858115e82a] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x99027) [0x7f858146b027] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x4ccc9) [0x7f858141ecc9] -> dovecot/imap(cmd_idle+0x66) [0x7f8581907c96] -> dovecot/imap(command_exec+0x3c) [0x7f858190dedc] -> dovecot/imap(+0x11f2e) [0x7f858190cf2e] -> dovecot/imap(+0x11fda) [0x7f858190cfda] -> dovecot/imap(client_handle_input+0x11d) [0x7f858190d23d] -> dovecot/imap(client_input+0x65) [0x7f858190db35] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f8581194016] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f8581194cc7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f8581193a28] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8581180483] -> dovecot/imap(main+0x297) [0x7f85819053e7] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f8580dd7ead] -> dovecot/imap(+0xa561) [0x7f8581905561] Jan 25 11:49:30 old dovecot: imap(root at hallowe.lt): Fatal: master: service(imap): child 17606 killed with signal 6 (core dumps disabled) I asked for this in the irc already but got no answer. I would be really happy if someone can help me with this. Thank you very much! Best regards, Kevin Holly - root at hallowe.lt - http://hallowe.lt/ From gilles.chauvin at univ-rouen.fr Sat Jan 25 13:42:03 2014 From: gilles.chauvin at univ-rouen.fr (Gilles Chauvin) Date: Sat, 25 Jan 2014 12:42:03 +0100 Subject: [Dovecot] Dsync Panic Message-ID: <52E3A30B.9020409@univ-rouen.fr> Hi, Using dsync to backup my users' mailboxes (dovecot 2.2.10 on both sides), I sometimes encounter the following issue. Below is the output of: dsync -Dvf -u "user" -R backup ssh root at server.domain.tld dsync -u "user" doveadm(root): Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_lookup (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_list_backend (this is usually intentional, so just ignore this message) doveadm(user): Debug: Effective uid=495, gid=495, home=/srv/mail/u/user doveadm(user): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=sdbox:/srv/mail/u/user doveadm(user): Debug: fs: root=/srv/mail/u/user, index=, indexpvt=, control=, inbox=, alt= doveadm(user): Debug: Namespace : Using permissions from /srv/mail/u/user: mode=0700 gid=default dsync-local(user): Debug: brain M: in state=master_recv_handshake dsync-local(user): Debug: brain M: out state=send_mailbox_tree changed=1 dsync-local(user): Debug: brain M: in state=send_mailbox_tree dsync-local(user): Debug: brain M: out state=send_mailbox_tree_deletes changed=1 dsync-local(user): Debug: brain M: in state=send_mailbox_tree_deletes dsync-local(user): Debug: brain M: out state=recv_mailbox_tree changed=1 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree dsync-local(user): Debug: brain M: out state=recv_mailbox_tree changed=0 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=1 dsync-local(user): Debug: brain M: in state=recv_mailbox_tree_deletes dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=0 dsync-remote(user): Panic: file dsync-brain-mailbox-tree-sync.c: line 111 (dsync_brain_mailbox_tree_sync_change): assertion failed: (brain->no_backup_overwrite) dsync-remote(user): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x6889a) [0x7f1e89ee889a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7f1e89ee89a2] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f1e89ea21cf] -> dsyn(dsync_brain_mailbox_tree_sync_change+0x3c6) [0x42e046] -> dsyn(dsync_brain_recv_mailbox_tree_deletes+0x12a) [0x42d30a] -> dsyn(dsync_brain_run+0x2e6) [0x42ac96] -> dsyn() [0x42b5f0] -> dsyn() [0x43d740] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f1e89ef8336] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f1e89ef93a7] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f1e89ef82a8] -> dsyn() [0x427fd1] -> dsyn() [0x411c97] -> dsyn(doveadm_mail_try_run+0x238) [0x4120a8] -> dsyn(main+0x3d1) [0x41aaa1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x7f1e89b0ad1d] -> dsyn() [0x411419] dsync-local(user): Debug: brain M: in state=recv_mailbox_tree_deletes dsync-local(user): Error: read(server.domain.tld) failed: EOF dsync-local(user): Debug: brain M: out state=recv_mailbox_tree_deletes changed=0 dsync-local(user): Error: Remote command returned error 255 Regards, Gilles From CMarcus at Media-Brokers.com Sat Jan 25 14:23:57 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 25 Jan 2014 07:23:57 -0500 Subject: [Dovecot] Dsync Errors In-Reply-To: <52E28C13.4030207@globalchangemusic.org> References: <52E28C13.4030207@globalchangemusic.org> Message-ID: <52E3ACDD.6000607@Media-Brokers.com> On 2014-01-24 10:51 AM, Asai wrote: > We're running Dovecot 2.2.4 and the dsync command is this: > dsync -u backup > maildir:/mnt/backups/// > > When this happens to a particular users account I delete the backup > and let it rebuild, which works for awhile, but then it happens again, > and it seems to happen to particular users. > > Can you point me in the right direction to start troubleshooting this? The first thing to do when experiencing problems like this is make sure you are on the current version of whatever point release you are running. In your case that would be 2.2.10. Then if you still experience the problem, come back and re-ask... If you are unable to update due to some kind of 'LTS' restrictions enforced by your chosen OS, then your first line of support should be from them - otherwise, what is the point of using that OS? Also, they would be the ones that would have to back-port any fixes from more recent releases to your 'stable' version. -- Best regards, Charles From CMarcus at Media-Brokers.com Sat Jan 25 14:32:28 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 25 Jan 2014 07:32:28 -0500 Subject: [Dovecot] dovecot produces messages dupes after nfs problems In-Reply-To: <52E3841A.6000208@wk-serv.de> References: <52E01DEF.1000303@wk-serv.de> <52E109D9.2010606@Media-Brokers.com> <52E2525C.9040200@Media-Brokers.com> <52E3841A.6000208@wk-serv.de> Message-ID: <52E3AEDC.5070605@Media-Brokers.com> On 2014-01-25 4:30 AM, Patrick Westenberg wrote: > this seems to be a problem with Outlook 2013 and not NFS. One of many details that you neglected to mention. Also, I just noticed your OP said you were using 2.2.2, so per my last email on this: > The first thing to do when experiencing problems like this is make > sure you are on the current version of whatever point release you are > running. In your case that would be 2.2.10. Then if you still > experience the problem, come back and re-ask... > > If you are unable to update due to some kind of 'LTS' restrictions > enforced by your chosen OS, then your first line of support should be > from them - otherwise, what is the point of using that OS? > > Also, they would be the ones that would have to back-port any fixes > from more recent releases to your 'stable' version. -- Best regards, Charles From CMarcus at Media-Brokers.com Sat Jan 25 14:38:07 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Sat, 25 Jan 2014 07:38:07 -0500 Subject: [Dovecot] Panic: file index-mailbox-check.c: line 75 (index_mailbox_check_add): assertion failed: (box->notify_min_interval > 0) In-Reply-To: <52E3986D.8020207@lists.dedilink.eu> References: <52E3986D.8020207@lists.dedilink.eu> Message-ID: <52E3B02F.7050204@Media-Brokers.com> On 2014-01-25 5:56 AM, Kevin Holly wrote: > My client is Thunderbird, my dovecot version is 2.1.7-7 from the > official Debian repo. If you want to see my config i'll grab all the > fils together and send it to you. Have you asked on the debian list, since you're running their old/outdated version? -- Best regards, Charles From ch2009 at arcor.de Sat Jan 25 18:28:10 2014 From: ch2009 at arcor.de (Chris) Date: Sat, 25 Jan 2014 17:28:10 +0100 Subject: [Dovecot] userdb maildir permission denied in 2.1.7 Message-ID: <52E3E61A.9090308@arcor.de> Dear All, I'm using version 2.1.7 which currently ships with debian stable. I'd like to use userdb { driver = passwd-file args = username_format=%n /etc/dovecot/users default_fields = uid=vmail gid=vmail override_fields = skip = never result_failure = continue result_internalfail = continue result_success = return-ok } from [1]. The error message is: Jan 25 14:02:03 post1 dovecot: lda(chris): Error: user chris: Initialization failed: Namespace '': stat(/home/vmail/chris/Maildir) failed: Permission denied (euid=1000(chris) egid=1000(chris) missing +x perm: /home/vmail/chris, dir owned by 1001:1001 mode=0700) The skip and result_* commands aren't supported. My users file: chris:{MD5-CRYPT}$1$3uC3URg......:::/home/vmail/chris/:/bin/false:: Dovecot should access the Maildir with vmail:vmail (1001:1001) and not chris:chris (1000:1000)! Thank you in advance! - Chris [1] http://wiki2.dovecot.org/UserDatabase From ch2009 at arcor.de Sat Jan 25 20:17:46 2014 From: ch2009 at arcor.de (Chris) Date: Sat, 25 Jan 2014 19:17:46 +0100 Subject: [Dovecot] userdb maildir permission denied in 2.1.7 In-Reply-To: <52E3E61A.9090308@arcor.de> References: <52E3E61A.9090308@arcor.de> Message-ID: <52E3FFCA.4000701@arcor.de> Sorry, there's another issue with this configuration, not in the part I quoted. Please ignore this thread. If there are further questions, I'll ask again. - Chris On 01/25/2014 05:28 PM, Chris wrote: > Dear All, > > I'm using version 2.1.7 which currently ships with debian stable. > > I'd like to use > > userdb { > driver = passwd-file > args = username_format=%n /etc/dovecot/users > > default_fields = uid=vmail gid=vmail > override_fields = > > skip = never > > result_failure = continue > result_internalfail = continue > result_success = return-ok > } > > from [1]. > > The error message is: > > Jan 25 14:02:03 post1 dovecot: lda(chris): Error: user chris: > Initialization failed: Namespace '': stat(/home/vmail/chris/Maildir) > failed: Permission denied (euid=1000(chris) egid=1000(chris) missing +x > perm: /home/vmail/chris, dir owned by 1001:1001 mode=0700) > > The skip and result_* commands aren't supported. > > My users file: > chris:{MD5-CRYPT}$1$3uC3URg......:::/home/vmail/chris/:/bin/false:: > > Dovecot should access the Maildir with vmail:vmail (1001:1001) and not > chris:chris (1000:1000)! > > Thank you in advance! > > - Chris > > > [1] http://wiki2.dovecot.org/UserDatabase > > From sca at andreasschulze.de Sat Jan 25 22:42:23 2014 From: sca at andreasschulze.de (Andreas Schulze) Date: Sat, 25 Jan 2014 21:42:23 +0100 Subject: [Dovecot] allow_nets + default + ldap Message-ID: <20140125204223.GA14875@solar.andreasschulze.de> Hello, I'm playing with allow_nets function. It is really cool! In a filebased passwd backend you simply add "allow_nets=192.0.2.143/32" as mentioned in http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/AllowNets But if I use an LDAP backend it looks different. Following http://wiki2.dovecot.org/AuthDatabase/LDAP/AuthBinds and http://wiki2.dovecot.org/AuthDatabase/LDAP/Userdb#Attribute_templates_.28v2.1.29 my pass_attrs looks this: pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets} Using this syntax I could add an attribute "allownets" in the ldapserver to limit access for a user. A problem occour if the attribute is not present. For example if a user should not be limited or only some but not any user should be limited. So I extend my pass_attrs with a default. pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets:10.0.0.0/8} Again, that's fine. Any user was allowed to connect from my private network. But then some users connect via ipv6. I tried to extend my default to pass_attrs = =user=%{ldap:uid}, \ =allow_nets=%{ldap:allownets:10.0.0.0/8,fec0::/16} That syntax, a comma separated list, produces errors no matter if quoting using " or ' or no quoting at all. So I looked at the source (thanks, it's open!) and wrote a little patch to allow simple defaults: - ALL -> allow any address - NONE -> deny any address Now I could write pass_attrs = =user=%{ldap:uid}, =allow_nets=%{ldap:allownets:ALL} or pass_attrs = =user=%{ldap:uid}, =allow_nets=%{ldap:allownets:NONE} to allow or deny any ldap account not having an attribute allownets. Maybe there are other solutions, but that's my way... Andreas -------------- next part -------------- A non-text attachment was scrubbed... Name: allow_nets_defaults.patch Type: text/x-diff Size: 786 bytes Desc: not available URL: From me at junc.eu Sun Jan 26 12:51:40 2014 From: me at junc.eu (Benny Pedersen) Date: Sun, 26 Jan 2014 11:51:40 +0100 Subject: [Dovecot] userdb maildir permission denied in 2.1.7 In-Reply-To: <52E3FFCA.4000701@arcor.de> References: <52E3E61A.9090308@arcor.de> <52E3FFCA.4000701@arcor.de> Message-ID: <59cc4f7cbbd6e13254c159e1bcee17a6@junc.eu> On 2014-01-25 19:17, Chris wrote: > Sorry, there's another issue with this configuration, not in the part I > quoted. Please ignore this thread. If there are further questions, I'll > ask again. >> userdb { ... >> default_fields = uid=vmail gid=vmail default_fields=uid=1001 gid=1001 ... >> } ignore if it already tested From listserv at xtlv.cn Sun Jan 26 15:45:36 2014 From: listserv at xtlv.cn (Mario Arnold) Date: Sun, 26 Jan 2014 14:45:36 +0100 Subject: [Dovecot] dsync failed Message-ID: <52E51180.4010009@xtlv.cn> Hello, Since i updated to 2.2.10 there is a problem with dsync: dsync -v -u test at vtlx.de backup $SSH -i $KEY -p $PORT $RHOST dsync -u test at vtlx.de dsync-remote(test at vtlx.de): Error: Mailbox INBOX: Failed to set attribute vendor/vendor.dovecot/pvt/server/sieve/files/t1: Internal attributes cannot be changed directly doveconf -n # 2.2.10 (6018854c8c91): /etc/dovecot/dovecot.conf # OS: Linux 3.12.6-domU i686 Debian jessie/sid ext3 ... managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave ... plugin { ... sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } ... protocols = " imap lmtp sieve pop3" Do I need to reconfigure something? Thank you for any hints -- ??????? From tj at terramar.net Sun Jan 26 19:45:31 2014 From: tj at terramar.net (Tom Johnson) Date: Sun, 26 Jan 2014 09:45:31 -0800 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: <52E32E2E.4090200@hardwarefreak.com> References: <52C958DD.6080206@westnet.com.au> <52E25819.9090405@hardwarefreak.com> <08BDB448-3435-4F86-9120-649E27BC9ECE@terramar.net> <52E32E2E.4090200@hardwarefreak.com> Message-ID: > On Jan 24, 2014, at 7:23 PM, Stan Hoeppner wrote: > >> On 1/24/2014 11:09 AM, Tom Johnson wrote: >> Is anybody using the Object Storage plugin for large-scale >> installations? > > I've not used it. > >> We're considering it, but are thinking of an in-house >> S3 storage system (riak, or ceph, or ?) Looking to support perhaps >> 300k users. I was thinking that if we use a bank of dovecot servers >> (with director) with ssds as cache, we might be able to consolidate >> all the storage on something like a riak cluster, which would make >> scaling simple and inexpensive - certainly much less than a NetApp >> solution. > > Everything costs less than a NetApp...except an EMC. > >> If anyone has any first-hand experience (or even >> off-the-top-of-their-head thoughts), I'd love to hear them) (Stan gives a great run-down on the economics of using a NetApp or even homegrown NFS filer versus using an object storage backend.) I am quite familiar with NetApp, and EMC - I used to have a number of Celera file servers back in my BigFish/FrontBridge days. But now I'm in a situation where I have dozens of servers with spare storage bays and unused CPU cycles sitting in data centers where the power is already provisioned, and a DFS is what makes most sense for me now. So, I would like to ask once again- is anyone on the list using the object storage plugin for dovecot at any reasonably large scale, whether it's an in-house storage solution or S3? Thanks- Tom From dovecot_list at greenant.net Mon Jan 27 08:57:54 2014 From: dovecot_list at greenant.net (Frank) Date: Mon, 27 Jan 2014 17:57:54 +1100 Subject: [Dovecot] post-login scripting failing with "denied access to user" v2.1.7 Message-ID: I am trying to have a default sieve rule for new mailboxes that can be edited by users using the round cube sieve plugin. It would actually be better executed when a new user is created but my postfixadmin runs on a separate machine so that's a bit tricky. The "sieve-default =" setting won't quite achieve what I want as I want users to be able to edit the default rule (to adjust SPAM level) Mail works fine before I add my post-login script to 10-master.conf ---------------------- service imap { # tell imap to do post-login lookup using a socket called "imap-postlogin" executable = imap imap-postlogin } service imap-postlogin { # all post-login scripts are executed via script-login binary executable = script-login /etc/dovecot/custom_sieve/postlogin.sh # the script process runs as the user specified here (v2.0.14+): user = mail # also tried $default_internal_user and root # this UNIX socket listener must use the same name as given to imap executable unix_listener imap-postlogin { } } After adding this setting, login fails and gives the error below. It certainly looks like a permission issue, but I have checked my script is executable and owned by vmail:vmail. The bash script executes fine as the mail user. The other possibility is that dovecot is denying access to the $HOME variable, but that seems unlikely. Nevertheless, I am stuck! Log shows: ------------------ dovecot: master: Dovecot v2.1.7 starting up (core dumps disabled) dovecot: auth-worker(17522): mysql(database1): Connected to database postfixadmin dovecot: imap-login: Login: user=, method=PLAIN, rip=10.0.3.120, lip=10.0.1.180, mpid=17524, TLS, session=<+blqxxxxxxxxxM> dovecot: imap(test2 at fqdn.net): Post-login script denied access to user test2 at fqdn.net BASH script: /etc/dovecot/custom_sieve/postlogin.sh -------------------------------------------------- #!/bin/sh if [ ! -f $HOME/dovecot.sieve ] # if file doesn't exist then mkdir -p $HOME/sieve cp /etc/dovecot/custom_sieve/default.sieve $HOME/sieve/managesieve.sieve ln -s $HOME/sieve/managesieve.sieve $HOME/dovecot.sieve fi DEFAULT SIEVE RULE: /etc/dovecot/custom_sieve/default.sieve ----------------------------------- require ["fileinto"]; # rule:[SPAM] if header :contains "X-Spam-Level" "**********" { fileinto "Junk"; } Config ======= # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.3 ext4 dict { sqldomainquota = mysql:/etc/dovecot/dovecot-sql-domain.conf sqluserquota = mysql:/etc/dovecot/dovecot-dict-sql-user.conf } mail_location = maildir:/home/vmail/%d/%n/Maildir:INDEX=/home/vmail/%d/%n/Maildir/indexes mail_plugins = " quota" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User Quota::proxy::sqluserquota quota_rule2 = Trash:storage=+100M sieve = ~/../.dovecot.sieve sieve_dir = ~/../sieve } protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-postlogin { executable = script-login /var/spool/mail/postlogin.sh user = vmail } service imap { executable = imap imap-postlogin } ssl_cert = notify_min_interval > 0) In-Reply-To: <52E3B02F.7050204@Media-Brokers.com> References: <52E3986D.8020207@lists.dedilink.eu> <52E3B02F.7050204@Media-Brokers.com> Message-ID: <52E6089E.8050105@lists.dedilink.eu> On 01/25/2014 01:38 PM, Charles Marcus wrote: > On 2014-01-25 5:56 AM, Kevin Holly wrote: >> My client is Thunderbird, my dovecot version is 2.1.7-7 from the >> official Debian repo. If you want to see my config i'll grab all the >> fils together and send it to you. > > Have you asked on the debian list, since you're running their > old/outdated version? > After asking there we got it fixed. The problem was that i had set "mailbox_idle_check_interval" to 0. From skdovecot at smail.inf.fh-brs.de Mon Jan 27 09:49:41 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 27 Jan 2014 08:49:41 +0100 (CET) Subject: [Dovecot] outlook will not sync In-Reply-To: <52E28703.9030105@thelounge.net> References: <52E285F9.4000000@whitehorsetc.com> <52E28703.9030105@thelounge.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 24 Jan 2014, Reindl Harald wrote: > Am 24.01.2014 16:25, schrieb Eric Broch: >> However, I've since removed the file manually, deleted the old folder >> and recreated it and Outlook will still not sync even in the absence of >> the above error. >> >> Has anyone seen this issue--slow to no Outlook performance with >> dovecot--before, and/or does anyone have a solution or point me in the >> right direction? Thanks! > > i had a situation where a dbmail-bugs which was long resolved > leaded to no longer see any new message in Outlook, frankly > even messages from a different folder in the one which was > displayed empty disappeared > > the only solution: > remove the complete account and configure it from scratch in Outlook Same seen here with Courier and Dovecot v1. Not seen with Dovecot v2.2 (yet) Also: Outlook != Outlook. There are so many different versions and variants of Outlook. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUuYPlXD1/YhP6VMHAQI0XQf+JXRldMdTTLbGk+DjB/XqkoRPNw0O+3eM Ui6mLFpTvmzj1V4X0DqC/Ta334q1t3W/hCuyJOF8w5zObXKc0ZC6IV0qPjptfEba q7UiBKpctLSNWVqMYIz1KZ4uss3ctBfH4VQlJxLNr3N0RF+JJU/8t0swETe6n+o/ 4eYJn15mqSdlLwFPdCRLv4uM0yYNMcyS/EiKGUMBx1LWP8v/g6mwRdedvfYjZto5 I3D3peXv+Qdt6iOuf56r80qwjyZ+x5R5oguffDCHCyuJvyxIhJFFo4nHMrTrH85o bxXEMd+mZMiIcK6JE0kX3VUYuzZIZNaA0bb9CUp20nfdmaf7oHUpvA== =IgCn -----END PGP SIGNATURE----- From itgeek31 at googlemail.com Mon Jan 27 11:15:16 2014 From: itgeek31 at googlemail.com (IT geek 31) Date: Mon, 27 Jan 2014 10:15:16 +0100 Subject: [Dovecot] Replication - what am I doing wrong? Message-ID: Hi, I'm having issues getting replication working, and I'm not also not having much luck finding help on it. So I'm wondering... am I not asking the right questions? Or am I not providing enough information... or do we just not know how this aspect of the technology works? If it's the former, then any pointers on what questions to ask or information to provide would be very helpful. If the community genuinely doesn't know how this works then that's okay too - I will look at another solution (if one exists) and try to move on. But if I can get this working then that would be amazing as I really like Dovecot and would be gutted to move away from it. -Mark From contact at toniob.net Mon Jan 27 15:46:55 2014 From: contact at toniob.net (Anthony Bourguignon) Date: Mon, 27 Jan 2014 14:46:55 +0100 Subject: [Dovecot] Auth socket can't listen using ssl Message-ID: <1390830415.6121.7.camel@anthony.lan.enovance.com> Hi, I'm using Dovecot 2.2.9 (debian package on testing). It seems that it's not possible to open an auth socket using ssl. I'm using this configuration : service auth { [...] inet_listener authxmpp-client { address = [ips] port = 5220 } inet_listener genericauth-client { ssl = yes address = [ips] port = 5221 } [...] } Both ports are running fine. But the 5221, which should listen in ssl (because of the "ssl = yes" as written in the documentation here : http://wiki2.dovecot.org/Services ) is using plaintext. If I telnet directly to it, the content is delivered on an unsecured socket. Is there a way to make ssl works on this kind of socket ? Thanks a lot From slitt at troubleshooters.com Mon Jan 27 19:08:04 2014 From: slitt at troubleshooters.com (Steve Litt) Date: Mon, 27 Jan 2014 12:08:04 -0500 Subject: [Dovecot] Auth socket can't listen using ssl In-Reply-To: <1390830415.6121.7.camel@anthony.lan.enovance.com> References: <1390830415.6121.7.camel@anthony.lan.enovance.com> Message-ID: <20140127120804.32a3f6c5@mydesk> On Mon, 27 Jan 2014 14:46:55 +0100 Anthony Bourguignon wrote: > Hi, > > I'm using Dovecot 2.2.9 (debian package on testing). > It seems that it's not possible to open an auth socket using ssl. I'm > using this configuration : > > service auth { > [...] > inet_listener authxmpp-client { > address = [ips] > port = 5220 > } > inet_listener genericauth-client { > ssl = yes > address = [ips] > port = 5221 > } > [...] > } > > Both ports are running fine. But the 5221, which should listen in ssl > (because of the "ssl = yes" as written in the documentation here : > http://wiki2.dovecot.org/Services ) is using plaintext. > If I telnet directly to it, the content is delivered on an unsecured > socket. > > Is there a way to make ssl works on this kind of socket ? > > Thanks a lot I read in some docs somewhere that Dovecot automatically trusts anything on localhost. If you're telnetting into it from the same physical computer that hosts the port, try telnetting into it from a different physical computer with a different IP address and see if you can still telnet in. Of course, if you were already doing that, then please ignore my email :-) Thanks, SteveT Steve Litt * http://www.troubleshooters.com/ Troubleshooting Training * Human Performance From d.parthey at metaways.de Mon Jan 27 19:10:26 2014 From: d.parthey at metaways.de (Daniel Parthey) Date: Mon, 27 Jan 2014 18:10:26 +0100 Subject: [Dovecot] post-login scripting failing with "denied access to user" v2.1.7 In-Reply-To: References: Message-ID: <52E69302.2030700@metaways.de> Hi Frank, Am 27.01.2014 07:57, schrieb Frank: > After adding this setting, login fails and gives the error below. > It certainly looks like a permission issue, but I have checked my script is executable and owned by vmail:vmail. The bash script executes fine as the mail user. > The other possibility is that dovecot is denying access to the $HOME variable, but that seems unlikely. > Nevertheless, I am stuck! > > Log shows: > ------------------ > dovecot: master: Dovecot v2.1.7 starting up (core dumps disabled) > dovecot: auth-worker(17522): mysql(database1): Connected to database postfixadmin > dovecot: imap-login: Login: user=, method=PLAIN, rip=10.0.3.120, lip=10.0.1.180, mpid=17524, TLS, session=<+blqxxxxxxxxxM> > dovecot: imap(test2 at fqdn.net): Post-login script denied access to user test2 at fqdn.net http://wiki2.dovecot.org/PostLoginScripting You need to hand over the connection to the original imap handler, your script may not simple exit, but needs to exec its argument line: exec "$@" Kind regards Daniel -- Dipl.-Inf. Daniel Parthey System Engineer Metaways Infosystems GmbH Pickhuben 2, D-20457 Hamburg E-Mail: d.parthey at metaways.de Web: http://www.metaways.de Metaways Infosystems GmbH - Sitz: D-22967 Tremsb?ttel Handelsregister: Amtsgericht L?beck HRB 4508 AH Gesch?ftsf?hrung: Hermann Thaele, L?der-H.Thaele From CMarcus at Media-Brokers.com Mon Jan 27 19:14:40 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 27 Jan 2014 12:14:40 -0500 Subject: [Dovecot] Panic: file index-mailbox-check.c: line 75 (index_mailbox_check_add): assertion failed: (box->notify_min_interval > 0) In-Reply-To: <52E6089E.8050105@lists.dedilink.eu> References: <52E3986D.8020207@lists.dedilink.eu> <52E3B02F.7050204@Media-Brokers.com> <52E6089E.8050105@lists.dedilink.eu> Message-ID: <52E69400.7080509@Media-Brokers.com> On 2014-01-27 2:19 AM, Kevin Holly wrote: > On 01/25/2014 01:38 PM, Charles Marcus wrote: >> On 2014-01-25 5:56 AM, Kevin Holly wrote: >>> My client is Thunderbird, my dovecot version is 2.1.7-7 from the >>> official Debian repo. If you want to see my config i'll grab all the >>> fils together and send it to you. >> Have you asked on the debian list, since you're running their >> old/outdated version? > After asking there we got it fixed. The problem was that i had set > "mailbox_idle_check_interval" to 0. Never a good idea to change the defaults unless you have a good reason. -- Best regards, Charles From erik at iamusingtheinternet.com Mon Jan 27 11:49:37 2014 From: erik at iamusingtheinternet.com (erik) Date: Mon, 27 Jan 2014 01:49:37 -0800 Subject: [Dovecot] =?utf-8?q?managesieve_-_point_me_in_the_right_direction?= =?utf-8?q?=3F?= Message-ID: <808060ce3c801a297253b879586c99cd@mx1.iamusingtheinternet.com> Hi, I am using Dovecot 2.1.16. I'm trying to get Roundcube to talk to the managesieve plugin. Postfix/Dovecot/Roundcube all exist on the same server. I'd like to get managesieve working. I've gone through a few guides, such as: https://wiki.archlinux.org/index.php/dovecot#Sieve But so far roundcube won't connect to the managesieve plugin. ("Cant reach server"). I see that port 4190 is listening and I can telnet to that port: Connected to localhost. Escape character is '^]'. "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN" "STARTTLS" "VERSION" "1.0" OK "Dovecot ready." I'm not sure what else to check. Any help appreciated! From mihai at badici.ro Mon Jan 27 21:41:28 2014 From: mihai at badici.ro (Mihai Badici) Date: Mon, 27 Jan 2014 21:41:28 +0200 Subject: [Dovecot] managesieve - point me in the right direction? In-Reply-To: <808060ce3c801a297253b879586c99cd@mx1.iamusingtheinternet.com> References: <808060ce3c801a297253b879586c99cd@mx1.iamusingtheinternet.com> Message-ID: <1997527.0p8Ry9OTTg@arhivio> On Monday 27 January 2014 01:49:37 erik wrote: > Hi, > > I am using Dovecot 2.1.16. I'm trying to get Roundcube to talk to the > managesieve plugin. Postfix/Dovecot/Roundcube all exist on the same > server. > > I'd like to get managesieve working. I've gone through a few guides, > such as: > https://wiki.archlinux.org/index.php/dovecot#Sieve > > But so far roundcube won't connect to the managesieve plugin. ("Cant > reach server"). I see that port 4190 is listening and I can telnet to > that port: > > Connected to localhost. > Escape character is '^]'. > "IMPLEMENTATION" "Dovecot Pigeonhole" > "SIEVE" "fileinto reject envelope encoded-character vacation subaddress > comparator-i;ascii-numeric relational regex imap4flags copy include > variables body enotify environment mailbox date ihave" > "NOTIFY" "mailto" > "SASL" "PLAIN LOGIN" > "STARTTLS" > "VERSION" "1.0" > OK "Dovecot ready." > > I'm not sure what else to check. Any help appreciated! -- In roundcube, the default port is 2000, did you change-it? Mihai B?dici http://mihai.badici.ro From CMarcus at Media-Brokers.com Mon Jan 27 21:49:26 2014 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 27 Jan 2014 14:49:26 -0500 Subject: [Dovecot] Replication - what am I doing wrong? In-Reply-To: References: Message-ID: <52E6B846.5090108@Media-Brokers.com> On 2014-01-27 4:15 AM, IT geek 31 wrote: > So I'm wondering... am I not asking the right questions? Or am I not > providing enough information... or do we just not know how this aspect of > the technology works? I only see this one email from you...? -- Best regards, Charles From itgeek31 at googlemail.com Mon Jan 27 22:06:15 2014 From: itgeek31 at googlemail.com (IT geek 31) Date: Mon, 27 Jan 2014 21:06:15 +0100 Subject: [Dovecot] Replication - what am I doing wrong? In-Reply-To: <52E6B846.5090108@Media-Brokers.com> References: <52E6B846.5090108@Media-Brokers.com> Message-ID: This month yes, but I've raised a few over the last few months and not had much luck :-( Timo helped me out on bit of the basic stuff, but I kinda got stuck again. I'm not sure if the following config is right, and if it is, why the resultant file sizes bigger than the original. The error I'm currently getting is: Jan 27 21:03:33 server1 dovecot: dsync-local(mark): Error: read( server2.mdb.eu.com) failed: EOF dovecot -n for server 1: # 2.2.9: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.2 cobalt auth_mechanisms = plain login doveadm_password = secret doveadm_port = 12345 first_valid_uid = 1003 last_valid_uid = 1020 listen = 192.168.1.2 login_greeting = Go on then, let's have it... mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " notify replication" passdb { driver = passwd } plugin { mail_replica = tcp:server2.test.com } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service doveadm { inet_listener { port = 12345 } } service imap-login { inet_listener imap { port = 0 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = wrote: > On 2014-01-27 4:15 AM, IT geek 31 wrote: > >> So I'm wondering... am I not asking the right questions? Or am I not >> providing enough information... or do we just not know how this aspect of >> the technology works? >> > > I only see this one email from you...? > > -- > > Best regards, > > Charles > > > From jtam.home at gmail.com Tue Jan 28 03:50:40 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 27 Jan 2014 17:50:40 -0800 (PST) Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: References: Message-ID: Sven Hartge wrote: > Interesting datapoint: NetApp Deduplication did only recover about 1% of > storage space with mdbox-based mail storage, while on an maildir-based > mail storage, the rate was about 15%. (This was tested with a copy of > real user data, so is accurate for my workload.) Just a guess, but I expect the difference is because NetApp de-dupes by checksumming blocks and mark whole blocks as duplicates if they have the same checksum. The message body has the same block offset in maildir (i.e. the start of a message is at byte 0), whereas mdbox might align message body anywhere in a block, so you might have 512 different block configurations for the same message. I don't know whether message alignment would be a worthwhile optimization for mdbox. Joseph Tam From alex at receptiveit.com.au Tue Jan 28 05:41:30 2014 From: alex at receptiveit.com.au (Alex Ferrara) Date: Tue, 28 Jan 2014 14:41:30 +1100 Subject: [Dovecot] Shared mailbox ACL In-Reply-To: References: Message-ID: <174C5BEF-102D-4482-BCEA-68CE51DAB26C@receptiveit.com.au> On 24/01/2014, at 8:40 PM, Alex Ferrara wrote: > Hi everyone, > > I am having some trouble with shared folders in trying to replicate how we use them with a Cyrus backend. > > The auth database is Samba4 active directory, so I am using an LDAP lookup to authenticate and forcing the UID and GID to be all the same. I have a post-login script that sets the group ACL, and this seems to be working fine. /mnt/mail is an NFS mount to a FreeNAS machine, and there is only one Dovecot server connecting to that NFS share. > > I have been able to get the inbox of the shared mailbox to appear in Thunderbird, but I would like to allow all subfolders to have the same ACLs. Is there a way to do this without having an ACL entry for each folder in the dovecot-acl file? I also cannot seem to create folders under the shared inbox. > > Thanks. > > Below is the output of /mnt/mail/acl/shared-mailboxes > shared/shared-boxes/group/accounting/accounting > 1 > shared/shared-boxes/group/team1/team1 > 1 > shared/shared-boxes/group/team2/team2 > 1 > > Below is the output of dovecot -n > > # 2.1.7: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-22-pve x86_64 Debian 7.3 nfs > auth_mechanisms = plain login > auth_username_format = %n > mail_debug = yes > mail_location = maildir:/mnt/mail/mailboxes/%n/Maildir:INDEX=/var/local/dovecot-indexes/%n > mail_plugins = acl > mail_shared_explicit_inbox = no > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave > namespace { > list = yes > location = maildir:/mnt/mail/mailboxes/%%n/Maildir:INDEX=/var/local/dovecot-shared/%%n > prefix = ZGroup/%%n/ > separator = / > subscriptions = no > type = shared > } > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > separator = / > type = private > } > passdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > plugin { > acl = vfile > acl_defaults_from_inbox = yes > acl_shared_dict = file:/mnt/mail/acl/shared-mailboxes > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = " imap lmtp sieve" > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > } > service imap-postlogin { > executable = script-login /usr/local/bin/postlogin.py > user = vmail > } > service imap { > executable = imap imap-postlogin > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > user = vmail > } > ssl_cert = ssl_key = userdb { > args = /etc/dovecot/dovecot-ldap.conf.ext > driver = ldap > } > protocol lmtp { > mail_plugins = quota sieve > } > protocol lda { > mail_plugins = quota sieve > } > protocol imap { > mail_plugins = acl imap_acl > } Any ideas? aF From stan at hardwarefreak.com Tue Jan 28 06:56:55 2014 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Mon, 27 Jan 2014 22:56:55 -0600 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: References: <52C958DD.6080206@westnet.com.au> <52E25819.9090405@hardwarefreak.com> <08BDB448-3435-4F86-9120-649E27BC9ECE@terramar.net> <52E32E2E.4090200@hardwarefreak.com> Message-ID: <52E73897.6050701@hardwarefreak.com> On 1/26/2014 11:45 AM, Tom Johnson wrote: > >> On Jan 24, 2014, at 7:23 PM, Stan Hoeppner >> wrote: >> >>> On 1/24/2014 11:09 AM, Tom Johnson wrote: Is anybody using the >>> Object Storage plugin for large-scale installations? >> >> I've not used it. >> >>> We're considering it, but are thinking of an in-house S3 storage >>> system (riak, or ceph, or ?) Looking to support perhaps 300k >>> users. I was thinking that if we use a bank of dovecot servers >>> (with director) with ssds as cache, we might be able to >>> consolidate all the storage on something like a riak cluster, >>> which would make scaling simple and inexpensive - certainly much >>> less than a NetApp solution. >> >> Everything costs less than a NetApp...except an EMC. >> >>> If anyone has any first-hand experience (or even >>> off-the-top-of-their-head thoughts), I'd love to hear them) > > (Stan gives a great run-down on the economics of using a NetApp or > even homegrown NFS filer versus using an object storage backend.) Tom I'm sorry I wasted your time with my initial response. > I am quite familiar with NetApp, and EMC - I used to have a number of > Celera file servers back in my BigFish/FrontBridge days. > > But now I'm in a situation where I have dozens of servers with spare > storage bays and unused CPU cycles sitting in data centers where the > power is already provisioned, and a DFS is what makes most sense for > me now. Had I known these details above up front I wouldn't have responded. I incorrectly assumed you were designing new infrastructure, wading into new waters, because few are yet to deploy DFS for mailbox storage these days. > So, I would like to ask once again- is anyone on the list using the > object storage plugin for dovecot at any reasonably large scale, > whether it's an in-house storage solution or S3? I'm hoping, as I'd guess you are, that someone will respond who is already doing this. If someone has it working well it offers others more storage options, which is always a good thing. Whether it costs more or less than the other solutions, it may still be a better option for some folks either way. -- Stan From tj at terramar.net Tue Jan 28 07:25:10 2014 From: tj at terramar.net (Thomas Johnson) Date: Mon, 27 Jan 2014 21:25:10 -0800 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: <52E73897.6050701@hardwarefreak.com> References: <52C958DD.6080206@westnet.com.au> <52E25819.9090405@hardwarefreak.com> <08BDB448-3435-4F86-9120-649E27BC9ECE@terramar.net> <52E32E2E.4090200@hardwarefreak.com> <52E73897.6050701@hardwarefreak.com> Message-ID: Hi Stan- >> >> (Stan gives a great run-down on the economics of using a NetApp or >> even homegrown NFS filer versus using an object storage backend.) > > Tom I'm sorry I wasted your time with my initial response. > No, you absolutely didn't waste my time, and it was certainly of great advantage to the list. I think it was a great write-up of the advantages and disadvantages of each different option. I know my situation isn't the standard one... >> I am quite familiar with NetApp, and EMC - I used to have a number of >> Celera file servers back in my BigFish/FrontBridge days. >> >> But now I'm in a situation where I have dozens of servers with spare >> storage bays and unused CPU cycles sitting in data centers where the >> power is already provisioned, and a DFS is what makes most sense for >> me now. > > Had I known these details above up front I wouldn't have responded. I > incorrectly assumed you were designing new infrastructure, wading into > new waters, because few are yet to deploy DFS for mailbox storage these > days. I think it's great that you did respond, and thanks for doing so. I know that this is wading into new waters...I'm just hoping I'm not really the very first :) >> So, I would like to ask once again- is anyone on the list using the >> object storage plugin for dovecot at any reasonably large scale, >> whether it's an in-house storage solution or S3? > > I'm hoping, as I'd guess you are, that someone will respond who is > already doing this. If someone has it working well it offers others > more storage options, which is always a good thing. Whether it costs > more or less than the other solutions, it may still be a better option > for some folks either way. Dovecot's commercial arm is certainly marketing the object storage. I'm just hoping someone is actually using it and can offer some guidance. Tom From tlx at leuxner.net Tue Jan 28 09:29:32 2014 From: tlx at leuxner.net (Thomas Leuxner) Date: Tue, 28 Jan 2014 08:29:32 +0100 Subject: [Dovecot] New global ACL mailbox pattern feature in HG Message-ID: <20140128072932.GA27627@nihlus.leuxner.net> Hi, I played around with changeset 9376bf098692 a bit. Right now I'm unsure how to describe a namespace using this feature. Using something like 'Public/*" doesn't seem to work while 'Public*" does, but would also potentially alter non-related mailboxes elsewhere: $ cat global-acl INBOX owner lrwstiekxap Public* group=PublicMailboxAdmins lrwsik Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From skdovecot at smail.inf.fh-brs.de Tue Jan 28 09:37:30 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 28 Jan 2014 08:37:30 +0100 (CET) Subject: [Dovecot] Shared mailbox ACL In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 24 Jan 2014, Alex Ferrara wrote: > I have been able to get the inbox of the shared mailbox to appear in > Thunderbird, but I would like to allow all subfolders to have the same > ACLs. Is there a way to do this without having an ACL entry for each > folder in the dovecot-acl file? No, currently you need one file per mailbox. > I also cannot seem to create folders > under the shared inbox. If the accessing user has the "k"-permission, there might be problems with the unix file permissions. Latter logs errors. I think I remember something that you cannot give ACLs to the top most root of some mail storages, e.g. in Maildir Maildir/dovecot-acl applies to the INBOX and there is no file for the "/" or something like that. Can you create a new mailbox below, say, the INBOX? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUudeO3D1/YhP6VMHAQJiuQf+I5dAE718UK+sUb+H77ddW8xXkSQ81s4P yFYs+kRbgsjFEztrGQoRno/IWJ4YGpdjBrj6cH4/MwT/iSIibGggCkkpLaU1RD0O Wgs+w58sCPwVQFiopTjSOA0ItwtKvedphX/0l2bDkH90mdIi/Ck9Ih6mSSk0t52Y 4pvGl1GvEWGl2jLYaJIiq+YP85nQlxkNC8nT7UbaexsVz9qPMVLPFU4So81aHvPI 5MYhhflIGMw11P+NrlAMrohJ8D1Gb6foEW5T8NmAp4qu2mataUvGx6/jcTlQxRLU 19uC93vb1Gbf3AN2U3tKF48iU2lVY2lW1PXkE/F66idRJSWe+AUsUQ== =XgAZ -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Tue Jan 28 09:40:42 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 28 Jan 2014 08:40:42 +0100 (CET) Subject: [Dovecot] Shared mailbox ACL In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 28 Jan 2014, Steffen Kaiser wrote: > On Fri, 24 Jan 2014, Alex Ferrara wrote: > >> I have been able to get the inbox of the shared mailbox to appear in >> Thunderbird, but I would like to allow all subfolders to have the same >> ACLs. Is there a way to do this without having an ACL entry for each >> folder in the dovecot-acl file? > > No, currently you need one file per mailbox. Oh, see http://hg.dovecot.org/dovecot-2.2/rev/9376bf098692 and the message from Thomas Leuxner "New global ACL mailbox pattern feature in HG" - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUude+3D1/YhP6VMHAQKapAgA3BB/FP1ET6I4Sm7WMBdyEdkSFXV6ZBoV Us/WREUzQrqxXH60k9ZJZjVqcWGqh0neY94CVVmFFw4Q/dPmHzI3Ud/64HzG01UH /xQkrCbVK/6ksAP2DnQH/tgk/gOY2eqwR1dN7DAsVKdptG7i2t28IcvKTRnAa/iF XXXHWnAcrHDl99JJSQ4ZxgETsfhHgUgnvu/kbOaXmTfNvTNU35osP+N3l5A0pGuB xdLTkRVKGpMdBhjOFwABMgpbDXzClNqoZozq9oeHLEAT4STFxZnQonHffMgpFp97 QO0h+q3MwHKdIAbtMqtKSVke0BQI6Ga3AVm4vOvR8DD3N10luj0grg== =Rw7v -----END PGP SIGNATURE----- From stan at hardwarefreak.com Tue Jan 28 09:53:44 2014 From: stan at hardwarefreak.com (Stan Hoeppner) Date: Tue, 28 Jan 2014 01:53:44 -0600 Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: References: <52C958DD.6080206@westnet.com.au> <52E25819.9090405@hardwarefreak.com> <08BDB448-3435-4F86-9120-649E27BC9ECE@terramar.net> <52E32E2E.4090200@hardwarefreak.com> <52E73897.6050701@hardwarefreak.com> Message-ID: <52E76208.2070409@hardwarefreak.com> On 1/27/2014 11:25 PM, Thomas Johnson wrote: > Hi Stan- > >>> >>> (Stan gives a great run-down on the economics of using a NetApp >>> or even homegrown NFS filer versus using an object storage >>> backend.) >> >> Tom I'm sorry I wasted your time with my initial response. >> > > No, you absolutely didn't waste my time, and it was certainly of > great advantage to the list. I think it was a great write-up of the > advantages and disadvantages of each different option. I know my > situation isn't the standard one... > >>> I am quite familiar with NetApp, and EMC - I used to have a >>> number of Celera file servers back in my BigFish/FrontBridge >>> days. >>> >>> But now I'm in a situation where I have dozens of servers with >>> spare storage bays and unused CPU cycles sitting in data centers >>> where the power is already provisioned, and a DFS is what makes >>> most sense for me now. >> >> Had I known these details above up front I wouldn't have responded. >> I incorrectly assumed you were designing new infrastructure, wading >> into new waters, because few are yet to deploy DFS for mailbox >> storage these days. > > I think it's great that you did respond, and thanks for doing so. I > know that this is wading into new waters...I'm just hoping I'm not > really the very first :) > > >>> So, I would like to ask once again- is anyone on the list using >>> the object storage plugin for dovecot at any reasonably large >>> scale, whether it's an in-house storage solution or S3? >> >> I'm hoping, as I'd guess you are, that someone will respond who is >> already doing this. If someone has it working well it offers >> others more storage options, which is always a good thing. Whether >> it costs more or less than the other solutions, it may still be a >> better option for some folks either way. > > Dovecot's commercial arm is certainly marketing the object storage. > I'm just hoping someone is actually using it and can offer some > guidance. > > Tom This may be a dumb suggestion and maybe you already have done so, but since this is a commercial only option, maybe you should contact Timo directly and see if he can point you to other customers who have deployed it. -- Stan From contact at toniob.net Tue Jan 28 11:32:15 2014 From: contact at toniob.net (Anthony Bourguignon) Date: Tue, 28 Jan 2014 10:32:15 +0100 Subject: [Dovecot] Auth socket can't listen using ssl In-Reply-To: <20140127120804.32a3f6c5@mydesk> References: <1390830415.6121.7.camel@anthony.lan.enovance.com> <20140127120804.32a3f6c5@mydesk> Message-ID: <1390901535.4500.2.camel@anthony.lan.enovance.com> Le Monday 27 January 2014 ? 12:08 -0500, Steve Litt a ?crit : > I read in some docs somewhere that Dovecot automatically > trusts anything on localhost. If you're telnetting into it from the same > physical computer that hosts the port, try telnetting into it from a > different physical computer with a different IP address and see if you > can still telnet in. I've tried from localhost and another computer. In both tries, the connection is made without ssl. But thanks for the tip From sven at svenhartge.de Tue Jan 28 11:46:30 2014 From: sven at svenhartge.de (Sven Hartge) Date: Tue, 28 Jan 2014 10:46:30 +0100 Subject: [Dovecot] Architecture for large Dovecot cluster References: Message-ID: <6adaitfetkv8@mids.svenhartge.de> Joseph Tam wrote: > Sven Hartge wrote: >> Interesting datapoint: NetApp Deduplication did only recover about 1% >> of storage space with mdbox-based mail storage, while on an >> maildir-based mail storage, the rate was about 15%. (This was tested >> with a copy of real user data, so is accurate for my workload.) > Just a guess, but I expect the difference is because NetApp de-dupes > by checksumming blocks and mark whole blocks as duplicates if they > have the same checksum. > The message body has the same block offset in maildir (i.e. the start > of a message is at byte 0), whereas mdbox might align message body > anywhere in a block, so you might have 512 different block > configurations for the same message. True, the start of the message is always at byte 0, but because of different header length per user for the same message (different mail address with different lengths) the body will never start at the same byte. In the end, a slight compression (gzip 3) via Dovecot resulted in better space savings than compression and deduplication via NetApp. The most space can obviously saved via SiS of attachements in dovecot, but to be frank, this feature scares me a bit. Gr??e, Sven. -- Sigmentation fault. Core dumped. From skdovecot at smail.inf.fh-brs.de Tue Jan 28 12:28:07 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 28 Jan 2014 11:28:07 +0100 (CET) Subject: [Dovecot] Auth socket can't listen using ssl In-Reply-To: <1390901535.4500.2.camel@anthony.lan.enovance.com> References: <1390830415.6121.7.camel@anthony.lan.enovance.com> <20140127120804.32a3f6c5@mydesk> <1390901535.4500.2.camel@anthony.lan.enovance.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 28 Jan 2014, Anthony Bourguignon wrote: > Le Monday 27 January 2014 ? 12:08 -0500, Steve Litt a ?crit : >> I read in some docs somewhere that Dovecot automatically >> trusts anything on localhost. If you're telnetting into it from the same >> physical computer that hosts the port, try telnetting into it from a >> different physical computer with a different IP address and see if you >> can still telnet in. > > I've tried from localhost and another computer. In both tries, the > connection is made without ssl. Hmm, maybe "internal" sockets do not utilize SSL at all? Just IMAP/POP/ManageSieve? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUueGOHD1/YhP6VMHAQJNNgf/YhJvRaC5OgqCE2TJzEcy6WvFDB7bKIdU +8tVn66o1p5cAQYXZWb917otLnuejrO8RVLe5fAOb06Olo1eIbSbhJZv4JISS3OW adYZ468TdYT1Qdjmwbzo0lchZPlA2JHoRMi4EfxFcJN6rUte5XdkSds92ZhOIUvK /yAaBhsXYmF84n/24OqwT65b+IY2uJTggZR80tW+RhzAlUIR0D44oOCw8d7k2w3Y u545oolzHQiUvT1NLNedzjpneTfuV9ZukK9c/W/9mgUkXmNBykhzRsLbsJcOoOwP re59kSzgVssNlsTEFimUajU/RvoUs591AY+LVwk3mPBDQ6iJTDRwng== =tKyc -----END PGP SIGNATURE----- From Daniel-128 at gmx.de Tue Jan 28 14:02:50 2014 From: Daniel-128 at gmx.de (Daniel Thielemann) Date: Tue, 28 Jan 2014 13:02:50 +0100 (CET) Subject: [Dovecot] Problem to setup replication Message-ID: Hi, i tried to setup replication since some days but I'am stuck now. My conf: # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-431.3.1.el6.x86_64 x86_64 CentOS release 6.5 (Final) dsync_remote_cmd = ssh -l%{login} %{host} /usr/bin/doveadm dsync-server -u%u -l%{lock_timeout} -n%{namespace} log_path = /var/log/dovecot mail_gid = 5000 mail_home = /var/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = " notify replication" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_replica = remote:vmail at server1.domain.dom replication_full_sync_interval = 1 hours sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service managesieve-login { inet_listener sieve_deprecated { port = 2000 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 user = vmail } } ssl = required ssl_cert = Hi, It would be nice if the recipient_delimiter configuration option supported multiple recipient delimiters as Postfix now does. e.g. now if I set: recipient_delimiter = +- in Postfix, then test-extension at sample.com and test+extension at sample.com are both recognized. But if I set: recipient_delimiter = +- in Dovecot, neither of the above are recognized and instead test+-extension at sample.com is valid. Well, presently this feature isn't that important to me, but I imagine it could be a source of confusion for people who are migrating from say qmail to postfix (as I am doing) and notice Postfix's cool ability to support both types of delimiters and assume Dovecot will as well (as I did). Thanks, Andrew Ray -- Andrew Ray +1 404-418-5443 +421 (0) 917 832 253 http://guns.freedomlives.net/ From patrickdk at patrickdk.com Wed Jan 29 01:51:32 2014 From: patrickdk at patrickdk.com (Patrick Domack) Date: Tue, 28 Jan 2014 18:51:32 -0500 Subject: [Dovecot] recipient_delimiter -- feature request In-Reply-To: <52E81DC6.8060807@freedomlives.net> References: <52E81DC6.8060807@freedomlives.net> Message-ID: <20140128185132.Horde.FuySQ22ry1dZVuiKFz9PZQ1@mail.patrickdk.com> To make it work the current way, is simple. --- a/src/lmtp/commands.c 2013-02-05 18:31:36.000000000 -0500 +++ b/src/lmtp/commands.c 2014-01-28 18:15:01.011677816 -0500 @@ -387,7 +387,7 @@ return; domain = strchr(address, '@'); - p = strstr(address, client->unexpanded_lda_set->recipient_delimiter); + p = strpbrk(address, client->unexpanded_lda_set->recipient_delimiter); if (p != NULL && (domain == NULL || p < domain)) { /* user+detail at domain */ *username_r = t_strdup_until(*username_r, p); I would love for it though, to lookup and see if an mailbox exists with the delim first, then if it doesn't lookup just the username part. Quoting Andrew Ray : > Hi, > > It would be nice if the recipient_delimiter configuration option > supported multiple recipient delimiters as Postfix now does. > e.g. now if I set: recipient_delimiter = +- in Postfix, then > test-extension at sample.com and test+extension at sample.com are both > recognized. > But if I set: recipient_delimiter = +- in Dovecot, neither of the > above are recognized and instead test+-extension at sample.com is valid. > > Well, presently this feature isn't that important to me, but I > imagine it could be a source of confusion for people who are > migrating from say qmail to postfix (as I am doing) and notice > Postfix's cool ability to support both types of delimiters and > assume Dovecot will as well (as I did). > > Thanks, > Andrew Ray > > -- > > Andrew Ray > +1 404-418-5443 > +421 (0) 917 832 253 > http://guns.freedomlives.net/ From dovecot_list at greenant.net Wed Jan 29 03:26:09 2014 From: dovecot_list at greenant.net (Frank) Date: Wed, 29 Jan 2014 12:26:09 +1100 Subject: [Dovecot] post-login scripting failing with "denied access to user" v2.1.7 In-Reply-To: <52E69302.2030700@metaways.de> References: <52E69302.2030700@metaways.de> Message-ID: <61EC8FD0-EEEA-48B6-B1BF-18C32DB22A61@greenant.net> Thanks Daniel, That worked well. The default spam filter is now created properly. I have placed sieve filters in the parent directory of the Maildir, otherwise the .dovecot.sieve file is erroneously interpreted as a maildir by IMAP clients. The way I have used parent directories ($HOME/../) in the script results in a warning from manage sieve but I think it is harmless as the filter work fine: dovecot: managesieve(test at fqdn.net): Warning: sieve-storage: Active sieve script symlink /home/vmail/fqdn.net/test/Maildir/../.dovecot.sieve is broken: invalid/unknown path to storage (points to /home/vmail/fqdn.net/test/Maildir/../sieve/managesieve.sieve). Is there a way to suppress this warning? Frank On 28/01/2014, at 4:10 AM, Daniel Parthey wrote: > Hi Frank, > > Am 27.01.2014 07:57, schrieb Frank: >> After adding this setting, login fails and gives the error below. >> It certainly looks like a permission issue, but I have checked my script is executable and owned by vmail:vmail. The bash script executes fine as the mail user. >> The other possibility is that dovecot is denying access to the $HOME variable, but that seems unlikely. >> Nevertheless, I am stuck! >> >> Log shows: >> ------------------ >> dovecot: master: Dovecot v2.1.7 starting up (core dumps disabled) >> dovecot: auth-worker(17522): mysql(database1): Connected to database postfixadmin >> dovecot: imap-login: Login: user=, method=PLAIN, rip=10.0.3.120, lip=10.0.1.180, mpid=17524, TLS, session=<+blqxxxxxxxxxM> >> dovecot: imap(test2 at fqdn.net): Post-login script denied access to user test2 at fqdn.net > > http://wiki2.dovecot.org/PostLoginScripting > > You need to hand over the connection to the original imap handler, > your script may not simple exit, but needs to exec its argument line: > > exec "$@" > > Kind regards > Daniel > > -- > Dipl.-Inf. Daniel Parthey > System Engineer > Metaways Infosystems GmbH > Pickhuben 2, D-20457 Hamburg > > E-Mail: d.parthey at metaways.de > Web: http://www.metaways.de > > Metaways Infosystems GmbH - Sitz: D-22967 Tremsb?ttel > Handelsregister: Amtsgericht L?beck HRB 4508 AH > Gesch?ftsf?hrung: Hermann Thaele, L?der-H.Thaele From patrickdk at patrickdk.com Wed Jan 29 03:57:33 2014 From: patrickdk at patrickdk.com (Patrick Domack) Date: Tue, 28 Jan 2014 20:57:33 -0500 Subject: [Dovecot] recipient_delimiter -- feature request In-Reply-To: <20140128185132.Horde.FuySQ22ry1dZVuiKFz9PZQ1@mail.patrickdk.com> References: <52E81DC6.8060807@freedomlives.net> <20140128185132.Horde.FuySQ22ry1dZVuiKFz9PZQ1@mail.patrickdk.com> Message-ID: <20140128205733.Horde.neRy7Ruy-RaMh5ix59JlWg6@mail.patrickdk.com> Quoting Patrick Domack : > To make it work the current way, is simple. > > > > I would love for it though, to lookup and see if an mailbox exists > with the delim first, then if it doesn't lookup just the username > part. > > > Quoting Andrew Ray : > >> Hi, >> >> It would be nice if the recipient_delimiter configuration option >> supported multiple recipient delimiters as Postfix now does. >> e.g. now if I set: recipient_delimiter = +- in Postfix, then >> test-extension at sample.com and test+extension at sample.com are both >> recognized. >> But if I set: recipient_delimiter = +- in Dovecot, neither of the >> above are recognized and instead test+-extension at sample.com is valid. >> >> Well, presently this feature isn't that important to me, but I >> imagine it could be a source of confusion for people who are >> migrating from say qmail to postfix (as I am doing) and notice >> Postfix's cool ability to support both types of delimiters and >> assume Dovecot will as well (as I did). >> >> Thanks, >> Andrew Ray >> >> -- >> >> Andrew Ray >> +1 404-418-5443 >> +421 (0) 917 832 253 >> http://guns.freedomlives.net/ Well, to answer my own wishlist, this isn't by no means complete, as I only use lmtp, so I didn't bother to patch lda, but logins already worked good the way it was, so just needed lmtp to match with delim first, then try again without it. --- dovecot-2.2.10/src/lmtp/commands.c 2013-08-21 16:30:17.000000000 -0400 +++ dovecot-2.2.10/src/lmtp/commands.c 2014-01-28 20:18:12.303577376 -0500 @@ -387,7 +387,7 @@ return; domain = strchr(address, '@'); - p = strstr(address, client->unexpanded_lda_set->recipient_delimiter); + p = strpbrk(address, client->unexpanded_lda_set->recipient_delimiter); if (p != NULL && (domain == NULL || p < domain)) { /* user+detail at domain */ *username_r = t_strdup_until(*username_r, p); @@ -536,7 +536,7 @@ memset(&input, 0, sizeof(input)); input.module = input.service = "lmtp"; - input.username = username; + input.username = address; input.local_ip = client->local_ip; input.remote_ip = client->remote_ip; input.local_port = client->local_port; @@ -545,6 +545,16 @@ ret = mail_storage_service_lookup(storage_service, &input, &rcpt.service_user, &error); + if (ret<=0 && strlen(detail)>0) { + input.username = username; + ret = mail_storage_service_lookup(storage_service, &input, + &rcpt.service_user, &error); + } else if(ret>0) { + username=t_strdup(address); + if(strlen(detail)>0) + detail = ""; + } + if (ret < 0) { prefix = t_strdup_printf(ERRSTR_TEMP_USERDB_FAIL_PREFIX, username); From jtam.home at gmail.com Wed Jan 29 04:05:50 2014 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 28 Jan 2014 18:05:50 -0800 (PST) Subject: [Dovecot] Architecture for large Dovecot cluster In-Reply-To: References: Message-ID: >> Just a guess, but I expect the difference is because NetApp de-dupes >> by checksumming blocks and mark whole blocks as duplicates if they >> have the same checksum. > > True, the start of the message is always at byte 0, but because of > different header length per user for the same message (different mail > address with different lengths) the body will never start at the same > byte. Oh yes, that's right. I confused maildir format with sendmail queue files that separates header and body. There is still some similarlity for mass mailouts to the same mail domain: they will have almost identical headers +/- message IDs and a few bytes here and there, but as you say, SiS is the way to go for deduping bulky message attachments. Joseph Tam From alex at receptiveit.com.au Wed Jan 29 06:02:23 2014 From: alex at receptiveit.com.au (Alex Ferrara) Date: Wed, 29 Jan 2014 15:02:23 +1100 Subject: [Dovecot] Shared mailbox ACL In-Reply-To: References: Message-ID: <09821975-D9B2-4815-80DD-4474477FA064@receptiveit.com.au> On 28/01/2014, at 6:37 PM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 24 Jan 2014, Alex Ferrara wrote: > >> I have been able to get the inbox of the shared mailbox to appear in Thunderbird, but I would like to allow all subfolders to have the same ACLs. Is there a way to do this without having an ACL entry for each folder in the dovecot-acl file? > > No, currently you need one file per mailbox. Thanks for the pointer Steffen. Since I am migrating from an established Cyrus installation, I thought that I would be smart about this and make a little script. I have made the script available at the bottom of this message if anyone is interested. > >> I also cannot seem to create folders >> under the shared inbox. > > If the accessing user has the "k"-permission, there might be problems with the unix file permissions. Latter logs errors. I think I remember something that you cannot give ACLs to the top most root of some mail storages, e.g. in Maildir Maildir/dovecot-acl applies to the INBOX and there is no file for the "/" or something like that. Can you create a new mailbox below, say, the INBOX? This is still a problem for me. I can create folders on subfolders of the shared folder, but not under the shared folder itself. I have set "mail_shared_explicit_inbox = no" so the shared folder is the inbox. If I change "mail_shared_explicit_inbox = yes" then I can create folders underneath the inbox, but still not in the top level. Folders that are already there from the migration work fine. The current configuration I have does not have an inbox per shared mailbox, so I would prefer to replicate that if possible. I am a little unsure what to try next as I have turned on debug logging and there is no entry in the logs when I unsuccessfully try to create a folder under the top level. dupacl.sh #!/bin/bash IFS_BAK=$IFS IFS=" " MAILROOT='/mnt/mail/mailboxes' MAILUSER='vmail' MAILGROUP='vmail' SHAREDFILE='/etc/dovecot/shared-mailboxes' function usage { echo -e "Dovecot ACL tool\n" echo -e "The purpose of this tool is to clone the ACL of the inbox to all child folders\n" echo -e "$0 [ mailbox | -all | -new ]" exit 1 } function cloneacl { MAILBOX="$MAILROOT/$1/Maildir" ACLFILE="$MAILBOX/dovecot-acl" if [ -d "$MAILBOX" ]; then echo "Working on mailbox $1..." # Make sure we have an ACL file if [ -f "$ACLFILE" ]; then if [ "$2" == "-new" ]; then echo "Found ACL file in mailbox $1. Skipping" return fi else echo "ACL file does not exist. Creating one" echo "group=$1 lrwstipekxa" > "$ACLFILE" chown $MAILUSER:$MAILGROUP "$ACLFILE" fi # Copy the ACL file to sub directories for dir in `find $MAILBOX -type d -name ".*"`; do cp -av $MAILBOX/dovecot-acl "$dir/" done # Remove the dovecot-acl-list to make the mailboxes appear if [ -f "$ACLFILE-list" ]; then rm "$ACLFILE-list" fi else echo "Mailbox $1 does not exist" exit 1 fi } if [ "$1" == "-all" -o "$1" == "-new" ]; then SHARED=`grep shared/ "$SHAREDFILE" | cut -d / -f 4` for mailbox in $SHARED; do cloneacl $mailbox $1 done elif [ $1 ];then cloneacl $1 -single else usage fi IFS=$IFS_BAK IFS_BAK= From debian.roxx at gmail.com Wed Jan 29 09:31:53 2014 From: debian.roxx at gmail.com (Sylvain) Date: Wed, 29 Jan 2014 08:31:53 +0100 Subject: [Dovecot] Assertion failed with imapc after upgrading Dovecot from 2.1.7 to 2.2.9 In-Reply-To: References: Message-ID: Hi ! I would like to jump to version 2.2.9 instead of 2.1.7 to avoid maybe hundred of segfault by day but my problem with the assertion is always here. Anyone has an idea to resolve it ? Sylvain 2014-01-07 Sylvain > Hi ! > > I have an old Courier IMAP and in front of it, I have put a proxy cache > with Dovecot/imapc. > > I use Debian Wheezy (stable) which package Dovecot in version 2.1.7. > I have tested the upgrade to Debian Jessie (testing) which package Dovecot > in version 2.2.9 but an assertion is thrown : > > dovecot: imap(xxx): Panic: file imapc-list.c: line 499 > (imapc_list_delete_unused_indexes): assertion failed: (strncmp(vname, > fs_list->ns->prefix, fs_list->ns->prefix_len) == 0) > > I have checked source code and have seen that if *imapc_list_prefix* is > not set, assertion will not be "walked". It's works but special inbox > aren't detected correctly in email clients. > If I understand the meaning of *vname* variable, it is because our > Courier IMAP send us "INBOX" which is the value of my *imapc_list_prefix*and thus, assertion is thrown. > > Here some details of my tests : > > Courier IMAP : > > * OK [CAPABILITY IMAP4rev1 UIDPLUS CHILDREN NAMESPACE > THREAD=ORDEREDSUBJECT THREAD=REFERENCES SORT QUOTA IDLE ACL ACL2=UNION > STARTTLS] Courier-IMAP ready. Copyright 1998-2005 Double Precision, Inc. > See COPYING for distribution information. > a login xxx xxx > a OK LOGIN Ok. > a list "" "*" > * LIST (\HasNoChildren) "." "INBOX.Drafts" > * LIST (\HasNoChildren) "." "INBOX.Trash" > * LIST (\HasNoChildren) "." "INBOX.test" > * LIST (\HasNoChildren) "." "INBOX.Sent" > * LIST (\HasNoChildren) "." "INBOX.Junk" > * LIST (\Unmarked \HasChildren) "." "INBOX" > a OK LIST completed > > Dovecot version 2.1.7 : > > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > AUTH=PLAIN AUTH=LOGIN] Dovecot ready. > a login xxx xxx > a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT > CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC > ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE] > Logged in > a list "" "*" > * LIST (\HasChildren) "." "INBOX" > * LIST (\HasNoChildren \Drafts) "." "INBOX.Drafts" > * LIST (\HasNoChildren \Trash) "." "INBOX.Trash" > * LIST (\HasNoChildren) "." "INBOX.test" > * LIST (\HasNoChildren \Sent) "." "INBOX.Sent" > * LIST (\HasNoChildren \Junk) "." "INBOX.Junk" > a OK List completed. > > Dovecot version 2.2.9 : > > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. > a login xxx xxx > a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT > MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS > LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE] Logged in > a list "" "*" > Connection closed by foreign host. > > And the dovecot configuration relative to the inbox : > > imapc_list_prefix = INBOX > namespace inbox { > inbox = yes > separator = . > prefix = INBOX. > } > > Any help will be welcome :) > > Sylvain > From contact at toniob.net Wed Jan 29 10:09:31 2014 From: contact at toniob.net (Anthony Bourguignon) Date: Wed, 29 Jan 2014 09:09:31 +0100 Subject: [Dovecot] Auth socket can't listen using ssl In-Reply-To: References: <1390830415.6121.7.camel@anthony.lan.enovance.com> <20140127120804.32a3f6c5@mydesk> <1390901535.4500.2.camel@anthony.lan.enovance.com> Message-ID: <1390982971.2268.3.camel@anthony.lan.enovance.com> Le Tuesday 28 January 2014 ? 11:28 +0100, Steffen Kaiser a ?crit : > On Tue, 28 Jan 2014, Anthony Bourguignon wrote: > > > Le Monday 27 January 2014 ? 12:08 -0500, Steve Litt a ?crit : > >> I read in some docs somewhere that Dovecot automatically > >> trusts anything on localhost. If you're telnetting into it from the same > >> physical computer that hosts the port, try telnetting into it from a > >> different physical computer with a different IP address and see if you > >> can still telnet in. > > > > I've tried from localhost and another computer. In both tries, the > > connection is made without ssl. > > Hmm, maybe "internal" sockets do not utilize SSL at all? Just > IMAP/POP/ManageSieve? > Maybe. I don't know. But that's cleary an issue. I'm trying to use dovecot authentication as a backend for prosody (a xmpp server). Dovecot and prosody are not on the same host. Sending my password in cleartext on the network is not a good option according to me ;) . Thanks From skdovecot at smail.inf.fh-brs.de Wed Jan 29 10:13:41 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 29 Jan 2014 09:13:41 +0100 (CET) Subject: [Dovecot] Auth socket can't listen using ssl In-Reply-To: <1390982971.2268.3.camel@anthony.lan.enovance.com> References: <1390830415.6121.7.camel@anthony.lan.enovance.com> <20140127120804.32a3f6c5@mydesk> <1390901535.4500.2.camel@anthony.lan.enovance.com> <1390982971.2268.3.camel@anthony.lan.enovance.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 29 Jan 2014, Anthony Bourguignon wrote: >>> I've tried from localhost and another computer. In both tries, the >>> connection is made without ssl. >> >> Hmm, maybe "internal" sockets do not utilize SSL at all? Just >> IMAP/POP/ManageSieve? >> > > Maybe. I don't know. > But that's cleary an issue. I'm trying to use dovecot authentication as > a backend for prosody (a xmpp server). Dovecot and prosody are not on > the same host. Sending my password in cleartext on the network is not a > good option according to me ;) . The work around would be to use stunnel or something like that. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUui4NXD1/YhP6VMHAQKo2Af/dK9DMgie7HX1R5JLxA6XpD+BA8f4MtSB Qmq43Ed+NfeJCU5E514FwVXPcWa4SCtxk79KsmkyL/QSiyXWNuyBCvum7Y6YaDSK VCCEQ2BayIKsOfyrj2E2jNphJ34FbV3QTdUNd+1+hd7pLGb93tlg5xtqAX2tjoks XOWl+CcWNBkv17DOVGQWAvxyhWbg0cGvTYGzPyLbCdY7qHuZdL8118ZZCNbJe00f R2xlOiHuxSelOG8HrlfwE3iF3C7JtTmmi/eK6hRZsppQwCrpX6nSOVENYZ1S5EJg og44E3KM7RkJo1sPGYy5/Ed0uvSl/M+6BHIRv28ZNtIkYW+HCmUGUQ== =2OmW -----END PGP SIGNATURE----- From contact at toniob.net Wed Jan 29 10:43:52 2014 From: contact at toniob.net (Anthony Bourguignon) Date: Wed, 29 Jan 2014 09:43:52 +0100 Subject: [Dovecot] Auth socket can't listen using ssl In-Reply-To: References: <1390830415.6121.7.camel@anthony.lan.enovance.com> <20140127120804.32a3f6c5@mydesk> <1390901535.4500.2.camel@anthony.lan.enovance.com> <1390982971.2268.3.camel@anthony.lan.enovance.com> Message-ID: <1390985032.2268.8.camel@anthony.lan.enovance.com> Le Wednesday 29 January 2014 ? 09:13 +0100, Steffen Kaiser a ?crit : > The work around would be to use stunnel or something like that. That's what I just did but it's a hack. If the option is available in the configuration, it should work. From asai at globalchangemusic.org Wed Jan 29 17:27:26 2014 From: asai at globalchangemusic.org (Asai) Date: Wed, 29 Jan 2014 08:27:26 -0700 Subject: [Dovecot] Dsync Errors In-Reply-To: <52E3ACDD.6000607@Media-Brokers.com> References: <52E28C13.4030207@globalchangemusic.org> <52E3ACDD.6000607@Media-Brokers.com> Message-ID: <52E91DDE.4060601@globalchangemusic.org> > The first thing to do when experiencing problems like this is make > sure you are on the current version of whatever point release you are > running. In your case that would be 2.2.10. Then if you still > experience the problem, come back and re-ask... > OK, I upgraded to 2.2.10. Same thing. Is there some kind of debug routine I can run? From msmith at datafoundry.com Wed Jan 29 20:03:50 2014 From: msmith at datafoundry.com (Michael Smith (DF)) Date: Wed, 29 Jan 2014 18:03:50 +0000 Subject: [Dovecot] dsync backup; compressed to uncompressed Message-ID: I need to backup some of the mailboxes on our system. We are currently using mdbox with zlib compression plugin. The backups need to be maildir without compression. How can I accomplish this using dsync? The following just causes each msg file in maildir to be compressed as well. dsync -f -u user1 backup maildir:/var/tmp/user1 While this just causes the dsync to fail while spewing a bunch of errors because it can no longer read the compressed mdbox files. dsync -f -u user1 -o mail_plugins= backup maildir:/var/tmp/user1 # doveconf -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = domain1.net auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = References: Message-ID: Ok, I think I found an answer. I don't know if it's the right one... I duplicated my dovecot.conf to backup.conf. I then removed this part from plugin {} zlib_save = gz zlib_save_level = 9 I then add "-c backup.conf" to my dsync command. This appears to allow dsync to read the compressed mdbox accounts, but when it writes the backup in maildir format, everything is uncompressed. -----Original Message----- From: dovecot-bounces at dovecot.org [mailto:dovecot-bounces at dovecot.org] On Behalf Of Michael Smith (DF) Sent: Wednesday, January 29, 2014 12:04 PM To: 'dovecot at dovecot.org' Subject: [Dovecot] dsync backup; compressed to uncompressed I need to backup some of the mailboxes on our system. We are currently using mdbox with zlib compression plugin. The backups need to be maildir without compression. How can I accomplish this using dsync? The following just causes each msg file in maildir to be compressed as well. dsync -f -u user1 backup maildir:/var/tmp/user1 While this just causes the dsync to fail while spewing a bunch of errors because it can no longer read the compressed mdbox files. dsync -f -u user1 -o mail_plugins= backup maildir:/var/tmp/user1 # doveconf -n # 2.2.4: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) auth_debug = yes auth_debug_passwords = yes auth_default_realm = domain1.net auth_master_user_separator = * auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain debug_log_path = /var/log/dovecot-debug.log disable_plaintext_auth = no dotlock_use_excl = no lda_mailbox_autocreate = yes lock_method = dotlock mail_access_groups = mail mail_debug = yes mail_fsync = always mail_location = mdbox:~/mail:INDEX=~/index mail_plugins = quota zlib mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_read_locks = dotlock mbox_write_locks = dotlock mdbox_rotate_interval = 1 weeks mdbox_rotate_size = 20 M mmap_disable = yes namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { autosubscribe = Trash autosubscribe2 = Junk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = INBOX mail_max_userip_connections = 10 managesieve_max_line_length = 65536 quota = dict:User quota::file:%h/dovecot.quota quota2_rule = Trash:storage=+10%% quota3_rule = Junk:storage=+20%% quota_rule = *:storage=100M:messages=100000 recipient_delimiter = + sieve_before = /var/opt/mail/global.sieve/ zlib_save = gz zlib_save_level = 9 } pop3_reuse_xuidl = yes protocols = imap pop3 sieve lmtp service auth { inet_listener auth { port = 113 } unix_listener auth-userdb { user = nobody } } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 10 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } ssl = no ssl_cert = Hi. mail_log_events is nice addition but how to log who exactly triggered particular event? For example 5 users from 5 IP addresses uses single imap user/mailbox. One of them deletes email and I'm logging delete related events. The only logged thing is: dovecot: imap(user): delete: box=INBOX, uid=673287, msgid=, size=1230 which tells me nothing about who triggered it actually (note all 5 users were logged in at deletion time) How to solve this problem? Thanks, -- Arkadiusz Mi?kiewicz, arekm / maven.pl From h.reindl at thelounge.net Thu Jan 30 12:11:32 2014 From: h.reindl at thelounge.net (Reindl Harald) Date: Thu, 30 Jan 2014 11:11:32 +0100 Subject: [Dovecot] mail_log_events, but who exactly triggered events? In-Reply-To: <201401301050.54809.arekm@maven.pl> References: <201401301050.54809.arekm@maven.pl> Message-ID: <52EA2554.5020707@thelounge.net> Am 30.01.2014 10:50, schrieb Arkadiusz Mi?kiewicz: > mail_log_events is nice addition but how to log who exactly triggered > particular event? For example 5 users from 5 IP addresses uses single imap > user/mailbox. > > One of them deletes email and I'm logging delete related events. The only > logged thing is: > > dovecot: imap(user): delete: box=INBOX, uid=673287, msgid=, > size=1230 > > which tells me nothing about who triggered it actually (note all 5 users were > logged in at deletion time) > > How to solve this problem? do not share user-logins don't do that for any service, not only mail that's why ACL / shared mailboxes exists because in that case you have the unique username in the logs instead always the same one -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From tlx at leuxner.net Thu Jan 30 12:23:15 2014 From: tlx at leuxner.net (Thomas Leuxner) Date: Thu, 30 Jan 2014 11:23:15 +0100 Subject: [Dovecot] New global ACL mailbox pattern feature in HG In-Reply-To: <20140128072932.GA27627@nihlus.leuxner.net> References: <20140128072932.GA27627@nihlus.leuxner.net> Message-ID: <20140130102315.GA21185@nihlus.leuxner.net> * Thomas Leuxner 2014.01.28 08:29: > $ cat global-acl > INBOX owner lrwstiekxap > Public* group=PublicMailboxAdmins lrwsik Following up on this, there seems to be an issue with separators. Mailbox creation crashes, while it used to work fine with the same configuration w/o the 'global-acl' file. Interestingly enough same syntax works for the public namespace (e.g. "mailbox create -u tlx at leuxner.net Public/Test" ): $ doveadm acl get -u tlx at leuxner.net INBOX ID Global Rights owner admin create delete expunge insert lookup post read write write-deleted write-seen $ doveadm mailbox create -u tlx at leuxner.net "Shops/Test" doveadm(tlx at leuxner.net): Panic: file acl-global-file.c: line 163 (acl_global_file_find_rights): assertion failed: (file->last_refresh_time != 0) doveadm(tlx at leuxner.net): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6b34f) [0x7f7de43bf34f] -> /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f7de43bf42a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7de4378e8e] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(+0xc692) [0x7f7de3799692] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(acl_global_file_have_any+0x1a) [0x7f7de3799bfa] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(+0x9f92) [0x7f7de3796f92] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(acl_mailbox_list_have_right+0xed) [0x7f7de379c44d] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(+0xda69) [0x7f7de379aa69] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x93027) [0x7f7de46bc027] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_create+0x38) [0x7f7de46aa048] -> doveadm() [0x418124] -> doveadm() [0x41358d] -> doveadm(doveadm_mail_try_run+0x251) [0x414251] -> doveadm(main+0x3c8) [0x413138] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f7de3fe8ead] -> doveadm() [0x413351] Aborted namespace { list = yes location = mdbox:/var/vmail/public:INDEXPVT=~/mdbox/public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: From arekm at maven.pl Thu Jan 30 13:04:00 2014 From: arekm at maven.pl (Arkadiusz =?utf-8?q?Mi=C5=9Bkiewicz?=) Date: Thu, 30 Jan 2014 12:04:00 +0100 Subject: [Dovecot] mail_log_events, but who exactly triggered events? In-Reply-To: <52EA2554.5020707@thelounge.net> References: <201401301050.54809.arekm@maven.pl> <52EA2554.5020707@thelounge.net> Message-ID: <201401301204.00493.arekm@maven.pl> On Thursday 30 of January 2014, Reindl Harald wrote: > Am 30.01.2014 10:50, schrieb Arkadiusz Mi?kiewicz: > > mail_log_events is nice addition but how to log who exactly triggered > > particular event? For example 5 users from 5 IP addresses uses single > > imap user/mailbox. > > > > One of them deletes email and I'm logging delete related events. The only > > logged thing is: > > > > dovecot: imap(user): delete: box=INBOX, uid=673287, msgid=, > > size=1230 > > > > which tells me nothing about who triggered it actually (note all 5 users > > were logged in at deletion time) > > > > How to solve this problem? > > do not share user-logins I'm not sharing. Customers are. > don't do that for any service, not only mail That impossible to make. Customer creates login "abc" on my server and gives it to 10 employees to watch that mailbox. 10 employees log in to that single accound and do some actions. One of them is "bad" and deletes important mail. I want to be able to figure which one. I have no control over customers. Also I see no sensible reason to disallow such work style. > that's why ACL / shared mailboxes exists because in that case > you have the unique username in the logs instead always the > same one When customers log in: dovecot: pop3-login: Login: user=, method=PLAIN, rip=xxx, lip=yyy, mpid=11680, session= dovecot: imap-login: Login: user=, method=PLAIN, rip=aaa, lip=yyy, mpid=11682, TLS, session= session id is logged. Now how to get that id logged in mail_log_events lines? -- Arkadiusz Mi?kiewicz, arekm / maven.pl From itgeek31 at googlemail.com Thu Jan 30 13:23:24 2014 From: itgeek31 at googlemail.com (IT geek 31) Date: Thu, 30 Jan 2014 12:23:24 +0100 Subject: [Dovecot] Is replication broken? Message-ID: Hi, Apologies for this being my 248th post about replication... The current error I'm getting is: Jan 30 12:10:54 Server1 dovecot: dsync-local(MailUser1): Error: dsync( Server2.test.com): read() failed: read((fd)) failed: Connection reset by peer Subsequent errors are: Jan 30 12:15:47 Server1 dovecot: dsync-local(MailUser1): Error: read( Server2.test.com) failed: EOF The above error is seen on Server1, after the initial sync completes of the first mailbox (Sent folder to be precise). Does anyone have an ideas as to what might be causing it? These are brand new rebuilds, running the latest build - I just can't seem to get this working. Bug maybe? Configs are as follows: Server1: # 2.2.10: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.2 cobalt auth_mechanisms = plain login doveadm_password = secret doveadm_port = 12345 first_valid_uid = 1003 last_valid_uid = 1020 listen = 192.168.1.1 login_greeting = test.com mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_plugins = " notify replication" passdb { driver = passwd } plugin { mail_replica = tcp:Server2.test.com } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { inet_listener imap { port = 0 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_cert = References: <201401301050.54809.arekm@maven.pl> <52EA2554.5020707@thelounge.net> <201401301204.00493.arekm@maven.pl> Message-ID: <52EA36B5.1010008@thelounge.net> Am 30.01.2014 12:04, schrieb Arkadiusz Mi?kiewicz: > On Thursday 30 of January 2014, Reindl Harald wrote: >> Am 30.01.2014 10:50, schrieb Arkadiusz Mi?kiewicz: >>> mail_log_events is nice addition but how to log who exactly triggered >>> particular event? For example 5 users from 5 IP addresses uses single >>> imap user/mailbox. >>> >>> One of them deletes email and I'm logging delete related events. The only >>> logged thing is: >>> >>> dovecot: imap(user): delete: box=INBOX, uid=673287, msgid=, >>> size=1230 >>> >>> which tells me nothing about who triggered it actually (note all 5 users >>> were logged in at deletion time) >>> >>> How to solve this problem? >> >> do not share user-logins > > I'm not sharing. Customers are. > >> don't do that for any service, not only mail > > That impossible to make. > > Customer creates login "abc" on my server and gives it to 10 employees to > watch that mailbox. > > 10 employees log in to that single accound and do some actions. One of them is > "bad" and deletes important mail. I want to be able to figure which one. > > I have no control over customers. Also I see no sensible reason to disallow > such work style than your answer to them is simply "i can't tell who did what" as long they insist on that work style - how is that your problem? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 246 bytes Desc: OpenPGP digital signature URL: From skdovecot at smail.inf.fh-brs.de Thu Jan 30 13:45:57 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 30 Jan 2014 12:45:57 +0100 (CET) Subject: [Dovecot] mail_log_events, but who exactly triggered events? In-Reply-To: <52EA36B5.1010008@thelounge.net> References: <201401301050.54809.arekm@maven.pl> <52EA2554.5020707@thelounge.net> <201401301204.00493.arekm@maven.pl> <52EA36B5.1010008@thelounge.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 30 Jan 2014, Reindl Harald wrote: > Am 30.01.2014 12:04, schrieb Arkadiusz Mi?kiewicz: >> On Thursday 30 of January 2014, Reindl Harald wrote: >>> Am 30.01.2014 10:50, schrieb Arkadiusz Mi?kiewicz: >>>> mail_log_events is nice addition but how to log who exactly triggered >>>> particular event? For example 5 users from 5 IP addresses uses single >>>> imap user/mailbox. >>>> >>>> One of them deletes email and I'm logging delete related events. The only >>>> logged thing is: >>>> >>>> dovecot: imap(user): delete: box=INBOX, uid=673287, msgid=, >>>> size=1230 >>>> >>>> which tells me nothing about who triggered it actually (note all 5 users >>>> were logged in at deletion time) >>>> >>>> How to solve this problem? >>> >>> do not share user-logins >> >> I'm not sharing. Customers are. >> >>> don't do that for any service, not only mail >> >> That impossible to make. >> >> Customer creates login "abc" on my server and gives it to 10 employees to >> watch that mailbox. >> >> 10 employees log in to that single accound and do some actions. One of them is >> "bad" and deletes important mail. I want to be able to figure which one. >> >> I have no control over customers. Also I see no sensible reason to disallow >> such work style > > than your answer to them is simply "i can't tell who did what" as long > they insist on that work style - how is that your problem? (Y) @Arkadiusz, please tell us, if 10 people use the same account name and password, how would you as a server behind the internet with a human brain differ those 10 individuals? The only idea I, personally, have is the IP address: Do they connect from different IP addresses _all_ the time? No NAT involved? Do you know who uses which IP address _all_ the time? If so, Dovecot logs the IP address during login and you can associate a PID with an IP address, IMHO you can add the remote IP address to the log string. Check out the variables page in the Wiki. But, frankly, _if_ you have someone, who is >>"bad" and deletes important mail<<, you should see >>sensible reason to disallow such work style<<. The next time you see yet another IP address and don't know the user again. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUuo7dXD1/YhP6VMHAQJdBAf8CEvum1A4mZsCj2I1bJbEalvNupHJl6UQ SwXmpXa42ldOcg5UDbUG6Xy/PyBzHjGGwFsCA6feFBwDoigM9M0kXJNFw5gfrmk5 cUzAQVEMHGrWNDD/fj9I/7JmBds8/bO7sziPPwwnNtlzva98dwG9RlNdFF09+FcR TxHq9q8RRgFtWKvh0LtmIcGdJ3+YDTA4I/pZKGKeVXLnsb8+4f1Ep0W2PSMg75Dy nZ82+CKTwgzROrCMEdAFhIYJTJMDmVd939539Dexp94KsuPhkIKEF59q4NOfvZ0V OLiymyCGf3DgeCySxONU/E55ihD3RTQX3wmNk10rNOPAKD3Tg4kP0g== =6ok/ -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Thu Jan 30 13:52:36 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 30 Jan 2014 12:52:36 +0100 (CET) Subject: [Dovecot] Is replication broken? In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 30 Jan 2014, IT geek 31 wrote: > Apologies for this being my 248th post about replication... > > The current error I'm getting is: > > Jan 30 12:10:54 Server1 dovecot: dsync-local(MailUser1): Error: dsync( > Server2.test.com): read() failed: read((fd)) failed: Connection reset by > peer this is a generic network error: http://stackoverflow.com/questions/1434451/what-does-connection-reset-by-peer-mean The other side of the communication channel closed the connection. It also does not neccessarily mean that other end point did it, but it could be a firewall, router, whatever in between as well. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUuo9BHD1/YhP6VMHAQLnZgf+LZPlLEvqf1RKui2tf3/a6w1u5pk9E0I2 k9fy4GRGCLQzrEhr0X2ayCyZmr6gLrfcqB1txwrlNw/YfZ/TpQwVIfCwQZOiDw49 Yr2sPP8tZtWqX4Ebk4L0577m9kscG3Hf2vWEP+t/m9RDUztGAEUweZvmMYOazk1p J5RQI1iAA0AnJesRL89xHv3c9cjCFCMrNs6V0nWpa+bPYbntq5NHB2nESZaifjWL 5dAMOevek/P0QGFrkHA1cLAaOe7qtJwdkOZ8eShXaIm+qPtrsSTZdSsi0dzC4DgU 612St0YTcfpcLnkYBLV14HlcuGaUA33kEnRt/ICVvE5fNRLyHrCFlA== =WeHN -----END PGP SIGNATURE----- From itgeek31 at googlemail.com Thu Jan 30 13:56:10 2014 From: itgeek31 at googlemail.com (IT geek 31) Date: Thu, 30 Jan 2014 12:56:10 +0100 Subject: [Dovecot] Is replication broken? In-Reply-To: References: Message-ID: Hi Steffen, Thanks for getting back to me. Do you know why I am now getting: Jan 30 12:50:43 Server1 dovecot: dsync-local(MailUser1): Error: read( Server2.test.com) failed: EOF Thanks, On 30 January 2014 12:52, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 30 Jan 2014, IT geek 31 wrote: > > Apologies for this being my 248th post about replication... >> >> The current error I'm getting is: >> >> Jan 30 12:10:54 Server1 dovecot: dsync-local(MailUser1): Error: dsync( >> Server2.test.com): read() failed: read((fd)) failed: Connection reset by >> peer >> > > this is a generic network error: > http://stackoverflow.com/questions/1434451/what-does- > connection-reset-by-peer-mean > > The other side of the communication channel closed the connection. It also > does not neccessarily mean that other end point did it, but it could be a > firewall, router, whatever in between as well. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUuo9BHD1/YhP6VMHAQLnZgf+LZPlLEvqf1RKui2tf3/a6w1u5pk9E0I2 > k9fy4GRGCLQzrEhr0X2ayCyZmr6gLrfcqB1txwrlNw/YfZ/TpQwVIfCwQZOiDw49 > Yr2sPP8tZtWqX4Ebk4L0577m9kscG3Hf2vWEP+t/m9RDUztGAEUweZvmMYOazk1p > J5RQI1iAA0AnJesRL89xHv3c9cjCFCMrNs6V0nWpa+bPYbntq5NHB2nESZaifjWL > 5dAMOevek/P0QGFrkHA1cLAaOe7qtJwdkOZ8eShXaIm+qPtrsSTZdSsi0dzC4DgU > 612St0YTcfpcLnkYBLV14HlcuGaUA33kEnRt/ICVvE5fNRLyHrCFlA== > =WeHN > -----END PGP SIGNATURE----- > From skdovecot at smail.inf.fh-brs.de Thu Jan 30 15:29:33 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 30 Jan 2014 14:29:33 +0100 (CET) Subject: [Dovecot] Is replication broken? In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 30 Jan 2014, IT geek 31 wrote: > On 30 January 2014 12:52, Steffen Kaiser wrote: > >> On Thu, 30 Jan 2014, IT geek 31 wrote: >> >> Apologies for this being my 248th post about replication... >>> >>> The current error I'm getting is: >>> >>> Jan 30 12:10:54 Server1 dovecot: dsync-local(MailUser1): Error: dsync( >>> Server2.test.com): read() failed: read((fd)) failed: Connection reset by >>> peer >>> >> >> this is a generic network error: >> http://stackoverflow.com/questions/1434451/what-does- >> connection-reset-by-peer-mean >> >> The other side of the communication channel closed the connection. It also >> does not neccessarily mean that other end point did it, but it could be a >> firewall, router, whatever in between as well. >> > Do you know why I am now getting: > > > Jan 30 12:50:43 Server1 dovecot: dsync-local(MailUser1): Error: read( > Server2.test.com) failed: EOF First you get "Connection reset by peer", the system closes the file descriptot, Dovecot reads further from the handle and gets EOF. It's a subsequent error, IMHO. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUupTvXD1/YhP6VMHAQJxAggAyeX8kLK1AaoTsGPzIFfVW9GZKKF/eMpT kgzL1UlY86ht0N3c2mvcOLBqjV15QSjNLaAV7wN4wPflMeescLScPUga21hrKKJV 077T8ggLZE8Du6qTrkGej48/g6SdE/ZuyKiG/h/7s9OcdHJXHSIaqzVL7i+SNRmp g0lo2n0axIk9M1mLLHw3SbbKEN1kDcrOGtdqh2Pl2wohLWNTJ+ZN1YpcBzJgOlq2 hIQeuVqvUXHLP8/S7CFngPVeZM+Kxr12HpOOt95/eqf4VEhyF1C1KXFVUXMbGkfX +6bifTBkoGIzwznGHOIsigmJWrk9a7RM0rk5stFLvyGfdjxyN0VYCg== =HOzr -----END PGP SIGNATURE----- From itgeek31 at googlemail.com Thu Jan 30 15:31:57 2014 From: itgeek31 at googlemail.com (IT geek 31) Date: Thu, 30 Jan 2014 14:31:57 +0100 Subject: [Dovecot] Is replication broken? In-Reply-To: References: Message-ID: Okay.. so how do I fix it? :-) Here are the errors on the remote server (the last two are a different mailbox!): Jan 30 13:25:16 Server2 dovecot: dsync-server(MailUser1): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Jan 30 13:25:16 Server2 dovecot: dsync-server(MailUser1): Fatal: master: service(doveadm): child 26627 killed with signal 6 (core not dumped - set service doveadm { drop_priv_before_exec=yes }) Jan 30 13:25:17 Server2 dovecot: dsync-server(MailUser2): Error: net_connect_unix(/var/run/dovecot/replicator-doveadm) failed: Permission denied Jan 30 13:25:51 Server2 dovecot: dsync-server(MailUser2): Error: Sync failed for mbox file /var/mail/mark: UID inserted in the middle of mailbox (334045 > 328601, seq=8220, idx_msgs=16554) Any help is appreciated. On 30 January 2014 14:29, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 30 Jan 2014, IT geek 31 wrote: > > On 30 January 2014 12:52, Steffen Kaiser > >wrote: >> >> On Thu, 30 Jan 2014, IT geek 31 wrote: >>> >>> Apologies for this being my 248th post about replication... >>> >>>> >>>> The current error I'm getting is: >>>> >>>> Jan 30 12:10:54 Server1 dovecot: dsync-local(MailUser1): Error: dsync( >>>> Server2.test.com): read() failed: read((fd)) failed: Connection reset >>>> by >>>> peer >>>> >>>> >>> this is a generic network error: >>> http://stackoverflow.com/questions/1434451/what-does- >>> connection-reset-by-peer-mean >>> >>> The other side of the communication channel closed the connection. It >>> also >>> does not neccessarily mean that other end point did it, but it could be a >>> firewall, router, whatever in between as well. >>> >>> Do you know why I am now getting: >> >> >> Jan 30 12:50:43 Server1 dovecot: dsync-local(MailUser1): Error: read( >> Server2.test.com) failed: EOF >> > > First you get "Connection reset by peer", the system closes the file > descriptot, Dovecot reads further from the handle and gets EOF. It's a > subsequent error, IMHO. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.11 (GNU/Linux) > > iQEVAwUBUupTvXD1/YhP6VMHAQJxAggAyeX8kLK1AaoTsGPzIFfVW9GZKKF/eMpT > kgzL1UlY86ht0N3c2mvcOLBqjV15QSjNLaAV7wN4wPflMeescLScPUga21hrKKJV > 077T8ggLZE8Du6qTrkGej48/g6SdE/ZuyKiG/h/7s9OcdHJXHSIaqzVL7i+SNRmp > g0lo2n0axIk9M1mLLHw3SbbKEN1kDcrOGtdqh2Pl2wohLWNTJ+ZN1YpcBzJgOlq2 > hIQeuVqvUXHLP8/S7CFngPVeZM+Kxr12HpOOt95/eqf4VEhyF1C1KXFVUXMbGkfX > +6bifTBkoGIzwznGHOIsigmJWrk9a7RM0rk5stFLvyGfdjxyN0VYCg== > =HOzr > -----END PGP SIGNATURE----- > From skdovecot at smail.inf.fh-brs.de Thu Jan 30 16:02:24 2014 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 30 Jan 2014 15:02:24 +0100 (CET) Subject: [Dovecot] Is replication broken? In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 30 Jan 2014, IT geek 31 wrote: > Here are the errors on the remote server (the last two are a different > mailbox!): > > Jan 30 13:25:16 Server2 dovecot: dsync-server(MailUser1): Panic: file > mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK > || mbox->mbox_lock_type != F_RDLCK) > > Jan 30 13:25:16 Server2 dovecot: dsync-server(MailUser1): Fatal: master: > service(doveadm): child 26627 killed with signal 6 (core not dumped - set > service doveadm { drop_priv_before_exec=yes }) follow the advice, set ulimit -c unlimited, get a core dump, then gdb /usr/.../binary core bt full post the output and use some subject line, e.g. dsync-server(MailUser1): Panic: file mbox-lock.c: line 799 with coredump to get Timos attension, that you have information for the panic. > Any help is appreciated. provide Timo any information about the core dump, give it an useful title, e.g. "BUG Panic: file mbox-lock.c: with backtrace" to catch his attention during his busy phases of work. Bumping the subject is not useful. I found only this: http://thr3ads.net/dovecot/2013/05/2645571-dsync-assert-failure-in-2.2.2 which says "Appears to work properly again in 2.2.4.". > On 30 January 2014 14:29, Steffen Kaiser wrote: > >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Thu, 30 Jan 2014, IT geek 31 wrote: >> >> On 30 January 2014 12:52, Steffen Kaiser >>> wrote: >>> >>> On Thu, 30 Jan 2014, IT geek 31 wrote: >>>> >>>> Apologies for this being my 248th post about replication... >>>> >>>>> >>>>> The current error I'm getting is: >>>>> >>>>> Jan 30 12:10:54 Server1 dovecot: dsync-local(MailUser1): Error: dsync( >>>>> Server2.test.com): read() failed: read((fd)) failed: Connection reset >>>>> by >>>>> peer >>>>> >>>>> >>>> this is a generic network error: >>>> http://stackoverflow.com/questions/1434451/what-does- >>>> connection-reset-by-peer-mean >>>> >>>> The other side of the communication channel closed the connection. It >>>> also >>>> does not neccessarily mean that other end point did it, but it could be a >>>> firewall, router, whatever in between as well. >>>> >>>> Do you know why I am now getting: >>> >>> >>> Jan 30 12:50:43 Server1 dovecot: dsync-local(MailUser1): Error: read( >>> Server2.test.com) failed: EOF >>> >> >> First you get "Connection reset by peer", the system closes the file >> descriptot, Dovecot reads further from the handle and gets EOF. It's a >> subsequent error, IMHO. >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1.4.11 (GNU/Linux) >> >> iQEVAwUBUupTvXD1/YhP6VMHAQJxAggAyeX8kLK1AaoTsGPzIFfVW9GZKKF/eMpT >> kgzL1UlY86ht0N3c2mvcOLBqjV15QSjNLaAV7wN4wPflMeescLScPUga21hrKKJV >> 077T8ggLZE8Du6qTrkGej48/g6SdE/ZuyKiG/h/7s9OcdHJXHSIaqzVL7i+SNRmp >> g0lo2n0axIk9M1mLLHw3SbbKEN1kDcrOGtdqh2Pl2wohLWNTJ+ZN1YpcBzJgOlq2 >> hIQeuVqvUXHLP8/S7CFngPVeZM+Kxr12HpOOt95/eqf4VEhyF1C1KXFVUXMbGkfX >> +6bifTBkoGIzwznGHOIsigmJWrk9a7RM0rk5stFLvyGfdjxyN0VYCg== >> =HOzr >> -----END PGP SIGNATURE----- >> > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBUupbcXD1/YhP6VMHAQIPvwgAt/vLcy5rW9CuUIWuePrK4X3lr9930YM4 A1gs57G++lLEWkJAYN5uxQ/rODbluAq+7yXfR6HUoeOQu+ZCuxIjSnG5Dqo9iwYE eJudAOs7oJIEBASfv3EaYtCCh44M8sZ6u+Y0+VFnNUbpqmr2hQn+OL67srsqnCFQ J3xFEHFvdyLK8QrIhtMucSYh6KwmmPjKRNCy6/L71aq7ZCEfG0UR55gnv7XQ/BDF kfTaC1pRUcZImO2WyTDwD8jXFjIhoH5bBiEbh7z2EKoKborpLK/hnSSpLvfhBZwf A09Ep4fXP/wFmXuDsbrWyc4BZVl1a76Nq21IOPtTL5foP8SjALQHRg== =PxdB -----END PGP SIGNATURE----- From asai at globalchangemusic.org Thu Jan 30 18:06:30 2014 From: asai at globalchangemusic.org (Asai) Date: Thu, 30 Jan 2014 09:06:30 -0700 Subject: [Dovecot] Dsync Errors In-Reply-To: <52E3ACDD.6000607@Media-Brokers.com> References: <52E28C13.4030207@globalchangemusic.org> <52E3ACDD.6000607@Media-Brokers.com> Message-ID: <52EA7886.2040908@globalchangemusic.org> Maybe this error sheds some light on it: Panic: file dsync-brain-mailbox-tree-sync.c: line 111 (dsync_brain_mailbox_tree_sync_change): assertion failed: (brain->no_backup_overwrite) From asai at globalchangemusic.org Thu Jan 30 18:09:02 2014 From: asai at globalchangemusic.org (Asai) Date: Thu, 30 Jan 2014 09:09:02 -0700 Subject: [Dovecot] Dsync Errors In-Reply-To: <52E3ACDD.6000607@Media-Brokers.com> References: <52E28C13.4030207@globalchangemusic.org> <52E3ACDD.6000607@Media-Brokers.com> Message-ID: <52EA791E.6000207@globalchangemusic.org> I see Timo addressed this problem with this reply ( from thread "[Dovecot] reproducible dsync backup panic (dovecot 2.2.7)/Fri Dec 20 00:37:21 EET 2013")/, but basically I don't understand how to go about doing this: Can you get it to dump core and use gdb /usr/bin/doveadm core bt full fr 5 p *change >/ The command I'm using to back up individual user's mail is something like: />/ />/ sudo -u vmail dsync -v -uuser at server.com -R backup ssh -i sshid-filelogin at server.com sudo -u vmail dsync -v -uuser at server.com / Probably an easier way would be if you could copy the local and remote mdboxes to e.g. /tmp/mdbox-local and /tmp/mdbox-remote. Then you should be able to do: gdb --args doveadm -o mail=mdbox:/tmp/mdbox-local backup -R mdbox:/tmp/mdbox-remote run bt full fr 5 p *change From fernando.figaro at uol.com.br Thu Jan 30 23:30:02 2014 From: fernando.figaro at uol.com.br (fernando.figaro at uol.com.br) Date: Thu, 30 Jan 2014 19:30:02 -0200 Subject: [Dovecot] possible quota bug ? In-Reply-To: 52d6c12d677f0_6aff11311301288@a4-weasel5.tmail References: 52d6c12d677f0_6aff11311301288@a4-weasel5.tmail Message-ID: <52eac45a9cc88_4ee222883073570@a4-weasel3.mail> I was researching deeper this issue, activated debug logs and when I move a message from one folder to another the message size is different Jan 30 18:48:07 imap(xxx at xxx): Info: copy from INBOX: box=INBOX.Sent, uid=17, msgid=<5520ed0fedee4e3386d08c98d249ad31 at lab.imap>, size=1048 Jan 30 18:48:07 imap(xxx at xxx): Info: expunge: box=INBOX, uid=3, msgid=<5520ed0fedee4e3386d08c98d249ad31 at lab.imap>, size=1898 This is exactly the sizes I see in the maildirsize. But I think these values should be equals. 1073741824S 2136 1 1048 1 -1898 -1 Att Fernando De: fernando.figaro at uol.com.br Enviada: Quarta-feira, 15 de Janeiro de 2014 15:11 Para: dovecot at dovecot.org Assunto: [Dovecot] possible quota bug ? Hi, I'm using dovecot 2.2.5 with quota (maildir backend), zlib and expunge plugins. When I list maildirsize file, I get: 1073741824S 17952 16 If I receive a new message (example: 1204 bytes compressed and 2524 bytes plain text), the quota file is write correctly (2524 1 entry). When I move the message to trash folder (or between user custom folders) the file have wrong entries: 1073741824S 17952 16 2524 1 1204 1 (this is the size of the compressed message) -2524 -1 I coudn't find any relation with the config settings causing this problem and checked the changelog since 2.2.5. Had someone had this same problem? Thanks, Fernando ? From alanm at sics.se Fri Jan 31 11:51:08 2014 From: alanm at sics.se (Alan McGinlay - SICS) Date: Fri, 31 Jan 2014 10:51:08 +0100 Subject: [Dovecot] dsync Error: Mailbox INBOX: Save commit failed: Mailbox was deleted under us Message-ID: <03454832c5fda5e994c48dd46012518b@sics.se> Hi, I am doing a mass migration of users from Cyrus imap on a solaris server to dovecot 1:2.2.9-1ubuntu1 and am getting this weird issue with dsync if I try to do a "full" sync. Debug output below: dsync(user at example.com): Error: Mailbox INBOX: Save commit failed: Mailbox was deleted under us dsync(user at example.com): Debug: brain M: out box 'INBOX' recv_state=recv_last_common send_state=done changed=1 dsync(user at example.com): Debug: brain M: out state=sync_mails changed=1 dsync(user at example.com): Debug: brain S: in state=sync_mails dsync(user at example.com): Debug: brain S: in box 'INBOX' recv_state=recv_last_common send_state=done dsync(user at example.com): Debug: brain S: out box 'INBOX' recv_state=recv_last_common send_state=done changed=0 dsync(user at example.com): Debug: brain S: out state=sync_mails changed=0 dsync(user at example.com): Debug: imapc(10.10.10.10:143): Disconnected [2]+ Killed /usr/bin/dsync -v -o mail_fsync=never backup -R -f -u user at example.com imapc: (I changed the domain / ip here of course) I notice that it does the IMAP sync for a while and then shows connecting info for pop3 (I have configuration for both imap and pop). The user in question has never connected with POP. imap migration config: imapc_host = 10.10.10.10 imapc_user = %u imapc_master_user = cyrusadmin imapc_password = blahblahblahpasswordhere imapc_features = rfc822.size imapc_features = $imapc_features #fetch-headers mail_prefetch_count = 20 pop configuration: pop3c_host = pop.example.com pop3c_user = %u pop3c_master_user = cyrusadmin pop3c_password = blahblahblahpasswordhere namespace { prefix = POP3-MIGRATION-NS/ location = pop3c: list = no hidden = yes } protocol doveadm { mail_plugins = $mail_plugins pop3_migration } plugin { pop3_migration_mailbox = POP3-MIGRATION-NS/INBOX } Thanks in advance for any pointers on this! /Alan From drum.lucas at gmail.com Fri Jan 31 13:41:42 2014 From: drum.lucas at gmail.com (drum.lucas at gmail.com) Date: Fri, 31 Jan 2014 09:41:42 -0200 Subject: [Dovecot] Dovecot2 + Quota Message-ID: Hello! I need to configure Quota on Roundcubemail with Dovecot2. So, I did: 90-quota.conf: # SQL backend: quota = dict:User quota::proxy::sqlquota quota_rule = *:storage=20M:messages=1000 } dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } OK, works! but, My webmail shows me 20M of quota. But on my Postfixadmin I configured 200M. How can I fix this? Att; *Lucas Possamai* http://about.me/lucaspossamai https://www.digitalocean.com/?refcode=25021cb7dbdf From me at junc.eu Fri Jan 31 13:51:35 2014 From: me at junc.eu (Benny Pedersen) Date: Fri, 31 Jan 2014 12:51:35 +0100 Subject: [Dovecot] Dovecot2 + Quota In-Reply-To: References: Message-ID: <9afc7ce48db7b4325fbe90ee6325977e@junc.eu> On 2014-01-31 12:41, drum.lucas at gmail.com wrote: > Hello! > > I need to configure Quota on Roundcubemail with Dovecot2. > > So, I did: > > 90-quota.conf: > > # SQL backend: > quota = dict:User quota::proxy::sqlquota > quota_rule = *:storage=20M:messages=1000 > } > dict { > sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > > } > > OK, works! but, My webmail shows me 20M of quota. But on my > Postfixadmin I > configured 200M. > > How can I fix this? remove quota_rule you as shown override postfixadmin with it, still not working ? i think its explained very well on readmes in postfixadmin From drum.lucas at gmail.com Fri Jan 31 14:16:27 2014 From: drum.lucas at gmail.com (drum.lucas at gmail.com) Date: Fri, 31 Jan 2014 10:16:27 -0200 Subject: [Dovecot] Dovecot2 + Quota In-Reply-To: <9afc7ce48db7b4325fbe90ee6325977e@junc.eu> References: <9afc7ce48db7b4325fbe90ee6325977e@junc.eu> Message-ID: dovecot-sql.conf: driver = mysql connect = host=localhost dbname=mail user=mail password=xxxxxxxxxxxx default_pass_scheme = MD5 user_query = SELECT '/var/vmail/%d/%n' as home, 'maildir:/var/vmail/%d/%n' as mail, 150 AS uid, 12 AS gid, CONCAT('dirsize:storage=', ROUND( mailbox.quota / 1024 ) ) AS quota FROM mailbox WHERE username = '%u' AND active = '1' password_query = SELECT username as user, password, '/var/vmail/%d/%n' as userdb_home, 'maildir:/var/vmail/%d/%n' as userdb_mail, 150 as userdb_uid, 12 as userdb_gid FROM mailbox WHERE username = '%u' AND active = '1' 90-quota.conf: ## Quota backends plugin { quota = dict:User quota::proxy::sqlquota } dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } Postixadmin config.inc.php: $CONF['maxquota'] = '0'; $CONF['quota'] = 'YES'; $CONF['quota_multiplier'] = '1024000'; I need quota peer user. Att; *Lucas Possamai* http://about.me/lucaspossamai https://www.digitalocean.com/?refcode=25021cb7dbdf 2014-01-31 Benny Pedersen : > On 2014-01-31 12:41, drum.lucas at gmail.com wrote: > >> Hello! >> >> I need to configure Quota on Roundcubemail with Dovecot2. >> >> So, I did: >> >> 90-quota.conf: >> >> # SQL backend: >> quota = dict:User quota::proxy::sqlquota >> quota_rule = *:storage=20M:messages=1000 >> } >> dict { >> sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext >> >> } >> >> OK, works! but, My webmail shows me 20M of quota. But on my Postfixadmin I >> configured 200M. >> >> How can I fix this? >> > > remove quota_rule > > you as shown override postfixadmin with it, still not working ? > > i think its explained very well on readmes in postfixadmin > From me at junc.eu Fri Jan 31 14:39:10 2014 From: me at junc.eu (Benny Pedersen) Date: Fri, 31 Jan 2014 13:39:10 +0100 Subject: [Dovecot] Dovecot2 + Quota In-Reply-To: References: <9afc7ce48db7b4325fbe90ee6325977e@junc.eu> Message-ID: On 2014-01-31 13:16, drum.lucas at gmail.com wrote: > dovecot-sql.conf: > driver = mysql > connect = host=localhost dbname=mail user=mail password=xxxxxxxxxxxx > default_pass_scheme = MD5 > > user_query = SELECT '/var/vmail/%d/%n' as home, > 'maildir:/var/vmail/%d/%n' > as mail, 150 AS uid, 12 AS gid, CONCAT('dirsize:storage=', ROUND( > mailbox.quota / 1024 ) ) AS quota FROM mailbox WHERE username = '%u' > AND > active = '1' i have in dovecot v1 # dovecot v1 format with postfixadmin quotas user_query = SELECT concat('/home/vmail/', maildir) AS home, concat('/home/vmail/', maildir) AS maildir, 1002 AS uid, 1002 AS gid, concat('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' quotadict is to see used quotas in postfixadmin, damm i know that but forgot it :=) From mayuri.enggheads at gmail.com Fri Jan 31 15:54:22 2014 From: mayuri.enggheads at gmail.com (mayu) Date: Fri, 31 Jan 2014 05:54:22 -0800 (PST) Subject: [Dovecot] Postfixadmin/MySQL/Dovecot 2 and quota In-Reply-To: References: <522C687C.5000001@mygaia.org> Message-ID: <1391176462400-46523.post@n4.nabble.com> Hi , I have a same problem what Matt has faced but the soln u provided to Matt was not helpful for me . I am using Postfixadmin ,Dovecot ,Squirrel ,postfix and check_quota plugin for showing quota value . The mysql table is fetching the data stored in postfixadmin ,But squirrel in not fetching the quota value .If I add this line: > quota_rule = *:storage=1G >in conf.d/90-quota.conf file, it works, I mean squirrelmail gets and >shows information (but not the one stored in db of course). Daniel Parthey wrote > Hi Matt, > > sounds like the quota is correctly updated in MySQL, but your roundcube > isn't able to fetch quota information via IMAP. > > Can you reproduce this via telnet or another IMAP client (e.g. Thunderbird > with Quota Display Extension)? > > Can you be so kind and post your whole dovecot config (doveconf -n)? > > Are there any error messages in your dovecot logs regarding quota? > > I think that quota_rule, quota_rule2, quota_rule3 etc. are applied in > sequence, so if you only need one quota_rule, then it should be named > quota_rule. > > Regards > Daniel > > > > Matt < > dovecot@ > > schrieb: >>Hi all, >> >>I'm setting up a new email server based on the softwares list below: >> >> * Postfix >> * Dovecot 2.0.9 >> * MySQL >> * Postfixadmin 2.3.6 >> >>My current problem is I'm unsure whether quota feature is well >>configured or not. >>In order to test and validate, I use Roundcubemail GUI which provides >>percentage of the space used by the mailbox (quota should be applied >>per >>mailbox). >> >>Here, my dovecot configuration: >>dovecot.conf: >>dict { >> quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf >>} >> >>dovecot-dict-quota.conf: >>connect = host=localhost dbname=postfix user=postfix password=postfix >>map { >> pattern = priv/quota/storage >> table = quota2 >> username_field = username >> value_field = bytes >>} >>map { >> pattern = priv/quota/messages >> table = quota2 >> username_field = username >> value_field = messages >>} >> >>dovecot-sql.conf.ext: >>driver = mysql >>connect = host=localhost dbname=postfix user=postfix password=postfix >>default_pass_scheme = PLAIN-MD5 >>password_query = SELECT username AS user, password, \ >> CONCAT('*:storage=', CAST(quota AS CHAR), 'b') AS quota_rule \ >> FROM mailbox WHERE username = '%u' AND active='1' >>user_query = SELECT maildir, 89 AS uid, 12 AS gid, \ >> concat('dict:storage=',floor(quota/1000),'::proxy::quotadict') AS >>quota, \ >> CONCAT('*:storage=', CAST(quota AS CHAR), 'b') AS quota_rule \ >> FROM mailbox WHERE username = '%u' AND active='1' >> >>conf.d/90-quota.conf: >>plugin { >> quota = dict:user::proxy::quotadict >> quota_rule2 = Trash:storage=+10%% >>} >> >>conf.d/20-imap.conf: >>protocol imap { >> mail_plugins = $mail_plugins imap_quota >>} >> >>When I check postfixadmin GUI, I can see that quota in realtime in >>quota2 table, no problem. >> >>But Roundcubemail cannot get this information and shows a unknown >>quota. >>If I add this line: >> quota_rule = *:storage=1G >>in conf.d/90-quota.conf file, it works, I mean roundcubemail gets and >>shows information (but not the one stored in db of course). >> >>I think I'm close to the right configuration but I need your help to >>complete this setup. >> >>Thank you in advance for your help. >> >>Best, >>Matt -- View this message in context: http://dovecot.2317879.n4.nabble.com/Postfixadmin-MySQL-Dovecot-2-and-quota-tp44217p46523.html Sent from the Dovecot mailing list archive at Nabble.com. From me at junc.eu Fri Jan 31 16:17:37 2014 From: me at junc.eu (Benny Pedersen) Date: Fri, 31 Jan 2014 15:17:37 +0100 Subject: [Dovecot] Postfixadmin/MySQL/Dovecot 2 and quota In-Reply-To: <1391176462400-46523.post@n4.nabble.com> References: <522C687C.5000001@mygaia.org> <1391176462400-46523.post@n4.nabble.com> Message-ID: On 2014-01-31 14:54, mayu wrote: > I have a same problem what Matt has faced but the soln u provided to > Matt > was not helpful for me . lost tree here on that, but dovecot quotadict is just for showing quotas in postfixadmin, its not for displaying squotas in squirrelmail check that dovecot quotas is setup to use postfixadmin sql tables with quotas first, this need to work before reporting back to postfixadmin works :) in thunderbird it works if one remember to install quota extension, with means that imap_quota works, and so quotas is defined somewhere please read docs in postfixadmin on it i cant help more if not knowing what part is not working yet From portase.florin at medianetork.ro Fri Jan 31 17:37:39 2014 From: portase.florin at medianetork.ro (Florin Portase) Date: Fri, 31 Jan 2014 16:37:39 +0100 Subject: [Dovecot] Dovecot 2.2.10 shared mailbox Message-ID: <52EBC343.1000008@medianetork.ro> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello all, I've just upgraded my dovecot from version 2.1.7 to 2.2.10 and since then I encounter errors when I'm enabling SHARED MAILBOX: here is part of dovecot.conf: .................... mail_plugins = $mail_plugins zlib expire acl namespace { type = shared prefix = Shared. separator = . list = children location = maildir:/home/vpopmail/Public/Maildir subscriptions = yes } namespace { hidden = no inbox = yes list = yes location = prefix = INBOX. separator = . subscriptions = yes type = private mailbox Trash { auto = subscribe special_use = \Trash } ................ protocol imap { imap_max_line_length = 64 k #mail_plugins = quota imap_quota autocreate zlib imap_zlib acl imap_acl expire mail_plugins = quota imap_quota zlib imap_zlib acl imap_acl expire } ................... plugin { quota = maildir quota_rule2 = INBOX.Trash:ignore quota_rule3 = INBOX.Sent:ignore ##autocreate = INBOX.Spam ##autosubscribe = INBOX.Spam expire = INBOX.Trash expire2 = INBOX.Spam expire3 = INBOX.Junk zlib_save = bz2 acl = vfile } To mention: on version 2.1.xx the shared mail box was working flawless. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJS68NDAAoJECEzxtLP+204uKIIAKFjl28qHPJvrR9ipO3NMAAx fRMiZ8I9cVaJpqYmOKnBgChPzexE3Mh3lStP+jfX12OaJ8Fgk9r0yPXwAILpY2Ef 7Uirpj0iL5pIwGhTURzt+sgbxu24YdJMRrHr5OtL0H+e1rP27injAaZYPhr4A2bk QbbhQic62S+5KNvYC/O4154fwlcgBDRkfSvlg8scq4h5faDrOR30Gjouf4PV6ZBe jwp3rGGyNOc52LyQKqBxA/JyiOXjEvamldIe0Ubjm9bh2EOmOkCdhC/OWpBRT+I0 A36syB+ouO4GXqDGWeMD8i8HD0o4eVfU11cJCDAB2tMrdSP8b2PTBWMHI65aud4= =+XmP -----END PGP SIGNATURE----- From kremels at kreme.com Fri Jan 31 18:45:00 2014 From: kremels at kreme.com (LuKreme) Date: Fri, 31 Jan 2014 09:45:00 -0700 Subject: [Dovecot] Postfixadmin/MySQL/Dovecot 2 and quota In-Reply-To: <1391176462400-46523.post@n4.nabble.com> References: <522C687C.5000001@mygaia.org> <1391176462400-46523.post@n4.nabble.com> Message-ID: On 31 Jan 2014, at 06:54 , mayu wrote: > The mysql table is fetching the data stored in postfixadmin ,But squirrel in > not fetching the quota value .If I add this line: >> quota_rule = *:storage=1G >> in conf.d/90-quota.conf file, it works, I mean squirrelmail gets and >> shows information (but not the one stored in db of course). That seems like an issue with squirrel mail, not dovecot. squirrelmail-users at lists.sourceforge.net -- Oh and I could be a genius if I just put my mind to it And I, I could do anything if only I could get 'round to it. From me at junc.eu Fri Jan 31 18:52:24 2014 From: me at junc.eu (Benny Pedersen) Date: Fri, 31 Jan 2014 17:52:24 +0100 Subject: [Dovecot] Postfixadmin/MySQL/Dovecot 2 and quota In-Reply-To: References: <522C687C.5000001@mygaia.org> <1391176462400-46523.post@n4.nabble.com> Message-ID: <0dbd82b6f7ee75f40aeb5f8b3e3cbc18@junc.eu> On 2014-01-31 17:45, LuKreme wrote: > On 31 Jan 2014, at 06:54 , mayu wrote: > >> The mysql table is fetching the data stored in postfixadmin ,But >> squirrel in >> not fetching the quota value .If I add this line: >>> quota_rule = *:storage=1G >>> in conf.d/90-quota.conf file, it works, I mean squirrelmail gets and >>> shows information (but not the one stored in db of course). > > That seems like an issue with squirrel mail, not dovecot. > > squirrelmail-users at lists.sourceforge.net this quota_rule is hardcoded in dovecot, thus not using postfixadmin quota data it have nothing to do with squirrelmail not showing correct quotas will this here be a long thread ? :=) From kremels at kreme.com Fri Jan 31 21:21:19 2014 From: kremels at kreme.com (LuKreme) Date: Fri, 31 Jan 2014 12:21:19 -0700 Subject: [Dovecot] Postfixadmin/MySQL/Dovecot 2 and quota In-Reply-To: <0dbd82b6f7ee75f40aeb5f8b3e3cbc18@junc.eu> References: <522C687C.5000001@mygaia.org> <1391176462400-46523.post@n4.nabble.com> <0dbd82b6f7ee75f40aeb5f8b3e3cbc18@junc.eu> Message-ID: <93A3F594-D7B4-4B2E-9EF0-7BF20F5E076B@kreme.com> On 31 Jan 2014, at 09:52 , Benny Pedersen wrote: > On 2014-01-31 17:45, LuKreme wrote: >> On 31 Jan 2014, at 06:54 , mayu wrote: >>> The mysql table is fetching the data stored in postfixadmin ,But squirrel in >>> not fetching the quota value .If I add this line: >>>> quota_rule = *:storage=1G >>>> in conf.d/90-quota.conf file, it works, I mean squirrelmail gets and >>>> shows information (but not the one stored in db of course). >> That seems like an issue with squirrel mail, not dovecot. >> squirrelmail-users at lists.sourceforge.net > > this quota_rule is hardcoded in dovecot, thus not using postfixadmin quota data > > it have nothing to do with squirrelmail not showing correct quotas > > will this here be a long thread ? :=) Maybe. I thought the post I replied to was saying that it DID work if the setting was hard coded but that SM was not reading the setting from the database. -- 99 percent of lawyers give the rest a bad name. From rs at sys4.de Fri Jan 31 22:06:42 2014 From: rs at sys4.de (Robert Schetterer) Date: Fri, 31 Jan 2014 21:06:42 +0100 Subject: [Dovecot] Dovecot2 + Quota In-Reply-To: References: Message-ID: <52EC0252.5070708@sys4.de> Am 31.01.2014 12:41, schrieb drum.lucas at gmail.com: > Hello! > > I need to configure Quota on Roundcubemail with Dovecot2. > > So, I did: > > 90-quota.conf: > > # SQL backend: > quota = dict:User quota::proxy::sqlquota > quota_rule = *:storage=20M:messages=1000 > } > dict { > sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > > } > > OK, works! but, My webmail shows me 20M of quota. But on my Postfixadmin I > configured 200M. > > How can I fix this? what about use something like this in dovecot-sql.conf.ext user_query = SELECT concat('/usr/local/virtual/', maildir) AS home, \ concat('*:bytes=', mailbox.quota) AS quota_rule, \ #when saving to Trash mailbox the user gets additional 50MB "Trash:storage=+50240" AS quota_rule2, \ #when saving to Sent mailbox the user gets additional 50MB "Sent:storage=+50240" AS quota_rule3, \ #when saving to Drafts mailbox the user gets additional 50MB "Drafts:storage=+50240" AS quota_rule4, \ #when saving to Templates mailbox the user gets additional 50MB "Templates:storage=+50240" AS quota_rule5, \ #when saving to Junk mailbox the user gets additional 50MB "Junk:storage=+50240" AS quota_rule6, \ #when saving to Archives mailbox the user gets additional 50MB "Archives:storage=+50240" AS quota_rule7, \ quota rules are not needed to configured here but something like concat('*:bytes=', mailbox.quota) AS quota_rule fits with dovecot, postfixadmin, squirrelmail at my site > > Att; > > *Lucas Possamai* > > http://about.me/lucaspossamai > > https://www.digitalocean.com/?refcode=25021cb7dbdf > Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From dickson.tim at googlemail.com Thu Jan 30 20:50:14 2014 From: dickson.tim at googlemail.com (Tim Dickson) Date: Thu, 30 Jan 2014 18:50:14 +0000 Subject: [Dovecot] mime support for pigeonhole Message-ID: <52EA9EE6.40905@googlemail.com> is there any chance of rfc5703 (mime support/extension) being added to pigeonhole? I am trying to filter mail with .exe and .zip attachments, to no success. I have tried *header :contains "x-attached" [".zip", ".exe"] *but emails i'm getting don't have x-attached. a sample snippet is below. Subject: testa1 Content-Type: multipart/mixed; boundary="------------020304040002050407030900" This is a multi-part message in MIME format. --------------020304040002050407030900 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit this has a compressed file added a1 --------------020304040002050407030900 Content-Type: application/x-zip-compressed; name="pinglog.zip" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="pinglog.zip" I have tried *header :contains ["Content-Type","name","filename"] ["application/x-zip-compressed",".zip",".exe"]* but that doesn't work either. I can't use body because that doesn't include the mime headers, so the only way I can see is to use mime (aka rfc5703) I am using dovecot 2.1.8 with pigeonhole 0.3.3 (and am about to use dovecot 2.2.9 with pigeonhole 0.4.2 on another server) If I'm just missing the point, or there is already support, please point me in the right direction.