From leon at f-m.fm Fri Jul 1 03:04:58 2016 From: leon at f-m.fm (Leon Kyneur) Date: Fri, 1 Jul 2016 11:04:58 +0800 Subject: v2.2.25 release candidate released In-Reply-To: <579B0EF1-E355-447A-8214-9E885B1E4DF6@iki.fi> References: <579B0EF1-E355-447A-8214-9E885B1E4DF6@iki.fi> Message-ID: <5775DDDA.5070309@f-m.fm> Hi Timo, Testing now and noticed the following error on a POP user: Jul 01 12:50:08 pop3-login: Info: Login: user=, method=PLAIN, rip=192.168.4.145, lip=10.0.0.4, mpid=52302, secured, session=<+lRmC4o2yubLhgGR> Jul 01 12:50:08 pop3(user at domain.com): Info: Disconnected: Logged out top=0/0, retr=0/0, del=0/327, size=2856127, uidls=327/0b11428c Jul 01 12:50:08 pop3(user at domain.com): Error: Failed to autoexpunge mailbox 'Junk': Mailbox doesn't exist: Junk Jul 01 12:50:08 pop3(user at domain.com): Error: Failed to autoexpunge mailbox 'Trash': Mailbox doesn't exist: Trash For a long time I have been using "autoexpunge = 90 days" setting in these mailboxes without error - is this now expected? Should I enable "auto = create" to resolve this? Global namespace configuration is: namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { autoexpunge = 90 days special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { autoexpunge = 90 days special_use = \Trash } prefix = separator = / } Regards Leon On 30/06/16 20:49, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/rc/dovecot-2.2.25.rc1.tar.gz > http://dovecot.org/releases/2.2/rc/dovecot-2.2.25.rc1.tar.gz.sig > > Quite a lot of changes. Please test out before the final v2.2.25 release, which I'm planning for tomorrow. Especially the new lib-dcrypt might have compiling problems with some OpenSSL versions. > > * lmtp: Start tracking lmtp_user_concurrency_limit and reject already > at RCPT TO stage. This avoids MTA unnecessarily completing DATA only > to get an error. > * doveadm: Previously only mail settings were read from protocol > doveadm { .. } section. Now all settings are. > > + quota: Added quota_over_flag_lazy_check setting. It avoids checking > quota_over_flag always at startup. Instead it's checked only when > quota is being read for some other purpose. > + auth: Added a new auth policy service: > http://wiki2.dovecot.org/Authentication/Policy > + auth: Added PBKDF2 password scheme > + auth: Added %{auth_user}, %{auth_username} and %{auth_domain} > + auth: Added ":remove" suffix to extra field names to remove them. > + auth: Added "delay_until=[+]" passdb > extra field. The auth will wait until and optionally some > randomness and then return success. > + dict proxy: Added idle_msecs= parameter. Support async operations. > + Performance improvements for handling large mailboxes. > + Added lib-dcrypt API for providing cryptographic functions. > + Added "doveadm mailbox update" command > + imap commands' output now includes timing spent on the "syncing" > stage if it's larger than 0. > + cassandra: Added metrics= to connect setting to output internal > statistics in JSON format every second to . > + doveadm mailbox delete: Added -e parameter to delete only empty > mailboxes. Added --unsafe option to quickly delete a mailbox, > bypassing lazy_expunge and quota plugins. > + doveadm user & auth cache flush are now available via doveadm-server. > + doveadm service stop will stop specified services while > leaving the rest of Dovecot running. > + quota optimization: Avoid reading mail sizes for backends which > don't need them (count, fs, dirsize) > + Added mailbox { autoexpunge_max_mails= } setting. > + Added welcome plugin: http://wiki2.dovecot.org/Plugins/Welcome > + fts: Added fts_autoindex_exclude setting. > - v2.2.24's MIME parser was assert-crashing on mails having truncated > MIME headers. > - auth: With multiple userdbs the final success/failure result wasn't > always correct. The last userdb's result was always used. > - doveadm backup was sometimes deleting entire mailboxes unnecessarily. > - doveadm: Command -parameters weren't being sent to doveadm-server. > - If dovecot.index read failed e.g. because mmap() reached VSZ limit, > an empty index could have been opened instead, corrupting the > mailbox state. > - imapc: Fixed EXPUNGE handling when imapc_features didn't have modseq. > - lazy-expunge: Fixed a crash when copying failed. Various other fixes. > - fts-lucene: Fixed crash on index rescan. > - auth_stats=yes produced broken output > - dict-ldap: Various fixes > - dict-sql: NULL values crashed. Now they're treated as "not found". From sr42354 at gmail.com Fri Jul 1 06:36:17 2016 From: sr42354 at gmail.com (Sam) Date: Fri, 1 Jul 2016 08:36:17 +0200 Subject: Fwd: Re: Dictionary quota with Flat file database In-Reply-To: <74a0d40e-95ee-e257-e5a4-15190db1e8a1@gmail.com> References: <74a0d40e-95ee-e257-e5a4-15190db1e8a1@gmail.com> Message-ID: <6522b7f3-e4fc-94b6-1dd0-e992a04a6463@gmail.com> Hello Aki, Finally I am using maildir as quota backend and it works! I set the second way like it was write here http://wiki2.dovecot.org/Quota/Maildir With this method The quota can be personalized per user manually. I only have to create the file once for the new users. But I don't know if these following options in 90-quota.ext works again : quota_rule2 = Trash:storage=+100M quota_grace = 10%% I'm going to test that. Thanks a lot! Sam Le 30/06/2016 ? 16:13, aki.tuomi at dovecot.fi a ?crit : >> On June 30, 2016 at 4:41 PM Sam wrote: >> >> >> Hello, >> >> I want specific quotas for certain users and I looking for doing that >> with dictionary quota backend and Flat file. >> >> Because I am using "active directory" with PAM for authenticate, I can't >> get per-user quota limits with set/override them by returning >> "quota_rule" extra field from userdb. >> >> I started reading http://wiki1.dovecot.org/Quota/Dict, saw some good >> stuff... >> >> The problem is that I don't understand how to set the limit in the users >> files. >> >> If I open one created file I only see the current number of messages and >> the actual size. Not the quota limits... >> >> vi /home/vmail/john.doe/Maildir/dovecot-quota : >> priv/quota/messages >> 13 >> priv/quota/storage >> 600201 >> >> Here is /etc/dovecot/conf.d/90-quota.conf file details : >> plugin { >> # I think I have to set the default limits here >> quota_rule = *:storage=10G:messages=10000 >> } >> ... >> plugin { >> quota = dict:user::file:%h/Maildir/dovecot-quota >> # same result with : >> # quota = dict:User::file:%h/Maildir/dovecot-quota >> } >> >> my server : CentOS Linux release 7.2.1511 >> dovecot : dovecot-2.2.10-5.el7.x86_64 >> >> Thanks for helping. >> Sam > Hi! > > You can use passwd-file userdb for setting additional attributes. > > Aki From mfoley at ohprs.org Fri Jul 1 06:42:06 2016 From: mfoley at ohprs.org (Mark Foley) Date: Fri, 01 Jul 2016 02:42:06 -0400 Subject: Looking for GSSAPI config [was: Looking for NTLM config example] In-Reply-To: <5774C306.2040005@dovecot.fi> References: <201606281417.u5SEHd2J003587@mail.hprs.local> <28360759.5872.1467126370957@appsuite-dev.open-xchange.com> <201606290204.u5T24gRt009386@mail.hprs.local> <201606290332.u5T3Wb6l027033@mail.hprs.local> <201606291540.u5TFeZcJ030860@mail.hprs.local> <5774C306.2040005@dovecot.fi> Message-ID: <201607010642.u616g6Fo000602@mail.hprs.local> My keytab now has: ktutil: read_kt /etc/dovecot/dovecot.keytab ktutil: list slot KVNO Principal ---- ---- --------------------------------------------------------------------- 1 1 smtp/mail.hprs.local at HPRS.LOCAL 2 1 imap/mail.hprs.local at HPRS.LOCAL I added these in ktutil with: addent -password -p smtp/mail.hprs.local at HPRS.LOCAL -k 1 -e arcfour-hmac Aki wrote: > I think the problem still is that your keytab file has no entry > imap/hostname at DOMAIN and IMAP/hostname at DOMAIN > you also have no host/hostname at DOMAIN Not sure how to interpret your template. Are you suggesting I should ... addent -password -p IMAP/mail at HPRS.LOCAL -k 1 -e arcfour-hmac addent -password -p imap/mail at HPRS.LOCAL -k 1 -e arcfour-hmac (one IMAP uppercase and one lowercase?) I don't get your distinction between host and hostname in your 3rd example: host/hostname at DOMAIN Meanwhile ... Tried a bunch of things. No go so far. In fact, I'm questioning if gssapi is enabled in my dovecot. I did rebuild and reinstall using `./configure --with-gssapi=yes`, but if I only enable gssapi authentication, I get "No authenticators available" (mail client). How can I verify gssapi is really available? dovecot --build-options shows: Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: Passdb: checkpassword passwd passwd-file shadow Userdb: checkpassword nss passwd prefetch passwd-file should I see authentication methods there? --Mark -----Original Message----- Subject: Re: Looking for GSSAPI config [was: Looking for NTLM config example] To: dovecot at dovecot.org From: Aki Tuomi Organization: Dovecot Oy Date: Thu, 30 Jun 2016 09:58:14 +0300 I think the problem still is that your keytab file has no entry imap/hostname at DOMAIN and IMAP/hostname at DOMAIN you also have no host/hostname at DOMAIN Aki On 29.06.2016 18:40, Mark Foley wrote: > Yes, I think that's exactly correct. I just made a similar reply to Edgar Pettijohn about that. > The Thunderbird message is: > > "The Kerberos/GSSAPI ticket was not accepted by the IMAP server mark at ohprs.org. Please check > that you are logged in to the Kerberos/GSSAPI realm." > > I made further comments in that message that I won't clutter the list by repeating here. Check > out that message and see what you think could be wrong. > > Thanks for your help! I'm sure this is solvable! > > --Mark > > -----Original Message----- >> Date: Wed, 29 Jun 2016 08:03:14 -0400 >> Subject: Re: Looking for GSSAPI config [was: Looking for NTLM config example] >> From: brendan kearney >> To: Mark Foley >> Cc: dovecot at dovecot.org >> >> The last log line shows "user=<>". This indicates no credentials were >> presented. If the rip field matches the client ip you tested from, I would >> bet the appropriate kerberos ticket (imap/host.domain.tld at REALM) was not >> pulled for the authentication. >> On Jun 28, 2016 11:33 PM, "Mark Foley" wrote: > [deleted] From aki.tuomi at dovecot.fi Fri Jul 1 07:10:43 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Fri, 1 Jul 2016 10:10:43 +0300 Subject: Looking for GSSAPI config [was: Looking for NTLM config example] In-Reply-To: <201607010642.u616g6Fo000602@mail.hprs.local> References: <201606281417.u5SEHd2J003587@mail.hprs.local> <28360759.5872.1467126370957@appsuite-dev.open-xchange.com> <201606290204.u5T24gRt009386@mail.hprs.local> <201606290332.u5T3Wb6l027033@mail.hprs.local> <201606291540.u5TFeZcJ030860@mail.hprs.local> <5774C306.2040005@dovecot.fi> <201607010642.u616g6Fo000602@mail.hprs.local> Message-ID: <57761773.40900@dovecot.fi> The distinction is that kerberos principals are in form /@ the hostname bit *must* match to the host you are connecting to, exactly and verbatim. It can differ in case, I guess. The service is what service you are connecting to. These have special meanings and can be case sensitive (like http won't always work, it has to be HTTP). host/ is always needed in at least system keytab. Not sure if it's needed now in the service tab. But I suspect that you need to have IMAP and not imap. Also make sure and double-check that the hostname is correct. Once you've done the keytab you'll want to grab a cup of coffee and local newspaper or something and read it thru before trying, because it might take some time for it to work. Also, your client *and* host needs to be able to access KDC (all of them) on 88/tcp. Aki On 01.07.2016 09:42, Mark Foley wrote: > My keytab now has: > > ktutil: read_kt /etc/dovecot/dovecot.keytab > ktutil: list > slot KVNO Principal > ---- ---- --------------------------------------------------------------------- > 1 1 smtp/mail.hprs.local at HPRS.LOCAL > 2 1 imap/mail.hprs.local at HPRS.LOCAL > > I added these in ktutil with: > > addent -password -p smtp/mail.hprs.local at HPRS.LOCAL -k 1 -e arcfour-hmac > > Aki wrote: > >> I think the problem still is that your keytab file has no entry >> imap/hostname at DOMAIN and IMAP/hostname at DOMAIN >> you also have no host/hostname at DOMAIN > Not sure how to interpret your template. Are you suggesting I should ... > > addent -password -p IMAP/mail at HPRS.LOCAL -k 1 -e arcfour-hmac > addent -password -p imap/mail at HPRS.LOCAL -k 1 -e arcfour-hmac > > (one IMAP uppercase and one lowercase?) > > I don't get your distinction between host and hostname in your 3rd example: host/hostname at DOMAIN > > Meanwhile ... > > Tried a bunch of things. No go so far. In fact, I'm questioning if gssapi is enabled in my > dovecot. I did rebuild and reinstall using `./configure --with-gssapi=yes`, but if I only > enable gssapi authentication, I get "No authenticators available" (mail client). How can I > verify gssapi is really available? dovecot --build-options shows: > > Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 > Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail > SQL drivers: > Passdb: checkpassword passwd passwd-file shadow > Userdb: checkpassword nss passwd prefetch passwd-file > > should I see authentication methods there? > > --Mark > > -----Original Message----- > Subject: Re: Looking for GSSAPI config [was: Looking for NTLM config example] > To: dovecot at dovecot.org > From: Aki Tuomi > Organization: Dovecot Oy > Date: Thu, 30 Jun 2016 09:58:14 +0300 > > I think the problem still is that your keytab file has no entry > imap/hostname at DOMAIN and IMAP/hostname at DOMAIN > > you also have no host/hostname at DOMAIN > > Aki > > On 29.06.2016 18:40, Mark Foley wrote: >> Yes, I think that's exactly correct. I just made a similar reply to Edgar Pettijohn about that. >> The Thunderbird message is: >> >> "The Kerberos/GSSAPI ticket was not accepted by the IMAP server mark at ohprs.org. Please check >> that you are logged in to the Kerberos/GSSAPI realm." >> >> I made further comments in that message that I won't clutter the list by repeating here. Check >> out that message and see what you think could be wrong. >> >> Thanks for your help! I'm sure this is solvable! >> >> --Mark >> >> -----Original Message----- >>> Date: Wed, 29 Jun 2016 08:03:14 -0400 >>> Subject: Re: Looking for GSSAPI config [was: Looking for NTLM config example] >>> From: brendan kearney >>> To: Mark Foley >>> Cc: dovecot at dovecot.org >>> >>> The last log line shows "user=<>". This indicates no credentials were >>> presented. If the rip field matches the client ip you tested from, I would >>> bet the appropriate kerberos ticket (imap/host.domain.tld at REALM) was not >>> pulled for the authentication. >>> On Jun 28, 2016 11:33 PM, "Mark Foley" wrote: >> [deleted] From skdovecot at smail.inf.fh-brs.de Fri Jul 1 08:02:50 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 1 Jul 2016 10:02:50 +0200 (CEST) Subject: Shared mailboxes not showing up in shared namespace In-Reply-To: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> References: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 30 Jun 2016, Marti Markov wrote: > I think I have configured everything correctly but for some reason I can?t get a list of the shared mailboxes to show up. > > When I run: > > doveadm acl debug -u m.markov Shared/d.marteva/INBOX > > > doveadm(m.markov): Info: User d.marteva found from ACL shared dict > doveadm(m.markov): Info: Mailbox Shared/d.marteva/INBOX is visible in LIST did you've tried: http://wiki2.dovecot.org/PreAuth /usr/local/libexec/dovecot/imap -u m.markov 1 LIST "" "*" 2 LOGOUT ? Maybe the client does not list them. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBV3Yjqnz1H7kL/d9rAQIoSQgAvKFsSKxMdt82a/1p52bikwkje4YoqGjK duStP9qG2AtkkRPbbNc8JWki20xixyW7XagIP39dGwd+yNVlkMZAVna0KGIFNUwk 9eVC1lMPax9lc0kq7Fw+EqwpPtFwuGe41eAsyP3JE51VlEbnA74oPGadJJe/6cM8 /3sMCxXC9PlxgoKhwFoqggnEeH0Dx6wkHqXsLT3lCnSwtQHX8ZaKlRkEaVBvTVvO ogu/9V/RZH6mhiVdlcYEDXDNoAZ7dh7ZgLqI2nCJm1AoTjpAyjnskhFT+1l5sOC0 +tEb7Rfl7zAp+eJy6X9RaX9nuDzIGSTRfHBeTV9rMVXrz005FYHZpg== =uU9/ -----END PGP SIGNATURE----- From odhiambo at gmail.com Fri Jul 1 09:23:28 2016 From: odhiambo at gmail.com (Odhiambo Washington) Date: Fri, 1 Jul 2016 12:23:28 +0300 Subject: v2.2.25 release candidate released In-Reply-To: <32BEE787-BB42-49F6-BA45-368EAA10803D@iki.fi> References: <579B0EF1-E355-447A-8214-9E885B1E4DF6@iki.fi> <32BEE787-BB42-49F6-BA45-368EAA10803D@iki.fi> Message-ID: On 30 June 2016 at 18:18, Timo Sirainen wrote: > On 30 Jun 2016, at 17:26, Odhiambo Washington wrote: > > > > FreeBSD 9.3-STABLE FreeBSD 9.3-STABLE amd64: > > > > sha1.h:80: error: static or type qualifiers in abstract declarator > > What gcc version is this? It should have been valid C99 code, so I > expected it to work without any special version checks.. > >From config.log: configure:4580: checking for gcc configure:4596: found /usr/bin/gcc configure:4607: result: gcc configure:4836: checking for C compiler version configure:4845: gcc --version >&5 gcc (GCC) 4.2.1 20070831 patched [FreeBSD] Copyright (C) 2007 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft." From aki.tuomi at dovecot.fi Fri Jul 1 09:43:50 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Fri, 1 Jul 2016 12:43:50 +0300 Subject: v2.2.25 release candidate released In-Reply-To: References: <579B0EF1-E355-447A-8214-9E885B1E4DF6@iki.fi> <32BEE787-BB42-49F6-BA45-368EAA10803D@iki.fi> Message-ID: <57763B56.5010402@dovecot.fi> On 01.07.2016 12:23, Odhiambo Washington wrote: > On 30 June 2016 at 18:18, Timo Sirainen wrote: > >> On 30 Jun 2016, at 17:26, Odhiambo Washington wrote: >>> FreeBSD 9.3-STABLE FreeBSD 9.3-STABLE amd64: >>> >>> sha1.h:80: error: static or type qualifiers in abstract declarator >> What gcc version is this? It should have been valid C99 code, so I >> expected it to work without any special version checks.. >> > From config.log: > > configure:4580: checking for gcc > configure:4596: found /usr/bin/gcc > configure:4607: result: gcc > configure:4836: checking for C compiler version > configure:4845: gcc --version >&5 > gcc (GCC) 4.2.1 20070831 patched [FreeBSD] > Copyright (C) 2007 Free Software Foundation, Inc. > This is free software; see the source for copying conditions. There is NO > warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. > > > > > Fixed in https://github.com/dovecot/core/commit/f54d511597447e40f5413716c10520a7229364f1 Aki From odhiambo at gmail.com Fri Jul 1 10:10:39 2016 From: odhiambo at gmail.com (Odhiambo Washington) Date: Fri, 1 Jul 2016 13:10:39 +0300 Subject: v2.2.25 release candidate released In-Reply-To: <57763B56.5010402@dovecot.fi> References: <579B0EF1-E355-447A-8214-9E885B1E4DF6@iki.fi> <32BEE787-BB42-49F6-BA45-368EAA10803D@iki.fi> <57763B56.5010402@dovecot.fi> Message-ID: On 1 July 2016 at 12:43, Aki Tuomi wrote: > > > On 01.07.2016 12:23, Odhiambo Washington wrote: > > On 30 June 2016 at 18:18, Timo Sirainen wrote: > > > >> On 30 Jun 2016, at 17:26, Odhiambo Washington > wrote: > >>> FreeBSD 9.3-STABLE FreeBSD 9.3-STABLE amd64: > >>> > >>> sha1.h:80: error: static or type qualifiers in abstract declarator > >> What gcc version is this? It should have been valid C99 code, so I > >> expected it to work without any special version checks.. > >> > > From config.log: > > > > configure:4580: checking for gcc > > configure:4596: found /usr/bin/gcc > > configure:4607: result: gcc > > configure:4836: checking for C compiler version > > configure:4845: gcc --version >&5 > > gcc (GCC) 4.2.1 20070831 patched [FreeBSD] > > Copyright (C) 2007 Free Software Foundation, Inc. > > This is free software; see the source for copying conditions. There is > NO > > warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR > PURPOSE. > > > > > > > > > > > > Fixed in > > https://github.com/dovecot/core/commit/f54d511597447e40f5413716c10520a7229364f1 > > Aki > That fixes it for sure. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft." From goetz.reinicke at filmakademie.de Fri Jul 1 11:34:39 2016 From: goetz.reinicke at filmakademie.de (=?UTF-8?Q?G=c3=b6tz_Reinicke_-_IT_Koordinator?=) Date: Fri, 1 Jul 2016 13:34:39 +0200 Subject: Suggestions? Moving maildir to new storage and may be switch to mdbox Message-ID: Hi, we got a new storage for our mails and now we think about the best way to use it. Currently about 1TB is stored in maildirs, some mail has been moved to client side local storage temporarily to get space on the old storage. I think of different options, some downtime in mind: a) stay with maildir and just rsync/move all mail to the new storage, mount the new storage at the old mountpoint (or may be new mountpoint and edit the dovecot config). b) "dsync backup" users maildir to mdboxes at a temp mountpoint and change the dovecot config afterwords. c) your suggestions or best practice Thanks for feedback . G?tz -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5571 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Fri Jul 1 14:36:47 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 1 Jul 2016 17:36:47 +0300 Subject: v2.2.25 released Message-ID: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz.sig Some minor fixes and (mainly logging) improvements since rc1. * lmtp: Start tracking lmtp_user_concurrency_limit and reject already at RCPT TO stage. This avoids MTA unnecessarily completing DATA only to get an error. * doveadm: Previously only mail settings were read from protocol doveadm { .. } section. Now all settings are. + quota: Added quota_over_flag_lazy_check setting. It avoids checking quota_over_flag always at startup. Instead it's checked only when quota is being read for some other purpose. + auth: Added a new auth policy service: http://wiki2.dovecot.org/Authentication/Policy + auth: Added PBKDF2 password scheme + auth: Added %{auth_user}, %{auth_username} and %{auth_domain} + auth: Added ":remove" suffix to extra field names to remove them. + auth: Added "delay_until=[+]" passdb extra field. The auth will wait until and optionally some randomness and then return success. + dict proxy: Added idle_msecs= parameter. Support async operations. + Performance improvements for handling large mailboxes. + Added lib-dcrypt API for providing cryptographic functions. + Added "doveadm mailbox update" command + imap commands' output now includes timing spent on the "syncing" stage if it's larger than 0. + cassandra: Added metrics= to connect setting to output internal statistics in JSON format every second to . + doveadm mailbox delete: Added -e parameter to delete only empty mailboxes. Added --unsafe option to quickly delete a mailbox, bypassing lazy_expunge and quota plugins. + doveadm user & auth cache flush are now available via doveadm-server. + doveadm service stop will stop specified services while leaving the rest of Dovecot running. + quota optimization: Avoid reading mail sizes for backends which don't need them (count, fs, dirsize) + Added mailbox { autoexpunge_max_mails= } setting. + Added welcome plugin: http://wiki2.dovecot.org/Plugins/Welcome + fts: Added fts_autoindex_exclude setting. - v2.2.24's MIME parser was assert-crashing on mails having truncated MIME headers. - auth: With multiple userdbs the final success/failure result wasn't always correct. The last userdb's result was always used. - doveadm backup was sometimes deleting entire mailboxes unnecessarily. - doveadm: Command -parameters weren't being sent to doveadm-server. - If dovecot.index read failed e.g. because mmap() reached VSZ limit, an empty index could have been opened instead, corrupting the mailbox state. - imapc: Fixed EXPUNGE handling when imapc_features didn't have modseq. - lazy-expunge: Fixed a crash when copying failed. Various other fixes. - fts-lucene: Fixed crash on index rescan. - auth_stats=yes produced broken output - dict-ldap: Various fixes - dict-sql: NULL values crashed. Now they're treated as "not found". From jcblanco at fi.upm.es Fri Jul 1 16:09:30 2016 From: jcblanco at fi.upm.es (Juan C. Blanco) Date: Fri, 1 Jul 2016 18:09:30 +0200 Subject: v2.2.25 released In-Reply-To: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> References: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> Message-ID: I Haven't had the time to check the sha1.h error with the new fixes but I've just done so after de 2.2.25 release was out and I'm having the same error: gcc -DHAVE_CONFIG_H -I. -I. -I../.. -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/kerberos/include -c guid.c -fPIC -DPIC -o .libs/guid.o In file included from guid.c:6: sha1.h:80: error: static or type qualifiers in abstract declarator make[4]: *** [guid.lo] Error 1 make[4]: Leaving directory `/home/jc/rpmbuild/BUILD/dovecot-2.2.25/src/lib' make[3]: *** [all] Error 2 make[3]: Leaving directory `/home/jc/rpmbuild/BUILD/dovecot-2.2.25/src/lib' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/home/jc/rpmbuild/BUILD/dovecot-2.2.25/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/home/jc/rpmbuild/BUILD/dovecot-2.2.25' make: *** [all] Error 2 Operating System: CentOS 5.11 GCC Version: gcc (GCC) 4.1.2 20080704 (Red Hat 4.1.2-55) We have four systems like this with dovecot 2.2.24 working fine. I would like to know if this platform will not be compatible anymore with dovecot and if we need to upgrade our systems prior to dovecot version since, besides this, I have the problem related to the openssl version for the lib-dcrypt library Thanks Juan C. Blanco -- +-------------------------------------------------------------------+ | Juan C. Blanco | | | | Centro de Calculo | | | E.T.S. Ingenieros Inform?ticos | E-mail: jcblanco at fi.upm.es | | Universidad Polit?cnica de Madrid | | | Campus de Montegancedo | | | Boadilla del Monte | Tel.: (+34) 91 336 7466 | | 28660 MADRID (Spain) | Fax : (+34) 91 336 6913 | +-------------------------------------------------------------------+ From adamw at adamw.org Fri Jul 1 16:39:20 2016 From: adamw at adamw.org (Adam Weinberger) Date: Fri, 1 Jul 2016 10:39:20 -0600 Subject: kqueue crash on FreeBSD with 2.2.25 Message-ID: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> Hi, 2.2.25 crashes on FreeBSD with a kqueue-related message. I see references to something similar (http://www.dovecot.org/list/dovecot/2012-February.txt) from a couple years ago. I get: Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor It's not dumping core, and I get the message even with "protocols =" Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? # Adam -- Adam Weinberger adamw at adamw.org http://www.adamw.org From tss at iki.fi Fri Jul 1 16:51:41 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 1 Jul 2016 19:51:41 +0300 Subject: v2.2.25 released In-Reply-To: References: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> Message-ID: <4E7C4405-3049-45E1-873D-863747FC934A@iki.fi> On 01 Jul 2016, at 19:09, Juan C. Blanco wrote: > > I Haven't had the time to check the sha1.h error with the new fixes but I've just done so after de 2.2.25 release was out and I'm having the same error: > > gcc -DHAVE_CONFIG_H -I. -I. -I../.. -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/kerberos/include -c guid.c -fPIC -DPIC -o .libs/guid.o > In file included from guid.c:6: > sha1.h:80: error: static or type qualifiers in abstract declarator I thought this was fixed in 2.2.25.. In config.h you should have only: #define STATIC_ARRAY (not #define STATIC_ARRAY static) > Operating System: CentOS 5.11 > GCC Version: gcc (GCC) 4.1.2 20080704 (Red Hat 4.1.2-55) > > We have four systems like this with dovecot 2.2.24 working fine. I would like to know if this platform will not be compatible anymore with dovecot and if we need to upgrade our systems prior to dovecot version since, besides this, I have the problem related to the openssl version for the lib-dcrypt library I recommend upgrading. We're considering not supporting older OSes anymore at all.. From tss at iki.fi Fri Jul 1 16:52:29 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 1 Jul 2016 19:52:29 +0300 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> Message-ID: On 01 Jul 2016, at 19:39, Adam Weinberger wrote: > > Hi, > > 2.2.25 crashes on FreeBSD with a kqueue-related message. I see references to something similar (http://www.dovecot.org/list/dovecot/2012-February.txt) from a couple years ago. > > I get: > Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor > > It's not dumping core, and I get the message even with "protocols =" > > Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? gdb backtrace: http://dovecot.org/bugreport.html#coredumps From mfoley at ohprs.org Fri Jul 1 17:37:48 2016 From: mfoley at ohprs.org (Mark Foley) Date: Fri, 01 Jul 2016 13:37:48 -0400 Subject: Looking for GSSAPI config [was: Looking for NTLM config example] In-Reply-To: <57761773.40900@dovecot.fi> References: <201606281417.u5SEHd2J003587@mail.hprs.local> <28360759.5872.1467126370957@appsuite-dev.open-xchange.com> <201606290204.u5T24gRt009386@mail.hprs.local> <201606290332.u5T3Wb6l027033@mail.hprs.local> <201606291540.u5TFeZcJ030860@mail.hprs.local> <5774C306.2040005@dovecot.fi> <201607010642.u616g6Fo000602@mail.hprs.local> <57761773.40900@dovecot.fi> Message-ID: <201607011737.u61HbmkY028402@mail.hprs.local> Aki - comments interspersed below ... --Mark -----Original Message----- > Subject: Re: Looking for GSSAPI config [was: Looking for NTLM config example] > To: dovecot at dovecot.org > From: Aki Tuomi > Organization: Dovecot Oy > Date: Fri, 1 Jul 2016 10:10:43 +0300 > > The distinction is that kerberos principals are in form > > /@ > > the hostname bit *must* match to the host you are connecting to, exactly > and verbatim. It can differ in case, I guess. > > The service is what service you are connecting to. These have special > meanings and can be case sensitive (like http won't always work, it has > to be HTTP). The current IMAP "Principle" in my keytab is: imap/mail.hprs.local at HPRS.LOCAL Explicitly, are you saying it needs to look like: IMAP/mail at HPRS.LOCAL Meaning, capitalized "IMAP" and just hostname, no FDQN? > host/ is always needed in at least system keytab. Not sure if it's > needed now in the service tab. But I suspect that you need to have IMAP > and not imap. Also make sure and double-check that the hostname is correct. Confused. What do you mean by "host/"? Can you give an example using my host and domain names? I don't know where "host/" goes. I assume this is not a synonym for "/"? This is the first I've head of a system keytab versus a service tab. What are they? Do I need both? > Once you've done the keytab you'll want to grab a cup of coffee and > local newspaper or something and read it thru before trying, because it > might take some time for it to work. Really? I can reboot this evening. > Also, your client *and* host needs to be able to access KDC (all of > them) on 88/tcp. There should be no problem with the intra-LAN firewall. Everything is permitted, but I'll double-check on the WIN7 workstation I'm testing from. Is there a way to know for sure my dovecot is enabled for gssapi? > Aki > > On 01.07.2016 09:42, Mark Foley wrote: > > My keytab now has: > > > > ktutil: read_kt /etc/dovecot/dovecot.keytab > > ktutil: list > > slot KVNO Principal > > ---- ---- --------------------------------------------------------------------- > > 1 1 smtp/mail.hprs.local at HPRS.LOCAL > > 2 1 imap/mail.hprs.local at HPRS.LOCAL > > > > I added these in ktutil with: > > > > addent -password -p smtp/mail.hprs.local at HPRS.LOCAL -k 1 -e arcfour-hmac > > > > Aki wrote: > > > >> I think the problem still is that your keytab file has no entry > >> imap/hostname at DOMAIN and IMAP/hostname at DOMAIN > >> you also have no host/hostname at DOMAIN > > Not sure how to interpret your template. Are you suggesting I should ... > > > > addent -password -p IMAP/mail at HPRS.LOCAL -k 1 -e arcfour-hmac > > addent -password -p imap/mail at HPRS.LOCAL -k 1 -e arcfour-hmac > > > > (one IMAP uppercase and one lowercase?) > > > > I don't get your distinction between host and hostname in your 3rd example: host/hostname at DOMAIN > > > > Meanwhile ... > > > > Tried a bunch of things. No go so far. In fact, I'm questioning if gssapi is enabled in my > > dovecot. I did rebuild and reinstall using `./configure --with-gssapi=yes`, but if I only > > enable gssapi authentication, I get "No authenticators available" (mail client). How can I > > verify gssapi is really available? dovecot --build-options shows: > > > > Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 > > Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail > > SQL drivers: > > Passdb: checkpassword passwd passwd-file shadow > > Userdb: checkpassword nss passwd prefetch passwd-file > > > > should I see authentication methods there? > > > > --Mark > > > > -----Original Message----- > > Subject: Re: Looking for GSSAPI config [was: Looking for NTLM config example] > > To: dovecot at dovecot.org > > From: Aki Tuomi > > Organization: Dovecot Oy > > Date: Thu, 30 Jun 2016 09:58:14 +0300 > > > > I think the problem still is that your keytab file has no entry > > imap/hostname at DOMAIN and IMAP/hostname at DOMAIN > > > > you also have no host/hostname at DOMAIN > > > > Aki > > > > On 29.06.2016 18:40, Mark Foley wrote: > >> Yes, I think that's exactly correct. I just made a similar reply to Edgar Pettijohn about that. > >> The Thunderbird message is: > >> > >> "The Kerberos/GSSAPI ticket was not accepted by the IMAP server mark at ohprs.org. Please check > >> that you are logged in to the Kerberos/GSSAPI realm." > >> > >> I made further comments in that message that I won't clutter the list by repeating here. Check > >> out that message and see what you think could be wrong. > >> > >> Thanks for your help! I'm sure this is solvable! > >> > >> --Mark > >> > >> -----Original Message----- > >>> Date: Wed, 29 Jun 2016 08:03:14 -0400 > >>> Subject: Re: Looking for GSSAPI config [was: Looking for NTLM config example] > >>> From: brendan kearney > >>> To: Mark Foley > >>> Cc: dovecot at dovecot.org > >>> > >>> The last log line shows "user=<>". This indicates no credentials were > >>> presented. If the rip field matches the client ip you tested from, I would > >>> bet the appropriate kerberos ticket (imap/host.domain.tld at REALM) was not > >>> pulled for the authentication. > >>> On Jun 28, 2016 11:33 PM, "Mark Foley" wrote: > >> [deleted] > From odhiambo at gmail.com Fri Jul 1 18:03:29 2016 From: odhiambo at gmail.com (Odhiambo Washington) Date: Fri, 1 Jul 2016 21:03:29 +0300 Subject: v2.2.25 released In-Reply-To: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> References: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> Message-ID: On 1 July 2016 at 17:36, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz.sig > > On FreeBSD 9.3 i386, [wash at gw ~/Tools/Dovecot/2.2/dovecot-2.2.25]$ gcc -v Using built-in specs. Target: i386-undermydesk-freebsd Configured with: FreeBSD/i386 system compiler Thread model: posix gcc version 4.2.1 20070831 patched [FreeBSD] .... libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/local/include -MT file-set-size.lo -MD -MP -MF .deps/file-set-size.Tpo -c file-set-size.c -fPIC -DPIC -o .libs/file-set-size.o libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/local/include -MT file-set-size.lo -MD -MP -MF .deps/file-set-size.Tpo -c file-set-size.c -o file-set-size.o >/dev/null 2>&1 mv -f .deps/file-set-size.Tpo .deps/file-set-size.Plo /bin/sh ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/local/include -MT guid.lo -MD -MP -MF .deps/guid.Tpo -c -o guid.lo guid.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/local/include -MT guid.lo -MD -MP -MF .deps/guid.Tpo -c guid.c -fPIC -DPIC -o .libs/guid.o In file included from guid.c:6: sha1.h:80: error: static or type qualifiers in abstract declarator Makefile:1118: recipe for target 'guid.lo' failed gmake[4]: *** [guid.lo] Error 1 gmake[4]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src/lib' Makefile:840: recipe for target 'all' failed gmake[3]: *** [all] Error 2 gmake[3]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src/lib' Makefile:490: recipe for target 'all-recursive' failed gmake[2]: *** [all-recursive] Error 1 gmake[2]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src' Makefile:618: recipe for target 'all-recursive' failed gmake[1]: *** [all-recursive] Error 1 gmake[1]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25' Makefile:462: recipe for target 'all' failed gmake: *** [all] Error 2 -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft." From odhiambo at gmail.com Fri Jul 1 18:10:39 2016 From: odhiambo at gmail.com (Odhiambo Washington) Date: Fri, 1 Jul 2016 21:10:39 +0300 Subject: v2.2.25 released In-Reply-To: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> References: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> Message-ID: On 1 July 2016 at 17:36, Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz.sig > > Some minor fixes and (mainly logging) improvements since rc1. > > * lmtp: Start tracking lmtp_user_concurrency_limit and reject > already > at RCPT TO stage. This avoids MTA unnecessarily completing DATA > only > to get an error. > * doveadm: Previously only mail settings were read from protocol > doveadm { .. } section. Now all settings are. > > + quota: Added quota_over_flag_lazy_check setting. It avoids > checking > quota_over_flag always at startup. Instead it's checked only when > quota is being read for some other purpose. > + auth: Added a new auth policy service: > http://wiki2.dovecot.org/Authentication/Policy > + auth: Added PBKDF2 password scheme > + auth: Added %{auth_user}, %{auth_username} and %{auth_domain} > + auth: Added ":remove" suffix to extra field names to remove them. > + auth: Added "delay_until=[+]" passdb > extra field. The auth will wait until and optionally > some > randomness and then return success. > + dict proxy: Added idle_msecs= parameter. Support async > operations. > + Performance improvements for handling large mailboxes. > + Added lib-dcrypt API for providing cryptographic functions. > + Added "doveadm mailbox update" command > + imap commands' output now includes timing spent on the "syncing" > stage if it's larger than 0. > + cassandra: Added metrics= to connect setting to output > internal > statistics in JSON format every second to . > + doveadm mailbox delete: Added -e parameter to delete only empty > mailboxes. Added --unsafe option to quickly delete a mailbox, > bypassing lazy_expunge and quota plugins. > + doveadm user & auth cache flush are now available via > doveadm-server. > + doveadm service stop will stop specified services > while > leaving the rest of Dovecot running. > + quota optimization: Avoid reading mail sizes for backends which > don't need them (count, fs, dirsize) > + Added mailbox { autoexpunge_max_mails= } setting. > + Added welcome plugin: http://wiki2.dovecot.org/Plugins/Welcome > + fts: Added fts_autoindex_exclude setting. > - v2.2.24's MIME parser was assert-crashing on mails having > truncated > MIME headers. > - auth: With multiple userdbs the final success/failure result > wasn't > always correct. The last userdb's result was always used. > - doveadm backup was sometimes deleting entire mailboxes > unnecessarily. > - doveadm: Command -parameters weren't being sent to > doveadm-server. > - If dovecot.index read failed e.g. because mmap() reached VSZ > limit, > an empty index could have been opened instead, corrupting the > mailbox state. > - imapc: Fixed EXPUNGE handling when imapc_features didn't have > modseq. > - lazy-expunge: Fixed a crash when copying failed. Various other > fixes. > - fts-lucene: Fixed crash on index rescan. > - auth_stats=yes produced broken output > - dict-ldap: Various fixes > - dict-sql: NULL values crashed. Now they're treated as "not > found". > Also ... (21:13:24 <~/Tools/Dovecot/2.2/dovecot-2.2.25>) 0 $ gmake gmake all-recursive gmake[1]: Entering directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25' Making all in . gmake[2]: Entering directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25' /bin/bash ./update-version.sh . . gmake[2]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25' Making all in src gmake[2]: Entering directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src' Making all in lib-test gmake[3]: Entering directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src/lib-test' gmake[3]: Nothing to be done for 'all'. gmake[3]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src/lib-test' Making all in lib gmake[3]: Entering directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src/lib' gmake all-am gmake[4]: Entering directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src/lib' /bin/bash ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/local/include -MT guid.lo -MD -MP -MF .deps/guid.Tpo -c -o guid.lo guid.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/local/include -MT guid.lo -MD -MP -MF .deps/guid.Tpo -c guid.c -fPIC -DPIC -o .libs/guid.o In file included from guid.c:6: sha1.h:80: error: static or type qualifiers in abstract declarator Makefile:1118: recipe for target 'guid.lo' failed gmake[4]: *** [guid.lo] Error 1 gmake[4]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src/lib' Makefile:840: recipe for target 'all' failed gmake[3]: *** [all] Error 2 gmake[3]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src/lib' Makefile:490: recipe for target 'all-recursive' failed gmake[2]: *** [all-recursive] Error 1 gmake[2]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25/src' Makefile:618: recipe for target 'all-recursive' failed gmake[1]: *** [all-recursive] Error 1 gmake[1]: Leaving directory '/usr/home/wash/Tools/Dovecot/2.2/dovecot-2.2.25' Makefile:462: recipe for target 'all' failed gmake: *** [all] Error 2 (21:13:26 <~/Tools/Dovecot/2.2/dovecot-2.2.25>) 0 $ uname -a FreeBSD gw.kictanet.or.ke 8.4-STABLE FreeBSD 8.4-STABLE #3: Sun May 17 14:55:55 EAT 2015 root at gw.kictanet.or.ke:/usr/obj/usr/src/sys/GW i386 (21:13:40 <~/Tools/Dovecot/2.2/dovecot-2.2.25>) 0 $ -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft." From idefix at fechner.net Fri Jul 1 18:21:21 2016 From: idefix at fechner.net (Matthias Fechner) Date: Fri, 1 Jul 2016 20:21:21 +0200 Subject: v2.2.25 released In-Reply-To: References: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> Message-ID: <195ecc37-0d3c-5377-daac-0e0c046f84d8@fechner.net> Am 01.07.2016 um 20:10 schrieb Odhiambo Washington: > (21:13:26 <~/Tools/Dovecot/2.2/dovecot-2.2.25>) 0 $ uname -a > FreeBSD gw.kictanet.or.ke 8.4-STABLE FreeBSD 8.4-STABLE #3: Sun May 17 > 14:55:55 EAT 2015 root at gw.kictanet.or.ke:/usr/obj/usr/src/sys/GW i386 > (21:13:40 <~/Tools/Dovecot/2.2/dovecot-2.2.25>) 0 $ FreeBSD 8.4 is not supported anymore, you should upgrade at least to 9.3 better 10.3. Gru? Matthias -- "Programming today is a race between software engineers striving to build bigger and better idiot-proof programs, and the universe trying to produce bigger and better idiots. So far, the universe is winning." -- Rich Cook From adamw at adamw.org Sat Jul 2 00:30:09 2016 From: adamw at adamw.org (Adam Weinberger) Date: Fri, 1 Jul 2016 18:30:09 -0600 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> Message-ID: <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> > On 1 Jul, 2016, at 10:52, Timo Sirainen wrote: > > On 01 Jul 2016, at 19:39, Adam Weinberger wrote: >> >> Hi, >> >> 2.2.25 crashes on FreeBSD with a kqueue-related message. I see references to something similar (http://www.dovecot.org/list/dovecot/2012-February.txt) from a couple years ago. >> >> I get: >> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor >> >> It's not dumping core, and I get the message even with "protocols =" >> >> Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? > > gdb backtrace: http://dovecot.org/bugreport.html#coredumps > Fuller logs attached. Thanks for your help, Timo. # Adam Okay. Here's my steps: 1) Install 2.2.5 into fresh i386 FreeBSD 10.3-RELEASE-p5 jail. 2) Built with the following settings: root at apnoea-builder:/usr/ports/mail/dovecot2 # make -V CONFIGURE_ARGS --localstatedir=/var --with-statedir=/var/db/dovecot --without-shadow --with-docs --with-ioloop=kqueue --with-notify=kqueue --without-libwrap --with-ssl=openssl --without-vpopmail --without-gssapi --without-cdb --without-ldap --without-mysql --without-pgsql --without-sqlite --without-icu --without-lucene --without-solr --without-textcat --prefix=/usr/local ${_LATE_CONFIGURE_ARGS} 3) Copied files into place and made following changes: root at apnoea-builder:/usr/ports/mail/dovecot2 # dovecot -n # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.3-RELEASE-p5 i386 auth_debug = yes auth_verbose = yes log_path = /var/log/dovelog mail_debug = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } ssl = no userdb { driver = passwd } 4. Started dovecot root at apnoea-builder:/usr/ports/mail/dovecot2 # /usr/local/sbin/dovecot -c /usr/local/etc/dovecot/dovecot.conf Last died with error (see error log for more information): kevent(EV_ADD, READ, 57) failed: Bad file descriptor root at apnoea-builder:~ # tail /var/log/dovelog Jul 02 00:15:56 master: Info: Dovecot v2.2.25 (7be1766) starting up for imap, pop3, lmtp Jul 02 00:15:56 master: Panic: kevent(EV_ADD, READ, 57) failed: Bad file descriptor 5. Backtrace root at apnoea-builder:~ # gdb /usr/local/sbin/dovecot /dovecot.core This GDB was configured as "i386-marcel-freebsd"... Core was generated by `dovecot'. Program terminated with signal 6, Aborted. Reading symbols from /usr/local/lib/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/local/lib/dovecot/libdovecot.so.0 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x28295237 in thr_kill () from /lib/libc.so.7 (gdb) bt #0 0x28295237 in thr_kill () from /lib/libc.so.7 #1 0x2829522a in raise () from /lib/libc.so.7 #2 0x28295176 in abort () from /lib/libc.so.7 #3 0x2815aea2 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 #4 0x2815b686 in i_syslog_fatal_handler (ctx=0xffffaaf0, format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m", args=0xffffab24 "8") at failures.c:418 #5 0x0804dfd1 in master_fatal_callback (ctx=0xffffaaf0, format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m", args=0xffffab24 "8") at main.c:167 #6 0x2815b23a in i_panic (format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m") at failures.c:275 #7 0x28185e10 in io_loop_handle_add (io=0x288843a0) at ioloop-kqueue.c:67 #8 0x281815a8 in io_add_file (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:59 #9 0x281813a6 in io_add (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:81 #10 0x2818a666 in lib_signals_set_handler (signo=1, flags=3, handler=0x804e6c0 , context=0x0) at lib-signals.c:243 #11 0x0804e129 in main_init (set=0x2881d098) at main.c:518 #12 0x0804d562 in main (argc=3, argv=0xffffae08) at main.c:890 (gdb) bt full #0 0x28295237 in thr_kill () from /lib/libc.so.7 No symbol table info available. #1 0x2829522a in raise () from /lib/libc.so.7 No symbol table info available. #2 0x28295176 in abort () from /lib/libc.so.7 No symbol table info available. #3 0x2815aea2 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x0 #4 0x2815b686 in i_syslog_fatal_handler (ctx=0xffffaaf0, format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m", args=0xffffab24 "8") at failures.c:418 status = 0 #5 0x0804dfd1 in master_fatal_callback (ctx=0xffffaaf0, format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m", args=0xffffab24 "8") at main.c:167 path = 0x28803810 "master-fatal.lastlog" str = 0x28803860 "kevent(EV_ADD, READ, 56) failed: Bad file descriptor" args2 = 0xffffab24 "8" pid = 94804 fd = -1 #6 0x2815b23a in i_panic (format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = 0xffffab24 "8" #7 0x28185e10 in io_loop_handle_add (io=0x288843a0) at ioloop-kqueue.c:67 ctx = (struct ioloop_handler_context *) 0x288131d0 ev = {ident = 56, filter = -1, flags = 1, fflags = 0, data = 0, udata = 0x288843a0} #8 0x281815a8 in io_add_file (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:59 io = (struct io_file *) 0x288843a0 #9 0x281813a6 in io_add (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:81 io = (struct io_file *) 0xffffac80 #10 0x2818a666 in lib_signals_set_handler (signo=1, flags=3, handler=0x804e6c0 , context=0x0) at lib-signals.c:243 h = (struct signal_handler *) 0x2805e079 #11 0x0804e129 in main_init (set=0x2881d098) at main.c:518 No locals. #12 0x0804d562 in main (argc=3, argv=0xffffae08) at main.c:890 _data_stack_cur_id = 2 set = (struct master_settings *) 0x2881d098 error = 0x282f42cf "\215e?[]?", '\220' , "U\211?SWV\203?\020\211M??" doveconf_arg = 0x0 orig_info_callback = (failure_callback_t *) 0x2815b800 orig_debug_callback = (failure_callback_t *) 0x2815b800 foreground = false ask_key_pass = false i = 3 c = -1 doubleopts = From adamw at adamw.org Sat Jul 2 00:46:16 2016 From: adamw at adamw.org (Adam Weinberger) Date: Fri, 1 Jul 2016 18:46:16 -0600 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> Message-ID: > On 1 Jul, 2016, at 18:30, Adam Weinberger wrote: > >> On 1 Jul, 2016, at 10:52, Timo Sirainen wrote: >> >> On 01 Jul 2016, at 19:39, Adam Weinberger wrote: >>> >>> Hi, >>> >>> 2.2.25 crashes on FreeBSD with a kqueue-related message. I see references to something similar (http://www.dovecot.org/list/dovecot/2012-February.txt) from a couple years ago. >>> >>> I get: >>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor >>> >>> It's not dumping core, and I get the message even with "protocols =" >>> >>> Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? >> >> gdb backtrace: http://dovecot.org/bugreport.html#coredumps >> > > Fuller logs attached. Thanks for your help, Timo. > > # Adam > > > Okay. Here's my steps: > 1) Install 2.2.5 into fresh i386 FreeBSD 10.3-RELEASE-p5 jail. > > 2) Built with the following settings: > root at apnoea-builder:/usr/ports/mail/dovecot2 # make -V CONFIGURE_ARGS > --localstatedir=/var --with-statedir=/var/db/dovecot --without-shadow --with-docs --with-ioloop=kqueue --with-notify=kqueue --without-libwrap --with-ssl=openssl --without-vpopmail --without-gssapi --without-cdb --without-ldap --without-mysql --without-pgsql --without-sqlite --without-icu --without-lucene --without-solr --without-textcat --prefix=/usr/local ${_LATE_CONFIGURE_ARGS} Just a follow-up: it runs without dumping core if I build with "--with-ioloop=poll --with-notify=none". # Adam -- Adam Weinberger adamw at adamw.org http://www.adamw.org From news at mefox.org Sat Jul 2 00:55:44 2016 From: news at mefox.org (Michael Fox) Date: Fri, 1 Jul 2016 17:55:44 -0700 Subject: quota-status service Message-ID: <051101d1d3fc$7710e3f0$6532abd0$@mefox.org> ??? From: Michael Fox [mailto:news at mefox.org] Sent: Thursday, June 30, 2016 1:59 PM To: Dovecot Mailing List (dovecot at dovecot.org) Subject: quota-status service I'm trying to understand the quota-status service, but I can't find complete documentation. The quota-status service is mentioned here: http://wiki.dovecot.org/Quota And an example configuration is shown: service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 # You can choose any port you want } client_limit = 1 } But I can't find any information on quota-status. "man quota-status" returns nothing. I am unable to find a "quota-status" file on my machine. Where is the executable located? What does the "-p postfix" option do? Are there any other command line options? The above wiki page shows three quota_status_* options in use: quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" Where are their meanings documented? What are the allowed values? Are there other quota_status_* options? Thanks in advance. Thanks, Michael From bc979 at lafn.org Sat Jul 2 09:16:51 2016 From: bc979 at lafn.org (Doug Hardie) Date: Sat, 2 Jul 2016 02:16:51 -0700 Subject: Deletion of mail from Junk mailbox Message-ID: <887B5445-CC35-4765-AAB0-B380D1609E85@lafn.org> I have a pigeon sive running which directs some of my received mail to the Junk folder. That works just fine. However, a couple minutes later, it is moved to Deleted mailbox and deleted from Junk. At first I thought my client was doing that so I shut down the client and it still happens. Here are the log entries: Jul 2 00:36:31 mail dovecot: imap(doug): copy from INBOX: box=Junk, uid=10842, msgid=, size=3340, from="jnilj"
Jul 2 00:36:31 mail dovecot: imap(doug): delete: box=INBOX, uid=55719, msgid=, size=3340, from="jnilj"
Jul 2 00:39:33 mail dovecot: imap(doug): copy from Junk: box=Deleted Messages, uid=31049, msgid=, size=3340, from="jnilj"
Jul 2 00:39:33 mail dovecot: imap(doug): delete: box=Junk, uid=10842, msgid=, size=3340, from="jnilj"
Jul 2 00:50:29 mail dovecot: imap(doug): expunge: box=Junk, uid=10842, msgid=, size=3340, from="jnilj"
Jul 2 00:50:29 mail dovecot: imap(doug): expunge: box=INBOX, uid=55719, msgid=, size=3340, from="jnilj"
Is this the intended way the Junk maibox is supposed to work? I couldn't find any settings that appear to control (or affect) this behavior. ? Doug From noel.butler at ausics.net Sat Jul 2 09:29:23 2016 From: noel.butler at ausics.net (Noel Butler) Date: Sat, 02 Jul 2016 19:29:23 +1000 Subject: Deletion of mail from Junk mailbox In-Reply-To: <887B5445-CC35-4765-AAB0-B380D1609E85@lafn.org> References: <887B5445-CC35-4765-AAB0-B380D1609E85@lafn.org> Message-ID: <79e13d3bcdf48536b95e7978e6939141@ausics.net> On 02/07/2016 19:16, Doug Hardie wrote: > I have a pigeon sive running which directs some of my received mail to > the Junk folder. That works just fine. However, a couple minutes > later, it is moved to Deleted mailbox and deleted from Junk. At first > I thought my client was doing that so I shut down the client and it > still happens. Here are the log entries: > > Jul 2 00:36:31 mail dovecot: imap(doug): copy from INBOX: box=Junk, > uid=10842, msgid=, size=3340, > from="jnilj"
> Jul 2 00:36:31 mail dovecot: imap(doug): delete: box=INBOX, > uid=55719, msgid=, size=3340, > from="jnilj"
> Jul 2 00:39:33 mail dovecot: imap(doug): copy from Junk: box=Deleted > Messages, uid=31049, msgid=, > size=3340, from="jnilj"
> Jul 2 00:39:33 mail dovecot: imap(doug): delete: box=Junk, uid=10842, > msgid=, size=3340, from="jnilj" >
> Jul 2 00:50:29 mail dovecot: imap(doug): expunge: box=Junk, > uid=10842, msgid=, size=3340, > from="jnilj"
> Jul 2 00:50:29 mail dovecot: imap(doug): expunge: box=INBOX, > uid=55719, msgid=, size=3340, > from="jnilj"
> > Is this the intended way the Junk maibox is supposed to work? I > couldn't find any settings that appear to control (or affect) this > behavior. > > ? Doug and your dovecot version is? I suggest you'll also need to show doveconf -n and example of sieve rules, because it doesnt seem right, certainly does not do that here. -- If you have the urge to reply to all rather than reply to list, you best first read http://members.ausics.net/qwerty/ From sysadmin at e-positive.ee Sat Jul 2 15:56:55 2016 From: sysadmin at e-positive.ee (Mart Pirita) Date: Sat, 2 Jul 2016 18:56:55 +0300 Subject: Dovecot 2.2.25 compiling error Message-ID: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> Hello. I cant build 2.2.25, but I can build fine version 2.2.24 with same options: RedHat based customized distro, 2.6.28.10 kernel Build options: export CPPFLAGS export LDFLAGS CPPFLAGS=-I/usr/local/ssl/include LDFLAGS=-L/usr/local/ssl/lib ./configure \ --prefix=/usr \ --with-ssl=openssl \ --with-ssldir=/etc/ssl \ --sysconfdir=/etc \ --without-vpopmail \ --with-pam \ --without-bsdauth \ --without-sql \ --without-nss \ --without-ldap \ --without-pgsql \ --without-mysql \ --without-sqlite \ --with-rundir=/var/run/dovecot\ --without-deliver \ --without-gssapi Build error: libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I/usr/local/ssl/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -MT guid.lo -MD -MP -MF .deps/guid.Tpo -c guid.c -fPIC -DPIC -o .libs/guid.o In file included from guid.c:6: sha1.h:80: error: static or type qualifiers in abstract declarator make[4]: *** [guid.lo] Error 1 make[4]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src/lib' make[3]: *** [all] Error 2 make[3]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src/lib' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25' make: *** [all] Error 2 Please advise? -- Mart From ad+lists at uni-x.org Sat Jul 2 16:55:27 2016 From: ad+lists at uni-x.org (Alexander Dalloz) Date: Sat, 2 Jul 2016 18:55:27 +0200 Subject: Dovecot 2.2.25 compiling error In-Reply-To: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> References: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> Message-ID: Am 02.07.2016 um 17:56 schrieb Mart Pirita: > Hello. > > I cant build 2.2.25, but I can build fine version 2.2.24 with same options: > > RedHat based customized distro, 2.6.28.10 kernel http://dovecot.org/pipermail/dovecot/2016-July/104798.html Alexander From aki.tuomi at dovecot.fi Sat Jul 2 16:58:07 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sat, 2 Jul 2016 19:58:07 +0300 (EEST) Subject: Dovecot 2.2.25 compiling error In-Reply-To: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> References: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> Message-ID: <361807399.1509.1467478687848@appsuite-dev.open-xchange.com> > On July 2, 2016 at 6:56 PM Mart Pirita wrote: > > > Hello. > > I cant build 2.2.25, but I can build fine version 2.2.24 with same options: > > RedHat based customized distro, 2.6.28.10 kernel > > Build options: > > export CPPFLAGS > export LDFLAGS > > CPPFLAGS=-I/usr/local/ssl/include > LDFLAGS=-L/usr/local/ssl/lib > > ./configure \ > --prefix=/usr \ > --with-ssl=openssl \ > --with-ssldir=/etc/ssl \ > --sysconfdir=/etc \ > --without-vpopmail \ > --with-pam \ > --without-bsdauth \ > --without-sql \ > --without-nss \ > --without-ldap \ > --without-pgsql \ > --without-mysql \ > --without-sqlite \ > --with-rundir=/var/run/dovecot\ > --without-deliver \ > --without-gssapi > > Build error: > > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. > -I/usr/local/ssl/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes > -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 > -Wbad-function-cast -fno-builtin-strftime -MT guid.lo -MD -MP -MF > .deps/guid.Tpo -c guid.c -fPIC -DPIC -o .libs/guid.o > In file included from guid.c:6: > sha1.h:80: error: static or type qualifiers in abstract declarator > make[4]: *** [guid.lo] Error 1 > make[4]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src/lib' > make[3]: *** [all] Error 2 > make[3]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src/lib' > make[2]: *** [all-recursive] Error 1 > make[2]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src' > make[1]: *** [all-recursive] Error 1 > make[1]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25' > make: *** [all] Error 2 > > > Please advise? > > > -- > Mart This has been fixed in https://github.com/dovecot/core/commit/f54d511597447e40f5413716c10520a7229364f1 --- Aki Tuomi Dovecot oy From aki.tuomi at dovecot.fi Sat Jul 2 17:03:43 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sat, 2 Jul 2016 20:03:43 +0300 (EEST) Subject: Dovecot 2.2.25 compiling error In-Reply-To: <361807399.1509.1467478687848@appsuite-dev.open-xchange.com> References: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> <361807399.1509.1467478687848@appsuite-dev.open-xchange.com> Message-ID: <938622260.1512.1467479024557@appsuite-dev.open-xchange.com> > On July 2, 2016 at 7:58 PM aki.tuomi at dovecot.fi wrote: > > > > > On July 2, 2016 at 6:56 PM Mart Pirita wrote: > > > > > > Hello. > > > > I cant build 2.2.25, but I can build fine version 2.2.24 with same options: > > > > RedHat based customized distro, 2.6.28.10 kernel > > > > Build options: > > > > export CPPFLAGS > > export LDFLAGS > > > > CPPFLAGS=-I/usr/local/ssl/include > > LDFLAGS=-L/usr/local/ssl/lib > > > > ./configure \ > > --prefix=/usr \ > > --with-ssl=openssl \ > > --with-ssldir=/etc/ssl \ > > --sysconfdir=/etc \ > > --without-vpopmail \ > > --with-pam \ > > --without-bsdauth \ > > --without-sql \ > > --without-nss \ > > --without-ldap \ > > --without-pgsql \ > > --without-mysql \ > > --without-sqlite \ > > --with-rundir=/var/run/dovecot\ > > --without-deliver \ > > --without-gssapi > > > > Build error: > > > > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. > > -I/usr/local/ssl/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes > > -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 > > -Wbad-function-cast -fno-builtin-strftime -MT guid.lo -MD -MP -MF > > .deps/guid.Tpo -c guid.c -fPIC -DPIC -o .libs/guid.o > > In file included from guid.c:6: > > sha1.h:80: error: static or type qualifiers in abstract declarator > > make[4]: *** [guid.lo] Error 1 > > make[4]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src/lib' > > make[3]: *** [all] Error 2 > > make[3]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src/lib' > > make[2]: *** [all-recursive] Error 1 > > make[2]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25/src' > > make[1]: *** [all-recursive] Error 1 > > make[1]: Leaving directory `/usr/src/redhat/BUILD/dovecot-2.2.25' > > make: *** [all] Error 2 > > > > > > Please advise? > > > > > > -- > > Mart > > This has been fixed in https://github.com/dovecot/core/commit/f54d511597447e40f5413716c10520a7229364f1 > > --- > Aki Tuomi > Dovecot oy Ah, no it wasn't for CentOS5. Sorry. Aki From sysadmin at e-positive.ee Sat Jul 2 17:24:14 2016 From: sysadmin at e-positive.ee (Mart Pirita) Date: Sat, 2 Jul 2016 20:24:14 +0300 Subject: Dovecot 2.2.25 compiling error In-Reply-To: References: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> Message-ID: <78874859-7b77-21b3-5532-d0f3221bb0d4@e-positive.ee> Alexander Dalloz wrote: > Am 02.07.2016 um 17:56 schrieb Mart Pirita: >> Hello. >> >> I cant build 2.2.25, but I can build fine version 2.2.24 with same options: >> >> RedHat based customized distro, 2.6.28.10 kernel > http://dovecot.org/pipermail/dovecot/2016-July/104798.html > But config.h does contain #define STATIC_ARRAY and does not contain #define STATIC_ARRAY static And also src/lib/macros.h does include the fix - https://github.com/dovecot/core/commit/f54d511597447e40f5413716c10520a7229364f1 So older systems can't upgrade anymore? -- Mart From aki.tuomi at dovecot.fi Sat Jul 2 17:49:10 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sat, 2 Jul 2016 20:49:10 +0300 (EEST) Subject: Dovecot 2.2.25 compiling error In-Reply-To: <78874859-7b77-21b3-5532-d0f3221bb0d4@e-positive.ee> References: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> <78874859-7b77-21b3-5532-d0f3221bb0d4@e-positive.ee> Message-ID: <1923195377.1515.1467481751046@appsuite-dev.open-xchange.com> > On July 2, 2016 at 8:24 PM Mart Pirita wrote: > > > Alexander Dalloz wrote: > > Am 02.07.2016 um 17:56 schrieb Mart Pirita: > >> Hello. > >> > >> I cant build 2.2.25, but I can build fine version 2.2.24 with same options: > >> > >> RedHat based customized distro, 2.6.28.10 kernel > > http://dovecot.org/pipermail/dovecot/2016-July/104798.html > > > > But config.h does contain #define STATIC_ARRAY and does not contain > #define STATIC_ARRAY static > > And also src/lib/macros.h does include the fix - https://github.com/dovecot/core/commit/f54d511597447e40f5413716c10520a7229364f1 > > So older systems can't upgrade anymore? > > -- > Mart We are considering stopping support for old distros because maintaining support for them is becoming increasingly difficult. Please consider upgrading your distribution instead? It is rather old. --- Aki Tuomi Dovecot oy From sysadmin at e-positive.ee Sat Jul 2 18:00:09 2016 From: sysadmin at e-positive.ee (Mart Pirita) Date: Sat, 2 Jul 2016 21:00:09 +0300 Subject: Dovecot 2.2.25 compiling error In-Reply-To: <1923195377.1515.1467481751046@appsuite-dev.open-xchange.com> References: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> <78874859-7b77-21b3-5532-d0f3221bb0d4@e-positive.ee> <1923195377.1515.1467481751046@appsuite-dev.open-xchange.com> Message-ID: aki.tuomi at dovecot.fi wrote: >> art > We are considering stopping support for old distros because maintaining support for them is becoming increasingly difficult. > > Please consider upgrading your distribution instead? It is rather old. > Well, don't do it on the middle of the v2.2, this is not the nice way, changing in the middle of version distribution requirements. Be flexible, do it for example since v2.3 or something like this. -- Mart From marti1234 at gmail.com Sat Jul 2 20:11:45 2016 From: marti1234 at gmail.com (Marti Markov) Date: Sat, 2 Jul 2016 21:11:45 +0100 Subject: Shared mailboxes not showing up in shared namespace In-Reply-To: References: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> Message-ID: I don?t seem to have that install on my Debian machine. But I have done this: 1 LIST "" % * LIST (\HasNoChildren) "/" confirmed-spam * LIST (\HasChildren) "/" Archive * LIST (\HasNoChildren \Sent) "/" Sent * LIST (\HasChildren \Trash) "/" Trash * LIST (\HasNoChildren) "/" Spam * LIST (\HasChildren) "/" Archives * LIST (\HasNoChildren \Drafts) "/" Drafts * LIST (\HasNoChildren \Junk) "/" Junk * LIST (\HasNoChildren) "/" Unwanted * LIST (\HasNoChildren) "/" confirmed-ham * LIST (\Noselect \HasChildren) "/" Public * LIST (\Noselect \HasNoChildren) "/" Shared * LIST (\HasNoChildren) "/" INBOX 1 OK List completed. 7 LIST * * * LIST (\HasNoChildren) "/" confirmed-spam * LIST (\HasChildren) "/" Archive * LIST (\HasNoChildren) "/" Archive/2015 * LIST (\HasNoChildren \Sent) "/" Sent * LIST (\HasChildren \Trash) "/" Trash * LIST (\HasNoChildren) "/" Trash/Junk * LIST (\HasNoChildren) "/" Spam * LIST (\HasChildren) "/" Archives * LIST (\HasNoChildren) "/" Archives/2015 * LIST (\HasNoChildren) "/" Archives/2011 * LIST (\HasNoChildren \Drafts) "/" Drafts * LIST (\HasNoChildren \Junk) "/" Junk * LIST (\HasNoChildren) "/" Unwanted * LIST (\HasNoChildren) "/" confirmed-ham * LIST (\Noselect \HasChildren) "/" Public * LIST (\HasNoChildren) "/" Public/office3 * LIST (\HasNoChildren) "/" Public/office4 * LIST (\Noselect \HasNoChildren) "/" Shared * LIST (\HasNoChildren) "/" INBOX 7 OK List completed. By connecting using `openssl` from a remote machine. > On 1 Jul 2016, at 09:02, Steffen Kaiser wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 30 Jun 2016, Marti Markov wrote: > >> I think I have configured everything correctly but for some reason I can?t get a list of the shared mailboxes to show up. >> >> When I run: >> >> doveadm acl debug -u m.markov Shared/d.marteva/INBOX >> >> >> doveadm(m.markov): Info: User d.marteva found from ACL shared dict >> doveadm(m.markov): Info: Mailbox Shared/d.marteva/INBOX is visible in LIST > > did you've tried: > > http://wiki2.dovecot.org/PreAuth > > /usr/local/libexec/dovecot/imap -u m.markov > 1 LIST "" "*" > 2 LOGOUT > > ? > > Maybe the client does not list them. > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBV3Yjqnz1H7kL/d9rAQIoSQgAvKFsSKxMdt82a/1p52bikwkje4YoqGjK > duStP9qG2AtkkRPbbNc8JWki20xixyW7XagIP39dGwd+yNVlkMZAVna0KGIFNUwk > 9eVC1lMPax9lc0kq7Fw+EqwpPtFwuGe41eAsyP3JE51VlEbnA74oPGadJJe/6cM8 > /3sMCxXC9PlxgoKhwFoqggnEeH0Dx6wkHqXsLT3lCnSwtQHX8ZaKlRkEaVBvTVvO > ogu/9V/RZH6mhiVdlcYEDXDNoAZ7dh7ZgLqI2nCJm1AoTjpAyjnskhFT+1l5sOC0 > +tEb7Rfl7zAp+eJy6X9RaX9nuDzIGSTRfHBeTV9rMVXrz005FYHZpg== > =uU9/ > -----END PGP SIGNATURE----- From goetz at suelze.de Fri Jul 1 22:05:33 2016 From: goetz at suelze.de (Goetz R Schultz) Date: Fri, 1 Jul 2016 23:05:33 +0100 Subject: Error on upgrade to 2.2.25 from 2.2.24 Message-ID: <5776E92D.8050107@suelze.de> Hi, I have compiled the latest version with those flags: ./configure --with-pgsql --with-sql under FreeBSD/amd64. This worked fine with the previous version. Compilation also works without errors. Yet when I start DC I get this error: Jul 1 22:48:55 section31 dovecot: master: Dovecot v2.2.25 () starting up for imap Jul 1 22:48:55 section31 dovecot: master: Panic: kevent(EV_ADD, READ, 55) failed: Bad file descriptor This does not hapen with the previous version. I could not find any change note that would point in that direction. Any clues? Did I miss something to set? -- Thanks and regards Goetz "I intend to live forever - so far, so good." =============================================== /"\ Get the rootcertificate at www.cacert.org \ / ASCII Ribbon Campaign against HTML e-mail X / \ Verify the cert @ CaCert.Com =============================================== "Si forte in alienas manus oberraverit hec peregrina epistola incertis ventis dimissa, sed Deo commendata, precamur ut ei reddatur cui soli destinata, nec preripiat quisquam non sibi parata." -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 2406 bytes Desc: S/MIME Cryptographic Signature URL: From tss at iki.fi Sun Jul 3 00:30:36 2016 From: tss at iki.fi (Timo Sirainen) Date: Sun, 3 Jul 2016 03:30:36 +0300 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> Message-ID: <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> On 02 Jul 2016, at 03:30, Adam Weinberger wrote: > >>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor >>> >>> It's not dumping core, and I get the message even with "protocols =" >>> >>> Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? >> >> gdb backtrace: http://dovecot.org/bugreport.html#coredumps >> > > Fuller logs attached. Thanks for your help, Timo. > > #6 0x2815b23a in i_panic (format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m") at failures.c:275 > #7 0x28185e10 in io_loop_handle_add (io=0x288843a0) at ioloop-kqueue.c:67 > #8 0x281815a8 in io_add_file (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:59 > #9 0x281813a6 in io_add (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:81 > #10 0x2818a666 in lib_signals_set_handler (signo=1, flags=3, handler=0x804e6c0 , context=0x0) at lib-signals.c:243 > #11 0x0804e129 in main_init (set=0x2881d098) at main.c:518 > #12 0x0804d562 in main (argc=3, argv=0xffffae08) at main.c:890 Weird. I haven't touched anything even close to that. Also kqueue works on my OSX. The only thing that comes to my mind is https://github.com/dovecot/core/commit/fde7b8a03bf91cfa5bb7ca3e84545386243fa0d2 Does it happen to work if you use the attached patch? -------------- next part -------------- A non-text attachment was scrubbed... Name: diff Type: application/octet-stream Size: 6057 bytes Desc: not available URL: From news at mefox.org Sun Jul 3 06:00:41 2016 From: news at mefox.org (Michael Fox) Date: Sat, 2 Jul 2016 23:00:41 -0700 Subject: FW: quota-status service In-Reply-To: <051101d1d3fc$7710e3f0$6532abd0$@mefox.org> References: <051101d1d3fc$7710e3f0$6532abd0$@mefox.org> Message-ID: <00f201d1d4f0$3b454510$b1cfcf30$@mefox.org> ??? 3rd request -----Original Message----- From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Michael Fox Sent: Friday, July 1, 2016 5:56 PM To: Dovecot Mailing List Subject: RE: quota-status service ??? From: Michael Fox [mailto:news at mefox.org] Sent: Thursday, June 30, 2016 1:59 PM To: Dovecot Mailing List (dovecot at dovecot.org) Subject: quota-status service I'm trying to understand the quota-status service, but I can't find complete documentation. The quota-status service is mentioned here: http://wiki.dovecot.org/Quota And an example configuration is shown: service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 # You can choose any port you want } client_limit = 1 } But I can't find any information on quota-status. "man quota-status" returns nothing. I am unable to find a "quota-status" file on my machine. Where is the executable located? What does the "-p postfix" option do? Are there any other command line options? The above wiki page shows three quota_status_* options in use: quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is full" Where are their meanings documented? What are the allowed values? Are there other quota_status_* options? Thanks in advance. Thanks, Michael From aki.tuomi at dovecot.fi Sun Jul 3 08:43:16 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Sun, 03 Jul 2016 11:43:16 +0300 Subject: FW: quota-status service Message-ID: If you need fast and timely support you can contact OX sales for an support agreement . It is somewhat impolite to except such from a public mailing list over weekend. ---Aki TuomiDovecot oy -------- Original message --------From: Michael Fox Date: 03/07/2016 09:00 (GMT+02:00) To: Dovecot Mailing List Subject: FW: quota-status service ??? 3rd request -----Original Message----- From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Michael Fox Sent: Friday, July 1, 2016 5:56 PM To: Dovecot Mailing List Subject: RE: quota-status service ??? From: Michael Fox [mailto:news at mefox.org] Sent: Thursday, June 30, 2016 1:59 PM To: Dovecot Mailing List (dovecot at dovecot.org) Subject: quota-status service I'm trying to understand the quota-status service, but I can't find complete documentation. The quota-status service is mentioned here:? http://wiki.dovecot.org/Quota And an example configuration is shown: service quota-status { ??? executable = quota-status -p postfix ??? inet_listener { ??????? port = 12340 ??????? # You can choose any port you want ??? } ??? client_limit = 1 } But I can't find any information on quota-status. "man quota-status" returns nothing. I am unable to find a "quota-status" file on my machine.? Where is the executable located? What does the "-p postfix" option do? Are there any other command line options? The above wiki page shows three quota_status_* options in use: ??? quota_status_success = DUNNO ??? quota_status_nouser = DUNNO ??? quota_status_overquota = "552 5.2.2 Mailbox is full" Where are their meanings documented? What are the allowed values? Are there other quota_status_* options? Thanks in advance. Thanks, Michael From pch at myzel.net Sun Jul 3 09:06:35 2016 From: pch at myzel.net (Peter Chiochetti) Date: Sun, 3 Jul 2016 11:06:35 +0200 Subject: FW: quota-status service In-Reply-To: References: Message-ID: <5778D59B.30402@myzel.net> Am 2016-07-03 um 10:43 schrieb Aki Tuomi: > If you need fast and timely support you can contact OX sales for an support agreement . It is somewhat impolite to except such from a public mailing list over weekend. Nah, expecting such can be unreasonable, Impolite though the manner of expression > ---Aki TuomiDovecot oy > -------- Original message --------From: Michael Fox Date: 03/07/2016 09:00 (GMT+02:00) To: Dovecot Mailing List Subject: FW: quota-status service > ??? 3rd request > > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Michael Fox > Sent: Friday, July 1, 2016 5:56 PM > To: Dovecot Mailing List > Subject: RE: quota-status service > > ??? > > > > From: Michael Fox [mailto:news at mefox.org] > Sent: Thursday, June 30, 2016 1:59 PM > To: Dovecot Mailing List (dovecot at dovecot.org) > Subject: quota-status service -- peter From aki.tuomi at dovecot.fi Sun Jul 3 14:04:59 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 3 Jul 2016 17:04:59 +0300 (EEST) Subject: Shared mailboxes not showing up in shared namespace In-Reply-To: References: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> Message-ID: <1617072920.1542.1467554700648@appsuite-dev.open-xchange.com> You should have it. Otherwise imap wouldn't work. It's probably under /usr/lib/dovecot or /usr/lib/x86_64/dovecot Aki > On July 2, 2016 at 11:11 PM Marti Markov wrote: > > > I don?t seem to have that install on my Debian machine. > > But I have done this: > > 1 LIST "" % > * LIST (\HasNoChildren) "/" confirmed-spam > * LIST (\HasChildren) "/" Archive > * LIST (\HasNoChildren \Sent) "/" Sent > * LIST (\HasChildren \Trash) "/" Trash > * LIST (\HasNoChildren) "/" Spam > * LIST (\HasChildren) "/" Archives > * LIST (\HasNoChildren \Drafts) "/" Drafts > * LIST (\HasNoChildren \Junk) "/" Junk > * LIST (\HasNoChildren) "/" Unwanted > * LIST (\HasNoChildren) "/" confirmed-ham > * LIST (\Noselect \HasChildren) "/" Public > * LIST (\Noselect \HasNoChildren) "/" Shared > * LIST (\HasNoChildren) "/" INBOX > 1 OK List completed. > 7 LIST * * > * LIST (\HasNoChildren) "/" confirmed-spam > * LIST (\HasChildren) "/" Archive > * LIST (\HasNoChildren) "/" Archive/2015 > * LIST (\HasNoChildren \Sent) "/" Sent > * LIST (\HasChildren \Trash) "/" Trash > * LIST (\HasNoChildren) "/" Trash/Junk > * LIST (\HasNoChildren) "/" Spam > * LIST (\HasChildren) "/" Archives > * LIST (\HasNoChildren) "/" Archives/2015 > * LIST (\HasNoChildren) "/" Archives/2011 > * LIST (\HasNoChildren \Drafts) "/" Drafts > * LIST (\HasNoChildren \Junk) "/" Junk > * LIST (\HasNoChildren) "/" Unwanted > * LIST (\HasNoChildren) "/" confirmed-ham > * LIST (\Noselect \HasChildren) "/" Public > * LIST (\HasNoChildren) "/" Public/office3 > * LIST (\HasNoChildren) "/" Public/office4 > * LIST (\Noselect \HasNoChildren) "/" Shared > * LIST (\HasNoChildren) "/" INBOX > 7 OK List completed. > > By connecting using `openssl` from a remote machine. > > > On 1 Jul 2016, at 09:02, Steffen Kaiser wrote: > > > > -----BEGIN PGP SIGNED MESSAGE----- > > Hash: SHA1 > > > > On Thu, 30 Jun 2016, Marti Markov wrote: > > > >> I think I have configured everything correctly but for some reason I can?t get a list of the shared mailboxes to show up. > >> > >> When I run: > >> > >> doveadm acl debug -u m.markov Shared/d.marteva/INBOX > >> > >> > >> doveadm(m.markov): Info: User d.marteva found from ACL shared dict > >> doveadm(m.markov): Info: Mailbox Shared/d.marteva/INBOX is visible in LIST > > > > did you've tried: > > > > http://wiki2.dovecot.org/PreAuth > > > > /usr/local/libexec/dovecot/imap -u m.markov > > 1 LIST "" "*" > > 2 LOGOUT > > > > ? > > > > Maybe the client does not list them. > > > > - -- Steffen Kaiser > > -----BEGIN PGP SIGNATURE----- > > Version: GnuPG v1 > > > > iQEVAwUBV3Yjqnz1H7kL/d9rAQIoSQgAvKFsSKxMdt82a/1p52bikwkje4YoqGjK > > duStP9qG2AtkkRPbbNc8JWki20xixyW7XagIP39dGwd+yNVlkMZAVna0KGIFNUwk > > 9eVC1lMPax9lc0kq7Fw+EqwpPtFwuGe41eAsyP3JE51VlEbnA74oPGadJJe/6cM8 > > /3sMCxXC9PlxgoKhwFoqggnEeH0Dx6wkHqXsLT3lCnSwtQHX8ZaKlRkEaVBvTVvO > > ogu/9V/RZH6mhiVdlcYEDXDNoAZ7dh7ZgLqI2nCJm1AoTjpAyjnskhFT+1l5sOC0 > > +tEb7Rfl7zAp+eJy6X9RaX9nuDzIGSTRfHBeTV9rMVXrz005FYHZpg== > > =uU9/ > > -----END PGP SIGNATURE----- From edgar at pettijohn-web.com Sun Jul 3 14:10:04 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sun, 3 Jul 2016 09:10:04 -0500 Subject: kqueue crash on FreeBSD with 2.2.25 and OpenBSD In-Reply-To: <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> Message-ID: <20160703141004.GA90637@thinkpad.my.domain> On 16-07-03 03:30:36, Timo Sirainen wrote: > On 02 Jul 2016, at 03:30, Adam Weinberger wrote: > > > >>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor > >>> > >>> It's not dumping core, and I get the message even with "protocols =" > >>> > >>> Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? > >> > >> gdb backtrace: http://dovecot.org/bugreport.html#coredumps > >> > > > > Fuller logs attached. Thanks for your help, Timo. > > > > #6 0x2815b23a in i_panic (format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m") at failures.c:275 > > #7 0x28185e10 in io_loop_handle_add (io=0x288843a0) at ioloop-kqueue.c:67 > > #8 0x281815a8 in io_add_file (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:59 > > #9 0x281813a6 in io_add (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:81 > > #10 0x2818a666 in lib_signals_set_handler (signo=1, flags=3, handler=0x804e6c0 , context=0x0) at lib-signals.c:243 > > #11 0x0804e129 in main_init (set=0x2881d098) at main.c:518 > > #12 0x0804d562 in main (argc=3, argv=0xffffae08) at main.c:890 > > Weird. I haven't touched anything even close to that. Also kqueue works on my OSX. The only thing that comes to my mind is https://github.com/dovecot/core/commit/fde7b8a03bf91cfa5bb7ca3e84545386243fa0d2 > > Does it happen to work if you use the attached patch? > Looks like its an issue on OpenBSD -current as well. This GDB was configured as "i386-unknown-openbsd6.0"... Core was generated by `dovecot'. Program terminated with signal 6, Aborted. Loaded symbols for /home/edgar/sbin/dovecot Reading symbols from /home/edgar/lib/dovecot/libdovecot.so.0.0...done. Loaded symbols for /home/edgar/lib/dovecot/libdovecot.so.0.0 Reading symbols from /usr/lib/libc.so.88.0...done. Loaded symbols for /usr/lib/libc.so.88.0 Reading symbols from /usr/libexec/ld.so...done. Loaded symbols for /usr/libexec/ld.so #0 0x0d8ca24f in thrkill () at :2 2 : No such file or directory. in (gdb) bt #0 0x0d8ca24f in thrkill () at :2 #1 0x0d8cd691 in *_libc_raise (s=6) at /usr/src/lib/libc/gen/raise.c:37 #2 0x0d8cb8fc in *_libc_abort () at /usr/src/lib/libc/stdlib/abort.c:52 #3 0x092d5a2f in default_fatal_finish (type=Variable "type" is not available. ) at failures.c:201 #4 0x092d5ae4 in i_syslog_fatal_handler (ctx=0xcf7dcdcc, format=0x2925f1d4 "kevent(EV_ADD, READ, %d) failed: %m", args=0xcf7dcdf4 "<") at failures.c:418 #5 0x17bd6f68 in master_fatal_callback (ctx=0xcf7dcdcc, format=0x2925f1d4 "kevent(EV_ADD, READ, %d) failed: %m", args=0xcf7dcdf4 "<") at main.c:167 #6 0x092d4ea6 in i_panic (format=Could not find the frame base for "i_panic". ) at failures.c:275 #7 0x092de2b9 in io_loop_handle_add (io=Variable "io" is not available. ) at ioloop-kqueue.c:67 #8 0x092df3e2 in io_add_file (fd=60, condition=IO_READ, source_linenum=244, callback=0x92efe80 , context=0x0) at ioloop.c:59 #9 0x092df491 in io_add (fd=60, condition=IO_READ, source_linenum=244, callback=0x92efe80 , context=0x0) at ioloop.c:81 #10 0x092f0283 in lib_signals_set_handler (signo=1, flags=3, handler=0x17bd5d30 , context=0x0) at lib-signals.c:243 #11 0x17bd58fb in main_init (set=0x86b34098) at main.c:518 #12 0x17bd6878 in main (argc=Cannot access memory at address 0x0 ) at main.c:890 Current language: auto; currently asm (gdb) bt full #0 0x0d8ca24f in thrkill () at :2 No locals. #1 0x0d8cd691 in *_libc_raise (s=6) at /usr/src/lib/libc/gen/raise.c:37 No locals. #2 0x0d8cb8fc in *_libc_abort () at /usr/src/lib/libc/stdlib/abort.c:52 mask = 4294967263 sa = {__sigaction_u = {__sa_handler = 0xcf7dcd38, __sa_sigaction = 0xcf7dcd38}, sa_mask = 690456752, sa_flags = 1} #3 0x092d5a2f in default_fatal_finish (type=Variable "type" is not available. ) at failures.c:201 backtrace = Variable "backtrace" is not available. (gdb) I'm happy to test patches, etc. -- Edgar Pettijohn From news at mefox.org Sun Jul 3 15:41:49 2016 From: news at mefox.org (Michael Fox) Date: Sun, 3 Jul 2016 08:41:49 -0700 Subject: FW: quota-status service In-Reply-To: <5778D59B.30402@myzel.net> References: <5778D59B.30402@myzel.net> Message-ID: <006501d1d541$6a7be4f0$3f73aed0$@mefox.org> Aki: Over the last three days, I've watched many other questions being asked and answered. Were they also impolite to ask? Peter: What exactly was impolite about identifying missing information and listing the specific details that I'm looking for? Aki & Peter: Do either of you know the answers to at least some of my questions? Michael > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Peter > Chiochetti > Sent: Sunday, July 3, 2016 2:07 AM > To: dovecot at dovecot.org > Subject: Re: FW: quota-status service > > Am 2016-07-03 um 10:43 schrieb Aki Tuomi: > > If you need fast and timely support you can contact OX sales for an > support agreement . It is somewhat impolite to except such from a public > mailing list over weekend. > > Nah, expecting such can be unreasonable, > Impolite though the manner of expression > From marti1234 at gmail.com Sun Jul 3 15:46:58 2016 From: marti1234 at gmail.com (Marti Markov) Date: Sun, 3 Jul 2016 16:46:58 +0100 Subject: Shared mailboxes not showing up in shared namespace In-Reply-To: <1617072920.1542.1467554700648@appsuite-dev.open-xchange.com> References: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> <1617072920.1542.1467554700648@appsuite-dev.open-xchange.com> Message-ID: <1134E5D0-36C7-4536-8D61-DF54A8BE7C60@gmail.com> Aki, you were right. It was at /usr/lib/dovecot Here is the output: root at mail:~# /usr/lib/dovecot/imap -u m.markov * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE ACL RIGHTS=texk] Logged in as m.markov at domain.com 1 LIST "" "*" * LIST (\HasNoChildren) "/" confirmed-spam * LIST (\HasNoChildren \Trash) "/" Trash * LIST (\HasNoChildren) "/" SpamLikely * LIST (\HasNoChildren) "/" Spam * LIST (\HasNoChildren) "/" "Sent Items" * LIST (\HasNoChildren) "/" Archive * LIST (\HasNoChildren \Drafts) "/" Drafts * LIST (\HasNoChildren) "/" Notes * LIST (\HasNoChildren) "/" TeamViewer * LIST (\HasNoChildren \Sent) "/" "Sent Messages" * LIST (\HasNoChildren) "/" confirmed-ham * LIST (\Noselect \HasChildren) "/" Public * LIST (\HasNoChildren) "/" Public/office3 * LIST (\HasNoChildren) "/" Public/office4 * LIST (\HasNoChildren) "/" Public/support * LIST (\HasNoChildren) "/" Public/root * LIST (\HasNoChildren) "/" Public/updates * LIST (\HasNoChildren) "/" Public/postmaster * LIST (\Noselect \HasChildren) "/" Shared * LIST (\Noselect \HasChildren) "/" Shared/d.marteva * LIST (\HasNoChildren) "/" Shared/d.marteva/INBOX * LIST (\HasNoChildren) "/" INBOX 1 OK List completed. 2 LOGOUT It does list the shared mailbox but it never shows up in either OX App Suite or Thunderbird. > On 3 Jul 2016, at 15:04, aki.tuomi at dovecot.fi wrote: > > You should have it. Otherwise imap wouldn't work. It's probably under /usr/lib/dovecot or /usr/lib/x86_64/dovecot > > Aki > >> On July 2, 2016 at 11:11 PM Marti Markov wrote: >> >> >> I don?t seem to have that install on my Debian machine. >> >> But I have done this: >> >> 1 LIST "" % >> * LIST (\HasNoChildren) "/" confirmed-spam >> * LIST (\HasChildren) "/" Archive >> * LIST (\HasNoChildren \Sent) "/" Sent >> * LIST (\HasChildren \Trash) "/" Trash >> * LIST (\HasNoChildren) "/" Spam >> * LIST (\HasChildren) "/" Archives >> * LIST (\HasNoChildren \Drafts) "/" Drafts >> * LIST (\HasNoChildren \Junk) "/" Junk >> * LIST (\HasNoChildren) "/" Unwanted >> * LIST (\HasNoChildren) "/" confirmed-ham >> * LIST (\Noselect \HasChildren) "/" Public >> * LIST (\Noselect \HasNoChildren) "/" Shared >> * LIST (\HasNoChildren) "/" INBOX >> 1 OK List completed. >> 7 LIST * * >> * LIST (\HasNoChildren) "/" confirmed-spam >> * LIST (\HasChildren) "/" Archive >> * LIST (\HasNoChildren) "/" Archive/2015 >> * LIST (\HasNoChildren \Sent) "/" Sent >> * LIST (\HasChildren \Trash) "/" Trash >> * LIST (\HasNoChildren) "/" Trash/Junk >> * LIST (\HasNoChildren) "/" Spam >> * LIST (\HasChildren) "/" Archives >> * LIST (\HasNoChildren) "/" Archives/2015 >> * LIST (\HasNoChildren) "/" Archives/2011 >> * LIST (\HasNoChildren \Drafts) "/" Drafts >> * LIST (\HasNoChildren \Junk) "/" Junk >> * LIST (\HasNoChildren) "/" Unwanted >> * LIST (\HasNoChildren) "/" confirmed-ham >> * LIST (\Noselect \HasChildren) "/" Public >> * LIST (\HasNoChildren) "/" Public/office3 >> * LIST (\HasNoChildren) "/" Public/office4 >> * LIST (\Noselect \HasNoChildren) "/" Shared >> * LIST (\HasNoChildren) "/" INBOX >> 7 OK List completed. >> >> By connecting using `openssl` from a remote machine. >> >>> On 1 Jul 2016, at 09:02, Steffen Kaiser wrote: >>> >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> On Thu, 30 Jun 2016, Marti Markov wrote: >>> >>>> I think I have configured everything correctly but for some reason I can?t get a list of the shared mailboxes to show up. >>>> >>>> When I run: >>>> >>>> doveadm acl debug -u m.markov Shared/d.marteva/INBOX >>>> >>>> >>>> doveadm(m.markov): Info: User d.marteva found from ACL shared dict >>>> doveadm(m.markov): Info: Mailbox Shared/d.marteva/INBOX is visible in LIST >>> >>> did you've tried: >>> >>> http://wiki2.dovecot.org/PreAuth >>> >>> /usr/local/libexec/dovecot/imap -u m.markov >>> 1 LIST "" "*" >>> 2 LOGOUT >>> >>> ? >>> >>> Maybe the client does not list them. >>> >>> - -- Steffen Kaiser >>> -----BEGIN PGP SIGNATURE----- >>> Version: GnuPG v1 >>> >>> iQEVAwUBV3Yjqnz1H7kL/d9rAQIoSQgAvKFsSKxMdt82a/1p52bikwkje4YoqGjK >>> duStP9qG2AtkkRPbbNc8JWki20xixyW7XagIP39dGwd+yNVlkMZAVna0KGIFNUwk >>> 9eVC1lMPax9lc0kq7Fw+EqwpPtFwuGe41eAsyP3JE51VlEbnA74oPGadJJe/6cM8 >>> /3sMCxXC9PlxgoKhwFoqggnEeH0Dx6wkHqXsLT3lCnSwtQHX8ZaKlRkEaVBvTVvO >>> ogu/9V/RZH6mhiVdlcYEDXDNoAZ7dh7ZgLqI2nCJm1AoTjpAyjnskhFT+1l5sOC0 >>> +tEb7Rfl7zAp+eJy6X9RaX9nuDzIGSTRfHBeTV9rMVXrz005FYHZpg== >>> =uU9/ >>> -----END PGP SIGNATURE----- From marti1234 at gmail.com Sun Jul 3 15:46:58 2016 From: marti1234 at gmail.com (Marti Markov) Date: Sun, 3 Jul 2016 16:46:58 +0100 Subject: Shared mailboxes not showing up in shared namespace In-Reply-To: <1617072920.1542.1467554700648@appsuite-dev.open-xchange.com> References: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> <1617072920.1542.1467554700648@appsuite-dev.open-xchange.com> Message-ID: <1134E5D0-36C7-4536-8D61-DF54A8BE7C60@gmail.com> Aki, you were right. It was at /usr/lib/dovecot Here is the output: root at mail:~# /usr/lib/dovecot/imap -u m.markov * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE ACL RIGHTS=texk] Logged in as m.markov at domain.com 1 LIST "" "*" * LIST (\HasNoChildren) "/" confirmed-spam * LIST (\HasNoChildren \Trash) "/" Trash * LIST (\HasNoChildren) "/" SpamLikely * LIST (\HasNoChildren) "/" Spam * LIST (\HasNoChildren) "/" "Sent Items" * LIST (\HasNoChildren) "/" Archive * LIST (\HasNoChildren \Drafts) "/" Drafts * LIST (\HasNoChildren) "/" Notes * LIST (\HasNoChildren) "/" TeamViewer * LIST (\HasNoChildren \Sent) "/" "Sent Messages" * LIST (\HasNoChildren) "/" confirmed-ham * LIST (\Noselect \HasChildren) "/" Public * LIST (\HasNoChildren) "/" Public/office3 * LIST (\HasNoChildren) "/" Public/office4 * LIST (\HasNoChildren) "/" Public/support * LIST (\HasNoChildren) "/" Public/root * LIST (\HasNoChildren) "/" Public/updates * LIST (\HasNoChildren) "/" Public/postmaster * LIST (\Noselect \HasChildren) "/" Shared * LIST (\Noselect \HasChildren) "/" Shared/d.marteva * LIST (\HasNoChildren) "/" Shared/d.marteva/INBOX * LIST (\HasNoChildren) "/" INBOX 1 OK List completed. 2 LOGOUT It does list the shared mailbox but it never shows up in either OX App Suite or Thunderbird. > On 3 Jul 2016, at 15:04, aki.tuomi at dovecot.fi wrote: > > You should have it. Otherwise imap wouldn't work. It's probably under /usr/lib/dovecot or /usr/lib/x86_64/dovecot > > Aki > >> On July 2, 2016 at 11:11 PM Marti Markov wrote: >> >> >> I don?t seem to have that install on my Debian machine. >> >> But I have done this: >> >> 1 LIST "" % >> * LIST (\HasNoChildren) "/" confirmed-spam >> * LIST (\HasChildren) "/" Archive >> * LIST (\HasNoChildren \Sent) "/" Sent >> * LIST (\HasChildren \Trash) "/" Trash >> * LIST (\HasNoChildren) "/" Spam >> * LIST (\HasChildren) "/" Archives >> * LIST (\HasNoChildren \Drafts) "/" Drafts >> * LIST (\HasNoChildren \Junk) "/" Junk >> * LIST (\HasNoChildren) "/" Unwanted >> * LIST (\HasNoChildren) "/" confirmed-ham >> * LIST (\Noselect \HasChildren) "/" Public >> * LIST (\Noselect \HasNoChildren) "/" Shared >> * LIST (\HasNoChildren) "/" INBOX >> 1 OK List completed. >> 7 LIST * * >> * LIST (\HasNoChildren) "/" confirmed-spam >> * LIST (\HasChildren) "/" Archive >> * LIST (\HasNoChildren) "/" Archive/2015 >> * LIST (\HasNoChildren \Sent) "/" Sent >> * LIST (\HasChildren \Trash) "/" Trash >> * LIST (\HasNoChildren) "/" Trash/Junk >> * LIST (\HasNoChildren) "/" Spam >> * LIST (\HasChildren) "/" Archives >> * LIST (\HasNoChildren) "/" Archives/2015 >> * LIST (\HasNoChildren) "/" Archives/2011 >> * LIST (\HasNoChildren \Drafts) "/" Drafts >> * LIST (\HasNoChildren \Junk) "/" Junk >> * LIST (\HasNoChildren) "/" Unwanted >> * LIST (\HasNoChildren) "/" confirmed-ham >> * LIST (\Noselect \HasChildren) "/" Public >> * LIST (\HasNoChildren) "/" Public/office3 >> * LIST (\HasNoChildren) "/" Public/office4 >> * LIST (\Noselect \HasNoChildren) "/" Shared >> * LIST (\HasNoChildren) "/" INBOX >> 7 OK List completed. >> >> By connecting using `openssl` from a remote machine. >> >>> On 1 Jul 2016, at 09:02, Steffen Kaiser wrote: >>> >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> On Thu, 30 Jun 2016, Marti Markov wrote: >>> >>>> I think I have configured everything correctly but for some reason I can?t get a list of the shared mailboxes to show up. >>>> >>>> When I run: >>>> >>>> doveadm acl debug -u m.markov Shared/d.marteva/INBOX >>>> >>>> >>>> doveadm(m.markov): Info: User d.marteva found from ACL shared dict >>>> doveadm(m.markov): Info: Mailbox Shared/d.marteva/INBOX is visible in LIST >>> >>> did you've tried: >>> >>> http://wiki2.dovecot.org/PreAuth >>> >>> /usr/local/libexec/dovecot/imap -u m.markov >>> 1 LIST "" "*" >>> 2 LOGOUT >>> >>> ? >>> >>> Maybe the client does not list them. >>> >>> - -- Steffen Kaiser >>> -----BEGIN PGP SIGNATURE----- >>> Version: GnuPG v1 >>> >>> iQEVAwUBV3Yjqnz1H7kL/d9rAQIoSQgAvKFsSKxMdt82a/1p52bikwkje4YoqGjK >>> duStP9qG2AtkkRPbbNc8JWki20xixyW7XagIP39dGwd+yNVlkMZAVna0KGIFNUwk >>> 9eVC1lMPax9lc0kq7Fw+EqwpPtFwuGe41eAsyP3JE51VlEbnA74oPGadJJe/6cM8 >>> /3sMCxXC9PlxgoKhwFoqggnEeH0Dx6wkHqXsLT3lCnSwtQHX8ZaKlRkEaVBvTVvO >>> ogu/9V/RZH6mhiVdlcYEDXDNoAZ7dh7ZgLqI2nCJm1AoTjpAyjnskhFT+1l5sOC0 >>> +tEb7Rfl7zAp+eJy6X9RaX9nuDzIGSTRfHBeTV9rMVXrz005FYHZpg== >>> =uU9/ >>> -----END PGP SIGNATURE----- From aki.tuomi at dovecot.fi Sun Jul 3 15:52:45 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 3 Jul 2016 18:52:45 +0300 (EEST) Subject: Shared mailboxes not showing up in shared namespace In-Reply-To: <1134E5D0-36C7-4536-8D61-DF54A8BE7C60@gmail.com> References: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> <1617072920.1542.1467554700648@appsuite-dev.open-xchange.com> <1134E5D0-36C7-4536-8D61-DF54A8BE7C60@gmail.com> Message-ID: <1803380844.1581.1467561165933@appsuite-dev.open-xchange.com> > On July 3, 2016 at 6:46 PM Marti Markov wrote: > > > Aki, you were right. > It was at /usr/lib/dovecot > > Here is the output: > > * LIST (\Noselect \HasChildren) "/" Shared > * LIST (\Noselect \HasChildren) "/" Shared/d.marteva > * LIST (\HasNoChildren) "/" Shared/d.marteva/INBOX Can you try doveadm mailbox subscribe -u yourusername Shared/d.marteva/INBOX Aki From marti1234 at gmail.com Sun Jul 3 15:58:36 2016 From: marti1234 at gmail.com (Marti Markov) Date: Sun, 3 Jul 2016 16:58:36 +0100 Subject: Shared mailboxes not showing up in shared namespace In-Reply-To: <1803380844.1581.1467561165933@appsuite-dev.open-xchange.com> References: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> <1617072920.1542.1467554700648@appsuite-dev.open-xchange.com> <1134E5D0-36C7-4536-8D61-DF54A8BE7C60@gmail.com> <1803380844.1581.1467561165933@appsuite-dev.open-xchange.com> Message-ID: <8484D212-3710-47C7-9634-6C38410897F2@gmail.com> Tried it but now luck in either OX App Suite or Thunderbird. The thing is that it isn?t even listed as a subscribeable folder. For example I have a Public namespace at that lists all the public mailboxes but Shared doesn?t list anything. I installed an addon in Thunderbird for ACL and that lists correct permissions on the INBOX folders. (Users having lookup & read permissions). I can post the doveconf output if you want? > On 3 Jul 2016, at 16:52, aki.tuomi at dovecot.fi wrote: > > >> On July 3, 2016 at 6:46 PM Marti Markov wrote: >> >> >> Aki, you were right. >> It was at /usr/lib/dovecot >> >> Here is the output: >> >> * LIST (\Noselect \HasChildren) "/" Shared >> * LIST (\Noselect \HasChildren) "/" Shared/d.marteva >> * LIST (\HasNoChildren) "/" Shared/d.marteva/INBOX > > Can you try > > doveadm mailbox subscribe -u yourusername Shared/d.marteva/INBOX > > Aki From aki.tuomi at dovecot.fi Sun Jul 3 16:08:51 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 3 Jul 2016 19:08:51 +0300 (EEST) Subject: FW: quota-status service In-Reply-To: <006501d1d541$6a7be4f0$3f73aed0$@mefox.org> References: <5778D59B.30402@myzel.net> <006501d1d541$6a7be4f0$3f73aed0$@mefox.org> Message-ID: <1806924494.1584.1467562132387@appsuite-dev.open-xchange.com> > On July 3, 2016 at 6:41 PM Michael Fox wrote: > > > Aki: Over the last three days, I've watched many other questions being asked and answered. Were they also impolite to ask? > No. But someone knew what to answer to them, you keep spamming the mailing list with repeated '???' instead of waiting, which *is* impolite. Someone WILL answer you when they have time to study your question and prepare an answer. As I said, if you think you should be entitled to timely responses, please consider purchasing a support agreement, so you can have an SLA. Support provided over mailing list is pro bono publico and no one gets paid doing it for you. Anyways, here are *some* answers to your questions: 1. Quota status comes with dovecot-core, on my server (debian) it is in ~$ ls -lah /usr/lib/dovecot/quota-status -rwxr-xr-x 1 root root 84K May 27 12:35 /usr/lib/dovecot/quota-status Did you look there? You also are going to need to use 'mail_plugins = $mail_plugins quota'. See quota configuration in dovecot wiki. (http://wiki2.dovecot.org/Quota) 2. It has no man page because it is not intended to be ran at command line, but -p means protocol. It should match your MTA/MX. Such as postfix, which at the moment is the only supported one. 3. Port you can choose freely, it is used by postfix to check the delivery possiblity before actually doing it. This is the statement in smtpd_recipient_restrictions, check_policy_service inet:mailstore.example.com:12340 replace mailstore.example.com with localhost or your dovecot hostname. And port with what you choose. 4. The various responses are what your MTA/MX expects. Looking at postfix manual (http://www.postfix.org/SMTPD_POLICY_README.html#protocol) you can see that "The "DUNNO" action causes Postfix to ignore the result." You can look at the postfix manual for various acceptable answers, but the one indicated in the configuration example probably works best. 5. quota_status_* quota_status_success, default response is OK quota_status_toolarge quota_status_overquota toolarge and overquota default to "554 5.2.2 ". quota_status_nouser, default response is "REJECT Unknown user" These are sent verbatim to your MTA/MX; refer to it's documentation for allowed responses. --- Aki Tuomi Dovecot oy From me at rvijay.me Sun Jul 3 16:18:28 2016 From: me at rvijay.me (Vijay Rajah) Date: Sun, 3 Jul 2016 21:48:28 +0530 Subject: quota-status service In-Reply-To: <051101d1d3fc$7710e3f0$6532abd0$@mefox.org> References: <051101d1d3fc$7710e3f0$6532abd0$@mefox.org> Message-ID: <05d47942-4391-62c1-0d90-951deaf13b83@rvijay.me> Michael, See my responses inline On 07/02/2016 06:25 AM, Michael Fox wrote: > ??? > > > > From: Michael Fox [mailto:news at mefox.org] > Sent: Thursday, June 30, 2016 1:59 PM > To: Dovecot Mailing List (dovecot at dovecot.org) > Subject: quota-status service > > > > I'm trying to understand the quota-status service, but I can't find complete > documentation. > > > > The quota-status service is mentioned here: http://wiki.dovecot.org/Quota > > > > And an example configuration is shown: > > > > service quota-status { > > executable = quota-status -p postfix > > inet_listener { > > port = 12340 > > # You can choose any port you want > > } > > client_limit = 1 > > } > > This is how I have configured it. > > But I can't find any information on quota-status. > > "man quota-status" returns nothing. > > I am unable to find a "quota-status" file on my machine. Where is the > executable located? > > What does the "-p postfix" option do? > > Are there any other command line options? > > The above wiki page shows three quota_status_* options in use: > > quota_status_success = DUNNO > quota_status_nouser = DUNNO > quota_status_overquota = "552 5.2.2 Mailbox is full" The way I understand it is, this Quota service was built specifically for postfix. (I only have postfix, have not used any other MTA) The "quota-status" executable is in you libexec directory. ( I compiled my dovecot instance, hence is is not in "regular" directory) The "quota_status_*" are responses to postifx. AFAIK, these are the only 3 possible options. Please see ( https://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ ) for a detailed info on this When Postfix MTA is "inline" with the sender, and if you have correctly configured the quota service, it will check if the recipient's mailbox can accept mails. If the recipient is able to accept mail dovecot responds with "DUNNO" (as configured in "quota_status_success" ) to let postifx continue with its sender checks. if the recipient's mail box is unable to accept mails, the dovecot responds with "552 5.2.2 Mailbox is full" (as configured in "quota_status_overquota"), this will prevent postfix from accepting mail and will respond with 552 status . All this is documented in that blog. Please also see: http://www.postfix.org/SMTPD_ACCESS_README.html > Where are their meanings documented? > > What are the allowed values? > > Are there other quota_status_* options? > > > > Thanks in advance. > > > > Thanks, > > Michael > > Hope this was helpful -Thanks Vijay From news at mefox.org Sun Jul 3 17:43:45 2016 From: news at mefox.org (Michael Fox) Date: Sun, 3 Jul 2016 10:43:45 -0700 Subject: FW: quota-status service In-Reply-To: <1806924494.1584.1467562132387@appsuite-dev.open-xchange.com> References: <5778D59B.30402@myzel.net> <006501d1d541$6a7be4f0$3f73aed0$@mefox.org> <1806924494.1584.1467562132387@appsuite-dev.open-xchange.com> Message-ID: <00a701d1d552$72c4f500$584edf00$@mefox.org> > No. But someone knew what to answer to them, you keep spamming the mailing > list with repeated '???' instead of waiting, which *is* impolite. Someone > WILL answer you when they have time to study your question and prepare an > answer. As I said, if you think you should be entitled to timely > responses, please consider purchasing a support agreement, so you can have > an SLA. Support provided over mailing list is pro bono publico and no one > gets paid doing it for you. Understood. And I don't think I'm "entitled" to anything. The list is free. But it may be helpful to understand this: I figured that most people would want to use the quota-status service. Therefore, most people must know something about it. But there was no response at all, not even "I can help but it will take a couple of days", even though there was lots of other activity on the list. So I did what is commonplace on some other lists by bumping it up to the top again. No disrespect intended. Every list has its own "personality". I'll learn. > 1. Quota status comes with dovecot-core, on my server (debian) it is in > > ~$ ls -lah /usr/lib/dovecot/quota-status > -rwxr-xr-x 1 root root 84K May 27 12:35 /usr/lib/dovecot/quota-status > > Did you look there? Yes. I actually looked everywhere with find / ... This machine is running Ubuntu 12.04, dovecot --version = 2.0.19 So, I just tried installing on another machine running Ubuntu 14.04, dovecot --version = 2.2.9. It **is** there on that machine. So, evidently, quota-status is not part of the older version. I guess I'll need to upgrade since I prefer not to compile from source. > You also are going to need ... > [answers clipped] Thank you. All EXCELLENT information. quota_status_toolarge wasn't mentioned on the wiki. I presume that refers to the individual message size being too large, correct? Thanks again, this is what I needed. Michael From news at mefox.org Sun Jul 3 18:04:38 2016 From: news at mefox.org (Michael Fox) Date: Sun, 3 Jul 2016 11:04:38 -0700 Subject: quota-status service In-Reply-To: <05d47942-4391-62c1-0d90-951deaf13b83@rvijay.me> References: <051101d1d3fc$7710e3f0$6532abd0$@mefox.org> <05d47942-4391-62c1-0d90-951deaf13b83@rvijay.me> Message-ID: <00cb01d1d555$5e0f1c00$1a2d5400$@mefox.org> > > The way I understand it is, this Quota service was built specifically > for postfix. (I only have postfix, have not used any other MTA) > The "quota-status" executable is in you libexec directory. ( I compiled > my dovecot instance, hence is is not in "regular" directory) Thanks. I also responded to Aki, but to close the loop: evidently quota-status is newer than the version of dovecot on my Ubuntu 12.04 machine. So I'll need to upgrade. > The "quota_status_*" are responses to postifx. AFAIK, these are the only > 3 possible options. > > Please see ( > https://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ ) for > a detailed info on this > > When Postfix MTA is "inline" with the sender, and if you have correctly > configured the quota service, it will check if the recipient's mailbox > can accept mails. If the recipient is able to accept mail dovecot > responds with "DUNNO" (as configured in "quota_status_success" ) to let > postifx continue with its sender checks. if the recipient's mail box is > unable to accept mails, the dovecot responds with "552 5.2.2 Mailbox is > full" (as configured in "quota_status_overquota"), this will prevent > postfix from accepting mail and will respond with 552 status . All this > is documented in that blog. > Thanks. I saw the link to Hildebrandt's blog on the wiki. (BTW, his Postfix book is still great!) And I understood the example. But it didn't cover the answers to my questions. Aki covered most of them. Thanks again, Michael From alavarre at gmail.com Sun Jul 3 20:44:42 2016 From: alavarre at gmail.com (C. Andrews Lavarre) Date: Sun, 03 Jul 2016 16:44:42 -0400 Subject: Postfix/dovecot: user unrecognized, file permissions being misread Message-ID: <1467578682.2493.8.camel@gmail.com> Hello all. Have spent several days following the excellent tutorial: http://www.binarytides.com/install-postfix-dovecot-debian/ but still fail to have the user recognized and am getting log entries that the mail directories are 0755 when I can clearly see that they are 0774. Very puzzling, any help would be deeply appreciated. Best regards, Andy =========== Details =========== ? I can add directories under IMAP, so my IMAP login and permissions must be correct. ? I can create an outgoing message under IMAP, but clicking SEND just hangs. Logs do not indicate problem. ? I clearly can send it a message with smtp. The message is delivered to postfix, but then dovecot fails to deliver it to a mailbox. ------------------------------------ Log Entries --------------------- --------------- # tail /var/log/mail postfix/qmgr[16390]: 9D6E8C1A77: from=, size=2794, nrcpt=1 (queue active) Message has been received postfix/lmtp[16770]: C218DC197D: to=, relay=mail.privustech.com[private/lmtp], delay=2560, delays=2260/0.01/300/0, dsn=4.4.2, status=deferred (conversation with mail.privustech.com[private/lmtp] timed out while receiving the initial server greeting) lmtp is not working ------------------------------------ # tail /var/log/dovecot.log auth-worker(16612): Info: pam(alavarre at privustech.com,98.179.190.111): unknown user imap-login: Info: Login: user=, method=PLAIN, rip=98.179.190.111, lip=70.186.159.22, mpid=16615, TLS, session= imap(alavarre at privustech.com): Error: mkdir(/var/mail/vhosts/privustech.com/alavarre/cur) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /var/mail/vhosts/privustech.com/alavarre, dir owned by 0:0 mode=0755) However, the mail directory /var/mail/vhosts/privustech.com/alavarre is -rwxrwxr-- vmail:vmail and I have restarted both postfix and dovecot. ========================= System is openSUSE Leap 42.1 (64). postfix and dovecot with SASL authentication, connecting through a Unix socket: /etc/postfix/main.cf: virtual_transport = lmtp:unix:private/lmtp /etc/dovecot/conf.d/10-master.cf: service lmtp { unix_listener /var/spool/postfix/private/lmtp { mode = 0600 user = postfix group = postfix } The lmtp socket is owned by postfix, while the mail system is owned by vmail, per the tutorial. ------------------------------ I am using virtual users (not system users) defined in /etc/dovecot/dovecot-users: alavarre at privustech.com:{plain}ksaj;flkasjd;ds;f Thanks in advance, Andy From edgar at pettijohn-web.com Sun Jul 3 20:47:36 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sun, 3 Jul 2016 15:47:36 -0500 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> Message-ID: <20160703204736.GA98480@thinkpad.my.domain> On 16-07-03 03:30:36, Timo Sirainen wrote: > On 02 Jul 2016, at 03:30, Adam Weinberger wrote: > > > >>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor > >>> > >>> It's not dumping core, and I get the message even with "protocols =" > >>> > >>> Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? > >> > >> gdb backtrace: http://dovecot.org/bugreport.html#coredumps > >> > > > > Fuller logs attached. Thanks for your help, Timo. > > > > #6 0x2815b23a in i_panic (format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m") at failures.c:275 > > #7 0x28185e10 in io_loop_handle_add (io=0x288843a0) at ioloop-kqueue.c:67 > > #8 0x281815a8 in io_add_file (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:59 > > #9 0x281813a6 in io_add (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:81 > > #10 0x2818a666 in lib_signals_set_handler (signo=1, flags=3, handler=0x804e6c0 , context=0x0) at lib-signals.c:243 > > #11 0x0804e129 in main_init (set=0x2881d098) at main.c:518 > > #12 0x0804d562 in main (argc=3, argv=0xffffae08) at main.c:890 > > Weird. I haven't touched anything even close to that. Also kqueue works on my OSX. The only thing that comes to my mind is https://github.com/dovecot/core/commit/fde7b8a03bf91cfa5bb7ca3e84545386243fa0d2 > > Does it happen to work if you use the attached patch? > The patch doesn't apply cleanly for me on OpenBSD -current. Hmm... Looks like a unified diff to me... The text leading up to this was: -------------------------- |commit 3fea4d5988de365503df44a9b067e3b181cac65c |Author: Timo Sirainen |Date: Thu Jun 30 14:08:24 2016 +0300 | | master: Stopping didn't close dead-pipes early enough. | | This caused stopping to be too slow. Broken by 0153cf542. | |diff --git a/src/master/service-monitor.c b/src/master/service-monitor.c |index 19655c2..44cdb26 100644 |--- a/src/master/service-monitor.c |+++ b/src/master/service-monitor.c -------------------------- Patching file service-monitor.c using Plan A... Hunk #1 succeeded at 513 (offset 8 lines). Hunk #2 failed at 538. Hunk #3 succeeded at 595 with fuzz 2 (offset 8 lines). 1 out of 3 hunks failed--saving rejects to service-monitor.c.rej Hmm... The next patch looks like a unified diff to me... The text leading up to this was: -------------------------- |commit fde7b8a03bf91cfa5bb7ca3e84545386243fa0d2 |Author: Timo Sirainen |Date: Tue Jun 28 23:38:11 2016 +0300 | | master: Added support for stopping specific services. | | We need to have a per-service fd for detecting a dead master. | |diff --git a/src/master/service-monitor.c b/src/master/service-monitor.c |index bf4e931..fb4f64f 100644 |--- a/src/master/service-monitor.c |+++ b/src/master/service-monitor.c -------------------------- Patching file service-monitor.c using Plan A... Reversed (or previously applied) patch detected! Assume -R? [y] If I select [y] and continue to build I get lots of build errors. -- Edgar Pettijohn From edgar at pettijohn-web.com Sun Jul 3 20:56:54 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sun, 3 Jul 2016 15:56:54 -0500 Subject: Postfix/dovecot: user unrecognized, file permissions being misread In-Reply-To: <1467578682.2493.8.camel@gmail.com> References: <1467578682.2493.8.camel@gmail.com> Message-ID: <20160703205654.GB98480@thinkpad.my.domain> On 16-07-03 16:44:42, C. Andrews Lavarre wrote: > Hello all. Have spent several days following the excellent tutorial: > > http://www.binarytides.com/install-postfix-dovecot-debian/ > > but still fail to have the user recognized and am getting log entries > that the mail directories are 0755 when I can clearly see that they are > 0774. > > Very puzzling, any help would be deeply appreciated. > > Best regards, Andy > =========== Details =========== > ??? I can add directories under IMAP, so my IMAP login and permissions > must be correct. > > ??? I can create an outgoing message under IMAP, but clicking SEND just > hangs. Logs do not indicate problem. > > ??? I clearly can send it a message with smtp. The message is delivered > to postfix, but then dovecot fails to deliver it to a mailbox. > ------------------------------------ Log Entries --------------------- > --------------- > # tail /var/log/mail > postfix/qmgr[16390]: 9D6E8C1A77: from=, > size=2794, nrcpt=1 (queue active) > Message has been received > > postfix/lmtp[16770]: C218DC197D: to=, > relay=mail.privustech.com[private/lmtp], delay=2560, > delays=2260/0.01/300/0, dsn=4.4.2, status=deferred (conversation with > mail.privustech.com[private/lmtp] timed out while receiving the initial > server greeting) > lmtp is not working > > ------------------------------------ > # tail /var/log/dovecot.log > > auth-worker(16612): Info: > pam(alavarre at privustech.com,98.179.190.111): unknown user This could be a problem. > > imap-login: Info: Login: user=, > method=PLAIN, rip=98.179.190.111, lip=70.186.159.22, mpid=16615, TLS, > session= > > imap(alavarre at privustech.com): Error: > mkdir(/var/mail/vhosts/privustech.com/alavarre/cur) failed: Permission > denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: > /var/mail/vhosts/privustech.com/alavarre, dir owned by 0:0 mode=0755) > However, the mail directory /var/mail/vhosts/privustech.com/alavarre is > -rwxrwxr-- vmail:vmail and I have restarted both postfix and dovecot. > I'm guessing vmail can't +w somewhere along the path of /var/mail/vhosts/etc... > ========================= > System is openSUSE Leap 42.1 (64). postfix and dovecot with SASL authentication, connecting through a Unix socket: > /etc/postfix/main.cf: > virtual_transport = lmtp:unix:private/lmtp > > /etc/dovecot/conf.d/10-master.cf: service lmtp { > unix_listener /var/spool/postfix/private/lmtp { > mode = 0600 > user = postfix > group = postfix > > } > The lmtp socket is owned by postfix, while the mail system is owned by vmail, per the tutorial. > > ------------------------------ > > I am using virtual users (not system users) defined in /etc/dovecot/dovecot-users: > alavarre at privustech.com:{plain}ksaj;flkasjd;ds;f > > Thanks in advance, Andy doveconf -n would be helpful -- Edgar Pettijohn From alavarre at gmail.com Sun Jul 3 22:17:48 2016 From: alavarre at gmail.com (C. Andrews Lavarre) Date: Sun, 03 Jul 2016 18:17:48 -0400 Subject: Postfix/dovecot: user unrecognized, file permissions being misread In-Reply-To: <20160703205654.GB98480@thinkpad.my.domain> References: <1467578682.2493.8.camel@gmail.com> <20160703205654.GB98480@thinkpad.my.domain> Message-ID: <1467584268.2493.10.camel@gmail.com> On Sun, 2016-07-03 at 15:56 -0500, Edgar Pettijohn wrote: > doveconf -n would be helpful Thank you: lavarre:/var/mail/vhosts/privustech.com # doveconf -n # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.1.26-21-default x86_64 openSUSE 42.1 (x86_64) ext4 auth_mechanisms = plain login auth_verbose = yes listen = * log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/var/mail/vhosts/%d/%n maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded -character vacation subaddress comparator-i;ascii-numeric r elational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = scheme=PLAIN username_format=%u /etc/dovecot/dovecot-users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_ca = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 10 } From alavarre at gmail.com Sun Jul 3 22:29:53 2016 From: alavarre at gmail.com (C. Andrews Lavarre) Date: Sun, 03 Jul 2016 18:29:53 -0400 Subject: Postfix/dovecot: user unrecognized, file permissions being misread In-Reply-To: <20160703205654.GB98480@thinkpad.my.domain> References: <1467578682.2493.8.camel@gmail.com> <20160703205654.GB98480@thinkpad.my.domain> Message-ID: <1467584993.2493.16.camel@gmail.com> Edgar hello. Thanks again. Not sure of the protocol. Perhaps better to keep the entire thread complete, so here again is doveconf -n with the precendents: lavarre:/var/mail/vhosts/privustech.com # doveconf -n # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.1.26-21-default x86_64 openSUSE 42.1 (x86_64) ext4 auth_mechanisms = plain login auth_verbose = yes listen = * log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/var/mail/vhosts/%d/%n maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded -character vacation subaddress comparator-i;ascii-numeric r elational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = scheme=PLAIN username_format=%u /etc/dovecot/dovecot-users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_ca = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 10 } On Sun, 2016-07-03 at 15:56 -0500, Edgar Pettijohn wrote: > On 16-07-03 16:44:42, C. Andrews Lavarre wrote: > > Hello all. Have spent several days following the excellent > > tutorial: > > > > http://www.binarytides.com/install-postfix-dovecot-debian/ > > > > but still fail to have the user recognized and am getting log > > entries > > that the mail directories are 0755 when I can clearly see that they > > are > > 0774. > > > > Very puzzling, any help would be deeply appreciated. > > > > Best regards, Andy > > =========== Details =========== > > ??? I can add directories under IMAP, so my IMAP login and > > permissions > > must be correct. > > > > ??? I can create an outgoing message under IMAP, but clicking SEND > > just > > hangs. Logs do not indicate problem. > > > > ??? I clearly can send it a message with smtp. The message is > > delivered > > to postfix, but then dovecot fails to deliver it to a mailbox. > > > > ------------------------------------ Log Entries -------------- > > ------- > > --------------- > > > > # tail /var/log/mail > > > > > > postfix/qmgr[16390]: 9D6E8C1A77: from=< > > alavarre at gmail.com>, > > size=2794, nrcpt=1 (queue active) > > > > > > > > Message has been received > > > > > > > > postfix/lmtp[16770]: C218DC197D: to=< > > alavarre at privustech.com>, > > relay=mail.privustech.com[private/lmtp], delay=2560, > > delays=2260/0.01/300/0, dsn=4.4.2, status=deferred (conversation > > with > > mail.privustech.com[private/lmtp] timed out while receiving the > > initial > > server greeting) > > > > > > lmtp is not working > > > > > > > > ------------------------------------ > > > > > > # tail /var/log/dovecot.log > > > > > > > > auth-worker(16612): Info: > > pam(alavarre at privustech.com,98.179.190.111): unknown user > > This could be a problem. > > > > > > > > > imap-login: Info: Login: user= > > , > > method=PLAIN, rip=98.179.190.111, lip=70.186.159.22, mpid=16615, > > TLS, > > session= > > > > > > > > imap(alavarre at privustech.com): Error: > > mkdir(/var/mail/vhosts/privustech.com/alavarre/cur) failed: > > Permission > > denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: > > /var/mail/vhosts/privustech.com/alavarre, dir owned by 0:0 > > mode=0755) > > However, the mail directory > > /var/mail/vhosts/privustech.com/alavarre is > > > > -rwxrwxr-- vmail:vmail and I have restarted both postfix and > > dovecot. > > > > I'm guessing vmail can't +w somewhere along the path of > /var/mail/vhosts/etc... > > > ========================= > > System is openSUSE Leap 42.1 (64). postfix and dovecot with SASL > > authentication, connecting through a Unix socket: > > > > /etc/postfix/main.cf: > > > > > > virtual_transport = lmtp:unix:private/lmtp > > > > > > > > /etc/dovecot/conf.d/10-master.cf:> > > > > > > > servic > > e lmtp { > > > > > > unix_listener /var/spool/postfix/private/lmtp { > > > > > > > > mode = 0600 > > > > > > > > > > user = postfix > > > > > > > > > > group = postfix > > > > > > > > } > > The lmtp socket is owned by postfix, while the mail system is owned > > by vmail, per the tutorial. > > > > ------------------------------ > > > > I am using virtual users (not system users) defined in > > /etc/dovecot/dovecot-users: > > alavarre at privustech.com:{plain}ksaj;flkasjd;ds;f > > > > Thanks in advance, Andy > > doveconf -n would be helpful From edgar at pettijohn-web.com Sun Jul 3 22:31:56 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sun, 3 Jul 2016 17:31:56 -0500 Subject: Postfix/dovecot: user unrecognized, file permissions being misread In-Reply-To: <1467584268.2493.10.camel@gmail.com> References: <1467578682.2493.8.camel@gmail.com> <20160703205654.GB98480@thinkpad.my.domain> <1467584268.2493.10.camel@gmail.com> Message-ID: <20160703223156.GA95675@thinkpad.my.domain> On 16-07-03 18:17:48, C. Andrews Lavarre wrote: > On Sun, 2016-07-03 at 15:56 -0500, Edgar Pettijohn wrote: > > doveconf -n would be helpful > Thank you: > lavarre:/var/mail/vhosts/privustech.com # doveconf -n > # 2.2.18: /etc/dovecot/dovecot.conf > > # Pigeonhole version 0.4.8 (0c4ae064f307+) > > # OS: Linux 4.1.26-21-default x86_64 openSUSE 42.1 (x86_64) ext4 > > auth_mechanisms = plain login > > auth_verbose = yes > > listen = * > > log_path = /var/log/dovecot.log > > mail_debug = yes > > mail_location = maildir:/var/mail/vhosts/%d/%n > > maildir_very_dirty_syncs = yes > > managesieve_notify_capability = mailto > > managesieve_sieve_capability = fileinto reject envelope encoded > -character vacation subaddress comparator-i;ascii-numeric r > elational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate > > namespace inbox { > > inbox = yes > > location = > mailbox Drafts { > > special_use = \Drafts > > } > > mailbox Junk { > > special_use = \Junk > > } > > mailbox Sent { > > special_use = \Sent > > } > > mailbox "Sent Messages" { > > special_use = \Sent > > } > > mailbox Trash { > > special_use = \Trash > > } > > prefix = > } > > passdb { > > driver = pam > > } > > passdb { > > args = scheme=PLAIN username_format=%u /etc/dovecot/dovecot-users > > driver = passwd-file > > } Double check me, but I think you only want (1) passdb {} block. > > plugin { > > sieve = ~/.dovecot.sieve > > sieve_after = /var/mail/vmail/sieve-after > > sieve_before = /var/mail/vmail/sieve-before > > sieve_dir = ~/sieve > > } > > protocols = imap pop3 sieve > > service auth { > > unix_listener /var/spool/postfix/private/auth { > > group = postfix > > mode = 0666 > > user = postfix > > } > > } > > service imap-login { > > inet_listener imaps { > > port = 993 > > ssl = yes > > } > > } > > service lmtp { > > unix_listener /var/spool/postfix/private/lmtp { > > group = postfix > > mode = 0600 > > user = postfix > > } > > } > > service pop3-login { > > inet_listener pop3s { > > port = 995 > > ssl = yes > > } > > } > > ssl = required > > ssl_ca = > ssl_cert = > ssl_dh_parameters_length = 2048 > > ssl_key = > ssl_options = no_compression > > ssl_prefer_server_ciphers = yes > > userdb { > > driver = passwd > > } > > userdb { > > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > > driver = static > > } Same here and make sure driver = "passdb driver". > > verbose_ssl = yes > > protocol lda { > > deliver_log_format = msgid=%m: %$ > > mail_plugins = sieve > > postmaster_address = postmaster at privustech.com > > quota_full_tempfail = yes > > rejection_reason = Your message to <%t> was automatically > rejected:%n%r > > } > > protocol imap { > > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep > > mail_max_userip_connections = 10 > > } I also noticed your certificate chain is broken. http://wiki2.dovecot.org/TestInstallation -- Edgar Pettijohn From marti1234 at gmail.com Sun Jul 3 22:43:56 2016 From: marti1234 at gmail.com (Marti Markov) Date: Sun, 3 Jul 2016 23:43:56 +0100 Subject: Shared mailboxes not showing up in shared namespace In-Reply-To: <8484D212-3710-47C7-9634-6C38410897F2@gmail.com> References: <2EDBDF5A-1F0D-4617-BF6F-6CE32E6BE969@gmail.com> <1617072920.1542.1467554700648@appsuite-dev.open-xchange.com> <1134E5D0-36C7-4536-8D61-DF54A8BE7C60@gmail.com> <1803380844.1581.1467561165933@appsuite-dev.open-xchange.com> <8484D212-3710-47C7-9634-6C38410897F2@gmail.com> Message-ID: Here is the `doveconf -n` output: root at mail:~# doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.14.32-xxxx-grs-ipv6-64 x86_64 auth_debug = yes auth_default_realm = domain.com auth_mechanisms = plain login auth_verbose = yes imapc_host = imap-mail.outlook.com mail_gid = vmail mail_home = /home/vmail/%d/%n mail_location = maildir:~/Maildir mail_plugins = acl mail_shared_explicit_inbox = yes mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace { list = yes location = maildir:/home/vmail/Public:INDEXPVT=~/Maildir/Public prefix = Public/ separator = / subscriptions = yes type = public } namespace { list = children location = maildir:/home/vmail/domain.com/%%u/Maildir:INDEXPVT=~/Maildir/shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile acl_shared_dict = file:/home/vmail/domain.com/shared-mailboxes2 sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/dovecot.sieve sieve_dir = ~/sieve } postmaster_address = postmaster at domain.com protocols = " imap lmtp sieve" service auth { unix_listener auth-client { group = Debian-exim mode = 0660 user = Debian-exim } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener lmtp { mode = 0666 } } ssl = required ssl_cert = On 3 Jul 2016, at 16:58, Marti Markov wrote: > > Tried it but now luck in either OX App Suite or Thunderbird. > > The thing is that it isn?t even listed as a subscribeable folder. For example I have a Public namespace at that lists all the public mailboxes but Shared doesn?t list anything. > > I installed an addon in Thunderbird for ACL and that lists correct permissions on the INBOX folders. (Users having lookup & read permissions). > > I can post the doveconf output if you want? > > >> On 3 Jul 2016, at 16:52, aki.tuomi at dovecot.fi wrote: >> >> >>> On July 3, 2016 at 6:46 PM Marti Markov wrote: >>> >>> >>> Aki, you were right. >>> It was at /usr/lib/dovecot >>> >>> Here is the output: >>> >>> * LIST (\Noselect \HasChildren) "/" Shared >>> * LIST (\Noselect \HasChildren) "/" Shared/d.marteva >>> * LIST (\HasNoChildren) "/" Shared/d.marteva/INBOX >> >> Can you try >> >> doveadm mailbox subscribe -u yourusername Shared/d.marteva/INBOX >> >> Aki > From amk at krell.zikzak.de Sun Jul 3 23:42:51 2016 From: amk at krell.zikzak.de (Andreas M. Kirchwitz) Date: Mon, 4 Jul 2016 01:42:51 +0200 Subject: Dovecot 2.2.25 fails on SSL Message-ID: <20160703234249.GA2315@krell.zikzak.de> Dear Dovecot developers! This problem already existed some years ago, has been fixed, and now it's there again in Dovecot 2.2.25 (2.2.24 was fine). I'm running CentOS 6 with a custom OpenSSL installation in /usr/local/ssl Therefore, Dovecot is configured like this: env SSL_CFLAGS="-I/usr/local/ssl/include" SSL_LIBS="-L/usr/local/ssl/lib -Wl,-R/usr/local/ssl/lib -lcrypto -lssl" ./configure --prefix=/usr/local/Dovecot-2.2.25 --with-ssl=openssl --with-ssldir=/usr/local/Dovecot-2.2.25/etc/dovecot/certs With "pkg-config", the same options for SSL are provided. "make" and "make install" run just fine, and the daemon starts without any errors. However, if a user connects on port 993 (IMAPS), Dovecot logs this failure message to syslog: Jul 4 01:08:43 myhost dovecot: ssl-params: Fatal: Couldn't load required plugin /usr/local/Dovecot-2.2.25/lib/dovecot/libssl_iostream_openssl.so: dlopen() failed: libcrypto.so.1.0.0: cannot open shared object file: No such file or directory Jul 4 01:08:43 myhost dovecot: ssl-params: Error: child process failed with status 22784 ldd /usr/local/Dovecot-2.2.25/lib/dovecot/libssl_iostream_openssl.so linux-gate.so.1 => (0x00e8c000) libcrypto.so.1.0.0 => not found libssl.so.1.0.0 => not found librt.so.1 => /lib/librt.so.1 (0x00be4000) libc.so.6 => /lib/libc.so.6 (0x001a6000) libpthread.so.0 => /lib/libpthread.so.0 (0x003e4000) /lib/ld-linux.so.2 (0x007e7000) ldd /usr/local/Dovecot-2.2.25/lib/dovecot/libdcrypt_openssl.so linux-gate.so.1 => (0x00dca000) libcrypto.so.1.0.0 => not found libssl.so.1.0.0 => not found librt.so.1 => /lib/librt.so.1 (0x00a7a000) libc.so.6 => /lib/libc.so.6 (0x00160000) libpthread.so.0 => /lib/libpthread.so.0 (0x0072f000) /lib/ld-linux.so.2 (0x00560000) When comparing to Dovecot 2.2.24: ldd /usr/local/Dovecot-2.2.24/lib/dovecot/libssl_iostream_openssl.so linux-gate.so.1 => (0x0073d000) libcrypto.so.1.0.0 => /usr/local/ssl/lib/libcrypto.so.1.0.0 (0x00b04000) libssl.so.1.0.0 => /usr/local/ssl/lib/libssl.so.1.0.0 (0x0044a000) librt.so.1 => /lib/librt.so.1 (0x00a60000) libc.so.6 => /lib/libc.so.6 (0x001e5000) libdl.so.2 => /lib/libdl.so.2 (0x003a9000) libpthread.so.0 => /lib/libpthread.so.0 (0x009d0000) /lib/ld-linux.so.2 (0x00d77000) There's no libdcrypt_openssl.so in Dovecot 2.2.24, so I guess with the newly introduced dcrypt stuff something with SSL went wrong. Would be great if that could be fixed so that SSL works again. Thanks a lot in advance ... Andreas From edgar at pettijohn-web.com Mon Jul 4 03:14:01 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sun, 3 Jul 2016 22:14:01 -0500 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> Message-ID: <20160704031401.GA69651@thinkpad.my.domain> On 16-07-03 03:30:36, Timo Sirainen wrote: > On 02 Jul 2016, at 03:30, Adam Weinberger wrote: > > > >>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor > >>> > >>> It's not dumping core, and I get the message even with "protocols =" > >>> > >>> Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? > >> > >> gdb backtrace: http://dovecot.org/bugreport.html#coredumps > >> > > > > Fuller logs attached. Thanks for your help, Timo. > > > > #6 0x2815b23a in i_panic (format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m") at failures.c:275 > > #7 0x28185e10 in io_loop_handle_add (io=0x288843a0) at ioloop-kqueue.c:67 > > #8 0x281815a8 in io_add_file (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:59 > > #9 0x281813a6 in io_add (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:81 > > #10 0x2818a666 in lib_signals_set_handler (signo=1, flags=3, handler=0x804e6c0 , context=0x0) at lib-signals.c:243 > > #11 0x0804e129 in main_init (set=0x2881d098) at main.c:518 > > #12 0x0804d562 in main (argc=3, argv=0xffffae08) at main.c:890 > > Weird. I haven't touched anything even close to that. Also kqueue works on my OSX. The only thing that comes to my mind is https://github.com/dovecot/core/commit/fde7b8a03bf91cfa5bb7ca3e84545386243fa0d2 > > Does it happen to work if you use the attached patch? > Still trying to learn git, but here is what happened when I tried applying this diff. Sun Jul 03 10:12:32 ~/dovecot/core $ git reset --hard 3fea4d5988de365503df44a9b067e3b181cac65c HEAD is now at 3fea4d5 master: Stopping didn't close dead-pipes early enough. Sun Jul 03 10:12:37 ~/dovecot/core $ git apply diff.patch error: patch failed: src/master/service-monitor.c:522 error: src/master/service-monitor.c: patch does not apply error: patch failed: src/master/service-monitor.c:452 error: src/master/service-monitor.c: patch does not apply error: patch failed: src/master/service-process.c:133 error: src/master/service-process.c: patch does not apply error: patch failed: src/master/service.c:283 error: src/master/service.c: patch does not apply error: patch failed: src/master/service.h:85 error: src/master/service.h: patch does not apply Same thing happened before the reset --hard. -- Edgar Pettijohn From mfoley at ohprs.org Mon Jul 4 04:44:52 2016 From: mfoley at ohprs.org (Mark Foley) Date: Mon, 04 Jul 2016 00:44:52 -0400 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] Message-ID: <201607040444.u644iqXG013623@mail.hprs.local> After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; and infinite thanks to Achim Gottinger on the SambaList for his patience in working this through with me. Although my purpose was for Dovecot to authenticate mail clients, the configuration settings needed were on the Samba side. I hope a variation of these instructions can eventually make it into: http://wiki2.dovecot.org/Authentication/Kerberos What is essentially missing from the wiki is how to set up the proper Service Principal Names and the subsequent creation of a dovecot useable kerberos keytab file. The wiki comment on "k5principals passdb" was not helpful and largely unintelligble to me. Perhaps like many of you, I have switched from Microsoft SBS and Exchange to Samaba4 and Dovecot/IMAP. The transition was completely transparent to my users, except they needed a separate password for email authentication in the absence of NTLM or GSSAPI working with Dovecot. A mild inconvenience, but I have been on a "quest" to fill that gap. This solution finally takes care of that last piece. The following describes how to create the SPNs and krb5 keytab files using Samba4 which has its own built-in (Heimdal) kerberos. The procedures are probably similar for other facilities such as setspn for Windows, but I've not used those so I won't attempt to discuss those mechanism here. You do need kerberos as the Samba built-in kerberos does not have needed commands like `klist`. My distro (Slackware 14.1) does not come with kerberos (nor, I think, does Ubuntu), but is easily found at: https://slackbuilds.org/repository/14.1/network/krb5/ Ubuntu/Debian: apt-get install krb5-config libpam-krb5 krb5-user ssh-krb5 (perhaps more) After provisioning Samba4, copy the krb5.conf template to /etc/krb5.conf. (Note: the actual docs advise symlinking: ln -sf /usr/local/samba/private/krb5.conf /etc/krb5.conf but I prefer making a copy in case I need to modify things). I've set The /etc/krb5.conf file to world readable. It's default contents are (and these do not need to be changed): [libdefaults] default_realm = HPRS.LOCAL dns_lookup_realm = false dns_lookup_kdc = true where HPRS.LOCAL is my realm, of course use your own. Now, we need a samba user in order to create the necessary SPNs (Server Principal Names): $ samba-tool user create dovecot New Password: Retype Password: User 'dovecot' created successfully Next, add the SPN(s), and create the keytab: $ samba-tool spn add imap/mail.hprs.local dovecot $ samba-tool domain exportkeytab --principal imap/mail.hprs.local /etc/dovecot/dovecot.keytab Dovecot does not do my (outgoing) SMTP serving, only (incoming) IMAP, but if it did I'd have to create another SPN for smtp: $ samba-tool spn add smtp/mail.hprs.local dovecot $ samba-tool domain exportkeytab --principal smtp/mail.hprs.local /etc/dovecot/dovecot.keytab Dovecot needs to be able to read the keytab file: $ chgrp dovecot /etc/dovecot/dovecot.keytab $ chmod g+r /etc/dovecot/dovecot.keytab my new keytab: $ klist -Kek /etc/dovecot/dovecot.keytab Keytab name: FILE:/etc/dovecot/dovecot.keytab KVNO Principal ---- -------------------------------------------------------------------------- 1 imap/mail.hprs.local at HPRS.LOCAL (des-cbc-crc) (0x232616c2a4fd08f7) 1 imap/mail.hprs.local at HPRS.LOCAL (des-cbc-md5) (0x232616c2a4fd08f7) 1 imap/mail.hprs.local at HPRS.LOCAL (arcfour-hmac) (0x9dae89a221dc374a39f560833352f60f) (and if I also created the spn for smtp I would also have these:) 1 smtp/mail.hprs.local at HPRS.LOCAL (des-cbc-crc) (0x232616c2a4fd08f7) 1 smtp/mail.hprs.local at HPRS.LOCAL (des-cbc-md5) (0x232616c2a4fd08f7) 1 smtp/mail.hprs.local at HPRS.LOCAL (arcfour-hmac) (0x9dae89a221dc374a39f560833352f60f) DOVECOT SETTINGS: My version: 2.2.15 Of crucial importance is to build dovecot with GSSAPI! That is NOT one of the default settings. In the dovecot build directory: ./configure --with-gssapi=yes Other than that serious build gotcha, settings are pretty simple. Add the following 3 settings to 10-auth.conf: auth_gssapi_hostname = "$ALL" auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_mechanisms = plain login gssapi The auth_gssapi_hostname is supposedly not required according to some of the above-listed commentors, but my 10-auth.conf template implies differently, so it can't hurt. gssapi does not require a passdb. Use whatever userdb you want. The dovecot wiki doc has some suggestions, not of which I've tried. I use the 'driver = passwd' for my userdb for unrelated reasons. I couldn't get any of this working until I rebooted the Samba AD/DC-Dovecot server, but that just may have been me not stopping/starting Samba and Dovecot in the right sequence (or, everything happened to start working with a concurrent upgrade to Samba 4.2!). In my WIN7 and Ubuntu Thunderbird clients I selected gssapi/kerberos for the IMAP authenticate method and it works! I've even changed the test user's AD password, just to make sure. Someone please put at least the required info on creating the SPNs and krb keytab file for other poor schmucks like me. Now, if I can get NTLM figured out for the remaining Outlook users ... ! --Mark From aki.tuomi at dovecot.fi Mon Jul 4 05:54:27 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 4 Jul 2016 08:54:27 +0300 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <201607040444.u644iqXG013623@mail.hprs.local> References: <201607040444.u644iqXG013623@mail.hprs.local> Message-ID: <5779FA13.1060107@dovecot.fi> On 04.07.2016 07:44, Mark Foley wrote: > After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI > authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this > list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; > and infinite thanks to Achim Gottinger on the SambaList for his patience in working this > through with me. Although my purpose was for Dovecot to authenticate mail clients, the > configuration settings needed were on the Samba side. I hope a variation of these instructions > can eventually make it into: > > http://wiki2.dovecot.org/Authentication/Kerberos > > It has been now updated. I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. I have to set up some kind of test environment to find out why it bugs. Aki From aki.tuomi at dovecot.fi Mon Jul 4 06:00:45 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 4 Jul 2016 09:00:45 +0300 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: <20160704031401.GA69651@thinkpad.my.domain> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> <20160704031401.GA69651@thinkpad.my.domain> Message-ID: <5779FB8D.9020208@dovecot.fi> On 04.07.2016 06:14, Edgar Pettijohn wrote: > On 16-07-03 03:30:36, Timo Sirainen wrote: >> On 02 Jul 2016, at 03:30, Adam Weinberger wrote: >>>>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor >>>>> >>>>> It's not dumping core, and I get the message even with "protocols =" >>>>> >>>>> Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? >>>> gdb backtrace: http://dovecot.org/bugreport.html#coredumps >>>> >>> Fuller logs attached. Thanks for your help, Timo. >>> >>> #6 0x2815b23a in i_panic (format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m") at failures.c:275 >>> #7 0x28185e10 in io_loop_handle_add (io=0x288843a0) at ioloop-kqueue.c:67 >>> #8 0x281815a8 in io_add_file (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:59 >>> #9 0x281813a6 in io_add (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:81 >>> #10 0x2818a666 in lib_signals_set_handler (signo=1, flags=3, handler=0x804e6c0 , context=0x0) at lib-signals.c:243 >>> #11 0x0804e129 in main_init (set=0x2881d098) at main.c:518 >>> #12 0x0804d562 in main (argc=3, argv=0xffffae08) at main.c:890 >> Weird. I haven't touched anything even close to that. Also kqueue works on my OSX. The only thing that comes to my mind is https://github.com/dovecot/core/commit/fde7b8a03bf91cfa5bb7ca3e84545386243fa0d2 >> >> Does it happen to work if you use the attached patch? >> > Still trying to learn git, but here is what happened when I tried applying this diff. > > Sun Jul 03 10:12:32 ~/dovecot/core $ git reset --hard 3fea4d5988de365503df44a9b067e3b181cac65c > HEAD is now at 3fea4d5 master: Stopping didn't close dead-pipes early enough. > Sun Jul 03 10:12:37 ~/dovecot/core $ git apply diff.patch > error: patch failed: src/master/service-monitor.c:522 > error: src/master/service-monitor.c: patch does not apply > error: patch failed: src/master/service-monitor.c:452 > error: src/master/service-monitor.c: patch does not apply > error: patch failed: src/master/service-process.c:133 > error: src/master/service-process.c: patch does not apply > error: patch failed: src/master/service.c:283 > error: src/master/service.c: patch does not apply > error: patch failed: src/master/service.h:85 > error: src/master/service.h: patch does not apply > > Same thing happened before the reset --hard. > I don't think Timo intended you to apply this as patch, but rather that it's probably what's causing it. Aki From mfoley at ohprs.org Mon Jul 4 07:23:30 2016 From: mfoley at ohprs.org (Mark Foley) Date: Mon, 04 Jul 2016 03:23:30 -0400 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <5779FA13.1060107@dovecot.fi> References: <201607040444.u644iqXG013623@mail.hprs.local> <5779FA13.1060107@dovecot.fi> Message-ID: <201607040723.u647NUdG004132@mail.hprs.local> On Mon, 4 Jul 2016 08:54:27 +0300 Aki Tuomi wrote: > > http://wiki2.dovecot.org/Authentication/Kerberos > > It has been now updated. Excellent! That was quick! Although, you used my actual local domain in your example: mail.hprs.local. Not that I care, no one can get to that, but it might be clearer to those of us who uncomprehendingly monkey-type things from wiki's when we don't fully understand. Perhaps something more generic would be clearer: myhost.myrealm, or myhost.mydom.local, or myLocalFDQN -- something like that. Not sure what is best; just don't want to imply that they HAVE TO use mail.hprs.local. > I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. > I have to set up some kind of test environment to find out why it bugs. I'm going to give my brain a rest for a bit before I resume tilting at the NTML windmill! I'll check back with the list to see if you've come up with anything. > Aki Again, thanks for all your help. --Mark -----Original Message----- > Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] > To: dovecot at dovecot.org > From: Aki Tuomi > Organization: Dovecot Oy > Date: Mon, 4 Jul 2016 08:54:27 +0300 > > On 04.07.2016 07:44, Mark Foley wrote: > > After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI > > authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this > > list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; > > and infinite thanks to Achim Gottinger on the SambaList for his patience in working this > > through with me. Although my purpose was for Dovecot to authenticate mail clients, the > > configuration settings needed were on the Samba side. I hope a variation of these instructions > > can eventually make it into: > > > > http://wiki2.dovecot.org/Authentication/Kerberos > > > > > > It has been now updated. > > I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. > I have to set up some kind of test environment to find out why it bugs. > > Aki > From mfoley at ohprs.org Mon Jul 4 07:30:52 2016 From: mfoley at ohprs.org (Mark Foley) Date: Mon, 04 Jul 2016 03:30:52 -0400 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <201607040723.u647NUdG004132@mail.hprs.local> References: <201607040444.u644iqXG013623@mail.hprs.local> <5779FA13.1060107@dovecot.fi> <201607040723.u647NUdG004132@mail.hprs.local> Message-ID: <201607040730.u647Uq5K018803@mail.hprs.local> Actually, I see that you used host.domain.name further down. That's a good substitute for mail.hprs.local. Also, not to be a literary critic, but it might not hurt to show an example keytab beneath your "Make sure your keytab has entry for ...". Just in case people don't exactly know how to "make sure: $ klist -Kek /etc/dovecot/dovecot.keytab Keytab name: FILE:/etc/dovecot/dovecot.keytab KVNO Principal ---- -------------------------------------------------------------------------- 1 imap/host.domain.name at MYREALM (des-cbc-crc) (0x232616c2a4fd08f7) 1 imap/host.domain.name at MYREALM (des-cbc-md5) (0x232616c2a4fd08f7) 1 imap/host.domain.name at MYREALM (arcfour-hmac) (0x9dae89a221dc374a39f560833 --Mark -----Original Message----- From: Mark Foley Date: Mon, 04 Jul 2016 03:23:30 -0400 Organization: Ohio Highway Patrol Retirement System To: dovecot at dovecot.org Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] On Mon, 4 Jul 2016 08:54:27 +0300 Aki Tuomi wrote: > > http://wiki2.dovecot.org/Authentication/Kerberos > > It has been now updated. Excellent! That was quick! Although, you used my actual local domain in your example: mail.hprs.local. Not that I care, no one can get to that, but it might be clearer to those of us who uncomprehendingly monkey-type things from wiki's when we don't fully understand. Perhaps something more generic would be clearer: myhost.myrealm, or myhost.mydom.local, or myLocalFDQN -- something like that. Not sure what is best; just don't want to imply that they HAVE TO use mail.hprs.local. > I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. > I have to set up some kind of test environment to find out why it bugs. I'm going to give my brain a rest for a bit before I resume tilting at the NTML windmill! I'll check back with the list to see if you've come up with anything. > Aki Again, thanks for all your help. --Mark -----Original Message----- > Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] > To: dovecot at dovecot.org > From: Aki Tuomi > Organization: Dovecot Oy > Date: Mon, 4 Jul 2016 08:54:27 +0300 > > On 04.07.2016 07:44, Mark Foley wrote: > > After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI > > authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this > > list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; > > and infinite thanks to Achim Gottinger on the SambaList for his patience in working this > > through with me. Although my purpose was for Dovecot to authenticate mail clients, the > > configuration settings needed were on the Samba side. I hope a variation of these instructions > > can eventually make it into: > > > > http://wiki2.dovecot.org/Authentication/Kerberos > > > > > > It has been now updated. > > I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. > I have to set up some kind of test environment to find out why it bugs. > > Aki > From aki.tuomi at dovecot.fi Mon Jul 4 09:47:25 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 4 Jul 2016 12:47:25 +0300 Subject: Dovecot 2.2.25 compiling error In-Reply-To: <938622260.1512.1467479024557@appsuite-dev.open-xchange.com> References: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> <361807399.1509.1467478687848@appsuite-dev.open-xchange.com> <938622260.1512.1467479024557@appsuite-dev.open-xchange.com> Message-ID: <577A30AD.1060500@dovecot.fi> On 02.07.2016 20:03, aki.tuomi at dovecot.fi wrote: >> On July 2, 2016 at 7:58 PM aki.tuomi at dovecot.fi wrote: >> >> >> >>> On July 2, 2016 at 6:56 PM Mart Pirita wrote: >>> >>> >>> Hello. >>> >>> I cant build 2.2.25, but I can build fine version 2.2.24 with same options: >>> >>> RedHat based customized distro, 2.6.28.10 kernel >>> >>> Build options: >>> Hi! This has been now fixed in master-2.2 with https://github.com/dovecot/core/commit/20e802d6bbf4ddad3a2140a2f7812d01de0ec2ef https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29dea7 Our testings indicate that you can compile 2.2.25.1 on CentOS5 with these applied. --- Aki Tuomi Dovecot oy From jcblanco at fi.upm.es Mon Jul 4 11:24:32 2016 From: jcblanco at fi.upm.es (Juan C. Blanco) Date: Mon, 4 Jul 2016 13:24:32 +0200 Subject: v2.2.25 released In-Reply-To: <4E7C4405-3049-45E1-873D-863747FC934A@iki.fi> References: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> <4E7C4405-3049-45E1-873D-863747FC934A@iki.fi> Message-ID: <36417d0f-cfd4-d9dd-a2ea-8028be30da71@fi.upm.es> On 01/07/2016 18:51, Timo Sirainen wrote: > On 01 Jul 2016, at 19:09, Juan C. Blanco wrote: >> >> I Haven't had the time to check the sha1.h error with the new fixes but I've just done so after de 2.2.25 release was out and I'm having the same error: >> >> gcc -DHAVE_CONFIG_H -I. -I. -I../.. -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/kerberos/include -c guid.c -fPIC -DPIC -o .libs/guid.o >> In file included from guid.c:6: >> sha1.h:80: error: static or type qualifiers in abstract declarator > > I thought this was fixed in 2.2.25.. In config.h you should have only: > > #define STATIC_ARRAY > > (not #define STATIC_ARRAY static) OK, my config.h contains: /* C99 static array */ #define STATIC_ARRAY static Regards. > >> Operating System: CentOS 5.11 >> GCC Version: gcc (GCC) 4.1.2 20080704 (Red Hat 4.1.2-55) >> >> We have four systems like this with dovecot 2.2.24 working fine. I would like to know if this platform will not be compatible anymore with dovecot and if we need to upgrade our systems prior to dovecot version since, besides this, I have the problem related to the openssl version for the lib-dcrypt library > > I recommend upgrading. We're considering not supporting older OSes anymore at all.. > -- +-------------------------------------------------------------------+ | Juan C. Blanco | | | | Centro de Calculo | | | E.T.S. Ingenieros Inform?ticos | E-mail: jcblanco at fi.upm.es | | Universidad Polit?cnica de Madrid | | | Campus de Montegancedo | | | Boadilla del Monte | Tel.: (+34) 91 336 7466 | | 28660 MADRID (Spain) | Fax : (+34) 91 336 6913 | +-------------------------------------------------------------------+ From aki.tuomi at dovecot.fi Mon Jul 4 11:44:42 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 4 Jul 2016 14:44:42 +0300 Subject: v2.2.25 released In-Reply-To: <36417d0f-cfd4-d9dd-a2ea-8028be30da71@fi.upm.es> References: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> <4E7C4405-3049-45E1-873D-863747FC934A@iki.fi> <36417d0f-cfd4-d9dd-a2ea-8028be30da71@fi.upm.es> Message-ID: <577A4C2A.8010708@dovecot.fi> On 04.07.2016 14:24, Juan C. Blanco wrote: > > > On 01/07/2016 18:51, Timo Sirainen wrote: >> On 01 Jul 2016, at 19:09, Juan C. Blanco wrote: >>> >>> I Haven't had the time to check the sha1.h error with the new fixes >>> but I've just done so after de 2.2.25 release was out and I'm having >>> the same error: >>> >>> gcc -DHAVE_CONFIG_H -I. -I. -I../.. -std=gnu99 -O2 -g -pipe -Wall >>> -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector >>> --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W >>> -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith >>> -Wchar-subscripts -Wformat=2 -Wbad-function-cast >>> -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/kerberos/include -c >>> guid.c -fPIC -DPIC -o .libs/guid.o >>> In file included from guid.c:6: >>> sha1.h:80: error: static or type qualifiers in abstract declarator >> >> I thought this was fixed in 2.2.25.. In config.h you should have only: >> >> #define STATIC_ARRAY >> >> (not #define STATIC_ARRAY static) > > OK, my config.h contains: > > /* C99 static array */ > #define STATIC_ARRAY static > > Regards. > >> >>> Operating System: CentOS 5.11 >>> GCC Version: gcc (GCC) 4.1.2 20080704 (Red Hat 4.1.2-55) >>> >>> We have four systems like this with dovecot 2.2.24 working fine. I >>> would like to know if this platform will not be compatible anymore >>> with dovecot and if we need to upgrade our systems prior to dovecot >>> version since, besides this, I have the problem related to the >>> openssl version for the lib-dcrypt library >> >> I recommend upgrading. We're considering not supporting older OSes >> anymore at all.. >> > Hi! This problem is hopefully now fixed by https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29dea7 Aki From bpk678 at gmail.com Mon Jul 4 14:40:06 2016 From: bpk678 at gmail.com (Brendan Kearney) Date: Mon, 04 Jul 2016 10:40:06 -0400 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <201607040730.u647Uq5K018803@mail.hprs.local> References: <201607040444.u644iqXG013623@mail.hprs.local> <5779FA13.1060107@dovecot.fi> <201607040723.u647NUdG004132@mail.hprs.local> <201607040730.u647Uq5K018803@mail.hprs.local> Message-ID: <577A7546.9060303@gmail.com> On 07/04/2016 03:30 AM, Mark Foley wrote: > Actually, I see that you used host.domain.name further down. That's a good substitute for mail.hprs.local. > > Also, not to be a literary critic, but it might not hurt to show an example keytab beneath your > "Make sure your keytab has entry for ...". Just in case people don't exactly know how to "make sure: > > $ klist -Kek /etc/dovecot/dovecot.keytab > Keytab name: FILE:/etc/dovecot/dovecot.keytab > KVNO Principal > ---- -------------------------------------------------------------------------- > 1 imap/host.domain.name at MYREALM (des-cbc-crc) (0x232616c2a4fd08f7) > 1 imap/host.domain.name at MYREALM (des-cbc-md5) (0x232616c2a4fd08f7) > 1 imap/host.domain.name at MYREALM (arcfour-hmac) (0x9dae89a221dc374a39f560833 > > --Mark > > -----Original Message----- > From: Mark Foley > Date: Mon, 04 Jul 2016 03:23:30 -0400 > Organization: Ohio Highway Patrol Retirement System > To: dovecot at dovecot.org > Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] > > On Mon, 4 Jul 2016 08:54:27 +0300 Aki Tuomi wrote: > >>> http://wiki2.dovecot.org/Authentication/Kerberos >> It has been now updated. > Excellent! That was quick! > > Although, you used my actual local domain in your example: mail.hprs.local. Not that I care, > no one can get to that, but it might be clearer to those of us who uncomprehendingly > monkey-type things from wiki's when we don't fully understand. Perhaps something more generic > would be clearer: myhost.myrealm, or myhost.mydom.local, or myLocalFDQN -- something like that. > Not sure what is best; just don't want to imply that they HAVE TO use mail.hprs.local. > >> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. >> I have to set up some kind of test environment to find out why it bugs. > I'm going to give my brain a rest for a bit before I resume tilting at the NTML windmill! I'll > check back with the list to see if you've come up with anything. > >> Aki > Again, thanks for all your help. > > --Mark > > -----Original Message----- >> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] >> To: dovecot at dovecot.org >> From: Aki Tuomi >> Organization: Dovecot Oy >> Date: Mon, 4 Jul 2016 08:54:27 +0300 >> On 04.07.2016 07:44, Mark Foley wrote: >>> After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI >>> authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this >>> list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; >>> and infinite thanks to Achim Gottinger on the SambaList for his patience in working this >>> through with me. Although my purpose was for Dovecot to authenticate mail clients, the >>> configuration settings needed were on the Samba side. I hope a variation of these instructions >>> can eventually make it into: >>> >>> http://wiki2.dovecot.org/Authentication/Kerberos >>> >>> >> It has been now updated. >> >> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. >> I have to set up some kind of test environment to find out why it bugs. >> >> Aki >> i have a document that i had written, recording each of the changes needed to each of the files to be modified, in order to have dovecot authenticate against kerberos and authorize against ldap. in addition, the use of nfs for maildir mailboxes and load balanced nuances are covered. the doc is in odt format (libre office writer), and i have attempted to post it to this mailing list, but it was quarantined. if there is any interest in the doc, reach out to me. i welcome input and feedback on it. brendan From dovecot-e51 at deemzed.uk Mon Jul 4 15:11:18 2016 From: dovecot-e51 at deemzed.uk (Dave) Date: Mon, 4 Jul 2016 16:11:18 +0100 Subject: v2.2.25 released In-Reply-To: <577A4C2A.8010708@dovecot.fi> References: <42B77557-D824-4D23-9401-740C26B351AE@iki.fi> <4E7C4405-3049-45E1-873D-863747FC934A@iki.fi> <36417d0f-cfd4-d9dd-a2ea-8028be30da71@fi.upm.es> <577A4C2A.8010708@dovecot.fi> Message-ID: <990b809f-e131-4419-4b10-d3857e0dd08d@deemzed.uk> On 04/07/2016 12:44, Aki Tuomi wrote: > > > On 04.07.2016 14:24, Juan C. Blanco wrote: >> >> >> On 01/07/2016 18:51, Timo Sirainen wrote: >>> On 01 Jul 2016, at 19:09, Juan C. Blanco wrote: >>>> >>>> I Haven't had the time to check the sha1.h error with the new fixes >>>> but I've just done so after de 2.2.25 release was out and I'm having >>>> the same error: >>>> >>>> gcc -DHAVE_CONFIG_H -I. -I. -I../.. -std=gnu99 -O2 -g -pipe -Wall >>>> -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector >>>> --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W >>>> -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith >>>> -Wchar-subscripts -Wformat=2 -Wbad-function-cast >>>> -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/kerberos/include -c >>>> guid.c -fPIC -DPIC -o .libs/guid.o >>>> In file included from guid.c:6: >>>> sha1.h:80: error: static or type qualifiers in abstract declarator >>> >>> I thought this was fixed in 2.2.25.. In config.h you should have only: >>> >>> #define STATIC_ARRAY >>> >>> (not #define STATIC_ARRAY static) >> >> OK, my config.h contains: >> >> /* C99 static array */ >> #define STATIC_ARRAY static >> >> Regards. >> >>> >>>> Operating System: CentOS 5.11 >>>> GCC Version: gcc (GCC) 4.1.2 20080704 (Red Hat 4.1.2-55) >>>> >>>> We have four systems like this with dovecot 2.2.24 working fine. I >>>> would like to know if this platform will not be compatible anymore >>>> with dovecot and if we need to upgrade our systems prior to dovecot >>>> version since, besides this, I have the problem related to the >>>> openssl version for the lib-dcrypt library >>> >>> I recommend upgrading. We're considering not supporting older OSes >>> anymore at all.. >>> >> > > Hi! > > This problem is hopefully now fixed by > https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29dea7 Aki, I had a go mock building on CentOS5 and it appears that the test succeeds with this patch in place: configure:21182: checking if we can use C99 static in array sizes configure:21202: gcc -c -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -fno-strict-aliasing -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 conftest.c >&5 configure:21202: $? = 0 configure:21214: result: yes (confirmed was built using unsigned char array) In fact, after a cursory examination and some testing I suspect the CentOS5 gcc does nominally support static array sizes, and it's likely hitting a compiler bug on the build proper? All I can suggest is a manual configure flag toggle of the test, or that this bug is better placed against Redhat? I haven't been able to narrow down a reproducer on triggering the error message other than during build. -- Dave From aki.tuomi at dovecot.fi Mon Jul 4 18:40:43 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 4 Jul 2016 21:40:43 +0300 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <577A7546.9060303@gmail.com> References: <201607040444.u644iqXG013623@mail.hprs.local> <5779FA13.1060107@dovecot.fi> <201607040723.u647NUdG004132@mail.hprs.local> <201607040730.u647Uq5K018803@mail.hprs.local> <577A7546.9060303@gmail.com> Message-ID: <577AADAB.7080000@dovecot.fi> On 04.07.2016 17:40, Brendan Kearney wrote: > On 07/04/2016 03:30 AM, Mark Foley wrote: >> Actually, I see that you used host.domain.name further down. That's a >> good substitute for mail.hprs.local. >> >> Also, not to be a literary critic, but it might not hurt to show an >> example keytab beneath your >> "Make sure your keytab has entry for ...". Just in case people don't >> exactly know how to "make sure: >> >> $ klist -Kek /etc/dovecot/dovecot.keytab >> Keytab name: FILE:/etc/dovecot/dovecot.keytab >> KVNO Principal >> ---- >> -------------------------------------------------------------------------- >> 1 imap/host.domain.name at MYREALM (des-cbc-crc) (0x232616c2a4fd08f7) >> 1 imap/host.domain.name at MYREALM (des-cbc-md5) (0x232616c2a4fd08f7) >> 1 imap/host.domain.name at MYREALM (arcfour-hmac) >> (0x9dae89a221dc374a39f560833 >> >> --Mark >> >> -----Original Message----- >> From: Mark Foley >> Date: Mon, 04 Jul 2016 03:23:30 -0400 >> Organization: Ohio Highway Patrol Retirement System >> To: dovecot at dovecot.org >> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for >> GSSAPI config] >> >> On Mon, 4 Jul 2016 08:54:27 +0300 Aki Tuomi >> wrote: >> >>>> http://wiki2.dovecot.org/Authentication/Kerberos >>> It has been now updated. >> Excellent! That was quick! >> >> Although, you used my actual local domain in your example: >> mail.hprs.local. Not that I care, >> no one can get to that, but it might be clearer to those of us who >> uncomprehendingly >> monkey-type things from wiki's when we don't fully understand. >> Perhaps something more generic >> would be clearer: myhost.myrealm, or myhost.mydom.local, or >> myLocalFDQN -- something like that. >> Not sure what is best; just don't want to imply that they HAVE TO use >> mail.hprs.local. >> >>> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. >>> I have to set up some kind of test environment to find out why it bugs. >> I'm going to give my brain a rest for a bit before I resume tilting >> at the NTML windmill! I'll >> check back with the list to see if you've come up with anything. >> >>> Aki >> Again, thanks for all your help. >> >> --Mark >> >> -----Original Message----- >>> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for >>> GSSAPI config] >>> To: dovecot at dovecot.org >>> From: Aki Tuomi >>> Organization: Dovecot Oy >>> Date: Mon, 4 Jul 2016 08:54:27 +0300 >>> On 04.07.2016 07:44, Mark Foley wrote: >>>> After a over a year and a half struggling to get Dovecot to do >>>> either NTLM or GSSAPI >>>> authentication with Samba4 AD/DC, I believe I've finally got it! >>>> Thanks to all those in this >>>> list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom >>>> Talpey especially Aki Tuomi; >>>> and infinite thanks to Achim Gottinger on the SambaList for his >>>> patience in working this >>>> through with me. Although my purpose was for Dovecot to >>>> authenticate mail clients, the >>>> configuration settings needed were on the Samba side. I hope a >>>> variation of these instructions >>>> can eventually make it into: >>>> >>>> http://wiki2.dovecot.org/Authentication/Kerberos >>>> >>>> >>> It has been now updated. >>> >>> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. >>> I have to set up some kind of test environment to find out why it bugs. >>> >>> Aki >>> > i have a document that i had written, recording each of the changes > needed to each of the files to be modified, in order to have dovecot > authenticate against kerberos and authorize against ldap. in > addition, the use of nfs for maildir mailboxes and load balanced > nuances are covered. the doc is in odt format (libre office writer), > and i have attempted to post it to this mailing list, but it was > quarantined. > > if there is any interest in the doc, reach out to me. i welcome input > and feedback on it. > > brendan I would very much like to have a copy, please. Aki From mfoley at ohprs.org Mon Jul 4 19:58:38 2016 From: mfoley at ohprs.org (Mark Foley) Date: Mon, 04 Jul 2016 15:58:38 -0400 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <577A7546.9060303@gmail.com> References: <201607040444.u644iqXG013623@mail.hprs.local> <5779FA13.1060107@dovecot.fi> <201607040723.u647NUdG004132@mail.hprs.local> <201607040730.u647Uq5K018803@mail.hprs.local> <577A7546.9060303@gmail.com> Message-ID: <201607041958.u64Jwcv6011758@mail.hprs.local> Brendan - yes, go ahead and send that doc directly to my email address. I've got Maildir folders going, but not nfs; and I'm curious about your load balance. THX --Mark -----Original Message----- > Date: Mon, 04 Jul 2016 10:40:06 -0400 > From: Brendan Kearney > To: dovecot at dovecot.org > Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] > > On 07/04/2016 03:30 AM, Mark Foley wrote: > > Actually, I see that you used host.domain.name further down. That's a good substitute for mail.hprs.local. > > > > Also, not to be a literary critic, but it might not hurt to show an example keytab beneath your > > "Make sure your keytab has entry for ...". Just in case people don't exactly know how to "make sure: > > > > $ klist -Kek /etc/dovecot/dovecot.keytab > > Keytab name: FILE:/etc/dovecot/dovecot.keytab > > KVNO Principal > > ---- -------------------------------------------------------------------------- > > 1 imap/host.domain.name at MYREALM (des-cbc-crc) (0x232616c2a4fd08f7) > > 1 imap/host.domain.name at MYREALM (des-cbc-md5) (0x232616c2a4fd08f7) > > 1 imap/host.domain.name at MYREALM (arcfour-hmac) (0x9dae89a221dc374a39f560833 > > > > --Mark > > > > -----Original Message----- > > From: Mark Foley > > Date: Mon, 04 Jul 2016 03:23:30 -0400 > > Organization: Ohio Highway Patrol Retirement System > > To: dovecot at dovecot.org > > Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] > > > > On Mon, 4 Jul 2016 08:54:27 +0300 Aki Tuomi wrote: > > > >>> http://wiki2.dovecot.org/Authentication/Kerberos > >> It has been now updated. > > Excellent! That was quick! > > > > Although, you used my actual local domain in your example: mail.hprs.local. Not that I care, > > no one can get to that, but it might be clearer to those of us who uncomprehendingly > > monkey-type things from wiki's when we don't fully understand. Perhaps something more generic > > would be clearer: myhost.myrealm, or myhost.mydom.local, or myLocalFDQN -- something like that. > > Not sure what is best; just don't want to imply that they HAVE TO use mail.hprs.local. > > > >> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. > >> I have to set up some kind of test environment to find out why it bugs. > > I'm going to give my brain a rest for a bit before I resume tilting at the NTML windmill! I'll > > check back with the list to see if you've come up with anything. > > > >> Aki > > Again, thanks for all your help. > > > > --Mark > > > > -----Original Message----- > >> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] > >> To: dovecot at dovecot.org > >> From: Aki Tuomi > >> Organization: Dovecot Oy > >> Date: Mon, 4 Jul 2016 08:54:27 +0300 > >> On 04.07.2016 07:44, Mark Foley wrote: > >>> After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI > >>> authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this > >>> list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; > >>> and infinite thanks to Achim Gottinger on the SambaList for his patience in working this > >>> through with me. Although my purpose was for Dovecot to authenticate mail clients, the > >>> configuration settings needed were on the Samba side. I hope a variation of these instructions > >>> can eventually make it into: > >>> > >>> http://wiki2.dovecot.org/Authentication/Kerberos > >>> > >>> > >> It has been now updated. > >> > >> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. > >> I have to set up some kind of test environment to find out why it bugs. > >> > >> Aki > >> > i have a document that i had written, recording each of the changes > needed to each of the files to be modified, in order to have dovecot > authenticate against kerberos and authorize against ldap. in addition, > the use of nfs for maildir mailboxes and load balanced nuances are > covered. the doc is in odt format (libre office writer), and i have > attempted to post it to this mailing list, but it was quarantined. > > if there is any interest in the doc, reach out to me. i welcome input > and feedback on it. > > brendan > From bc979 at lafn.org Mon Jul 4 21:39:18 2016 From: bc979 at lafn.org (Doug Hardie) Date: Mon, 4 Jul 2016 14:39:18 -0700 Subject: Feature Request Message-ID: I would like to request an additional optional argument for queue-id to dovecot-lda. The intended use for this argument is to include in the logging. From what I can tell, the queue-id size is not consistent between the various MTAs and so would need to be allocated dynamically when read during initialization. This element in the log messages would make it easier to find the trace of a received email. Generally I can easily get the queue-id generated by postfix (or sendmail - I use both). One grep would then give me the whole picture rather than having to dig out the message-id and doing a secondary grep to obtain the lda log messages. ? Doug I find it interesting that every submission to this list results in a quick response that says moderation is required since I "am not a member". However, I am a member... From luca at lm-net.it Mon Jul 4 23:14:55 2016 From: luca at lm-net.it (Luca Lesinigo) Date: Tue, 5 Jul 2016 01:14:55 +0200 Subject: is it possible to run a post-login script in a dovecot proxy with local auth? Message-ID: <944AFA14-4FE9-425D-A66A-883710D8BF5B@lm-net.it> We?re using dovecot v2.2.22, authenticating on a local database (passdb with sql driver), and then proxying the connections to the backend server returned by passdb (proxy=y and backend in ?host? column). To support some legacy clients we should keep POP/IMAP-before-SMTP running for some time, but right know I don?t know how to hook up a successful authentication in the dovecot proxy. I did read from http://wiki2.dovecot.org/PostLoginScripting: ?...it's not currently possible to run post-login scripts in proxies, because they're not actually logging in to the local Dovecot? Does that also holds true even if the proxy is authenticating users locally before proxying them? Failing that, any idea on how to get successful logins, other than parsing the log file? thank you, -- Luca Lesinigo From edgar at pettijohn-web.com Tue Jul 5 00:26:59 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Mon, 4 Jul 2016 19:26:59 -0500 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: <20160704031401.GA69651@thinkpad.my.domain> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> <20160704031401.GA69651@thinkpad.my.domain> Message-ID: <20160705002659.GA20201@thinkpad.my.domain> On 16-07-03 22:14:01, Edgar Pettijohn wrote: > On 16-07-03 03:30:36, Timo Sirainen wrote: > > On 02 Jul 2016, at 03:30, Adam Weinberger wrote: > > > > > >>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor > > >>> > > >>> It's not dumping core, and I get the message even with "protocols =" > > >>> > > >>> Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? > > >> > > >> gdb backtrace: http://dovecot.org/bugreport.html#coredumps > > >> > > > > > > Fuller logs attached. Thanks for your help, Timo. > > > > > > #6 0x2815b23a in i_panic (format=0x281ccf7a "kevent(EV_ADD, READ, %d) failed: %m") at failures.c:275 > > > #7 0x28185e10 in io_loop_handle_add (io=0x288843a0) at ioloop-kqueue.c:67 > > > #8 0x281815a8 in io_add_file (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:59 > > > #9 0x281813a6 in io_add (fd=56, condition=IO_READ, source_linenum=244, callback=0x2818a7d0 , context=0x0) at ioloop.c:81 > > > #10 0x2818a666 in lib_signals_set_handler (signo=1, flags=3, handler=0x804e6c0 , context=0x0) at lib-signals.c:243 > > > #11 0x0804e129 in main_init (set=0x2881d098) at main.c:518 > > > #12 0x0804d562 in main (argc=3, argv=0xffffae08) at main.c:890 > > > > Weird. I haven't touched anything even close to that. Also kqueue works on my OSX. The only thing that comes to my mind is https://github.com/dovecot/core/commit/fde7b8a03bf91cfa5bb7ca3e84545386243fa0d2 > > > > Does it happen to work if you use the attached patch? > > > > Still trying to learn git, but here is what happened when I tried applying this diff. > > Sun Jul 03 10:12:32 ~/dovecot/core $ git reset --hard 3fea4d5988de365503df44a9b067e3b181cac65c > HEAD is now at 3fea4d5 master: Stopping didn't close dead-pipes early enough. > Sun Jul 03 10:12:37 ~/dovecot/core $ git apply diff.patch > error: patch failed: src/master/service-monitor.c:522 > error: src/master/service-monitor.c: patch does not apply > error: patch failed: src/master/service-monitor.c:452 > error: src/master/service-monitor.c: patch does not apply > error: patch failed: src/master/service-process.c:133 > error: src/master/service-process.c: patch does not apply > error: patch failed: src/master/service.c:283 > error: src/master/service.c: patch does not apply > error: patch failed: src/master/service.h:85 > error: src/master/service.h: patch does not apply > > Same thing happened before the reset --hard. > > -- > Edgar Pettijohn It was a misconfiguration problem on my part causing the issues on OpenBSD. Probably the same for FreeBSD. Had to make changes to /etc/login.conf to fix it. However, the following diff keeps it from panicing and logs enough info to help figure out the problem. -- Edgar Pettijohn -------------- next part -------------- diff --git a/src/lib/ioloop-kqueue.c b/src/lib/ioloop-kqueue.c index 881ce87..9c35202 100644 --- a/src/lib/ioloop-kqueue.c +++ b/src/lib/ioloop-kqueue.c @@ -63,12 +63,12 @@ void io_loop_handle_add(struct io_file *io) if ((io->io.condition & (IO_READ | IO_ERROR)) != 0) { MY_EV_SET(&ev, io->fd, EVFILT_READ, EV_ADD, 0, 0, io); - if (kevent(ctx->kq, &ev, 1, NULL, 0, NULL) < 0) + if (kevent(ctx->kq, &ev, 1, NULL, 0, NULL) == -1) i_panic("kevent(EV_ADD, READ, %d) failed: %m", io->fd); } if ((io->io.condition & IO_WRITE) != 0) { MY_EV_SET(&ev, io->fd, EVFILT_WRITE, EV_ADD, 0, 0, io); - if (kevent(ctx->kq, &ev, 1, NULL, 0, NULL) < 0) + if (kevent(ctx->kq, &ev, 1, NULL, 0, NULL) == -1) i_panic("kevent(EV_ADD, WRITE, %d) failed: %m", io->fd); } From achim at ag-web.biz Tue Jul 5 12:50:54 2016 From: achim at ag-web.biz (Achim Gottinger) Date: Tue, 5 Jul 2016 14:50:54 +0200 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <201607040730.u647Uq5K018803@mail.hprs.local> References: <201607040444.u644iqXG013623@mail.hprs.local> <5779FA13.1060107@dovecot.fi> <201607040723.u647NUdG004132@mail.hprs.local> <201607040730.u647Uq5K018803@mail.hprs.local> Message-ID: <577BAD2E.7010707@ag-web.biz> Am 04.07.2016 um 09:30 schrieb Mark Foley: > Actually, I see that you used host.domain.name further down. That's a good substitute for mail.hprs.local. > > Also, not to be a literary critic, but it might not hurt to show an example keytab beneath your > "Make sure your keytab has entry for ...". Just in case people don't exactly know how to "make sure: > > $ klist -Kek /etc/dovecot/dovecot.keytab > Keytab name: FILE:/etc/dovecot/dovecot.keytab > KVNO Principal > ---- -------------------------------------------------------------------------- > 1 imap/host.domain.name at MYREALM (des-cbc-crc) (0x232616c2a4fd08f7) > 1 imap/host.domain.name at MYREALM (des-cbc-md5) (0x232616c2a4fd08f7) > 1 imap/host.domain.name at MYREALM (arcfour-hmac) (0x9dae89a221dc374a39f560833 > > --Mark > > -----Original Message----- > From: Mark Foley > Date: Mon, 04 Jul 2016 03:23:30 -0400 > Organization: Ohio Highway Patrol Retirement System > To: dovecot at dovecot.org > Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] > > On Mon, 4 Jul 2016 08:54:27 +0300 Aki Tuomi wrote: > >>> http://wiki2.dovecot.org/Authentication/Kerberos >> It has been now updated. > Excellent! That was quick! > > Although, you used my actual local domain in your example: mail.hprs.local. Not that I care, > no one can get to that, but it might be clearer to those of us who uncomprehendingly > monkey-type things from wiki's when we don't fully understand. Perhaps something more generic > would be clearer: myhost.myrealm, or myhost.mydom.local, or myLocalFDQN -- something like that. > Not sure what is best; just don't want to imply that they HAVE TO use mail.hprs.local. > >> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. >> I have to set up some kind of test environment to find out why it bugs. > I'm going to give my brain a rest for a bit before I resume tilting at the NTML windmill! I'll > check back with the list to see if you've come up with anything. > >> Aki > Again, thanks for all your help. > > --Mark > > -----Original Message----- >> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] >> To: dovecot at dovecot.org >> From: Aki Tuomi >> Organization: Dovecot Oy >> Date: Mon, 4 Jul 2016 08:54:27 +0300 >> On 04.07.2016 07:44, Mark Foley wrote: >>> After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI >>> authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this >>> list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; >>> and infinite thanks to Achim Gottinger on the SambaList for his patience in working this >>> through with me. Although my purpose was for Dovecot to authenticate mail clients, the >>> configuration settings needed were on the Samba side. I hope a variation of these instructions >>> can eventually make it into: >>> >>> http://wiki2.dovecot.org/Authentication/Kerberos >>> >>> >> It has been now updated. >> >> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. >> I have to set up some kind of test environment to find out why it bugs. >> >> Aki >> Thanks for updating the kerberos docs. Usually it is also an good idea to disable password expiry for the service accounts. samba-tool user setexpiry dovecot --noexpiry achim~ From bpk678 at gmail.com Tue Jul 5 12:52:45 2016 From: bpk678 at gmail.com (Brendan Kearney) Date: Tue, 05 Jul 2016 08:52:45 -0400 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <577AADAB.7080000@dovecot.fi> References: <201607040444.u644iqXG013623@mail.hprs.local> <5779FA13.1060107@dovecot.fi> <201607040723.u647NUdG004132@mail.hprs.local> <201607040730.u647Uq5K018803@mail.hprs.local> <577A7546.9060303@gmail.com> <577AADAB.7080000@dovecot.fi> Message-ID: <577BAD9D.5060703@gmail.com> On 07/04/2016 02:40 PM, Aki Tuomi wrote: > > > On 04.07.2016 17:40, Brendan Kearney wrote: >> On 07/04/2016 03:30 AM, Mark Foley wrote: >>> Actually, I see that you used host.domain.name further down. That's >>> a good substitute for mail.hprs.local. >>> >>> Also, not to be a literary critic, but it might not hurt to show an >>> example keytab beneath your >>> "Make sure your keytab has entry for ...". Just in case people don't >>> exactly know how to "make sure: >>> >>> $ klist -Kek /etc/dovecot/dovecot.keytab >>> Keytab name: FILE:/etc/dovecot/dovecot.keytab >>> KVNO Principal >>> ---- >>> -------------------------------------------------------------------------- >>> 1 imap/host.domain.name at MYREALM (des-cbc-crc) (0x232616c2a4fd08f7) >>> 1 imap/host.domain.name at MYREALM (des-cbc-md5) (0x232616c2a4fd08f7) >>> 1 imap/host.domain.name at MYREALM (arcfour-hmac) >>> (0x9dae89a221dc374a39f560833 >>> >>> --Mark >>> >>> -----Original Message----- >>> From: Mark Foley >>> Date: Mon, 04 Jul 2016 03:23:30 -0400 >>> Organization: Ohio Highway Patrol Retirement System >>> To: dovecot at dovecot.org >>> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for >>> GSSAPI config] >>> >>> On Mon, 4 Jul 2016 08:54:27 +0300 Aki Tuomi >>> wrote: >>> >>>>> http://wiki2.dovecot.org/Authentication/Kerberos >>>> It has been now updated. >>> Excellent! That was quick! >>> >>> Although, you used my actual local domain in your example: >>> mail.hprs.local. Not that I care, >>> no one can get to that, but it might be clearer to those of us who >>> uncomprehendingly >>> monkey-type things from wiki's when we don't fully understand. >>> Perhaps something more generic >>> would be clearer: myhost.myrealm, or myhost.mydom.local, or >>> myLocalFDQN -- something like that. >>> Not sure what is best; just don't want to imply that they HAVE TO >>> use mail.hprs.local. >>> >>>> I had a look at the NTLM mechanism, it *should* support SSP and >>>> NTLMv2. >>>> I have to set up some kind of test environment to find out why it >>>> bugs. >>> I'm going to give my brain a rest for a bit before I resume tilting >>> at the NTML windmill! I'll >>> check back with the list to see if you've come up with anything. >>> >>>> Aki >>> Again, thanks for all your help. >>> >>> --Mark >>> >>> -----Original Message----- >>>> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for >>>> GSSAPI config] >>>> To: dovecot at dovecot.org >>>> From: Aki Tuomi >>>> Organization: Dovecot Oy >>>> Date: Mon, 4 Jul 2016 08:54:27 +0300 >>>> On 04.07.2016 07:44, Mark Foley wrote: >>>>> After a over a year and a half struggling to get Dovecot to do >>>>> either NTLM or GSSAPI >>>>> authentication with Samba4 AD/DC, I believe I've finally got it! >>>>> Thanks to all those in this >>>>> list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom >>>>> Talpey especially Aki Tuomi; >>>>> and infinite thanks to Achim Gottinger on the SambaList for his >>>>> patience in working this >>>>> through with me. Although my purpose was for Dovecot to >>>>> authenticate mail clients, the >>>>> configuration settings needed were on the Samba side. I hope a >>>>> variation of these instructions >>>>> can eventually make it into: >>>>> >>>>> http://wiki2.dovecot.org/Authentication/Kerberos >>>>> >>>>> >>>> It has been now updated. >>>> >>>> I had a look at the NTLM mechanism, it *should* support SSP and >>>> NTLMv2. >>>> I have to set up some kind of test environment to find out why it >>>> bugs. >>>> >>>> Aki >>>> >> i have a document that i had written, recording each of the changes >> needed to each of the files to be modified, in order to have dovecot >> authenticate against kerberos and authorize against ldap. in >> addition, the use of nfs for maildir mailboxes and load balanced >> nuances are covered. the doc is in odt format (libre office writer), >> and i have attempted to post it to this mailing list, but it was >> quarantined. >> >> if there is any interest in the doc, reach out to me. i welcome >> input and feedback on it. >> >> brendan > > I would very much like to have a copy, please. > > Aki replied off list, as my doc is quarantined due to size. From doug at mail.sermon-archive.info Mon Jul 4 20:18:19 2016 From: doug at mail.sermon-archive.info (Doug Hardie) Date: Mon, 4 Jul 2016 13:18:19 -0700 Subject: Deletion of mail from Junk mailbox In-Reply-To: <79e13d3bcdf48536b95e7978e6939141@ausics.net> References: <887B5445-CC35-4765-AAB0-B380D1609E85@lafn.org> <79e13d3bcdf48536b95e7978e6939141@ausics.net> Message-ID: <5F9108AE-EBE5-4EDA-8EB5-6ED7045936E1@mail.sermon-archive.info> > On 2 July 2016, at 02:29, Noel Butler wrote: > > On 02/07/2016 19:16, Doug Hardie wrote: >> I have a pigeon sive running which directs some of my received mail to >> the Junk folder. That works just fine. However, a couple minutes >> later, it is moved to Deleted mailbox and deleted from Junk. At first >> I thought my client was doing that so I shut down the client and it >> still happens. Here are the log entries: >> Jul 2 00:36:31 mail dovecot: imap(doug): copy from INBOX: box=Junk, >> uid=10842, msgid=, size=3340, >> from="jnilj"
>> Jul 2 00:36:31 mail dovecot: imap(doug): delete: box=INBOX, >> uid=55719, msgid=, size=3340, >> from="jnilj"
>> Jul 2 00:39:33 mail dovecot: imap(doug): copy from Junk: box=Deleted >> Messages, uid=31049, msgid=, >> size=3340, from="jnilj"
>> Jul 2 00:39:33 mail dovecot: imap(doug): delete: box=Junk, uid=10842, >> msgid=, size=3340, from="jnilj" >>
>> Jul 2 00:50:29 mail dovecot: imap(doug): expunge: box=Junk, >> uid=10842, msgid=, size=3340, >> from="jnilj"
>> Jul 2 00:50:29 mail dovecot: imap(doug): expunge: box=INBOX, >> uid=55719, msgid=, size=3340, >> from="jnilj"
>> Is this the intended way the Junk maibox is supposed to work? I >> couldn't find any settings that appear to control (or affect) this >> behavior. >> ? Doug > > and your dovecot version is? > > I suggest you'll also need to show doveconf -n and example of sieve rules, because it doesnt seem right, certainly does not do that here. > After some more experimentation, it seemed like the messages above were created by a MUA and not the LDA. However, I was not able to identify the MUA that caused that. I modified logging to include the remote IP address, restarted dovecot with all the MUAs disabled. Now the problem has not reoccurred. I have been restarting the MUSs one at a time, however I still don't know who did it. I have only had a couple junk emails in the last few days so its not much of a test yet. I guess the volume will return to normal tomorrow. mail# doveconf -n # 2.2.24 (a82c823): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: FreeBSD 9.3-RELEASE-p43 amd64 ufs auth_mechanisms = plain login base_dir = /var/run/home_mail/ first_valid_gid = 0 lda_mailbox_autocreate = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k session=<%{session}> port=%a mail_gid = 2222 mail_location = maildir:/var/mail/home_mail/%n mail_log_prefix = "%s(%u)[%r]<%{session}>: " mail_uid = 2222 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { autoexpunge = 5 days special_use = \Drafts } mailbox Junk { autoexpunge = 2 days special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { autoexpunge = 2 days special_use = \Trash } prefix = } passdb { args = scheme=CRYPT username_format=%n /usr/local/etc/dovecot/users driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size from sieve = file:/var/mail/home_mail/%n/sieve;active=/var/mail/home_mail/%n/.dovecot.sieve } postmaster_address = doug at sermon-archive.info protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } inet_listener imaps2 { port = 998 ssl = yes } } ssl_cert = I'm using dovecot 2.1.7 I'm trying to connect to dovecot by imap via Java mail api. My approach described here . Bill Shannon, author of the Java Mail api recommended me to check carefully my server side (I have dovecot at server side). Actually, imap login in loop works but very slow. Each store.connect(login,password) takes about 1 minute. I tried to increase mail_max_userip_connections client_limit and process limit but it didn't help. My dovecot sometimes performs query, sometimes not! My logs: Jul 04 18:23:25 auth: Error: pgsql: Query failed, aborting: SELECT email, 'maildir:/home/mailboxes/maildir/'||maildir as mail,'/home/mailboxes/home/'||maildir as home, 500 as uid, 500 as gid FROM users WHERE email = 'test at test.domain.com' Jul 04 18:23:25 auth: Error: sql(test at test.domain.com,127.0.0.1,): User query failed: ERROR: permission denied for relation users My user and password queries: password_query = SELECT email as user, password FROM users WHERE email = '%u' user_query = SELECT email as user, 'maildir:/home/mailboxes/maildir/'||maildir as mail, '/home/mailboxes/home/'||maildir as home, 500 as uid, 500 as gid FROM users WHERE email = '%u' My master conf *Please note, that I'm using same uid!* service imap-login { inet_listener imap { #port = 143 } inet_listener imaps { #port = 993 #ssl = yes } # Number of connections to handle before starting a new process. Typically # the only useful values are 0 (unlimited) or 1. 1 is more secure, but 0 # is faster. #service_count = 1 # Number of processes to always keep waiting for more connections. #process_min_avail = 0 # If you set service_count=0, you probably need to grow this. #vsz_limit = $default_vsz_limit } service imap { # Most of the memory goes to mmap()ing files. You may need to increase this # limit if you have huge mailboxes. #vsz_limit = $default_vsz_limit # Max. number of IMAP processes (connections) #process_limit = 1024 } service auth { unix_listener auth-userdb { #mode = 0666 #user = #group = } # Postfix smtp-auth #unix_listener /var/spool/postfix/private/auth { # mode = 0666 #} # Auth process is run as this user. #user = $default_internal_user } service auth-worker { # Auth worker process is run as root by default, so that it can access # /etc/shadow. If this isn't necessary, the user should be changed to # $default_internal_user. #user = root } I'm sure that long login *reason is poor dovecot config* but some things are not clear to me and I can't improve it. 1. Which service are being used when Java connects to dovecot? imap-login,imap or auth? My assumption - imap-login. Imap user for dealing with folders *after* login, auth is for delivery (my assotioations here are postfix,lmtp,lda) =) Is my assumptions about imap-login and other services correct? 2. Which user are being used when I login? One that specified in connection code(one of 50K users in loop) or uid(500) user? I suggested that only one user and increased mail_max_userip_connections is it correct? 3. May some troubles in connection (which I showed above) caused by mode(0660) bad config in master.cf services? 4. Almost each loop iteration connects to dovecot in 60 seconds and rarely connects in a few milliseconds. Is that fact somehow connected with deafult_idle_kill which equlas to 1 mins? From d.kuhn at heinlein-support.de Tue Jul 5 10:10:25 2016 From: d.kuhn at heinlein-support.de (Dennis Kuhn) Date: Tue, 5 Jul 2016 12:10:25 +0200 Subject: duplicate Mails with dsync replication Message-ID: <839d52d0-c5a8-bb1d-5bd1-48dc924de145@heinlein-support.de> Hi! We have some strange replication issues. Some mails are duplicated when expunged. This bug is quite hard to reproduce, it just happens occasionally. It seems somehow related to sieve. When i deleted the sieve script i could not reproduce this behavior. Here are some logs, mjm-100010 at mydomain.com is an alias for mjm at mydomain.com: # Master Jun 23 00:51:41 dobby4 dovecot: lmtp(mjm-100010 at mydomain.com): copy from : box=INBOX, uid=7816, msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>, size=8933 Jun 23 00:51:41 dobby4 dovecot: lmtp(mjm-100010 at mydomain.com): 4N23HaMVa1fpmQEAJEBNLA: sieve: msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>: stored mail into mailbox 'INBOX' Jun 23 04:52:57 dobby4 dovecot: pop3(mjm at mydomain.com): expunge: box=INBOX, uid=7816, msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>, size=8933 Jun 23 04:52:57 dobby4 dovecot: dsync-local(mjm at mydomain.com): save: box=INBOX, uid=7817, msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>, size=8933 Jun 23 04:55:21 dobby4 dovecot: pop3(mjm at mydomain.com): expunge: box=INBOX, uid=7817, msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>, size=8933 # Replica Jun 23 00:51:42 dobby5 dovecot: dsync-server(mjm-100010 at mydomain.com): save: box=INBOX, uid=7816, msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>, size=8933 Jun 23 04:52:57 dobby5 dovecot: dsync-server(mjm at mydomain.com): copy from INBOX: box=INBOX, uid=7817, msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>, size=8933 Jun 23 04:52:57 dobby5 dovecot: dsync-server(mjm at mydomain.com): expunge: box=INBOX, uid=7816, msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>, size=8933 Jun 23 04:55:22 dobby5 dovecot: dsync-server(mjm at mydomain.com): expunge: box=INBOX, uid=7817, msgid=<20160623005132EE517444BB$3A04DF25DD at ABRAHAM>, size=8933 The problem is the "dsync-server(mjm at mydomain.com): copy from INBOX: box=INBOX, uid=7817" on dobby5 at 04:52:57. This creates a new uid 7817 and the new mail is replicated back to dobby4. But i have no idea what triggers this copy. Any ideas? The dovecot version is 2.2.24. Thanks Dennis From tss at iki.fi Tue Jul 5 16:35:01 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 5 Jul 2016 19:35:01 +0300 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: <20160705002659.GA20201@thinkpad.my.domain> References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> <20160704031401.GA69651@thinkpad.my.domain> <20160705002659.GA20201@thinkpad.my.domain> Message-ID: >>>>>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor Here's the fix for this: https://github.com/dovecot/core/commit/ffd8dc932516bc55bf01d91355540daab365e5e9 From goetz at suelze.de Tue Jul 5 19:34:52 2016 From: goetz at suelze.de (Goetz R Schultz) Date: Tue, 5 Jul 2016 20:34:52 +0100 Subject: kqueue crash on FreeBSD with 2.2.25 In-Reply-To: References: <18243986-F67C-4F74-9910-2FCA4CCED779@adamw.org> <0A4237D0-D455-48E7-A9BD-F41045B084D2@adamw.org> <217FAADC-BE97-40B2-AB09-2BEDCD2F9C5C@iki.fi> <20160704031401.GA69651@thinkpad.my.domain> <20160705002659.GA20201@thinkpad.my.domain> Message-ID: <577C0BDC.8050307@suelze.de> Works for me (recompiled fresh). Thanks a lot. Thanks and regards Goetz R. Schultz "I intend to live forever - so far, so good." =============================================== /"\ Get the rootcertificate at www.cacert.org \ / ASCII Ribbon Campaign against HTML e-mail X / \ Verify the cert @ CaCert.Com =============================================== "Si forte in alienas manus oberraverit hec peregrina epistola incertis ventis dimissa, sed Deo commendata, precamur ut ei reddatur cui soli destinata, nec preripiat quisquam non sibi parata." On 05/07/16 17:35, Timo Sirainen wrote: >>>>>>> Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor > > Here's the fix for this: https://github.com/dovecot/core/commit/ffd8dc932516bc55bf01d91355540daab365e5e9 > -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 2406 bytes Desc: S/MIME Cryptographic Signature URL: From asteriskmail at gmail.com Tue Jul 5 22:37:09 2016 From: asteriskmail at gmail.com (Il Neofita) Date: Tue, 5 Jul 2016 18:37:09 -0400 Subject: Dovecot delete and expunge loop Message-ID: Hi I am using dovecot 2.0.9 with redhat 6.8 One client with Outlook 2013 is deleting and expunging and email over and over changing the uid. I am not able to understand how to solve it. From lists at tigertech.com Tue Jul 5 22:49:59 2016 From: lists at tigertech.com (Robert L Mathews) Date: Tue, 5 Jul 2016 15:49:59 -0700 Subject: Dovecot delete and expunge loop In-Reply-To: References: Message-ID: On 7/5/16 3:37 PM, Il Neofita wrote: > I am using dovecot 2.0.9 with redhat 6.8 > One client with Outlook 2013 is deleting and expunging and email over and > over changing the uid. > I am not able to understand how to solve it. Is this by any chance happening with the "Junk Email" folder? If so: I've been seeing it happen occasionally with our customers for a couple of years, and have never found any solution. I suspect it to be a bug in Outlook (both 2013 and 2016), where it incorrectly re-detects mail it finds in that folder as Junk again, and then re-APPENDs it to the same folder, and so on. But I've never been able to find any other reports of it, on any mail server software. Disabling all the Junk controls in Outlook stops it. So does "chmod 0500 tmp" in the ".Junk E-mail" directory on the server. :-) -- Robert L Mathews, Tiger Technologies, http://www.tigertech.net/ From alavarre at gmail.com Wed Jul 6 01:36:31 2016 From: alavarre at gmail.com (C. Andrews Lavarre) Date: Tue, 05 Jul 2016 21:36:31 -0400 Subject: Postfix/dovecot: user unrecognized, file permissions being misread In-Reply-To: <20160703223156.GA95675@thinkpad.my.domain> References: <1467578682.2493.8.camel@gmail.com> <20160703205654.GB98480@thinkpad.my.domain> <1467584268.2493.10.camel@gmail.com> <20160703223156.GA95675@thinkpad.my.domain> Message-ID: <1467768991.2419.62.camel@gmail.com> Hello all. Thanks to Edgar for the below, but we still have a curiosity: On Sun, 2016-07-03 at 17:31 -0500, Edgar Pettijohn wrote: > On 16-07-03 18:17:48, C. Andrews Lavarre wrote: > > On Sun, 2016-07-03 at 15:56 -0500, Edgar Pettijohn wrote: > > > doveconf -n would be helpful > Double check me, but I think you only want (1) passdb {} block. > ... > Same here (userdb {) Agree on both, thank you. There are a huge number of files expressing p assdb { and userdb { but most are commented out. The undesirables were from conf.d/auth-system.conf.ext that I have now entirely commented out, since we are not using system users. > (and make sure driver = "passdb driver". > Presumably this means in auth-passwd-file.conf.ext: > > userdb { > > driver = passdb driver This was commented out. I changed it as you say, but it doesn't like it: auth: Fatal: Unknown userdb driver 'passdb driver' so I changed it back to driver = passwd-file Now we have no dovecot.log errors, except: The reported error was "IMAP server said BYE: Disconnected: Auth process broken Tomorrow is another day. I attach the lavarre:/etc/dovecot # doveconf -n >lavarre-160705_conf.txt Thank you again. Kind regards, Andy -------------- next part -------------- # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.1.26-21-default x86_64 openSUSE 42.1 (x86_64) ext4 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes listen = * log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/var/mail/vhosts/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = scheme=PLAIN username_format=%u /etc/dovecot/dovecot-users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_ca = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 10 } From jlbrown at bordo.com.au Wed Jul 6 02:28:22 2016 From: jlbrown at bordo.com.au (James Brown) Date: Wed, 6 Jul 2016 12:28:22 +1000 Subject: Compile error v2.2.25 MacOS X Message-ID: <134194D2-E029-4E11-8817-BFB0530F62D9@bordo.com.au> Tried to update from 2.2.24 to 2.2.25 using same configure command as previously. make ends with: In file included from guid.c:6: sha1.h:80: error: static or type qualifiers in abstract declarator make[4]: *** [guid.lo] Error 1 make[3]: *** [all] Error 2 make[2]: *** [all-recursive] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 Mac OS X 10.7.5 Configure statement was: ./configure --with-mysql --with-ssl=openssl Any suggestions? Thanks, James. From edgar at pettijohn-web.com Wed Jul 6 04:30:14 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Tue, 5 Jul 2016 23:30:14 -0500 Subject: Postfix/dovecot: user unrecognized, file permissions being misread In-Reply-To: <1467768991.2419.62.camel@gmail.com> References: <1467578682.2493.8.camel@gmail.com> <20160703205654.GB98480@thinkpad.my.domain> <1467584268.2493.10.camel@gmail.com> <20160703223156.GA95675@thinkpad.my.domain> <1467768991.2419.62.camel@gmail.com> Message-ID: <26B2357F-94B8-4B1C-BD51-E03B79B2DE39@pettijohn-web.com> Sent from my iPhone > On Jul 5, 2016, at 8:36 PM, C. Andrews Lavarre wrote: > > Hello all. Thanks to Edgar for the below, but we still have a > curiosity: >> On Sun, 2016-07-03 at 17:31 -0500, Edgar Pettijohn wrote: >>> On 16-07-03 18:17:48, C. Andrews Lavarre wrote: >>>> On Sun, 2016-07-03 at 15:56 -0500, Edgar Pettijohn wrote: >>>> doveconf -n would be helpful >> Double check me, but I think you only want (1) passdb {} block. >> ... >> Same here (userdb {) > Agree on both, thank you. There are a huge number of files expressing p > assdb { and userdb { but most are commented out. > The undesirables were from conf.d/auth-system.conf.ext that I have now > entirely commented out, since we are not using system users. > >> (and make sure driver = "passdb driver". > > Presumably this means in auth-passwd-file.conf.ext: >> > userdb { >> > driver = passdb driver > This was commented out. > I changed it as you say, but it doesn't like it: > auth: Fatal: Unknown userdb driver 'passdb driver' > > so I changed it back to > > driver = passwd-file > Just meant to use the correct driver. > Now we have no dovecot.log errors, except: > The reported error was "IMAP server said BYE: Disconnected: > Auth process broken Make sure your passdb and userdb are formatted correctly and can be found where you are telling dovecot they are. Also make sure dovecot was compiled with passwd-file as an option. I think it is unless specifically removed, but double check. > Tomorrow is another day. > I attach the > lavarre:/etc/dovecot # doveconf -n >lavarre-160705_conf.txt > > > Thank you again. > Kind regards, Andy > From edgar at pettijohn-web.com Wed Jul 6 04:31:53 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Tue, 5 Jul 2016 23:31:53 -0500 Subject: Compile error v2.2.25 MacOS X In-Reply-To: <134194D2-E029-4E11-8817-BFB0530F62D9@bordo.com.au> References: <134194D2-E029-4E11-8817-BFB0530F62D9@bordo.com.au> Message-ID: Sent from my iPhone > On Jul 5, 2016, at 9:28 PM, James Brown wrote: > > Tried to update from 2.2.24 to 2.2.25 using same configure command as previously. > > make ends with: > > In file included from guid.c:6: > sha1.h:80: error: static or type qualifiers in abstract declarator > make[4]: *** [guid.lo] Error 1 > make[3]: *** [all] Error 2 > make[2]: *** [all-recursive] Error 1 > make[1]: *** [all-recursive] Error 1 > make: *** [all] Error 2 > > Mac OS X 10.7.5 > > Configure statement was: > > ./configure --with-mysql --with-ssl=openssl > > Any suggestions? > > Thanks, > > James. Look at config.h and check for STATIC_ARRAY static If so remove the word "static". From jlbrown at bordo.com.au Wed Jul 6 05:19:42 2016 From: jlbrown at bordo.com.au (James Brown) Date: Wed, 6 Jul 2016 15:19:42 +1000 Subject: Compile error v2.2.25 MacOS X In-Reply-To: References: <134194D2-E029-4E11-8817-BFB0530F62D9@bordo.com.au> Message-ID: <2225E56B-9D53-4A23-BE18-BC97C47CAF27@bordo.com.au> > On 6 Jul. 2016, at 2:31 pm, Edgar Pettijohn wrote: > > > > Sent from my iPhone > >> On Jul 5, 2016, at 9:28 PM, James Brown wrote: >> >> Tried to update from 2.2.24 to 2.2.25 using same configure command as previously. >> >> make ends with: >> >> In file included from guid.c:6: >> sha1.h:80: error: static or type qualifiers in abstract declarator >> make[4]: *** [guid.lo] Error 1 >> make[3]: *** [all] Error 2 >> make[2]: *** [all-recursive] Error 1 >> make[1]: *** [all-recursive] Error 1 >> make: *** [all] Error 2 >> >> Mac OS X 10.7.5 >> >> Configure statement was: >> >> ./configure --with-mysql --with-ssl=openssl >> >> Any suggestions? >> >> Thanks, >> >> James. > > Look at config.h and check for STATIC_ARRAY static > > If so remove the word "static". Yes I had ?static? after STATIC_ARRAY. Removed it and compile went through without errors. Thanks, James. From max at pierro.ru Wed Jul 6 06:43:25 2016 From: max at pierro.ru (Maximus) Date: Wed, 6 Jul 2016 09:43:25 +0300 Subject: Dovecot2-pigeonhole Message-ID: <000001d1d751$b2534720$16f9d560$@pierro.ru> Got an error then I'm trying to upgrade to version 0.4.14: cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" From aki.tuomi at dovecot.fi Wed Jul 6 10:56:37 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Wed, 6 Jul 2016 13:56:37 +0300 (EEST) Subject: Compile error v2.2.25 MacOS X In-Reply-To: <2225E56B-9D53-4A23-BE18-BC97C47CAF27@bordo.com.au> References: <134194D2-E029-4E11-8817-BFB0530F62D9@bordo.com.au> <2225E56B-9D53-4A23-BE18-BC97C47CAF27@bordo.com.au> Message-ID: <134872143.1024.1467802597913@appsuite-dev.open-xchange.com> > On July 6, 2016 at 8:19 AM James Brown wrote: > > > > > On 6 Jul. 2016, at 2:31 pm, Edgar Pettijohn wrote: > > > > > > > > Sent from my iPhone > > > >> On Jul 5, 2016, at 9:28 PM, James Brown wrote: > >> > >> Tried to update from 2.2.24 to 2.2.25 using same configure command as previously. > >> > >> make ends with: > >> > >> In file included from guid.c:6: > >> sha1.h:80: error: static or type qualifiers in abstract declarator > >> make[4]: *** [guid.lo] Error 1 > >> make[3]: *** [all] Error 2 > >> make[2]: *** [all-recursive] Error 1 > >> make[1]: *** [all-recursive] Error 1 > >> make: *** [all] Error 2 > >> > >> Mac OS X 10.7.5 > >> > >> Configure statement was: > >> > >> ./configure --with-mysql --with-ssl=openssl > >> > >> Any suggestions? > >> > >> Thanks, > >> > >> James. > > > > Look at config.h and check for STATIC_ARRAY static > > > > If so remove the word "static". > > Yes I had ?static? after STATIC_ARRAY. > > Removed it and compile went through without errors. > > Thanks, > > James. Hi! This has been fixed in https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29dea7 If it still occurs with your OS please let me know. Aki From remko at freebsd.org Wed Jul 6 11:15:34 2016 From: remko at freebsd.org (Remko Lodder) Date: Wed, 6 Jul 2016 13:15:34 +0200 (CEST) Subject: Master-Master replication question Message-ID: <1304695756.35.1467803735221@openexchange.elvandar.org> Dear list, I have setup a master-master replication setup. My primairy MX's send email over on a DNS loadbalanced way, so DNS is doing some kind of round-robin way of sending mail to both master servers. I found out, that on one of the two machines, the email synchronisation is heavily delayed. Lets assume server A receives a mail from the MX; it synchronises almost instantly with the other server. Whenever server B receives the email, it could take up to several hours to synchronise the email, it seems that it is not detected prior. It is also interesting to see, that the mailboxes on server A (Where users login to retrieve their email via webmail/clients) are significantly smaller then the mailboxes on server B. When investigating, it seems that "older" mailboxes (or storage rather since we use mdbox) are still there on server B, which already had been removed on server A. My personal mailbox was 170MB on server A, while it was still 2.5GB on server B. (which was around that size before cleaning up the mailsboxes). I enabled debugging on the servers, and I see rather quick : "Replication requests" on server A, but when getting an email on server B, I do not see the request at all. My servers are both running the same version, same configuration (utilizing puppet), both running on ZFS and FreeBSD. Where server B is more loaded in it's memory because of some bhyve VM's and the server A does not run any VM. Does someone have any pointers on where to look? Thanks in advance ;-) Remko Included below the configurations from server A and B: Server A: # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: FreeBSD 10.3-RELEASE-p2 amd64 auth_mechanisms = plain login disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it haproxy_trusted_networks = YYYY lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_save_to_detail_mailbox = yes mail_debug = yes mail_fsync = always mail_location = mdbox:~/mdbox mail_plugins = " quota notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { driver = pam } plugin { antispam_backend = mailtrain antispam_mail_notspam = --ham antispam_mail_sendmail = /usr/local/bin/sa-learn.sh antispam_mail_spam = --spam antispam_spam_pattern_ignorecase = spam;junk antispam_trash_pattern_ignorecase = trash;deleted items;deleted messages antispam_verbose_debug = 1 mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:the other server:12346 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /usr/local/etc/dovecot/sieve/global/ sieve_global_path = /usr/local/etc/dovecot/sieve/default.sieve } postmaster_address = postmaster at xxx protocols = imap pop3 lmtp sieve replication_dsync_parameters = -d -N -l 60 -U replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service doveadm { inet_listener { port = 12346 ssl = yes } } service imap-login { inet_listener imap_haproxy { haproxy = yes port = 10143 } inet_listener imaps_haproxy { haproxy = yes port = 10144 ssl = yes } service_count = 1 } service imap { process_limit = 1024 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3 { process_limit = 1024 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_ca = Hi I'm doing: doveadm force-resync -S director1:1234 -A "*" The director gives this error: Jul 06 16:17:29 auth: Error: Trying to iterate users, but userdbs don't support it Jul 06 16:17:29 doveadm: Error: User listing returned failure Jul 06 16:17:29 doveadm: Error: Failed to iterate through some users The director has "iterate_query" set -- Tom From mail at tomsommer.dk Wed Jul 6 14:21:59 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Wed, 06 Jul 2016 16:21:59 +0200 Subject: Director/Doveadm: Trying to iterate users, but userdbs don't support it In-Reply-To: References: Message-ID: On the director (which is set to proxy doveadm commands): # doveadm force-resync -A "*" Error: User listing returned failure doveadm: Error: Failed to iterate through some users --- Tom On 2016-07-06 16:20, Tom Sommer wrote: > Hi > > I'm doing: doveadm force-resync -S director1:1234 -A "*" > > The director gives this error: > > Jul 06 16:17:29 auth: Error: Trying to iterate users, but userdbs > don't support it > Jul 06 16:17:29 doveadm: Error: User listing returned failure > Jul 06 16:17:29 doveadm: Error: Failed to iterate through some users > > The director has "iterate_query" set From bpk678 at gmail.com Wed Jul 6 14:26:59 2016 From: bpk678 at gmail.com (Brendan Kearney) Date: Wed, 06 Jul 2016 10:26:59 -0400 Subject: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] In-Reply-To: <201607041958.u64Jwcv6011758@mail.hprs.local> References: <201607040444.u644iqXG013623@mail.hprs.local> <5779FA13.1060107@dovecot.fi> <201607040723.u647NUdG004132@mail.hprs.local> <201607040730.u647Uq5K018803@mail.hprs.local> <577A7546.9060303@gmail.com> <201607041958.u64Jwcv6011758@mail.hprs.local> Message-ID: <577D1533.1070605@gmail.com> On 07/04/2016 03:58 PM, Mark Foley wrote: > Brendan - yes, go ahead and send that doc directly to my email address. I've got Maildir > folders going, but not nfs; and I'm curious about your load balance. > > THX --Mark > > -----Original Message----- >> Date: Mon, 04 Jul 2016 10:40:06 -0400 >> From: Brendan Kearney >> To: dovecot at dovecot.org >> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] >> >> On 07/04/2016 03:30 AM, Mark Foley wrote: >>> Actually, I see that you used host.domain.name further down. That's a good substitute for mail.hprs.local. >>> >>> Also, not to be a literary critic, but it might not hurt to show an example keytab beneath your >>> "Make sure your keytab has entry for ...". Just in case people don't exactly know how to "make sure: >>> >>> $ klist -Kek /etc/dovecot/dovecot.keytab >>> Keytab name: FILE:/etc/dovecot/dovecot.keytab >>> KVNO Principal >>> ---- -------------------------------------------------------------------------- >>> 1 imap/host.domain.name at MYREALM (des-cbc-crc) (0x232616c2a4fd08f7) >>> 1 imap/host.domain.name at MYREALM (des-cbc-md5) (0x232616c2a4fd08f7) >>> 1 imap/host.domain.name at MYREALM (arcfour-hmac) (0x9dae89a221dc374a39f560833 >>> >>> --Mark >>> >>> -----Original Message----- >>> From: Mark Foley >>> Date: Mon, 04 Jul 2016 03:23:30 -0400 >>> Organization: Ohio Highway Patrol Retirement System >>> To: dovecot at dovecot.org >>> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] >>> >>> On Mon, 4 Jul 2016 08:54:27 +0300 Aki Tuomi wrote: >>> >>>>> http://wiki2.dovecot.org/Authentication/Kerberos >>>> It has been now updated. >>> Excellent! That was quick! >>> >>> Although, you used my actual local domain in your example: mail.hprs.local. Not that I care, >>> no one can get to that, but it might be clearer to those of us who uncomprehendingly >>> monkey-type things from wiki's when we don't fully understand. Perhaps something more generic >>> would be clearer: myhost.myrealm, or myhost.mydom.local, or myLocalFDQN -- something like that. >>> Not sure what is best; just don't want to imply that they HAVE TO use mail.hprs.local. >>> >>>> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. >>>> I have to set up some kind of test environment to find out why it bugs. >>> I'm going to give my brain a rest for a bit before I resume tilting at the NTML windmill! I'll >>> check back with the list to see if you've come up with anything. >>> >>>> Aki >>> Again, thanks for all your help. >>> >>> --Mark >>> >>> -----Original Message----- >>>> Subject: Re: Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config] >>>> To: dovecot at dovecot.org >>>> From: Aki Tuomi >>>> Organization: Dovecot Oy >>>> Date: Mon, 4 Jul 2016 08:54:27 +0300 >>>> On 04.07.2016 07:44, Mark Foley wrote: >>>>> After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI >>>>> authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this >>>>> list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; >>>>> and infinite thanks to Achim Gottinger on the SambaList for his patience in working this >>>>> through with me. Although my purpose was for Dovecot to authenticate mail clients, the >>>>> configuration settings needed were on the Samba side. I hope a variation of these instructions >>>>> can eventually make it into: >>>>> >>>>> http://wiki2.dovecot.org/Authentication/Kerberos >>>>> >>>>> >>>> It has been now updated. >>>> >>>> I had a look at the NTLM mechanism, it *should* support SSP and NTLMv2. >>>> I have to set up some kind of test environment to find out why it bugs. >>>> >>>> Aki >>>> >> i have a document that i had written, recording each of the changes >> needed to each of the files to be modified, in order to have dovecot >> authenticate against kerberos and authorize against ldap. in addition, >> the use of nfs for maildir mailboxes and load balanced nuances are >> covered. the doc is in odt format (libre office writer), and i have >> attempted to post it to this mailing list, but it was quarantined. >> >> if there is any interest in the doc, reach out to me. i welcome input >> and feedback on it. >> >> brendan >> replied off list as my doc is quarantined for size. having re-read the doc, nfs is not specifically mentioned. the default storage dir (or the one i specified), /var/spool/dovecot, is automounted to a nas share i have. my export on the nas looks like the below: /export/dovecot server[1-2].bpk2.com(rw,sync) mail.bpk2.com(rw,sync) i normally run sec=krb5p in addition to the rw,sync options, but i do not believe a way exists to have the maildir mounted with a credential set. the mount on the mailserver looks like the below: nas.bpk2.com:/export/dovecot on /var/spool/dovecot type nfs (rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.88.3,mountvers=3,mountport=20048,mountproto=udp,local_lock=none,addr=192.168.88.3) with the nas exporting the nfs share, and sssd managing the automount, the fact that the maildir is mounted across the network is transparent to dovecot. the use of nfs here allows each dovecot instance to leverage the same data and not require duplication. iscsi would require duplication of data. i believe the director functionality, along with session persistence at the load balancer would allow multiple dovecot instances to use the one data set, without stepping on other instances and causing possible write conflicts or contention. thoughts and/or feedback? brendan From listeem at ksb.id.lv Wed Jul 6 19:51:07 2016 From: listeem at ksb.id.lv (KSB) Date: Wed, 6 Jul 2016 22:51:07 +0300 Subject: Dovecot and Solr 6 Message-ID: <347df3a7-4902-3614-3eaa-9ba06486fee5@ksb.id.lv> Hi! Dovecot 2.2.24 Had set up solr and new schema collection. Copied dovecot provided schema. There was an error with booleans (while getting schema via http), which I "solved" by removing "add-unknown-fields-to-the-schema" from solrconfig.xml. It is correct way to solve this? Anyway, I run tcpdump to see network activity between dovecot and solr: #tcpdump -i lo port 8983 and see nothing while doing: #doveadm fts rescan -u username at domain.tld no output also from doveadm. Noticed that dovecot.index.log reapears in user mail root if deleted. plugin { fts = solr fts_solr = url=http://localhost:8983/solr/dovecot/ debug .. } -- KSB From max at pierro.ru Thu Jul 7 05:35:31 2016 From: max at pierro.ru (Maximus) Date: Thu, 7 Jul 2016 08:35:31 +0300 Subject: Compile error Dovecot2-pigeonhole Message-ID: <000301d1d811$60d747a0$2285d6e0$@pierro.ru> FreeBSD 9.3 Dovecot 2.25 (7be1766) I'm trying to install Dovecot2-pigeonhole-0.4.14_2 from ports. Get an error: cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" With options MAKE_JOBS_UNSAFE=yes: cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" *** [edit-mail.lo] Error code 1 Stop in /usr/ports/mail/dovecot2-pigeonhole/work/dovecot-2.2-pigeonhole-0.4.14/src/l ib-sieve/util. *** [all-recursive] Error code 1 Stop in /usr/ports/mail/dovecot2-pigeonhole/work/dovecot-2.2-pigeonhole-0.4.14/src/l ib-sieve. *** [all-recursive] Error code 1 Stop in /usr/ports/mail/dovecot2-pigeonhole/work/dovecot-2.2-pigeonhole-0.4.14/src. *** [all-recursive] Error code 1 Stop in /usr/ports/mail/dovecot2-pigeonhole/work/dovecot-2.2-pigeonhole-0.4.14. *** [all] Error code 1 Stop in /usr/ports/mail/dovecot2-pigeonhole/work/dovecot-2.2-pigeonhole-0.4.14. *** [do-build] Error code 1 Stop in /usr/ports/mail/dovecot2-pigeonhole. *** [stage] Error code 1 I was trying to compile from sources. Same error. Any suggestions? From aki.tuomi at dovecot.fi Thu Jul 7 06:23:36 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Thu, 7 Jul 2016 09:23:36 +0300 Subject: Compile error Dovecot2-pigeonhole In-Reply-To: <000301d1d811$60d747a0$2285d6e0$@pierro.ru> References: <000301d1d811$60d747a0$2285d6e0$@pierro.ru> Message-ID: <577DF568.3050102@dovecot.fi> On 07.07.2016 08:35, Maximus wrote: > FreeBSD 9.3 > > Dovecot 2.25 (7be1766) > > > > > > I'm trying to install Dovecot2-pigeonhole-0.4.14_2 from ports. > > Get an error: > > cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" > > > > With options MAKE_JOBS_UNSAFE=yes: > > Hi! Try removing that superfluous compiler flag? Aki From aki.tuomi at dovecot.fi Thu Jul 7 07:24:37 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Thu, 7 Jul 2016 10:24:37 +0300 Subject: Compile error Dovecot2-pigeonhole In-Reply-To: <000c01d1d820$73a21450$5ae63cf0$@pierro.ru> References: <000301d1d811$60d747a0$2285d6e0$@pierro.ru> <577DF568.3050102@dovecot.fi> <000c01d1d820$73a21450$5ae63cf0$@pierro.ru> Message-ID: <577E03B5.3090503@dovecot.fi> Please keep replies on-list. If you removed the compiler flag, how can you get error about compiler flag? Perhaps you need to contact package maintainer? Aki On 07.07.2016 10:23, Maximus wrote: > Sure. > Same error. > > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Aki Tuomi > Sent: Thursday, July 07, 2016 9:24 AM > To: dovecot at dovecot.org > Subject: Re: Compile error Dovecot2-pigeonhole > > > > On 07.07.2016 08:35, Maximus wrote: >> FreeBSD 9.3 >> >> Dovecot 2.25 (7be1766) >> >> >> >> >> >> I'm trying to install Dovecot2-pigeonhole-0.4.14_2 from ports. >> >> Get an error: >> >> cc1: error: unrecognized command line option > "-Wno-duplicate-decl-specifier" >> >> >> With options MAKE_JOBS_UNSAFE=yes: >> >> > Hi! > > Try removing that superfluous compiler flag? > > Aki From tpriebe at inet.tu-berlin.de Thu Jul 7 11:12:00 2016 From: tpriebe at inet.tu-berlin.de (Tom Priebe) Date: Thu, 07 Jul 2016 13:12:00 +0200 Subject: duplicated mail in users inbox only Message-ID: <1467889920.846.18.camel@inet.tu-berlin.de> Hello, one of my users has the issue that some mails seem to get doubled -- but only in their inbox. The mail is bcc'd to them and the original recipient receives one copy as intended. The log shows nothing extraordinary, postfix, dovecot and sieve are certain that they received and delivered one single mail (per user). Further research showed that the doubled mails' mailbox files have the same inode, which seems inexplicable. I'm using dovecot 2.2.13 replicated over two servers (Master-Master). Duplication seems to happen regardless of the receiving server, yet still not all mails they receive with them in bcc are duplicated. Here's doveconf -n > # 2.2.13: /etc/dovecot/dovecot.conf > # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.3? > auth_gssapi_hostname = mail.net.t-labs.tu-berlin.de > auth_mechanisms = login plain gssapi > auth_username_format = %n > auth_verbose = yes > default_client_limit = 1024 > default_process_limit = 1024 > default_vsz_limit = 512 M > doveadm_password = supersecretpassword > listen = *, [::] > log_timestamp = "%Y-%m-%d %H:%M:%S " > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l > %c % > mail_location = maildir:~/Maildir > mail_plugins = " notify replication" > mail_privileged_group = mail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded- > character vacation subaddress comparator-i;ascii-numeric relational > regex imap4flags copy include variables body enotify environment > mailbox date ihave > namespace inbox { > ? inbox = yes > ? location =? > ? mailbox Drafts { > ????special_use = \Drafts > ? } > ? mailbox Junk { > ????special_use = \Junk > ? } > ? mailbox Sent { > ????special_use = \Sent > ? } > ? mailbox "Sent Messages" { > ????special_use = \Sent > ? } > ? mailbox Trash { > ????special_use = \Trash > ? } > ? prefix =? > } > passdb { > ? args = failure_show_msg=yes dovecot > ? driver = pam > } > plugin { > ? mail_replica = remote:vmail at mail1.inet.tu-berlin.de > ? sieve = /mail/home/%u/.dovecot.sieve > ? sieve_dir = /mail/home/%u/sieve > ? sieve_max_redirects = 20 > } > postmaster_address = postmaster at net.t-labs.tu-berlin.de > protocols = imap sieve > service aggregator { > ? fifo_listener replication-notify-fifo { > ????user = vmail > ? } > ? unix_listener replication-notify { > ????user = vmail > ? } > } > service anvil { > ? chroot = empty > ? client_limit = 4096 > ? process_limit = 1 > } > service auth { > ? client_limit = 4096 > ? unix_listener /var/spool/postfix/private/auth { > ????group = postfix > ????mode = 0660 > ????user = postfix > ? } > ? unix_listener auth-master { > ????mode = 0600 > ????user = vmail > ? } > ? unix_listener auth-userdb { > ????mode = 0600 > ????user = vmail > ? } > ? user = root > } > service doveadm { > ? inet_listener { > ????port = 12345 > ????ssl = yes > ? } > } > service imap-login { > ? client_limit = 1024 > ? inet_listener imap { > ????port = 143 > ? } > ? inet_listener imaps { > ????port = 993 > ????ssl = yes > ? } > ? process_limit = 100 > ? process_min_avail = 2 > ? service_count = 50 > } > service imap { > ? process_limit = 1024 > } > service managesieve-login { > ? client_limit = 1024 > ? executable = /usr/lib/dovecot/managesieve-login > ? inet_listener sieve { > ????port = 4190 > ? } > ? process_limit = 1024 > ? process_min_avail = 20 > ? service_count = 1 > } > service managesieve { > ? process_limit = 1024 > } > service pop3-login { > ? client_limit = 1024 > ? inet_listener pop3 { > ????port = 110 > ? } > ? inet_listener pop3s { > ????port = 995 > ????ssl = yes > ? } > ? process_limit = 100 > ? process_min_avail = 2 > ? service_count = 50 > } > service pop3 { > ? process_limit = 1024 > } > service replicator { > ? process_min_avail = 1 > ? unix_listener replicator-doveadm { > ????group = vmail > ????mode = 0660 > ? } > } > ssl = required > ssl_ca = </etc/ssl/certs/TUB-CA.pem > ssl_cert = </etc/ssl/certs/mail.inet.tu-berlin.de.crt > ssl_cipher_list = > EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+S > HA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aR > SA:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4 > ssl_client_ca_dir = /etc/ssl/certs > ssl_key = </etc/ssl/private/mail.inet.tu-berlin.de.pem > ssl_prefer_server_ciphers = yes > ssl_protocols = !SSLv2 !SSLv3 > userdb { > ? driver = passwd > ? override_fields = home=/mail/home/%u uid=vmail gid=vmail > allow_all_users=yes > } > protocol lda { > ? auth_socket_path = /var/run/dovecot/auth-master > ? mail_plugins = " notify replication sieve" > } > protocol sieve { > ? managesieve_logout_format = bytes=%i/%o > ? managesieve_max_line_length = 65536 > ? managesieve_notify_capability = mailto > ? managesieve_sieve_capability = fileinto reject envelope encoded- > character vacation subaddress comparator-i;ascii-num eric relational > regex imap4flags copy include variables body enotify environment > mailbox date ihave > } Has anyone any suggestions what went wrong? Is this a dovecot configuration issue or is something broken? Regards, Tom -- Group "Intelligent Networks" (INET) Technische Universit?t Berlin Marchstr. 23 MAR4-4 D-10587 Berlin TEL: +49-30-314-78537 -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: This is a digitally signed message part URL: From r at sys4.de Thu Jul 7 12:31:04 2016 From: r at sys4.de (Ralf Hildebrandt) Date: Thu, 7 Jul 2016 14:31:04 +0200 Subject: "anvil: Error: connect limit: disconnection for unknown pid 17659 + ident lmtp/backup@backup.invalid" Message-ID: <20160707123104.GA27313@sys4.de> I updated to 2.3.0 today, and now I'm getting these entries in my log: Jul 7 14:26:20 mail-cbf dovecot: anvil: Error: connect limit: disconnection for unknown pid 17687 + ident lmtp/backup at backup.invalid Jul 7 14:26:20 mail-cbf dovecot: anvil: Error: connect limit: disconnection for unknown pid 17659 + ident lmtp/backup at backup.invalid Jul 7 14:26:21 mail-cbf dovecot: anvil: Error: connect limit: disconnection for unknown pid 17654 + ident lmtp/backup at backup.invalid Jul 7 14:26:22 mail-cbf dovecot: anvil: Error: connect limit: disconnection for unknown pid 17659 + ident lmtp/backup at backup.invalid Jul 7 14:26:22 mail-cbf dovecot: anvil: Error: connect limit: disconnection for unknown pid 17687 + ident lmtp/backup at backup.invalid Jul 7 14:26:23 mail-cbf dovecot: anvil: Error: connect limit: disconnection for unknown pid 17659 + ident lmtp/backup at backup.invalid lmtp on the other seems to be working ok -- I'm not seeing any mails queueing up... Jul 7 14:28:01 mail-cbf dovecot: lmtp(17659): Connect from local Jul 7 14:28:01 mail-cbf dovecot: anvil: Error: connect limit: disconnection for unknown pid 17659 + ident lmtp/backup at backup.invalid Jul 7 14:28:01 mail-cbf dovecot: lmtp(17659): Disconnect from local: Successful quit -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Schlei?heimer Stra?e 26/MG, 80333 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From daff at pseudoterminal.org Thu Jul 7 12:48:03 2016 From: daff at pseudoterminal.org (Andreas Ntaflos) Date: Thu, 07 Jul 2016 14:48:03 +0200 Subject: LDA autocreate/autosubscribe per namespace? Message-ID: <5d5054e4daec26126c14d71a173317b9@webmail.ptmx.org> Using Dovecot 2.2.25 and Pigeonhole 0.4.14. I can provide the output of doveconf -n if needed. We use a moderately clever global Sieve script to create a read-only (using ACLs) backup/archive of all incoming and outgoing mails. Mail messages filtered this way are filed into folders in a namespace called "Backup", e.g. Backup/sent-backup/${year}/${month} and Backup/received-backup/${year}/${month}. The Sieve script in question can be found at the end of this message for reference. Now obviously we generally want mailboxes to be created automatically, so we set lda_mailbox_autocreate = yes in dovecot.conf. We also want regular mailboxes, created by our users' own Sieve scripts, to be autocreated and autosubscribed, so we also set lda_mailbox_autosubscribe = yes in dovecot.conf. But we *don't* want the Backup mailboxes to be subscribed automatically, because our users usually only need access to those when they want to restore messages accidentally deleted from their INBOX or other folders. So the idea is to keep these Backup mailboxes unsubscribed, which also saves lots of space and network traffic on the user side. When a user then wants to restore a deleted mail message they subscribe to the right Backup folder and copy the message back to their INBOX (and then unsubscribe again). Is there a way to control autocreate/autosubscribe per namespace? Currently it doesn't look that way, and lda_mailbox_autocreate/lda_mailbox_autosubscribe are valid globally. The "Backup" namespace is configured this way: namespace backup { hidden = no list = yes inbox = no location = maildir:~/Maildir-backup prefix = Backup/ separator = / type = private } This is the Sieve script in /etc/dovecot/sieve.d/before/002-backup-mails.sieve: require ["subaddress", "fileinto", "copy", "envelope", "imap4flags", "variables", "date", "mailbox" ]; if currentdate :matches "year" "*" { set "year" "${1}"; } if currentdate :matches "month" "*" { set "month" "${1}"; } # This makes use of sender_bcc_maps in Postfix if envelope :detail "to" "sent-backup" { fileinto :flags "\\Seen" "Backup/sent-backup/${year}/${month}"; stop; } # We only want to backup incoming mail if it is not marked as spam. if header :contains "X-Spam-Flag" ["YES"] { discard; stop; } else { fileinto :copy :flags "\\Seen" "Backup/received-backup/${year}/${month}"; } Thanks, Andreas From nick+dovecot at bunbun.be Thu Jul 7 12:53:16 2016 From: nick+dovecot at bunbun.be (Nick Rosier) Date: Thu, 07 Jul 2016 14:53:16 +0200 Subject: Compile error Dovecot2-pigeonhole In-Reply-To: <000301d1d811$60d747a0$2285d6e0$@pierro.ru> References: <000301d1d811$60d747a0$2285d6e0$@pierro.ru> Message-ID: <577E50BC.10203@bunbun.be> Maximus wrote: > FreeBSD 9.3 > > Dovecot 2.25 (7be1766) > > > I'm trying to install Dovecot2-pigeonhole-0.4.14_2 from ports. > > Get an error: > > cc1: error: unrecognized command line option > "-Wno-duplicate-decl-specifier" > > > With options MAKE_JOBS_UNSAFE=yes: > > cc1: error: unrecognized command line option > "-Wno-duplicate-decl-specifier" > > .... > > I was trying to compile from sources. Same error. > > Any suggestions? Latest build from port works fine for me. Build everything with poudriere but doubt that has anything to do with it. build started at Wed Jul 6 22:30:30 CEST 2016 port directory: /usr/ports/mail/dovecot2-pigeonhole building for: FreeBSD FreeBSD-10-default-job-02 10.3-RELEASE-p5 FreeBSD 10.3-RELEASE-p5 amd64 maintained by: ler at lerctr.org Makefile ident: $FreeBSD: head/mail/dovecot2-pigeonhole/Makefile 418095 2016-07-05 17:06:52Z adamw $ Poudriere version: 3.1.14 Part from build-log: /bin/sh ../../../libtool --tag=CC --mode=compile cc -DHAVE_CONFIG_H -I. -I../../.. -I/usr/local/include/dovecot -DMODULEDIR=\""/usr/local/lib/dovecot"\" -std=gnu99 -O2 -pipe -DLIBICONV_PLUG -fstack-protector -fno-strict-aliasing -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast *-Wno-duplicate-decl-specifier* -Wstrict-aliasing=2 -I/usr/local/include -I../../.. -MT edit-mail.lo -MD -MP -MF .deps/edit-mail.Tpo -c -o edit-mail.lo edit-mail.c libtool: compile: cc -DHAVE_CONFIG_H -I. -I../../.. -I/usr/local/include/dovecot -DMODULEDIR=\"/usr/local/lib/dovecot\" -std=gnu99 -O2 -pipe -DLIBICONV_PLUG -fstack-protector -fno-strict-aliasing -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast *-Wno-duplicate-decl-specifier* -Wstrict-aliasing=2 -I/usr/local/include -I../../.. -MT edit-mail.lo -MD -MP -MF .deps/edit-mail.Tpo -c edit-mail.c -fPIC -DPIC -o .libs/edit-mail.o I'm building with standard CC (clang): FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 Target: x86_64-unknown-freebsd10.3 Thread model: posix Are you using GCC? If so, why??? Rgds, N. From max at pierro.ru Thu Jul 7 13:18:12 2016 From: max at pierro.ru (Maximus) Date: Thu, 7 Jul 2016 16:18:12 +0300 Subject: Compile error Dovecot2-pigeonhole Message-ID: <002801d1d852$03f15300$0bd3f900$@pierro.ru> Thanks, you've saved my day. ;) Switch to clang and everything looks fine. From frank at moltke28.b.shuttle.de Thu Jul 7 13:45:56 2016 From: frank at moltke28.b.shuttle.de (Frank Elsner) Date: Thu, 7 Jul 2016 15:45:56 +0200 Subject: "anvil: Error: connect limit: disconnection for unknown pid 17659 + ident lmtp/backup@backup.invalid" In-Reply-To: <20160707123104.GA27313@sys4.de> References: <20160707123104.GA27313@sys4.de> Message-ID: <20160707154556.15d111146799349dc2a54dbf@moltke28.b.shuttle.de> On Thu, 7 Jul 2016 14:31:04 +0200 Ralf Hildebrandt wrote: > I updated to 2.3.0 today, and now I'm getting these entries in my log: ^^^^^ Hey, what's that? Typo or secret version? --Frank Elsner From michael.slusarz at dovecot.fi Thu Jul 7 14:15:21 2016 From: michael.slusarz at dovecot.fi (Michael Slusarz) Date: Thu, 7 Jul 2016 08:15:21 -0600 (MDT) Subject: "anvil: Error: connect limit: disconnection for unknown pid 17659 + ident lmtp/backup@backup.invalid" In-Reply-To: <20160707154556.15d111146799349dc2a54dbf@moltke28.b.shuttle.de> References: <20160707123104.GA27313@sys4.de> <20160707154556.15d111146799349dc2a54dbf@moltke28.b.shuttle.de> Message-ID: <362367203.676.1467900921912@appsuite-dev.open-xchange.com> > On July 7, 2016 at 7:45 AM Frank Elsner wrote: > > On Thu, 7 Jul 2016 14:31:04 +0200 Ralf Hildebrandt wrote: > > > I updated to 2.3.0 today, and now I'm getting these entries in my log: > > ^^^^^ > > Hey, what's that? Typo or secret version? Development (git master) version. michael From m.mungolin at fsol.su Thu Jul 7 07:44:11 2016 From: m.mungolin at fsol.su (=?koi8-r?B?7dXOx8/Myc4g7cHL08nN?=) Date: Thu, 7 Jul 2016 10:44:11 +0300 Subject: Compile error Dovecot2-pigeonhole Message-ID: <000001d1d823$59d4d370$0d7e7a50$@fsol.su> 1) I was trying to compile from ports: make (without any flags) Got an error: cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" *** [edit-mail.lo] Error code 1 *** [program-client-local.lo] Error code 1 *** [program-client-remote.lo] Error code 1 *** [rfc2822.lo] Error code 1 4 errors *** [all-recursive] Error code 1 1 error *** [all-recursive] Error code 1 1 error *** [all-recursive] Error code 1 1 error *** [all] Error code 2 1 error ===> Compilation failed unexpectedly. Try to set MAKE_JOBS_UNSAFE=yes and rebuild before reporting the failure to the maintainer. *** [do-build] Error code 1 Stop in /usr/ports/mail/dovecot2-pigeonhole. *** [stage] Error code 1 2) When, I was trying to add flag -k (force). Same error. 3) When, I was trying to add flag MAKE_JOBS_UNSAFE. Same error. From stephan at rename-it.nl Thu Jul 7 21:24:13 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 7 Jul 2016 23:24:13 +0200 Subject: Released Pigeonhole v0.4.15 for Dovecot v2.2.25. Message-ID: Hello Dovecot users, I have completed the final release. I found a few more problems while testing this release, so a few more fixes are included. I also added a behavioral change to the vacation extension. Changelog v0.4.15: * vacation extension: The sieve_user_email setting is now used in the check for implicit delivery. - imapsieve plugin: For any mail transaction, the mailbox was opened a second time, even if no mailbox rule matched. This was unintentional, useless and caused problems when the imapsieve plugin was used with other plugins like acl. - extprograms plugin: Significantly improved error handling. No stream errors were logged. - extprograms plugin: Fixed bug in handling of result code from remote program (script service). - extprograms plugin: Connection to remote program service was not retried. - Several small fixes based on static analysis. - Fixed handling of quoted string localparts in email addresses. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.15.tar.gz http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.15.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan at rename-it.nl From listeem at ksb.id.lv Thu Jul 7 21:31:07 2016 From: listeem at ksb.id.lv (KSB) Date: Fri, 8 Jul 2016 00:31:07 +0300 Subject: Dovecot and Solr 6 In-Reply-To: <347df3a7-4902-3614-3eaa-9ba06486fee5@ksb.id.lv> References: <347df3a7-4902-3614-3eaa-9ba06486fee5@ksb.id.lv> Message-ID: <6f4f29e3-9938-ee29-e5fd-e28d8e3f1cb9@ksb.id.lv> On 2016.07.06. 22:51, KSB wrote: > Hi! > Dovecot 2.2.24 > Had set up solr and new schema collection. Copied dovecot provided > schema. There was an error with booleans (while getting schema via > http), which I "solved" by removing "add-unknown-fields-to-the-schema" > from solrconfig.xml. It is correct way to solve this? > Anyway, I run tcpdump to see network activity between dovecot and solr: > #tcpdump -i lo port 8983 > and see nothing while doing: > #doveadm fts rescan -u username at domain.tld > no output also from doveadm. > > Noticed that dovecot.index.log reapears in user mail root if deleted. > > plugin { > fts = solr > fts_solr = url=http://localhost:8983/solr/dovecot/ debug > .. > } > > -- > KSB After some fiddling around, come in to conclusion that doveadm fts rescan is nothing to do about real indexing. So, it is working. Anyway, now thinking about what really differs when fts is used vs not used. 1 argument is speed, what else? -- KSB From bc979 at lafn.org Thu Jul 7 21:50:47 2016 From: bc979 at lafn.org (Doug Hardie) Date: Thu, 7 Jul 2016 14:50:47 -0700 Subject: Deletion of mail from Junk mailbox In-Reply-To: <5F9108AE-EBE5-4EDA-8EB5-6ED7045936E1@mail.sermon-archive.info> References: <887B5445-CC35-4765-AAB0-B380D1609E85@lafn.org> <79e13d3bcdf48536b95e7978e6939141@ausics.net> <5F9108AE-EBE5-4EDA-8EB5-6ED7045936E1@mail.sermon-archive.info> Message-ID: > On 4 July 2016, at 13:18, Doug Hardie wrote: > >> >> On 2 July 2016, at 02:29, Noel Butler wrote: >> >> On 02/07/2016 19:16, Doug Hardie wrote: >>> I have a pigeon sive running which directs some of my received mail to >>> the Junk folder. That works just fine. However, a couple minutes >>> later, it is moved to Deleted mailbox and deleted from Junk. At first >>> I thought my client was doing that so I shut down the client and it >>> still happens. Here are the log entries: >>> Jul 2 00:36:31 mail dovecot: imap(doug): copy from INBOX: box=Junk, >>> uid=10842, msgid=, size=3340, >>> from="jnilj"
>>> Jul 2 00:36:31 mail dovecot: imap(doug): delete: box=INBOX, >>> uid=55719, msgid=, size=3340, >>> from="jnilj"
>>> Jul 2 00:39:33 mail dovecot: imap(doug): copy from Junk: box=Deleted >>> Messages, uid=31049, msgid=, >>> size=3340, from="jnilj"
>>> Jul 2 00:39:33 mail dovecot: imap(doug): delete: box=Junk, uid=10842, >>> msgid=, size=3340, from="jnilj" >>>
>>> Jul 2 00:50:29 mail dovecot: imap(doug): expunge: box=Junk, >>> uid=10842, msgid=, size=3340, >>> from="jnilj"
>>> Jul 2 00:50:29 mail dovecot: imap(doug): expunge: box=INBOX, >>> uid=55719, msgid=, size=3340, >>> from="jnilj"
>>> Is this the intended way the Junk maibox is supposed to work? I >>> couldn't find any settings that appear to control (or affect) this >>> behavior. >>> ? Doug >> >> and your dovecot version is? >> >> I suggest you'll also need to show doveconf -n and example of sieve rules, because it doesnt seem right, certainly does not do that here. >> > > > After some more experimentation, it seemed like the messages above were created by a MUA and not the LDA. However, I was not able to identify the MUA that caused that. I modified logging to include the remote IP address, restarted dovecot with all the MUAs disabled. Now the problem has not reoccurred. I have been restarting the MUSs one at a time, however I still don't know who did it. I have only had a couple junk emails in the last few days so its not much of a test yet. I guess the volume will return to normal tomorrow. > > mail# doveconf -n > # 2.2.24 (a82c823): /usr/local/etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.14 (099a97c) > # OS: FreeBSD 9.3-RELEASE-p43 amd64 ufs > auth_mechanisms = plain login > base_dir = /var/run/home_mail/ > first_valid_gid = 0 > lda_mailbox_autocreate = yes > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k session=<%{session}> port=%a > mail_gid = 2222 > mail_location = maildir:/var/mail/home_mail/%n > mail_log_prefix = "%s(%u)[%r]<%{session}>: " > mail_uid = 2222 > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext > namespace inbox { > inbox = yes > location = > mailbox Drafts { > autoexpunge = 5 days > special_use = \Drafts > } > mailbox Junk { > autoexpunge = 2 days > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > autoexpunge = 2 days > special_use = \Trash > } > prefix = > } > passdb { > args = scheme=CRYPT username_format=%n /usr/local/etc/dovecot/users > driver = passwd-file > } > plugin { > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > mail_log_fields = uid box msgid size from > sieve = file:/var/mail/home_mail/%n/sieve;active=/var/mail/home_mail/%n/.dovecot.sieve > } > postmaster_address = doug at sermon-archive.info > protocols = imap > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0666 > user = vmail > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > inet_listener imaps2 { > port = 998 > ssl = yes > } > } > ssl_cert = ssl_key = syslog_facility = local0 > userdb { > args = home=/var/mail/home_mail/%d/%n allow_all_users=yes > driver = static > } > verbose_proctitle = yes > protocol lda { > mail_plugins = " sieve" > } > protocol imap { > mail_plugins = " mail_log notify" > } > protocol pop3 { > mail_plugins = " mail_log notify" > } > mail# Well, its been running a few days now and I still am able to reproduce the problem. There has been quite a bit of mail moved by sieve to Junk, but none was deleted. It appears that changing the logging fixed the problem. I have a lot of trouble believing that though. I still suspect one of the MUAs, but have no idea which one it might have been. ? Doug From sysadmin at e-positive.ee Thu Jul 7 22:14:19 2016 From: sysadmin at e-positive.ee (Mart Pirita) Date: Fri, 8 Jul 2016 01:14:19 +0300 Subject: Dovecot 2.2.25 compiling error In-Reply-To: <577A30AD.1060500@dovecot.fi> References: <42959389-cb3b-f7a9-191c-069d09312cdc@e-positive.ee> <361807399.1509.1467478687848@appsuite-dev.open-xchange.com> <938622260.1512.1467479024557@appsuite-dev.open-xchange.com> <577A30AD.1060500@dovecot.fi> Message-ID: <1ea6af91-b59b-f522-6662-0d259e555f88@e-positive.ee> Aki Tuomi wrote: > This has been now fixed in master-2.2 with > > https://github.com/dovecot/core/commit/20e802d6bbf4ddad3a2140a2f7812d01de0ec2ef > https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29dea7 > > Our testings indicate that you can compile 2.2.25.1 on CentOS5 with > these applied. > Well, tried with or without patches, but got still same error: sha1.h:80: error: static or type qualifiers in abstract declarator Editing config.h, #define STATIC_ARRAY static > #define STATIC_ARRAY does help, but as configure generates via confdefs.h config.h file, then it's overwritten every time by configure: if test $i_cv_c99_static_arrays = yes; then static_value=static else static_value= fi cat >>confdefs.h <<_ACEOF #define STATIC_ARRAY $static_value _ACEOF So finally I just manually removed, as a dirty workaround, the STATIC_ARRAY value from test result "yes": if test $i_cv_c99_static_arrays = yes; then static_value= else static_value= fi And dovecot compiled fine from latest, unpatched dovecot-2.2.25.tar.gz source. During rpm install I got error, that this build depends on libstats_auth.so and found that it have to be in /usr/lib/dovecot/stats folder, so I included it in spec file and rebuilt rpm again and installed it. So far all OK. -- Mart From jtam.home at gmail.com Thu Jul 7 22:37:52 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 7 Jul 2016 15:37:52 -0700 (PDT) Subject: Dovecot 2.2.25 compiling error Message-ID: > Well, tried with or without patches, but got still same error: > > sha1.h:80: error: static or type qualifiers in abstract declarator For what it's worth, I get the same error compiling on Solaris 10. It may be because I have a rather old gcc (3.4.4). Editing out the "static" keyword from config.h allowed it to finish the compile. Joseph Tam From zhb at iredmail.org Fri Jul 8 01:22:17 2016 From: zhb at iredmail.org (Zhang Huangbin) Date: Fri, 8 Jul 2016 09:22:17 +0800 Subject: Dovecot and Solr 6 In-Reply-To: <6f4f29e3-9938-ee29-e5fd-e28d8e3f1cb9@ksb.id.lv> References: <347df3a7-4902-3614-3eaa-9ba06486fee5@ksb.id.lv> <6f4f29e3-9938-ee29-e5fd-e28d8e3f1cb9@ksb.id.lv> Message-ID: <01989A5C-8FF1-4C08-83C9-659243946CD2@iredmail.org> > On Jul 8, 2016, at 5:31 AM, KSB wrote: > > 1 argument is speed, what else? Solr is built for indexing, what else do you expect? From yingying.liu at cs2c.com.cn Fri Jul 8 04:53:31 2016 From: yingying.liu at cs2c.com.cn (=?UTF-8?Q?=E5=88=98=E8=8E=B9=E8=8E=B9?=) Date: Fri, 08 Jul 2016 12:53:31 +0800 Subject: a question about dovecot-sieve Message-ID: question discribe: example: > vim .dovecot.sieve require ["fileinto"]; # rule:[filter1] if anyof (header :contains "Subject" "????") { fileinto "sieve"; } when i write a mail ,give subject "????????" , then server convert this subject to " SUBJECT: =?UTF-8?Q?=E8=BF=99=E6=98=AF=E4=B8=80=E5=B0=81=E6=B5=8B=E8=AF=95=E9=82=AE?= =?UTF-8?Q?=E4=BB=B6?= " the essential question is when the mail go through dovecot-sieve plugin, the sieve plugin get mail subject is "??????? ?" not "????????"?there is a extra space added(which as segmentation between "=?UTF-8?Q?"). SIMPLY SAY?edit subject"????????" ??>server convert "SUBJECT: =?UTF-8?Q?=E8=BF=99=E6=98=AF=E4=B8=80=E5=B0=81=E6=B5=8B=E8=AF=95=E9=82=AE?= =?UTF-8?Q?=E4=BB=B6?="??>sieve plugin get "??????? ?" The result is filter failure. is this a bug ? How can I avoid it? thanks From aki.tuomi at dovecot.fi Fri Jul 8 05:38:51 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Fri, 8 Jul 2016 08:38:51 +0300 Subject: Dovecot 2.2.25 compiling error In-Reply-To: References: Message-ID: <577F3C6B.7050803@dovecot.fi> On 08.07.2016 01:37, Joseph Tam wrote: > >> Well, tried with or without patches, but got still same error: >> >> sha1.h:80: error: static or type qualifiers in abstract declarator > > For what it's worth, I get the same error compiling on Solaris 10. > It may be because I have a rather old gcc (3.4.4). Editing out > the "static" keyword from config.h allowed it to finish the compile. > > Joseph Tam It still happened even with https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29dea7 ? You need to rerun autotools on this before it can do anything. Aki From listeem at ksb.id.lv Fri Jul 8 09:34:20 2016 From: listeem at ksb.id.lv (KSB) Date: Fri, 8 Jul 2016 12:34:20 +0300 Subject: Dovecot and Solr 6 In-Reply-To: <01989A5C-8FF1-4C08-83C9-659243946CD2@iredmail.org> References: <347df3a7-4902-3614-3eaa-9ba06486fee5@ksb.id.lv> <6f4f29e3-9938-ee29-e5fd-e28d8e3f1cb9@ksb.id.lv> <01989A5C-8FF1-4C08-83C9-659243946CD2@iredmail.org> Message-ID: On 2016.07.08. 4:22, Zhang Huangbin wrote: > >> On Jul 8, 2016, at 5:31 AM, KSB wrote: >> >> 1 argument is speed, what else? > > Solr is built for indexing, what else do you expect? > Stemming for example, but it's not critical anyway, as my language doe's not have publicly available stemming dictionary/algorithm. -- KSB From leon at f-m.fm Sat Jul 9 07:26:28 2016 From: leon at f-m.fm (Leon Kyneur) Date: Sat, 9 Jul 2016 15:26:28 +0800 Subject: Raw backtrace multiple passwords not allowed Message-ID: <5780A724.9030500@f-m.fm> Hi Recently enabled support for encrypted passwords on my proxies - CRAM-MD5, DIGEST-MD5, NTLM and APOP to support some new users. Most users are working perfectly though every so often I see this happening in the logs: Jul 09 06:32:51 auth: Error: ldap(user at domain.com,192.168.10.90,): Multiple password values not supported Jul 09 06:32:51 auth: Panic: file passdb-ldap.c: line 99 (ldap_lookup_finish): assertion failed: (password == NULL || scheme != NULL) Jul 09 06:32:51 auth: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x86aae) [0x7ff4db08faae] -> /usr/lib64/dovecot/libdovecot.so.0(+0x86b8e) [0x7ff4db08fb8e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff4db033b5d] -> /usr/lib64/dovecot/auth/libauthdb_ldap.so(+0x720b) [0x7ff4d967a20b] -> /usr/lib64/dovecot/auth/libauthdb_ldap.so(+0x5e2f) [0x7ff4d9678e2f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7ff4db0a338c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xff) [0x7ff4db0a47ef] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7ff4db0a3415] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7ff4db0a35c8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7ff4db03a033] -> dovecot/auth [13 wait, 1 passdb, 0 userdb](main+0x39c) [0x7ff4db5454ac] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7ff4da61fb15] -> dovecot/auth [13 wait, 1 passdb, 0 userdb](+0xf6a1) [0x7ff4db5456a1] Jul 09 06:32:51 imap-login: Warning: Auth connection closed with 1 pending requests (max 0 secs, pid=8759, EOF) Jul 09 06:32:51 imap-login: Warning: Auth connection closed with 1 pending requests (max 1 secs, pid=8764, EOF) Password debug shows: Jul 09 06:38:25 auth: Debug: ldap(user at domain.com,192.168.10.90,): Credentials: 4b616e6761733138 Jul 09 06:38:27 auth: Debug: client passdb out: FAIL 2541 user=user at domain.com pass=NotPassword original_user=user Jul 09 06:38:37 auth: Debug: passwd-file(tassiedevil,192.168.10.90,): username changed user -> user at domain.com Jul 09 06:38:37 auth: Debug: passwd-file(user at domain.com,192.168.10.90,): Allowing any password Jul 09 06:38:37 auth: Debug: ldap(user at domain.com,192.168.10.90,): pass search: base=o=domains,dc=mail,dc=com scope=subtree filter=(&(objectClass=mail)(status=active)(|(|(mail=user at domain.com)(&(uid=user at domain.com)))(&(enabledService=shadowaddress)(shadowAddress user at domain.com)))) fields=mail,userPlaintextPassword,userPlaintextPassword,mailstoreHost Jul 09 06:38:37 auth: Debug: ldap(user at domain.com,192.168.10.90,): result: mail=user at domain.com userPlaintextPassword=NotPassword; mail,userPlaintextPassword unused Jul 09 06:38:37 auth: Debug: ldap(user at domain.com,192.168.10.90,): result: mail=user at domain.com userPlaintextPassword=NotPassword; mailstoreHost missing Jul 09 06:38:37 auth: Debug: ldap(user at domain.com,192.168.10.90,): PLAIN( Jenni) != 'NotPassword' Jul 09 06:38:39 auth: Debug: client passdb out: FAIL 2826 user=user at domain.com original_user=user This particular user has a space in their password.. some other users do not when seeing this error. I run multiple passdb and config is: passdb { args = /etc/dovecot/dovecot-ldap-proxy-alias.conf.ext default_fields = nopassword=y password= driver = ldap result_failure = continue-fail result_internalfail = continue-fail result_success = continue-ok } passdb { args = scheme=plain username_format=%l@%d /etc/dovecot/passwd.domains default_fields = nopassword=y password= driver = passwd-file result_success = continue-fail } passdb { args = /etc/dovecot/dovecot-ldap-proxy.conf.ext driver = ldap } LDAP passdb specifies 'PLAIN' as default_pass_scheme. [root at S605 dovecot]# dovecot --version 2.2.24 (a82c823) Any ideas what's going on here? From lists at alex-at.ru Sat Jul 9 07:55:06 2016 From: lists at alex-at.ru (Alexey Asemov (Alex/AT)) Date: Sat, 9 Jul 2016 10:55:06 +0300 Subject: [2.2.25 auth issue] auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) In-Reply-To: <8b872c68-d12d-f270-3b16-a904628a8450@alex-at.ru> References: <8b872c68-d12d-f270-3b16-a904628a8450@alex-at.ru> Message-ID: Hello, Since updating to 2.2.25, we do have the following issue (seems to be related to the new auth policy code): Jul 9 00:00:14 LXmail01 dovecot: auth-worker(6558): sql(user at domain.org,*.*.*.*,): unknown user Jul 9 00:00:14 LXmail01 dovecot: auth: Panic: file auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) Jul 9 00:00:14 LXmail01 dovecot: auth: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x8d57e) [0x7f197bd8157e] -> /usr/lib64/dovecot/libdovecot.so.0(+0x8d65e) [0x7f197bd8165e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f197bd201f6] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x1a15a) [0x7f197c44715a] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x26f8f) [0x7f197c453f8f] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x19d2b) [0x7f197c446d2b] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](auth_request_lookup_credentials_callback+0x68) [0x7f197c4 46e28] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](passdb_handle_credentials+0x92) [0x7f197c457742] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2af06) [0x7f197c457f06] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2065a) [0x7f197c44d65a] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f197bd94edc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_in ternal+0xff) [0x7f197bd9633f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f197bd94f65] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f197bd95118] -> /usr /lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f197bd26663] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](main+0x3a1) [0x7f197c43cbe1] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f197b30ab15] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0xfdd1) [0x7f197c43cdd1] Jul 9 00:00:14 LXmail01 dovecot: auth: Fatal: master: service(auth): child 6555 killed with signal 6 (core dumps disabled) Jul 9 00:00:14 LXmail01 dovecot: pop3-login: Warning: Auth connection closed with 1 pending requests (max 1 secs, pid=8133, EOF) Environment is MySQL passdb/userdb, we are using plain scheme as default and password_noscheme field. In 2.2.24 and below auth worked without scratch. Reverting all policy-related commits in 2.2.25 fixes this, but I have not dug the details. KR, Alex From tripivceta at gmail.com Sat Jul 9 10:01:43 2016 From: tripivceta at gmail.com (UNIX admin) Date: Sat, 9 Jul 2016 12:01:43 +0200 Subject: passdb {driver = shadow args = override_username=%variable} Message-ID: Hello list I want to implement override_username = %variable for the "shadow" driver, so that the following works: passdb { driver = shadow args = override_username=%Ln } by "%variable", I mean "Variables" at http://wiki.dovecot.org/Variables. I've hacked up a solution with strtok(3C), but that's a hack and a possible security hole, and I'd rather not implement it. What I really want is to be able to leverage Dovecot's var_expand() call, which, looking at the code, appears to be the function responsible for %variable expansion and formatting. The relevant piece of code seems to be this excerpt in auth/passdb-shadow.c: static enum passdb_result shadow_lookup(struct auth_request *request, struct spwd **spw_r) { auth_request_log_debug(request, AUTH_SUBSYS_DB, "lookup"); *spw_r = getspnam(request->user); if (*spw_r == NULL) { auth_request_log_unknown_user(request, AUTH_SUBSYS_DB); return PASSDB_RESULT_USER_UNKNOWN; } when request->user contains 'user at domain.tld', I want the code to be able to process "override_username", determine that the format is %Ln so that request->user is lowercased, and everything after the "@" sign is stripped. Therefore, if this user happens to exist in the shadow file, authentication will succeed. Currently, the "shadow" driver only appears to support "args = blocking=no". Please advise. From gbulfon at sonicle.com Fri Jul 8 16:20:08 2016 From: gbulfon at sonicle.com (Gabriele Bulfon) Date: Fri, 8 Jul 2016 18:20:08 +0200 (CEST) Subject: Dovecot threading implementation Message-ID: <12720369.439.1467994808626.JavaMail.sonicle@www> Hi, I was trying to compare avrious thread refs/references implementation, both server side and client side. While testing dovecot, it looks to me that issuing thread=references or thread=refs I get the same response, while the refs drafts says it should reverse the date ordering inside a branch. Is this correct? Does Dovecot implements references and refs with same sorting? Also, cyrus has subject grouping included in references (which is bad!). What's dovecot doing in references alg? Thanks for any help, Gabriele ---------------------------------------------------------------------------------------- Sonicle S.r.l. : http://www.sonicle.com Music: http://www.gabrielebulfon.com Quantum Mechanics : http://www.cdbaby.com/cd/gabrielebulfon From leon at f-m.fm Sun Jul 10 10:32:56 2016 From: leon at f-m.fm (Leon Kyneur) Date: Sun, 10 Jul 2016 18:32:56 +0800 Subject: Raw backtrace multiple passwords not allowed In-Reply-To: <5780A724.9030500@f-m.fm> References: <5780A724.9030500@f-m.fm> Message-ID: <57822458.2070001@f-m.fm> This turned into quite a large problem for me but think I have resolved it. After toying this a few settings I ended up (out of sheer desperation) setting "blocking = yes" in my LDAP configuration. Is this a logical thing to do? I couldn't find much on it other than i'm guessing queries are no long async. I don't really see the downside given the upside is auth is not crashing and causing password prompts for all my customers... On 09/07/16 15:26, Leon Kyneur wrote: > Hi > > Recently enabled support for encrypted passwords on my proxies - > CRAM-MD5, DIGEST-MD5, NTLM and APOP to support some new users. Most > users are working perfectly though every so often I see this happening > in the logs: > > Jul 09 06:32:51 auth: Error: > ldap(user at domain.com,192.168.10.90,): Multiple > password values not supported > Jul 09 06:32:51 auth: Panic: file passdb-ldap.c: line 99 > (ldap_lookup_finish): assertion failed: (password == NULL || scheme != > NULL) > Jul 09 06:32:51 auth: Error: Raw backtrace: > /usr/lib64/dovecot/libdovecot.so.0(+0x86aae) [0x7ff4db08faae] -> > /usr/lib64/dovecot/libdovecot.so.0(+0x86b8e) [0x7ff4db08fb8e] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff4db033b5d] -> > /usr/lib64/dovecot/auth/libauthdb_ldap.so(+0x720b) [0x7ff4d967a20b] -> > /usr/lib64/dovecot/auth/libauthdb_ldap.so(+0x5e2f) [0x7ff4d9678e2f] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) > [0x7ff4db0a338c] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xff) > [0x7ff4db0a47ef] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) > [0x7ff4db0a3415] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7ff4db0a35c8] > -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7ff4db03a033] -> dovecot/auth [13 wait, 1 passdb, 0 > userdb](main+0x39c) [0x7ff4db5454ac] -> > /lib64/libc.so.6(__libc_start_main+0xf5) [0x7ff4da61fb15] -> > dovecot/auth [13 wait, 1 passdb, 0 userdb](+0xf6a1) [0x7ff4db5456a1] > Jul 09 06:32:51 imap-login: Warning: Auth connection closed with 1 > pending requests (max 0 secs, pid=8759, EOF) > Jul 09 06:32:51 imap-login: Warning: Auth connection closed with 1 > pending requests (max 1 secs, pid=8764, EOF) > > Password debug shows: > Jul 09 06:38:25 auth: Debug: > ldap(user at domain.com,192.168.10.90,): Credentials: > 4b616e6761733138 > Jul 09 06:38:27 auth: Debug: client passdb out: FAIL 2541 > user=user at domain.com pass=NotPassword original_user=user > Jul 09 06:38:37 auth: Debug: > passwd-file(tassiedevil,192.168.10.90,): username > changed user -> user at domain.com > Jul 09 06:38:37 auth: Debug: > passwd-file(user at domain.com,192.168.10.90,): > Allowing any password > Jul 09 06:38:37 auth: Debug: > ldap(user at domain.com,192.168.10.90,): pass search: > base=o=domains,dc=mail,dc=com scope=subtree > filter=(&(objectClass=mail)(status=active)(|(|(mail=user at domain.com)(&(uid=user at domain.com)))(&(enabledService=shadowaddress)(shadowAddress > user at domain.com)))) > fields=mail,userPlaintextPassword,userPlaintextPassword,mailstoreHost > Jul 09 06:38:37 auth: Debug: > ldap(user at domain.com,192.168.10.90,): result: > mail=user at domain.com userPlaintextPassword=NotPassword; > mail,userPlaintextPassword unused > Jul 09 06:38:37 auth: Debug: > ldap(user at domain.com,192.168.10.90,): result: > mail=user at domain.com userPlaintextPassword=NotPassword; mailstoreHost > missing > Jul 09 06:38:37 auth: Debug: > ldap(user at domain.com,192.168.10.90,): PLAIN( Jenni) > != 'NotPassword' > Jul 09 06:38:39 auth: Debug: client passdb out: FAIL 2826 > user=user at domain.com original_user=user > > > This particular user has a space in their password.. some other users > do not when seeing this error. > > I run multiple passdb and config is: > passdb { > args = /etc/dovecot/dovecot-ldap-proxy-alias.conf.ext > default_fields = nopassword=y password= > driver = ldap > result_failure = continue-fail > result_internalfail = continue-fail > result_success = continue-ok > } > passdb { > args = scheme=plain username_format=%l@%d /etc/dovecot/passwd.domains > default_fields = nopassword=y password= > driver = passwd-file > result_success = continue-fail > } > passdb { > args = /etc/dovecot/dovecot-ldap-proxy.conf.ext > driver = ldap > } > > LDAP passdb specifies 'PLAIN' as default_pass_scheme. > > [root at S605 dovecot]# dovecot --version > 2.2.24 (a82c823) > > Any ideas what's going on here? From aki.tuomi at dovecot.fi Sun Jul 10 12:05:12 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 10 Jul 2016 15:05:12 +0300 (EEST) Subject: Raw backtrace multiple passwords not allowed In-Reply-To: <57822458.2070001@f-m.fm> References: <5780A724.9030500@f-m.fm> <57822458.2070001@f-m.fm> Message-ID: <1974206914.3479.1468152313416@appsuite-dev.open-xchange.com> You sure you're not returning multiple password attributes from LDAP? Aki > On July 10, 2016 at 1:32 PM Leon Kyneur wrote: > > > This turned into quite a large problem for me but think I have resolved it. > > After toying this a few settings I ended up (out of sheer desperation) > setting "blocking = yes" in my LDAP configuration. > > Is this a logical thing to do? I couldn't find much on it other than i'm > guessing queries are no long async. > > I don't really see the downside given the upside is auth is not crashing > and causing password prompts for all my customers... > > On 09/07/16 15:26, Leon Kyneur wrote: > > Hi > > > > Recently enabled support for encrypted passwords on my proxies - > > CRAM-MD5, DIGEST-MD5, NTLM and APOP to support some new users. Most > > users are working perfectly though every so often I see this happening > > in the logs: > > > > Jul 09 06:32:51 auth: Error: > > ldap(user at domain.com,192.168.10.90,): Multiple > > password values not supported > > Jul 09 06:32:51 auth: Panic: file passdb-ldap.c: line 99 > > (ldap_lookup_finish): assertion failed: (password == NULL || scheme != > > NULL) > > Jul 09 06:32:51 auth: Error: Raw backtrace: > > /usr/lib64/dovecot/libdovecot.so.0(+0x86aae) [0x7ff4db08faae] -> > > /usr/lib64/dovecot/libdovecot.so.0(+0x86b8e) [0x7ff4db08fb8e] -> > > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff4db033b5d] -> > > /usr/lib64/dovecot/auth/libauthdb_ldap.so(+0x720b) [0x7ff4d967a20b] -> > > /usr/lib64/dovecot/auth/libauthdb_ldap.so(+0x5e2f) [0x7ff4d9678e2f] -> > > /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) > > [0x7ff4db0a338c] -> > > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xff) > > [0x7ff4db0a47ef] -> > > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) > > [0x7ff4db0a3415] -> > > /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7ff4db0a35c8] > > -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) > > [0x7ff4db03a033] -> dovecot/auth [13 wait, 1 passdb, 0 > > userdb](main+0x39c) [0x7ff4db5454ac] -> > > /lib64/libc.so.6(__libc_start_main+0xf5) [0x7ff4da61fb15] -> > > dovecot/auth [13 wait, 1 passdb, 0 userdb](+0xf6a1) [0x7ff4db5456a1] > > Jul 09 06:32:51 imap-login: Warning: Auth connection closed with 1 > > pending requests (max 0 secs, pid=8759, EOF) > > Jul 09 06:32:51 imap-login: Warning: Auth connection closed with 1 > > pending requests (max 1 secs, pid=8764, EOF) > > > > Password debug shows: > > Jul 09 06:38:25 auth: Debug: > > ldap(user at domain.com,192.168.10.90,): Credentials: > > 4b616e6761733138 > > Jul 09 06:38:27 auth: Debug: client passdb out: FAIL 2541 > > user=user at domain.com pass=NotPassword original_user=user > > Jul 09 06:38:37 auth: Debug: > > passwd-file(tassiedevil,192.168.10.90,): username > > changed user -> user at domain.com > > Jul 09 06:38:37 auth: Debug: > > passwd-file(user at domain.com,192.168.10.90,): > > Allowing any password > > Jul 09 06:38:37 auth: Debug: > > ldap(user at domain.com,192.168.10.90,): pass search: > > base=o=domains,dc=mail,dc=com scope=subtree > > filter=(&(objectClass=mail)(status=active)(|(|(mail=user at domain.com)(&(uid=user at domain.com)))(&(enabledService=shadowaddress)(shadowAddress > > user at domain.com)))) > > fields=mail,userPlaintextPassword,userPlaintextPassword,mailstoreHost > > Jul 09 06:38:37 auth: Debug: > > ldap(user at domain.com,192.168.10.90,): result: > > mail=user at domain.com userPlaintextPassword=NotPassword; > > mail,userPlaintextPassword unused > > Jul 09 06:38:37 auth: Debug: > > ldap(user at domain.com,192.168.10.90,): result: > > mail=user at domain.com userPlaintextPassword=NotPassword; mailstoreHost > > missing > > Jul 09 06:38:37 auth: Debug: > > ldap(user at domain.com,192.168.10.90,): PLAIN( Jenni) > > != 'NotPassword' > > Jul 09 06:38:39 auth: Debug: client passdb out: FAIL 2826 > > user=user at domain.com original_user=user > > > > > > This particular user has a space in their password.. some other users > > do not when seeing this error. > > > > I run multiple passdb and config is: > > passdb { > > args = /etc/dovecot/dovecot-ldap-proxy-alias.conf.ext > > default_fields = nopassword=y password= > > driver = ldap > > result_failure = continue-fail > > result_internalfail = continue-fail > > result_success = continue-ok > > } > > passdb { > > args = scheme=plain username_format=%l@%d /etc/dovecot/passwd.domains > > default_fields = nopassword=y password= > > driver = passwd-file > > result_success = continue-fail > > } > > passdb { > > args = /etc/dovecot/dovecot-ldap-proxy.conf.ext > > driver = ldap > > } > > > > LDAP passdb specifies 'PLAIN' as default_pass_scheme. > > > > [root at S605 dovecot]# dovecot --version > > 2.2.24 (a82c823) > > > > Any ideas what's going on here? From leon at f-m.fm Sun Jul 10 13:37:06 2016 From: leon at f-m.fm (Leon Kyneur) Date: Sun, 10 Jul 2016 21:37:06 +0800 Subject: Raw backtrace multiple passwords not allowed In-Reply-To: <1974206914.3479.1468152313416@appsuite-dev.open-xchange.com> References: <5780A724.9030500@f-m.fm> <57822458.2070001@f-m.fm> <1974206914.3479.1468152313416@appsuite-dev.open-xchange.com> Message-ID: <57824F82.90206@f-m.fm> > You sure you're not returning multiple password attributes from LDAP? > > Aki pass_attrs = 'mail=user, userPlaintextPassword=password_noscheme, =proxy=y, =pass=%{ldap:userPlaintextPassword}, =host=%{ldap:mailstoreHost}' I am returning the same password attribute into different fields : password_noscheme - to auth the user pass = to send plaintext password to backend This is the only workable solution I could muster to terminate encrypted passwords on the proxy layer. From leon at f-m.fm Sun Jul 10 14:44:21 2016 From: leon at f-m.fm (Leon Kyneur) Date: Sun, 10 Jul 2016 22:44:21 +0800 Subject: Panic: file mdbox-save.c: line 337: unreached Message-ID: <57825F45.7000305@f-m.fm> Recently updated to 2.2.25. Noticed a migration script I've been previously running fine started giving me the errors below. Remove server doesn't log any failure. doveconf -n attached. + /bin/doveadm -o mail_fsync=never backup -R -u user at domain.com imapc: dsync(user at domain.com): Panic: file mdbox-save.c: line 337: unreached dsync(user at domain.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x8d52e) [0x7f58e6da052e] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_ha ndler+0x2a) [0x7f58e6da059a] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f58e6d3f1b6] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5b157) [0x7f58e7080157] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbfdbf) [0x7f58e70e4dbf] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9d) [0x7f58e 710043d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x107) [0x7f58e70e5337] -> /usr/lib64/dovecot/lib20_zlib_plugin.so(+0x3163) [0x7f58e5f29 163] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0xc703) [0x7f58e613d703] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x51) [0 x7f58e7069631] -> /bin/doveadm [user at domain.com INBOX import:650/674](dsync_mailbox_import_deinit+0xf8) [0x7f58e7a12898] -> /bin/doveadm [user at domain.com IN BOX import:650/674](+0x41bbf) [0x7f58e7a0cbbf] -> /bin/doveadm [user at domain.com INBOX import:650/674](dsync_brain_sync_mails+0x723) [0x7f58e7a0d433] -> /bin/dovea dm [user at domain.com INBOX import:650/674](dsync_brain_run+0x5f8) [0x7f58e7a08c78] -> /bin/doveadm [user at domain.com INBOX import:650/674](+0x27521) [0x7f58e7 9f2521] -> /bin/doveadm [user at domain.com INBOX import:650/674](+0x2929f) [0x7f58e79f429f] -> /bin/doveadm [user at domain.com INBOX import:650/674](+0x29d8d) [0x7f58e79f4d8d] -> /bin/doveadm [user at domain.com INBOX import:650/674](doveadm_mail_try_run+0x215) [0x7f58e79f56f5] -> /bin/doveadm [user at domain.com INBOX import:650/674](main+0x455) [0x7f58e79e57f5] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f58e6973b15] -> /bin/doveadm [user at domain.com INBOX import:650/674](+0x1a96d) [0x7f58e79e596d] /root/migrate_code/migrate_mailbox_eftel.sh: line 31: 48637 Aborted /bin/doveadm -o mail_fsync=never backup -R -u $USERNAME imapc: + RETCODE=134 Regards Leon -------------- next part -------------- # 2.2.25 (7be1766): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: Linux 3.10.0-327.4.5.el7.x86_64 x86_64 CentOS Linux release 7.2.1511 (Core) auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@&+ debug_log_path = /var/log/dovecot-debug.log imapc_features = rfc822.size fetch-headers fetch-fix-broken-mails imapc_host = 192.168.90.4 imapc_master_user = migrate imapc_password = # hidden, use -P to show it imapc_user = %u lmtp_proxy = yes log_path = /var/log/dovecot.log login_trusted_networks = 192.168.10.0/24 mail_gid = vmail mail_location = mdbox:%h/mdbox:ALT=/altstorage%h/mdbox mail_plugins = quota zlib mail_prefetch_count = 50 mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_size = 10 M namespace { hidden = yes list = no location = pop3c: prefix = POP3-MIGRATION-NS/ } namespace inbox { inbox = yes location = mailbox "Deleted Messages" { auto = no autoexpunge = 90 days special_use = \Trash } mailbox Drafts { special_use = \Drafts } mailbox Junk { autoexpunge = 90 days special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = no autoexpunge = 90 days special_use = \Junk } mailbox Trash { autoexpunge = 90 days special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-ldap-old.conf.ext driver = ldap result_failure = continue-fail result_internalfail = continue-fail result_success = continue-ok skip = authenticated } passdb { args = /etc/dovecot/dovecot-ldap-new.conf.ext driver = ldap result_failure = return-fail result_internalfail = return-fail result_success = continue-ok skip = authenticated } plugin { pop3_migration_ignore_missing_uidls = yes pop3_migration_mailbox = POP3-MIGRATION-NS/INBOX quota = dict:User quota:noenforcing:file:%h/dovecot-quota quota_status_nouser = DUNNO quota_status_overquota = 552 5.5.2 Mailbox is full quota_status_success = DUNNO quota_warning = storage=99%% quota-warning 99 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=80%% quota-warning 80 %u sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/default.sieve stats_refresh = 60 secs zlib_save = gz zlib_save_level = 6 } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, uidls=%u pop3c_host = 192.168.90.4 pop3c_password = # hidden, use -P to show it protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service lmtp { inet_listener lmtp { address = 192.168.10.221 port = 24 } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 12340 } service_count = 0 } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { user = vmail } } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = credentials_scheme == scheme) In-Reply-To: References: <8b872c68-d12d-f270-3b16-a904628a8450@alex-at.ru> Message-ID: <57832CF8.8040506@dovecot.fi> On 09.07.2016 10:55, Alexey Asemov (Alex/AT) wrote: > Hello, > > Since updating to 2.2.25, we do have the following issue (seems to be > related to the new auth policy code): > > Jul 9 00:00:14 LXmail01 dovecot: auth-worker(6558): > sql(user at domain.org,*.*.*.*,): unknown user > Jul 9 00:00:14 LXmail01 dovecot: auth: Panic: file auth-request.c: > line 1049 (auth_request_lookup_credentials): assertion failed: > (request->credentials_scheme == scheme) > Jul 9 00:00:14 LXmail01 dovecot: auth: Error: Raw backtrace: > /usr/lib64/dovecot/libdovecot.so.0(+0x8d57e) [0x7f197bd8157e] -> > /usr/lib64/dovecot/libdovecot.so.0(+0x8d65e) [0x7f197bd8165e] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f197bd201f6] -> > dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x1a15a) [0x7f197c44715a] > -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x26f8f) > [0x7f197c453f8f] -> dovecot/auth [1 wait, 0 passdb, 0 > userdb](+0x19d2b) [0x7f197c446d2b] -> dovecot/auth [1 wait, 0 passdb, > 0 userdb](auth_request_lookup_credentials_callback+0x68) [0x7f197c4 > 46e28] -> dovecot/auth [1 wait, 0 passdb, 0 > userdb](passdb_handle_credentials+0x92) [0x7f197c457742] -> > dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2af06) [0x7f197c457f06] > -> dovecot/auth [1 > wait, 0 passdb, 0 userdb](+0x2065a) [0x7f197c44d65a] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) > [0x7f197bd94edc] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_in > ternal+0xff) [0x7f197bd9633f] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) > [0x7f197bd94f65] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f197bd95118] > -> /usr > /lib64/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7f197bd26663] -> dovecot/auth [1 wait, 0 passdb, 0 > userdb](main+0x3a1) [0x7f197c43cbe1] -> > /lib64/libc.so.6(__libc_start_main+0xf5) > [0x7f197b30ab15] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0xfdd1) > [0x7f197c43cdd1] > Jul 9 00:00:14 LXmail01 dovecot: auth: Fatal: master: service(auth): > child 6555 killed with signal 6 (core dumps disabled) > Jul 9 00:00:14 LXmail01 dovecot: pop3-login: Warning: Auth connection > closed with 1 pending requests (max 1 secs, pid=8133, EOF) > > Environment is MySQL passdb/userdb, we are using plain scheme as > default and password_noscheme field. In 2.2.24 and below auth worked > without scratch. Reverting all policy-related commits in 2.2.25 fixes > this, but I have not dug the details. > > KR, > > Alex Hi! Could you provide your doveconf -n so we could debug this? Aki From aki.tuomi at dovecot.fi Mon Jul 11 05:38:38 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 11 Jul 2016 08:38:38 +0300 Subject: Panic: file mdbox-save.c: line 337: unreached In-Reply-To: <57825F45.7000305@f-m.fm> References: <57825F45.7000305@f-m.fm> Message-ID: <578330DE.60108@dovecot.fi> On 10.07.2016 17:44, Leon Kyneur wrote: > Recently updated to 2.2.25. Noticed a migration script I've been > previously running fine started giving me the errors below. > > Remove server doesn't log any failure. doveconf -n attached. > > + /bin/doveadm -o mail_fsync=never backup -R -u user at domain.com imapc: > dsync(user at domain.com): Panic: file mdbox-save.c: line 337: unreached > dsync(user at domain.com): Error: Raw backtrace: > /usr/lib64/dovecot/libdovecot.so.0(+0x8d52e) [0x7f58e6da052e] -> > /usr/lib64/dovecot/libdovecot.so.0(default_fatal_ha > ndler+0x2a) [0x7f58e6da059a] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f58e6d3f1b6] -> > /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5b157) [0x7f58e7080157] > -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbfdbf) > [0x7f58e70e4dbf] -> > /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9d) > [0x7f58e > 710043d] -> > /usr/lib64/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x107) > [0x7f58e70e5337] -> /usr/lib64/dovecot/lib20_zlib_plugin.so(+0x3163) > [0x7f58e5f29 > 163] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0xc703) > [0x7f58e613d703] -> > /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x51) > [0 > x7f58e7069631] -> /bin/doveadm [user at domain.com INBOX > import:650/674](dsync_mailbox_import_deinit+0xf8) [0x7f58e7a12898] -> > /bin/doveadm [user at domain.com IN > BOX import:650/674](+0x41bbf) [0x7f58e7a0cbbf] -> /bin/doveadm > [user at domain.com INBOX import:650/674](dsync_brain_sync_mails+0x723) > [0x7f58e7a0d433] -> /bin/dovea > dm [user at domain.com INBOX import:650/674](dsync_brain_run+0x5f8) > [0x7f58e7a08c78] -> /bin/doveadm [user at domain.com INBOX > import:650/674](+0x27521) [0x7f58e7 > 9f2521] -> /bin/doveadm [user at domain.com INBOX > import:650/674](+0x2929f) [0x7f58e79f429f] -> /bin/doveadm > [user at domain.com INBOX import:650/674](+0x29d8d) [0x7f58e79f4d8d] -> > /bin/doveadm [user at domain.com INBOX > import:650/674](doveadm_mail_try_run+0x215) [0x7f58e79f56f5] -> > /bin/doveadm [user at domain.com INBOX import:650/674](main+0x455) > [0x7f58e79e57f5] -> /lib64/libc.so.6(__libc_start_main+0xf5) > [0x7f58e6973b15] -> /bin/doveadm [user at domain.com INBOX > import:650/674](+0x1a96d) [0x7f58e79e596d] > /root/migrate_code/migrate_mailbox_eftel.sh: line 31: 48637 > Aborted /bin/doveadm -o mail_fsync=never backup -R -u > $USERNAME imapc: > + RETCODE=134 > > Regards > > Leon Hi! Any chance you could run gdb with bt full on the core? --- Aki Tuomi Dovecot oy From tss at iki.fi Mon Jul 11 08:06:28 2016 From: tss at iki.fi (Timo Sirainen) Date: Mon, 11 Jul 2016 11:06:28 +0300 Subject: "anvil: Error: connect limit: disconnection for unknown pid 17659 + ident lmtp/backup@backup.invalid" In-Reply-To: <20160707123104.GA27313@sys4.de> References: <20160707123104.GA27313@sys4.de> Message-ID: <399EAF33-D4CB-4072-8023-408B0090E577@iki.fi> On 07 Jul 2016, at 15:31, Ralf Hildebrandt wrote: > > I updated to 2.3.0 today, and now I'm getting these entries in my log: > > Jul 7 14:26:20 mail-cbf dovecot: anvil: Error: connect limit: disconnection for unknown pid 17687 + ident lmtp/backup at backup.invalid Fixed: https://git.dovecot.net/dovecot/core/commit/1c6d55fc292c099f0b4b20daf9208031d982e757 Unfortunately it's also in v2.2.25 :( But other than the error message being logged it's not harmful. From tss at iki.fi Mon Jul 11 09:09:23 2016 From: tss at iki.fi (Timo Sirainen) Date: Mon, 11 Jul 2016 12:09:23 +0300 Subject: Panic: file mdbox-save.c: line 337: unreached In-Reply-To: <57825F45.7000305@f-m.fm> References: <57825F45.7000305@f-m.fm> Message-ID: <35DC19B2-0EFA-44F4-A0FC-5F3D2A13CA76@iki.fi> On 10 Jul 2016, at 17:44, Leon Kyneur wrote: > > Recently updated to 2.2.25. Noticed a migration script I've been previously running fine started giving me the errors below. > > Remove server doesn't log any failure. doveconf -n attached. > > + /bin/doveadm -o mail_fsync=never backup -R -u user at domain.com imapc: > dsync(user at domain.com): Panic: file mdbox-save.c: line 337: unreached Thanks, fixed: https://github.com/dovecot/core/commit/3aae8844765b1d74d847e8e37daa135ac7035e6b From aki.tuomi at dovecot.fi Mon Jul 11 09:39:29 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 11 Jul 2016 12:39:29 +0300 Subject: Dovecot 2.2.25 fails on SSL In-Reply-To: <20160703234249.GA2315@krell.zikzak.de> References: <20160703234249.GA2315@krell.zikzak.de> Message-ID: <57836951.8030509@dovecot.fi> On 04.07.2016 02:42, Andreas M. Kirchwitz wrote: > Dear Dovecot developers! > > This problem already existed some years ago, has been fixed, > and now it's there again in Dovecot 2.2.25 (2.2.24 was fine). > > I'm running CentOS 6 with a custom OpenSSL installation in /usr/local/ssl > Therefore, Dovecot is configured like this: > > env SSL_CFLAGS="-I/usr/local/ssl/include" SSL_LIBS="-L/usr/local/ssl/lib -Wl,-R/usr/local/ssl/lib -lcrypto -lssl" ./configure --prefix=/usr/local/Dovecot-2.2.25 --with-ssl=openssl --with-ssldir=/usr/local/Dovecot-2.2.25/etc/dovecot/certs > > With "pkg-config", the same options for SSL are provided. > > "make" and "make install" run just fine, and the daemon starts > without any errors. However, if a user connects on port 993 (IMAPS), > Dovecot logs this failure message to syslog: > > Jul 4 01:08:43 myhost dovecot: ssl-params: Fatal: Couldn't load required plugin /usr/local/Dovecot-2.2.25/lib/dovecot/libssl_iostream_openssl.so: dlopen() failed: libcrypto.so.1.0.0: cannot open shared object file: No such file or directory > Jul 4 01:08:43 myhost dovecot: ssl-params: Error: child process failed with status 22784 > > ldd /usr/local/Dovecot-2.2.25/lib/dovecot/libssl_iostream_openssl.so > linux-gate.so.1 => (0x00e8c000) > libcrypto.so.1.0.0 => not found > libssl.so.1.0.0 => not found > librt.so.1 => /lib/librt.so.1 (0x00be4000) > libc.so.6 => /lib/libc.so.6 (0x001a6000) > libpthread.so.0 => /lib/libpthread.so.0 (0x003e4000) > /lib/ld-linux.so.2 (0x007e7000) > > ldd /usr/local/Dovecot-2.2.25/lib/dovecot/libdcrypt_openssl.so > linux-gate.so.1 => (0x00dca000) > libcrypto.so.1.0.0 => not found > libssl.so.1.0.0 => not found > librt.so.1 => /lib/librt.so.1 (0x00a7a000) > libc.so.6 => /lib/libc.so.6 (0x00160000) > libpthread.so.0 => /lib/libpthread.so.0 (0x0072f000) > /lib/ld-linux.so.2 (0x00560000) > > When comparing to Dovecot 2.2.24: > > ldd /usr/local/Dovecot-2.2.24/lib/dovecot/libssl_iostream_openssl.so > linux-gate.so.1 => (0x0073d000) > libcrypto.so.1.0.0 => /usr/local/ssl/lib/libcrypto.so.1.0.0 (0x00b04000) > libssl.so.1.0.0 => /usr/local/ssl/lib/libssl.so.1.0.0 (0x0044a000) > librt.so.1 => /lib/librt.so.1 (0x00a60000) > libc.so.6 => /lib/libc.so.6 (0x001e5000) > libdl.so.2 => /lib/libdl.so.2 (0x003a9000) > libpthread.so.0 => /lib/libpthread.so.0 (0x009d0000) > /lib/ld-linux.so.2 (0x00d77000) > > There's no libdcrypt_openssl.so in Dovecot 2.2.24, so I guess > with the newly introduced dcrypt stuff something with SSL went wrong. > > Would be great if that could be fixed so that SSL works again. > > Thanks a lot in advance ... Andreas Hi! Thank you for your report, we'll look into it! --- Aki Tuomi Dovecot oy From stephan at rename-it.nl Mon Jul 11 11:15:22 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 11 Jul 2016 13:15:22 +0200 Subject: a question about dovecot-sieve In-Reply-To: References: Message-ID: <542545b0-4973-a409-d05d-89b022c58071@rename-it.nl> Op 8-7-2016 om 6:53 schreef ???: > > question discribe: > > example: > > > vim .dovecot.sieve > > require > ["fileinto"]; > > # rule:[filter1] > > if anyof (header :contains "Subject" > "????") > > { > > fileinto "sieve"; > > } > > when i write a mail ,give subject > "????????" , then server convert this subject to" > > SUBJECT: > =?UTF-8?Q?=E8=BF=99=E6=98=AF=E4=B8=80=E5=B0=81=E6=B5=8B=E8=AF=95=E9=82=AE?= > =?UTF-8?Q?=E4=BB=B6?= > > " > > the essential question is when the mail go > through dovecot-sieve plugin, the sieve plugin get mail subject is "??????? > ?" not "????????"?there is a extra space added(which as segmentation > between "=?UTF-8?Q?"). > > SIMPLY SAY?edit subject"????????" ??>server convert > "SUBJECT: > =?UTF-8?Q?=E8=BF=99=E6=98=AF=E4=B8=80=E5=B0=81=E6=B5=8B=E8=AF=95=E9=82=AE?= > =?UTF-8?Q?=E4=BB=B6?="??>sieve plugin get "??????? ?" > > The result is filter > failure. is this a bug ? How can I avoid it? I cannot reproduce this problem here. What version of Dovecot and Pigeonhole are you using? Regards, Stephan. > From Ralf.Hildebrandt at charite.de Mon Jul 11 11:15:14 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Mon, 11 Jul 2016 13:15:14 +0200 Subject: 2.3.0~alpha0-1~auto+197: Crash when openening a message via IMAP Message-ID: <20160711111514.GF25046@charite.de> >From the log: Jul 11 13:12:42 mproxy dovecot: imap-login: Login: user=, method=PLAIN, rip=141.42.206.36, lip=141.42.206.11, mpid=27254, TLS, session= Jul 11 13:12:44 mproxy dovecot: imap(hildeb): Panic: file imap-client.c: line 854 (client_check_command_hangs): assertion failed: ((io_loop_find_fd_conditions(current_ioloop, client->fd_out) & IO_WRITE) != 0) Jul 11 13:12:44 mproxy dovecot: imap(hildeb): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x8e09e) [0x7efd1d3a309e] -> /usr/lib/dovecot/libdovecot.so.0(+0x8e18c) [0x7efd1d3a318c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7efd1d34169e] -> dovecot/imap [hildeb 141.42.206.36 UID FETCH - 8192 bytes waiting corked](+0x1ad42) [0x55649b35cd42] -> dovecot/imap [hildeb 141.42.206.36 UID FETCH - 8192 bytes waiting corked](client_output+0x118) [0x55649b35ce68] -> /usr/lib/dovecot/libdovecot.so.0(+0xaf370) [0x7efd1d3c4370] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7efd1d3b715c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7efd1d3b85b1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7efd1d3b71e5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x30) [0x7efd1d3b7380] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7efd1d347c13] -> dovecot/imap [hildeb 141.42.206.36 UID FETCH - 8192 bytes waiting corked](main+0x322) [0x55649b34faf2] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7efd1cf6c830] -> dovecot/imap [hildeb 141.42.206.36 UID FETCH - 8192 bytes waiting corked](+0xdc6f) [0x55649b34fc6f] Jul 11 13:12:44 mproxy dovecot: imap(hildeb): Fatal: master: service(imap): child 27254 killed with signal 6 (core dumped) # 2.3.0.alpha0 (3aae884) [XI:2:2.3.0~alpha0-1~auto+197]: /etc/dovecot/dovecot.conf -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From aki.tuomi at dovecot.fi Mon Jul 11 11:37:17 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 11 Jul 2016 14:37:17 +0300 Subject: 2.3.0~alpha0-1~auto+197: Crash when openening a message via IMAP In-Reply-To: <20160711111514.GF25046@charite.de> References: <20160711111514.GF25046@charite.de> Message-ID: <578384ED.4010905@dovecot.fi> On 11.07.2016 14:15, Ralf Hildebrandt wrote: > From the log: > > Jul 11 13:12:42 mproxy dovecot: imap-login: Login: user=, method=PLAIN, rip=141.42.206.36, lip=141.42.206.11, mpid=27254, TLS, session= > Jul 11 13:12:44 mproxy dovecot: imap(hildeb): Panic: file imap-client.c: line 854 (client_check_command_hangs): assertion failed: ((io_loop_find_fd_conditions(current_ioloop, client->fd_out) & IO_WRITE) != 0) > Jul 11 13:12:44 mproxy dovecot: imap(hildeb): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x8e09e) > [0x7efd1d3a309e] -> /usr/lib/dovecot/libdovecot.so.0(+0x8e18c) > [0x7efd1d3a318c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) > [0x7efd1d34169e] -> dovecot/imap [hildeb 141.42.206.36 UID FETCH - 8192 bytes waiting corked](+0x1ad42) > [0x55649b35cd42] -> dovecot/imap [hildeb 141.42.206.36 UID FETCH - 8192 bytes waiting corked](client_output+0x118) > [0x55649b35ce68] -> /usr/lib/dovecot/libdovecot.so.0(+0xaf370) > [0x7efd1d3c4370] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) > [0x7efd1d3b715c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) > [0x7efd1d3b85b1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) > [0x7efd1d3b71e5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x30) > [0x7efd1d3b7380] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7efd1d347c13] -> dovecot/imap [hildeb 141.42.206.36 UID FETCH - 8192 bytes waiting corked](main+0x322) [0x55649b34faf2] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) > [0x7efd1cf6c830] -> dovecot/imap [hildeb 141.42.206.36 UID FETCH - 8192 bytes waiting corked](+0xdc6f) [0x55649b34fc6f] > Jul 11 13:12:44 mproxy dovecot: imap(hildeb): Fatal: master: service(imap): child 27254 killed with signal 6 (core dumped) > > # 2.3.0.alpha0 (3aae884) [XI:2:2.3.0~alpha0-1~auto+197]: /etc/dovecot/dovecot.conf > Did you forget to include doveconf -n? Aki From wlt-ml at o-sinc.com Mon Jul 11 15:21:46 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Mon, 11 Jul 2016 11:21:46 -0400 Subject: Master-Master replication question In-Reply-To: <1304695756.35.1467803735221@openexchange.elvandar.org> References: <1304695756.35.1467803735221@openexchange.elvandar.org> Message-ID: You are not alone! On Wednesday, July 06, 2016 01:15:34 PM Remko Lodder wrote: > Dear list, > > I have setup a master-master replication setup. My primairy MX's send email > over on a DNS loadbalanced way, so DNS is doing some kind of round-robin > way of sending mail to both master servers. > > I found out, that on one of the two machines, the email synchronisation is > heavily delayed. Lets assume server A receives a mail from the MX; it > synchronises almost instantly with the other server. > > Whenever server B receives the email, it could take up to several hours to > synchronise the email, it seems that it is not detected prior. I have been dealing with this for months. http://www.dovecot.org/list/dovecot/2016-March/103680.html For a band aid I use this crontab entry. On the 2nd mail server. */15 * * * * root /usr/bin/doveadm sync -u "*" remote:mail1 However in doing this, and at other times during the sync. Something happens and kmail pulls in the email twice, and puts one in an odd state, grayed out in the GUI. I have to go do the directory and delete. Once read it has a T flag which other emails do not have. That becomes more common when I use the above, but otherwise happens on occasion. > It is also interesting to see, that the mailboxes on server A (Where users > login to retrieve their email via webmail/clients) are significantly > smaller then the mailboxes on server B. When investigating, it seems that > "older" mailboxes (or storage rather since we use mdbox) are still there on > server B, which already had been removed on server A. I experience every bit of what you are describing. Also seems to be effected when email arrives on one server, but users are checking/pulling email from another. They never see the ones on the other, and can have emails arrive, be deleted, etc. > My personal mailbox was 170MB on server A, while it was still 2.5GB on > server B. (which was around that size before cleaning up the mailsboxes). > > I enabled debugging on the servers, and I see rather quick : "Replication > requests" on server A, but when getting an email on server B, I do not see > the request at all. > > My servers are both running the same version, same configuration (utilizing > puppet), both running on ZFS and FreeBSD. Where server B is more loaded in > it's memory because of some bhyve VM's and the server A does not run any > VM. > > Does someone have any pointers on where to look? I have been hoping its some issue that gets fixed in some new release. It seems there might have been some regressions there, as at times it seemed to have gotten better and other times worse. I think it has something to do with full vs fast/quick syncing. I think the above command forces a full, and most times its doing a fast sync. There are not many settings to play with or adjust so seems to be something that requires addressing in the code itself unless some new settings are introduced. -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: This is a digitally signed message part. URL: From rick at havokmon.com Mon Jul 11 15:36:13 2016 From: rick at havokmon.com (Rick Romero) Date: Mon, 11 Jul 2016 10:36:13 -0500 Subject: Master-Master replication question In-Reply-To: References: <1304695756.35.1467803735221@openexchange.elvandar.org> Message-ID: <20160711103613.Horde.UvxzLbVuae1QKE8I43SCWA9@www.vfemail.net> Quoting "William L. Thomson Jr." : > You are not alone! > > On Wednesday, July 06, 2016 01:15:34 PM Remko Lodder wrote: >> Dear list, >> >> I have setup a master-master replication setup. My primairy MX's send >> email >> over on a DNS loadbalanced way, so DNS is doing some kind of round-robin >> way of sending mail to both master servers. >> >> I found out, that on one of the two machines, the email synchronisation >> is >> heavily delayed. Lets assume server A receives a mail from the MX; it >> synchronises almost instantly with the other server. >> >> Whenever server B receives the email, it could take up to several hours >> to >> synchronise the email, it seems that it is not detected prior. > > I have been dealing with this for months. > http://www.dovecot.org/list/dovecot/2016-March/103680.html > > For a band aid I use? this crontab entry. On the 2nd mail server. > > */15 * * * *? ?root? ? /usr/bin/doveadm sync -u "*" remote:mail1 > Are you guys using LMTP to deliver from your MX server to the mailbox server? I have a similar setup, but not yet synched, because as I understand it - using 'deliver' to drop mail into an NFS mount won't inititate a sync.? I have to migrate my procmail scripts to sieve (and use the execute plugin) and change my final delivery to be a redirect to LMTP.?? Not sure how replication will work when running old procmail scripts from sieve... In any case..? If you're piping to dovecot's deliver/dovecot-lda, here is a rudimentary LMTP script I hacked together that I planned to use to replace deliver with...?? I'd grab the 'master' mailbox server IP for each user for the command line. #!/usr/bin/perl use Net::LMTP; use Getopt::Std; $opts{'s'} = "localhost"; $opts{'p'} = "24"; $opts{'f'} = 'root@' . `hostname`; chomp($opts{'f'}); chomp($opts{'s'}); getopts("hs:p:f:u:", \%opts); if ($opts{'h'}) { ??? print " lmtpsend [-s lmtpserver] [-f fromaddress] [-u subject] toaddress [...] ? lmtpsend will send an email from the commandline. ? Options: ??? -s lmtpserver????? Sets the lmtpserver for where to send the mail through. ??? -f fromaddress???? Sets the email address to be used on the From: line. ??? -u subject???????? Sets the email subject to be used from the Subject line. ??? toaddress????????? Where you want the email sent to. "; ??? exit; } die "no recepients to send mail to" if ($#ARGV < 0); @emailbody = ; # send the message $message = Net::LMTP->new($opts{'s'},$opts{'p'}) || die "can't talk to server $opts{'s'}\n"; $message->mail($opts{'f'}); $message->to(@ARGV) || die "failed to send to the recepients ",join(",", at ARGV),": $!"; $message->data(); $message->datasend("To: " . join(", ", at ARGV) . "\n"); $message->datasend(@emailbody); $message->dataend(); $message->quit; Rick From remko at FreeBSD.org Mon Jul 11 15:38:20 2016 From: remko at FreeBSD.org (Remko Lodder) Date: Mon, 11 Jul 2016 17:38:20 +0200 Subject: Master-Master replication question In-Reply-To: References: <1304695756.35.1467803735221@openexchange.elvandar.org> Message-ID: <96A4EF68-6E29-41BE-BBB4-0BC3EE172181@FreeBSD.org> > On 11 Jul 2016, at 17:21, William L. Thomson Jr. wrote: > > You are not alone! Hello, Now that?s a relief! One of the things that I described and observed is that it seems that serverB is not seeing the email (or at least there is no connection that when an email is send and stored on the mailserver that the services see them and notify the other end). With tcpdump there is no traffic at all, until there is a sync the other way around. As said both systems are identical in hardware setup and use puppet to obtain their configuration, which is the same for both hosts (except the IP adresses and hostname); But since we are with at least two, we might have better luck in getting some help with this. I currently do not have an idea on where to look and how to investigate this properly. Any pointers from the list are welcome! Cheers Remko > > -- > William L. Thomson Jr. > Obsidian-Studios, Inc. > http://www.obsidian-studios.com From remko at FreeBSD.org Mon Jul 11 15:40:03 2016 From: remko at FreeBSD.org (Remko Lodder) Date: Mon, 11 Jul 2016 17:40:03 +0200 Subject: Master-Master replication question In-Reply-To: <20160711103613.Horde.UvxzLbVuae1QKE8I43SCWA9@www.vfemail.net> References: <1304695756.35.1467803735221@openexchange.elvandar.org> <20160711103613.Horde.UvxzLbVuae1QKE8I43SCWA9@www.vfemail.net> Message-ID: > On 11 Jul 2016, at 17:36, Rick Romero wrote: > > Quoting "William L. Thomson Jr." : > >> You are not alone! >> >> On Wednesday, July 06, 2016 01:15:34 PM Remko Lodder wrote: >>> Dear list, >>> >>> I have setup a master-master replication setup. My primairy MX's send >>> email >>> over on a DNS loadbalanced way, so DNS is doing some kind of round-robin >>> way of sending mail to both master servers. >>> >>> I found out, that on one of the two machines, the email synchronisation >>> is >>> heavily delayed. Lets assume server A receives a mail from the MX; it >>> synchronises almost instantly with the other server. >>> >>> Whenever server B receives the email, it could take up to several hours >>> to >>> synchronise the email, it seems that it is not detected prior. >> >> I have been dealing with this for months. >> http://www.dovecot.org/list/dovecot/2016-March/103680.html >> >> For a band aid I use this crontab entry. On the 2nd mail server. >> >> */15 * * * * root /usr/bin/doveadm sync -u "*" remote:mail1 >> > > Are you guys using LMTP to deliver from your MX server to the mailbox > server? Local delivery on the destination server is LMTP but the transport between MX and destination server is just plain SMTP. I could try and revert to dovecot-lda and see what that does? Cheers remko > > I have a similar setup, but not yet synched, because as I understand it - > using 'deliver' to drop mail into an NFS mount won't inititate a sync. I > have to migrate my procmail scripts to sieve (and use the execute plugin) > and change my final delivery to be a redirect to LMTP. Not sure how > replication will work when running old procmail scripts from sieve... > > In any case.. If you're piping to dovecot's deliver/dovecot-lda, here is > a rudimentary LMTP script I hacked together that I planned to use to > replace deliver with... I'd grab the 'master' mailbox server IP for > each user for the command line. > > #!/usr/bin/perl > > use Net::LMTP; > use Getopt::Std; > > $opts{'s'} = "localhost"; > $opts{'p'} = "24"; > $opts{'f'} = 'root@' . `hostname`; > chomp($opts{'f'}); > chomp($opts{'s'}); > getopts("hs:p:f:u:", \%opts); > > if ($opts{'h'}) { > print " > lmtpsend [-s lmtpserver] [-f fromaddress] [-u subject] toaddress [...] > > lmtpsend will send an email from the commandline. > > Options: > -s lmtpserver Sets the lmtpserver for where to send the > mail through. > -f fromaddress Sets the email address to be used on the > From: line. > -u subject Sets the email subject to be used from > the Subject line. > toaddress Where you want the email sent to. > > "; > exit; > } > > die "no recepients to send mail to" if ($#ARGV < 0); > > @emailbody = ; > > # send the message > > $message = Net::LMTP->new($opts{'s'},$opts{'p'}) || die "can't talk to > server $opts{'s'}\n"; > > $message->mail($opts{'f'}); > $message->to(@ARGV) || die "failed to send to the recepients > ",join(",", at ARGV),": $!"; > $message->data(); > $message->datasend("To: " . join(", ", at ARGV) . "\n"); > $message->datasend(@emailbody); > $message->dataend(); > $message->quit; > > Rick From rick at havokmon.com Mon Jul 11 15:53:05 2016 From: rick at havokmon.com (Rick Romero) Date: Mon, 11 Jul 2016 10:53:05 -0500 Subject: Master-Master replication question In-Reply-To: References: <1304695756.35.1467803735221@openexchange.elvandar.org> <20160711103613.Horde.UvxzLbVuae1QKE8I43SCWA9@www.vfemail.net> Message-ID: <20160711105305.Horde.9o17R_pwGjMK5I9_aMqYCQ6@www.vfemail.net> Quoting Remko Lodder : >> On 11 Jul 2016, at 17:36, Rick Romero wrote: >> >> Quoting "William L. Thomson Jr." : >> >>> You are not alone! >>> >>> On Wednesday, July 06, 2016 01:15:34 PM Remko Lodder wrote: >>>> Dear list, >>>> >>>> I have setup a master-master replication setup. My primairy MX's send >>>> email >>>> over on a DNS loadbalanced way, so DNS is doing some kind of >>>> round-robin >>>> way of sending mail to both master servers. >>>> >>>> I found out, that on one of the two machines, the email synchronisation >>>> is >>>> heavily delayed. Lets assume server A receives a mail from the MX; it >>>> synchronises almost instantly with the other server. >>>> >>>> Whenever server B receives the email, it could take up to several hours >>>> to >>>> synchronise the email, it seems that it is not detected prior. >>> >>> I have been dealing with this for months. >>> http://www.dovecot.org/list/dovecot/2016-March/103680.html >>> >>> For a band aid I use? this crontab entry. On the 2nd mail server. >>> >>> */15 * * * *? ?root? ? /usr/bin/doveadm sync -u "*" remote:mail1 >>> >> >> Are you guys using LMTP to deliver from your MX server to the mailbox >> server? > > Local delivery on the destination server is LMTP but the transport between > MX and destination server is just plain SMTP. > > I could try and revert to dovecot-lda and see what that does? > ? I don't think that'll help.? From what I understand, LMTP is required for replication on delivery. Out of curiousity, why do you use SMTP from the MX to the destination server instead of LMTP? ? From wlt-ml at o-sinc.com Mon Jul 11 16:34:15 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Mon, 11 Jul 2016 12:34:15 -0400 Subject: Master-Master replication question In-Reply-To: <20160711103613.Horde.UvxzLbVuae1QKE8I43SCWA9@www.vfemail.net> References: <1304695756.35.1467803735221@openexchange.elvandar.org> <20160711103613.Horde.UvxzLbVuae1QKE8I43SCWA9@www.vfemail.net> Message-ID: On Monday, July 11, 2016 10:36:13 AM Rick Romero wrote: > Are you guys using LMTP to deliver from your MX server to the mailbox > server? I am not at this time. My use of NFS is for other reasons. All services SMTP, POP, and IMAP are on the same system. I have not tried it without NFS to see if that is causing the problem or not. I do not believe it to be a NFS issue but it might. -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: This is a digitally signed message part. URL: From remko at FreeBSD.org Mon Jul 11 16:34:46 2016 From: remko at FreeBSD.org (Remko Lodder) Date: Mon, 11 Jul 2016 18:34:46 +0200 Subject: Master-Master replication question In-Reply-To: <20160711105305.Horde.9o17R_pwGjMK5I9_aMqYCQ6@www.vfemail.net> References: <1304695756.35.1467803735221@openexchange.elvandar.org> <20160711103613.Horde.UvxzLbVuae1QKE8I43SCWA9@www.vfemail.net> <20160711105305.Horde.9o17R_pwGjMK5I9_aMqYCQ6@www.vfemail.net> Message-ID: <12B0460B-F294-45B3-844F-335BE73F491B@FreeBSD.org> Hi Rick, >> Local delivery on the destination server is LMTP but the transport between >> MX and destination server is just plain SMTP. >> >> I could try and revert to dovecot-lda and see what that does? >> > I don't think that'll help. From what I understand, LMTP is required for replication on delivery. > > Out of curiousity, why do you use SMTP from the MX to the destination server instead of LMTP? > It was using that already :-), I do not see a direct reason for this to change, I will test it at some point though :) From wlt-ml at o-sinc.com Mon Jul 11 16:41:31 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Mon, 11 Jul 2016 12:41:31 -0400 Subject: Master-Master replication question In-Reply-To: <20160711105305.Horde.9o17R_pwGjMK5I9_aMqYCQ6@www.vfemail.net> References: <1304695756.35.1467803735221@openexchange.elvandar.org> <20160711105305.Horde.9o17R_pwGjMK5I9_aMqYCQ6@www.vfemail.net> Message-ID: On Monday, July 11, 2016 10:53:05 AM Rick Romero wrote: > I don't think that'll help. From what I understand, LMTP is required for > replication on delivery. Where did you come across that requirement? I do not recall that. > Out of curiousity, why do you use SMTP from the MX to the destination > server instead of LMTP? My reason is because qmail does not support that. I am not sure if I will migrate to exim or postfix. Seems others have inquired about LMTP with qmail, might be something out there. -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: This is a digitally signed message part. URL: From wlt-ml at o-sinc.com Mon Jul 11 16:48:29 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Mon, 11 Jul 2016 12:48:29 -0400 Subject: passdb {driver = shadow args = override_username=%variable} In-Reply-To: References: Message-ID: On Saturday, July 09, 2016 12:01:43 PM UNIX admin wrote: > Hello list > > I want to implement override_username = %variable for the "shadow" > driver, so that the following works: > > passdb { > driver = shadow > args = override_username=%Ln > } > > by "%variable", I mean "Variables" at http://wiki.dovecot.org/Variables. That is pretty interesting, and along those lines. Could override_username also allow one to block certain usernames from being synced? My mail server monitoring uses the nobody user account. That triggers syncing for the nobody user account. Which always fails syncing. I end up running the following command allot to avoid repeat errors in logs. "doveadm replicator remove nobody" I have not found a way to block users from passdb. Seems to be all or nothing. I could see about having monitoring use an actual account. -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: This is a digitally signed message part. URL: From rick at havokmon.com Mon Jul 11 17:46:50 2016 From: rick at havokmon.com (Rick Romero) Date: Mon, 11 Jul 2016 12:46:50 -0500 Subject: Master-Master replication question In-Reply-To: References: <1304695756.35.1467803735221@openexchange.elvandar.org> <20160711105305.Horde.9o17R_pwGjMK5I9_aMqYCQ6@www.vfemail.net> Message-ID: <20160711124650.Horde.1-H5SA0uh808x8k83FI_mw9@www.vfemail.net> Quoting "William L. Thomson Jr." : > On Monday, July 11, 2016 10:53:05 AM Rick Romero wrote: >> I don't think that'll help.? From what I understand, LMTP is required for >> replication on delivery. > > Where did you come across that requirement? I do not recall that.? Hmmm I can't seem to find any reference to it.? Maybe it was from the old blog - http://blog.dovecot.org/2012/02/dovecot-clustering-with-dsync-based.html? My understanding/assumption is that LDA delivers and updates indexes. I assume using LMTP delivers, updates indexes and kicks off a quick sync. Out of curiousity, why do you use SMTP from the MX to the destination >> server instead of LMTP? > > My reason is because qmail does not support that. I am not sure if I will > migrate to exim or postfix. Seems others have inquired about LMTP with > qmail, > might be something out there. I use qmail as well - that's why I wrote/hacked the LMTP script :)?? Basically, my last step (if no .qmail exists) is 'pipe to dovecot deliver' - I need to change that to 'pipe to this LMTP script'? The script allows you to specify a hostname to deliver to, so that you can dynamic deliver to the primary server for each user, assuming you're already doing that with a director instance. So the theory is.? I've been hitting on pieces of this for years, and I want to get all my data replicated before actually I start testing again..? The LMTP script is 6 months old and I haven't done anything beyond basic testing with it yet :/ If it weren't for all the procmail stuff I've put in over the years I'd already be done.? *sigh* Rick From lists at alex-at.ru Mon Jul 11 17:58:54 2016 From: lists at alex-at.ru (Alexey Asemov (Alex/AT)) Date: Mon, 11 Jul 2016 20:58:54 +0300 Subject: [2.2.25 auth issue] auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) In-Reply-To: References: Message-ID: <7c80a365-7731-6628-2232-b6306672233c@alex-at.ru> Hello Aki. Here it is. Some sensitive data was replaced by ***. # 2.2.25 (7be1766): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: Linux 3.10.0-***.el7.x86_64 x86_64 CentOS Linux release 7.*** (Core) ext4 auth_cache_negative_ttl = 15 secs auth_cache_size = 8 M auth_cache_ttl = 15 secs auth_default_realm = *** auth_mechanisms = plain login digest-md5 cram-md5 ntlm auth_username_chars = abcdefghijklmnopqrstuvwxyz ABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.,;=-_@ auth_username_format = %LTn@%LTd auth_verbose = yes auth_worker_max_count = 64 dict { last_login = mysql:/etc/dovecot/mailserver/last_login.dbconf sieve = mysql:/etc/dovecot/mailserver/sieve.dbconf } disable_plaintext_auth = no import_environment = TZ listen = * lock_method = dotlock log_timestamp = %F %T login_greeting = *** Mail Server ready and serving (LXmail01). mail_attachment_dir = /mailboxes/%1.16Nu/%Ld/.attachments mail_attachment_hash = %{sha256}.%{size} mail_attachment_min_size = 64 k mail_cache_min_mail_count = 32 mail_gid = mailbox mail_home = /mailboxes/%1.16Nu/%Ld/%2.256Nn/%Ln mail_location = mdbox:/mailboxes/%1.16Nu/%Ld/%2.256Nn/%Ln mail_max_keyword_length = 64 mail_plugins = quota fts fts_lucene zlib mail_uid = mailbox mailbox_idle_check_interval = 1 mins managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_interval = 90 days mdbox_rotate_size = 4 M namespace { inbox = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = no special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/mailserver/mysql.dbconf driver = sql } plugin { fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 65536 fts_index_timeout = 900 fts_lucene = whitespace_chars=@.,;-/ last_login_dict = proxy::last_login last_login_key = last_login/%u quota = dict:user quota::file:%h/.quota quota_rule = *:bytes=2684354560 quota_rule2 = Trash:bytes=+10%% quota_rule3 = Spam:bytes=+10%% sieve = dict:proxy::sieve;name=%Lu;bindir=/mail_local/sieve/cache sieve_dir = ~/sieve sieve_global_dir = /mail_local/sieve/global sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 16K sieve_user_log = /mail_local/sieve/logs/%Lu.log sieve_vacation_dont_check_recipient = yes sieve_vacation_max_period = 0 sieve_vacation_min_period = 0 zlib_save = xz zlib_save_level = 1 } service anvil { client_limit = 6666 } service auth { client_limit = 6666 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mailbox mode = 0600 user = mailbox } user = $default_internal_user } service auth_worker { user = root } service dict { unix_listener dict { group = mailbox mode = 0600 user = mailbox } } service imap-login { chroot = login client_limit = 2048 inet_listener imaps { address = * } process_limit = 2048 process_min_avail = 1 service_count = 1 user = dovecot } service imap { drop_priv_before_exec = no process_limit = 2048 } service indexer-worker { process_limit = 2 } service ipc { unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = dovecot mode = 0660 user = $default_login_user } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } unix_listener lmtp { group = mailbox mode = 0600 user = mailbox } } service pop3-login { chroot = login client_limit = 2048 inet_listener pop3s { address = * } process_limit = 2048 process_min_avail = 1 service_count = 1 user = dovecot } service pop3 { drop_priv_before_exec = no process_limit = 2048 } shutdown_clients = no ssl_cert = Hi! > > Could you provide your doveconf -n so we could debug this? > > Aki > From wlt-ml at o-sinc.com Mon Jul 11 23:13:44 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Mon, 11 Jul 2016 19:13:44 -0400 Subject: Master-Master replication question In-Reply-To: <20160711124650.Horde.1-H5SA0uh808x8k83FI_mw9@www.vfemail.net> References: <1304695756.35.1467803735221@openexchange.elvandar.org> <20160711124650.Horde.1-H5SA0uh808x8k83FI_mw9@www.vfemail.net> Message-ID: On Monday, July 11, 2016 12:46:50 PM Rick Romero wrote: > Quoting "William L. Thomson Jr." : > > On Monday, July 11, 2016 10:53:05 AM Rick Romero wrote: > >> I don't think that'll help. From what I understand, LMTP is required > > for > > >> replication on delivery. > > > > Where did you come across that requirement? I do not recall that. > > Hmmm I can't seem to find any reference to it. Maybe it was from the old > blog - > http://blog.dovecot.org/2012/02/dovecot-clustering-with-dsync-based.html > My understanding/assumption is that LDA delivers and updates indexes. I > assume using LMTP delivers, updates indexes and kicks off a quick sync. That is what I read as well, when others said NFS would not work. I seemed to have missed the part you mentioned. Likely skimmed vs read over a cup of tea... Maybe that is why I have syncing issues. I will go back and reread. Also I could change one end to not be NFS and see if that helps, not sure I can do both to really rule that out/in. Likely need to change both to be 100%, unless one side being NFS helps show the problem. > I use qmail as well - that's why I wrote/hacked the LMTP script :) That is good to know, I might play around with it in that case. Not to mention that there are others still using qmail. With patch for IPv6, not sure I really need to replace qmail. I have ASSP in front of qmail, and tends to do more of the modern things qmail does not. But thats OT for this list. > Basically, my last step (if no .qmail exists) is 'pipe to dovecot deliver' > - I need to change that to 'pipe to this LMTP script' > The script allows you to specify a hostname to deliver to, so that you can > dynamic deliver to the primary server for each user, assuming you're > already doing that with a director instance. I do not have a primary server, as I want both to be the same so it does not matter which is used, or if either has an issue and goes away. But I might be able to achieve the same by setting a primary. Having a primary would likely fix most syncing issues, but more with users checking email on the same one its arriving on. Other syncing issues might still remain. > So the theory is. I've been hitting on pieces of this for years, and I > want to get all my data replicated before actually I start testing > again.. The LMTP script is 6 months old and I haven't done anything > beyond basic testing with it yet :/ I have my replication stuff in production, and for the most part no problems short of the delayed emails at times and duplicates at others. If I can run the manual command to sync, it will band aid the replication problems. > If it weren't for all the procmail stuff I've put in over the years I'd > already be done. *sigh* I never got hooked on that, but I do know its quite powerful. I likely need to keep and do more server side. I pull most to client and do filter. Though procmail can do more than filter. -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: This is a digitally signed message part. URL: From jtam.home at gmail.com Mon Jul 11 23:16:56 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 11 Jul 2016 16:16:56 -0700 (PDT) Subject: Dovecot 2.2.25 compiling error In-Reply-To: References: Message-ID: Aki Tuomi wrote: >>> Well, tried with or without patches, but got still same error: >>> >>> sha1.h:80: error: static or type qualifiers in abstract declarator >> >> For what it's worth, I get the same error compiling on Solaris 10. >> It may be because I have a rather old gcc (3.4.4). Editing out >> the "static" keyword from config.h allowed it to finish the compile. > > It still happened even with > https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29dea7 > > You need to rerun autotools on this before it can do anything. I don't grok autotools, but I don't think this will solve the problem. If I understand the patch correctly, it modifies the small program used by configure to test a C99 feature. Manually compiling the small test program (with and without the changes made by the patch) will result in a successful compile, but if you compile sha1.h (line 80,81), it will fail. I've reduced the problem to this: void foo(int X[static 20]); will compile but if you remove "X", it won't. Joseph Tam From wlt-ml at o-sinc.com Mon Jul 11 23:21:51 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Mon, 11 Jul 2016 19:21:51 -0400 Subject: Master-Master replication question In-Reply-To: <96A4EF68-6E29-41BE-BBB4-0BC3EE172181@FreeBSD.org> References: <1304695756.35.1467803735221@openexchange.elvandar.org> <96A4EF68-6E29-41BE-BBB4-0BC3EE172181@FreeBSD.org> Message-ID: On Monday, July 11, 2016 05:38:20 PM Remko Lodder wrote: > > On 11 Jul 2016, at 17:21, William L. Thomson Jr. > > wrote: > > > > You are not alone! > > Hello, > > Now that?s a relief! Maybe if I had a solution, but I guess knowing others suffer the same can be reliving. > One of the things that I described and observed is that it seems that > serverB is not seeing the email (or at least there is no connection that > when an email is send and stored on the mailserver that the services see > them and notify the other end). With tcpdump there is no traffic at all, > until there is a sync the other way around. I really have not had a chance to debug this. I was under the impression one side thought it had synced. Since both sides tend to show fast sync, but its the full sync I have been curious about. When I run the manual command, it seems to do a full sync. Also not clear if emails are supposed to be on both or if one has reference to emails on the other. When I do a manual sync via command line, it seems to make both have the same emails, but different file names. The manual syncing I think it triggers another issue with duplicate emails. Another started a topic on duplicate emails from dsync, which I suffer from as well when I try to force syncing, or as a result of syncing at times. That as well I have not had a chance to debug. > As said both systems are identical in hardware setup and use puppet to > obtain their configuration, which is the same for both hosts (except the IP > adresses and hostname); Same here, I literally cloned my 2nd one as both are VMs. I use Ansible to make them identical configuration wise. Only thing that is different is the data, email that arrives on one or the other. > But since we are with at least two, we might have better luck in getting > some help with this. I currently do not have an idea on where to look and > how to investigate this properly. It seems there might have been a few regressions, maybe or hopefully. Things seemed to get better and/or go away entirely for a month or so after a past updated. I commented about that on list. Though it seems to have regressed with 2.2.24. I haven't upgraded to 2.2.25 yet. Seems that might have other regressions not sure or maybe fixes. > Any pointers from the list are welcome! Beyond running the manual sync via command line, not sure at this time. The manual sync via cli seemed to stop working a few updates back. Just as I type that, I went to run the command again so I could get errors to pass along and it worked. I know I tried to run it the other day and it failed. Something about unable to lookup UID or switch to the users. I had cron running it every 15 minutes to force things to sync. I stopped when I started getting emails of errors when it ran every 15 minutes. I think error is similar for the use case for the dsync wrapper script for root, mentioned here. When I get the error it seems root has a problem changing to another UID. Which seems that is what the script does, wrap users for root. http://wiki.dovecot.org/Replication Just odd that it works sometimes and not others. I thought it stopped working during an update. Now I think it is related to the syncing. Maybe when syncing is not working, if I run that command I will get the errors. Not sure if it will shed any light on syncing. At least I know that is not related to an update or regression. I will see about replicating the manual sync errors, and see if regular syncing is broken at the same time. Beyond that, I am open to any input from the list as well... Though need to do my part and try to debug a bit more. -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: This is a digitally signed message part. URL: From tss at iki.fi Tue Jul 12 01:18:25 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 12 Jul 2016 04:18:25 +0300 Subject: 2.3.0~alpha0-1~auto+197: Crash when openening a message via IMAP In-Reply-To: <20160711111514.GF25046@charite.de> References: <20160711111514.GF25046@charite.de> Message-ID: On 11 Jul 2016, at 14:15, Ralf Hildebrandt wrote: > > From the log: > > Jul 11 13:12:42 mproxy dovecot: imap-login: Login: user=, method=PLAIN, rip=141.42.206.36, lip=141.42.206.11, mpid=27254, TLS, session= > Jul 11 13:12:44 mproxy dovecot: imap(hildeb): Panic: file imap-client.c: line 854 (client_check_command_hangs): assertion failed: ((io_loop_find_fd_conditions(current_ioloop, client->fd_out) & IO_WRITE) != 0) Could you gdb the core and print some outputs: fr 5 (or whichever frame number has client_check_command_hangs) p *client p *client->command_queue p *client->command_queue->next p *client->command_queue->next->next (etc, until it fails) p *current_ioloop p *current_ioloop->io_files p *current_ioloop->io_files->next p *current_ioloop->io_files->next->next (etc, until it fails) From tss at iki.fi Tue Jul 12 01:23:59 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 12 Jul 2016 04:23:59 +0300 Subject: passdb {driver = shadow args = override_username=%variable} In-Reply-To: References: Message-ID: <60F9BA1B-A4E7-4F99-ADB5-AB733C06DAED@iki.fi> On 09 Jul 2016, at 13:01, UNIX admin wrote: > > Hello list > > I want to implement override_username = %variable for the "shadow" > driver, so that the following works: > > passdb { > driver = shadow > args = override_username=%Ln > } > > by "%variable", I mean "Variables" at http://wiki.dovecot.org/Variables. > > I've hacked up a solution with strtok(3C), but that's a hack and a > possible security hole, and I'd rather not implement it. > What I really want is to be able to leverage Dovecot's var_expand() > call, which, looking at the code, appears to be the function > responsible for %variable expansion and formatting. > > The relevant piece of code seems to be this excerpt in auth/passdb-shadow.c: > > static enum passdb_result > shadow_lookup(struct auth_request *request, struct spwd **spw_r) > { > auth_request_log_debug(request, AUTH_SUBSYS_DB, "lookup"); > > *spw_r = getspnam(request->user); > if (*spw_r == NULL) { > auth_request_log_unknown_user(request, AUTH_SUBSYS_DB); > return PASSDB_RESULT_USER_UNKNOWN; > } > > when request->user contains 'user at domain.tld', I want the code to be > able to process "override_username", determine that the format is %Ln > so that request->user is lowercased, and everything after the "@" sign > is stripped. Therefore, if this user happens to exist in the shadow > file, authentication will succeed. > > Currently, the "shadow" driver only appears to support "args = blocking=no". You need this to be specific to the one passdb, not everything? So auth_username_format=%Ln setting wouldn't work? passwd-file driver has username_format parameter, which does this. I've thought that rather than copy&pasting such code to other drivers, the next step would be to make it work for all the passdb and userdb drivers, such as: passdb { driver = anything args = anything username_format = %Ln } I'd be happy for such a generic patch. I'm not entirely sure what's the best/nicest way to do it though. Maybe temporarily override auth_request->user? Could be ugly, but maybe doable.. From tss at iki.fi Tue Jul 12 01:25:53 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 12 Jul 2016 04:25:53 +0300 Subject: passdb {driver = shadow args = override_username=%variable} In-Reply-To: References: Message-ID: <412EFDEB-4E1B-4832-8DE5-B52EADB74225@iki.fi> On 11 Jul 2016, at 19:48, William L. Thomson Jr. wrote: > > On Saturday, July 09, 2016 12:01:43 PM UNIX admin wrote: >> Hello list >> >> I want to implement override_username = %variable for the "shadow" >> driver, so that the following works: >> >> passdb { >> driver = shadow >> args = override_username=%Ln >> } >> >> by "%variable", I mean "Variables" at http://wiki.dovecot.org/Variables. > > That is pretty interesting, and along those lines. Could override_username also allow one > to block certain usernames from being synced? > > My mail server monitoring uses the nobody user account. That triggers syncing for the > nobody user account. Which always fails syncing. I end up running the following command > allot to avoid repeat errors in logs. > > "doveadm replicator remove nobody" > > I have not found a way to block users from passdb. Seems to be all or nothing. I could see > about having monitoring use an actual account. If something isn't in first_valid_uid..last_valid_uid it's not included in the list of users. In v2.3.x tree there's also a commit to check also first_valid_gid..last_valid_gid, which I'm not sure if it should be part of v2.2.x. From tss at iki.fi Tue Jul 12 01:27:48 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 12 Jul 2016 04:27:48 +0300 Subject: Dovecot 2.2.25 compiling error In-Reply-To: References: Message-ID: <0400C01D-A7F2-42EE-9201-1683832CF50B@iki.fi> > On 12 Jul 2016, at 02:16, Joseph Tam wrote: > > Aki Tuomi wrote: > >>>> Well, tried with or without patches, but got still same error: >>>> >>>> sha1.h:80: error: static or type qualifiers in abstract declarator >>> >>> For what it's worth, I get the same error compiling on Solaris 10. >>> It may be because I have a rather old gcc (3.4.4). Editing out >>> the "static" keyword from config.h allowed it to finish the compile. >> >> It still happened even with >> https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29dea7 >> >> You need to rerun autotools on this before it can do anything. > > I don't grok autotools, but I don't think this will solve the problem. > If I understand the patch correctly, it modifies the small program used > by configure to test a C99 feature. > > Manually compiling the small test program (with and without the changes > made by the patch) will result in a successful compile, but if you > compile sha1.h (line 80,81), it will fail. > > I've reduced the problem to this: > > void foo(int X[static 20]); > > will compile but if you remove "X", it won't. The change was to replace "int" with "unsigned char" in the above test program, and the test started failing then in CentOS 5's gcc. I'd expect the same to happen for you also. From tss at iki.fi Tue Jul 12 01:30:32 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 12 Jul 2016 04:30:32 +0300 Subject: is it possible to run a post-login script in a dovecot proxy with local auth? In-Reply-To: <944AFA14-4FE9-425D-A66A-883710D8BF5B@lm-net.it> References: <944AFA14-4FE9-425D-A66A-883710D8BF5B@lm-net.it> Message-ID: On 05 Jul 2016, at 02:14, Luca Lesinigo wrote: > > We?re using dovecot v2.2.22, authenticating on a local database (passdb with sql driver), and then proxying the connections to the backend server returned by passdb (proxy=y and backend in ?host? column). To support some legacy clients we should keep POP/IMAP-before-SMTP running for some time, but right know I don?t know how to hook up a successful authentication in the dovecot proxy. > > I did read from http://wiki2.dovecot.org/PostLoginScripting: > ?...it's not currently possible to run post-login scripts in proxies, because they're not actually logging in to the local Dovecot? > Does that also holds true even if the proxy is authenticating users locally before proxying them? Yes. Only when the imap/pop3 process starts the post-login scripting can work. > Failing that, any idea on how to get successful logins, other than parsing the log file? passdb checkpassword? Or write a plugin. From tss at iki.fi Tue Jul 12 01:41:55 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 12 Jul 2016 04:41:55 +0300 Subject: Feature Request In-Reply-To: References: Message-ID: <2B7EFB6B-A466-4E08-9C13-88A96CECE931@iki.fi> On 05 Jul 2016, at 00:39, Doug Hardie wrote: > > I would like to request an additional optional argument for queue-id to dovecot-lda. The intended use for this argument is to include in the logging. From what I can tell, the queue-id size is not consistent between the various MTAs and so would need to be allocated dynamically when read during initialization. > > This element in the log messages would make it easier to find the trace of a received email. Generally I can easily get the queue-id generated by postfix (or sendmail - I use both). One grep would then give me the whole picture rather than having to dig out the message-id and doing a secondary grep to obtain the lda log messages. It wouldn't work with LMTP though, which is nowadays the preferred method of delivering mails to Dovecot. So I'd rather not add features that didn't work with LMTP. > I find it interesting that every submission to this list results in a quick response that says moderation is required since I "am not a member". However, I am a member... You seem to be a member. I don't see anything in logs about you being moderated though.. From jtam.home at gmail.com Tue Jul 12 02:00:47 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Mon, 11 Jul 2016 19:00:47 -0700 (PDT) Subject: Dovecot 2.2.25 compiling error In-Reply-To: References: Message-ID: >> I've reduced the problem to this: >> >> void foo(int X[static 20]); >> >> will compile but if you remove "X", it won't. > > The change was to replace "int" with "unsigned char" in the above test > program, and the test started failing then in CentOS 5's gcc. I'd > expect the same to happen for you also. No, it will fail with both "int" and "unsigned char" without the dummy argument "X", and works for both if one is inserted. I don't know why -- perhaps a bug with my version of gcc. Joseph Tam From Ralf.Hildebrandt at charite.de Tue Jul 12 09:09:18 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Tue, 12 Jul 2016 11:09:18 +0200 Subject: 2.3.0~alpha0-1~auto+197: Crash when openening a message via IMAP In-Reply-To: <578384ED.4010905@dovecot.fi> References: <20160711111514.GF25046@charite.de> <578384ED.4010905@dovecot.fi> Message-ID: <20160712090918.GD19765@charite.de> * Aki Tuomi : > Did you forget to include doveconf -n? # 2.3.0.alpha0 (e84ffeb) [XI:2:2.3.0~alpha0-1~auto+200]: /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.alpha0 (66b7c14) # OS: Linux 4.4.0-24-generic x86_64 Ubuntu 16.04 LTS auth_mechanisms = plain login default_vsz_limit = 1 G imapc_host = email.charite.de imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no listen = *,:: mail_gid = imapproxy mail_home = /home/imapproxy/%u mail_location = imapc:~/imapc mail_plugins = mail_log notify mail_uid = imapproxy passdb { args = host=email.charite.de port=993 ssl=imaps default_fields = userdb_imapc_user=%u userdb_imapc_password=%w userdb_imapc_host=email.charite.de userdb_imapc_ssl=imaps userdb_imapc_port=993 driver = imap } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap service auth { inet_listener { address = 127.0.0.1 port = 12345 } } ssl = required ssl_ca = References: <20160711111514.GF25046@charite.de> Message-ID: <20160712092535.GE19765@charite.de> * Timo Sirainen : > On 11 Jul 2016, at 14:15, Ralf Hildebrandt wrote: > > > > From the log: > > > > Jul 11 13:12:42 mproxy dovecot: imap-login: Login: user=, method=PLAIN, rip=141.42.206.36, lip=141.42.206.11, mpid=27254, TLS, session= > > Jul 11 13:12:44 mproxy dovecot: imap(hildeb): Panic: file imap-client.c: line 854 (client_check_command_hangs): assertion failed: ((io_loop_find_fd_conditions(current_ioloop, client->fd_out) & IO_WRITE) != 0) > > Could you gdb the core and print some outputs: > > fr 5 (or whichever frame number has client_check_command_hangs) > p *client > p *client->command_queue > p *client->command_queue->next > p *client->command_queue->next->next > (etc, until it fails) > p *current_ioloop > p *current_ioloop->io_files > p *current_ioloop->io_files->next > p *current_ioloop->io_files->next->next > (etc, until it fails) Here it goes: Core was generated by 'dovecot/imap'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f6fa260d418 in __GI_raise (sig=sig at entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54 54 ../sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 0x00007f6fa260d418 in __GI_raise (sig=sig at entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54 #1 0x00007f6fa260f01a in __GI_abort () at abort.c:89 #2 0x00007f6fa2a2f226 in default_fatal_finish (type=, status=status at entry=0) at failures.c:201 #3 0x00007f6fa2a2f31c in i_internal_fatal_handler (ctx=0x7ffc8041e430, format=, args=) at failures.c:670 #4 0x00007f6fa29cd6ce in i_panic (format=format at entry=0x558b2197ce00 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 #5 0x0000558b2196bd42 in client_check_command_hangs (client=0x558b21bf7030) at imap-client.c:854 #6 client_continue_pending_input (client=0x558b21bf7030) at imap-client.c:919 #7 0x0000558b2196be68 in client_output (client=0x558b21bf7030) at imap-client.c:1233 #8 0x00007f6fa2a50500 in stream_send_io (fstream=0x558b21be5bb0) at ostream-file.c:478 #9 0x00007f6fa2a432ec in io_loop_call_io (io=0x558b21bfdf00) at ioloop.c:564 #10 0x00007f6fa2a44741 in io_loop_handler_run_internal (ioloop=ioloop at entry=0x558b21ba3740) at ioloop-epoll.c:221 #11 0x00007f6fa2a43375 in io_loop_handler_run (ioloop=ioloop at entry=0x558b21ba3740) at ioloop.c:612 #12 0x00007f6fa2a43510 in io_loop_run (ioloop=0x558b21ba3740) at ioloop.c:588 #13 0x00007f6fa29d3c43 in master_service_run (service=0x558b21ba35e0, callback=) at master-service.c:650 #14 0x0000558b2195eaf2 in main (argc=1, argv=0x558b21ba3390) at main.c:460 (gdb) fr 5 #5 0x0000558b2196bd42 in client_check_command_hangs (client=0x558b21bf7030) at imap-client.c:854 854 imap-client.c: No such file or directory. (gdb) p *client $1 = {prev = 0x0, next = 0x0, v = {state_export = 0x558b219763a0 , state_import = 0x558b219768f0 , destroy = 0x558b2196c290 }, session_id = 0x558b21bf71d8 "qsZiv2w3uLWNKs4k", userdb_fields = 0x558b21bf7400, fd_in = 7, fd_out = 7, io = 0x558b21be5cf0, input = 0x558b21be5a60, output = 0x558b21be5c40, to_idle = 0x558b21be5d50, to_idle_output = 0x558b21bfe020, to_delayed_input = 0x0, pool = 0x558b21bf7010, service_user = 0x558b21baa020, set = 0x558b21baa7f0, lda_set = 0x558b21baa930, capability_string = 0x558b21bf7258, user = 0x558b21bb8360, mailbox = 0x558b21bfa060, keywords = {names = 0x558b21bfb0f8, announce_count = 1}, sync_counter = 1, messages_count = 1443, recent_count = 0, uidvalidity = 58, enabled_features = (unknown: 0), last_input = 1468315092, last_output = 1468315092, bad_counter = 0, free_parser = 0x0, command_pool = 0x558b21bf7820, command_queue = 0x558b21bf7840, command_queue_size = 1, sync_last_full_modseq = 12854, highest_fetch_modseq = 0, fetch_hdr_count = 0, fetch_body_count = 1, fetch_hdr_bytes = 0, fetch_body_bytes = 369600, deleted_count = 0, expunged_count = 0, trashed_count = 0, search_saved_uidset = {arr = {buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, search_updates = {arr = {buffer = 0x0, element_size = 0}, v = 0x0, v_modifiable = 0x0}, notify_ctx = 0x0, notify_uidnext = 157276, input_lock = 0x0, output_cmd_lock = 0x558b21bf7840, mailbox_change_lock = 0x0, urlauth_ctx = 0x0, module_contexts = {arr = { buffer = 0x558b21bf71f0, element_size = 8}, v = 0x558b21bf71f0, v_modifiable = 0x558b21bf71f0}, sync_seen_deletes = false, disconnected = false, destroyed = false, handling_input = false, syncing = false, id_logged = false, mailbox_examined = false, anvil_sent = true, tls_compression = false, input_skip_line = false, modseqs_sent_since_sync = false, notify_immediate_expunges = false, notify_count_changes = true, notify_flag_changes = true, imap_metadata_enabled = false, nonpermanent_modseqs = false, state_import_bad_idle_done = false, state_import_idle_continue = false} (gdb) p *client->command_queue $2 = {prev = 0x0, next = 0x0, client = 0x558b21bf7030, pool = 0x558b21bf7820, tag = 0x558b21bf7970 "a0020", name = 0x558b21bf7978 "UID FETCH", args = 0x558b21bf7988 "157242 BODY.PEEK[]", cmd_flags = COMMAND_FLAG_BREAKS_SEQS, tagline_reply = 0x0, func = 0x558b219616a0 , context = 0x558b21bf79a0, module_contexts = {arr = {buffer = 0x558b21bf7908, element_size = 8}, v = 0x558b21bf7908, v_modifiable = 0x558b21bf7908}, parser = 0x558b21ba7810, state = CLIENT_COMMAND_STATE_WAIT_OUTPUT, start_time = {tv_sec = 1468315092, tv_usec = 52854}, last_run_timeval = { tv_sec = 1468315092, tv_usec = 52854}, start_ioloop_wait_usecs = 1094365, running_usecs = 50959, bytes_in = 18, bytes_out = 369642, sync = 0x0, uid = true, cancel = false, param_error = false, search_save_result = false, search_save_result_used = false, temp_executed = true, tagline_sent = false, executing = false} (gdb) p *client->command_queue->next Cannot access memory at address 0x0 (gdb) p *current_ioloop $4 = {prev = 0x0, cur_ctx = 0x558b21bb8150, io_files = 0x558b21bfdea0, next_io_file = 0x0, timeouts = 0x558b21ba37c0, timeouts_new = {arr = {buffer = 0x558b21ba3930, element_size = 8}, v = 0x558b21ba3930, v_modifiable = 0x558b21ba3930}, handler_context = 0x558b21ba5250, notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback = 0x7f6fa2cfdea0 , next_max_time = 1468315393, ioloop_wait_usecs = 1097229, io_pending_count = 0, running = true, iolooping = true} (gdb) p *current_ioloop->io_files $5 = {io = {condition = IO_READ, source_linenum = 1558, pending = false, callback = 0x7f6fa2d4bb50 , context = 0x558b21be1570, ioloop = 0x558b21ba3740, ctx = 0x558b21bb8150}, prev = 0x0, next = 0x558b21be5cf0, refcount = 1, fd = 16, istream = 0x0} (gdb) p *current_ioloop->io_files->next $6 = {io = {condition = IO_READ, source_linenum = 115, pending = false, callback = 0x558b2196beb0 , context = 0x558b21bf7030, ioloop = 0x558b21ba3740, ctx = 0x558b21bb8150}, prev = 0x558b21bfdea0, next = 0x558b21ba6ba0, refcount = 1, fd = 7, istream = 0x558b21be5a60} (gdb) p *current_ioloop->io_files->next->next $7 = {io = {condition = IO_ERROR, source_linenum = 520, pending = false, callback = 0x7f6fa29d42f0 , context = 0x558b21ba35e0, ioloop = 0x558b21ba3740, ctx = 0x0}, prev = 0x558b21be5cf0, next = 0x558b21ba6020, refcount = 1, fd = 6, istream = 0x0} (gdb) p *current_ioloop->io_files->next->next->next $8 = {io = {condition = IO_READ, source_linenum = 244, pending = false, callback = 0x7f6fa2a46540 , context = 0x0, ioloop = 0x558b21ba3740, ctx = 0x0}, prev = 0x558b21ba6ba0, next = 0x0, refcount = 1, fd = 10, istream = 0x0} (gdb) p *current_ioloop->io_files->next->next->next->next Cannot access memory at address 0x0 -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From aki.tuomi at dovecot.fi Tue Jul 12 13:34:00 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Tue, 12 Jul 2016 16:34:00 +0300 Subject: [2.2.25 auth issue] auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) In-Reply-To: <7c80a365-7731-6628-2232-b6306672233c@alex-at.ru> References: <7c80a365-7731-6628-2232-b6306672233c@alex-at.ru> Message-ID: <5784F1C8.9050303@dovecot.fi> On 11.07.2016 20:58, Alexey Asemov (Alex/AT) wrote: > Hello Aki. > Did you by chance test if this happens always, or in particular conditions? Aki From miguelmclara at gmail.com Tue Jul 12 15:03:50 2016 From: miguelmclara at gmail.com (Miguel C) Date: Tue, 12 Jul 2016 16:03:50 +0100 Subject: dovecot master password without "auth_master_user_separator" Message-ID: Looking at the doc its sugest we can either use auth_master_user_separator to login with a master user (i.e user at email.com*master and the master password defined in a file or db) I'm able to use this method with a password file and works just fine, however we need to sync some imap users to another destrination that does not allow us to use this format in the "email address source" (shame) But the doc also sugests if I don't use this flag I should be able to just use the same login used in the SASL mecahnisms which is not working (testing with plain text ). Is there anything more to this? I have tried to add a username to the password file with the same master password but still doens't work :| What am I missing? Melhores Cumprimentos // Best Regards ----------------------------------------------- *Miguel Clara* *IT - Sys Admin & Developer* From jtam.home at gmail.com Tue Jul 12 19:01:40 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 12 Jul 2016 12:01:40 -0700 (PDT) Subject: Dovecot 2.2.25 compiling error In-Reply-To: References: Message-ID: >>> void foo(int X[static 20]); >>> >>> will compile but if you remove "X", it won't. >> >> The change was to replace "int" with "unsigned char" in the above test >> program, and the test started failing then in CentOS 5's gcc. I'd >> expect the same to happen for you also. > > No, it will fail with both "int" and "unsigned char" without the dummy > argument "X", and works for both if one is inserted. I don't know why -- > perhaps a bug with my version of gcc. I don't have a CentOS5 lying around, so I tried compiling this with the gcc supplied by Ubuntu8 (v4.2.4), and observed the same failure. With a newer gcc (v4.6.3), it compiles cleanly with/without the X identifier. The type was irrelevant in both versions. My eyes glazed over trying to decipher section 6.7.5 of the ISO C99 document, so I've come to the conclusion I'm lousy at reading ISO documents. I suspect the identifier-less prototype is legal. http://www.open-std.org/jtc1/sc22/wg14/www/docs/n1256.pdf For now, I'll just patch sha1.h +++ ./src/lib/sha1.h~ Tue Jul 12 11:51:48 2016 --- ./src/lib/sha1.h Tue Jul 12 11:52:00 2016 @@ -80,1 +80,1 @@ - unsigned char [STATIC_ARRAY SHA1_RESULTLEN]); + unsigned char dummy[STATIC_ARRAY SHA1_RESULTLEN]); Joseph Tam From tripivceta at gmail.com Tue Jul 12 19:08:59 2016 From: tripivceta at gmail.com (UNIX admin) Date: Tue, 12 Jul 2016 21:08:59 +0200 Subject: passdb {driver = shadow args = override_username=%variable} In-Reply-To: <60F9BA1B-A4E7-4F99-ADB5-AB733C06DAED@iki.fi> References: <60F9BA1B-A4E7-4F99-ADB5-AB733C06DAED@iki.fi> Message-ID: On Tue, Jul 12, 2016 at 3:23 AM, Timo Sirainen wrote: > You need this to be specific to the one passdb, not everything? Actually it would not matter to me if all passdb drivers implemented "username_format", or "override_username"; that would make the software even more flexible and powerful. > So auth_username_format=%Ln setting wouldn't work? Consider the scenario where one has a mix of local users, found in the shadow file, and virtual users, which are in a SQLite database. The virtual users in the database might be completely different users, i.e. "timo at iki.fi" and "timo at oulu.fi" could legitimately be two completely different users, and the user "timo" in /etc/shadow could be yet another, unrelated person. According to the specification and examples found at http://wiki2.dovecot.org/AuthDatabase/SQL#Examples, the "password_query" performs the following SELECT: password_query = SELECT userid AS username, domain, password \ FROM users WHERE userid = '%n' AND domain = '%d' this means that the "domain" column is being used to perform user validation, and indeed, a %n@%d (user at domain) forms a tuple which is unique, so this is a valid use case, since there is enough information from that to identify unique users. As "user at domain.net" and "user at domain.fi" could be two different users, IMAP login must be set to "user at domain" forma, rather than just using "user" as the login. The problem is that when the client passes user at domain as login, and the user actually has a real UNIX account and receives e-mail on the system, the lookup in /etc/shadow fails. Since "auth_username_format=%Ln" overrides everything, that immediately breaks lookups of virtual users in the aforementioned SQLite database. Currently, it appears that sticking "auth_username_format" in userdb{} or passdb{} blocks is illegal. If the software allowed to specify discrete "auth_username_format" for each userdb{} and passdb{} block, that would immediately solve the problem, and increase the software's flexibility as a beneficial sideeffect. However, since I am not familiar with the code base, I am not even sure how I would go about this. If you could explain to me what exactly I need to pass into var_expand() function in order to be able to expand placeholders like "%Ln", I might be able to write a patch to implement override_username. That is of course assuming var_expand() is indeed the function doing the %placeholder expansion? As an aside, if one uses "username_format", in the userdb{} block, "auth" complains thus: auth-worker(5330): Warning: userdb passwd: Move templates args to override_fields setting. > I'd be happy for such a generic patch. I'm not entirely sure what's the best/nicest way to do it though. Maybe temporarily override auth_request->user? Could be ugly, but maybe doable.. Here is what I cooked up: + char *Login = NULL; + if((request->user != NULL) && ((Login = strdup(request->user)) != NULL)) + { + if(strtok(Login, "@") != NULL) + { + *spw_r = getspnam(Login); + } + } + else but that is a hack, and a potentially very dangerous hack, since I don't know what kind of validation has been done on request->user up to that point, so that could be a direct vector of a buffer overflow attack. (If I were attacking dovecot, this is the first place I would hit it at.) I've tried to be paranoid with all the NULL checking, but I don't trust myself. Nevertheless, I'm attaching the full patch to this e-mail, and would appreciate any feedback from a security standpoint. -------------- next part -------------- A non-text attachment was scrubbed... Name: src-auth-passdb-shadow.c.patch Type: application/octet-stream Size: 740 bytes Desc: not available URL: From leithner at itronic.at Tue Jul 12 19:25:31 2016 From: leithner at itronic.at (Harald Leithner) Date: Tue, 12 Jul 2016 21:25:31 +0200 Subject: Panic on cleanup Message-ID: Hi, I got a doveadm panic while running purge -A with 2.2.25 doveadm(x at itronic.at): Panic: file mdbox-map.c: line 1359: unreached doveadm(x at itronic.at): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x8dc6e) [0x7f2fe2022c6e] -> /usr/lib/dovecot/libdovecot.so.0(+0x8dce8) [0x7f2fe2022ce8] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f2fe1fc102e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_map_append_move+0x1ed) [0x7f2fe2301c0d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_purge+0xfe3) [0x7f2fe2303103] -> doveadm(+0x29458) [0x7f2fe2c7e458] -> doveadm(+0x2910f) [0x7f2fe2c7e10f] -> doveadm(+0x29db4) [0x7f2fe2c7edb4] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x278) [0x7f2fe2c7fae8] -> doveadm(doveadm_cmd_run_ver2+0x560) [0x7f2fe2c8dfd0] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x7f2fe2c8e027] -> doveadm(main+0x1e4) [0x7f2fe2c6f414] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f2fe1c0bb45] -> doveadm(+0x1a7ee) [0x7f2fe2c6f7ee] The command was run in a cleanup script that expunge old mails from the lazy-plugin. ---- #!/bin/sh # Permanently expunge old Trash doveadm expunge -A -d mailbox '#EXPUNGED/*' savedbefore 2w # Optimize mdbox storage and sis storage doveadm purge -A ---- After rerunning the command it fails again. stace could be found after config. config: # 2.2.devel (6d2fa6b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (3f51b82) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.5 auth_cache_negative_ttl = 1 secs auth_cache_size = 10 M auth_cache_ttl = 1 secs auth_mechanisms = PLAIN LOGIN DIGEST-MD5 SCRAM-SHA-1 CRAM-MD5 APOP auth_verbose = yes default_client_limit = 600 default_vsz_limit = 512 M dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlacl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 hostname = mailstore1 at itronic.at imap_hibernate_timeout = 1 mins imap_id_log = * imap_id_send = * imap_idle_notify_interval = 10 mins instance_name = mailstore1 last_valid_gid = 1001 last_valid_uid = 1001 lda_original_recipient_header = X-LDA-Original-To lmtp_rcpt_check_quota = yes login_greeting = ITronic Mail Store login_trusted_networks = 172.22.14.0/24 mail_attachment_dir = /srv/storage1/vmail_sis mail_attachment_hash = %{sha512} mail_attachment_min_size = 64 k mail_cache_min_mail_count = 5 mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib lazy_expunge stats acl quota mail_prefetch_count = 100 mail_server_admin = mailto:postmaster at itronic.at mail_server_comment = ITronic Mail System mail_shared_explicit_inbox = yes mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_preallocate_space = yes namespace { hidden = yes list = no location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = "#EXPUNGED/" subscriptions = no type = private } namespace { list = children location = mdbox:%%h/mdbox prefix = "#Users/%%u/" separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes location = mailbox Archvie { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::sqlacl last_login_dict = proxy::lastlogin last_login_key = last-login/%u lazy_expunge = "#EXPUNGED/" lazy_expunge_only_last_instance = no quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_rule = *:storage=1024M quota_rule2 = "#EXPUNGED:storage=+100M" quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=80%% quota-warning 80 %u recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_global = /etc/dovecot/sieve sieve_max_actions = 64 sieve_max_redirects = 8 sieve_max_script_size = 2M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 64M stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } pop3_uidl_duplicates = rename protocols = imap lmtp sieve pop3 sieve service auth-worker { user = $default_internal_user } service auth { inet_listener { port = 4180 } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 unix_listener imap-master { user = dovecot } unix_listener imap { group = vmail mode = 0666 } vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = 172.22.14.135 port = 24000 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 50 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 20 service_count = 1 vsz_limit = 64 M } service pop3 { process_limit = 1024 } service quota-warning { executable = script /opt/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } shutdown_clients = no ssl_cert = \0\1\0\0\0\260*\0\0\0\0\0\0"..., 832) = 832 fstat(23, {st_mode=S_IFREG|0644, st_size=90096, ...}) = 0 mmap(NULL, 2185952, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 23, 0) = 0x7f002ed5b000 mprotect(0x7f002ed71000, 2093056, PROT_NONE) = 0 mmap(0x7f002ef70000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 23, 0x15000) = 0x7f002ef70000 close(23) = 0 munmap(0x7f0033cca000, 17246) = 0 futex(0x7f0032d9e190, FUTEX_WAKE_PRIVATE, 2147483647) = 0 futex(0x7f002ef70850, FUTEX_WAKE_PRIVATE, 2147483647) = 0 write(2, "doveadm(lord at itronic.at): Error:"..., 860doveadm(lord at itronic.at): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x8dc6e) [0x7f0032e2dc6e] -> /usr/lib/dovecot/libdovecot.so.0(+0x8dce8) [0x7f0032e2dce8] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0032dcc02e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_map_append_move+0x1ed) [0x7f003310cc0d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_purge+0xfe3) [0x7f003310e103] -> doveadm(+0x29458) [0x7f0033a89458] -> doveadm(+0x2910f) [0x7f0033a8910f] -> doveadm(+0x29db4) [0x7f0033a89db4] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x278) [0x7f0033a8aae8] -> doveadm(doveadm_cmd_run_ver2+0x560) [0x7f0033a98fd0] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x7f0033a99027] -> doveadm(main+0x1e4) [0x7f0033a7a414] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f0032a16b45] -> doveadm(+0x1a7ee) [0x7f0033a7a7ee] ) = 860 rt_sigprocmask(SIG_UNBLOCK, [ABRT], NULL, 8) = 0 tgkill(5682, 5682, SIGABRT) = 0 --- SIGABRT {si_signo=SIGABRT, si_code=SI_TKILL, si_pid=5682, si_uid=0} --- +++ killed by SIGABRT +++ [1] 5679 abort strace doveadm purge -A -- Harald Leithner ITronic Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner at itronic.at | itronic.at From larryrtx at gmail.com Wed Jul 13 02:12:40 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Tue, 12 Jul 2016 21:12:40 -0500 Subject: Pigeonhole vs dovecot gssapi option Message-ID: Stephan, Is there a reason you don't pick up the dovecot-config file to set additional libraries like the Kerberos libs? I'm the FreeBSD Ports Maintainer for pigeonhole, and a user filed a PR about missing the krb5 libs. Thanks! -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 From lists at alex-at.ru Wed Jul 13 05:04:10 2016 From: lists at alex-at.ru (Alexey Asemov (Alex/AT)) Date: Wed, 13 Jul 2016 08:04:10 +0300 Subject: [2.2.25 auth issue] auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) In-Reply-To: <5784F1C8.9050303@dovecot.fi> References: <7c80a365-7731-6628-2232-b6306672233c@alex-at.ru> <5784F1C8.9050303@dovecot.fi> Message-ID: Checked logs, it looks like completely random to me. We do have users with special chars in passwords, including + - { } and so on, but log content on crashes don't seem related at all. KR, Alex On 12.07.2016 16:34, Aki Tuomi wrote: > > > On 11.07.2016 20:58, Alexey Asemov (Alex/AT) wrote: >> Hello Aki. >> > > Did you by chance test if this happens always, or in particular > conditions? > > Aki > From aki.tuomi at dovecot.fi Wed Jul 13 06:06:39 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Wed, 13 Jul 2016 09:06:39 +0300 Subject: [2.2.25 auth issue] auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) In-Reply-To: References: <7c80a365-7731-6628-2232-b6306672233c@alex-at.ru> <5784F1C8.9050303@dovecot.fi> Message-ID: <5785DA6F.1000401@dovecot.fi> I was more thinking about login methods, such as NTLM or CRAM-MD5. Or whether the user is present or missing. Or combination of these. Aki On 13.07.2016 08:04, Alexey Asemov (Alex/AT) wrote: > Checked logs, it looks like completely random to me. > > We do have users with special chars in passwords, including + - { } > and so on, but log content on crashes don't seem related at all. > > KR, > > Alex > > > On 12.07.2016 16:34, Aki Tuomi wrote: >> >> >> On 11.07.2016 20:58, Alexey Asemov (Alex/AT) wrote: >>> Hello Aki. >>> >> >> Did you by chance test if this happens always, or in particular >> conditions? >> >> Aki >> From aki.tuomi at dovecot.fi Wed Jul 13 06:08:46 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Wed, 13 Jul 2016 09:08:46 +0300 Subject: Panic on cleanup In-Reply-To: References: Message-ID: <5785DAEE.7020200@dovecot.fi> On 12.07.2016 22:25, Harald Leithner wrote: > Hi, > > I got a doveadm panic while running purge -A with 2.2.25 > > > doveadm(x at itronic.at): Panic: file mdbox-map.c: line 1359: unreached > doveadm(x at itronic.at): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0x8dc6e) [0x7f2fe2022c6e] -> > /usr/lib/dovecot/libdovecot.so.0(+0x8dce8) [0x7f2fe2022ce8] -> > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f2fe1fc102e] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_map_append_move+0x1ed) > [0x7f2fe2301c0d] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_purge+0xfe3) > [0x7f2fe2303103] -> doveadm(+0x29458) [0x7f2fe2c7e458] -> > doveadm(+0x2910f) [0x7f2fe2c7e10f] -> doveadm(+0x29db4) > [0x7f2fe2c7edb4] -> > doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x278) [0x7f2fe2c7fae8] > -> doveadm(doveadm_cmd_run_ver2+0x560) [0x7f2fe2c8dfd0] -> > doveadm(doveadm_cmd_try_run_ver2+0x37) [0x7f2fe2c8e027] -> > doveadm(main+0x1e4) [0x7f2fe2c6f414] -> > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) > [0x7f2fe1c0bb45] -> doveadm(+0x1a7ee) [0x7f2fe2c6f7ee] > > The command was run in a cleanup script that expunge old mails from > the lazy-plugin. > ---- > #!/bin/sh > > # Permanently expunge old Trash > doveadm expunge -A -d mailbox '#EXPUNGED/*' savedbefore 2w > > # Optimize mdbox storage and sis storage > doveadm purge -A > ---- > > After rerunning the command it fails again. > > stace could be found after config. > > > config: > # 2.2.devel (6d2fa6b): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.devel (3f51b82) > # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.5 > auth_cache_negative_ttl = 1 secs > auth_cache_size = 10 M > auth_cache_ttl = 1 secs > auth_mechanisms = PLAIN LOGIN DIGEST-MD5 SCRAM-SHA-1 CRAM-MD5 APOP > auth_verbose = yes > default_client_limit = 600 > default_vsz_limit = 512 M > dict { > lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > sqlacl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext > } > disable_plaintext_auth = no > first_valid_gid = 1001 > first_valid_uid = 1001 > hostname = mailstore1 at itronic.at > imap_hibernate_timeout = 1 mins > imap_id_log = * > imap_id_send = * > imap_idle_notify_interval = 10 mins > instance_name = mailstore1 > last_valid_gid = 1001 > last_valid_uid = 1001 > lda_original_recipient_header = X-LDA-Original-To > lmtp_rcpt_check_quota = yes > login_greeting = ITronic Mail Store > login_trusted_networks = 172.22.14.0/24 > mail_attachment_dir = /srv/storage1/vmail_sis > mail_attachment_hash = %{sha512} > mail_attachment_min_size = 64 k > mail_cache_min_mail_count = 5 > mail_gid = vmail > mail_location = mdbox:~/mdbox > mail_plugins = zlib lazy_expunge stats acl quota > mail_prefetch_count = 100 > mail_server_admin = mailto:postmaster at itronic.at > mail_server_comment = ITronic Mail System > mail_shared_explicit_inbox = yes > mail_uid = vmail > mailbox_list_index = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate mime foreverypart > extracttext > mdbox_preallocate_space = yes > namespace { > hidden = yes > list = no > location = mdbox:~/mdbox:MAILBOXDIR=expunged > prefix = "#EXPUNGED/" > subscriptions = no > type = private > } > namespace { > list = children > location = mdbox:%%h/mdbox > prefix = "#Users/%%u/" > separator = / > subscriptions = yes > type = shared > } > namespace inbox { > hidden = no > inbox = yes > location = > mailbox Archvie { > special_use = \Archive > } > mailbox Drafts { > special_use = \Drafts > } > mailbox Sent { > special_use = \Sent > } > mailbox Spam { > special_use = \Junk > } > mailbox Trash { > special_use = \Trash > } > prefix = > separator = / > subscriptions = yes > type = private > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > acl = vfile > acl_shared_dict = proxy::sqlacl > last_login_dict = proxy::lastlogin > last_login_key = last-login/%u > lazy_expunge = "#EXPUNGED/" > lazy_expunge_only_last_instance = no > quota = dict:User quota::proxy::sqlquota > quota_grace = 10%% > quota_rule = *:storage=1024M > quota_rule2 = "#EXPUNGED:storage=+100M" > quota_warning = storage=100%% quota-warning 100 %u > quota_warning2 = storage=95%% quota-warning 95 %u > quota_warning3 = storage=80%% quota-warning 80 %u > recipient_delimiter = + > sieve = file:~/sieve;active=~/.dovecot.sieve > sieve_global = /etc/dovecot/sieve > sieve_max_actions = 64 > sieve_max_redirects = 8 > sieve_max_script_size = 2M > sieve_quota_max_scripts = 0 > sieve_quota_max_storage = 64M > stats_refresh = 30 secs > stats_track_cmds = yes > zlib_save = gz > zlib_save_level = 6 > } > pop3_uidl_duplicates = rename > protocols = imap lmtp sieve pop3 sieve > service auth-worker { > user = $default_internal_user > } > service auth { > inet_listener { > port = 4180 > } > unix_listener auth-userdb { > mode = 0666 > } > } > service dict { > unix_listener dict { > group = vmail > mode = 0666 > } > } > service imap-hibernate { > unix_listener imap-hibernate { > group = vmail > mode = 0666 > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > process_min_avail = 1 > service_count = 0 > } > service imap { > process_limit = 1024 > unix_listener imap-master { > user = dovecot > } > unix_listener imap { > group = vmail > mode = 0666 > } > vsz_limit = 512 M > } > service lmtp { > inet_listener lmtp { > address = 172.22.14.135 > port = 24000 > } > unix_listener lmtp { > mode = 0666 > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > process_min_avail = 0 > service_count = 1 > vsz_limit = 64 M > } > service managesieve { > process_limit = 50 > } > service pop3-login { > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > process_min_avail = 20 > service_count = 1 > vsz_limit = 64 M > } > service pop3 { > process_limit = 1024 > } > service quota-warning { > executable = script /opt/scripts/quota-warning.sh > unix_listener quota-warning { > user = vmail > } > user = dovecot > } > service stats { > fifo_listener stats-mail { > mode = 0600 > user = vmail > } > } > shutdown_clients = no > ssl_cert = ssl_cipher_list = > ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA:AES256-SHA:DHE-RSA-CAMELLIA128-SHA:DHE-RSA-CAMELLIA256-SHA:CAMELLIA128-SHA:CAMELLIA256-SHA:ECDHE-RSA-DES-CBC3-SHA:DES-CBC3-SHA > ssl_dh_parameters_length = 2048 > ssl_key = ssl_options = no_compression > ssl_prefer_server_ciphers = yes > ssl_protocols = !SSLv2 !SSLv3 > submission_host = 172.22.14.198 > syslog_facility = local0 > userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > valid_chroot_dirs = /srv/storage1/vmail > verbose_proctitle = yes > protocol imap { > mail_max_userip_connections = 20 > mail_plugins = zlib lazy_expunge stats imap_stats quota imap_quota > acl imap_acl last_login > } > protocol lda { > mail_plugins = zlib lazy_expunge stats acl sieve quota > } > protocol lmtp { > mail_plugins = zlib lazy_expunge stats acl sieve quota > } > protocol sieve { > mail_max_userip_connections = 10 > managesieve_max_compile_errors = 5 > managesieve_max_line_length = 65536 > } > protocol pop3 { > mail_max_userip_connections = 10 > mail_plugins = zlib lazy_expunge stats acl last_login > } > > > > > > > strace: > > open("/srv/storage1/vmail/itronic/7/mdbox/storage/m.4184", O_RDWR) = 22 > fstat(22, {st_mode=S_IFREG|0644, st_size=38285, ...}) = 0 > pread(22, "2 M1e C577baa0d\n\1\2N 000"..., 8192, 0) = 8192 > flock(22, LOCK_EX|LOCK_NB) = 0 > stat("/srv/storage1/vmail/itronic/7/mdbox/storage/m.4184", > {st_mode=S_IFREG|0644, st_size=38285, ...}) = 0 > fstat(22, {st_mode=S_IFREG|0644, st_size=38285, ...}) = 0 > fstat(22, {st_mode=S_IFREG|0644, st_size=38285, ...}) = 0 > pread(19, "\1\2N 0000000000000BE3\n\37\213"..., 8192, > 1889547) = 8192 > pwrite(22, "\1\2N 0000000000000BE3\n\37\213"..., 3073, 38285) > = 3073 > > .... > > pread(19, "\1\2N 00000000000003CA\n\37\213"..., 8192, > 2095957) = 1078 > pwrite(22, "\n\1\3\nZ1510\nR532d6d69\nV1574\nGc74fb"..., 1094, 244601) > = 1094 > pwrite(21, "\n\1\3\nZ62903b\nR576a94d0\nV63ea34\nG9"..., 632, 2094401) > = 632 > fdatasync(21) = 0 > pwrite(20, "\n\1\3\nZ44ef\nR523ab092\nV467e\nG524f7"..., 94, 2095470) > = 94 > fdatasync(20) = 0 > pwrite(22, "\n\1\3\nZ73b\nR570f7b1b\nV790\nGa658d91"..., 78, 245695) = 78 > fdatasync(22) = 0 > stat("/srv/storage1/vmail/itronic/7/mdbox/storage/dovecot.map.index.log.2", > {st_mode=S_IFREG|0644, st_size=37848, ...}) = 0 > alarm(180) = 0 > fcntl(17, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 > alarm(0) = 180 > stat("/srv/storage1/vmail/itronic/7/mdbox/storage/dovecot.map.index.log", > {st_mode=S_IFREG|0644, st_size=5160, ...}) = 0 > fstat(17, {st_mode=S_IFREG|0644, st_size=5160, ...}) = 0 > write(2, "doveadm(lord at itronic.at): Panic:"..., > 72doveadm(lord at itronic.at): Panic: file mdbox-map.c: line 1359: unreached > ) = 72 > open("/usr/lib/dovecot/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = -1 ENOENT > (No such file or directory) > open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 23 > fstat(23, {st_mode=S_IFREG|0644, st_size=17246, ...}) = 0 > mmap(NULL, 17246, PROT_READ, MAP_PRIVATE, 23, 0) = 0x7f0033cca000 > close(23) = 0 > access("/etc/ld.so.nohwcap", F_OK) = -1 ENOENT (No such file or > directory) > open("/lib/x86_64-linux-gnu/libgcc_s.so.1", O_RDONLY|O_CLOEXEC) = 23 > read(23, > "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260*\0\0\0\0\0\0"..., > 832) = 832 > fstat(23, {st_mode=S_IFREG|0644, st_size=90096, ...}) = 0 > mmap(NULL, 2185952, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, > 23, 0) = 0x7f002ed5b000 > mprotect(0x7f002ed71000, 2093056, PROT_NONE) = 0 > mmap(0x7f002ef70000, 4096, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 23, 0x15000) = 0x7f002ef70000 > close(23) = 0 > munmap(0x7f0033cca000, 17246) = 0 > futex(0x7f0032d9e190, FUTEX_WAKE_PRIVATE, 2147483647) = 0 > futex(0x7f002ef70850, FUTEX_WAKE_PRIVATE, 2147483647) = 0 > write(2, "doveadm(lord at itronic.at): Error:"..., > 860doveadm(lord at itronic.at): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0x8dc6e) [0x7f0032e2dc6e] -> > /usr/lib/dovecot/libdovecot.so.0(+0x8dce8) [0x7f0032e2dce8] -> > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f0032dcc02e] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_map_append_move+0x1ed) > [0x7f003310cc0d] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mdbox_purge+0xfe3) > [0x7f003310e103] -> doveadm(+0x29458) [0x7f0033a89458] -> > doveadm(+0x2910f) [0x7f0033a8910f] -> doveadm(+0x29db4) > [0x7f0033a89db4] -> > doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x278) [0x7f0033a8aae8] > -> doveadm(doveadm_cmd_run_ver2+0x560) [0x7f0033a98fd0] -> > doveadm(doveadm_cmd_try_run_ver2+0x37) [0x7f0033a99027] -> > doveadm(main+0x1e4) [0x7f0033a7a414] -> > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) > [0x7f0032a16b45] -> doveadm(+0x1a7ee) [0x7f0033a7a7ee] > ) = 860 > rt_sigprocmask(SIG_UNBLOCK, [ABRT], NULL, 8) = 0 > tgkill(5682, 5682, SIGABRT) = 0 > --- SIGABRT {si_signo=SIGABRT, si_code=SI_TKILL, si_pid=5682, > si_uid=0} --- > +++ killed by SIGABRT +++ > [1] 5679 abort strace doveadm purge -A > > > > Hi! We are looking into this, thank you for your report! --- Aki Tuomi Dovecot oy From stephan at rename-it.nl Wed Jul 13 06:52:36 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 13 Jul 2016 08:52:36 +0200 Subject: Pigeonhole vs dovecot gssapi option In-Reply-To: References: Message-ID: Op 7/13/2016 om 4:12 AM schreef Larry Rosenman: > Stephan, > Is there a reason you don't pick up the dovecot-config file to set > additional libraries like the Kerberos libs? > > I'm the FreeBSD Ports Maintainer for pigeonhole, and a user filed a PR > about missing the krb5 libs. Could you elaborate? Regards, Stephan. From larryrtx at gmail.com Wed Jul 13 13:42:15 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Wed, 13 Jul 2016 08:42:15 -0500 Subject: Pigeonhole vs dovecot gssapi option In-Reply-To: References: Message-ID: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211025 Basically, if dovecot is built with gssapi support, we need to pick up .../dovecot-config's DOVECOT_LIBS in pigeonhole's link. On Wed, Jul 13, 2016 at 1:52 AM, Stephan Bosch wrote: > Op 7/13/2016 om 4:12 AM schreef Larry Rosenman: > > Stephan, > > Is there a reason you don't pick up the dovecot-config file to set > > additional libraries like the Kerberos libs? > > > > I'm the FreeBSD Ports Maintainer for pigeonhole, and a user filed a PR > > about missing the krb5 libs. > > Could you elaborate? > > Regards, > > Stephan. > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 From stephan at rename-it.nl Wed Jul 13 14:43:39 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 13 Jul 2016 16:43:39 +0200 Subject: Pigeonhole vs dovecot gssapi option In-Reply-To: References: Message-ID: <5fe1e0c2-41e8-92a3-1eab-bcd40017f3de@rename-it.nl> Op 13-7-2016 om 15:42 schreef Larry Rosenman: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211025 > > Basically, if dovecot is built with gssapi support, we need to pick up > .../dovecot-config's DOVECOT_LIBS in pigeonhole's link. It does that: https://github.com/dovecot/pigeonhole/blob/master-0.4/m4/dovecot.m4#L112 https://github.com/dovecot/pigeonhole/blob/master-0.4/configure.ac#L38 Looking at that bug report, this is what adds "-lkrb5 -lgssapi" and subsequently triggers this error: /usr/bin/ld: cannot find -lkrb5 So, the problem is not that Pigeonhole is not following Dovecot's DOVECOT_LIBS definition from dovecot-config. Rather, it seems to me that dovecot-config is missing a -L${LOCALBASE}/lib/heimdal in $DOVECOT_LIBS, as suggested by the poster of this bug. I am not sure why. Regards, Stephan. > On Wed, Jul 13, 2016 at 1:52 AM, Stephan Bosch wrote: > >> Op 7/13/2016 om 4:12 AM schreef Larry Rosenman: >>> Stephan, >>> Is there a reason you don't pick up the dovecot-config file to set >>> additional libraries like the Kerberos libs? >>> >>> I'm the FreeBSD Ports Maintainer for pigeonhole, and a user filed a PR >>> about missing the krb5 libs. >> Could you elaborate? >> >> Regards, >> >> Stephan. >> > > From larryrtx at gmail.com Wed Jul 13 18:50:37 2016 From: larryrtx at gmail.com (Larry Rosenman) Date: Wed, 13 Jul 2016 13:50:37 -0500 Subject: Pigeonhole vs dovecot gssapi option In-Reply-To: <5fe1e0c2-41e8-92a3-1eab-bcd40017f3de@rename-it.nl> References: <5fe1e0c2-41e8-92a3-1eab-bcd40017f3de@rename-it.nl> Message-ID: I wound up just adding the same GSSAPI options to the pigeonhole port with a note that they must be the same as Dovecot. I'm not sure who the culprit is for NOT writing the -L.../lib/heimdal to dovecot-config. On Wed, Jul 13, 2016 at 9:43 AM, Stephan Bosch wrote: > Op 13-7-2016 om 15:42 schreef Larry Rosenman: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211025 > > Basically, if dovecot is built with gssapi support, we need to pick up > .../dovecot-config's DOVECOT_LIBS in pigeonhole's link. > > > It does that: > > https://github.com/dovecot/pigeonhole/blob/master-0.4/m4/dovecot.m4#L112 > https://github.com/dovecot/pigeonhole/blob/master-0.4/configure.ac#L38 > > Looking at that bug report, this is what adds "-lkrb5 -lgssapi" and > subsequently triggers this error: > > /usr/bin/ld: cannot find -lkrb5 > > So, the problem is not that Pigeonhole is not following Dovecot's DOVECOT_LIBS definition from dovecot-config. Rather, it seems to me that dovecot-config is missing a > > -L${LOCALBASE}/lib/heimdal > > in $DOVECOT_LIBS, as suggested by the poster of this bug. > > I am not sure why. > > > Regards, > > Stephan. > > On Wed, Jul 13, 2016 at 1:52 AM, Stephan Bosch wrote: > > > Op 7/13/2016 om 4:12 AM schreef Larry Rosenman: > > Stephan, > Is there a reason you don't pick up the dovecot-config file to set > additional libraries like the Kerberos libs? > > I'm the FreeBSD Ports Maintainer for pigeonhole, and a user filed a PR > about missing the krb5 libs. > > Could you elaborate? > > Regards, > > Stephan. > > > > > -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 From leon at f-m.fm Thu Jul 14 02:33:32 2016 From: leon at f-m.fm (Leon Kyneur) Date: Thu, 14 Jul 2016 10:33:32 +0800 Subject: Panic: file mdbox-save.c: line 337: unreached In-Reply-To: <35DC19B2-0EFA-44F4-A0FC-5F3D2A13CA76@iki.fi> References: <57825F45.7000305@f-m.fm> <35DC19B2-0EFA-44F4-A0FC-5F3D2A13CA76@iki.fi> Message-ID: <5786F9FC.5090702@f-m.fm> Thanks Timo I will apply this patch and let you know if I encounter any more issues. On 11/07/16 17:09, Timo Sirainen wrote: > On 10 Jul 2016, at 17:44, Leon Kyneur wrote: >> Recently updated to 2.2.25. Noticed a migration script I've been previously running fine started giving me the errors below. >> >> Remove server doesn't log any failure. doveconf -n attached. >> >> + /bin/doveadm -o mail_fsync=never backup -R -u user at domain.com imapc: >> dsync(user at domain.com): Panic: file mdbox-save.c: line 337: unreached > Thanks, fixed: https://github.com/dovecot/core/commit/3aae8844765b1d74d847e8e37daa135ac7035e6b > From arekm at maven.pl Thu Jul 14 07:56:35 2016 From: arekm at maven.pl (Arkadiusz =?utf-8?q?Mi=C5=9Bkiewicz?=) Date: Thu, 14 Jul 2016 09:56:35 +0200 Subject: Panic: file mail-transaction-log-file.c: line 104 (mail_transaction_log_file_free): assertion failed: (!file->locked) Message-ID: <201607140956.35987.arekm@maven.pl> 2.2.25 (also happens on 2.2.24). Happens every time I try to make deliver and only for this user: Jul 14 09:52:02 mbox dovecot: lmtp(25601): Connect from local Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=, Error: Index /var/mail/powiadomienia/dovecot.index: Lost log for seq=1009 offset=40: Missing middle file seq=1009 (between 1009..4294967295) Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=, Warning: fscking index file /var/mail/powiadomienia/dovecot.index Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=, Error: Fixed index file /var/mail/powiadomienia/dovecot.index: log_file_seq 1009 -> 1011 Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=, Panic: file mail-transaction-log-file.c: line 104 (mail_transaction_log_file_free): assertion failed: (!file->locked) Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=, Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x8d7d2) [0x7feb89fc97d2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x8d8bd) [0x7feb89fc98bd] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7feb89f67e31] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_log_file_free+0x160) [0x7feb8a331fa0] -> /usr/lib64/dovecot/libdovecot- storage.so.0(mail_transaction_logs_clean+0x4d) [0x7feb8a3360ed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_transaction_log_close+0x30) [0x7feb8a336230] -> /usr/lib64/dovecot/libdovecot- storage.so.0(mail_transaction_log_move_to_memory+0xd5) [0x7feb8a3363e5] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_move_to_memory+0xa0) [0x7feb8a330440] -> /usr/lib64/dovecot/libdovecot- storage.so.0(mail_index_write+0x183) [0x7feb8a32e9d3] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_fsck+0xc1f) [0x7feb8a3186ff] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x49b) [0x7feb8a322eab] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_map+0x71) [0x7feb8a31a231] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xe0fed) [0x7feb8a32ffed] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xe15f3) [0x7feb8a3305f3] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_open+0x78) [0x7feb8a3306d8] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0x92) [0x7feb8a309202] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x6c0e2) [0x7feb8a2bb0e2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x6c1c8) [0x7feb8a2bb1c8] -> /usr/lib64/dovecot/plugins/lib20_zlib_plugin.so(+0x2fdc) [0x7feb85697fdc] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x450c6) [0x7feb8a2940c6] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_open+0x20) [0x7feb8a294240] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save_open+0xad) [0x7feb8a58d1ad] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver_save+0xbb) [0x7feb8a58d48b] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0x123) [0x7feb8a58d9e3] -> dovecot/lmtp [DATA powiadomienia]() [0x406bc8] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7feb89fdd67c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7feb89fdeb01] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7feb89fdd705] Jul 14 09:52:02 mbox dovecot: lmtp(powiadomienia): session=, Fatal: master: service(lmtp): child 25601 killed with signal 6 (core dumps disabled) -- Arkadiusz Mi?kiewicz, arekm / ( maven.pl | pld-linux.org ) From goetz.reinicke at filmakademie.de Thu Jul 14 09:34:10 2016 From: goetz.reinicke at filmakademie.de (=?UTF-8?Q?G=c3=b6tz_Reinicke_-_IT_Koordinator?=) Date: Thu, 14 Jul 2016 11:34:10 +0200 Subject: quota config - when is the warning messag send? Message-ID: <9b9ce8f1-6766-985c-1c2c-8548781d2acb@filmakademie.de> Hi, we run dovecot 2.2.24 and from what I see, quota management with warning message is configured currently with "noenforcing". Our individual quota limit is stored in the users ldap DN which is fetched as I see from the logs and by "doveadm quota get -u" I tried to trigger the warning mail by going over the limit on my account step by step and can see that values are counted with the command above and in thunderbird by showing the orange and than red warning symbol at the bottom for me. But the warning mail script is not triggert. How may I debug this? from 90-quota.conf: service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = vmail # dovecot unix_listener quota-warning { user = vmail } } /usr/local/bin/quota-warning.sh is owned currently by vmail and executable by vmail. Thanks for feedback and suggestion . /G?tz -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5571 bytes Desc: S/MIME Cryptographic Signature URL: From aki.tuomi at dovecot.fi Thu Jul 14 10:51:06 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Thu, 14 Jul 2016 13:51:06 +0300 Subject: Panic: file mail-transaction-log-file.c: line 104 (mail_transaction_log_file_free): assertion failed: (!file->locked) In-Reply-To: <201607140956.35987.arekm@maven.pl> References: <201607140956.35987.arekm@maven.pl> Message-ID: <57876E9A.4040309@dovecot.fi> On 14.07.2016 10:56, Arkadiusz Mi?kiewicz wrote: > 2.2.25 (also happens on 2.2.24). Happens every time I try to make deliver > and only for this user: > > Hi! Any chance for doveconf -n + gdb bt full output from coredump? gdb /path/to/lmtp /path/to/core bt full Aki Tuomi Dovecot oy From jtam.home at gmail.com Thu Jul 14 18:26:19 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 14 Jul 2016 11:26:19 -0700 (PDT) Subject: "Error: nfs_flush_file_handle_cache_dir: rmdir(/inboxes)" log spikes Message-ID: I received a bunch of these log messages at a rate of a few thousand per hour for one of my users -- she may have max'd out her quota. The directory is a NFS directory containing mbox formatted INBOX's. Other than alleviating the space crunch, is there any particular action I need to take? Joseph Tam From aki.tuomi at dovecot.fi Thu Jul 14 19:58:33 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Thu, 14 Jul 2016 22:58:33 +0300 Subject: "Error: nfs_flush_file_handle_cache_dir: rmdir(/inboxes)" log spikes In-Reply-To: References: Message-ID: <5787EEE9.70200@dovecot.fi> On 14.07.2016 21:26, Joseph Tam wrote: > > I received a bunch of these log messages at a rate of a few thousand > per hour > for one of my users -- she may have max'd out her quota. The > directory is > a NFS directory containing mbox formatted INBOX's. > > Other than alleviating the space crunch, is there any particular action I > need to take? > > Joseph Tam Are we talking about dovecot quota or some filesystem quota? Aki From news at mefox.org Thu Jul 14 20:56:09 2016 From: news at mefox.org (Michael Fox) Date: Thu, 14 Jul 2016 13:56:09 -0700 Subject: controlling STARTTLS by IP address Message-ID: <029001d1de12$262806b0$72781410$@mefox.org> On my POP3 server, I need to be able to control the use of STARTTLS by client IP address. Specifically: * Clients on certain internal subnets (e.g., 192.168.1.0/24) must not have the option to use TLS. If the client tries to use STARTTLS, the option should be rejected. This is to satisfy US FCC rules regarding the use of encryption over certain radio frequencies. * All other internal clients (e.g., 192.168.0.0/16, but not 192.168.1.0/24) should be able to use STARTTLS if they choose to. * All external clients (0.0.0.0/0) will be required to use TLS. Is there a way to control which clients are allowed to use STARTTLS according to the client's IP address? Thanks, Michael From edgar at pettijohn-web.com Thu Jul 14 21:13:56 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Thu, 14 Jul 2016 16:13:56 -0500 Subject: controlling STARTTLS by IP address In-Reply-To: <029001d1de12$262806b0$72781410$@mefox.org> References: <029001d1de12$262806b0$72781410$@mefox.org> Message-ID: <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> Sent from my iPhone > On Jul 14, 2016, at 3:56 PM, Michael Fox wrote: > > On my POP3 server, I need to be able to control the use of STARTTLS by > client IP address. Specifically: > > * Clients on certain internal subnets (e.g., 192.168.1.0/24) must not have > the option to use TLS. If the client tries to use STARTTLS, the option > should be rejected. This is to satisfy US FCC rules regarding the use of > encryption over certain radio frequencies. > * All other internal clients (e.g., 192.168.0.0/16, but not 192.168.1.0/24) > should be able to use STARTTLS if they choose to. > * All external clients (0.0.0.0/0) will be required to use TLS. > > Is there a way to control which clients are allowed to use STARTTLS > according to the client's IP address? > > Thanks, > Michael > > > Seems like your firewall could redirect to a different port that doesn't offer starttls. > From lists at lazygranch.com Thu Jul 14 21:23:31 2016 From: lists at lazygranch.com (lists at lazygranch.com) Date: Thu, 14 Jul 2016 14:23:31 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <029001d1de12$262806b0$72781410$@mefox.org> References: <029001d1de12$262806b0$72781410$@mefox.org> Message-ID: <20160714212331.5517397.85571.6763@lazygranch.com> Are you 100% sure your interpretation of the FCC rules is correct? Do you really want passwords going out over RF unencrypted?? As far as I know, only ham bands are not allowed to use encryption. Even baby monitors these days are DECT. (Mind you, not good encryption.) ? Original Message ? From: Michael Fox Sent: Thursday, July 14, 2016 1:57 PM To: Dovecot Mailing List Subject: controlling STARTTLS by IP address On my POP3 server, I need to be able to control the use of STARTTLS by client IP address. Specifically: * Clients on certain internal subnets (e.g., 192.168.1.0/24) must not have the option to use TLS. If the client tries to use STARTTLS, the option should be rejected. This is to satisfy US FCC rules regarding the use of encryption over certain radio frequencies. * All other internal clients (e.g., 192.168.0.0/16, but not 192.168.1.0/24) should be able to use STARTTLS if they choose to. * All external clients (0.0.0.0/0) will be required to use TLS. Is there a way to control which clients are allowed to use STARTTLS according to the client's IP address? Thanks, Michael From aki.tuomi at dovecot.fi Thu Jul 14 21:26:30 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Fri, 15 Jul 2016 00:26:30 +0300 Subject: controlling STARTTLS by IP address In-Reply-To: <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> Message-ID: <57880386.7060200@dovecot.fi> On 15.07.2016 00:13, Edgar Pettijohn wrote: > > Sent from my iPhone > >> On Jul 14, 2016, at 3:56 PM, Michael Fox wrote: >> >> On my POP3 server, I need to be able to control the use of STARTTLS by >> client IP address. Specifically: >> >> * Clients on certain internal subnets (e.g., 192.168.1.0/24) must not have >> the option to use TLS. If the client tries to use STARTTLS, the option >> should be rejected. This is to satisfy US FCC rules regarding the use of >> encryption over certain radio frequencies. >> * All other internal clients (e.g., 192.168.0.0/16, but not 192.168.1.0/24) >> should be able to use STARTTLS if they choose to. >> * All external clients (0.0.0.0/0) will be required to use TLS. >> >> Is there a way to control which clients are allowed to use STARTTLS >> according to the client's IP address? >> >> Thanks, >> Michael >> >> >> > Seems like your firewall could redirect to a different port that doesn't offer starttls. You could try remote x.x.x.x/y { ssl = no } Aki From news at mefox.org Thu Jul 14 21:52:35 2016 From: news at mefox.org (Michael Fox) Date: Thu, 14 Jul 2016 14:52:35 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> Message-ID: <02c601d1de1a$086fddc0$194f9940$@mefox.org> > Seems like your firewall could redirect to a different port that doesn't > offer starttls. Yes, of course. But that would require multiple ports, making the client configuration cumbersome and error-prone. Michael From news at mefox.org Thu Jul 14 21:52:35 2016 From: news at mefox.org (Michael Fox) Date: Thu, 14 Jul 2016 14:52:35 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <20160714212331.5517397.85571.6763@lazygranch.com> References: <029001d1de12$262806b0$72781410$@mefox.org> <20160714212331.5517397.85571.6763@lazygranch.com> Message-ID: <02c701d1de1a$08b439c0$1a1cad40$@mefox.org> > Are you 100% sure your interpretation of the FCC rules is correct? Yes > Do you really want passwords going out over RF unencrypted? No. I don't plan to use plaintext auth methods. > As far as I know, only ham bands are not allowed to use encryption. Even > baby monitors these days are DECT. (Mind you, not good encryption.) Correct. It is ham radio. Michael From news at mefox.org Thu Jul 14 21:52:35 2016 From: news at mefox.org (Michael Fox) Date: Thu, 14 Jul 2016 14:52:35 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <57880386.7060200@dovecot.fi> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <57880386.7060200@dovecot.fi> Message-ID: <02c801d1de1a$09087440$1b195cc0$@mefox.org> > > You could try > > remote x.x.x.x/y { > ssl = no > } > > Aki Wow. OK. But I can find no documentation on how to use that. Would it be used inside service pop3-login, or at the top level? And, does it apply the first match found? For example: # Disable SSL for radio clients remote 192.168.1.0/24 { ssl = no } # Allow SSL for internal clients remote 192.168.0.0/16 { ssl = yes } # Require SSL for all others remote 0.0.0.0/0 { ssl = required } Thanks, Michael From aki.tuomi at dovecot.fi Thu Jul 14 21:53:58 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Fri, 15 Jul 2016 00:53:58 +0300 Subject: controlling STARTTLS by IP address In-Reply-To: <02c801d1de1a$09087440$1b195cc0$@mefox.org> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <57880386.7060200@dovecot.fi> <02c801d1de1a$09087440$1b195cc0$@mefox.org> Message-ID: <578809F6.5050201@dovecot.fi> On 15.07.2016 00:52, Michael Fox wrote: >> You could try >> >> remote x.x.x.x/y { >> ssl = no >> } >> >> Aki > Wow. OK. But I can find no documentation on how to use that. > > Would it be used inside service pop3-login, or at the top level? > > And, does it apply the first match found? For example: > > # Disable SSL for radio clients > remote 192.168.1.0/24 { > ssl = no > } > # Allow SSL for internal clients > remote 192.168.0.0/16 { > ssl = yes > } > # Require SSL for all others > remote 0.0.0.0/0 { > ssl = required > } > > Thanks, > Michael You can leave the last bit off. Not sure about the ordering, but you'll find out by testing? =) Aki From news at mefox.org Thu Jul 14 22:23:39 2016 From: news at mefox.org (Michael Fox) Date: Thu, 14 Jul 2016 15:23:39 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <57880386.7060200@dovecot.fi> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <57880386.7060200@dovecot.fi> Message-ID: <02d701d1de1e$5feb3410$1fc19c30$@mefox.org> > You could try > > remote x.x.x.x/y { > ssl = no > } > > Aki That works! Thanks SO much! Michael From jtam.home at gmail.com Thu Jul 14 22:35:04 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 14 Jul 2016 15:35:04 -0700 (PDT) Subject: "Error: nfs_flush_file_handle_cache_dir: rmdir(/inboxes)" log spikes In-Reply-To: References: Message-ID: Aki Tuomi wrote: > On 14.07.2016 21:26, Joseph Tam wrote: >> >> I received a bunch of these log messages at a rate of a few thousand >> per hour for one of my users -- she may have max'd out her quota. The >> directory is a NFS directory containing mbox formatted INBOX's. >> >> Other than alleviating the space crunch, is there any particular >> action I need to take? > > Are we talking about dovecot quota or some filesystem quota? Filesystem quota. Joseph Tam From dovecot at r.paypc.com Thu Jul 14 23:07:53 2016 From: dovecot at r.paypc.com (M. Balridge) Date: Thu, 14 Jul 2016 16:07:53 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <02c601d1de1a$086fddc0$194f9940$@mefox.org> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <02c601d1de1a$086fddc0$194f9940$@mefox.org> Message-ID: <1468537673.57881b49d5c147.73540111@www.paypc.com> Quoting Michael Fox : > > Seems like your firewall could redirect to a different port that doesn't > > offer starttls. > > Yes, of course. But that would require multiple ports, making the client > configuration cumbersome and error-prone. It looks like there's an internal Dovecot solution, so all's well. I just thought to remind people that with some firewalls, there's always a way to perform "silent" redirections using the DNAT target in the PREROUTING table, i.e.,: -t nat -A PREROUTING -i ${EXTIF} -s ${NOTLSSOURCES} -p tcp --dport 110 \ --syn -j DNAT --to-destination ${DOVECOT}:${NOTLSPOP3PORT} If you're using a Linux iptables firewall, you wouldn't need to expose the different port to the client, but would make use of the NAT subsystem to redirect the connection from certain IP#s->POP3 to the service port where you've denied TLS. No client would need to be made aware of the "secret" ${NOTLSPOP3PORT}, and in fact, the firewall would continue to DROP packets sent to it from elsewhere if you have a default-deny policy in effect. =R= From edgar at pettijohn-web.com Thu Jul 14 23:44:21 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Thu, 14 Jul 2016 18:44:21 -0500 Subject: controlling STARTTLS by IP address In-Reply-To: <1468537673.57881b49d5c147.73540111@www.paypc.com> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <02c601d1de1a$086fddc0$194f9940$@mefox.org> <1468537673.57881b49d5c147.73540111@www.paypc.com> Message-ID: <20160714234421.GA17750@thinkpad.my.domain> On 16-07-14 16:07:53, M. Balridge wrote: > Quoting Michael Fox : > > > > Seems like your firewall could redirect to a different port that doesn't > > > offer starttls. > > > > Yes, of course. But that would require multiple ports, making the client > > configuration cumbersome and error-prone. > > It looks like there's an internal Dovecot solution, so all's well. > > I just thought to remind people that with some firewalls, there's always a way > to perform "silent" redirections using the DNAT target in the PREROUTING > table, i.e.,: > > -t nat -A PREROUTING -i ${EXTIF} -s ${NOTLSSOURCES} -p tcp --dport 110 \ > --syn -j DNAT --to-destination ${DOVECOT}:${NOTLSPOP3PORT} > That is basically what I meant without enough detail I guess. > If you're using a Linux iptables firewall, you wouldn't need to expose the > different port to the client, but would make use of the NAT subsystem to > redirect the connection from certain IP#s->POP3 to the service port where > you've denied TLS. > > No client would need to be made aware of the "secret" ${NOTLSPOP3PORT}, and in > fact, the firewall would continue to DROP packets sent to it from elsewhere if > you have a default-deny policy in effect. > > =R= -- Edgar Pettijohn From lists at lazygranch.com Thu Jul 14 23:44:22 2016 From: lists at lazygranch.com (lists at lazygranch.com) Date: Thu, 14 Jul 2016 16:44:22 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <02c701d1de1a$08b439c0$1a1cad40$@mefox.org> References: <029001d1de12$262806b0$72781410$@mefox.org> <20160714212331.5517397.85571.6763@lazygranch.com> <02c701d1de1a$08b439c0$1a1cad40$@mefox.org> Message-ID: <20160714234422.5517397.73338.6777@lazygranch.com> I'm not a FCC lawyer, just a ham. Seems to me all you could do is "sign" messages and not send them if the sign isn't correct. ?The package itself is in plain text.? Anyway, I'll leave the thread but would like to hear about the final solution. ? Original Message ? From: Michael Fox Sent: Thursday, July 14, 2016 2:54 PM To: 'Dovecot Mailing List' Subject: RE: controlling STARTTLS by IP address > Are you 100% sure your interpretation of the FCC rules is correct? Yes > Do you really want passwords going out over RF unencrypted? No. I don't plan to use plaintext auth methods. > As far as I know, only ham bands are not allowed to use encryption. Even > baby monitors these days are DECT. (Mind you, not good encryption.) Correct. It is ham radio. Michael From news at mefox.org Fri Jul 15 06:52:16 2016 From: news at mefox.org (Michael Fox) Date: Thu, 14 Jul 2016 23:52:16 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <20160714234421.GA17750@thinkpad.my.domain> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <02c601d1de1a$086fddc0$194f9940$@mefox.org> <1468537673.57881b49d5c147.73540111@www.paypc.com> <20160714234421.GA17750@thinkpad.my.domain> Message-ID: <32e501d1de65$6d5f2470$481d6d50$@mefox.org> > > I just thought to remind people that with some firewalls, there's always > a way > > to perform "silent" redirections using the DNAT target in the PREROUTING > > table, i.e.,: > > > > -t nat -A PREROUTING -i ${EXTIF} -s ${NOTLSSOURCES} -p tcp --dport 110 \ > > --syn -j DNAT --to-destination ${DOVECOT}:${NOTLSPOP3PORT} > > > > That is basically what I meant without enough detail I guess. > Yes. Good point. And thanks for the clarification. As a Dovecot newbie, I'm curious. What would be the syntax in dovecot to configure a second pop3 listener? Would it something like this? service pop3-login { # POP3 for STARTTLS users inet_listener pop3 { port = 110 ssl = yes } # POP3 for no TLS inet_listener pop3 { port = xxx ssl = no } # POP3 for inet_listener pop3s { port = 993 ssl = required } And shouldn't "inet_listener pop3s" really use ssl=required (as above), instead of ssl=yes (as shown in the default 10-master.conf file)? Thanks, Michael From listeem at ksb.id.lv Fri Jul 15 06:57:26 2016 From: listeem at ksb.id.lv (KSB) Date: Fri, 15 Jul 2016 09:57:26 +0300 Subject: controlling STARTTLS by IP address In-Reply-To: <1468537673.57881b49d5c147.73540111@www.paypc.com> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <02c601d1de1a$086fddc0$194f9940$@mefox.org> <1468537673.57881b49d5c147.73540111@www.paypc.com> Message-ID: <1176c5ff-f7c4-9c38-69e5-690237454fe6@ksb.id.lv> On 2016.07.15. 2:07, M. Balridge wrote: > > I just thought to remind people that with some firewalls, there's always a way > to perform "silent" redirections using the DNAT target in the PREROUTING > table, i.e.,: > > -t nat -A PREROUTING -i ${EXTIF} -s ${NOTLSSOURCES} -p tcp --dport 110 \ > --syn -j DNAT --to-destination ${DOVECOT}:${NOTLSPOP3PORT} > > If you're using a Linux iptables firewall, you wouldn't need to expose the > different port to the client, but would make use of the NAT subsystem to > redirect the connection from certain IP#s->POP3 to the service port where > you've denied TLS. > > No client would need to be made aware of the "secret" ${NOTLSPOP3PORT}, and in > fact, the firewall would continue to DROP packets sent to it from elsewhere if > you have a default-deny policy in effect. > > =R= > If you're just changing port, better use REDIRECT target. -- KSb From zhb at iredmail.org Fri Jul 15 07:41:51 2016 From: zhb at iredmail.org (Zhang Huangbin) Date: Fri, 15 Jul 2016 15:41:51 +0800 Subject: authentication failed: Connection lost to authentication server Message-ID: Dear all, I got error "authentication failed: Connection lost to authentication server", i turned on debug mode in Postfix/Dovecot, but this is the error i can get. All other errors point to sasl auth failure, what does "connection lost to authentication server" means? How can i exactly know what the problem is and how to fix it? Here's my Dovecot/Postfix configuration, with Active Directory integration. - dovecot.conf: http://pastebin.com/7T05kvmH - dovecot-ldap.conf: http://pastebin.com/DtkAg01v - Postfix main.cf: http://pastebin.com/Z9Wihmvr Dovecot/Postfix and AD are running in the same network (192.168.10.X), no firewall between them. Thanks for your help. :) From Jochen.Bern at LINworks.de Fri Jul 15 07:45:58 2016 From: Jochen.Bern at LINworks.de (Jochen Bern) Date: Fri, 15 Jul 2016 09:45:58 +0200 Subject: controlling STARTTLS by IP address In-Reply-To: <02c601d1de1a$086fddc0$194f9940$@mefox.org> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <02c601d1de1a$086fddc0$194f9940$@mefox.org> Message-ID: <578894B6.60602@LINworks.de> On 07/14/2016 11:52 PM, Michael Fox wrote: >> Seems like your firewall could redirect to a different port that doesn't >> offer starttls. > Yes, of course. But that would require multiple ports, making the client > configuration cumbersome and error-prone. No, the multiple ports would be on the *server* side, and "the firewall" (which could be iptables on the server itself) would DNAT the ever-same *client* side ports based on the clients' IPs. Speaking of simplifying client configuration: Please note that STARTTLS and "must be plaintext" aren't mutually exclusive: $ openssl ciphers 'NULL:eNULL:!ECDH:!DH' NULL-SHA256:NULL-SHA:NULL-MD5 https://www.openssl.org/docs/manmaster/apps/ciphers.html#EXAMPLES If you can get dovecot to use a different "ssl_cipher_list" per client subnet, instead of changing "ssl", you could keep all clients that support those ciphers configured so as to *require* STARTTLS. Regards, Jochen Bern Systemingenieur -- LINworks GmbH Fon: +49 6151 9067-231 Fax: +49 6151 9067-299 E-Mail: Jochen.Bern at LINworks.de Web: http://www.LINworks.de/ NEC IT Infrastrukturprodukte vom Deutschland Distributor Server, Storage, Virtualisierung, Management Software Shop: http://www.NEC-Store.de/ Briefanschrift: Postfach 10 01 21 ? 64201 Darmstadt ? DE Hausanschrift: Robert-Koch-Stra?e 9 ? 64331 Weiterstadt ? DE Gesch?ftsf?hrer: Metin Dogan, Nils Manegold, Oliver Michel Unternehmenssitz: Weiterstadt Register: Amtsgericht Darmstadt, HRB 85202 MAX21-Unternehmensgruppe -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 1850 bytes Desc: S/MIME Cryptographic Signature URL: From news at mefox.org Fri Jul 15 08:03:16 2016 From: news at mefox.org (Michael Fox) Date: Fri, 15 Jul 2016 01:03:16 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <20160714234422.5517397.73338.6777@lazygranch.com> References: <029001d1de12$262806b0$72781410$@mefox.org> <20160714212331.5517397.85571.6763@lazygranch.com> <02c701d1de1a$08b439c0$1a1cad40$@mefox.org> <20160714234422.5517397.73338.6777@lazygranch.com> Message-ID: <337e01d1de6f$584db9c0$08e92d40$@mefox.org> > I'm not a FCC lawyer, just a ham. Seems to me all you could do is "sign" > messages and not send them if the sign isn't correct. ?The package itself > is in plain text. I'm not sure what the confusion or concern is. The intention is to use non-plaintext (but technically not encrypted) authentication without TLS over ham frequencies. Hashed challenge/response auth methods don't violate the FCC rules. Of course, without TLS encryption, the auth process is not totally secure. And, yes, the message itself would be in plain text. But it's the best we can do given the rules. Think of it as packet radio on steroids. 73, Michael N6MEF From news at mefox.org Fri Jul 15 08:13:41 2016 From: news at mefox.org (Michael Fox) Date: Fri, 15 Jul 2016 01:13:41 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <578894B6.60602@LINworks.de> References: <029001d1de12$262806b0$72781410$@mefox.org> <6875ADB5-9622-40D8-9DB9-CB2429D9C204@pettijohn-web.com> <02c601d1de1a$086fddc0$194f9940$@mefox.org> <578894B6.60602@LINworks.de> Message-ID: <338001d1de70$cce57bf0$66b073d0$@mefox.org> > -----Original Message----- > From: dovecot [mailto:dovecot-bounces at dovecot.org] On Behalf Of Jochen > Bern > Sent: Friday, July 15, 2016 12:46 AM > To: dovecot at dovecot.org > Subject: Re: RE: controlling STARTTLS by IP address > > On 07/14/2016 11:52 PM, Michael Fox wrote: > >> Seems like your firewall could redirect to a different port that > doesn't > >> offer starttls. > > Yes, of course. But that would require multiple ports, making the > client > > configuration cumbersome and error-prone. > > No, the multiple ports would be on the *server* side, and "the firewall" > (which could be iptables on the server itself) would DNAT the ever-same > *client* side ports based on the clients' IPs. > > Speaking of simplifying client configuration: Please note that STARTTLS > and "must be plaintext" aren't mutually exclusive: > > $ openssl ciphers 'NULL:eNULL:!ECDH:!DH' > NULL-SHA256:NULL-SHA:NULL-MD5 > > https://www.openssl.org/docs/manmaster/apps/ciphers.html#EXAMPLES > > If you can get dovecot to use a different "ssl_cipher_list" per client > subnet, instead of changing "ssl", you could keep all clients that > support those ciphers configured so as to *require* STARTTLS. > > Regards, > > Jochen Bern > Systemingenieur Hmmm. Interesting. I hadn't thought along those lines. Something to investigate. Michael From news at mefox.org Fri Jul 15 08:22:06 2016 From: news at mefox.org (Michael Fox) Date: Fri, 15 Jul 2016 01:22:06 -0700 Subject: postconf -n display error for "remote"? Message-ID: <338301d1de71$fa0e0ab0$ee2a2010$@mefox.org> Is this a bug? I configured the following: remote 192.168.7.128/27 { ssl = no } remote 192.168.7.0/24 { ssl = yes } But, when I run doveconf -n, I see: remote 192.168.7.0/24/24 { ssl = yes } remote 192.168.7.128/27/27 { ssl = no } Note the repeated network prefix length (/27/27 and /24/24). Is there a way to tell for sure whether this is just a cosmetic issue or something that could cause a problem? Michael From listeem at ksb.id.lv Fri Jul 15 09:15:03 2016 From: listeem at ksb.id.lv (KSB) Date: Fri, 15 Jul 2016 12:15:03 +0300 Subject: controlling STARTTLS by IP address In-Reply-To: <337e01d1de6f$584db9c0$08e92d40$@mefox.org> References: <029001d1de12$262806b0$72781410$@mefox.org> <20160714212331.5517397.85571.6763@lazygranch.com> <02c701d1de1a$08b439c0$1a1cad40$@mefox.org> <20160714234422.5517397.73338.6777@lazygranch.com> <337e01d1de6f$584db9c0$08e92d40$@mefox.org> Message-ID: <52e53161-0470-7474-a03c-cbbf2edebbc6@ksb.id.lv> On 2016.07.15. 11:03, Michael Fox wrote: >> I'm not a FCC lawyer, just a ham. Seems to me all you could do is "sign" >> messages and not send them if the sign isn't correct. The package itself >> is in plain text. > > I'm not sure what the confusion or concern is. The intention is to use > non-plaintext (but technically not encrypted) authentication without TLS > over ham frequencies. Hashed challenge/response auth methods don't violate > the FCC rules. Of course, without TLS encryption, the auth process is not > totally secure. And, yes, the message itself would be in plain text. But > it's the best we can do given the rules. Think of it as packet radio on > steroids. > > 73, > Michael > N6MEF > Just curious, it is transferred in some RSxxx serial protocol? -- KSB From laszlo at karolyi.hu Tue Jul 12 13:30:38 2016 From: laszlo at karolyi.hu (=?utf-8?Q?L=C3=A1szl=C3=B3_K=C3=A1rolyi?=) Date: Tue, 12 Jul 2016 15:30:38 +0200 Subject: Doveadm error Message-ID: Hey everyone, I've got a weird error since I upgraded to the latest dovecot on my FreeBSD box: root at postfixjail /# doveadm quota recalc -u xxx at xxx.com doveadm(xxx at xxx.com): Error: dict-client: Commit failed: Deinit fish: 'doveadm quota recalc -u xxx@?' terminated by signal SIGSEGV (Address boundary error) root at postfixjail /# dovecot --version 2.2.25 (7be1766) root at postfixjail /# dovecot -n # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: FreeBSD 10.3-STABLE amd64 auth_cache_negative_ttl = 0 auth_cache_ttl = 0 auth_mechanisms = plain login cram-md5 digest-md5 auth_realms = flix.hu base_dir = /usr/local/var/run/dovecot/ default_login_user = nobody dict { quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext quota_rule2 = Trash:bytes=+100M } listen = * login_trusted_networks = 127.0.0.0/24 mail_location = mdbox:~/mdbox mail_plugins = quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.pipe mdbox_rotate_size = 20 M namespace { inbox = yes location = prefix = separator = . } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quota sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /usr/local/etc/email-responder sieve_plugins = sieve_extprograms } postmaster_address = postmaster at flix.hu protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } } service dict { unix_listener dict { mode = 0600 user = vmail } } service imap-login { process_min_avail = 3 service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 2 service_count = 1 } service managesieve { process_limit = 1024 process_min_avail = 2 } service pop3-login { process_min_avail = 3 service_count = 1 } ssl = required ssl_cert = From aki.tuomi at dovecot.fi Fri Jul 15 14:03:15 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Fri, 15 Jul 2016 17:03:15 +0300 (EEST) Subject: Doveadm error In-Reply-To: References: Message-ID: <1974283857.141.1468591395901@appsuite-dev.open-xchange.com> > On July 12, 2016 at 4:30 PM L?szl? K?rolyi wrote: > > > Hey everyone, > > I've got a weird error since I upgraded to the latest dovecot on my FreeBSD box: > > root at postfixjail /# doveadm quota recalc -u xxx at xxx.com > doveadm(xxx at xxx.com): Error: dict-client: Commit failed: Deinit > fish: 'doveadm quota recalc -u xxx@?' terminated by signal SIGSEGV (Address boundary error) > root at postfixjail /# dovecot --version > 2.2.25 (7be1766) > root at postfixjail /# dovecot -n > # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.15 (97b3da0) > # OS: FreeBSD 10.3-STABLE amd64 > auth_cache_negative_ttl = 0 > auth_cache_ttl = 0 > auth_mechanisms = plain login cram-md5 digest-md5 > auth_realms = flix.hu > base_dir = /usr/local/var/run/dovecot/ > default_login_user = nobody > dict { > quota = mysql:/usr/local/etc/dovecot/dovecot-dict-sql.conf.ext > quota_rule2 = Trash:bytes=+100M > } > listen = * > login_trusted_networks = 127.0.0.0/24 > mail_location = mdbox:~/mdbox > mail_plugins = quota > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.pipe > mdbox_rotate_size = 20 M > namespace { > inbox = yes > location = > prefix = > separator = . > } > passdb { > args = /usr/local/etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > quota = dict:User quota::proxy::quota > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > sieve_extensions = +vnd.dovecot.pipe > sieve_pipe_bin_dir = /usr/local/etc/email-responder > sieve_plugins = sieve_extprograms > } > postmaster_address = postmaster at flix.hu > protocols = imap pop3 lmtp sieve > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = vmail > mode = 0600 > user = vmail > } > } > service dict { > unix_listener dict { > mode = 0600 > user = vmail > } > } > service imap-login { > process_min_avail = 3 > service_count = 1 > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > process_min_avail = 2 > service_count = 1 > } > service managesieve { > process_limit = 1024 > process_min_avail = 2 > } > service pop3-login { > process_min_avail = 3 > service_count = 1 > } > ssl = required > ssl_cert = ssl_key = userdb { > driver = prefetch > } > userdb { > args = /usr/local/etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > protocol lda { > mail_plugins = quota sieve > } > protocol lmtp { > mail_plugins = quota sieve > } > protocol sieve { > mail_plugins = quota sieve > managesieve_max_line_length = 65536 > } > protocol imap { > mail_max_userip_connections = 20 > mail_plugins = quota imap_quota > } > protocol pop3 { > mail_max_userip_connections = 15 > mail_plugins = quota > } > root at postfixjail /# uname -a > FreeBSD postfixjail.xxx.com 10.3-STABLE FreeBSD 10.3-STABLE #19 r302639: Tue Jul 12 13:54:21 CEST 2016 root at flix.hu:/usr/obj/usr/src/sys/MYKERNEL amd64 > > There seems no difference of which virtual mailbox I want dovecot to quota recalculate, it always fails with this error message. > > Any suggestions? > > Cheers, > -- > L?szl? K?rolyi > http://linkedin.com/in/karolyi Hi This bug is being fixed. Aki From news at mefox.org Fri Jul 15 17:24:21 2016 From: news at mefox.org (Michael Fox) Date: Fri, 15 Jul 2016 10:24:21 -0700 Subject: controlling STARTTLS by IP address In-Reply-To: <52e53161-0470-7474-a03c-cbbf2edebbc6@ksb.id.lv> References: <029001d1de12$262806b0$72781410$@mefox.org> <20160714212331.5517397.85571.6763@lazygranch.com> <02c701d1de1a$08b439c0$1a1cad40$@mefox.org> <20160714234422.5517397.73338.6777@lazygranch.com> <337e01d1de6f$584db9c0$08e92d40$@mefox.org> <52e53161-0470-7474-a03c-cbbf2edebbc6@ksb.id.lv> Message-ID: <027901d1debd$ba7d3cd0$2f77b670$@mefox.org> KSB: > Just curious, it is transferred in some RSxxx serial protocol? The expectation is that the unencrypted traffic will be used for clients on an Ethernet network behind a radio operating on amateur radio frequencies according to FCC Part 97 rules. The radio could be: -- 56+kbps UHF, such as the upcoming UDRX-440 by NW Digital Radio -- WiFi radio using BBHN or AREDN mesh software -- WiFi radio using commercial software, but operated under FCC Part 97 (amateur radio) rules, instead of Part 15 (commercial/consumer) rules -- ... or maybe something else It won't be the bulk of our traffic, but it is important since it is part of the county's emergency communications plan. I don't want to hijack this list with amateur radio stuff. Curious hams can contact me off list at n6mef at mefox dot org. Michael From news at mefox.org Fri Jul 15 19:23:37 2016 From: news at mefox.org (Michael Fox) Date: Fri, 15 Jul 2016 12:23:37 -0700 Subject: doveconf -n display error for "remote" Message-ID: <032901d1dece$63a015c0$2ae04140$@mefox.org> Upon further testing, it seems that the issue below may only be a display bug in doveconf. In other words, the remote filter appears to work as configured, even though it is displayed with duplicate prefix length by doveconf. Is this sufficient information to report a bug or is there some other protocol? Michael ------------------------------------------- Dovecot --version: 2.2.9 I configured the following in local.conf: remote 192.168.7.128/27 { ssl = no } remote 192.168.7.0/24 { ssl = yes } But, when I run doveconf -n, I see: remote 192.168.7.0/24/24 { ssl = yes } remote 192.168.7.128/27/27 { ssl = no } Note the repeated network prefix length (/27/27 and /24/24). From mfoley at ohprs.org Sat Jul 16 05:43:35 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sat, 16 Jul 2016 01:43:35 -0400 Subject: Moving Maildir folders Message-ID: <201607160543.u6G5hZSL024243@mail.hprs.local> Our office had a user leave. Another user is taking over her duties and needs reference to the departing user's email. I've copied that entire departed user's Maildir structure to the current user: mv olduser/Maildir/.* curuser/Maildir/.olduser I did change permission and ownership on curuser/Maildir/.olduser to be the target user. I did not bring over the olduser/Maildir/dovecot* files (indexes, subscriptions, etc.) as I thought that would be bad. Nevertheless, the curuser cannot see this new olduser folder (which should be at the same level as Inbox, Junk Mail, etc.). I did manually add olduser to the curuser/Maildir/subscriptions file, but still nothing. So, what did I do wrong and how do I fix it? THX -- Mark From lists at luigirosa.com Sat Jul 16 06:53:27 2016 From: lists at luigirosa.com (Luigi Rosa) Date: Sat, 16 Jul 2016 08:53:27 +0200 Subject: Moving Maildir folders In-Reply-To: <201607160543.u6G5hZSL024243@mail.hprs.local> References: <201607160543.u6G5hZSL024243@mail.hprs.local> Message-ID: <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> Mark Foley wrote on 16/07/2016 07:43: > Our office had a user leave. Another user is taking over her duties and needs reference to the > departing user's email. I've copied that entire departed user's Maildir structure to the current > user: > > mv olduser/Maildir/.* curuser/Maildir/.olduser > > I did change permission and ownership on curuser/Maildir/.olduser to be the target user. I did > not bring over the olduser/Maildir/dovecot* files (indexes, subscriptions, etc.) as I thought > that would be bad. Maildir has no nested folders. If you want a subtree structure in maildir you must create each folder at the first level in the new user you must have something like: .olduser.INBOX .olduser.Sent .olduser.Trash .olduser.Drafts .olduser.whatever Each directory with tmp, newm cur subdirs only (ad dovecot files, of course) -- Ciao, luigi / +--[Luigi Rosa]-- \ Understanding is a three-edged sword. --Kosh, "Deathwalker" From stsiol at yahoo.co.uk Sat Jul 16 08:02:33 2016 From: stsiol at yahoo.co.uk (Spyros Tsiolis) Date: Sat, 16 Jul 2016 08:02:33 +0000 (UTC) Subject: an e-mail client for dovecot ? References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> Message-ID: <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> Hello all, For some years now, I've been using Thunderbird for dovecot. I am not very satisfied with t/b so I thought of using m/s outlook but then I thought that I want to distance my clients from office products. I have a newly created dovecot installation on a very small site. Three nodes, all x86 Windows 7 professional with an ubuntu v14.04 server (x86 again) running dovecot 1.2.17. The clients there use dovecot as an imap server, so they have a real-world e-mail account each and whatever they want to keep , they store by gradding-and-dropping to the imap (local / archive) account. Since I have quite some experiece with thunderbird, I know most of its shortcomings; So I thought if there's an alternative (better?) imap mail client for x86 windows 7 systems than t/b. Even better if there's an alternative client that is also supporeted under linux . Any ideas are welcome, TIA, s.t. From geek at uniserve.com Sat Jul 16 14:27:15 2016 From: geek at uniserve.com (Dave Stevens) Date: Sat, 16 Jul 2016 07:27:15 -0700 Subject: an e-mail client for dovecot ? In-Reply-To: <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> Message-ID: <20160716072715.30a5dcad@user-Satellite-A100> On Sat, 16 Jul 2016 08:02:33 +0000 (UTC) Spyros Tsiolis wrote: > Hello all, > > For some years now, I've been using Thunderbird for dovecot. > I am not very satisfied with t/b so I thought of using m/s outlook > but then I thought that I want to distance my clients from office > products. > > I have a newly created dovecot installation on a very small site. > Three nodes, all x86 Windows 7 professional with an ubuntu v14.04 > server (x86 again) running dovecot 1.2.17. > > The clients there use dovecot as an imap server, so they have a > real-world e-mail account each and whatever they want to keep , they > store by gradding-and-dropping to the imap (local / archive) account. > > Since I have quite some experiece with thunderbird, I know most of > its shortcomings; So I thought if there's an alternative (better?) > imap mail client for x86 windows 7 systems than t/b. > > Even better if there's an alternative client that is also supporeted > under linux . > > Any ideas are welcome, > > TIA, > > s.t. I use Claws and like it a lot. Has plugins for extensions, very fast to work with. Dave -- Reporter to Mahatma Ghandi after his tour of east London "What do you think of western civilization, Mr. Ghandi?" Ghandi - "I think it would be an excellent idea!" From tanstaafl at libertytrek.org Sat Jul 16 16:12:42 2016 From: tanstaafl at libertytrek.org (Charles Marcus) Date: Sat, 16 Jul 2016 12:12:42 -0400 Subject: an e-mail client for dovecot ? In-Reply-To: <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> Message-ID: On July 16, 2016 4:02:33 AM EDT, Spyros Tsiolis wrote: >Since I have quite some experiece with thunderbird, I know most of >its shortcomings Care to elaborate? Thunderbird is far from perfect, but is by far the best IMAP client available. Most times you can work around supposed short comings (if what you think are short comings actually are, often they are not)... -- Sent from my Android device with K-9 Mail. Please excuse my brevity. From mfoley at ohprs.org Sat Jul 16 17:07:39 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sat, 16 Jul 2016 13:07:39 -0400 Subject: Moving Maildir folders In-Reply-To: <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> Message-ID: <201607161707.u6GH7dFL032724@mail.hprs.local> On Sat, 16 Jul 2016 08:53:27 +0200 Luigi Rosa wrote: > > Mark Foley wrote on 16/07/2016 07:43: > > Our office had a user leave. Another user is taking over her duties and needs reference to the > > departing user's email. I've copied that entire departed user's Maildir structure to the current > > user: > > > > mv olduser/Maildir/.* curuser/Maildir/.olduser > > > > I did change permission and ownership on curuser/Maildir/.olduser to be the target user. I did > > not bring over the olduser/Maildir/dovecot* files (indexes, subscriptions, etc.) as I thought > > that would be bad. > > Maildir has no nested folders. > > If you want a subtree structure in maildir you must create each folder at the > first level > > in the new user you must have something like: > > .olduser.INBOX > .olduser.Sent > .olduser.Trash > .olduser.Drafts > .olduser.whatever > > Each directory with tmp, newm cur subdirs only (ad dovecot files, of course) > > > > -- > > > Ciao, > luigi > > / > +--[Luigi Rosa]-- > \ > > Understanding is a three-edged sword. > --Kosh, "Deathwalker" OK, I believe I've done as you suggested, but still nothing showing on the target users mail client. Here's what part of the Maildir looks like with the 1st set of folders belonging to the target user and those beginning with .bpatterson from the old user. Does this look right as you've advised? Perhaps I need to do something else? .INBOX.Travel/ .INBOX.UPS/ .INBOX.US\ Bank/ .INBOX.United\ Health\ Care-Employee/ .INBOX.VRC/ .INBOX.Website/ .INBOX.Website.Mouse\ Pad\ Insert/ .INBOX.iLink/ .Junk\ E-mail/ .Sent\ Items/ .Templates/ .bpatterson.Deleted\ Items/ .bpatterson.Drafts/ .bpatterson.INBOX.2011\ Investment\ Confirmation\ Responses/ .bpatterson.INBOX.2011\ and\ 2012\ KCR\ Audit/ .bpatterson.INBOX.2012\ Investment\ Confirmation\ Responses/ .bpatterson.INBOX.2013\ Health\ Care\ Changes\ -\ Information/ .bpatterson.INBOX.2013\ Investment\ Confirmation\ Responses/ At the top level, the target user has (in email client): Inbox Drafts Templates Sent Items Junk E-mail Deleted Items I'm expecting to see "bpatterson" appear in that list. Thanks --Mark From mfoley at ohprs.org Sat Jul 16 17:22:51 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sat, 16 Jul 2016 13:22:51 -0400 Subject: an e-mail client for dovecot ? In-Reply-To: <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> Message-ID: <201607161722.u6GHMpPG026198@mail.hprs.local> Wow! That's interesting. Our office of 10+ Windows 7 *and* Ubuntu workstations have been moving from Outlook to Thunderbird over the past year. Our users find it WAY BETTER than Outlook. Have you actually tried Outlook 2013 and later? The suckiness of 2013 was what drove us to look elsewere in the first place. We tried a number of clients including Evolution and emClient and Tbird proved the best in my testing. Thunderbird runs on both Windows and Ubuntu, can do AD authentication and basically has all the features of Outlook including color categories which our director could not live without; and can be configured to have a very similar look-and-feel as Outlook. In over a year of running Thunderbird (currently at 38.8.0 Ubuntu, 45.2.0 Window) it has performed flawlessly. I concur with Charles Marcus' query: can you elaborate on how Thunderbird is failing for you? --Mark -----Original Message----- > Date: Sat, 16 Jul 2016 08:02:33 +0000 (UTC) > From: Spyros Tsiolis > To: Dovecot > Subject: an e-mail client for dovecot ? > > Hello all, > > For some years now, I've been using Thunderbird for dovecot. > I am not very satisfied with t/b so I thought of using m/s outlook > but then I thought that I want to distance my clients from office > products. > > I have a newly created dovecot installation on a very small site. > Three nodes, all x86 Windows 7 professional with an ubuntu v14.04 > server (x86 again) running dovecot 1.2.17. > > The clients there use dovecot as an imap server, so they have a > real-world e-mail account each and whatever they want to keep , they > store by gradding-and-dropping to the imap (local / archive) account. > > Since I have quite some experiece with thunderbird, I know most of > its shortcomings; So I thought if there's an alternative (better?) > imap mail client for x86 windows 7 systems than t/b. > > Even better if there's an alternative client that is also supporeted under > linux . > > Any ideas are welcome, > > TIA, > > s.t. > From f-u.s at gmx.net Sat Jul 16 18:41:10 2016 From: f-u.s at gmx.net (Frank-Ulrich Sommer) Date: Sat, 16 Jul 2016 20:41:10 +0200 Subject: Moving Maildir folders In-Reply-To: <201607161707.u6GH7dFL032724@mail.hprs.local> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> Message-ID: <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> How did you verify that dovecot doesn't show these folders? Couldn't this be a client problem? In Thunderbird e.g. it might be necessary to update the list of displayed folders. Am 16. Juli 2016 19:07:39 MESZ, schrieb Mark Foley : >On Sat, 16 Jul 2016 08:53:27 +0200 Luigi Rosa >wrote: >> >> Mark Foley wrote on 16/07/2016 07:43: >> > Our office had a user leave. Another user is taking over her >duties and needs reference to the >> > departing user's email. I've copied that entire departed user's >Maildir structure to the current >> > user: >> > >> > mv olduser/Maildir/.* curuser/Maildir/.olduser >> > >> > I did change permission and ownership on curuser/Maildir/.olduser >to be the target user. I did >> > not bring over the olduser/Maildir/dovecot* files (indexes, >subscriptions, etc.) as I thought >> > that would be bad. >> >> Maildir has no nested folders. >> >> If you want a subtree structure in maildir you must create each >folder at the >> first level >> >> in the new user you must have something like: >> >> .olduser.INBOX >> .olduser.Sent >> .olduser.Trash >> .olduser.Drafts >> .olduser.whatever >> >> Each directory with tmp, newm cur subdirs only (ad dovecot files, of >course) >> >> >> >> -- >> >> >> Ciao, >> luigi >> >> / >> +--[Luigi Rosa]-- >> \ >> >> Understanding is a three-edged sword. >> --Kosh, "Deathwalker" > >OK, I believe I've done as you suggested, but still nothing showing on >the target users mail >client. Here's what part of the Maildir looks like with the 1st set of >folders belonging to the >target user and those beginning with .bpatterson from the old user. >Does this look right as >you've advised? Perhaps I need to do something else? > >.INBOX.Travel/ >.INBOX.UPS/ >.INBOX.US\ Bank/ >.INBOX.United\ Health\ Care-Employee/ >.INBOX.VRC/ >.INBOX.Website/ >.INBOX.Website.Mouse\ Pad\ Insert/ >.INBOX.iLink/ >.Junk\ E-mail/ >.Sent\ Items/ >.Templates/ >.bpatterson.Deleted\ Items/ >.bpatterson.Drafts/ >.bpatterson.INBOX.2011\ Investment\ Confirmation\ Responses/ >.bpatterson.INBOX.2011\ and\ 2012\ KCR\ Audit/ >.bpatterson.INBOX.2012\ Investment\ Confirmation\ Responses/ >.bpatterson.INBOX.2013\ Health\ Care\ Changes\ -\ Information/ >.bpatterson.INBOX.2013\ Investment\ Confirmation\ Responses/ > >At the top level, the target user has (in email client): > >Inbox >Drafts >Templates >Sent Items >Junk E-mail >Deleted Items > >I'm expecting to see "bpatterson" appear in that list. > >Thanks --Mark -- Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet. From mfoley at ohprs.org Sat Jul 16 19:05:33 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sat, 16 Jul 2016 15:05:33 -0400 Subject: Moving Maildir folders In-Reply-To: <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> Message-ID: <201607161905.u6GJ5XZ2030407@mail.hprs.local> Hey!! It is now showing the former users' folders at the top level of the current user. Great! Perhaps dovecot just needed time to "index" the new messages? Anyway, Luigi's suggestion on moving and renaming the folders apparently worked. Thanks!!!! --Mark -----Original Message----- > Subject: Re: Moving Maildir folders > From: Frank-Ulrich Sommer > Date: Sat, 16 Jul 2016 20:41:10 +0200 > To: dovecot at dovecot.org > How did you verify that dovecot doesn't show these folders? Couldn't this be a client problem? In Thunderbird e.g. it might be necessary to update the list of displayed folders. > > Am 16. Juli 2016 19:07:39 MESZ, schrieb Mark Foley : > >On Sat, 16 Jul 2016 08:53:27 +0200 Luigi Rosa > >wrote: > >> > >> Mark Foley wrote on 16/07/2016 07:43: > >> > Our office had a user leave. Another user is taking over her > >duties and needs reference to the > >> > departing user's email. I've copied that entire departed user's > >Maildir structure to the current > >> > user: > >> > > >> > mv olduser/Maildir/.* curuser/Maildir/.olduser > >> > > >> > I did change permission and ownership on curuser/Maildir/.olduser > >to be the target user. I did > >> > not bring over the olduser/Maildir/dovecot* files (indexes, > >subscriptions, etc.) as I thought > >> > that would be bad. > >> > >> Maildir has no nested folders. > >> > >> If you want a subtree structure in maildir you must create each > >folder at the > >> first level > >> > >> in the new user you must have something like: > >> > >> .olduser.INBOX > >> .olduser.Sent > >> .olduser.Trash > >> .olduser.Drafts > >> .olduser.whatever > >> > >> Each directory with tmp, newm cur subdirs only (ad dovecot files, of > >course) > >> > >> > >> > >> -- > >> > >> > >> Ciao, > >> luigi > >> > >> / > >> +--[Luigi Rosa]-- > >> \ > >> > >> Understanding is a three-edged sword. > >> --Kosh, "Deathwalker" > > > >OK, I believe I've done as you suggested, but still nothing showing on > >the target users mail > >client. Here's what part of the Maildir looks like with the 1st set of > >folders belonging to the > >target user and those beginning with .bpatterson from the old user. > >Does this look right as > >you've advised? Perhaps I need to do something else? > > > >.INBOX.Travel/ > >.INBOX.UPS/ > >.INBOX.US\ Bank/ > >.INBOX.United\ Health\ Care-Employee/ > >.INBOX.VRC/ > >.INBOX.Website/ > >.INBOX.Website.Mouse\ Pad\ Insert/ > >.INBOX.iLink/ > >.Junk\ E-mail/ > >.Sent\ Items/ > >.Templates/ > >.bpatterson.Deleted\ Items/ > >.bpatterson.Drafts/ > >.bpatterson.INBOX.2011\ Investment\ Confirmation\ Responses/ > >.bpatterson.INBOX.2011\ and\ 2012\ KCR\ Audit/ > >.bpatterson.INBOX.2012\ Investment\ Confirmation\ Responses/ > >.bpatterson.INBOX.2013\ Health\ Care\ Changes\ -\ Information/ > >.bpatterson.INBOX.2013\ Investment\ Confirmation\ Responses/ > > > >At the top level, the target user has (in email client): > > > >Inbox > >Drafts > >Templates > >Sent Items > >Junk E-mail > >Deleted Items > > > >I'm expecting to see "bpatterson" appear in that list. > > > >Thanks --Mark > > -- > Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet. > From shiva at sewingwitch.com Sat Jul 16 23:52:08 2016 From: shiva at sewingwitch.com (Kenneth Porter) Date: Sat, 16 Jul 2016 16:52:08 -0700 Subject: an e-mail client for dovecot ? In-Reply-To: <201607161722.u6GHMpPG026198@mail.hprs.local> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> <201607161722.u6GHMpPG026198@mail.hprs.local> Message-ID: On 7/16/2016 10:22 AM, Mark Foley wrote: > I concur with Charles Marcus' query: can you elaborate on how Thunderbird is failing for you? I run Thunderbird and Mulberry side-by-side, as there are features in Mulberry I don't want to give up, even though it's old and buggy. I've noticed that Mulberry finds folders in my huge hierarchy (100's of folders) that Tbird misses. Notably my SpamAssassin folder, and it's consistent across several accounts I monitor. Both programs are set to scan all IMAP folders. It's not just because the SA folder is flagged as an additional Junk folder. I've got other folders that Tbird misses. Most receive automated server mail from Linux services (such as logwatch). I haven't been able to find a pattern. From mfoley at ohprs.org Sun Jul 17 00:36:38 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sat, 16 Jul 2016 20:36:38 -0400 Subject: Moving Maildir folders In-Reply-To: <201607161905.u6GJ5XZ2030407@mail.hprs.local> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> Message-ID: <201607170036.u6H0acVe014238@mail.hprs.local> Not quite there yet. The folders show up, but I cannot see the mail inside the folders unless (in the Thunderbird client) I uncheck the setting "Show only subscribed folders". Still, the top-level folder is shown as grayed-out/italics as well as the the sub-folder INBOX. All other sub-folder at the same level as INBOX are not grayed-out, nor are folders subordinate to INBOX: user at mydom.org <-- topmost "real" account folder +Inbox Drafts Templates send Items Junk E-mail Deleted Items +bpatterson <-- added Maildir folders from former user, grayed-out, italics +INBOX <-- grayed out, italic Payabled <-- not grayed Health Care <-- not grayed : : Sent <-- not grayed Sent Items <-- not grayed Templates <-- not grayed Trash <-- not grayed Mozilla has a reference to this phenomenon http://kb.mozillazine.org/Grey_italic_folders, but this seems to have to do with GMAIL accounts. Mine is a local IMAP server and the link has no apparent remedy. Furthermore, if I attempt to delete e.g. "Trash" I get an error, presumably from Dovecot: "The current command did not succeed. The mail server for account user at mydom.org responded: [ALREADYEXISTS] Target mailbox already exists." Seem like an odd error when trying to delete. My theory is that if I can designated these folders as 'subcribed' everything would work normally. I don't know if that's true. I've tried added these folders to the 'subscriptions' file in the user's Maildir folder, an excerpt of which: INBOX.Directed Brokerage INBOX.Directed Brokerage.Abel Noser INBOX.Investments-Active.Kayne INBOX.Pending - Open Projects Deleted Items.Oath INBOX.Board Info.New Trustee-Oath of Office INBOX.Rule Filing-Rule Changes bpatterson.INBOX.2011 Investment Confirmation Responses bpatterson.INBOX.2011 and 2012 KCR Audit bpatterson.INBOX.2012 Investment Confirmation Responses bpatterson.INBOX.2013 Health Care Changes - Information bpatterson.INBOX.2013 Investment Confirmation Responses where the 1st 7 listed are part of the user's existing list and the next ones are what I added for the former user's mail folders. This did not work. Ideas? --Mark -----Original Message----- From: Mark Foley Date: Sat, 16 Jul 2016 15:05:33 -0400 Organization: Ohio Highway Patrol Retirement System To: dovecot at dovecot.org Subject: Re: Moving Maildir folders Hey!! It is now showing the former users' folders at the top level of the current user. Great! Perhaps dovecot just needed time to "index" the new messages? Anyway, Luigi's suggestion on moving and renaming the folders apparently worked. Thanks!!!! --Mark -----Original Message----- > Subject: Re: Moving Maildir folders > From: Frank-Ulrich Sommer > Date: Sat, 16 Jul 2016 20:41:10 +0200 > To: dovecot at dovecot.org > How did you verify that dovecot doesn't show these folders? Couldn't this be a client problem? In Thunderbird e.g. it might be necessary to update the list of displayed folders. > > Am 16. Juli 2016 19:07:39 MESZ, schrieb Mark Foley : > >On Sat, 16 Jul 2016 08:53:27 +0200 Luigi Rosa > >wrote: > >> > >> Mark Foley wrote on 16/07/2016 07:43: > >> > Our office had a user leave. Another user is taking over her > >duties and needs reference to the > >> > departing user's email. I've copied that entire departed user's > >Maildir structure to the current > >> > user: > >> > > >> > mv olduser/Maildir/.* curuser/Maildir/.olduser > >> > > >> > I did change permission and ownership on curuser/Maildir/.olduser > >to be the target user. I did > >> > not bring over the olduser/Maildir/dovecot* files (indexes, > >subscriptions, etc.) as I thought > >> > that would be bad. > >> > >> Maildir has no nested folders. > >> > >> If you want a subtree structure in maildir you must create each > >folder at the > >> first level > >> > >> in the new user you must have something like: > >> > >> .olduser.INBOX > >> .olduser.Sent > >> .olduser.Trash > >> .olduser.Drafts > >> .olduser.whatever > >> > >> Each directory with tmp, newm cur subdirs only (ad dovecot files, of > >course) > >> > >> > >> > >> -- > >> > >> > >> Ciao, > >> luigi > >> > >> / > >> +--[Luigi Rosa]-- > >> \ > >> > >> Understanding is a three-edged sword. > >> --Kosh, "Deathwalker" > > > >OK, I believe I've done as you suggested, but still nothing showing on > >the target users mail > >client. Here's what part of the Maildir looks like with the 1st set of > >folders belonging to the > >target user and those beginning with .bpatterson from the old user. > >Does this look right as > >you've advised? Perhaps I need to do something else? > > > >.INBOX.Travel/ > >.INBOX.UPS/ > >.INBOX.US\ Bank/ > >.INBOX.United\ Health\ Care-Employee/ > >.INBOX.VRC/ > >.INBOX.Website/ > >.INBOX.Website.Mouse\ Pad\ Insert/ > >.INBOX.iLink/ > >.Junk\ E-mail/ > >.Sent\ Items/ > >.Templates/ > >.bpatterson.Deleted\ Items/ > >.bpatterson.Drafts/ > >.bpatterson.INBOX.2011\ Investment\ Confirmation\ Responses/ > >.bpatterson.INBOX.2011\ and\ 2012\ KCR\ Audit/ > >.bpatterson.INBOX.2012\ Investment\ Confirmation\ Responses/ > >.bpatterson.INBOX.2013\ Health\ Care\ Changes\ -\ Information/ > >.bpatterson.INBOX.2013\ Investment\ Confirmation\ Responses/ > > > >At the top level, the target user has (in email client): > > > >Inbox > >Drafts > >Templates > >Sent Items > >Junk E-mail > >Deleted Items > > > >I'm expecting to see "bpatterson" appear in that list. > > > >Thanks --Mark > > -- > Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet. > From achim at ag-web.biz Sun Jul 17 01:44:05 2016 From: achim at ag-web.biz (Achim Gottinger) Date: Sun, 17 Jul 2016 03:44:05 +0200 Subject: Moving Maildir folders In-Reply-To: <201607170036.u6H0acVe014238@mail.hprs.local> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> <201607170036.u6H0acVe014238@mail.hprs.local> Message-ID: Am 17.07.2016 um 02:36 schrieb Mark Foley: > Not quite there yet. The folders show up, but I cannot see the mail inside the folders unless > (in the Thunderbird client) I uncheck the setting "Show only subscribed folders". Still, the > top-level folder is shown as grayed-out/italics as well as the the sub-folder INBOX. All other > sub-folder at the same level as INBOX are not grayed-out, nor are folders subordinate to INBOX: > > user at mydom.org <-- topmost "real" account folder > +Inbox > Drafts > Templates > send Items > Junk E-mail > Deleted Items > +bpatterson <-- added Maildir folders from former user, grayed-out, italics > +INBOX <-- grayed out, italic > Payabled <-- not grayed > Health Care <-- not grayed > : > : > Sent <-- not grayed > Sent Items <-- not grayed > Templates <-- not grayed > Trash <-- not grayed > > Mozilla has a reference to this phenomenon http://kb.mozillazine.org/Grey_italic_folders, but > this seems to have to do with GMAIL accounts. Mine is a local IMAP server and the link has no > apparent remedy. > > Furthermore, if I attempt to delete e.g. "Trash" I get an error, presumably from Dovecot: "The > current command did not succeed. The mail server for account user at mydom.org responded: > [ALREADYEXISTS] Target mailbox already exists." Seem like an odd error when trying to delete. > > My theory is that if I can designated these folders as 'subcribed' everything would work > normally. I don't know if that's true. I've tried added these folders to the 'subscriptions' > file in the user's Maildir folder, an excerpt of which: > > INBOX.Directed Brokerage > INBOX.Directed Brokerage.Abel Noser > INBOX.Investments-Active.Kayne > INBOX.Pending - Open Projects > Deleted Items.Oath > INBOX.Board Info.New Trustee-Oath of Office > INBOX.Rule Filing-Rule Changes > bpatterson.INBOX.2011 Investment Confirmation Responses > bpatterson.INBOX.2011 and 2012 KCR Audit > bpatterson.INBOX.2012 Investment Confirmation Responses > bpatterson.INBOX.2013 Health Care Changes - Information > bpatterson.INBOX.2013 Investment Confirmation Responses > > where the 1st 7 listed are part of the user's existing list and the next ones are what I added > for the former user's mail folders. This did not work. > > Ideas? > > --Mark Hi Mark, Try to subscribe in thundebird via your accounts right click context menu. The greyed out folders may not contain mails (missing .cur etc. suubfolders). Sometimes it is neccessary to clean the ImapMail folder in the thunderbird user profile (as an last resort). achim~ From mfoley at ohprs.org Sun Jul 17 05:35:51 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sun, 17 Jul 2016 01:35:51 -0400 Subject: an e-mail client for dovecot ? In-Reply-To: References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> <201607161722.u6GHMpPG026198@mail.hprs.local> Message-ID: <201607170535.u6H5Zp7Z000915@mail.hprs.local> Hmmm, one thing to perhaps try first is upgrading your software. You mentioned that your dovecot is version 1.2.17. I'm running 2.2.15 (which is also older. Current version is 2.2.25). I know there were major changes between version 1.x and 2.x. Your Ubuntu is 14.04 which is 2 released old, now at 16.04 (I'm running 15.10). I do have 16.04 booting with x86, but I haven't yet installed it. You didn't mention your Thunderbird version, but I'm guessing they are similarly dated. My Ubuntu Tbird is 38.8.0 and my Win7 is 45.2.0. It could be your older versions of things don't support what you want. My dovecot server is Slackware64 14.1. One of the users has over 1400 mail folders and 7.2G of IMAP space. She has had no problems with Thunderbird. All of our WIN7 workstations are x64, so perhaps there are issues with x86 version of dovecot/Thunderbird. --Mark -----Original Message----- > Subject: Re: an e-mail client for dovecot ? > To: dovecot at dovecot.org > From: Kenneth Porter > Date: Sat, 16 Jul 2016 16:52:08 -0700 > On 7/16/2016 10:22 AM, Mark Foley wrote: > > I concur with Charles Marcus' query: can you elaborate on how Thunderbird is failing for you? > > I run Thunderbird and Mulberry side-by-side, as there are features in > Mulberry I don't want to give up, even though it's old and buggy. I've > noticed that Mulberry finds folders in my huge hierarchy (100's of > folders) that Tbird misses. Notably my SpamAssassin folder, and it's > consistent across several accounts I monitor. Both programs are set to > scan all IMAP folders. It's not just because the SA folder is flagged as > an additional Junk folder. I've got other folders that Tbird misses. > Most receive automated server mail from Linux services (such as > logwatch). I haven't been able to find a pattern. > From mfoley at ohprs.org Sun Jul 17 05:41:50 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sun, 17 Jul 2016 01:41:50 -0400 Subject: Moving Maildir folders In-Reply-To: References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> <201607170036.u6H0acVe014238@mail.hprs.local> Message-ID: <201607170541.u6H5fo0A005154@mail.hprs.local> On Sun, 17 Jul 2016 03:44:05 +0200 Achim Gottinger wrote: Am 17.07.2016 um 02:36 schrieb Mark Foley: > Not quite there yet. The folders show up, but I cannot see the mail inside the folders unless > (in the Thunderbird client) I uncheck the setting "Show only subscribed folders". Still, the > top-level folder is shown as grayed-out/italics as well as the the sub-folder INBOX. All other > sub-folder at the same level as INBOX are not grayed-out, nor are folders subordinate to INBOX: > > user at mydom.org <-- topmost "real" account folder > +Inbox > Drafts > Templates > send Items > Junk E-mail > Deleted Items > +bpatterson <-- added Maildir folders from former user, grayed-out, italics > +INBOX <-- grayed out, italic > Payabled <-- not grayed > Health Care <-- not grayed > : > : > Sent <-- not grayed > Sent Items <-- not grayed > Templates <-- not grayed > Trash <-- not grayed > > Mozilla has a reference to this phenomenon http://kb.mozillazine.org/Grey_italic_folders, but > this seems to have to do with GMAIL accounts. Mine is a local IMAP server and the link has no > apparent remedy. > > Furthermore, if I attempt to delete e.g. "Trash" I get an error, presumably from Dovecot: "The > current command did not succeed. The mail server for account user at mydom.org responded: > [ALREADYEXISTS] Target mailbox already exists." Seem like an odd error when trying to delete. > > My theory is that if I can designated these folders as 'subcribed' everything would work > normally. I don't know if that's true. I've tried added these folders to the 'subscriptions' > file in the user's Maildir folder, an excerpt of which: > > INBOX.Directed Brokerage > INBOX.Directed Brokerage.Abel Noser > INBOX.Investments-Active.Kayne > INBOX.Pending - Open Projects > Deleted Items.Oath > INBOX.Board Info.New Trustee-Oath of Office > INBOX.Rule Filing-Rule Changes > bpatterson.INBOX.2011 Investment Confirmation Responses > bpatterson.INBOX.2011 and 2012 KCR Audit > bpatterson.INBOX.2012 Investment Confirmation Responses > bpatterson.INBOX.2013 Health Care Changes - Information > bpatterson.INBOX.2013 Investment Confirmation Responses > > where the 1st 7 listed are part of the user's existing list and the next ones are what I added > for the former user's mail folders. This did not work. > > Ideas? > > --Mark Hi Mark, Try to subscribe in thundebird via your accounts right click context menu. The greyed out folders may not contain mails (missing .cur etc. suubfolders). Sometimes it is neccessary to clean the ImapMail folder in the thunderbird user profile (as an last resort). achim~ > From dovecot-bounces at dovecot.org Sat Jul 16 21:44:27 2016 > X-Virus-Status: Clean > X-Virus-Scanned: clamav-milter 0.98.6 at mail > X-Spam-Checker-Version: SpamAssassin 3.3.2-_revision__1.20__ (2011-06-06) on > mail.hprs.local > X-Spam-Level: > X-Spam-Status: No, score=-102.7 required=3.0 tests=LOCAL_FROM_WORDS5, > USER_IN_WHITELIST,USER_IN_WHITELIST_TO autolearn=no > version=3.3.2-_revision__1.20__ > X-Original-To: dovecot at dovecot.org > Delivered-To: dovecot at dovecot.org > Subject: Re: Moving Maildir folders > To: dovecot at dovecot.org > From: Achim Gottinger > Date: Sun, 17 Jul 2016 03:44:05 +0200 > User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 > Icedove/45.1.0 > Content-Type: text/plain; charset=windows-1252; format=flowed > X-Authenticated-Sender: achim at ag-web.biz > X-Virus-Scanned: Clear (ClamAV 0.99.2/21916/Sun Jul 17 00:49:18 2016) > X-BeenThere: dovecot at dovecot.org > X-Mailman-Version: 2.1.17 > Precedence: list > Reply-To: Dovecot Mailing List > List-Id: Dovecot Mailing List > List-Unsubscribe: , > > List-Archive: > List-Post: > List-Help: > List-Subscribe: , > > Errors-To: dovecot-bounces at dovecot.org > Sender: "dovecot" > X-Spam-Report: > * -100 USER_IN_WHITELIST From: address is in the user's white-list > * 3.3 LOCAL_FROM_WORDS5 From contains words in reject list > * -6.0 USER_IN_WHITELIST_TO User is listed in 'whitelist_to' > > > > Am 17.07.2016 um 02:36 schrieb Mark Foley: > > Not quite there yet. The folders show up, but I cannot see the mail inside the folders unless > > (in the Thunderbird client) I uncheck the setting "Show only subscribed folders". Still, the > > top-level folder is shown as grayed-out/italics as well as the the sub-folder INBOX. All other > > sub-folder at the same level as INBOX are not grayed-out, nor are folders subordinate to INBOX: > > > > user at mydom.org <-- topmost "real" account folder > > +Inbox > > Drafts > > Templates > > send Items > > Junk E-mail > > Deleted Items > > +bpatterson <-- added Maildir folders from former user, grayed-out, italics > > +INBOX <-- grayed out, italic > > Payabled <-- not grayed > > Health Care <-- not grayed > > : > > : > > Sent <-- not grayed > > Sent Items <-- not grayed > > Templates <-- not grayed > > Trash <-- not grayed > > > > Mozilla has a reference to this phenomenon http://kb.mozillazine.org/Grey_italic_folders, but > > this seems to have to do with GMAIL accounts. Mine is a local IMAP server and the link has no > > apparent remedy. > > > > Furthermore, if I attempt to delete e.g. "Trash" I get an error, presumably from Dovecot: "The > > current command did not succeed. The mail server for account user at mydom.org responded: > > [ALREADYEXISTS] Target mailbox already exists." Seem like an odd error when trying to delete. > > > > My theory is that if I can designated these folders as 'subcribed' everything would work > > normally. I don't know if that's true. I've tried added these folders to the 'subscriptions' > > file in the user's Maildir folder, an excerpt of which: > > > > INBOX.Directed Brokerage > > INBOX.Directed Brokerage.Abel Noser > > INBOX.Investments-Active.Kayne > > INBOX.Pending - Open Projects > > Deleted Items.Oath > > INBOX.Board Info.New Trustee-Oath of Office > > INBOX.Rule Filing-Rule Changes > > bpatterson.INBOX.2011 Investment Confirmation Responses > > bpatterson.INBOX.2011 and 2012 KCR Audit > > bpatterson.INBOX.2012 Investment Confirmation Responses > > bpatterson.INBOX.2013 Health Care Changes - Information > > bpatterson.INBOX.2013 Investment Confirmation Responses > > > > where the 1st 7 listed are part of the user's existing list and the next ones are what I added > > for the former user's mail folders. This did not work. > > > > Ideas? > > > > --Mark > Hi Mark, > > Try to subscribe in thundebird via your accounts right click context menu. > The greyed out folders may not contain mails (missing .cur etc. > suubfolders). > Sometimes it is neccessary to clean the ImapMail folder in the > thunderbird user profile (as an last resort). > > achim~ These could possibly be excellent suggestions, but I've no idea how to do what you suggest. What do you mean "subscribe via [my] accounts right click context menu"? How would I "clean the ImapMail folder"? THX -- Mark From reuben-dovecot at reub.net Sun Jul 17 06:18:45 2016 From: reuben-dovecot at reub.net (Reuben Farrelly) Date: Sun, 17 Jul 2016 16:18:45 +1000 Subject: Occasional lock timeouts on Linode VM with Dovecot Replication Message-ID: I've been seeing periodic entries in my dovecot logs like this: dovecot[3464]: dsync-server(kaylene): Error: Couldn't lock /home/kaylene/.dovecot-sync.lock: Timed out after 30 seconds: 3 Time(s) dovecot[3464]: dsync-server(reuben): Error: Couldn't lock /home/reuben/.dovecot-sync.lock: Timed out after 30 seconds: 1 Time(s) They occur several times per day, but don't appear to have any obvious cause and I am not aware of any problems this is causing. [They could be the cause of some reappearing UID type messages that also periodically are logged, but I can't be sure] They occur on a lightly loaded Linode VM, KVM Paravirtualised and with only local SSD disk storage. The VM is a Gentoo Linux VM running the latest kernels that Linode provide. I also saw this problem under Xen. The dovecot setup is a dsync replication between two hosts, there is about 150ms of latency between them. The host where I am seeing these messages on (lightning) is a dovecot replica of another system (thunderstorm). I am using Maildir storage. Thunderstorm sees the vast majority of the client side reads and writes and lightning just functions as a not-so-active replica. Thunderstorm is also a VM but on VMware (also on SSDs). This system has never had this problem. I've had this across many dovecot versions going back many months now so it's impossible to pinpoint when this started. I am currently running dovecot -git master-2.2 branch at the moment. I've never seen disk latency in excess of 30s on any system either so I doubt that raw IO is the cause. I don't have any settings specified in 10-mail.conf in the Mail processes section relating to locking or mmap. Has anyone else experienced this and/or any ideas about where to look next to determine the root cause? Is this a common warning to see in cloud hosted/shared environments? Reuben From pch at myzel.net Sun Jul 17 09:01:57 2016 From: pch at myzel.net (Peter Chiochetti) Date: Sun, 17 Jul 2016 11:01:57 +0200 Subject: Moving Maildir folders In-Reply-To: <201607170036.u6H0acVe014238@mail.hprs.local> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> <201607170036.u6H0acVe014238@mail.hprs.local> Message-ID: <578B4985.1040806@myzel.net> Am 2016-07-17 um 02:36 schrieb Mark Foley: > Not quite there yet. The folders show up, but I cannot see the mail inside the folders unless > (in the Thunderbird client) I uncheck the setting "Show only subscribed folders". Still, the > top-level folder is shown as grayed-out/italics as well as the the sub-folder INBOX. All other > sub-folder at the same level as INBOX are not grayed-out, nor are folders subordinate to INBOX: > > user at mydom.org <-- topmost "real" account folder > +Inbox > Drafts > Templates > send Items > Junk E-mail > Deleted Items > +bpatterson <-- added Maildir folders from former user, grayed-out, italics > +INBOX <-- grayed out, italic > Payabled <-- not grayed > Health Care <-- not grayed > : > : > Sent <-- not grayed > Sent Items <-- not grayed > Templates <-- not grayed > Trash <-- not grayed > > > Furthermore, if I attempt to delete e.g. "Trash" I get an error, presumably from Dovecot: "The > current command did not succeed. The mail server for account user at mydom.org responded: > [ALREADYEXISTS] Target mailbox already exists." Seem like an odd error when trying to delete. > > > Ideas? With Maildir and path separator "." one can have incomplete paths: eg. bpatterson.INBOX.2011 will say that there is 2011 within INBOX within bpatterson -- while it is possible, that both bpatterson and bpatterson.INBOX do not exist! Thunderbird will render the missing folders gray in the UI, you probably cannot subscribe to those, even from the subscribe dialogue. You should be able to create them though. Also, you cannot delete a folder, when there is already a folder with the same name inside of your Trash, i.e. Trash.Trash? -- peter From lists at luigirosa.com Sun Jul 17 10:24:04 2016 From: lists at luigirosa.com (Luigi Rosa) Date: Sun, 17 Jul 2016 12:24:04 +0200 Subject: Moving Maildir folders In-Reply-To: <578B4985.1040806@myzel.net> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> <201607170036.u6H0acVe014238@mail.hprs.local> <578B4985.1040806@myzel.net> Message-ID: <578B5CC4.8050401@luigirosa.com> Peter Chiochetti wrote on 17/07/2016 11:01: > With Maildir and path separator "." one can have incomplete paths: eg. > bpatterson.INBOX.2011 will say that there is 2011 within INBOX within bpatterson > -- while it is possible, that both bpatterson and bpatterson.INBOX do not exist! > Thunderbird will render the missing folders gray in the UI, you probably cannot > subscribe to those, even from the subscribe dialogue. You should be able to > create them though. That is correct. If you want to create the "path" Somename/Foo/Bar/Baz (as seen by the IMAP client), even if only Somename and Baz contains messages, you must have the entire "path", that is tour mailbox directory must contain the directories: .Somename .Somename.Foo .Somename.Foo.Bar .Somename.Foo.Bar.Baz Of course each of the directories will contain cur, tmp, new and Dovecot files -- Ciao, luigi / +--[Luigi Rosa]-- \ Britain reveals plans for high-speed rail link that could get people the hell out of Scotland and into the civilized world in less than two hours. --fark.com From lists at luigirosa.com Sun Jul 17 10:29:58 2016 From: lists at luigirosa.com (Luigi Rosa) Date: Sun, 17 Jul 2016 12:29:58 +0200 Subject: doveadm feature request: move mailbox between users Message-ID: <578B5E26.8080800@luigirosa.com> A feature request for doveadm: move (or copy) mailboxes between users Something like: doveadm movemailbox -s User1 -d User2 Old/Mail/Box Destin/Ation/Path (the same with copymailbox) Or something like that is already possible? -- Ciao, luigi / +--[Luigi Rosa]-- \ It's not enough that we do our best; sometimes we have to do what's required. --Sir Winston Churchill From aki.tuomi at dovecot.fi Sun Jul 17 10:37:06 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 17 Jul 2016 13:37:06 +0300 (EEST) Subject: doveadm feature request: move mailbox between users In-Reply-To: <578B5E26.8080800@luigirosa.com> References: <578B5E26.8080800@luigirosa.com> Message-ID: <144822612.774.1468751827190@appsuite-dev.open-xchange.com> > On July 17, 2016 at 1:29 PM Luigi Rosa wrote: > > > A feature request for doveadm: move (or copy) mailboxes between users > > Something like: > > doveadm movemailbox -s User1 -d User2 Old/Mail/Box Destin/Ation/Path > > (the same with copymailbox) > > > Or something like that is already possible? > > > > -- > > > Ciao, > luigi > > / > +--[Luigi Rosa]-- > \ > > It's not enough that we do our best; > sometimes we have to do what's required. > --Sir Winston Churchill You can do this with - mailbox create - move - delete --- Aki Tuomi Dovecot oy From lists at luigirosa.com Sun Jul 17 11:20:59 2016 From: lists at luigirosa.com (Luigi Rosa) Date: Sun, 17 Jul 2016 13:20:59 +0200 Subject: doveadm feature request: move mailbox between users In-Reply-To: <144822612.774.1468751827190@appsuite-dev.open-xchange.com> References: <578B5E26.8080800@luigirosa.com> <144822612.774.1468751827190@appsuite-dev.open-xchange.com> Message-ID: <578B6A1B.2040706@luigirosa.com> aki.tuomi at dovecot.fi wrote on 17/07/2016 12:37: >> A feature request for doveadm: move (or copy) mailboxes between users >> >> Something like: >> >> doveadm movemailbox -s User1 -d User2 Old/Mail/Box Destin/Ation/Path > You can do this with > - mailbox create > - move > - delete See thread "Moving Maildir folders" The problem is to prune and graft some branches of the [Maildir] folder structure between users. For instance, when a user leaves an organization, some of their mailboxes must ne copied/moved to varius coleagues in order to ensure business continuity -- Ciao, luigi / +--[Luigi Rosa]-- \ All great truths begin as blasphemies. --George Bernard Shaw From aki.tuomi at dovecot.fi Sun Jul 17 11:27:56 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 17 Jul 2016 14:27:56 +0300 (EEST) Subject: doveadm feature request: move mailbox between users In-Reply-To: <578B6A1B.2040706@luigirosa.com> References: <578B5E26.8080800@luigirosa.com> <144822612.774.1468751827190@appsuite-dev.open-xchange.com> <578B6A1B.2040706@luigirosa.com> Message-ID: <1769005961.795.1468754877042@appsuite-dev.open-xchange.com> > On July 17, 2016 at 2:20 PM Luigi Rosa wrote: > > > aki.tuomi at dovecot.fi wrote on 17/07/2016 12:37: > > >> A feature request for doveadm: move (or copy) mailboxes between users > >> > >> Something like: > >> > >> doveadm movemailbox -s User1 -d User2 Old/Mail/Box Destin/Ation/Path > > > You can do this with > > - mailbox create > > - move > > - delete > > See thread "Moving Maildir folders" > > The problem is to prune and graft some branches of the [Maildir] folder > structure between users. > > For instance, when a user leaves an organization, some of their mailboxes must > ne copied/moved to varius coleagues in order to ensure business continuity > > > -- > > > Ciao, > luigi > > / > +--[Luigi Rosa]-- > \ > > All great truths begin as blasphemies. > --George Bernard Shaw We'll consider this. Thank you for the idea. Aki From lists at luigirosa.com Sun Jul 17 11:39:40 2016 From: lists at luigirosa.com (Luigi Rosa) Date: Sun, 17 Jul 2016 13:39:40 +0200 Subject: doveadm feature request: move mailbox between users In-Reply-To: <1769005961.795.1468754877042@appsuite-dev.open-xchange.com> References: <578B5E26.8080800@luigirosa.com> <144822612.774.1468751827190@appsuite-dev.open-xchange.com> <578B6A1B.2040706@luigirosa.com> <1769005961.795.1468754877042@appsuite-dev.open-xchange.com> Message-ID: <578B6E7C.2090500@luigirosa.com> aki.tuomi at dovecot.fi wrote on 17/07/2016 13:27: > We'll consider this. Thank you for the idea. Thanks! -- Ciao, luigi / +--[Luigi Rosa]-- \ The number of unlikely things that can happen is so large, you can be assured that unlikely things are likely. --Neil deGrasse Tyson @neiltyson via Twitter From mfoley at ohprs.org Sun Jul 17 22:56:06 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sun, 17 Jul 2016 18:56:06 -0400 Subject: Moving Maildir folders In-Reply-To: <578B5CC4.8050401@luigirosa.com> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> <201607170036.u6H0acVe014238@mail.hprs.local> <578B4985.1040806@myzel.net> <578B5CC4.8050401@luigirosa.com> Message-ID: <201607172256.u6HMu6ba024283@mail.hprs.local> On Date: Sun, 17 Jul 2016 12:24:04 +0200 Luigi Rosa wrote: > > Peter Chiochetti wrote on 17/07/2016 11:01: > > > With Maildir and path separator "." one can have incomplete paths: eg. > > bpatterson.INBOX.2011 will say that there is 2011 within INBOX within bpatterson > > -- while it is possible, that both bpatterson and bpatterson.INBOX do not exist! > > Thunderbird will render the missing folders gray in the UI, you probably cannot > > subscribe to those, even from the subscribe dialogue. You should be able to > > create them though. > > That is correct. > > If you want to create the "path" Somename/Foo/Bar/Baz (as seen by the IMAP > client), even if only Somename and Baz contains messages, you must have the > entire "path", that is tour mailbox directory must contain the directories: > > .Somename > .Somename.Foo > .Somename.Foo.Bar > .Somename.Foo.Bar.Baz > > Of course each of the directories will contain cur, tmp, new and Dovecot files > > Ciao, > luigi That was probably my problem. While I moved the entire Maildir structure from the old user's Maildir hierarchy, I just created .bpatterson.Foo.Bar/ .bpatterson.Foo.raB/ etc I never did create .bpatterson/ .bpatterson.Foo/ etc. Good to know. I'll sort that out better next time. Meanwhile, before reading this message, I created a new folder in Tbird, then dragged the folders out of the .bpatterson hierarchy to the new folder. That worked, but was a bit time consuming. I supposed I was thrown off because the destination user's Maildir has no .INBOX/ directory, only: .INBOX.this/ .INBOX.that/ but, I suppose INBOX is a special case since the rest of the top-level folders (Drafts, Templates, Sent Items, ...) do have directories. Next time! Thanks --Mark From lists at luigirosa.com Mon Jul 18 04:23:28 2016 From: lists at luigirosa.com (Luigi Rosa) Date: Mon, 18 Jul 2016 06:23:28 +0200 Subject: Moving Maildir folders In-Reply-To: <201607172256.u6HMu6ba024283@mail.hprs.local> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> <201607170036.u6H0acVe014238@mail.hprs.local> <578B4985.1040806@myzel.net> <578B5CC4.8050401@luigirosa.com> <201607172256.u6HMu6ba024283@mail.hprs.local> Message-ID: <578C59C0.6060801@luigirosa.com> Mark Foley wrote on 18/07/2016 00:56: > I supposed I was thrown off because the destination user's Maildir has no .INBOX/ directory, only: > > .INBOX.this/ > .INBOX.that/ > > but, I suppose INBOX is a special case since the rest of the top-level folders (Drafts, > Templates, Sent Items, ...) do have directories. Next time! Creating the folders before is a good idea, if you are not familiar with Maildir structure INBOX is the root dir of Maildir: if you look at the root dir, you will find the IMAP folders that begins with a "." AND cur,tmp,new dir: that three dirs are the INBOX -- Ciao, luigi / +--[Luigi Rosa]-- \ That the automobile has practically reached the limit of its development is suggested by the fact that during the past year no improvements of a radical nature have been introduced. --Scientific American, 1909 From kremels at kreme.com Mon Jul 18 08:19:12 2016 From: kremels at kreme.com (@lbutlr) Date: Mon, 18 Jul 2016 02:19:12 -0600 Subject: Moving Maildir folders In-Reply-To: <201607172256.u6HMu6ba024283@mail.hprs.local> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> <201607170036.u6H0acVe014238@mail.hprs.local> <578B4985.1040806@myzel.net> <578B5CC4.8050401@luigirosa.com> <201607172256.u6HMu6ba024283@mail.hprs.local> Message-ID: <93CD7B4B-B0A4-4374-9FE9-C5AB695381A3@kreme.com> > On Jul 17, 2016, at 4:56 PM, Mark Foley wrote: > > .bpatterson.Foo.Bar/ > .bpatterson.Foo.raB/ > etc > > I never did create > > .bpatterson/ > .bpatterson.Foo/ Neither of these are needed. The path delimiter for IMAP is a . And you do not put maildir folders under maildir folders. INBOX is the top level maildir folder, and is not normally named INBOX on the filesystem. Here?s the folder structure for one of my accounts: drwx------ 5 1004 1004 512 May 22 2015 ,Junk drwx------ 5 1004 1004 512 Jul 18 02:14 .Archive drwxr-xr-x 5 1004 1004 512 Jun 26 13:25 .Archive.OLD drwx------ 5 1004 1004 512 Jul 18 02:15 .Drafts drwx------ 5 1004 1004 512 Jul 18 01:40 .Junk drwx------ 5 1004 1004 512 Jul 18 02:12 .Sent drwx------ 5 1004 1004 512 Jun 9 20:05 .Trash drwx------ 5 1004 1004 512 Jul 17 15:15 .bbedit drwx------ 5 1004 1004 512 Jul 18 01:47 .bind drwx------ 5 1004 1004 512 Jul 18 02:14 .dovecot drwx------ 5 1004 1004 512 Jul 18 02:14 .httpd drwx------ 5 1004 1004 512 Jul 18 01:47 .macosx drwx------ 5 1004 1004 512 Jul 18 01:47 .postfix drwx------ 5 1004 1004 512 Jul 18 01:40 .spamassassin drwx------ 5 1004 1004 512 Jul 18 01:40 .swift drwx------ 5 1004 1004 512 Jul 18 02:12 .tidbits drwx------ 5 1004 1004 512 Jul 19 2015 .tidbits.2014.archive drwxr-xr-x 2 1004 1004 512 Jun 15 15:00 cur -rw------- 1 1004 1004 44 Aug 19 2013 dovecot-keywords -rw------- 1 1004 1004 365 Jun 17 21:12 dovecot-uidlist -rw------- 1 1004 1004 8 Jul 18 01:45 dovecot-uidvalidity -rw------- 1 1004 1004 520 Jun 7 09:33 dovecot.index -rw------- 1 1004 1004 9824 Jul 17 14:18 dovecot.index.cache -rw------- 1 1004 1004 28008 Jul 3 09:45 dovecot.index.log -rw------- 1 1004 1004 3120 Jul 10 00:44 dovecot.mailbox.log -rw------- 1 1004 1004 4200 May 29 07:50 dovecot.mailbox.log.2 drwxr-xr-x 2 1004 1004 512 Jun 13 07:36 new -rw------- 1 1004 1004 43 Jul 10 00:43 subscriptions drwxr-xr-x 2 1004 1004 512 Jul 11 19:01 tmp Notice that .tidbits.2104.archive is three levels down, and the middle level doesn?t exist on its own. The folders new, tmp, and cur are the Maildir folders for INBOX. -- Don't congratulate yourself too much, or berate yourself either. You choices are half chance; so are everybody else's. From mail at marc-stuermer.de Mon Jul 18 08:50:26 2016 From: mail at marc-stuermer.de (=?UTF-8?Q?Marc_St=C3=BCrmer?=) Date: Mon, 18 Jul 2016 10:50:26 +0200 Subject: an e-mail client for dovecot ? In-Reply-To: <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> Message-ID: <2b5d98d6f6b389a8f3d0be062730ed41@marc-stuermer.de> Am 2016-07-16 10:02, schrieb Spyros Tsiolis: > For some years now, I've been using Thunderbird for dovecot. > I am not very satisfied with t/b so I thought of using m/s outlook > but then I thought that I want to distance my clients from office > products. The last somewhat usable Outlook version with IMAP is 2010, period. All versions after that have been crippled on IMAP by Microsoft on purpose. All versions >= 2013 don't support the header only download of an email anymore, have crappy auto detection of standard folders like trash etc., and will always try to sync all mails to their local mail storage. Also mail check is quite unstable, bugged and quite slow. In short: nothing you want to use with IMAP. > I have a newly created dovecot installation on a very small site. > Three nodes, all x86 Windows 7 professional with an ubuntu v14.04 > server (x86 again) running dovecot 1.2.17. Dovecot 1.2.X is ancient. You should really consider upgrading to the recent version! > Since I have quite some experiece with thunderbird, I know most of > its shortcomings; So I thought if there's an alternative (better?) > imap mail client for x86 windows 7 systems than t/b. emClient, maybe. From yacinechaouche at yahoo.com Mon Jul 18 09:18:29 2016 From: yacinechaouche at yahoo.com (chaouche yacine) Date: Mon, 18 Jul 2016 09:18:29 +0000 (UTC) Subject: Moving Maildir folders In-Reply-To: <93CD7B4B-B0A4-4374-9FE9-C5AB695381A3@kreme.com> References: <201607160543.u6G5hZSL024243@mail.hprs.local> <955b0809-b07e-736f-63e3-787a102b896f@luigirosa.com> <201607161707.u6GH7dFL032724@mail.hprs.local> <46F77180-0B5F-4C68-8B05-48EF3E4BAC92@gmx.net> <201607161905.u6GJ5XZ2030407@mail.hprs.local> <201607170036.u6H0acVe014238@mail.hprs.local> <578B4985.1040806@myzel.net> <578B5CC4.8050401@luigirosa.com> <201607172256.u6HMu6ba024283@mail.hprs.local> <93CD7B4B-B0A4-4374-9FE9-C5AB695381A3@kreme.com> Message-ID: <757568110.909178.1468833509129.JavaMail.yahoo@mail.yahoo.com> >From: "@lbutlr" >To: dovecot at dovecot.org >Sent: Monday, July 18, 2016 9:19 AM >Subject: Re: Moving Maildir folders > >The folders new, tmp, and cur are the Maildir folders for INBOX. Every subfolder has new,tmp and cur directories. Every subfolder is a Maildir. >From http://www.courier-mta.org/imap/README.maildirquota.html?rev=1.1 : << Each subdirectory is a fully-fledged Maildir of its own, that is you have .Important/tmp, .Important/new, and .Important/cur. Everything that applies to the main Maildir applies equally well to the subdirectory, including automatically cleaning up old files in tmp. A Maildir++ enhancement is that a message can be moved between folders and/or the main Maildir simply by moving/renaming the file (into the cur subdirectory of the destination folder). Therefore, the entire Maildir++ must reside on the same filesystem. Within each subdirectory there's an empty file, maildirfolder. Its existence tells the mail delivery agent that this Maildir is a really a folder underneath a parent Maildir++.>> Although this is from the courier website, it is a definition of the maildir structure which is a standard (it's not specific to courier). Yassine. From stephan at rename-it.nl Mon Jul 18 09:46:06 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 18 Jul 2016 11:46:06 +0200 Subject: an e-mail client for dovecot ? In-Reply-To: References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> Message-ID: <3908fdba-7cf2-365d-e5a6-ff74145e06c1@rename-it.nl> Op 16-7-2016 om 18:12 schreef Charles Marcus: > > On July 16, 2016 4:02:33 AM EDT, Spyros Tsiolis wrote: >> Since I have quite some experiece with thunderbird, I know most of >> its shortcomings > Care to elaborate? Thunderbird is far from perfect, but is by far the best IMAP client available. > > Most times you can work around supposed short comings (if what you think are short comings actually are, often they are not)... I agree. I haven't seen anything better so far. Still, with my 100+ folders it regularly hangs for a few seconds while it is presumably doing stuff in the background. So, for example composing a message is often a frustrating activity. This is enough reason for me to look for an alternative client, but there is no real alternative... Regards, Stephan. From jerry at seibercom.net Mon Jul 18 10:00:36 2016 From: jerry at seibercom.net (Jerry) Date: Mon, 18 Jul 2016 06:00:36 -0400 Subject: an e-mail client for dovecot ? In-Reply-To: <20160716072715.30a5dcad@user-Satellite-A100> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> <20160716072715.30a5dcad@user-Satellite-A100> Message-ID: <20160718060036.000073e8@seibercom.net> On Sat, 16 Jul 2016 07:27:15 -0700, Dave Stevens stated: >On Sat, 16 Jul 2016 08:02:33 +0000 (UTC) >Spyros Tsiolis wrote: > >> Hello all, >> >> For some years now, I've been using Thunderbird for dovecot. >> I am not very satisfied with t/b so I thought of using m/s outlook >> but then I thought that I want to distance my clients from office >> products. >> >> I have a newly created dovecot installation on a very small site. >> Three nodes, all x86 Windows 7 professional with an ubuntu v14.04 >> server (x86 again) running dovecot 1.2.17. >> >> The clients there use dovecot as an imap server, so they have a >> real-world e-mail account each and whatever they want to keep , they >> store by gradding-and-dropping to the imap (local / archive) account. >> >> Since I have quite some experiece with thunderbird, I know most of >> its shortcomings; So I thought if there's an alternative (better?) >> imap mail client for x86 windows 7 systems than t/b. >> >> Even better if there's an alternative client that is also supporeted >> under linux . >> >> Any ideas are welcome, >> >> TIA, >> >> s.t. > >I use Claws and like it a lot. Has plugins for extensions, very fast to >work with. > >Dave I like "claws-mail" also; however, it does have some particular quirks. The most annoying one is that it is not a fully "multi-threaded" application. This can make it extremely annoying when sending or receiving mail. -- Jerry From lefty at spes.gr Mon Jul 18 17:10:12 2016 From: lefty at spes.gr (Lefteris Tsintjelis) Date: Mon, 18 Jul 2016 20:10:12 +0300 Subject: Include IMAP Junk folder to pop3 clients. Message-ID: Hi, I would like to include all new mails of Junk box (I have a global sieve filtering set) folder to pop3 clients. Is this possible? This is my current configuration. # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: FreeBSD 9.3-RELEASE-p43 amd64 auth_default_realm = example.com auth_failure_delay = 30 secs auth_mechanisms = plain login disable_plaintext_auth = no info_log_path = /var/log/dovmaillog lmtp_rcpt_check_quota = yes log_path = /var/log/dovmessages login_greeting = NO UBE/UCE - Trespassers will be pursued. mail_gid = mail mail_home = /home/vmail/%d/%u mail_max_userip_connections = 30 mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Drafts { auto = create special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = create special_use = \Sent } mailbox Trash { auto = create autoexpunge = 30 days special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/local.ext driver = sql } plugin { antispam_backend = dspam antispam_dspam_args = --deliver=;--source=error;--signature=%%s;--user;%u antispam_dspam_binary = /usr/local/bin/dspam antispam_dspam_result_header = X-DSPAM-Result antispam_signature = X-DSPAM-Signature antispam_signature_missing = move antispam_spam = Junk antispam_trash = Trash quota = maildir sieve = /home/vmail/.sieve/%d/%u/.user.sieve sieve_dir = /home/vmail/.sieve/%d/%u/.sieve sieve_global_dir = /home/vmail/.sieve/global sieve_global_path = /home/vmail/.sieve/global.sieve sieve_max_script_size = 512K } protocols = imap pop3 lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth { unix_listener /var/spool/postfix/private/dovauth { group = wheel mode = 0666 user = postfix } } service imap-login { chroot = login client_limit = 256 executable = /usr/local/libexec/dovecot/imap-login inet_listener imap { address = * port = 143 } inet_listener imaps { address = * port = 993 } process_limit = 128 process_min_avail = 2 service_count = 1 } service imap { executable = /usr/local/libexec/dovecot/imap } service lmtp { unix_listener /var/spool/postfix/private/dovlmtp { group = wheel mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { chroot = login client_limit = 256 executable = /usr/local/libexec/dovecot/pop3-login inet_listener pop3 { address = * port = 110 } inet_listener pop3s { address = * port = 995 } process_limit = 128 process_min_avail = 2 service_count = 1 } service pop3 { executable = /usr/local/libexec/dovecot/pop3 } ssl_cert = References: Message-ID: <578D2763.7000800@sys4.de> Am 18.07.2016 um 19:10 schrieb Lefteris Tsintjelis: > Hi, > > I would like to include all new mails of Junk box (I have a global sieve > filtering set) folder to pop3 clients. Is this possible? This is my > current configuration. > > # 2.2.25 (7be1766): /usr/local/etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.15 (97b3da0) > # OS: FreeBSD 9.3-RELEASE-p43 amd64 > auth_default_realm = example.com > auth_failure_delay = 30 secs > auth_mechanisms = plain login > disable_plaintext_auth = no > info_log_path = /var/log/dovmaillog > lmtp_rcpt_check_quota = yes > log_path = /var/log/dovmessages > login_greeting = NO UBE/UCE - Trespassers will be pursued. > mail_gid = mail > mail_home = /home/vmail/%d/%u > mail_max_userip_connections = 30 > mail_uid = vmail > mailbox_list_index = yes > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate mime foreverypart > extracttext > namespace inbox { > inbox = yes > location = > mailbox Archive { > auto = create > special_use = \Archive > } > mailbox Drafts { > auto = create > special_use = \Drafts > } > mailbox Junk { > auto = create > special_use = \Junk > } > mailbox Sent { > auto = create > special_use = \Sent > } > mailbox Trash { > auto = create > autoexpunge = 30 days > special_use = \Trash > } > prefix = > } > passdb { > args = /usr/local/etc/dovecot/local.ext > driver = sql > } > plugin { > antispam_backend = dspam > antispam_dspam_args = --deliver=;--source=error;--signature=%%s;--user;%u > antispam_dspam_binary = /usr/local/bin/dspam > antispam_dspam_result_header = X-DSPAM-Result > antispam_signature = X-DSPAM-Signature > antispam_signature_missing = move > antispam_spam = Junk > antispam_trash = Trash > quota = maildir > sieve = /home/vmail/.sieve/%d/%u/.user.sieve > sieve_dir = /home/vmail/.sieve/%d/%u/.sieve > sieve_global_dir = /home/vmail/.sieve/global > sieve_global_path = /home/vmail/.sieve/global.sieve > sieve_max_script_size = 512K > } > protocols = imap pop3 lmtp sieve > sendmail_path = /usr/local/sbin/sendmail > service auth { > unix_listener /var/spool/postfix/private/dovauth { > group = wheel > mode = 0666 > user = postfix > } > } > service imap-login { > chroot = login > client_limit = 256 > executable = /usr/local/libexec/dovecot/imap-login > inet_listener imap { > address = * > port = 143 > } > inet_listener imaps { > address = * > port = 993 > } > process_limit = 128 > process_min_avail = 2 > service_count = 1 > } > service imap { > executable = /usr/local/libexec/dovecot/imap > } > service lmtp { > unix_listener /var/spool/postfix/private/dovlmtp { > group = wheel > mode = 0666 > user = postfix > } > } > service managesieve-login { > inet_listener sieve { > port = 4190 > } > } > service pop3-login { > chroot = login > client_limit = 256 > executable = /usr/local/libexec/dovecot/pop3-login > inet_listener pop3 { > address = * > port = 110 > } > inet_listener pop3s { > address = * > port = 995 > } > process_limit = 128 > process_min_avail = 2 > service_count = 1 > } > service pop3 { > executable = /usr/local/libexec/dovecot/pop3 > } > ssl_cert = ssl_key = userdb { > driver = prefetch > } > userdb { > args = /usr/local/etc/dovecot/local.ext > driver = sql > } > protocol lmtp { > mail_plugins = quota mail_log notify sieve quota > } > protocol lda { > auth_socket_path = /var/spool/postfix/private/dovauth > mail_plugins = quota mail_log notify sieve quota > } > protocol sieve { > mail_max_userip_connections = 10 > managesieve_implementation_string = Dovecot Pigeonhole > managesieve_logout_format = bytes=%i/%o > managesieve_max_compile_errors = 5 > managesieve_max_line_length = 65536 > } > protocol imap { > imap_client_workarounds = delay-newmail tb-extra-mailbox-sep > imap_max_line_length = 64 k > mail_plugins = quota mail_log notify imap_quota antispam > } > protocol pop3 { > pop3_client_workarounds = outlook-no-nuls oe-ns-eoh > pop3_uidl_format = %08Xu%08Xv > } you need the virtual plugin see http://wiki.dovecot.org/Plugins/Virtual https://sys4.de/de/blog/2013/02/11/dovecot-virtual-setup-mit-globaler-sieve-spamfilter-regel-fur-pop3-nutzer/ Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Schlei?heimer Stra?e 26/MG, 80333 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From alessio at skye.it Mon Jul 18 21:25:50 2016 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 18 Jul 2016 23:25:50 +0200 Subject: Some killed with signal 11 after upgrade to 2.2.25 Message-ID: Hi, after to upgrade to dovecot-2.2.25 I see some killed with signal 11 in the log file: Jul 18 08:41:59 pop01 dovecot: pop3(rossi at milano.it): Fatal: master: service(pop3): child 32318 killed with signal 11 (core dumped) Jul 18 09:22:48 pop01 dovecot: imap(mail_backup at domain.it): Fatal: master: service(imap): child 16137 killed with signal 11 (core dumped) I?m not sure but I think happens with new users at the first login but I?m not able to reproduce it. Here the backtrace: Core was generated by `dovecot/pop3 pop3-postlogin'. Program terminated with signal 11, Segmentation fault. #0 0x00000001afdb5828 in ?? () Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.5-7.el6_0.x86_64 expat-2.0.1-11.el6_2.x86_64 glibc-2.12-1.192.el6.x86_64 libgcc-4.4.7-17.el6.x86_64 libicu56-56.1-4.1.x86_64 libstdc++-4.4.7-17.el6.x86_64 zlib-1.2.3-29.el6.x86_64 (gdb) bt full #0 0x00000001afdb5828 in ?? () No symbol table info available. #1 0x000000000120a5d0 in ?? () No symbol table info available. #2 0x00007f7dafd74cac in client_dict_wait (_dict=0x120a920) at dict-client.c:573 dict = 0x120a920 #3 0x00007f7dafd757d8 in client_dict_lookup (_dict=0x120a5d0, pool=0x7f7db0020110, key=0x7f7daef41a07 "priv/quota/messages", value_r=0x7ffe94cb1650) at dict-client.c:669 result = {ret = -2, value = 0x0, error = 0x0} #4 0x00007f7daef3c5c3 in dict_quota_get_resource (_root=0x120a2d0, name=, value_r=0x7ffe94cb1708) at quota-dict.c:168 value = _data_stack_cur_id = 5 root = 0x120a2d0 want_bytes = ret = #5 0x00007f7daef39170 in quota_get_resource (root=0x120a2d0, mailbox_name=0x7f7daef41cfc "", name=0x7f7daef412f3 "MESSAGE", value_r=0x7ffe94cb1708, limit_r=0x7ffe94cb1700) at quota.c:686 bytes_limit = count_limit = kilobytes = false ret = #6 0x00007f7daef39303 in quota_over_flag_check_root (root=0x120a2d0) at quota.c:1036 name = overquota_script = resources = 0x7f7daf144980 i = value = 0 limit = 0 cur_overquota = ret = #7 0x00007f7daef39530 in quota_over_flag_check_startup (quota=) at quota.c:1078 roots = i = count = 2 name = #8 0x00007f7db006babe in hook_mail_namespaces_created (namespaces=0x12038d0) at mail-storage-hooks.c:296 _data_stack_cur_id = 4 hooks__foreach_end = 0x12073d8 hooks = 0x12073a8 #9 0x00007f7db0060065 in mail_namespaces_init_finish (namespaces=0x12038d0, error_r=0x7ffe94cb1920) at mail-namespace.c:357 _data_stack_cur_id = 3 ---Type to continue, or q to quit--- ns = 0x0 prefixless_found = __FUNCTION__ = "mail_namespaces_init_finish" #10 0x00007f7db00601f4 in mail_namespaces_init (user=0x1205270, error_r=0x7ffe94cb1920) at mail-namespace.c:405 mail_set = 0x1206118 ns_set = unexpanded_ns_set = namespaces = 0x12038d0 ns_p = i = count = __FUNCTION__ = "mail_namespaces_init" #11 0x00007f7db006f56d in mail_storage_service_init_post (ctx=, user=0x11f1960, mail_user_r=0x7ffe94cb19f0) at mail-storage-service.c:714 mail_set = 0x1206118 home = 0x11f2931 "/home/domains/milano.it/rossi" mail_user = 0x1205270 #12 mail_storage_service_next_real (ctx=, user=0x11f1960, mail_user_r=0x7ffe94cb19f0) at mail-storage-service.c:1411 len = temp_priv_drop = false priv = {uid = 89, gid = 89, uid_source = 0x7f7db01118d9 "userdb lookup", gid_source = 0x7f7db01118d9 "userdb lookup", home = 0x11f2931 "/home/domains/milano.it/rossi", chroot = 0x11e4670 ""} error = use_chroot = true #13 mail_storage_service_next (ctx=, user=0x11f1960, mail_user_r=0x7ffe94cb19f0) at mail-storage-service.c:1429 old_log_prefix = 0x11f1750 "pop3(rossi at milano.it): " ret = 18899224 #14 0x00007f7db006f7ad in mail_storage_service_lookup_next (ctx=0x11ecdc0, input=, user_r=0x7ffe94cb19f8, mail_user_r=0x7ffe94cb19f0, error_r=0x7ffe94cb1a70) at mail-storage-service.c:1462 user = 0x11f1960 ret = #15 0x000000000040434e in client_create_from_input (input=0x7ffe94cb1a80, fd_in=13, fd_out=13, input_buf=0x7ffe94cb1a30, error_r=) at main.c:106 lookup_error_str = 0x4083b0 "-ERR [SYS/TEMP] Internal error occurred. Refer to server log for more information.\r\n" user = mail_user = client = set = error = #16 0x0000000000404abe in login_client_connected (client=0x11eefc0, username=, ---Type to continue, or q to quit--- extra_fields=) at main.c:178 input = {module = 0x40932a "pop3", service = 0x40932a "pop3", username = 0x11e3168 "rossi at milano.it", session_id = 0x11ef040 "MI/mQ+M3nvtPBuXj", session_id_prefix = 0x0, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "\n`\003\235", '\000' , __u6_addr16 = {24586, 40195, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {2634244106, 0, 0, 0}}}, ip4 = {s_addr = 2634244106}}}, remote_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "O\006\345\343", '\000' , __u6_addr16 = {1615, 58341, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {3823437391, 0, 0, 0}}}, ip4 = {s_addr = 3823437391}}}, local_port = 0, remote_port = 0, userdb_fields = 0x11e3140, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0, debug = 0} error = input_buf = {data = 0x11ef030, used = 0, priv = {0x0, 0x0, 0x0, 0x0, 0x0}} __FUNCTION__ = "login_client_connected" #17 0x00007f7dafd456fe in master_login_auth_finish (client=0x11eefc0, auth_args=) at master-login.c:210 login = 0x11ee2a0 service = 0x11eb5d0 close_sockets = true __FUNCTION__ = "master_login_auth_finish" #18 0x00007f7dafd45989 in master_login_postlogin_input (pl=0x11f1490) at master-login.c:284 login = 0x11ee2a0 buf = "rossi at milano.it\tquota_rule=*:backend=8589934592S,229376C\tuid=89\tgid=89\thome=/home/domains/milano.it/rossi\n\000\257\005\000\000\001\000\000\000\300\035?\376\177\000\000@\226?}\177\000\000X3W\260}\177\000\000\200\035?\376\177\000\000\250\035?\376\177\000\000\000\060W\260}\177\000\000\030\275V\260}\177\000\000\326+\301\213\000\000\000\000\352\377\065\260}\177"... auth_args = 0x11e3138 p = 0x11e3160 len = ret = -1 fd = -1 #19 0x00007f7dafdb55db in io_loop_call_io (io=0x11eee00) at ioloop.c:564 ioloop = 0x11eb730 t_id = 2 __FUNCTION__ = "io_loop_call_io" #20 0x00007f7dafdb6bc7 in io_loop_handler_run_internal (ioloop=) at ioloop-epoll.c:220 ctx = 0x11ec850 events = event = 0x11ed6c0 list = 0x11eee60 io = tv = {tv_sec = 59, tv_usec = 999953} events_count = msecs = ret = 1 i = ---Type to continue, or q to quit--- call = __FUNCTION__ = "io_loop_handler_run_internal" #21 0x00007f7dafdb5685 in io_loop_handler_run (ioloop=0x11eb730) at ioloop.c:612 No locals. #22 0x00007f7dafdb5828 in io_loop_run (ioloop=0x11eb730) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #23 0x00007f7dafd47b53 in master_service_run (service=0x11eb5d0, callback=) at master-service.c:640 No locals. #24 0x00000000004048d4 in main (argc=2, argv=0x11eb390) at main.c:289 set_roots = {0x409400, 0x0} login_set = {auth_socket_path = 0x11e3050 "/var/run/dovecot/auth-master", postlogin_socket_path = 0x11e3088 "/var/run/dovecot/pop3-postlogin", postlogin_timeout_secs = 60, callback = 0x404a00 , failure_callback = 0x404500 , request_auth_token = 0} service_flags = storage_service_flags = username = auth_socket_path = c = (gdb) and this: Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 11, Segmentation fault. #0 0x0000000178e39828 in ?? () Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.5-7.el6_0.x86_64 expat-2.0.1-11.el6_2.x86_64 glibc-2.12-1.192.el6.x86_64 libgcc-4.4.7-17.el6.x86_64 libicu56-56.1-4.1.x86_64 libstdc++-4.4.7-17.el6.x86_64 zlib-1.2.3-29.el6.x86_64 (gdb) bt full #0 0x0000000178e39828 in ?? () No symbol table info available. #1 0x0000000000e1e670 in ?? () No symbol table info available. #2 0x00007f1178df8cac in client_dict_wait (_dict=0xe1e910) at dict-client.c:573 dict = 0xe1e910 #3 0x00007f1178df97d8 in client_dict_lookup (_dict=0xe1e670, pool=0x7f11790a4110, key=0x7f1177dc1a07 "priv/quota/messages", value_r=0x7ffc745d6590) at dict-client.c:669 result = {ret = -2, value = 0x0, error = 0x0} #4 0x00007f1177dbc5c3 in dict_quota_get_resource (_root=0xe189a0, name=, value_r=0x7ffc745d6648) at quota-dict.c:168 value = _data_stack_cur_id = 5 root = 0xe189a0 want_bytes = ret = #5 0x00007f1177db9170 in quota_get_resource (root=0xe189a0, mailbox_name=0x7f1177dc1cfc "", name=0x7f1177dc12f3 "MESSAGE", value_r=0x7ffc745d6648, limit_r=0x7ffc745d6640) at quota.c:686 bytes_limit = count_limit = kilobytes = false ret = #6 0x00007f1177db9303 in quota_over_flag_check_root (root=0xe189a0) at quota.c:1036 name = overquota_script = resources = 0x7f1177fc4980 i = value = 0 limit = 0 cur_overquota = ret = #7 0x00007f1177db9530 in quota_over_flag_check_startup (quota=) at quota.c:1078 roots = i = count = 2 name = #8 0x00007f11790efabe in hook_mail_namespaces_created (namespaces=0xe1d230) at mail-storage-hooks.c:296 _data_stack_cur_id = 4 hooks__foreach_end = 0xe1b450 hooks = 0xe1b420 #9 0x00007f11790e4065 in mail_namespaces_init_finish (namespaces=0xe1d230, error_r=0x7ffc745d6860) at mail-namespace.c:357 _data_stack_cur_id = 3 ---Type to continue, or q to quit--- ns = 0x0 prefixless_found = __FUNCTION__ = "mail_namespaces_init_finish" #10 0x00007f11790e41f4 in mail_namespaces_init (user=0xe19260, error_r=0x7ffc745d6860) at mail-namespace.c:405 mail_set = 0xe1a120 ns_set = unexpanded_ns_set = namespaces = 0xe1d230 ns_p = i = count = __FUNCTION__ = "mail_namespaces_init" #11 0x00007f11790f356d in mail_storage_service_init_post (ctx=, user=0xe04340, mail_user_r=0x7ffc745d6928) at mail-storage-service.c:714 mail_set = 0xe1a120 home = 0xe054a1 "/home/domains/C/domain.it/mail_backup" mail_user = 0xe19260 #12 mail_storage_service_next_real (ctx=, user=0xe04340, mail_user_r=0x7ffc745d6928) at mail-storage-service.c:1411 len = temp_priv_drop = false priv = {uid = 89, gid = 89, uid_source = 0x7f11791958d9 "userdb lookup", gid_source = 0x7f11791958d9 "userdb lookup", home = 0xe054a1 "/home/domains/C/domain.it/mail_backup", chroot = 0xdf66a0 ""} error = use_chroot = true #13 mail_storage_service_next (ctx=, user=0xe04340, mail_user_r=0x7ffc745d6928) at mail-storage-service.c:1429 old_log_prefix = 0xe04130 "imap(mail_backup at domain.it): " ret = 14786848 #14 0x00007f11790f37ad in mail_storage_service_lookup_next (ctx=0xdff7d0, input=, user_r=0x7ffc745d6930, mail_user_r=0x7ffc745d6928, error_r=0x7ffc745d6988) at mail-storage-service.c:1462 user = 0xe04340 ret = #15 0x0000000000424811 in client_create_from_input (input=0x7ffc745d69a0, fd_in=14, fd_out=14, client_r=0x7ffc745d6990, error_r=0x7ffc745d6988) at main.c:228 user = mail_user = 0x0 ns = client = imap_set = lda_set = errstr = mail_error = 32529 ---Type to continue, or q to quit--- #16 0x00000000004251fc in login_client_connected (login_client=0xe01a50, username=, extra_fields=) at main.c:316 input = {module = 0x42d701 "imap", service = 0x42d701 "imap", username = 0xdf5128 "mail_backup at domain.it", session_id = 0xe01ad0 "12Tc1eM34NNeVqvj", session_id_prefix = 0x0, local_ip = {family = 2, u = {ip6 = {__in6_u = { __u6_addr8 = "m\250q\234", '\000' , __u6_addr16 = {43117, 40049, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {2624694381, 0, 0, 0}}}, ip4 = {s_addr = 2624694381}}}, remote_ip = {family = 2, u = {ip6 = { __in6_u = {__u6_addr8 = "^V\253\343", '\000' , __u6_addr16 = {22110, 58283, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {3819656798, 0, 0, 0}}}, ip4 = {s_addr = 3819656798}}}, local_port = 0, remote_port = 0, userdb_fields = 0xdf50f8, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0, debug = 0} client = flags = error = __FUNCTION__ = "login_client_connected" #17 0x00007f1178dc96fe in master_login_auth_finish (client=0xe01a50, auth_args=) at master-login.c:210 login = 0xe00d30 service = 0xdfd5f0 close_sockets = true __FUNCTION__ = "master_login_auth_finish" #18 0x00007f1178dc9989 in master_login_postlogin_input (pl=0xe03ea0) at master-login.c:284 login = 0xe00d30 buf = "mail_backup at domain.it\tquota_rule=*:backend=1073741824S,32768C\tuid=89\tgid=89\thome=/home/domains/C/domain.it/mail_backup\tauth_token=a3ac7f7c5f6b71227cc12425b8ca588d426452a2\n\270l]t\374\177\000\000\370D\200y\021\177\000\000\060\263\177y\021"... auth_args = 0xdf50f0 p = 0xdf5120 len = ret = -1 fd = -1 #19 0x00007f1178e395db in io_loop_call_io (io=0xe01890) at ioloop.c:564 ioloop = 0xdfd750 t_id = 2 __FUNCTION__ = "io_loop_call_io" #20 0x00007f1178e3abc7 in io_loop_handler_run_internal (ioloop=) at ioloop-epoll.c:220 ctx = 0xdff260 events = event = 0xe000d0 list = 0xe018f0 io = tv = {tv_sec = 59, tv_usec = 999978} events_count = msecs = ret = 1 ---Type to continue, or q to quit--- i = call = __FUNCTION__ = "io_loop_handler_run_internal" #21 0x00007f1178e39685 in io_loop_handler_run (ioloop=0xdfd750) at ioloop.c:612 No locals. #22 0x00007f1178e39828 in io_loop_run (ioloop=0xdfd750) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #23 0x00007f1178dcbb53 in master_service_run (service=0xdfd5f0, callback=) at master-service.c:640 No locals. #24 0x0000000000425025 in main (argc=2, argv=0xdfd390) at main.c:460 set_roots = {0x42d740, 0x6359e0, 0x0} login_set = {auth_socket_path = 0xdf5050 "uota_rule=*:backend=1073741824S,32768C", postlogin_socket_path = 0xdf5088 "e=/home/domains/C/domain.it/mail_backup", postlogin_timeout_secs = 60, callback = 0x425160 , failure_callback = 0x424690 , request_auth_token = 1} service_flags = storage_service_flags = username = auth_socket_path = 0x42e6f0 "auth-master" c = and my configuration: # 2.2.25.1 (f9daebb): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15.rc1 (b9dc09d) # OS: Linux 2.6.32-642.1.1.el6.x86_64 x86_64 CentOS release 6.8 (Final) auth_cache_negative_ttl = 2 mins auth_cache_size = 20 M auth_cache_ttl = 20 mins auth_master_user_separator = * auth_mechanisms = plain login auth_worker_max_count = 50 deliver_log_format = msgid=%m, from=%f, subject="%s": %$ dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext expire = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_idle_notify_interval = 29 mins imap_logout_format = in=%i out=%o session=<%{session}> imap_max_line_length = 2 M last_valid_gid = 89 last_valid_uid = 89 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 10.0.1.5 login_trusted_networks = 10.0.1.0/24 mail_fsync = always mail_location = maildir:~/Maildir mail_plugins = quota acl expire zlib fts fts_solr maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.duplicate mmap_disable = yes namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/dovecot-deny-sql.conf.ext deny = yes driver = sql } passdb { args = /etc/dovecot/extra/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl expire = Trash expire2 = Spam expire_dict = proxy::expire fts = solr fts_solr = url=http://10.0.1.145:8983/solr/ quota = maildir:UserQuota quota2 = dict:Quota Usage::noenforcing:proxy::sqlquota quota_grace = 10M quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/.dovecot.sieve sieve_before = /etc/dovecot/sieve/before.sieve sieve_dir = ~/sieve sieve_extensions = +vnd.dovecot.duplicate -vacation zlib_save = gz zlib_save_level = 6 } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o, session=<%{session}> protocols = imap pop3 sieve sendmail_path = /var/qmail/bin/sendmail service anvil { unix_listener anvil-auth-penalty { mode = 00 } } service auth { client_limit = 6524 unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service dict { process_limit = 500 unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { process_min_avail = 4 service_count = 0 } service imap-postlogin { executable = script-login /etc/dovecot/scripts/imap-postlogin.sh unix_listener imap-postlogin { group = vmail mode = 0660 user = vmail } user = vmail } service imap { executable = imap imap-postlogin process_limit = 5000 vsz_limit = 384 M } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { process_min_avail = 4 service_count = 0 } service pop3-postlogin { executable = script-login /etc/dovecot/scripts/pop3-postlogin.sh unix_listener pop3-postlogin { group = vmail mode = 0660 user = vmail } user = vmail } service pop3 { executable = pop3 pop3-postlogin process_limit = 1024 } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = no submission_host = 127.0.0.1 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lda { mail_fsync = optimized mail_location = maildir:~/Maildir:INDEX=MEMORY mail_plugins = quota acl expire zlib fts fts_solr sieve } protocol imap { mail_max_userip_connections = 50 mail_plugins = quota acl expire zlib fts fts_solr imap_quota imap_acl imap_zlib } protocol sieve { mail_max_userip_connections = 2 } protocol pop3 { mail_max_userip_connections = 15 } I hope can be fixed. Thanks From leon at f-m.fm Tue Jul 19 07:43:45 2016 From: leon at f-m.fm (Leon Kyneur) Date: Tue, 19 Jul 2016 15:43:45 +0800 Subject: dovecot --version tarball Message-ID: <578DDA31.4050808@f-m.fm> Hi, Trying to understand what the version numbers mean. I typically build from the stable tarball and then apply patches as needed.. however since 2.2.25 this hasn't been working (not sure if it worked before or never really looked closely TBH). http://dovecot.org/releases/2.2/dovecot-2.2.25.tar.gz - shows GITID 7be1766 however it has commits / changes newer than this. Also the github tag for 2.2.25 is c1527e5 which doesn't match the source tarball as well. Should the source tarball and git commit hash be related? Thanks Leon From stargate at tango.lu Tue Jul 19 09:30:00 2016 From: stargate at tango.lu (Luescher Claude) Date: Tue, 19 Jul 2016 11:30:00 +0200 Subject: Replication sieve scripts. Message-ID: Hello, Following up on old thread: http://www.dovecot.org/pipermail/dovecot/2014-December/099003.html I have the exact same issue with 2.2.10: ii dovecot-antispam 2.0+20130822-2 amd64 Dovecot plugins for training spam filters ii dovecot-core 1:2.2.10-1 amd64 secure POP3/IMAP server - core files ii dovecot-imapd 1:2.2.10-1 amd64 secure POP3/IMAP server - IMAP daemon ii dovecot-ldap 1:2.2.10-1 amd64 secure POP3/IMAP server - LDAP support ii dovecot-lmtpd 1:2.2.10-1 amd64 secure POP3/IMAP server - LMTP server ii dovecot-managesieved 1:2.2.10-1 amd64 secure POP3/IMAP server - ManageSieve server ii dovecot-mysql 1:2.2.10-1 amd64 secure POP3/IMAP server - MySQL support ii dovecot-pop3d 1:2.2.10-1 amd64 secure POP3/IMAP server - POP3 daemon ii dovecot-sieve 1:2.2.10-1 amd64 secure POP3/IMAP server - Sieve filters support As even his version should already support sieve replication through dsync mine would have to support it for sure but I would like to hear a confirmation from the developers. The mail sync just works perfectly between the 2 nodes, it is only the sieve scripts which don't get replicated. I have tried to add additional sieve related options to the replicator: service replicator { process_min_avail = 1 } plugin { mail_replica = tcp:1.2.3.4 replication_full_sync_interval = 1 hours #Added (makes no difference) sieve = ~/.dovecot.sieve sieve_dir = ~/sieve_after sieve_extensions = +vnd.dovecot.duplicate sieve_duplicate_period = 1h #Added (makes no difference) } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } It did not help. If there is one way I would like to get this work without upgrading dovecot. Thank you. From stephan at rename-it.nl Tue Jul 19 09:54:27 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 19 Jul 2016 11:54:27 +0200 Subject: Replication sieve scripts. In-Reply-To: References: Message-ID: Op 19-7-2016 om 11:30 schreef Luescher Claude: > Hello, > > Following up on old thread: > > http://www.dovecot.org/pipermail/dovecot/2014-December/099003.html > > I have the exact same issue with 2.2.10: > > It did not help. If there is one way I would like to get this work > without upgrading dovecot. Many bugs were fixed since this version. That is likely Pigeonhole 0.4.2, which is very old (26-09-2013). The synchronization didn't work flawlessly until at least version 0.4.4, which goes with Dovecot 2.2.15. Regards, Stephan. From stargate at tango.lu Tue Jul 19 12:03:35 2016 From: stargate at tango.lu (Luescher Claude) Date: Tue, 19 Jul 2016 14:03:35 +0200 Subject: Replication sieve scripts. In-Reply-To: References: Message-ID: Hello, Are you sure about that I would need so recent version? That is ok to have some bugfixes but you are talking about the latest cutting edge debian jessie backports package. Even the mainline debian jessie only have 2.2.13 in it and my system is a complex wheezy installation, the last thing I want to do is to move all my components into jessie just because of this or do you know 2.2.15 deb packages built for wheezy? My installation is a multi-node cluster already I would have to update all the nodes but if it would be only to install a couple of new debs on them I would not hesitate trying a newer dovecot version. Thank you. On Tue, 19 Jul 2016 11:54:27 +0200, Stephan Bosch wrote: > Op 19-7-2016 om 11:30 schreef Luescher Claude: > >> Hello, Following up on old thread: >> http://www.dovecot.org/pipermail/dovecot/2014-December/099003.html >> [1] >> I have the exact same issue with 2.2.10: It did not help. If there >> is >> one way I would like to get this work without upgrading dovecot. > > Many bugs were fixed since this version. That is likely Pigeonhole > 0.4.2, which is very old (26-09-2013). The synchronization didn't > work > flawlessly until at least version 0.4.4, which goes with Dovecot > 2.2.15. > > Regards, > > Stephan. Links: ------ [1] http://www.dovecot.org/pipermail/dovecot/2014-December/099003.html From listeem at ksb.id.lv Tue Jul 19 12:27:54 2016 From: listeem at ksb.id.lv (KSB) Date: Tue, 19 Jul 2016 15:27:54 +0300 Subject: Replication sieve scripts. In-Reply-To: References: Message-ID: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> On 2016.07.19. 15:03, Luescher Claude wrote: > Hello, > > Are you sure about that I would need so recent version? That is ok to > have some bugfixes but you are talking about the latest cutting edge > debian jessie backports package. > Even the mainline debian jessie only have 2.2.13 in it and my system is > a complex wheezy installation, the last thing I want to do is to move > all my components into jessie just because of this or do you know 2.2.15 > deb packages built for wheezy? My installation is a multi-node cluster > already I would have to update all the nodes but if it would be only to > install a couple of new debs on them I would not hesitate trying a newer > dovecot version. > > Thank you. > If you have a huge multi node system, then you need to have testing system also. It's easy to compile Dovecot by yourself and make deb packages, if needed. -- KSB From lefty at spes.gr Tue Jul 19 13:09:23 2016 From: lefty at spes.gr (Lefteris Tsintjelis) Date: Tue, 19 Jul 2016 16:09:23 +0300 Subject: Virtual mailboxes Message-ID: I have been banging my head to the walls for the past couple of days to make virtual mailboxes work and I finally found the problem. It seems when prefetch is used the user_query is not working at all. However, I have not found any reference to this one. http://wiki.dovecot.org/Plugins/Virtual I have tried to add the SQL statements to the password_query with prefetch but it did not work. It seems that it only works with prefetch off. From sergey.schwartz at bgoperator.com Tue Jul 19 13:55:05 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Tue, 19 Jul 2016 16:55:05 +0300 Subject: an e-mail client for dovecot ? In-Reply-To: <201607161722.u6GHMpPG026198@mail.hprs.local> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> <201607161722.u6GHMpPG026198@mail.hprs.local> Message-ID: <578E3139.1060806@bgoperator.com> Gentlemen, I can only confirm that Thunderbird may be not perfect, but it is way much better then any other imap client. PS: has anybody tried using Nylas N1 in production https://www.nylas.com/about/ ? looks nice :) Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz at bgoperator.com 16.07.2016 20:22, Mark Foley ?????: > Wow! That's interesting. Our office of 10+ Windows 7 *and* Ubuntu workstations have been > moving from Outlook to Thunderbird over the past year. Our users find it WAY BETTER than > Outlook. Have you actually tried Outlook 2013 and later? The suckiness of 2013 was what drove > us to look elsewere in the first place. We tried a number of clients including Evolution and > emClient and Tbird proved the best in my testing. > > Thunderbird runs on both Windows and Ubuntu, can do AD authentication and basically has all the > features of Outlook including color categories which our director could not live without; and > can be configured to have a very similar look-and-feel as Outlook. In over a year of running > Thunderbird (currently at 38.8.0 Ubuntu, 45.2.0 Window) it has performed flawlessly. > > I concur with Charles Marcus' query: can you elaborate on how Thunderbird is failing for you? > > --Mark > > -----Original Message----- >> Date: Sat, 16 Jul 2016 08:02:33 +0000 (UTC) >> From: Spyros Tsiolis >> To: Dovecot >> Subject: an e-mail client for dovecot ? >> >> Hello all, >> >> For some years now, I've been using Thunderbird for dovecot. >> I am not very satisfied with t/b so I thought of using m/s outlook >> but then I thought that I want to distance my clients from office >> products. >> >> I have a newly created dovecot installation on a very small site. >> Three nodes, all x86 Windows 7 professional with an ubuntu v14.04 >> server (x86 again) running dovecot 1.2.17. >> >> The clients there use dovecot as an imap server, so they have a >> real-world e-mail account each and whatever they want to keep , they >> store by gradding-and-dropping to the imap (local / archive) account. >> >> Since I have quite some experiece with thunderbird, I know most of >> its shortcomings; So I thought if there's an alternative (better?) >> imap mail client for x86 windows 7 systems than t/b. >> >> Even better if there's an alternative client that is also supporeted under >> linux . >> >> Any ideas are welcome, >> >> TIA, >> >> s.t. >> From miquels at cistron.nl Tue Jul 19 15:42:45 2016 From: miquels at cistron.nl (Miquel van Smoorenburg) Date: Tue, 19 Jul 2016 17:42:45 +0200 Subject: an e-mail client for dovecot ? In-Reply-To: <3908fdba-7cf2-365d-e5a6-ff74145e06c1@rename-it.nl> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> <3908fdba-7cf2-365d-e5a6-ff74145e06c1@rename-it.nl> Message-ID: <578E4A75.9060304@cistron.nl> On 18/07/16 11:46, Stephan Bosch wrote: > > > Op 16-7-2016 om 18:12 schreef Charles Marcus: >> >> On July 16, 2016 4:02:33 AM EDT, Spyros Tsiolis >> wrote: >>> Since I have quite some experiece with thunderbird, I know most of >>> its shortcomings >> Care to elaborate? Thunderbird is far from perfect, but is by far the >> best IMAP client available. >> >> Most times you can work around supposed short comings (if what you >> think are short comings actually are, often they are not)... > > I agree. I haven't seen anything better so far. Still, with my 100+ > folders it regularly hangs for a few seconds while it is presumably > doing stuff in the background. So, for example composing a message is > often a frustrating activity. This is enough reason for me to look for > an alternative client, but there is no real alternative... Known problem. Sort of a indexing thundering herd problem. Preferences -> Advanced -> Config Editor, set mail.db.idlelimit to a large number. I set it to 30000000. Fixed it for me.. Mike. From tanstaafl at libertytrek.org Tue Jul 19 15:50:02 2016 From: tanstaafl at libertytrek.org (Tanstaafl) Date: Tue, 19 Jul 2016 11:50:02 -0400 Subject: an e-mail client for dovecot ? In-Reply-To: <578E4A75.9060304@cistron.nl> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> <3908fdba-7cf2-365d-e5a6-ff74145e06c1@rename-it.nl> <578E4A75.9060304@cistron.nl> Message-ID: <602e2c0d-48b3-d471-9bfb-2a2c87706323@libertytrek.org> Please do NOT send to me directly, I am on the list. Anyone who wishes direct responses should say so by setting explicit Reply-To. On 7/19/2016 11:42 AM, Miquel van Smoorenburg wrote: > On 18/07/16 11:46, Stephan Bosch wrote: >> >> >> Op 16-7-2016 om 18:12 schreef Charles Marcus: >>> >>> On July 16, 2016 4:02:33 AM EDT, Spyros Tsiolis >>> wrote: >>>> Since I have quite some experiece with thunderbird, I know most of >>>> its shortcomings >>> Care to elaborate? Thunderbird is far from perfect, but is by far the >>> best IMAP client available. >>> >>> Most times you can work around supposed short comings (if what you >>> think are short comings actually are, often they are not)... >> >> I agree. I haven't seen anything better so far. Still, with my 100+ >> folders it regularly hangs for a few seconds while it is presumably >> doing stuff in the background. So, for example composing a message is >> often a frustrating activity. This is enough reason for me to look for >> an alternative client, but there is no real alternative... > > Known problem. Sort of a indexing thundering herd problem. > > Preferences -> Advanced -> Config Editor, set mail.db.idlelimit to a > large number. I set it to 30000000. Fixed it for me.. > > Mike. > From cheeks at swcp.com Tue Jul 19 19:23:38 2016 From: cheeks at swcp.com (Mark Costlow) Date: Tue, 19 Jul 2016 13:23:38 -0600 Subject: Panic when runing "doveadm mailbox status ... vsize" Message-ID: <20160719192338.GA40077@same.swcp.com> I'm using dovecot 2.2.24 on FreeBSD 10.3. I'm working on converting users from maildir to mdbox, for the usual reasons. I have converted some test users and they generally work fine. But when I run "doveadm mailbox status" I get a Panic if I ask for the vsize field (or "all"), but other fields work fine. For example: # doveadm mailbox status -u bubbacheex3 "messages" INBOX INBOX messages=53 # doveadm mailbox status -u bubbacheex3 "guid" INBOX INBOX guid=bf976912f3748957761d0100f906a3d0 # doveadm mailbox status -u bubbacheex3 "unseen" INBOX INBOX unseen=52 # doveadm mailbox status -u bubbacheex3 "vsize" INBOX doveadm(bubbacheex3): Panic: file file-lock.c: line 269: unreached Abort trap I've only converted a few users, but they all exhibit this problem. I converted them with: dsync -u bubbacheex3 mirror maildir:/var/tmp/bubbacheex3 I have done a force-resync, which succeeds but doesn't change the behavior. I spent a little time trying to get gdb running but didn't get very far (couldn't seem to get it to find the source files once I got a few levels deep in the call stack). Before I beat my head on the gdb issue more, I thought I'd check here to see if anyone has any ideas. I didn't turn up anything in google or searching this list. Here's my "doveconf -n" output: ------------------------------------------------------ # 2.2.24 (a82c823): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.3-RELEASE-p3 amd64 ufs auth_failure_delay = 1 secs auth_mechanisms = plain login auth_winbind_helper_path = /usr/local/bin/ntlm_auth auth_worker_max_count = 60 base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 100 first_valid_uid = 1000 listen = * login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c mail_location = mdbox:/var/mail/%u:INDEX=/var/dovecot/%u mail_log_prefix = "%Us(%u): " mail_nfs_storage = yes mail_privileged_group = mail mdbox_rotate_interval = 1 days mdbox_rotate_size = 4 M mmap_disable = yes namespace { inbox = yes location = prefix = separator = . } passdb { args = session=yes dovecot driver = pam } protocols = imap pop3 service auth { unix_listener auth-client { mode = 0660 } unix_listener auth-master { mode = 0600 } user = root vsz_limit = 256 M } service imap-login { chroot = login process_limit = 128 process_min_avail = 10 service_count = 1 user = dovecot vsz_limit = 64 M } service imap { drop_priv_before_exec = no process_limit = 512 vsz_limit = 256 M } service pop3-login { chroot = login process_limit = 128 process_min_avail = 5 service_count = 1 user = dovecot vsz_limit = 64 M } service pop3 { drop_priv_before_exec = no process_limit = 512 vsz_limit = 256 M } ssl_cert = was automatically rejected:%n%r sendmail_path = /usr/sbin/sendmail } ------------------------------------------------------ Thanks, Mark -- Mark Costlow | Southwest Cyberport | Fax: +1-505-232-7975 cheeks at swcp.com | Web: www.swcp.com | Voice: +1-505-232-7992 Mail Minder - Intelligent Push Notifications for Email on the iPhone http://mailminderapp.com/download or in the App Store From aki.tuomi at dovecot.fi Tue Jul 19 21:04:38 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Wed, 20 Jul 2016 00:04:38 +0300 (EEST) Subject: Panic when runing "doveadm mailbox status ... vsize" In-Reply-To: <20160719192338.GA40077@same.swcp.com> References: <20160719192338.GA40077@same.swcp.com> Message-ID: <1179258195.6000.1468962279421@appsuite-dev.open-xchange.com> > On July 19, 2016 at 10:23 PM Mark Costlow wrote: > > > I'm using dovecot 2.2.24 on FreeBSD 10.3. I'm working on converting > users from maildir to mdbox, for the usual reasons. > > I have converted some test users and they generally work fine. But > when I run "doveadm mailbox status" I get a Panic if I ask for the > vsize field (or "all"), but other fields work fine. For example: > Any hope for gdb with bt full on the corefile? --- Aki Tuomi Dovecot oy From mays at win.net Tue Jul 19 23:03:24 2016 From: mays at win.net (Joseph Mays) Date: Tue, 19 Jul 2016 19:03:24 -0400 Subject: Managesieve problem Message-ID: <1B922077BA184F11ADCAD5B32A1D60E3@Gantry> Trying to get either avelsieve or server side filters to work with managesieve. Managesieve is running but whenever avelsieve or the server settings backend try to talk to it the same thing happens. So I guess it's really a problem with something about managesieve at this point. I hit the Message Filters option, it takes a long time for it to come back, though it finally just times out and does nothing, and immediately when I click on the Message Filters link the following two messages appear in /var/log/dovecot.... 2016-07-18 17:03:02 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=108() egid=65534() missing +x perm: /, dir owned by 0:111 mode=0750) 2016-07-18 17:03:02 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=108() egid=65534() missing +x perm: /, dir owned by 0:111 mode=0750) Seems to be straightforwardly a permissions error on a directory, but I don't believe it's really the / directory, so which directory is it? Any insights on where to look would be appreciated. From mays at win.net Tue Jul 19 23:19:32 2016 From: mays at win.net (Joseph Mays) Date: Tue, 19 Jul 2016 19:19:32 -0400 Subject: Managesieve problem In-Reply-To: <1B922077BA184F11ADCAD5B32A1D60E3@Gantry> References: <1B922077BA184F11ADCAD5B32A1D60E3@Gantry> Message-ID: <591518D5620B43508D65D2F84A62C642@Gantry> Sorry, meant to include the dovecot version. root at 4s-mail:~# dovecot --version 2.0.19 -----Original Message----- From: Joseph Mays Sent: Tuesday, July 19, 2016 7:03 PM To: dovecot at dovecot.org Subject: Managesieve problem Trying to get either avelsieve or server side filters to work with managesieve. Managesieve is running but whenever avelsieve or the server settings backend try to talk to it the same thing happens. So I guess it's really a problem with something about managesieve at this point. I hit the Message Filters option, it takes a long time for it to come back, though it finally just times out and does nothing, and immediately when I click on the Message Filters link the following two messages appear in /var/log/dovecot.... 2016-07-18 17:03:02 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=108() egid=65534() missing +x perm: /, dir owned by 0:111 mode=0750) 2016-07-18 17:03:02 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied (euid=108() egid=65534() missing +x perm: /, dir owned by 0:111 mode=0750) Seems to be straightforwardly a permissions error on a directory, but I don't believe it's really the / directory, so which directory is it? Any insights on where to look would be appreciated. From mkliewe at gmx.de Tue Jul 19 23:25:44 2016 From: mkliewe at gmx.de (Michael Kliewe) Date: Wed, 20 Jul 2016 01:25:44 +0200 Subject: Panic when runing "doveadm mailbox status ... vsize" In-Reply-To: <20160719192338.GA40077@same.swcp.com> References: <20160719192338.GA40077@same.swcp.com> Message-ID: Hi Mark, Am 19.07.2016 um 21:23 schrieb Mark Costlow: > I have converted some test users and they generally work fine. But > when I run "doveadm mailbox status" I get a Panic if I ask for the > vsize field (or "all"), but other fields work fine. For example: > > # doveadm mailbox status -u bubbacheex3 "messages" INBOX > INBOX messages=53 > > # doveadm mailbox status -u bubbacheex3 "guid" INBOX > INBOX guid=bf976912f3748957761d0100f906a3d0 > > # doveadm mailbox status -u bubbacheex3 "unseen" INBOX > INBOX unseen=52 > > # doveadm mailbox status -u bubbacheex3 "vsize" INBOX > doveadm(bubbacheex3): Panic: file file-lock.c: line 269: unreached > Abort trap > Have you checked that line 269 in file-lock.c? https://github.com/dovecot/core/blob/master/src/lib/file-lock.c#L269 Do you have write access to the mail folder of the user? I'm not sure anymore, maybe a workaround for me was: -o lock_method=fcntl Using fcntl instead of dotlock for that command... Or I made sure to have write access to the mail folder of the user... Or both.... I don't remember anymore. Maybe someone can explain why dotlock is not supported in that code path. Michael From cheeks at swcp.com Tue Jul 19 23:49:56 2016 From: cheeks at swcp.com (Mark Costlow) Date: Tue, 19 Jul 2016 17:49:56 -0600 Subject: Panic when runing "doveadm mailbox status ... vsize" In-Reply-To: References: <20160719192338.GA40077@same.swcp.com> Message-ID: <20160719234956.GA51082@same.swcp.com> Thank you for pushing me in the right direction! I originally used "lock_method = dotlock" on this server. I had gotten to a point in trouble-shooting where i thought I should change to fcntl, which I did. BUT I did not restart dovecot! I just did that, and now "vsize" works. I don't have a theory for why dotlock wouldn't be supported in that path. Thanks again, Mark On Wed, Jul 20, 2016 at 01:25:44AM +0200, Michael Kliewe wrote: > Hi Mark, > > Am 19.07.2016 um 21:23 schrieb Mark Costlow: > > I have converted some test users and they generally work fine. But > > when I run "doveadm mailbox status" I get a Panic if I ask for the > > vsize field (or "all"), but other fields work fine. For example: > > > > # doveadm mailbox status -u bubbacheex3 "messages" INBOX > > INBOX messages=53 > > > > # doveadm mailbox status -u bubbacheex3 "guid" INBOX > > INBOX guid=bf976912f3748957761d0100f906a3d0 > > > > # doveadm mailbox status -u bubbacheex3 "unseen" INBOX > > INBOX unseen=52 > > > > # doveadm mailbox status -u bubbacheex3 "vsize" INBOX > > doveadm(bubbacheex3): Panic: file file-lock.c: line 269: unreached > > Abort trap > > > Have you checked that line 269 in file-lock.c? > https://github.com/dovecot/core/blob/master/src/lib/file-lock.c#L269 > > Do you have write access to the mail folder of the user? > > I'm not sure anymore, maybe a workaround for me was: > -o lock_method=fcntl > Using fcntl instead of dotlock for that command... > Or I made sure to have write access to the mail folder of the user... Or > both.... I don't remember anymore. > > Maybe someone can explain why dotlock is not supported in that code path. > > Michael -- Mark Costlow | Southwest Cyberport | Fax: +1-505-232-7975 cheeks at swcp.com | Web: www.swcp.com | Voice: +1-505-232-7992 Mail Minder - Intelligent Push Notifications for Email on the iPhone http://mailminderapp.com/download or in the App Store From stargate at tango.lu Wed Jul 20 12:51:25 2016 From: stargate at tango.lu (Luescher Claude) Date: Wed, 20 Jul 2016 14:51:25 +0200 Subject: Replication sieve scripts. In-Reply-To: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> References: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> Message-ID: <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> I did eventually was forced to do this and setup a 2 node test environment with the latest dovecot: /usr/dovecot/sbin/dovecot --version 2.2.25 (7be1766) /usr/dovecot/sbin/dovecot --build-options Build options: ioloop=epoll notify=inotify ipv6 openssl io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail SQL drivers: mysql Passdb: checkpassword ldap pam passwd passwd-file shadow sql Userdb: checkpassword ldap nss passwd prefetch passwd-file sql and dovecot-2.2-pigeonhole-0.4.15. It unfortunately made no difference at all. The emails are still replicating while it is completely ignoring the sieve files so there must be a switch in the config for this somewhere. Otherwise I will have to look for other solutions like lsync, rsync to sync them between the nodes. Here is my complete doveconf -n output: # 2.2.25 (7be1766): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.8 auth_cache_size = 1 M auth_mechanisms = plain login cram-md5 default_vsz_limit = 512 M dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it doveadm_port = 7777 login_greeting = mail.company.com is ready login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_gid = vmail mail_location = maildir:~/Maildir mail_plugins = " quota notify replication" mail_uid = vmail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext editheader namespace cyruscompat1 { alias_for = hidden = yes list = no location = prefix = INBOX/ separator = / type = private } namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { antispam_backend = spool2dir antispam_spam = Spam;SPAM antispam_spool2dir_notspam = /home/vmail/spam_training/good/new/%%020lu-%u-%%05lu antispam_spool2dir_spam = /home/vmail/spam_training/bad/new/%%020lu-%u-%%05lu antispam_trash_pattern_ignorecase = trash;Deleted *;?l?ments supprim?s;gel?schte *;&AMk-l&AOk-ments supprim&AOk-s mail_replica = tcp:1.2.3.4 quota = dict:User quota::proxy::quota quota_grace = 10M quota_rule = *:storage=100M quota_rule2 = Trash:storage=+10%% quota_rule3 = Deleted Messages:storage=+10%% quota_status_nouser = DUNNO quota_status_success = DUNNO quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u replication_full_sync_interval = 1 hours sieve = ~/.dovecot.sieve sieve_after = ~/sieve_after sieve_dir = ~/sieve sieve_duplicate_period = 1h sieve_extensions = +editheader sieve_max_redirects = 20 } pop3c_host = pop3.e2advance.net postmaster_address = postmaster at company.com protocols = imap pop3 lmtp imap lmtp sieve pop3 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } user = $default_internal_user } service dict { unix_listener dict { mode = 0600 user = vmail } } service doveadm { inet_listener { port = 7777 } } service imap-login { process_limit = 256 process_min_avail = 5 } service lmtp { unix_listener /var/spool/postfix/public/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 } service quota-status { client_limit = 1 executable = quota-status -p postfix inet_listener { port = 10020 } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_ca = On 2016.07.19. 15:03, Luescher Claude wrote: > >> Hello, Are you sure about that I would need so recent version? That >> is >> ok to have some bugfixes but you are talking about the latest >> cutting >> edge debian jessie backports package. Even the mainline debian >> jessie >> only have 2.2.13 in it and my system is a complex wheezy >> installation, >> the last thing I want to do is to move all my components into jessie >> just because of this or do you know 2.2.15 deb packages built for >> wheezy? My installation is a multi-node cluster already I would have > to >> update all the nodes but if it would be only to install a couple of > new >> debs on them I would not hesitate trying a newer dovecot version. > Thank >> you. > > If you have a huge multi node system, then you need to have testing > system also. It's easy to compile Dovecot by yourself and make deb > packages, if needed. > > -- > KSB From miloslav.hula at gmail.com Wed Jul 20 13:52:46 2016 From: miloslav.hula at gmail.com (=?UTF-8?Q?Miloslav_H=c5=afla?=) Date: Wed, 20 Jul 2016 15:52:46 +0200 Subject: Absolute path in SUBSCRIPTIONS Message-ID: Hello, I'm using following two namespaces with Dovecot 2.2.13-12~deb8u1: namespace inbox { inbox = yes list = yes location = prefix = INBOX. # the previous Cyrus compatibility separator = . subscriptions = yes type = private ... } namespace { inbox = no list = children location = maildir:/vmail/user/%%n/Maildir:INDEXPVT=/vmail/user/%n/Maildir/Shared/%%n prefix = user.%%n. separator = . subscriptions = yes type = shared } For the shared namespace, the subscriptions are stored globally in '/vmail/user/%%n/Maildir/subscribtions' which is bad for me. I would like too keep subscriptions per user. I cannot set 'subscriptions = no' because I have no parent namespace. And when I set :SUBSCRIPTIONS=/vmail/user/%n/Maildir/subscriptions-shared it does not work (absolute path does not work) and it creates file in: /vmail/user/%%n/Maildir/vmail/user/%n/Maildir/subscriptions-shared instead of /vmail/user/%n/Maildir/subscriptions-shared I found, that relative path hack works: :SUBSCRIPTIONS=../../%n/Maildir/subscriptions-shared but I'm not sure it is the legitimate solution. Are there other options? Kind regards, Milo From trashcan at ellael.org Wed Jul 20 13:55:46 2016 From: trashcan at ellael.org (Michael Grimm) Date: Wed, 20 Jul 2016 15:55:46 +0200 Subject: Replication sieve scripts. In-Reply-To: <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> References: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> Message-ID: On 2016-07-20 14:51, Luescher Claude wrote: > I did eventually was forced to do this and setup a 2 node test > environment with the latest dovecot: > > /usr/dovecot/sbin/dovecot --version > 2.2.25 (7be1766) > > /usr/dovecot/sbin/dovecot --build-options > Build options: ioloop=epoll notify=inotify ipv6 openssl > io_block_size=8192 > Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw > fail > SQL drivers: mysql > Passdb: checkpassword ldap pam passwd passwd-file shadow sql > Userdb: checkpassword ldap nss passwd prefetch passwd-file sql > > and dovecot-2.2-pigeonhole-0.4.15. > > It unfortunately made no difference at all. The emails are still > replicating while it is completely ignoring the sieve files so there > must be a switch in the config for this somewhere. I did report a year ago [1] that I did observe mails being synced but no sieves. Although I did report at the end that replication started again, I do have to report today that it stopped again shortly afterwards (even on current version of dovecot and pigeonhole). The only way to get sieves synced in my case is: removing the corresponding files at one server, update the sieve files at the other server [2]. Only then, sieves become synced. On very rare occasions syncing happens without applying the first step just mentioned. This issue looks to me a very subtle one I am unable to reproduce reliably, sorry. HTH, Michael [1] http://dovecot.org/pipermail/dovecot/2015-May/100839.html [2] I can live with that workaround because I am the only user having sieves activated. From stephan at rename-it.nl Wed Jul 20 14:31:55 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 20 Jul 2016 16:31:55 +0200 Subject: Replication sieve scripts. In-Reply-To: <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> References: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> Message-ID: Op 20-7-2016 om 14:51 schreef Luescher Claude: > I did eventually was forced to do this and setup a 2 node test > environment with the latest dovecot: > > > /usr/dovecot/sbin/dovecot --version > 2.2.25 (7be1766) > > > /usr/dovecot/sbin/dovecot --build-options > Build options: ioloop=epoll notify=inotify ipv6 openssl > io_block_size=8192 > Mail storages: shared mdbox sdbox maildir mbox cydir imapc pop3c raw fail > SQL drivers: mysql > Passdb: checkpassword ldap pam passwd passwd-file shadow sql > Userdb: checkpassword ldap nss passwd prefetch passwd-file sql > > and dovecot-2.2-pigeonhole-0.4.15. > > It unfortunately made no difference at all. The emails are still > replicating while it is completely ignoring the sieve files so there > must be a switch in the config for this somewhere. Otherwise I will > have to look for other solutions like lsync, rsync to sync them > between the nodes. Is the doveadm sieve plugin properly installed at both sides of the replication? On my system (Debian Jessie), it is located at /usr/lib/dovecot/modules/doveadm. The file name is lib10_doveadm_sieve_plugin.so. When mail_debug is enabled, the replication should log all kinds of doveadm-sieve debug messages. Any errors in the log? Regards, Stephan. From wlt-ml at o-sinc.com Wed Jul 20 15:58:20 2016 From: wlt-ml at o-sinc.com (William L. Thomson Jr.) Date: Wed, 20 Jul 2016 11:58:20 -0400 Subject: Occasional lock timeouts on Linode VM with Dovecot Replication In-Reply-To: References: Message-ID: Reuben, On Sunday, July 17, 2016 04:18:45 PM Reuben Farrelly wrote: > I've been seeing periodic entries in my dovecot logs like this: > > dovecot[3464]: dsync-server(kaylene): Error: Couldn't lock > /home/kaylene/.dovecot-sync.lock: Timed out after 30 seconds: 3 Time(s) > dovecot[3464]: dsync-server(reuben): Error: Couldn't lock > /home/reuben/.dovecot-sync.lock: Timed out after 30 seconds: 1 Time(s) > > They occur several times per day, but don't appear to have any obvious > cause and I am not aware of any problems this is causing. [They could > be the cause of some reappearing UID type messages that also > periodically are logged, but I can't be sure] > > They occur on a lightly loaded Linode VM, KVM Paravirtualised and with > only local SSD disk storage. The VM is a Gentoo Linux VM running the > latest kernels that Linode provide. I also saw this problem under Xen. I am running the same, Gentoo, replicating Dovecot, on Linode VMs. Only difference is I am using NFS, it seems you are using local disk. I have never had issues like your experiencing. My mail VMs get pretty loaded at times due ASSP and mail volume. I would not think it to be load related what so ever. If you feel it might be specific to that VM you might request Linode move it to a new host machine. I have had one of my mail servers have some issues before and it was host related. Linode opened a ticket and migrated it about the time I got the first Nagios notification. If you get Linode to migrate the VM and it continues, you can rule out the host at least. > Is this a common warning to see in cloud hosted/shared environments? Not to my knowledge, I have never seen that error before. -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: This is a digitally signed message part. URL: From giles at coochey.net Thu Jul 21 11:56:09 2016 From: giles at coochey.net (Giles Coochey) Date: Thu, 21 Jul 2016 12:56:09 +0100 Subject: an e-mail client for dovecot ? In-Reply-To: <578E4A75.9060304@cistron.nl> References: <2033221606.108022.1468656153685.JavaMail.yahoo.ref@mail.yahoo.com> <2033221606.108022.1468656153685.JavaMail.yahoo@mail.yahoo.com> <3908fdba-7cf2-365d-e5a6-ff74145e06c1@rename-it.nl> <578E4A75.9060304@cistron.nl> Message-ID: On 19/07/16 16:42, Miquel van Smoorenburg wrote: > > Known problem. Sort of a indexing thundering herd problem. > > Preferences -> Advanced -> Config Editor, set mail.db.idlelimit to a > large number. I set it to 30000000. Fixed it for me.. > > Mike. If you're using a Thunderbird version > 38 then you don't need to make this change, it is to do with reducing auto closing mail folders and opening them again (which is CPU intensive). If you are using a version > 38 then you should retain the default value to mail.db.idle_limit. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3819 bytes Desc: S/MIME Cryptographic Signature URL: From stargate at tango.lu Thu Jul 21 13:50:35 2016 From: stargate at tango.lu (Luescher Claude) Date: Thu, 21 Jul 2016 15:50:35 +0200 Subject: Replication sieve scripts. In-Reply-To: References: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> Message-ID: <49dc5279a227245dc2f571d84291dd0e@tango.lu> Hello, Thanks for the advice. I have looked for the libs and here is the difference: Dovecot production env 2.2.10: /usr/lib/dovecot/modules/doveadm rw-r--r-- 1 root root 18560 Jan 9 2014 lib10_doveadm_acl_plugin.so -rw-r--r-- 1 root root 14256 Jan 9 2014 lib10_doveadm_expire_plugin.so -rw-r--r-- 1 root root 10232 Jan 9 2014 lib10_doveadm_quota_plugin.so -rw-r--r-- 1 root root 51352 Jan 9 2014 lib10_doveadm_sieve_plugin.so -rw-r--r-- 1 root root 14344 Jan 9 2014 lib20_doveadm_fts_plugin.so Dovecot new test env: /usr/dovecot/lib/dovecot/doveadm -rw-r--r-- 1 root root 140574 Jul 20 12:53 lib10_doveadm_acl_plugin.a -rwxr-xr-x 1 root root 1066 Jul 20 12:53 lib10_doveadm_acl_plugin.la -rwxr-xr-x 1 root root 98910 Jul 20 12:53 lib10_doveadm_acl_plugin.so -rw-r--r-- 1 root root 56108 Jul 20 12:53 lib10_doveadm_expire_plugin.a -rwxr-xr-x 1 root root 1087 Jul 20 12:53 lib10_doveadm_expire_plugin.la -rwxr-xr-x 1 root root 43879 Jul 20 12:53 lib10_doveadm_expire_plugin.so -rw-r--r-- 1 root root 97212 Jul 20 12:53 lib10_doveadm_quota_plugin.a -rwxr-xr-x 1 root root 1080 Jul 20 12:53 lib10_doveadm_quota_plugin.la -rwxr-xr-x 1 root root 63227 Jul 20 12:53 lib10_doveadm_quota_plugin.so -rw-r--r-- 1 root root 338560 Jul 20 12:53 lib10_doveadm_sieve_plugin.a -rwxr-xr-x 1 root root 1286 Jul 20 12:53 lib10_doveadm_sieve_plugin.la -rwxr-xr-x 1 root root 177604 Jul 20 12:53 lib10_doveadm_sieve_plugin.so -rw-r--r-- 1 root root 139748 Jul 20 12:53 lib20_doveadm_fts_plugin.a -rwxr-xr-x 1 root root 1066 Jul 20 12:53 lib20_doveadm_fts_plugin.la -rwxr-xr-x 1 root root 94615 Jul 20 12:53 lib20_doveadm_fts_plugin.so Also I have set the mail_log to debug as you have suggested and I see the following for users in the logs (with my "old" version): Jul 21 11:52:27 server1 dovecot: dsync-server(user1 at company.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Jul 21 11:52:27 server1 dovecot: dsync-server(user1 at company.com): Debug: sieve: Pigeonhole version 0.4.2 initializing Jul 21 11:52:27 server1 dovecot: dsync-server(user1 at company.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Jul 21 11:52:27 server1 dovecot: dsync-server(user1 at company.com): Debug: sieve-storage: using active sieve script path: /home/vmail/company.com/user1 at company.com//.dovecot.sieve Jul 21 11:52:27 server1 dovecot: dsync-server(user1 at company.com): Debug: sieve-storage: using sieve script storage directory: /home/vmail/company.com/user1 at company.com//sieve Jul 21 11:52:27 server1 dovecot: dsync-server(user1 at company.com): Debug: sieve-storage: using permissions from /home/vmail/company.com/user1 at company.com//sieve: mode=0700 gid=-1 Jul 21 11:52:27 server1 dovecot: dsync-server(user1 at company.com): Debug: sieve-storage: relative path to sieve storage in active link: sieve/ Jul 21 15:17:21 server1 dovecot: dsync-local(user2 at company.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Jul 21 15:17:21 server1 dovecot: dsync-local(user2 at company.com): Debug: sieve: Pigeonhole version 0.4.2 initializing Jul 21 15:17:21 server1 dovecot: dsync-local(user2 at company.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Jul 21 15:17:21 server1 dovecot: dsync-local(user2 at company.com): Debug: sieve-storage: using active sieve script path: /home/vmail/company.com/user2 at company.com//.dovecot.sieve Jul 21 15:17:21 server1 dovecot: dsync-local(user2 at company.com): Debug: sieve-storage: using sieve script storage directory: /home/vmail/company.com/user2 at company.com//sieve Jul 21 15:17:21 server1 dovecot: dsync-local(user2 at company.com): Debug: sieve-storage: using permissions from /home/vmail/company.com/user2 at company.com//sieve: mode=0700 gid=-1 Jul 21 15:17:21 server1 dovecot: dsync-local(user2 at company.com): Debug: sieve-storage: relative path to sieve storage in active link: sieve/ Jul 21 15:17:21 server1 dovecot: dsync-local(user3 at company.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Jul 21 15:17:21 server1 dovecot: dsync-local(user3 at company.com): Debug: sieve: Pigeonhole version 0.4.2 initializing Jul 21 15:17:21 server1 dovecot: dsync-local(user3 at company.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Jul 21 15:17:21 server1 dovecot: dsync-local(user3 at company.com): Debug: sieve-storage: using active sieve script path: /home/vmail/company.com/user3 at company.com//.dovecot.sieve First problem I notice is this /home/vmail/company.com/user1 at company.com//.dovecot.sieve missing. Is this supposed to be a file or a directory? The second sieve_global_dir, I don't need global rules. The third is this minus gid=-1 value. The user/group/rights on that directory is not different from the mail dirs (where the replication works): ls -al /home/vmail/company.com/user2 at company.com//sieve drwx--S--- 2 vmail vmail 4096 Jul 21 15:17 tmp The important directory for me is the siev_after because roundcube vacation plugin puts the sieves in there for example: -rw------- 1 vmail vmail 413 Jul 21 15:23 01_vacation.sieve -rw------- 1 vmail vmail 124 Jul 21 15:23 01_vacation.svbin -rw-r--r-- 1 vmail vmail 193 Feb 26 2014 antispam.sieve -rw-r--r-- 1 vmail vmail 272 Apr 13 2015 antispam.svbin Gets created after setting out of office message but will not get replicated to the other node. As I have showed in my earlier doveconf output is defined: sieve = ~/.dovecot.sieve sieve_after = ~/sieve_after sieve_dir = ~/sieve sieve_duplicate_period = 1h sieve_extensions = +editheader sieve_max_redirects = 20 And the sieve scripts work locally per server they are just not replicating as they should be. On Wed, 20 Jul 2016 16:31:55 +0200, Stephan Bosch wrote: > Op 20-7-2016 om 14:51 schreef Luescher Claude: > >> I did eventually was forced to do this and setup a 2 node test >> environment with the latest dovecot: /usr/dovecot/sbin/dovecot >> --version 2.2.25 (7be1766) /usr/dovecot/sbin/dovecot --build-options >> Build options: ioloop=epoll notify=inotify ipv6 openssl >> io_block_size=8192 Mail storages: shared mdbox sdbox maildir mbox > cydir >> imapc pop3c raw fail SQL drivers: mysql Passdb: checkpassword ldap >> pam >> passwd passwd-file shadow sql Userdb: checkpassword ldap nss passwd >> prefetch passwd-file sql and dovecot-2.2-pigeonhole-0.4.15. It >> unfortunately made no difference at all. The emails are still >> replicating while it is completely ignoring the sieve files so there >> must be a switch in the config for this somewhere. Otherwise I will >> have to look for other solutions like lsync, rsync to sync them > between >> the nodes. > > Is the doveadm sieve plugin properly installed at both sides of the > replication? On my system (Debian Jessie), it is located at > /usr/lib/dovecot/modules/doveadm. The file name is > lib10_doveadm_sieve_plugin.so. > > When mail_debug is enabled, the replication should log all kinds of > doveadm-sieve debug messages. > > Any errors in the log? > > Regards, > > Stephan. From dovecot-ml at seichter.de Thu Jul 21 14:27:41 2016 From: dovecot-ml at seichter.de (Ralph Seichter) Date: Thu, 21 Jul 2016 16:27:41 +0200 Subject: Suggested improvement for antispam plugin documentation Message-ID: <64d13bc0-fc74-6da7-9181-8e1e5a1bc8cc@seichter.de> Hello, I struggled a bit with getting the antispam plugin to work, because the plugin configuration in http://wiki2.dovecot.org/Plugins/Antispam is incomplete. After some twiddling, I ended up with this: # /etc/dovecot/conf.d/90-plugin.conf plugin { antispam_backend = mailtrain antispam_mail_spam = spam antispam_mail_notspam = ham antispam_mail_sendmail = /path/to/mailtrain/script antispam_spam = Junk;Spam antispam_trash = Deleted Messages;Trash } I know that the antispam plugin has not yet been officially released, but I think it might be worth updating the documentation anyway. Your thoughts? -Ralph From stephan at rename-it.nl Thu Jul 21 15:19:25 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 21 Jul 2016 17:19:25 +0200 Subject: Replication sieve scripts. In-Reply-To: <49dc5279a227245dc2f571d84291dd0e@tango.lu> References: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> <49dc5279a227245dc2f571d84291dd0e@tango.lu> Message-ID: Op 21-7-2016 om 15:50 schreef Luescher Claude: > Hello, > > Thanks for the advice. I have looked for the libs and here is the > difference: > [...] > First problem I notice is this > /home/vmail/company.com/user1 at company.com//.dovecot.sieve missing. Is > this supposed to be a file or a directory? > The second sieve_global_dir, I don't need global rules. > The third is this minus gid=-1 value. The user/group/rights on that > directory is not different from the mail dirs (where the replication > works): > > ls -al /home/vmail/company.com/user2 at company.com//sieve > drwx--S--- 2 vmail vmail 4096 Jul 21 15:17 tmp > > The important directory for me is the siev_after because roundcube > vacation plugin puts the sieves in there for example: > > -rw------- 1 vmail vmail 413 Jul 21 15:23 01_vacation.sieve > -rw------- 1 vmail vmail 124 Jul 21 15:23 01_vacation.svbin > -rw-r--r-- 1 vmail vmail 193 Feb 26 2014 antispam.sieve > -rw-r--r-- 1 vmail vmail 272 Apr 13 2015 antispam.svbin > > Gets created after setting out of office message but will not get > replicated to the other node. > > As I have showed in my earlier doveconf output is defined: > > sieve = ~/.dovecot.sieve > sieve_after = ~/sieve_after > sieve_dir = ~/sieve > sieve_duplicate_period = 1h > sieve_extensions = +editheader > sieve_max_redirects = 20 > > And the sieve scripts work locally per server they are just not > replicating as they should be. There is your problem. The sieve_after/sieve_before settings usually point to administrator-controlled global scripts. Therefore, these are not replicated by the doveadm_sieve plugin. Only the user's scripts in the ~/sieve directory and the active script marked by ~/.dovecot.sieve (symlink) are replicated. Regards, Stephan. From dovecot at mx24.net Thu Jul 21 22:19:58 2016 From: dovecot at mx24.net (Vince42) Date: Fri, 22 Jul 2016 00:19:58 +0200 Subject: SSL connection reset by peer Message-ID: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> Hi, I am running a dovecot server and have set up an external monitoring, where every five minutes a login with SSL on port 993 is done. I usually get once a day an error "connection reset by peer - SSL connect", which goes away until the next monitor is executed. Initially I thought that raising the mail_max_userip_connections in protocol imap in 20-imap.conf to 256 should do the trick - but the error stays. What could be the reason for this error and which configuration values could be changed in order to avoid this error? I read a lot of different suggestions - but did not find a plausible explanation and recommendation. Thanks in advance! -- Cheers, \\|// Vince (o o) ----------------------------ooO-(_)-Ooo------------------------- ''' (o)_(o) [ ][0][ ] ??? (=?o?=) World Domination by Copy and Paste [ ][ ][0] - (")_(") [0][0][0] () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments Ooo. ---------------------------.ooO----( )------------------------- ( ) (_/ \_) From stargate at tango.lu Fri Jul 22 08:43:12 2016 From: stargate at tango.lu (Luescher Claude) Date: Fri, 22 Jul 2016 10:43:12 +0200 Subject: Replication sieve scripts. In-Reply-To: References: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> <49dc5279a227245dc2f571d84291dd0e@tango.lu> Message-ID: Hello, Ok so I have set everything to ~/sieve dir on the 2 nodes: >doveconf -n | grep siev managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave editheader sieve = ~/.dovecot.sieve sieve_after = ~/sieve sieve_before = ~/sieve sieve_dir = ~/sieve sieve_extensions = +editheader sieve_max_redirects = 20 protocols = " imap lmtp sieve pop3" service managesieve-login { inet_listener sieve { mail_plugins = " quota notify replication sieve" mail_plugins = " quota notify replication sieve" This way after I add a brand new user the sieve dir will be replicated but nothing after that. I have added a new user on node2 then enabled out of office message, the sieve files were created under the: /home/vmail/company.com/user5 at company.com/sieve -rw------- 1 vmail vmail 1011 Jul 22 09:49 01_vacation.sieve -rw------- 1 vmail vmail 644 Jul 22 09:49 01_vacation.svbin directory but were never replicated not even after restarting both dove nodes. Node2 Jul 22 09:47:54 mailnode2 dovecot: dsync-local(user5 at company.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Jul 22 09:47:54 mailnode2 dovecot: dsync-local(user5 at company.com): Debug: sieve: Pigeonhole version 0.4.2 initializing Jul 22 09:47:54 mailnode2 dovecot: dsync-local(user5 at company.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Jul 22 09:47:54 mailnode2 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: using active sieve script path: /home/vmail/company.com/user5 at company.com//.dovecot.sieve Jul 22 09:47:54 mailnode2 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: using sieve script storage directory: /home/vmail/company.com/user5 at company.com//sieve Jul 22 09:47:54 mailnode2 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: permission lookup failed from /home/vmail/company.com/user5 at company.com//sieve Jul 22 09:47:54 mailnode2 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: created storage directory /home/vmail/company.com/user5 at company.com//sieve/tmp Jul 22 09:47:54 mailnode2 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: relative path to sieve storage in active link: sieve/ Jul 22 09:47:54 mailnode2 dovecot: dsync-server(user5 at company.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Jul 22 09:47:54 mailnode2 dovecot: dsync-server(user5 at company.com): Debug: sieve: Pigeonhole version 0.4.2 initializing Jul 22 09:47:54 mailnode2 dovecot: dsync-server(user5 at company.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Jul 22 09:47:54 mailnode2 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: using active sieve script path: /home/vmail/company.com/user5 at company.com//.dovecot.sieve Jul 22 09:47:54 mailnode2 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: using sieve script storage directory: /home/vmail/company.com/user5 at company.com//sieve Jul 22 09:47:54 mailnode2 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: using permissions from /home/vmail/company.com/user5 at company.com//sieve: mode=0700 gid=-1 Jul 22 09:47:54 mailnode2 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: relative path to sieve storage in active link: sieve/ Node1 Jul 22 09:50:16 mailnode1 dovecot: dsync-server(user5 at company.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Jul 22 09:50:16 mailnode1 dovecot: dsync-server(user5 at company.com): Debug: sieve: Pigeonhole version 0.4.2 initializing Jul 22 09:50:16 mailnode1 dovecot: dsync-server(user5 at company.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Jul 22 09:50:16 mailnode1 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: using active sieve script path: /home/vmail/company.com/user5 at company.com//.dovecot.sieve Jul 22 09:50:16 mailnode1 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: using sieve script storage directory: /home/vmail/company.com/user5 at company.com//sieve Jul 22 09:50:16 mailnode1 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: permission lookup failed from /home/vmail/company.com/user5 at company.com//sieve Jul 22 09:50:16 mailnode1 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: created storage directory /home/vmail/company.com/user5 at company.com//sieve/tmp Jul 22 09:50:16 mailnode1 dovecot: dsync-server(user5 at company.com): Debug: sieve-storage: relative path to sieve storage in active link: sieve/ Jul 22 09:50:16 mailnode1 dovecot: dsync-local(user5 at company.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Jul 22 09:50:16 mailnode1 dovecot: dsync-local(user5 at company.com): Debug: sieve: Pigeonhole version 0.4.2 initializing Jul 22 09:50:16 mailnode1 dovecot: dsync-local(user5 at company.com): Debug: sieve: include: sieve_global_dir is not set; it is currently not possible to include `:global' scripts. Jul 22 09:50:16 mailnode1 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: using active sieve script path: /home/vmail/company.com/user5 at company.com//.dovecot.sieve Jul 22 09:50:16 mailnode1 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: using sieve script storage directory: /home/vmail/company.com/user5 at company.com//sieve Jul 22 09:50:16 mailnode1 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: using permissions from /home/vmail/company.com/user5 at company.com//sieve: mode=0700 gid=-1 Jul 22 09:50:16 mailnode1 dovecot: dsync-local(user5 at company.com): Debug: sieve-storage: relative path to sieve storage in active link: sieve/ On Thu, 21 Jul 2016 17:19:25 +0200, Stephan Bosch wrote: > Op 21-7-2016 om 15:50 schreef Luescher Claude: > >> Hello, Thanks for the advice. I have looked for the libs and here is >> the difference: > > [...] > >> First problem I notice is this >> /home/vmail/company.com/user1 at company.com [1]//.dovecot.sieve >> missing. >> Is this supposed to be a file or a directory? The second >> sieve_global_dir, I don't need global rules. The third is this minus >> gid=-1 value. The user/group/rights on that directory is not >> different >> from the mail dirs (where the replication works): ls -al >> /home/vmail/company.com/user2 at company.com [2]//sieve drwx--S--- 2 > vmail >> vmail 4096 Jul 21 15:17 tmp The important directory for me is the >> siev_after because roundcube vacation plugin puts the sieves in >> there >> for example: -rw------- 1 vmail vmail 413 Jul 21 15:23 >> 01_vacation.sieve -rw------- 1 vmail vmail 124 Jul 21 15:23 >> 01_vacation.svbin -rw-r--r-- 1 vmail vmail 193 Feb 26 2014 >> antispam.sieve -rw-r--r-- 1 vmail vmail 272 Apr 13 2015 >> antispam.svbin >> Gets created after setting out of office message but will not get >> replicated to the other node. As I have showed in my earlier >> doveconf >> output is defined: sieve = ~/.dovecot.sieve sieve_after = > ~/sieve_after >> sieve_dir = ~/sieve sieve_duplicate_period = 1h sieve_extensions = >> +editheader sieve_max_redirects = 20 And the sieve scripts work > locally >> per server they are just not replicating as they should be. > > There is your problem. The sieve_after/sieve_before settings usually > point to administrator-controlled global scripts. Therefore, these > are > not replicated by the doveadm_sieve plugin. Only the user's scripts > in > the ~/sieve directory and the active script marked by > ~/.dovecot.sieve > (symlink) are replicated. > > Regards, > > Stephan. Links: ------ [1] mailto:/home/vmail/company.com/user1 at company.com [2] mailto:/home/vmail/company.com/user2 at company.com From damir at cargosoft.ru Fri Jul 22 09:29:36 2016 From: damir at cargosoft.ru (damir) Date: Fri, 22 Jul 2016 12:29:36 +0300 Subject: Disable auth_ssl_require_client_cert for SASL Message-ID: <4f6a150f-65ef-29ae-9634-aa2d62bf0898@cargosoft.ru> Hello! Dovecot version - 2.2.6 Postfix version - 2.10.2 OS: Mageia Linux 4 x86_64 I have configured Dovecot imaps-server on 993 port to authenticate users via private certificates: auth_ssl_require_client_cert = yes auth_ssl_username_from_cert = no Users' database is in OpenLDAP and in dovecot-ldap.conf.ext checking of users' passwords is disabled: pass_attrs = uid=%n, mail=%n@%d, =nopassword=1 It all works fine. I have configured Postfix submission-service on 587 port to connect users via StartTLS: submission inet n - y - - smtpd -o smtpd_tls_security_level=encrypt -o smtpd_enforce_tls=yes -o smtpd_tls_req_ccert=yes -o smtpd_tls_ask_ccert=yes -o smtpd_client_restrictions=permit_tls_all_clientcerts,reject -o smtpd_recipient_restrictions=permit_tls_all_clientcerts,reject -o smtpd_helo_restrictions=permit_tls_all_clientcerts,reject It works fine. And now I have a new task: I also need Postfix to authenticate OpenLDAP-users using SASL on smtps-port 465. I need it for using on mobile devices, which don't support StartTLS. So I have configured smtps in Postfix: smtps inet n - y - - smtpd -o smtpd_tls_wrappermode=yes -o smtpd_enforce_tls=yes -o smtpd_sasl_auth_enable=yes -o smtpd_sasl_type=dovecot -o smtpd_sasl_path=private/auth -o smtpd_client_restrictions=permit_sasl_authenticated,reject -o smtpd_recipient_restrictions=permit_sasl_authenticated,reject_unauth_destination -o smtpd_helo_restrictions=permit_sasl_authenticated,reject While trying to connect to smtps, clients get an error: "Client didn't present valid SSL certificate", and this is clear. The question is: how to configure an additional auth-service in dovecot, which doesn't require private certificates and authenticates users using login/password? Configuration-files: dovecot -n: # 2.2.6: /etc/dovecot/dovecot.conf # OS: Linux 3.14.43-server-1.mga4 x86_64 Mageia 4 ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose = yes base_dir = /var/run/dovecot/ first_valid_gid = 12 first_valid_uid = 8 hostname = myexample.com last_valid_gid = 12 last_valid_uid = 8 listen = * login_greeting = Dovecot L ready. login_trusted_networks = 127.0.0.0/8 10.62.0.0/16 mail_debug = yes mail_gid = 12 mail_home = /home/mail/%d/%n mail_location = maildir:/home/mail/%d/%n mail_uid = 8 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = homeDirectory=/home/mail/%d/%n driver = ldap } plugin { sieve = /home/mail/%d/%n/sieve/UsersActiveScript.sieve sieve_before = /var/spool/mail/dovecot.sieve sieve_default = /var/spool/mail/dovecot.sieve sieve_dir = /home/mail/%d/%n/sieve } postmaster_address = admin at myexample.com protocols = imap service anvil { type = anvil unix_listener anvil-auth-penalty { group = mail mode = 0600 user = mail } unix_listener anvil { mode = 0600 user = mail } } service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = mail mode = 0600 user = mail } } service imap-login { inet_listener imap { port = 0 ssl = no } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl_ca = Hi, hope someone can help also if this problem is difficult to debug I have a mail account that has on file system 32GB however quotacalculation gives a higher value 41262146 I've already tried to: - doveadm quota recalc -u user at domain - removing maildirsize from /users/vmail/domain/user/Maildir - checking all emails messages if they have the size in the name (S=xxxx) different from the real size. I used the script here in attach giving it in input the output of << find /users/vmail/domain/user -name *S=* -type f>> I don't have mail compression the mail account have a lot of mailboxes and at now 78319 messages doveadm quota get -u user at domain Quota name Type Value Limit % User quota STORAGE 41262146 42991616 95 User quota MESSAGE 78319 - 0 this is the same command run with -Dv doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so doveadm(root): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm doveadm(root): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(root): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) doveadm(root): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(user at domain): Debug: Added userdb setting: mail_location=maildir:/users/vmail/domain/user/Maildir doveadm(user at domain): Debug: Added userdb setting: plugin/quota_rule=*:storage=41G doveadm(user at domain): Debug: Effective uid=5000, gid=5000, home=/users/vmail/domain/user doveadm(user at domain): Debug: Quota root: name=User quota backend=maildir args= doveadm(user at domain): Debug: Quota rule: root=User quota mailbox=* bytes=44023414784 messages=0 doveadm(user at domain): Debug: Quota warning: bytes=41822244044 (95%) messages=0 reverse=no command=quota-warning 95 user at domain doveadm(user at domain): Debug: Quota grace: root=User quota bytes=20971520 doveadm(user at domain): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/users/vmail/domain/user/Maildir doveadm(user at domain): Debug: maildir++: root=/users/vmail/domain/user/Maildir, index=, indexpvt=, control=, inbox=/users/vmail/domain/user/Maildir, alt= Quota name Type Value Limit % User quota STORAGE 41202926 42991616 95 User quota MESSAGE 78247 - hope someone can help I'm running dovecot-2.2.10-5.el7 on centos7 -------------- next part -------------- A non-text attachment was scrubbed... Name: messagesize_check_mismatch.pl Type: application/x-perl Size: 485 bytes Desc: not available URL: From mays at win.net Fri Jul 22 20:15:02 2016 From: mays at win.net (Joseph Mays) Date: Fri, 22 Jul 2016 16:15:02 -0400 Subject: "Invalid characters in atom" when squirrelmail plugin connects to managesieve In-Reply-To: <75a40d9d-7b63-cf12-dbfd-8e1617973c34@gmail.com> References: <75a40d9d-7b63-cf12-dbfd-8e1617973c34@gmail.com> Message-ID: <0571C2129C7A4022A9A231E45D0B279D@Gantry> I found a similar error to this posted on the dovecot list from 2013, but no solution. I'm using the avelsieve squirrelmail plugin with dovecot. It throws an error when it connects to managesieve. dovecot version is 2.0.19 ngrep of the connection shows.... T 127.0.0.1:4190 -> 127.0.0.1:55753 [AP] "IMPLEMENTATION" "Dovecot Pigeonhole".."SIEVE" "fileinto reject envelope en coded-character vacation subaddress comparator-i;ascii-numeric relational r egex imap4flags copy include variables body enotify environment mailbox dat e ihave".."NOTIFY" "mailto".."SASL" "PLAIN LOGIN CRAM-MD5".."VERSION" "1.0" ..OK "Dovecot ready.".. ## T 127.0.0.1:55753 -> 127.0.0.1:4190 [AP] AUTHENTICATE "PLAIN" \{80+}.. ## T 127.0.0.1:55753 -> 127.0.0.1:4190 [AP] bWF5c0A0c2Vhc29uc3Jlc29ydC5jb20AbWF5c0A0c2Vhc29uc3Jlc29ydC5jb20AZmxvdmVyMDk xNw==.. ## T 127.0.0.1:4190 -> 127.0.0.1:55753 [AP] NO "Invalid characters in atom"..NO "Error in MANAGESIEVE command received by server.".. From bill at KnoxvilleChristian.org Fri Jul 22 21:03:45 2016 From: bill at KnoxvilleChristian.org (Bill Shirley) Date: Fri, 22 Jul 2016 17:03:45 -0400 Subject: Managesieve problem In-Reply-To: <591518D5620B43508D65D2F84A62C642@Gantry> References: <1B922077BA184F11ADCAD5B32A1D60E3@Gantry> <591518D5620B43508D65D2F84A62C642@Gantry> Message-ID: What directory is sieve configures to use? Mine is: sieve = ~/Maildir/dovecot.sieve Which is: drwxr-xr-x. 13 root root system_u:object_r:home_root_t:s0 4096 Jul 17 2015 /home drwx------. 13 bill bill unconfined_u:object_r:user_home_dir_t:s0 4096 Aug 30 2015 /home/bill drwx------. 84 bill bill system_u:object_r:mail_home_rw_t:s0 8192 Jul 22 17:02 /home/bill/Maildir drwxr-x---. 3 bill bill system_u:object_r:mail_home_rw_t:s0 4096 May 27 08:09 /home/bill/Maildir/sieve Bill On 7/19/2016 7:19 PM, Joseph Mays wrote: > Sorry, meant to include the dovecot version. > > root at 4s-mail:~# dovecot --version > 2.0.19 > > -----Original Message----- From: Joseph Mays > Sent: Tuesday, July 19, 2016 7:03 PM > To: dovecot at dovecot.org > Subject: Managesieve problem > > Trying to get either avelsieve or server side filters to work with managesieve. Managesieve is running but whenever avelsieve > or the server settings backend try to talk to it the same thing happens. So I guess it's really a problem with something about > managesieve at this point. I hit the Message Filters option, it takes a long time for it to come back, though it finally just > times out and does nothing, and immediately when I click on the Message Filters link the following two messages appear in > /var/log/dovecot.... > > 2016-07-18 17:03:02 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied > (euid=108() egid=65534() missing +x perm: /, dir owned by 0:111 mode=0750) > 2016-07-18 17:03:02 managesieve-login: Error: auth: connect(login) in directory / failed: Permission denied > (euid=108() egid=65534() missing +x perm: /, dir owned by 0:111 mode=0750) > > Seems to be straightforwardly a permissions error on a directory, but I don't believe it's really the / directory, so which > directory is it? Any insights on where to look would be appreciated. From alessio at skye.it Sat Jul 23 08:05:12 2016 From: alessio at skye.it (Alessio Cecchi) Date: Sat, 23 Jul 2016 10:05:12 +0200 Subject: Doveadm error In-Reply-To: <1974283857.141.1468591395901@appsuite-dev.open-xchange.com> References: <1974283857.141.1468591395901@appsuite-dev.open-xchange.com> Message-ID: Il 15.07.2016 16:03 aki.tuomi at dovecot.fi ha scritto: >> On July 12, 2016 at 4:30 PM L?szl? K?rolyi wrote: >> >> >> Hey everyone, >> >> I've got a weird error since I upgraded to the latest dovecot on my >> FreeBSD box: >> >> root at postfixjail /# doveadm quota recalc -u xxx at xxx.com >> doveadm(xxx at xxx.com): Error: dict-client: Commit failed: Deinit >> fish: 'doveadm quota recalc -u xxx@?' terminated by signal SIGSEGV >> (Address boundary error) >> root at postfixjail /# dovecot --version >> 2.2.25 (7be1766) [...] > > > Hi > > This bug is being fixed. Hi Aki, in what version of dovecot is being fixed? I still have the error: # dovecot --version 2.2.25.2 (624a8f8) # doveadm quota recalc -u alessio at skye.it doveadm(alessio at skye.it): Error: dict-client: Commit failed: Deinit Up to version 2.2.24 working fine. Thanks -- Alessio Cecchi Postmaster AT http://www.qboxmail.it http://www.linkedin.com/in/alessice From lefty at spes.gr Sat Jul 23 08:40:09 2016 From: lefty at spes.gr (Lefteris Tsintjelis) Date: Sat, 23 Jul 2016 11:40:09 +0300 Subject: Doveadm error In-Reply-To: References: <1974283857.141.1468591395901@appsuite-dev.open-xchange.com> Message-ID: <557B851A-2DCC-4067-A549-9E0AFA3700F8@spes.gr> On 23 Jul 2016, at 11:05, Alessio Cecchi wrote: > > Il 15.07.2016 16:03 aki.tuomi at dovecot.fi ha scritto: >>> On July 12, 2016 at 4:30 PM L?szl? K?rolyi wrote: >>> Hey everyone, >>> I've got a weird error since I upgraded to the latest dovecot on my FreeBSD box: >>> root at postfixjail /# doveadm quota recalc -u xxx at xxx.com >>> doveadm(xxx at xxx.com): Error: dict-client: Commit failed: Deinit >>> fish: 'doveadm quota recalc -u xxx@?' terminated by signal SIGSEGV (Address boundary error) >>> root at postfixjail /# dovecot --version >>> 2.2.25 (7be1766) > > [...] > >> Hi >> This bug is being fixed. > > Hi Aki, > > in what version of dovecot is being fixed? I still have the error: > > # dovecot --version > 2.2.25.2 (624a8f8) > > # doveadm quota recalc -u alessio at skye.it > doveadm(alessio at skye.it): Error: dict-client: Commit failed: Deinit > > Up to version 2.2.24 working fine. It is working fine here with no errors and I use FreeBSD also with dovecot ?version 2.2.25 (7be1766) From dovecot at mx24.net Sat Jul 23 12:24:01 2016 From: dovecot at mx24.net (Vince42) Date: Sat, 23 Jul 2016 14:24:01 +0200 Subject: SSL connection reset by peer In-Reply-To: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> References: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> Message-ID: <1b5f8a01-d00a-d2ab-baa0-1cd576dd0f8e@mx24.net> Hi, [Vince42] - [2016-07-22 00:19] > I am running a dovecot server and have set up an external monitoring, > where every five minutes a login with SSL on port 993 is done. I usually > get once a day an error "connection reset by peer - SSL connect", which > goes away until the next monitor is executed. > > Initially I thought that raising the mail_max_userip_connections in > protocol imap in 20-imap.conf to 256 should do the trick - but the error > stays. > > What could be the reason for this error and which configuration values > could be changed in order to avoid this error? > > I read a lot of different suggestions - but did not find a plausible > explanation and recommendation. Anybody? Sorry for bumping this thread ... but I am really desperately looking for some configuration issues to scrutinize ... -- Cheers, \\|// Vince (o o) ----------------------------ooO-(_)-Ooo------------------------- ''' (o)_(o) [ ][0][ ] ??? (=?o?=) World Domination by Copy and Paste [ ][ ][0] - (")_(") [0][0][0] () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments Ooo. ---------------------------.ooO----( )------------------------- ( ) (_/ \_) From dovecot at cloudzeeland.nl Sat Jul 23 12:26:29 2016 From: dovecot at cloudzeeland.nl (Jos Chrispijn) Date: Sat, 23 Jul 2016 14:26:29 +0200 Subject: Thunderbird | Attachments failed opened Message-ID: <2ec97ee0-8b02-e625-5a72-5cc7c660d5e1@cloudzeeland.nl> It lately happens that I cannot open attachments in Thunderbird45.2.0. Only when I resend the email to myself I can open it. What could be done? Found out that with Outlook there is noproblem opening these attachments. Thanks, Jos -- AI is no match for natural ignorance From ml+dovecot at valo.at Sat Jul 23 12:50:07 2016 From: ml+dovecot at valo.at (Christian Kivalo) Date: Sat, 23 Jul 2016 14:50:07 +0200 Subject: SSL connection reset by peer In-Reply-To: <1b5f8a01-d00a-d2ab-baa0-1cd576dd0f8e@mx24.net> References: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> <1b5f8a01-d00a-d2ab-baa0-1cd576dd0f8e@mx24.net> Message-ID: Am 23. Juli 2016 14:24:01 MESZ, schrieb Vince42 : >Hi, > >[Vince42] - [2016-07-22 00:19] >> I am running a dovecot server and have set up an external monitoring, >> where every five minutes a login with SSL on port 993 is done. I >usually >> get once a day an error "connection reset by peer - SSL connect", >which >> goes away until the next monitor is executed. >> >> Initially I thought that raising the mail_max_userip_connections in >> protocol imap in 20-imap.conf to 256 should do the trick - but the >error >> stays. >> >> What could be the reason for this error and which configuration >values >> could be changed in order to avoid this error? >> >> I read a lot of different suggestions - but did not find a plausible >> explanation and recommendation. > >Anybody? Sorry for bumping this thread ... but I am really desperately >looking for some configuration issues to scrutinize ... I don't really have a suggestion for configuration but i think maybe some logs and the output of doveconf -n would help. Is the error definitly from your monitoring ip? -- Christian From trashcan at ellael.org Sat Jul 23 16:17:58 2016 From: trashcan at ellael.org (Michael Grimm) Date: Sat, 23 Jul 2016 18:17:58 +0200 Subject: Replication sieve scripts. In-Reply-To: References: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> <49dc5279a227245dc2f571d84291dd0e@tango.lu> Message-ID: Stephan Bosch wrote: > Only the user's scripts in the ~/sieve directory and the active script marked by ~/.dovecot.sieve (symlink) are replicated. I do have those files in those directories: KB> la /var/mail/.homedirs/mike/.dovecot.sieve /var/mail/.homedirs/mike/.sieves/default.sieve lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:38 /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve -rw------- 1 vmail dovecot uarch 5898 Jul 21 19:38 /var/mail/.homedirs/mike/.sieves/default.sieve MW> la /var/mail/.homedirs/mike/.dovecot.sieve /var/mail/.homedirs/mike/.sieves/default.sieve lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:38 /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve -rw------- 1 vmail dovecot uarch 5898 Jul 21 19:38 /var/mail/.homedirs/mike/.sieves/default.sieve KB> ls -al default -rw-r--r-- 1 root wheel 5909 Jul 21 19:39 default KB> doveadm sieve put -u mike -a default < default I do see traffic arriving at MW when listening on the defined port for synchronisation (tcpdump), but the new default file at KB doesn't become synchronized: MW> la /var/mail/.homedirs/mike/.dovecot.sieve /var/mail/.homedirs/mike/.sieves/default.sieve lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:38 /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve -rw------- 1 vmail dovecot uarch 5898 Jul 21 19:38 /var/mail/.homedirs/mike/.sieves/default.sieve If I do remove that file at MW and repeat "doveadm sieve put" at KB, I do see synchronization succeed: MW> rm /var/mail/.homedirs/mike/.sieves/default.sieve MW> la /var/mail/.homedirs/mike/.dovecot.sieve /var/mail/.homedirs/mike/.sieves/default.sieve ls: /var/mail/.homedirs/mike/.sieves/default.sieve: No such file or directory lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:38 /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve KB> doveadm sieve put -u mike -a default < default KB> la /var/mail/.homedirs/mike/.dovecot.sieve /var/mail/.homedirs/mike/.sieves/default.sieve lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:40 /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve -rw------- 1 vmail dovecot uarch 5909 Jul 21 19:40 /var/mail/.homedirs/mike/.sieves/default.sieve MW> la /var/mail/.homedirs/mike/.dovecot.sieve /var/mail/.homedirs/mike/.sieves/default.sieve lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:40 /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve -rw------- 1 vmail dovecot uarch 5909 Jan 1 1970 /var/mail/.homedirs/mike/.sieves/default.sieve The date of the file puzzles me, though. JFTR: This is a recent FreeBSD and ZFS. JFTR: The logfiles do show the very same messages as Claud has shown in his last mail. Regards, Michael From kondybas at gmail.com Sat Jul 23 17:44:56 2016 From: kondybas at gmail.com (=?UTF-8?B?0JDRgNGC0LXQvCDQn9C10YDQtdC60YDQtdGB0L3QuNC5?=) Date: Sat, 23 Jul 2016 20:44:56 +0300 Subject: Converting mailboxes to UTF-8 Message-ID: Is any proven routine to migrate mailboxes from mUTF-7 to UTF-8 encoding? I've try to use doveadm list/mutf7/rename but have been stuck with nested inboxes. Say I have the next structure: INBOX INBOX.??? INBOX.???.??? encoded for FS respectively as .INBOX .INBOX.&BDYESwRA- .INBOX.&BDYESwRA-.&BE8ENARK- ?When I've try to rename ?INBOX.??? with doveadm mailbox rename -u me -s "INBOX.&BDYESwRA-" $(doveadm mailbox mutf7 -7 "INBOX.&BDYESwRA-") I've get the next: .INBOX .INBOX.??? .INBOX.???.&BE8ENARK- ?Sure when I've try to rename ?.INBOX.???.&BE8ENARK- I've get a message that this is not a valid mUTF7-encoded string. So that is the question. From alavarre at gmail.com Sun Jul 24 01:37:44 2016 From: alavarre at gmail.com (C. Andrews Lavarre) Date: Sat, 23 Jul 2016 21:37:44 -0400 Subject: Cannot connect to Dovecot IMAP or POP In-Reply-To: <572A9B76.2010704@pettijohn-web.com> References: <1462406455.14742.34.camel@gmail.com> <572A9B76.2010704@pettijohn-web.com> Message-ID: <1469324264.5653.12.camel@gmail.com> > > Edgar, thank you for your help: > > > > i also noticed your certificate chain is broken. > > > > http://wiki2.dovecot.org/testinstallation > > > > i have worked through this link, thank you > > > > changing permissions for /var/mail/* to > > > > > > root:mail > > > > > > ($UID:$GID = 1000:12) > > > > and then changing /etc/dovecot/users correspondingly to > > > > > > user at privustech.com:{plain}actualpassword:1000:12::/var/ma > > il/vhosts/privustech/user > > > > now allows a normal login. and we can create a new folder (e.g., > > work) and delete it. > > > > If we set permissions to > > > > > > vmail:vmail> > > > 100:5000 > > > > > > and update /etc/dovecot/users correspondingly it fails. > > > > Regardless, despite following FindMailLocation neither we nor the > > system can find the mailbox: > > > > > > > > b select inbox > > > > > > * 0 EXISTS > > > > > > * 0 RECENT > > > > and postfix fails with > > 2016-07-23T21:22:37.312039-04:00 lavarre postfix/error[17088]: > > A8DA2C1BB2: to=, orig_to=, relay > > =none, delay=278572, delays=278271/300/0/0.04, dsn=4.4.2, > > status=deferred (delivery temporarily suspended: conversation with > > mail.privustech.com[private/lmtp] timed out while receiving the > > initial server greeting) > > > > lmtp may be the culprit... > > From alavarre at gmail.com Sun Jul 24 20:03:55 2016 From: alavarre at gmail.com (C. Andrews Lavarre) Date: Sun, 24 Jul 2016 16:03:55 -0400 Subject: Dovecot cannot find mailboxes Message-ID: <1469390635.2503.46.camel@gmail.com> Edgar, thank you for your help: I have solved gaining access from a client (Evolution) via IMAP to the server: I can refresh, add folders, and delete folders. But I am still confounded, as IMAP does not see any mailboxes. Neither we from the command line (telnet, openssl, login, select) nor the system can find the mailbox, despite following FindMailLocation: telnet, openssl, login, then b select inbox * 0 EXISTS * 0 RECENT and postfix fails with 2016-07-23T21:22:37.312039-04:00 lavarre postfix/error[17088]: A8DA2C1BB2: to=, orig_to=, relay But the mailboxes do exist in /var/mail/vhosts/privustech.com/andy and we point to them in /etc/dovecot/users. doveconf -n is attached. ----- Two issues are: 1. file permissions and ownership 2. virtual versus system users 1. It appears that having the correct ownership and permissions on various files is critical (of course), but those parameters must also be included in the interior of the /etc/dovecot/user. So if you change permissions you also must change that file. For example, you said: i also noticed your certificate chain is broken. http://wiki2.dovecot.org/testinstallation I worked through this link, thank you. Changing permissions for the directories /var/mail/* to root:mail ($UID:$GID = 1000:12) and then changing /etc/dovecot/users correspondingly to user at privustech.com :{plain}actualpassword: 1000:12 ::/var/mail/vhosts/privustech.com/user now allows a normal login. and we can create a new folder (e.g., work) and delete it. However, this is at variance with http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall which says to set the ownership to vmail:vmail ($UID:$GID = 100: 5000). Doing so breaks dovecot. 2. The various links suggest that having virtual users is preferable to setting system users. The former do not require directories under /homebut they do require a directory in the mail system, which I have provided under /var/mail/vhosts. It also turns out that for virtual users you must include the domain (andy at privustech.com). Making that change allowed the success reported above. But despite that, we still cannot find the mailboxes on login. Any thoughts on how to have IMAP find the mailboxes (beyond FindMailLocation, which doesn't seem to work for me) would be most appreciated. Kind regards, Andy -------------- next part -------------- # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.1.27-27-default x86_64 openSUSE 42.1 (x86_64) ext4 auth_debug = yes auth_mechanisms = plain login auth_verbose = yes info_log_path = /var/log/dovecot-info.log listen = * log_path = /var/log/dovecot.log mail_debug = yes mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } plugin { sieve = ~/.dovecot.sieve sieve_after = /var/mail/vmail/sieve-after sieve_before = /var/mail/vmail/sieve-before sieve_dir = ~/sieve } protocols = imap pop3 sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl = required ssl_ca = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 10 } From tss at iki.fi Sun Jul 24 22:03:54 2016 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jul 2016 18:03:54 -0400 Subject: Doveadm error In-Reply-To: References: <1974283857.141.1468591395901@appsuite-dev.open-xchange.com> Message-ID: <5F95C09D-891B-48B5-BAAE-1C36F1FB14B8@iki.fi> On 23 Jul 2016, at 04:05, Alessio Cecchi wrote: > > Il 15.07.2016 16:03 aki.tuomi at dovecot.fi ha scritto: >>> On July 12, 2016 at 4:30 PM L?szl? K?rolyi wrote: >>> Hey everyone, >>> I've got a weird error since I upgraded to the latest dovecot on my FreeBSD box: >>> root at postfixjail /# doveadm quota recalc -u xxx at xxx.com >>> doveadm(xxx at xxx.com): Error: dict-client: Commit failed: Deinit >>> fish: 'doveadm quota recalc -u xxx@?' terminated by signal SIGSEGV (Address boundary error) >>> root at postfixjail /# dovecot --version >>> 2.2.25 (7be1766) > > [...] > >> Hi >> This bug is being fixed. > > Hi Aki, > > in what version of dovecot is being fixed? I still have the error: > > # dovecot --version > 2.2.25.2 (624a8f8) > > # doveadm quota recalc -u alessio at skye.it > doveadm(alessio at skye.it): Error: dict-client: Commit failed: Deinit > > Up to version 2.2.24 working fine. Could you get gdb backtrace? Probably just: gdb --args doveadm quota recalc -u user at domain run bt full with 2.2.25.2 you'd need the dovecot-ee-debuginfo package. From tss at iki.fi Sun Jul 24 22:08:39 2016 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jul 2016 18:08:39 -0400 Subject: Converting mailboxes to UTF-8 In-Reply-To: References: Message-ID: On 23 Jul 2016, at 13:44, ????? ??????????? wrote: > > Is any proven routine to migrate mailboxes from mUTF-7 to UTF-8 encoding? For what purpose? By default Dovecot assumes that mailboxes are mUTF-7 on filesystem. > I've try to use doveadm list/mutf7/rename but have been stuck with nested > inboxes. Say I have the next structure: > > INBOX > INBOX.??? > INBOX.???.??? > > encoded for FS respectively as > > .INBOX > .INBOX.&BDYESwRA- > .INBOX.&BDYESwRA-.&BE8ENARK- > > ?When I've try to rename ?INBOX.??? with > > doveadm mailbox rename -u me -s "INBOX.&BDYESwRA-" $(doveadm mailbox mutf7 > -7 "INBOX.&BDYESwRA-") > > I've get the next: > > .INBOX > .INBOX.??? > .INBOX.???.&BE8ENARK- > > ?Sure when I've try to rename ?.INBOX.???.&BE8ENARK- I've get a message > that this is not a valid mUTF7-encoded string. > > So that is the question. I don't think there's any especially easy way to do that. You'd need to write a script that properly goes through the hierarchies and does the renaming. From tss at iki.fi Sun Jul 24 22:11:31 2016 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jul 2016 18:11:31 -0400 Subject: maildirsize calculation gives higher value than a real disk utilization In-Reply-To: <75a40d9d-7b63-cf12-dbfd-8e1617973c34@gmail.com> References: <75a40d9d-7b63-cf12-dbfd-8e1617973c34@gmail.com> Message-ID: On 21 Jul 2016, at 12:54, Andrea Lisci wrote: > > Hi, > > hope someone can help also if this problem is difficult to debug > > I have a mail account that has on file system 32GB however > quotacalculation gives a higher value 41262146 > > I've already tried to: > > - doveadm quota recalc -u user at domain If after quota recalc the quota value is higher than "du" value, try with "du -l" instead. My guess it that the same emails have been copied to multiple folders with hard links. Dovecot counts each instance as its own mail, even though on filesystem they are deduplicated. From tss at iki.fi Sun Jul 24 22:22:04 2016 From: tss at iki.fi (Timo Sirainen) Date: Sun, 24 Jul 2016 18:22:04 -0400 Subject: postconf -n display error for "remote"? In-Reply-To: <338301d1de71$fa0e0ab0$ee2a2010$@mefox.org> References: <338301d1de71$fa0e0ab0$ee2a2010$@mefox.org> Message-ID: <17A6F022-3851-4772-A4FC-FBC9570C75D1@iki.fi> On 15 Jul 2016, at 04:22, Michael Fox wrote: > > Is this a bug? > > I configured the following: > > remote 192.168.7.128/27 { > ssl = no > } > remote 192.168.7.0/24 { > ssl = yes > } > > > But, when I run doveconf -n, I see: > > remote 192.168.7.0/24/24 { > ssl = yes > } > remote 192.168.7.128/27/27 { > ssl = no > } > > Note the repeated network prefix length (/27/27 and /24/24). > > Is there a way to tell for sure whether this is just a cosmetic issue or > something that could cause a problem? I'm pretty sure this was fixed quite a long time ago. From skdovecot at smail.inf.fh-brs.de Mon Jul 25 06:23:34 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 25 Jul 2016 08:23:34 +0200 (CEST) Subject: SSL connection reset by peer In-Reply-To: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> References: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 22 Jul 2016, Vince42 wrote: > I am running a dovecot server and have set up an external monitoring, > where every five minutes a login with SSL on port 993 is done. I usually > get once a day an error "connection reset by peer - SSL connect", which > goes away until the next monitor is executed. that looks like a basic networking issue to me. Do you have logs how many users try to connect at this time? Is it always the same time range? Is the server load very high? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBV5WwZnz1H7kL/d9rAQIfcggAyOBqarR7dZw22AUSyqh3WqJh3tNKhtYn jVvROFO29mPjxLzM7UlGp/R6Ys2frJgr5Gsdo+Ep/Eaa05SJwHDo0M6rlGabwLLw SDUqfdZA7eqSMIUn62S1knZYnScjkcXUQnYqLkgViIKt0XvSYiRDOcXpgtA4ZXP6 JkN0l2KTOC46IACSnh1R4p+hbo+A3bHBix78Mx+4vrkYhK1/17l9m1kztG2WkA8U cNgAPsUIxeJZJLlZqmYbadWpQZS2D2p3qWhK42Zt0yWZ5N1XwMp7qS4I5YQWYaxO gnoNJP7ms26tNh13oO6zHmdsB4z4gp1/1q/5IxbqCnoqGT5wJTDcZQ== =7PLg -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Mon Jul 25 06:29:47 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 25 Jul 2016 08:29:47 +0200 (CEST) Subject: Dovecot cannot find mailboxes In-Reply-To: <1469390635.2503.46.camel@gmail.com> References: <1469390635.2503.46.camel@gmail.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 24 Jul 2016, C. Andrews Lavarre wrote: > I have solved gaining access from a client (Evolution) via IMAP to the > server: I can refresh, add folders, and delete folders. But I am still > confounded, as IMAP does not see any mailboxes. Neither we from the > command line (telnet, openssl, login, select) nor the system can find > the mailbox, despite following FindMailLocation: > > telnet, openssl, login, then > b select inbox > * 0 EXISTS > * 0 RECENT > > and postfix fails with > > 2016-07-23T21:22:37.312039-04:00 lavarre postfix/error[17088]: A8DA2C1BB2: to=, orig_to=, relay > > But the mailboxes do exist in /var/mail/vhosts/privustech.com/andy and > we point to them in /etc/dovecot/users. Check: doveadm user -u andy then enable logging and see if Dovecot uses the desired mail location. > > doveconf -n is attached. > > ----- > > Two issues are: > 1. file permissions and ownership > 2. virtual versus system users > > 1. It appears that having the correct ownership and permissions on > various files is critical (of course), but those parameters must also > be included in the interior of the /etc/dovecot/user. So if you change > permissions you also must change that file. > > For example, you said: > > i also noticed your certificate chain is broken. > http://wiki2.dovecot.org/testinstallation > > I worked through this link, thank you. Changing permissions for the > directories /var/mail/* to > > root:mail ($UID:$GID = 1000:12) > > and then changing /etc/dovecot/users correspondingly to > > user at privustech.com :{plain}actualpassword: 1000:12 ::/var/mail/vhosts/privustech.com/user > > now allows a normal login. and we can create a new folder (e.g., work) > and delete it. However, this is at variance with > http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall > > which says to set the ownership to vmail:vmail ($UID:$GID = 100: > 5000). Doing so breaks dovecot. > > 2. The various links suggest that having virtual users is preferable to > setting system users. The former do not require directories under /homebut they do require a directory in the mail system, which I have provided under /var/mail/vhosts. It also turns out that for virtual users you must include the domain (andy at privustech.com). Making that change allowed the success reported above. But despite that, we still cannot find the mailboxes on login. > > > Any thoughts on how to have IMAP find the mailboxes (beyond > FindMailLocation, which doesn't seem to work for me) would be most > appreciated. > > Kind regards, Andy > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBV5Wx23z1H7kL/d9rAQI0rAf8CIXCVOJAI7zIAtEBr1RWU4fnm4atCU/I NRtqslLp8oXnaoB8S6VCoJqtgrssShzIDlUqa0bEDL0UZTENhRa6afhJ2iD6LFqx ShpC+PG31Njj3Eezcz0AcFplMrKnYqUIF2Sxdc5n7UVHaS6fgf3gxS7/c2O2yjQm XHxSKxioYt6QqneioGuuTh/twdlD5yf2TLmBQIev/lEFFnxsi4toRQuGJKGKpRCD dF5dtO0RQxHlAAjS6EQg3St6eNQ41UVIrM+jencqm4npyEYf0enSoPy9DPkYBRph 0iJim1dtdXqEBIIMjfYyEAQ7kygALMoavgCDPTLZXoyQzmlbg76ihg== =PFXu -----END PGP SIGNATURE----- From alessio at skye.it Mon Jul 25 07:07:53 2016 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 25 Jul 2016 09:07:53 +0200 Subject: Doveadm error In-Reply-To: <5F95C09D-891B-48B5-BAAE-1C36F1FB14B8@iki.fi> References: <1974283857.141.1468591395901@appsuite-dev.open-xchange.com> <5F95C09D-891B-48B5-BAAE-1C36F1FB14B8@iki.fi> Message-ID: <39375be0df80184c6ccc7eb13786cd88@skye.it> Il 25.07.2016 00:03 Timo Sirainen ha scritto: > On 23 Jul 2016, at 04:05, Alessio Cecchi wrote: >> >> Il 15.07.2016 16:03 aki.tuomi at dovecot.fi ha scritto: >>>> On July 12, 2016 at 4:30 PM L?szl? K?rolyi >>>> wrote: >>>> Hey everyone, >>>> I've got a weird error since I upgraded to the latest dovecot on my >>>> FreeBSD box: >>>> root at postfixjail /# doveadm quota recalc -u xxx at xxx.com >>>> doveadm(xxx at xxx.com): Error: dict-client: Commit failed: Deinit >>>> fish: 'doveadm quota recalc -u xxx@?' terminated by signal SIGSEGV >>>> (Address boundary error) >>>> root at postfixjail /# dovecot --version >>>> 2.2.25 (7be1766) >> >> [...] >> >>> Hi >>> This bug is being fixed. >> >> Hi Aki, >> >> in what version of dovecot is being fixed? I still have the error: >> >> # dovecot --version >> 2.2.25.2 (624a8f8) >> >> # doveadm quota recalc -u alessio at skye.it >> doveadm(alessio at skye.it): Error: dict-client: Commit failed: Deinit >> >> Up to version 2.2.24 working fine. > > Could you get gdb backtrace? Probably just: > > gdb --args doveadm quota recalc -u user at domain > run > bt full > > with 2.2.25.2 you'd need the dovecot-ee-debuginfo package. I found the the command works fine but output the error. I will try to get gdb backtrace. Thanks -- Alessio Cecchi Postmaster AT http://www.qboxmail.it http://www.linkedin.com/in/alessice From andrelisci at gmail.com Mon Jul 25 09:25:38 2016 From: andrelisci at gmail.com (Andrea Lisci) Date: Mon, 25 Jul 2016 11:25:38 +0200 Subject: maildirsize calculation gives higher value than a real disk utilization In-Reply-To: References: <75a40d9d-7b63-cf12-dbfd-8e1617973c34@gmail.com> Message-ID: <7a07b8c9-50f9-827f-5b2c-7263e7472fcc@gmail.com> Yes, you are right du -skl /users/vmail/domain/user shows 41565640 su -sk /users/vmail/domain/user shows 33361728 doveadm quota get -u user at domain shows 41354370 so considering checking 'du' by '-l' shows 211270kb of difference from 'quota get'. the mail account was imported by imapsync and the user has made modification to the folder structure by microsoft outlook 2010. What can cause this ? On 07/25/2016 12:11 AM, Timo Sirainen wrote: > On 21 Jul 2016, at 12:54, Andrea Lisci wrote: >> Hi, >> >> hope someone can help also if this problem is difficult to debug >> >> I have a mail account that has on file system 32GB however >> quotacalculation gives a higher value 41262146 >> >> I've already tried to: >> >> - doveadm quota recalc -u user at domain > If after quota recalc the quota value is higher than "du" value, try with "du -l" instead. My guess it that the same emails have been copied to multiple folders with hard links. Dovecot counts each instance as its own mail, even though on filesystem they are deduplicated. > From kondybas at gmail.com Mon Jul 25 09:50:29 2016 From: kondybas at gmail.com (=?UTF-8?B?0JDRgNGC0LXQvCDQn9C10YDQtdC60YDQtdGB0L3QuNC5?=) Date: Mon, 25 Jul 2016 12:50:29 +0300 Subject: Converting mailboxes to UTF-8 In-Reply-To: References: Message-ID: 2016-07-25 1:08 GMT+03:00 Timo Sirainen : > On 23 Jul 2016, at 13:44, ????? ??????????? wrote: > > > > Is any proven routine to migrate mailboxes from mUTF-7 to UTF-8 encoding? > > For what purpose? By default Dovecot assumes that mailboxes are mUTF-7 on > filesystem. > > > I've try to use doveadm list/mutf7/rename but have been stuck with nested > > inboxes. Say I have the next structure: > > > > INBOX > > INBOX.??? > > INBOX.???.??? > > > > encoded for FS respectively as > > > > .INBOX > > .INBOX.&BDYESwRA- > > .INBOX.&BDYESwRA-.&BE8ENARK- > > > > ?When I've try to rename ?INBOX.??? with > > > > doveadm mailbox rename -u me -s "INBOX.&BDYESwRA-" $(doveadm mailbox > mutf7 > > -7 "INBOX.&BDYESwRA-") > > > > I've get the next: > > > > .INBOX > > .INBOX.??? > > .INBOX.???.&BE8ENARK- > > > > ?Sure when I've try to rename ?.INBOX.???.&BE8ENARK- I've get a message > > that this is not a valid mUTF7-encoded string. > > > > So that is the question. > > I don't think there's any especially easy way to do that. You'd need to > write a script that properly goes through the hierarchies and does the > renaming. > > I've thought doveadm behaviour is more straightforward so I've try to keep my sticky hands off the maildir internals. Is any traps with renaming/subscription I have to know? From stargate at tango.lu Mon Jul 25 12:21:54 2016 From: stargate at tango.lu (Luescher Claude) Date: Mon, 25 Jul 2016 14:21:54 +0200 Subject: Replication sieve scripts. In-Reply-To: References: <05c9de41-683d-1000-3f64-e364bb96776d@ksb.id.lv> <6c31da00e8c18b2778cf5cc87d5b6466@tango.lu> <49dc5279a227245dc2f571d84291dd0e@tango.lu> Message-ID: <953b35f9abfbeb8fd753cb16b42a8d2b@tango.lu> Hello, So basically this sieve replication support is still in some broken alfa stage and one should not build production system on top of it. I have found this older thread: http://www.dovecot.org/list/dovecot/2013-February/088640.html We came up with a few options for syncing: 1) rsync/unison ~/sieve every x seconds 2) move sieve dirs to separatate partition and sync with gluster or drbd 3) patch roundcube managesieve sieve plugin to upload to both managesieve servers (only roundcube can access managesieve in our setup) 4) store sieve scripts in mysql and patch roundcube managesieve plugin to directly access the db instead of using managesieve (we tried this, but apparently sieve scripts read from db via dovecot dict can't have more than one line? show stopper due to roundcube sieve plugin needing comments to parse the scripts) The database solution would be perfect since the nodes are using a db master-master cluster but at the time of that post this was not working. My original 2.2.10 dovecot is around that time so I would have to upgrade for that again and at the end it would might not work because as he said roundcube using multi-line sieve scripts. The problem with rsync is that rsync from where? If I rsync from machine A -> B and let's say the user already have sieves on both nodes and changes his holiday sieve on node B then the file will be overwritten. I will give unison a try otherwise I have to put the sieves on a shared filesystem like OCFS2 which imo is not reliable for production either. When nodes lose connectivity that can end in kernel crash, autoreboot on 1 node or both. On Sat, 23 Jul 2016 18:17:58 +0200, Michael Grimm wrote: > Stephan Bosch wrote: > >> Only the user's scripts in the ~/sieve directory and the active >> script >> marked by ~/.dovecot.sieve (symlink) are replicated. > > I do have those files in those directories: > > KB> la /var/mail/.homedirs/mike/.dovecot.sieve > /var/mail/.homedirs/mike/.sieves/default.sieve > lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:38 > /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve > -rw------- 1 vmail dovecot uarch 5898 Jul 21 19:38 > /var/mail/.homedirs/mike/.sieves/default.sieve > > MW> la /var/mail/.homedirs/mike/.dovecot.sieve > /var/mail/.homedirs/mike/.sieves/default.sieve > lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:38 > /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve > -rw------- 1 vmail dovecot uarch 5898 Jul 21 19:38 > /var/mail/.homedirs/mike/.sieves/default.sieve > > KB> ls -al default > -rw-r--r-- 1 root wheel 5909 Jul 21 19:39 default > > KB> doveadm sieve put -u mike -a default < default > > I do see traffic arriving at MW when listening on the defined port > for > synchronisation (tcpdump), but the new default file at KB doesn't > become > synchronized: > > MW> la /var/mail/.homedirs/mike/.dovecot.sieve > /var/mail/.homedirs/mike/.sieves/default.sieve > lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:38 > /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve > -rw------- 1 vmail dovecot uarch 5898 Jul 21 19:38 > /var/mail/.homedirs/mike/.sieves/default.sieve > > If I do remove that file at MW and repeat "doveadm sieve put" at KB, > I > do see synchronization succeed: > > MW> rm /var/mail/.homedirs/mike/.sieves/default.sieve > > MW> la /var/mail/.homedirs/mike/.dovecot.sieve > /var/mail/.homedirs/mike/.sieves/default.sieve > ls: /var/mail/.homedirs/mike/.sieves/default.sieve: No such file or > directory > lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:38 > /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve > > KB> doveadm sieve put -u mike -a default < default > > KB> la /var/mail/.homedirs/mike/.dovecot.sieve > /var/mail/.homedirs/mike/.sieves/default.sieve > lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:40 > /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve > -rw------- 1 vmail dovecot uarch 5909 Jul 21 19:40 > /var/mail/.homedirs/mike/.sieves/default.sieve > > MW> la /var/mail/.homedirs/mike/.dovecot.sieve > /var/mail/.homedirs/mike/.sieves/default.sieve > lrwx------ 1 vmail dovecot uarch 21 Jul 21 19:40 > /var/mail/.homedirs/mike/.dovecot.sieve -> .sieves/default.sieve > -rw------- 1 vmail dovecot uarch 5909 Jan 1 1970 > /var/mail/.homedirs/mike/.sieves/default.sieve > > The date of the file puzzles me, though. > > JFTR: This is a recent FreeBSD and ZFS. > JFTR: The logfiles do show the very same messages as Claud has shown > in > his last mail. > > Regards, > Michael Links: ------ [1] mailto:stephan at rename-it.nl From alessio at skye.it Mon Jul 25 16:09:34 2016 From: alessio at skye.it (Alessio Cecchi) Date: Mon, 25 Jul 2016 18:09:34 +0200 Subject: Doveadm error In-Reply-To: <5F95C09D-891B-48B5-BAAE-1C36F1FB14B8@iki.fi> References: <1974283857.141.1468591395901@appsuite-dev.open-xchange.com> <5F95C09D-891B-48B5-BAAE-1C36F1FB14B8@iki.fi> Message-ID: Il 25.07.2016 00:03 Timo Sirainen ha scritto: > On 23 Jul 2016, at 04:05, Alessio Cecchi wrote: >> >> Il 15.07.2016 16:03 aki.tuomi at dovecot.fi ha scritto: >>>> On July 12, 2016 at 4:30 PM L?szl? K?rolyi >>>> wrote: >>>> Hey everyone, >>>> I've got a weird error since I upgraded to the latest dovecot on my >>>> FreeBSD box: >>>> root at postfixjail /# doveadm quota recalc -u xxx at xxx.com >>>> doveadm(xxx at xxx.com): Error: dict-client: Commit failed: Deinit >>>> fish: 'doveadm quota recalc -u xxx@?' terminated by signal SIGSEGV >>>> (Address boundary error) >>>> root at postfixjail /# dovecot --version >>>> 2.2.25 (7be1766) >> >> [...] >> >>> Hi >>> This bug is being fixed. >> >> Hi Aki, >> >> in what version of dovecot is being fixed? I still have the error: >> >> # dovecot --version >> 2.2.25.2 (624a8f8) >> >> # doveadm quota recalc -u alessio at skye.it >> doveadm(alessio at skye.it): Error: dict-client: Commit failed: Deinit >> >> Up to version 2.2.24 working fine. > > Could you get gdb backtrace? Probably just: > > gdb --args doveadm quota recalc -u user at domain > run > bt full > > with 2.2.25.2 you'd need the dovecot-ee-debuginfo package. Hi, # gdb --args doveadm quota recalc -u alessio at skye.it GNU gdb (GDB) Red Hat Enterprise Linux (7.2-90.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/bin/doveadm...Reading symbols from /usr/lib/debug/usr/bin/doveadm.debug...done. done. (gdb) run Starting program: /usr/bin/doveadm quota recalc -u alessio at skye.it [Thread debugging using libthread_db enabled] doveadm(alessio at skye.it): Error: dict-client: Commit failed: Deinit Program exited normally. Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.5-7.el6_0.x86_64 cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64 dovecot-ee-pigeonhole-2.2.25.2-2.x86_64 glibc-2.12-1.192.el6.x86_64 nspr-4.11.0-1.el6.x86_64 nss-3.21.0-8.el6.x86_64 nss-softokn-freebl-3.14.3-23.el6_7.x86_64 nss-util-3.21.0-2.el6.x86_64 openldap-2.4.40-12.el6.x86_64 zlib-1.2.3-29.el6.x86_64 (gdb) bt full No stack. (gdb) And quota is now correctly update, so doveadm works fine but output the error "Error: dict-client: Commit failed: Deinit". I hope can be fixed. Thanks -- Alessio Cecchi Postmaster AT http://www.qboxmail.it http://www.linkedin.com/in/alessice From dovecot at mx24.net Mon Jul 25 22:19:54 2016 From: dovecot at mx24.net (Vince42) Date: Tue, 26 Jul 2016 00:19:54 +0200 Subject: SSL connection reset by peer In-Reply-To: References: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> <1b5f8a01-d00a-d2ab-baa0-1cd576dd0f8e@mx24.net> Message-ID: Hi, [Christian Kivalo] - [2016-07-23 14:50] > I don't really have a suggestion for configuration but i think maybe > some logs and the output of doveconf -n would help. Is the error > definitly from your monitoring ip? I already searched in the logs but did not find anything obvious. Anything specific I should look for? My dovecot -n looks like this: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-68-generic x86_64 Ubuntu 14.04.4 LTS auth_mechanisms = plain login auth_username_format = %n debug_log_path = /var/log/dovecot.log mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve pop3 service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = References: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> Message-ID: <94489cea-5a4b-de32-3201-4e096d5762aa@mx24.net> Hi, [Steffen Kaiser] - [2016-07-25 08:23] >> I am running a dovecot server and have set up an external monitoring, >> where every five minutes a login with SSL on port 993 is done. I usually >> get once a day an error "connection reset by peer - SSL connect", which >> goes away until the next monitor is executed. > that looks like a basic networking issue to me. > Do you have logs how many users try to connect at this time? Is it > always the same time range? Is the server load very high? My server has nice specs (in fact a 30 times lower scaled server never had this kind of problems), I also don't host many domains and users, therefore I doubt that some kind of limit might be touched. I also suspected some internal system load, but unfortunately the error occurs arbitrarily, which makes me think that no scheduled process is responsible for this. I also ran 'top' during such an event without any obvious load tasks. The system statistics also show no weird peaks. I read about the "running out of random" phenomenon, but during such an event there were still enough resources random-wise. Could it be that I need to offer more login processes or that I should raise some of my configuration values? The mail_max_userip_connections does not seem to solve the problem. -- Cheers, \\|// Vince (o o) ----------------------------ooO-(_)-Ooo------------------------- ''' (o)_(o) [ ][0][ ] ??? (=?o?=) World Domination by Copy and Paste [ ][ ][0] - (")_(") [0][0][0] () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments Ooo. ---------------------------.ooO----( )------------------------- ( ) (_/ \_) From tss at iki.fi Tue Jul 26 01:34:36 2016 From: tss at iki.fi (Timo Sirainen) Date: Mon, 25 Jul 2016 21:34:36 -0400 Subject: SSL connection reset by peer In-Reply-To: <94489cea-5a4b-de32-3201-4e096d5762aa@mx24.net> References: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> <94489cea-5a4b-de32-3201-4e096d5762aa@mx24.net> Message-ID: <9CD81E29-9E39-41C6-A316-AA61EA8E6B84@iki.fi> On 25 Jul 2016, at 18:26, Vince42 wrote: > > Hi, > > [Steffen Kaiser] - [2016-07-25 08:23] >>> I am running a dovecot server and have set up an external monitoring, >>> where every five minutes a login with SSL on port 993 is done. I usually >>> get once a day an error "connection reset by peer - SSL connect", which >>> goes away until the next monitor is executed. > >> that looks like a basic networking issue to me. >> Do you have logs how many users try to connect at this time? Is it >> always the same time range? Is the server load very high? > > My server has nice specs (in fact a 30 times lower scaled server never > had this kind of problems), I also don't host many domains and users, > therefore I doubt that some kind of limit might be touched. I also > suspected some internal system load, but unfortunately the error occurs > arbitrarily, which makes me think that no scheduled process is > responsible for this. I also ran 'top' during such an event without any > obvious load tasks. The system statistics also show no weird peaks. I > read about the "running out of random" phenomenon, but during such an > event there were still enough resources random-wise. > > Could it be that I need to offer more login processes or that I should > raise some of my configuration values? If you are reaching any such limits, a warning is logged. Do you see any errors or warnings at all in logs? From leon at f-m.fm Tue Jul 26 02:30:24 2016 From: leon at f-m.fm (Leon Kyneur) Date: Tue, 26 Jul 2016 10:30:24 +0800 Subject: [2.2.25 auth issue] auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) In-Reply-To: References: <8b872c68-d12d-f270-3b16-a904628a8450@alex-at.ru> Message-ID: <181d40f4-139f-8a93-a9b6-4b20c4da6004@f-m.fm> I am also seeing this error since updating to 2.2.25. I do believe it's only occurring on CRAM-MD5, DIGEST-MD5 and NLTM auth. # dovecot --version 2.2.25 (7be1766) Jul 26 02:10:57 auth-worker(11499): Info: ldap(username,192.168.10.9,): unknown user - trying the next passdb Jul 26 02:10:57 auth-worker(11499): Info: ldap(username at notallocated.com.au,192.168.10.9,): unknown user Jul 26 02:10:57 auth: Panic: file auth-request.c: line 1069 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme) Jul 26 02:10:57 auth: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x8d52e) [0x7f8cf859752e] -> /usr/lib64/dovecot/libdovecot.so.0(+0x8d60e) [0x7f8cf859760e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8cf85361b6] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x1a3aa) [0x7f8cf8c5d3aa] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2714f) [0x7f8cf8c6a14f] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x19f2b) [0x7f8cf8c5cf2b] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](auth_request_lookup_credentials_callback+0x73) [0x7f8cf8c5d033] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](passdb_handle_credentials+0x92) [0x7f8cf8c6d902] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2b106) [0x7f8cf8c6e106] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2081a) [0x7f8cf8c6381a] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7f8cf85aae8c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xff) [0x7f8cf85ac2ef] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7f8cf85aaf15] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8cf85ab0c8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f8cf853c613] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](main+0x3a1) [0x7f8cf8c52be1] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f8cf7b1fb15] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0xfdd1) [0x7f8cf8c52dd1] Jul 26 02:10:57 auth: Fatal: master: service(auth): child 11496 killed with signal 6 (core dumped) Jul 26 02:10:57 pop3-login: Warning: Auth connection closed with 1 pending requests (max 0 secs, pid=11488, EOF) Jul 26 02:10:58 auth-worker(11505): Info: ldap(username at domain.com,192.168.10.9,): unknown user - trying the next passdb Jul 26 02:10:58 auth: Info: passwd-file(username at domain.com,192.168.10.9,): unknown user - trying the next passdb Jul 26 02:10:58 pop3-login: Info: proxy(username at domain.com): started proxying to mailstore03.service.int.oss-core.com:110: user=, method=DIGEST-MD5, rip=192.168.10.9, lip=203.134.11.19, session=, orig_user= Jul 26 02:10:58 pop3-login: Info: proxy(username at domain.com): disconnecting 192.168.10.9 (Disconnected by server(0s idle, in=139, out=4767)): user=, method=DIGEST-MD5, rip=192.168.10.9, lip=203.134.11.19, session=, orig_user= # gdb /usr/libexec/dovecot/auth core-auth-sig6-user97-group97-pid11496-time1469499057 GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-80.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /usr/libexec/dovecot/auth...Reading symbols from /usr/lib/debug/usr/libexec/dovecot/auth.debug...done. done. [New LWP 11496] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/auth'. Program terminated with signal 6, Aborted. #0 0x00007f8cf7b335f7 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig); (gdb) bt full #0 0x00007f8cf7b335f7 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 11496 selftid = 11496 #1 0x00007f8cf7b34ce8 in __GI_abort () at abort.c:90 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x1, sa_sigaction = 0x1}, sa_mask = {__val = {31457280, 140727725664896, 140727725664888, 140243452896936, 140243438753907, 140243445984576, 140243452896936, 513, 6889173324748996864, 140727725665136, 140243438919218, 140243452896936, 140727725665024, 0, 140243438919321, 140243452896936}}, sa_flags = -128374774, sa_restorer = 0x7ffdba192b01} sigs = {__val = {32, 0 }} #2 0x00007f8cf8597526 in default_fatal_finish (type=, status=status at entry=0) at failures.c:201 backtrace = 0x7f8cf93126e0 "/usr/lib64/dovecot/libdovecot.so.0(+0x8d52e) [0x7f8cf859752e] -> /usr/lib64/dovecot/libdovecot.so.0(+0x8d60e) [0x7f8cf859760e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8cf85361b6] -> dove"... #3 0x00007f8cf859760e in i_internal_fatal_handler (ctx=0x7ffdba192b50, format=, args=) at failures.c:670 status = 0 #4 0x00007f8cf85361b6 in i_panic (format=format at entry=0x7f8cf8c7ad40 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffdba192c50, reg_save_area = 0x7ffdba192b90}} #5 0x00007f8cf8c5d3aa in auth_request_lookup_credentials (request=request at entry=0x7f8cf935bb30, scheme=scheme at entry=0x7f8cf8c8024d "LANMAN", callback=callback at entry=0x7f8cf8c6a000 ) at auth-request.c:1069 ctx = __FUNCTION__ = "auth_request_lookup_credentials" #6 0x00007f8cf8c6a14f in ntlm_credentials_callback (result=, credentials=, size=, auth_request=0x7f8cf935bb30) at mech-ntlm.c:171 request = 0x7f8cf935bb30 #7 0x00007f8cf8c5cf2b in auth_request_lookup_credentials_finish (result=PASSDB_RESULT_USER_UNKNOWN, credentials=credentials at entry=0x0, size=size at entry=0, request=request at entry=0x7f8cf935bb30) at auth-request.c:1012 No locals. #8 0x00007f8cf8c5d033 in auth_request_lookup_credentials_callback (result=PASSDB_RESULT_USER_UNKNOWN, credentials=0x0, size=0, request=0x7f8cf935bb30) at auth-request.c:1054 passdb = cache_cred = 0x7f8cf9312657 "" cache_scheme = 0xfffffffffffffffd
__FUNCTION__ = "auth_request_lookup_credentials_callback" #9 0x00007f8cf8c6d902 in passdb_handle_credentials (result=result at entry=PASSDB_RESULT_USER_UNKNOWN, password=, scheme=scheme at entry=0x0, callback=0x7f8cf8c5cfc0 , auth_request=0x7f8cf935bb30) at passdb.c:144 credentials = 0x0 size = 0 #10 0x00007f8cf8c6e106 in lookup_credentials_callback (reply=, context=) at passdb-blocking.c:119 request = 0x7f8cf935bb30 result = PASSDB_RESULT_USER_UNKNOWN password = 0x0 scheme = 0x0 #11 0x00007f8cf8c6381a in auth_worker_request_handle (request=0x7f8cf936f9c0, request=0x7f8cf936f9c0, line=0x7f8cf936bac3 "FAIL\t-3", conn=0x7f8cf934def0) at auth-worker-server.c:303 No locals. #12 worker_input (conn=0x7f8cf934def0) at auth-worker-server.c:403 line = 0x7f8cf936bac2 "\tFAIL\t-3" id_str = id = 5 #13 0x00007f8cf85aae8c in io_loop_call_io (io=0x7f8cf935b520) at ioloop.c:564 ioloop = 0x7f8cf93197f0 t_id = 2 __FUNCTION__ = "io_loop_call_io" #14 0x00007f8cf85ac2ef in io_loop_handler_run_internal (ioloop=ioloop at entry=0x7f8cf93197f0) at ioloop-epoll.c:220 ctx = 0x7f8cf9329960 events = list = 0x7f8cf935b580 io = tv = {tv_sec = 59, tv_usec = 999487} events_count = msecs = ret = 1 i = 0 call = __FUNCTION__ = "io_loop_handler_run_internal" #15 0x00007f8cf85aaf15 in io_loop_handler_run (ioloop=ioloop at entry=0x7f8cf93197f0) at ioloop.c:612 No locals. #16 0x00007f8cf85ab0c8 in io_loop_run (ioloop=0x7f8cf93197f0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #17 0x00007f8cf853c613 in master_service_run (service=0x7f8cf9319690, callback=) at master-service.c:640 No locals. #18 0x00007f8cf8c52be1 in main (argc=1, argv=0x7f8cf9319390) at main.c:400 c = On 09/07/16 15:55, Alexey Asemov (Alex/AT) wrote: > Hello, > > Since updating to 2.2.25, we do have the following issue (seems to be > related to the new auth policy code): > > Jul 9 00:00:14 LXmail01 dovecot: auth-worker(6558): > sql(user at domain.org,*.*.*.*,): unknown user > Jul 9 00:00:14 LXmail01 dovecot: auth: Panic: file auth-request.c: > line 1049 (auth_request_lookup_credentials): assertion failed: > (request->credentials_scheme == scheme) > Jul 9 00:00:14 LXmail01 dovecot: auth: Error: Raw backtrace: > /usr/lib64/dovecot/libdovecot.so.0(+0x8d57e) [0x7f197bd8157e] -> > /usr/lib64/dovecot/libdovecot.so.0(+0x8d65e) [0x7f197bd8165e] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f197bd201f6] -> > dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x1a15a) [0x7f197c44715a] > -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x26f8f) > [0x7f197c453f8f] -> dovecot/auth [1 wait, 0 passdb, 0 > userdb](+0x19d2b) [0x7f197c446d2b] -> dovecot/auth [1 wait, 0 passdb, > 0 userdb](auth_request_lookup_credentials_callback+0x68) [0x7f197c4 > 46e28] -> dovecot/auth [1 wait, 0 passdb, 0 > userdb](passdb_handle_credentials+0x92) [0x7f197c457742] -> > dovecot/auth [1 wait, 0 passdb, 0 userdb](+0x2af06) [0x7f197c457f06] > -> dovecot/auth [1 > wait, 0 passdb, 0 userdb](+0x2065a) [0x7f197c44d65a] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) > [0x7f197bd94edc] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_in > ternal+0xff) [0x7f197bd9633f] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) > [0x7f197bd94f65] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f197bd95118] > -> /usr > /lib64/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7f197bd26663] -> dovecot/auth [1 wait, 0 passdb, 0 > userdb](main+0x3a1) [0x7f197c43cbe1] -> > /lib64/libc.so.6(__libc_start_main+0xf5) > [0x7f197b30ab15] -> dovecot/auth [1 wait, 0 passdb, 0 userdb](+0xfdd1) > [0x7f197c43cdd1] > Jul 9 00:00:14 LXmail01 dovecot: auth: Fatal: master: service(auth): > child 6555 killed with signal 6 (core dumps disabled) > Jul 9 00:00:14 LXmail01 dovecot: pop3-login: Warning: Auth connection > closed with 1 pending requests (max 1 secs, pid=8133, EOF) > > Environment is MySQL passdb/userdb, we are using plain scheme as > default and password_noscheme field. In 2.2.24 and below auth worked > without scratch. Reverting all policy-related commits in 2.2.25 fixes > this, but I have not dug the details. > > KR, > > Alex From alavarre at gmail.com Tue Jul 26 03:28:36 2016 From: alavarre at gmail.com (Andy Lavarre) Date: Mon, 25 Jul 2016 23:28:36 -0400 Subject: Dovecot cannot find mailboxes In-Reply-To: References: <1469390635.2503.46.camel@gmail.com> Message-ID: <5796D8E4.7030107@gmail.com> Steffen thank you. I shall attend to this as soon as possible. Today I awoke to a system that cannot address the hard drive... :-( More Screwtape... Thank you, Andy On 07/25/16 02:29, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Sun, 24 Jul 2016, C. Andrews Lavarre wrote: > >> I have solved gaining access from a client (Evolution) via IMAP to the >> server: I can refresh, add folders, and delete folders. But I am still >> confounded, as IMAP does not see any mailboxes. Neither we from the >> command line (telnet, openssl, login, select) nor the system can find >> the mailbox, despite following FindMailLocation: >> >> telnet, openssl, login, then >> b select inbox >> * 0 EXISTS >> * 0 RECENT >> >> and postfix fails with >> >> 2016-07-23T21:22:37.312039-04:00 lavarre postfix/error[17088]: >> A8DA2C1BB2: to=, orig_to=, relay >> >> But the mailboxes do exist in /var/mail/vhosts/privustech.com/andy and >> we point to them in /etc/dovecot/users. > > Check: > doveadm user -u andy > > then enable logging and see if Dovecot uses the desired mail location. > >> >> doveconf -n is attached. >> >> ----- >> >> Two issues are: >> 1. file permissions and ownership >> 2. virtual versus system users >> >> 1. It appears that having the correct ownership and permissions on >> various files is critical (of course), but those parameters must also >> be included in the interior of the /etc/dovecot/user. So if you change >> permissions you also must change that file. >> >> For example, you said: >> >> i also noticed your certificate chain is broken. >> http://wiki2.dovecot.org/testinstallation >> >> I worked through this link, thank you. Changing permissions for the >> directories /var/mail/* to >> >> root:mail ($UID:$GID = 1000:12) >> >> and then changing /etc/dovecot/users correspondingly to >> >> user at privustech.com :{plain}actualpassword: 1000:12 >> ::/var/mail/vhosts/privustech.com/user >> >> now allows a normal login. and we can create a new folder (e.g., work) >> and delete it. However, this is at variance with >> http://wiki2.dovecot.org/HowTo/SimpleVirtualInstall >> >> which says to set the ownership to vmail:vmail ($UID:$GID = 100: >> 5000). Doing so breaks dovecot. >> >> 2. The various links suggest that having virtual users is preferable to >> setting system users. The former do not require directories under >> /homebut they do require a directory in the mail system, which I have >> provided under /var/mail/vhosts. It also turns out that for virtual >> users you must include the domain (andy at privustech.com). Making that >> change allowed the success reported above. But despite that, we still >> cannot find the mailboxes on login. >> >> >> Any thoughts on how to have IMAP find the mailboxes (beyond >> FindMailLocation, which doesn't seem to work for me) would be most >> appreciated. >> >> Kind regards, Andy >> >> > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBV5Wx23z1H7kL/d9rAQI0rAf8CIXCVOJAI7zIAtEBr1RWU4fnm4atCU/I > NRtqslLp8oXnaoB8S6VCoJqtgrssShzIDlUqa0bEDL0UZTENhRa6afhJ2iD6LFqx > ShpC+PG31Njj3Eezcz0AcFplMrKnYqUIF2Sxdc5n7UVHaS6fgf3gxS7/c2O2yjQm > XHxSKxioYt6QqneioGuuTh/twdlD5yf2TLmBQIev/lEFFnxsi4toRQuGJKGKpRCD > dF5dtO0RQxHlAAjS6EQg3St6eNQ41UVIrM+jencqm4npyEYf0enSoPy9DPkYBRph > 0iJim1dtdXqEBIIMjfYyEAQ7kygALMoavgCDPTLZXoyQzmlbg76ihg== > =PFXu > -----END PGP SIGNATURE----- From news at mefox.org Tue Jul 26 04:55:20 2016 From: news at mefox.org (Michael Fox) Date: Mon, 25 Jul 2016 21:55:20 -0700 Subject: imap & pop3 using same mailbox with virtual plugin Message-ID: <02e201d1e6f9$e9f49320$bdddb960$@mefox.org> This is a noobie question, so bear with me if it's not worded correctly: Primary Requirements: 1) I'd like to have two namespaces - one private/per-user, and one public (visible by all logged-in users). The public mailbox would be used to distribute information to all users. 2) I'd like both POP3 and IMAP users to see both namespaces. As I understand it, this requires the use of the virtual plugin to create a virtual namespace which would mix together the private and public namespaces into one mailbox. I have read: http://wiki.dovecot.org/Plugins/Virtual https://sys4.de/de/blog/2013/02/11/dovecot-virtual-setup-mit-globaler-sieve- spamfilter-regel-fur-pop3-nutzer/ (via Google translation) I don't really understand the example MySQL code (too much "..." for me to follow) in the above web pages. As I understand it (and I could be very wrong), the solution relies on a MySQL query to determine which namespace should have inbox = yes -- the private namespace or the virtual namespace -- depending on if the user is an imap or pop3 user, respectively. Question 1: How would this be done on a user-by-user basis if the userdb is a passwd-file flat file? Would it be something like this? -- Userdb extra fields for IMAP User: userdb_namespace/inbox/inbox=yes -- Userdb extra fields for POP3 User: userdb_namespace/virtual/inbox=yes Question 2: If I want to allow any user to use either POP3 or IMAP, then could I do it this way? protocol imap { namespace inbox { inbox = yes } } protocol pop3 { namespace virtual { inbox = yes } } Thanks, Michael From vsevostiyanov at gmail.com Tue Jul 26 06:51:57 2016 From: vsevostiyanov at gmail.com (=?UTF-8?B?0JLQsNGB0LjQu9C40Lkg0KHQtdCy0L7RgdGC0YzRj9C90L7Qsg==?=) Date: Tue, 26 Jul 2016 09:51:57 +0300 Subject: Segfault in lib11_trash_plugin.so Message-ID: After a recent update of dovecot to 2.2.devel (d81a83b) I started to get errors like that: Jul 26 07:34:44 mx kernel: pop3[17311]: segfault at 1ee74b0d5 ip 00000001ee74b0d5 sp 00007ffe593dc3c0 error 14 in lib11_trash_plugin.so[ 7f66edce2000+3000] Jul 26 08:11:25 mx dovecot: pop3(xxxxxxxx): Fatal: master: service(pop3): child 17311 killed with signal 11 (core dumps disabled) My dovecot configuration follows: # 2.2.devel (d81a83b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (3f51b82) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.5 ext4 auth_default_realm = euct.ru auth_mechanisms = plain login dict { acl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * login_greeting = Hello. mail_gid = 5000 mail_location = maildir:/home/vmail/%d/%u mail_max_userip_connections = 25 mail_plugins = " quota trash" mail_uid = 5000 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = maildir:/home/vmail/%d/%%n:INDEX=/home/vmail/%d/%n/Shared/%%u prefix = Shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes list = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe autoexpunge = 1 weeks special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl deleted_to_trash_folder = Trash quota = dict:User quota::proxy::quota quota_grace = 50M quota_rule = *:storage=250M quota_rule2 = Trash:storage=+50M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = ~/sieve/.dovecot.sieve sieve_dir = ~/sieve sieve_vacation_default_period = 7d sieve_vacation_max_period = 30d sieve_vacation_min_period = 1d trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = postmaster at euct.ru protocols = " imap sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = dovecot mode = 0666 user = vmail } } service dict { unix_listener dict { group = dovecot mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl = required ssl_cert = References: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> <94489cea-5a4b-de32-3201-4e096d5762aa@mx24.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 26 Jul 2016, Vince42 wrote: > [Steffen Kaiser] - [2016-07-25 08:23] >>> I am running a dovecot server and have set up an external monitoring, >>> where every five minutes a login with SSL on port 993 is done. I usually >>> get once a day an error "connection reset by peer - SSL connect", which >>> goes away until the next monitor is executed. > >> that looks like a basic networking issue to me. >> Do you have logs how many users try to connect at this time? Is it >> always the same time range? Is the server load very high? > > My server has nice specs (in fact a 30 times lower scaled server never > had this kind of problems), I also don't host many domains and users, > therefore I doubt that some kind of limit might be touched. I also > suspected some internal system load, but unfortunately the error occurs > arbitrarily, which makes me think that no scheduled process is > responsible for this. I also ran 'top' during such an event without any > obvious load tasks. The system statistics also show no weird peaks. I > read about the "running out of random" phenomenon, but during such an > event there were still enough resources random-wise. what about the network itself? Does the monitor crosses a firewall? > Could it be that I need to offer more login processes or that I should > raise some of my configuration values? The mail_max_userip_connections > does not seem to solve the problem. usually you get some warning in the logs, if such limit is reached. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBV5cLnXz1H7kL/d9rAQIEHgf9Fm+0PDtY+N2s2yYX1xcIntI8QdrmDuvU oQP2FMY57bcnQXb4g3PYaplNCNDIljUfCyWAGC4y07kRXrbztbxhawXVSdXELQQ4 EHofsZPWoC19yPibz5hCQ2Bd2EEq9D7I2o68wQCsvDbaZgyPsHnTdfBONt/T9NGW 1gZTY44G0xX8QzpVkqhZcLYo4X5737NmceLis7eZajfgAn3XMrOgrKLoolEsMr3m aTOIm4FcWGDU5V84zcbMIwC3+ukSR22RyOXeQcflU3k8i+PZh0dKmwS6a27ogk3Z ZttoOE961p2i9wy2MaiXjkVpLrfkaNLsCcud10aH5B+xUzLn0mcFqA== =NrfW -----END PGP SIGNATURE----- From goetz.reinicke at filmakademie.de Tue Jul 26 07:18:21 2016 From: goetz.reinicke at filmakademie.de (=?UTF-8?Q?G=c3=b6tz_Reinicke_-_IT_Koordinator?=) Date: Tue, 26 Jul 2016 09:18:21 +0200 Subject: any news Enterprise Repository Access? Message-ID: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> Hi, we had access to the repository and it was working fine. But as we cant get the 2.2.25 update I was looking into the repofolders and there are RPMs "just" for RHEL 6// but not 5 any more. My be I missed the latest discussions or announcements? Could you give me an update on information and may be the RHEL 5 RPMs too? Thanks a lot and regards . G?tz -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5571 bytes Desc: S/MIME Cryptographic Signature URL: From matthias.lay at securepoint.de Tue Jul 26 11:07:24 2016 From: matthias.lay at securepoint.de (Matthias Lay) Date: Tue, 26 Jul 2016 13:07:24 +0200 Subject: [BUG] Re: auth_bind with "()" in username not working In-Reply-To: <20160624103351.1a683b24@eugen.spdev.local> References: <20160609144856.20d7ee37@eugen.spdev.local> <20160624103351.1a683b24@eugen.spdev.local> Message-ID: <20160726130724.17f6a7b8@eugen.spdev.local> Hi guys, I had a look in the sources about this problem. the problem seems to be the ldap_escape function that is called from ldap_verify_plain_auth_bind_userdn(..) I dont really know if this escaping is needed at this point, but with this change it works for me. No other problems discovered so far. could somebody, who is deeper in the sources give me a hint if this will make some troubles? Patch for 2.2.16: diff --git a/src/auth/passdb-ldap.c b/src/auth/passdb-ldap.c index c1c2544..10bfe20 100644 --- a/src/auth/passdb-ldap.c +++ b/src/auth/passdb-ldap.c @@ -367,7 +367,7 @@ ldap_verify_plain_auth_bind_userdn(struct auth_request *auth_request, brequest->request.type = LDAP_REQUEST_TYPE_BIND; - vars = auth_request_get_var_expand_table(auth_request, ldap_escape); + vars = auth_request_get_var_expand_table(auth_request, NULL); dn = t_str_new(512); var_expand(dn, conn->set.auth_bind_userdn, vars); From sami.ketola at dovecot.fi Tue Jul 26 12:41:12 2016 From: sami.ketola at dovecot.fi (Sami Ketola) Date: Tue, 26 Jul 2016 14:41:12 +0200 Subject: any news Enterprise Repository Access? In-Reply-To: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> References: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> Message-ID: <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> > On 26 Jul 2016, at 09:18, G?tz Reinicke - IT Koordinator wrote: > > Hi, > we had access to the repository and it was working fine. But as we cant > get the 2.2.25 update I was looking into the repofolders and there are > RPMs "just" for RHEL 6// but not 5 any more. > > My be I missed the latest discussions or announcements? Could you give > me an update on information and may be the RHEL 5 RPMs too? > > Thanks a lot and regards . G?tz Dovecot EE build support for RHEL 5 / CentOS 5 is going away soon even if we still made one more build for CentOS 5. Please upgrade your system. Sami From ad+lists at uni-x.org Tue Jul 26 19:12:03 2016 From: ad+lists at uni-x.org (Alexander Dalloz) Date: Tue, 26 Jul 2016 21:12:03 +0200 Subject: any news Enterprise Repository Access? In-Reply-To: <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> References: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> Message-ID: <4023f52c-0fe0-d995-4c70-3e568583979b@uni-x.org> Am 26.07.2016 um 14:41 schrieb Sami Ketola: > >> On 26 Jul 2016, at 09:18, G?tz Reinicke - IT Koordinator wrote: >> >> Hi, >> we had access to the repository and it was working fine. But as we cant >> get the 2.2.25 update I was looking into the repofolders and there are >> RPMs "just" for RHEL 6// but not 5 any more. >> >> My be I missed the latest discussions or announcements? Could you give >> me an update on information and may be the RHEL 5 RPMs too? >> >> Thanks a lot and regards . G?tz > > > Dovecot EE build support for RHEL 5 / CentOS 5 is going away soon even if we still made one more build for CentOS 5. Please upgrade your system. > > Sami Not only because of dovecot [21:09:27 CEST] CentOS 5 will go EOL on 31 March, 2017 -- in 35 weeks, 2 days, 4 hours, 50 minutes, and 47 seconds but be aware that it is now in production phase 3 and only receives critical updates Alexander From luckyfellow42 at gmail.com Tue Jul 26 23:08:53 2016 From: luckyfellow42 at gmail.com (Andreas Meyer) Date: Wed, 27 Jul 2016 01:08:53 +0200 Subject: New password hashing scheme as plugin Message-ID: Hi, I want to add a new password hashing scheme as plugin and provide it for the dovecot project, so that it will be included as optional plugin in future releases. Yet the plugin compiles fine and the .so file gets created. My approach is to call the functions password_scheme_register() and password_scheme_unregister() (src/auth/password-scheme.c) inside the plugin's _init() and _deinit() functions. When a client tries to login via imap the log shows an error message: Error: Couldn't load required plugin /usr/local/lib/dovecot/lib20_newauth_plugin.so: dlopen() failed: /usr/local/lib/dovecot/lib20_newauth_plugin.so: undefined symbol: password_scheme_unregister That error obviously occurs, because the required lib is not linked into the plugin. Now my problem is to understand, whether this approach (via .so file) can be successful at all and if so, how? Do I need to link libs into it? Which would that be and how do I specify them in the Makefile.am? I assume, I don't need to link a lib, but need to use a hook to register the new hashing scheme, since the plugin is loaded into an already existing process, which needs to get extended. If this is true, which hook would that be and how do I register the new scheme? Or is there no way to accomplish this via a separated .so plugin? Should I extend the sources in /src/auth instead? (separat file for the hashing scheme with preprocessor instructions to include it only on demand) Thank you very much, Andreas From goetz.reinicke at filmakademie.de Wed Jul 27 06:31:34 2016 From: goetz.reinicke at filmakademie.de (=?UTF-8?Q?G=c3=b6tz_Reinicke_-_IT_Koordinator?=) Date: Wed, 27 Jul 2016 08:31:34 +0200 Subject: any news Enterprise Repository Access? In-Reply-To: <4023f52c-0fe0-d995-4c70-3e568583979b@uni-x.org> References: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> <4023f52c-0fe0-d995-4c70-3e568583979b@uni-x.org> Message-ID: <46fba39b-8783-cb3e-72f4-120424071704@filmakademie.de> Am 26.07.16 um 21:12 schrieb Alexander Dalloz: > Am 26.07.2016 um 14:41 schrieb Sami Ketola: >> >>> On 26 Jul 2016, at 09:18, G?tz Reinicke - IT Koordinator >>> wrote: >>> >>> Hi, >>> we had access to the repository and it was working fine. But as we cant >>> get the 2.2.25 update I was looking into the repofolders and there are >>> RPMs "just" for RHEL 6// but not 5 any more. >>> >>> My be I missed the latest discussions or announcements? Could you give >>> me an update on information and may be the RHEL 5 RPMs too? >>> >>> Thanks a lot and regards . G?tz >> >> >> Dovecot EE build support for RHEL 5 / CentOS 5 is going away soon >> even if we still made one more build for CentOS 5. Please upgrade >> your system. >> >> Sami > > Not only because of dovecot > > [21:09:27 CEST] CentOS 5 will go EOL on 31 March, 2017 -- in > 35 weeks, 2 days, 4 hours, 50 minutes, and 47 seconds but be aware > that it is now in production phase 3 and only receives critical updates > > Alexander Thx for your both feedback, and yes, it is EOL but as you mentioned in 35+ weeks. O.K. Redhat never did a dovecot update to the current version and as a lot of customers we think the update policy for some software should be changed too to support more modern versions of "core" server services. But that's not a dovecot topic ;) That dovecot offers still EE build for free is great, but a road map on what the future subscription plans are would be nice; e.g low cost fee for just the repos, higher fees for support etc. That's what I missed. Regards . G?tz -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5571 bytes Desc: S/MIME Cryptographic Signature URL: From kondybas at gmail.com Wed Jul 27 09:35:16 2016 From: kondybas at gmail.com (=?UTF-8?B?0JDRgNGC0LXQvCDQn9C10YDQtdC60YDQtdGB0L3QuNC5?=) Date: Wed, 27 Jul 2016 12:35:16 +0300 Subject: Converting mailboxes to UTF-8 In-Reply-To: References: Message-ID: 2016-07-25 1:08 GMT+03:00 Timo Sirainen : > On 23 Jul 2016, at 13:44, ????? ??????????? wrote: > > Is any proven routine to migrate mailboxes from mUTF-7 to UTF-8 encoding? > ?For what purpose? By default Dovecot assumes that mailboxes are mUTF-7 on > filesystem.? > > ??Main idea is to convert FS directories names of the inherited dovecot's v 1.x hierarcy from the mUTF-7 to the readable UTF-8 format?. It's too dizzy to work with directories like .INBOX.&BDYESwRA-.&BE8ENARK-. Also logs are look weird. > I don't think there's any especially easy way to do that. You'd need to > write a script that properly goes through the hierarchies and does the > renaming. > Here is the quick solution:? we have to list mailbox names in the reverse alnum order to be sure nested subdirs will be renamed prior to the upper level ?ones: ?#!/bin/sh doveadm mailbox list -8 -A | sort -r | while read user utf7 do utf8=$( doveadm mailbox mutf7 -7 "$utf7" ) [ $utf7 != $utf8 ] && doveadm mailbox rename -u $user -s "$utf7" "$utf8" done #### ? 1. Stop dovecot 2. Add the "UTF-8" key to the `mail_location = maildir:/path/:UTF-8` 3. Start dovecot. Now all old folders will be shown as plain mUFT7-encoded strings (subscriptions stay correct) 4. Run the script above ?In my case managesieve is already configured to use UTF-8 for sieve rules ?so no additional conversion needed. But if mUTF-7 is used for sieve files `doveadm mailbox mutf7` can be used for conversion. ?Artem? From leithner at itronic.at Wed Jul 27 10:46:27 2016 From: leithner at itronic.at (Harald Leithner) Date: Wed, 27 Jul 2016 12:46:27 +0200 Subject: Sieve vacation address problem Message-ID: Hi, it seams I have a problem with the vacation script. The problem is that the vacation answers to a address that is not listed in the sieve script. I checked the postfix master.conf which delivers to lda correct parameter. In the logfile you can see that that office at example.com received a message that get delivered to user at example.com (with the sievescipt) and to office at example.com (another user without script). The sieve script has the :addresses parameter only set to user at example.com Is something wrong with my setup? We use roundcube + sievemanage to create sieve scripts. Sievescript: ## Generated by Roundcube Webmail SieveRules Plugin ## require ["date","relational","vacation"]; # rule:[Urlaub] if allof (currentdate :zone "+0200" :value "gt" "date" "2016-07-22", currentdate :zone "+0200" :value "lt" "date" "2016-08-08") { vacation :days 1 :addresses ["user at example.com"] :subject "Abwesenheitsnotiz" text: Thx i'm not here . ; } -------------- postfix master.conf dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -f ${sender} -a ${original_recipient} -d ${user}@${nexthop} -e -------------- Logfile: Postfix: 2016-07-27T11:44:30+02:00 mailstore1 postfix/smtpd[5037]: connect from unknown[172.20.20.229]:15677 2016-07-27T11:44:30+02:00 mailstore1 postfix/smtpd[5037]: 3rzqp64klWzF: client=unknown[172.20.20.229]:15677 2016-07-27T11:44:30+02:00 mailstore1 postfix/cleanup[5040]: 3rzqp64klWzF: message-id=<019301d1e7eb$76b26a70$64173f50$@example.org> 2016-07-27T11:44:30+02:00 mailstore1 postfix/qmgr[704]: 3rzqp64klWzF: from=, size=7337, nrcpt=2 (queue active) 2016-07-27T11:44:30+02:00 mailstore1 postfix/smtpd[5037]: disconnect from unknown[172.20.20.229]:15677 2016-07-27T11:44:30+02:00 mailstore1 postfix/pipe[5157]: 3rzqp64klWzF: to=, relay=dovecot, delay=0.12, delays=0.02/0.03/0/0.06, dsn=2.0.0, status=sent (delivered via dovecot service) 2016-07-27T11:44:30+02:00 mailstore1 postfix/pipe[5042]: 3rzqp64klWzF: to=, orig_to=, relay=dovecot, delay=0.12, delays=0.02/0.03/0/0.07, dsn=2.0.0, status=sent (delivered via dovecot service) 2016-07-27T11:44:30+02:00 mailstore1 postfix/qmgr[704]: 3rzqp64klWzF: removed dovecot lda 2016-07-27T11:44:30+02:00 mailstore1 dovecot: lda(user at example.com): sieve: msgid=<019301d1e7eb$76b26a70$64173f50$@example.org>: sent vacation response to 2016-07-27T11:44:30+02:00 mailstore1 dovecot: lda(office at example.com): msgid=<019301d1e7eb$76b26a70$64173f50$@example.org>: saved mail to INBOX 2016-07-27T11:44:30+02:00 mailstore1 dovecot: lda(user at example.com): sieve: msgid=<019301d1e7eb$76b26a70$64173f50$@example.org>: stored mail into mailbox 'INBOX' ----------- doveocot conf # 2.2.devel (d81a83b): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (3f51b82) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.5 auth_cache_negative_ttl = 1 secs auth_cache_size = 10 M auth_cache_ttl = 1 secs auth_mechanisms = PLAIN LOGIN DIGEST-MD5 SCRAM-SHA-1 CRAM-MD5 APOP auth_verbose = yes default_client_limit = 600 default_vsz_limit = 512 M dict { lastlogin = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlacl = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_gid = 1001 first_valid_uid = 1001 hostname = mailstore1 at itronic.at imap_hibernate_timeout = 1 mins imap_id_log = * imap_id_send = * imap_idle_notify_interval = 10 mins instance_name = mailstore1 last_valid_gid = 1001 last_valid_uid = 1001 lda_original_recipient_header = X-LDA-Original-To lmtp_rcpt_check_quota = yes login_greeting = ITronic Mail Store login_trusted_networks = 172.22.14.0/24 mail_attachment_dir = /srv/storage1/vmail_sis mail_attachment_hash = %{sha512} mail_attachment_min_size = 64 k mail_cache_min_mail_count = 5 mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = zlib lazy_expunge stats acl quota mail_prefetch_count = 100 mail_server_admin = mailto:postmaster at itronic.at mail_server_comment = ITronic Mail System mail_shared_explicit_inbox = yes mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_preallocate_space = yes namespace { hidden = yes list = no location = mdbox:~/mdbox:MAILBOXDIR=expunged prefix = "#EXPUNGED/" subscriptions = no type = private } namespace { list = children location = mdbox:%%h/mdbox prefix = "#Users/%%u/" separator = / subscriptions = yes type = shared } namespace inbox { hidden = no inbox = yes location = mailbox Archvie { special_use = \Archive } mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Spam { special_use = \Junk } mailbox Trash { special_use = \Trash } prefix = separator = / subscriptions = yes type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::sqlacl last_login_dict = proxy::lastlogin last_login_key = last-login/%u lazy_expunge = "#EXPUNGED/" lazy_expunge_only_last_instance = no quota = dict:User quota::proxy::sqlquota quota_grace = 10%% quota_rule = *:storage=1024M quota_rule2 = "#EXPUNGED:storage=+100M" quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=80%% quota-warning 80 %u recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_global = /etc/dovecot/sieve sieve_max_actions = 64 sieve_max_redirects = 8 sieve_max_script_size = 2M sieve_quota_max_scripts = 0 sieve_quota_max_storage = 64M stats_refresh = 30 secs stats_track_cmds = yes zlib_save = gz zlib_save_level = 6 } pop3_uidl_duplicates = rename protocols = imap lmtp sieve pop3 sieve service auth-worker { user = $default_internal_user } service auth { inet_listener { port = 4180 } unix_listener auth-userdb { mode = 0666 } } service dict { unix_listener dict { group = vmail mode = 0666 } } service imap-hibernate { unix_listener imap-hibernate { group = vmail mode = 0666 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 1 service_count = 0 } service imap { process_limit = 1024 unix_listener imap-master { user = dovecot } unix_listener imap { group = vmail mode = 0666 } vsz_limit = 512 M } service lmtp { inet_listener lmtp { address = 172.22.14.135 port = 24000 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 50 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_min_avail = 20 service_count = 1 vsz_limit = 64 M } service pop3 { process_limit = 1024 } service quota-warning { executable = script /opt/scripts/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } shutdown_clients = no ssl_cert = References: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> <37a6b68e75d99db0507399edf935f73b@tomsommer.dk> <11b843dcfa9d753dcaeeab033a7f0dfa@tomsommer.dk> Message-ID: <52ae60ac161aa885a83e02f6d8e3f94f@tomsommer.dk> On 2016-04-07 15:02, Timo Sirainen wrote: > On 07 Apr 2016, at 14:49, Tom Sommer wrote: >> >> On 2016-04-06 21:09, Tom Sommer wrote: >>> On 2016-04-06 20:38, Timo Sirainen wrote: >>>> On 06 Apr 2016, at 13:43, Tom Sommer wrote: >>>>> I'm switching quota backend to redis (from maildir++), so all my >>>>> current usages are reset. >>>>> I get that I can do "doveadm quota recalc -A", but it takes forever >>>>> (and auth processes time out/crash). >>>>> It would make much more sense to recalc the usage on login if the >>>>> current usage is unset. Is there no way to do a >>>>> recalc-quota-on-first-login? >>>> I'd actually recommend switching to "count" quota: >>>> http://wiki2.dovecot.org/Quota/Count >>> I tried count, but it crashes because of dotlocks :) There is another >>> post about it :) >> >> Any change you will have time to fix this? Because I would really love >> to switch to "count". > > Looks unlikely right now, but lets see. You could also in theory just > mount with -o nolock and use fcntl/flock locking so each server does > the locking internally only. Having director working correctly is of > course even more important in that case. I tried to disable dotlocks and enable "count" with vsizes. If you enable "quota_vsizes = yes" then this setting is stored in the index files? You cannot turn it off again without deleting dovecot.index? So if I go back to dotlocks I'm basically breaking everything because dotlocks does not work with vsize? From mail at tomsommer.dk Wed Jul 27 14:34:41 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Wed, 27 Jul 2016 16:34:41 +0200 Subject: Opportunistic quota recalc In-Reply-To: <52ae60ac161aa885a83e02f6d8e3f94f@tomsommer.dk> References: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> <37a6b68e75d99db0507399edf935f73b@tomsommer.dk> <11b843dcfa9d753dcaeeab033a7f0dfa@tomsommer.dk> <52ae60ac161aa885a83e02f6d8e3f94f@tomsommer.dk> Message-ID: <1be5374fc0a063ebf552e75187df05e4@tomsommer.dk> On 2016-07-27 16:32, Tom Sommer wrote: > On 2016-04-07 15:02, Timo Sirainen wrote: >> On 07 Apr 2016, at 14:49, Tom Sommer wrote: >>> >>> On 2016-04-06 21:09, Tom Sommer wrote: >>>> On 2016-04-06 20:38, Timo Sirainen wrote: >>>>> On 06 Apr 2016, at 13:43, Tom Sommer wrote: >>>>>> I'm switching quota backend to redis (from maildir++), so all my >>>>>> current usages are reset. >>>>>> I get that I can do "doveadm quota recalc -A", but it takes >>>>>> forever (and auth processes time out/crash). >>>>>> It would make much more sense to recalc the usage on login if the >>>>>> current usage is unset. Is there no way to do a >>>>>> recalc-quota-on-first-login? >>>>> I'd actually recommend switching to "count" quota: >>>>> http://wiki2.dovecot.org/Quota/Count >>>> I tried count, but it crashes because of dotlocks :) There is >>>> another >>>> post about it :) >>> >>> Any change you will have time to fix this? Because I would really >>> love to switch to "count". >> >> Looks unlikely right now, but lets see. You could also in theory just >> mount with -o nolock and use fcntl/flock locking so each server does >> the locking internally only. Having director working correctly is of >> course even more important in that case. > > I tried to disable dotlocks and enable "count" with vsizes. Oh, and since vsizes create .vsize.lock files in the Maildir folders, I now get a ton of errors: Jul 27 14:44:19 imap(xxxx): Error: stat(/xxxxx/Maildir/.vsize.lock3a32c03afb509d28/tmp) failed: Not a directory From kevin at my.walr.us Wed Jul 27 15:03:32 2016 From: kevin at my.walr.us (KT Walrus) Date: Wed, 27 Jul 2016 11:03:32 -0400 Subject: any news Enterprise Repository Access? In-Reply-To: <46fba39b-8783-cb3e-72f4-120424071704@filmakademie.de> References: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> <4023f52c-0fe0-d995-4c70-3e568583979b@uni-x.org> <46fba39b-8783-cb3e-72f4-120424071704@filmakademie.de> Message-ID: > That dovecot offers still EE build for free is great, but a road map on > what the future subscription plans are would be nice; e.g low cost fee > for just the repos, higher fees for support etc. That's what I missed. I?d like to see Dovecot distributed in the Docker Store (coming soon) or the Docker Hub. Most enterprises are moving to deploying their apps in containers and these containers can run on your laptop the same as they run in production. Most modern Linux distributions support Docker these days. I build and run Dovecot in Docker now (built from latest released sources against Ubuntu 16.04), and while I am still in development, I?m sure Docker is the way to run my apps and will run great for deployment and maintenance. Kevin > On Jul 27, 2016, at 2:31 AM, G?tz Reinicke - IT Koordinator wrote: > > Am 26.07.16 um 21:12 schrieb Alexander Dalloz: >> Am 26.07.2016 um 14:41 schrieb Sami Ketola: >>> >>>> On 26 Jul 2016, at 09:18, G?tz Reinicke - IT Koordinator >>>> wrote: >>>> >>>> Hi, >>>> we had access to the repository and it was working fine. But as we cant >>>> get the 2.2.25 update I was looking into the repofolders and there are >>>> RPMs "just" for RHEL 6// but not 5 any more. >>>> >>>> My be I missed the latest discussions or announcements? Could you give >>>> me an update on information and may be the RHEL 5 RPMs too? >>>> >>>> Thanks a lot and regards . G?tz >>> >>> >>> Dovecot EE build support for RHEL 5 / CentOS 5 is going away soon >>> even if we still made one more build for CentOS 5. Please upgrade >>> your system. >>> >>> Sami >> >> Not only because of dovecot >> >> [21:09:27 CEST] CentOS 5 will go EOL on 31 March, 2017 -- in >> 35 weeks, 2 days, 4 hours, 50 minutes, and 47 seconds but be aware >> that it is now in production phase 3 and only receives critical updates >> >> Alexander > Thx for your both feedback, and yes, it is EOL but as you mentioned in > 35+ weeks. O.K. Redhat never did a dovecot update to the current version > and as a lot of customers we think the update policy for some software > should be changed too to support more modern versions of "core" server > services. But that's not a dovecot topic ;) > > That dovecot offers still EE build for free is great, but a road map on > what the future subscription plans are would be nice; e.g low cost fee > for just the repos, higher fees for support etc. That's what I missed. > > Regards . G?tz > > > > > From michael.chen at rivetlogic.com Wed Jul 27 15:46:25 2016 From: michael.chen at rivetlogic.com (Michael Chen) Date: Wed, 27 Jul 2016 08:46:25 -0700 Subject: Dovecot v2.2.25 crashed on startup in Mac OSX Message-ID: I built from dovecot-2.2.25.tar.gz on Mac OSX 10.11.15 (El Capitan) the usual way: CFLAGS=-I/usr/local/ssl/include LDFLAGS=-L/usr/local/ssl/lib ./configure make sudo make install sudo /usr/local/sbin/dovecot It consistently crash on startup with the following entries in /var/log/mail.log (edited backtrace): Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Dovecot v2.2.25 (7be1766) starting up for imap, pop3, lmtp Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Panic: kevent(EV_ADD, READ, 60) failed: Bad file descriptor Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Error: Raw backtrace: 2 libdovecot.0.dylib 0x00000001000dc3fb default_fatal_finish + 43 -> 3 libdovecot.0.dylib 0x00000001000dd4e0 syslog_handler + 0 -> 4 dovecot 0x0000000100026f8d master_fatal_callback + 429 -> 5 libdovecot.0.dylib 0x00000001000dca9f i_panic + 415 -> 6 libdovecot.0.dylib 0x00000001000ff022 io_loop_handle_add + 194 -> 7 libdovecot.0.dylib 0x00000001000fb5f1 io_add_file + 385 -> 8 libdovecot.0.dylib 0x00000001000fb456 io_add + 118 -> 9 libdovecot.0.dylib 0x0000000100102b83 lib_signals_set_handler + 355 -> 10 dovecot 0x0000000100027070 main_init + 112 -> 11 dovecot 0x0000000100026628 main + 2024 -> 12 libdyld.dylib 0x00007fff889ac5ad start + 1 It looks similar to this report: http://article.gmane.org/gmane.mail.imap.dovecot/86319/match=panic+kevent HomeBrew installed 2.2.24, and it works in my Mac. Can someone confirm this is a bug? I also built 2.2.25 with debug, but can't make it break at line iolook-kqueue.c:67 i_panic("kevent(EV_ADD, READ, %d) failed: %m", io->fd); Thanks --mc . -- CONFIDENTIALITY NOTICE: This e-mail, including attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information or otherwise be protected by law. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender and destroy all copies and the original message. From edgar at pettijohn-web.com Wed Jul 27 15:54:54 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Wed, 27 Jul 2016 10:54:54 -0500 Subject: Dovecot v2.2.25 crashed on startup in Mac OSX In-Reply-To: References: Message-ID: <7E7E652D-C848-4118-BF04-88E1E91BA636@pettijohn-web.com> I think they fixed it in git, but probably didn't apply it to 2.2.25. I would recommend trying the latest from git. Sent from my iPhone > On Jul 27, 2016, at 10:46 AM, Michael Chen wrote: > > I built from dovecot-2.2.25.tar.gz on Mac OSX 10.11.15 (El Capitan) the > usual way: > > CFLAGS=-I/usr/local/ssl/include LDFLAGS=-L/usr/local/ssl/lib ./configure > make > sudo make install > sudo /usr/local/sbin/dovecot > > It consistently crash on startup with the following entries in > /var/log/mail.log (edited backtrace): > > Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Dovecot v2.2.25 > (7be1766) starting up for imap, pop3, lmtp > Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Panic: kevent(EV_ADD, > READ, 60) failed: Bad file descriptor > Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Error: Raw backtrace: > 2 libdovecot.0.dylib 0x00000001000dc3fb > default_fatal_finish + 43 > -> 3 libdovecot.0.dylib 0x00000001000dd4e0 > syslog_handler + 0 > -> 4 dovecot 0x0000000100026f8d > master_fatal_callback + 429 > -> 5 libdovecot.0.dylib 0x00000001000dca9f i_panic + 415 > -> 6 libdovecot.0.dylib 0x00000001000ff022 > io_loop_handle_add + 194 > -> 7 libdovecot.0.dylib 0x00000001000fb5f1 io_add_file > + 385 > -> 8 libdovecot.0.dylib 0x00000001000fb456 io_add + 118 > -> 9 libdovecot.0.dylib 0x0000000100102b83 > lib_signals_set_handler + 355 > -> 10 dovecot 0x0000000100027070 main_init + > 112 > -> 11 dovecot 0x0000000100026628 main + 2024 > -> 12 libdyld.dylib 0x00007fff889ac5ad start + 1 > > > It looks similar to this report: > > > http://article.gmane.org/gmane.mail.imap.dovecot/86319/match=panic+kevent > > HomeBrew installed 2.2.24, and it works in my Mac. Can someone confirm this > is a bug? > > I also built 2.2.25 with debug, but can't make it break at line > iolook-kqueue.c:67 > > i_panic("kevent(EV_ADD, READ, %d) failed: %m", io->fd); > > Thanks > > --mc > . > > -- > > > CONFIDENTIALITY NOTICE: This e-mail, including attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information or otherwise be protected by law. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender and destroy all copies and the original message. From michael.chen at rivetlogic.com Wed Jul 27 16:05:52 2016 From: michael.chen at rivetlogic.com (Michael Chen) Date: Wed, 27 Jul 2016 09:05:52 -0700 Subject: Dovecot v2.2.25 crashed on startup in Mac OSX In-Reply-To: <7E7E652D-C848-4118-BF04-88E1E91BA636@pettijohn-web.com> References: <7E7E652D-C848-4118-BF04-88E1E91BA636@pettijohn-web.com> Message-ID: Thanks, Edgar. I can confirm that this commit also fixed it on Mac OSX: https://github.com/dovecot/core/commit/ffd8dc932516bc55bf01d91355540daab365e5e9 --mc On Wed, Jul 27, 2016 at 8:54 AM, Edgar Pettijohn wrote: > I think they fixed it in git, but probably didn't apply it to 2.2.25. I > would recommend trying the latest from git. > > Sent from my iPhone > > > On Jul 27, 2016, at 10:46 AM, Michael Chen > wrote: > > > > I built from dovecot-2.2.25.tar.gz on Mac OSX 10.11.15 (El Capitan) the > > usual way: > > > > CFLAGS=-I/usr/local/ssl/include LDFLAGS=-L/usr/local/ssl/lib > ./configure > > make > > sudo make install > > sudo /usr/local/sbin/dovecot > > > > It consistently crash on startup with the following entries in > > /var/log/mail.log (edited backtrace): > > > > Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Dovecot v2.2.25 > > (7be1766) starting up for imap, pop3, lmtp > > Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Panic: kevent(EV_ADD, > > READ, 60) failed: Bad file descriptor > > Jul 27 07:39:26 macbook-pro dovecot[70234]: master: Error: Raw backtrace: > > 2 libdovecot.0.dylib 0x00000001000dc3fb > > default_fatal_finish + 43 > > -> 3 libdovecot.0.dylib 0x00000001000dd4e0 > > syslog_handler + 0 > > -> 4 dovecot 0x0000000100026f8d > > master_fatal_callback + 429 > > -> 5 libdovecot.0.dylib 0x00000001000dca9f i_panic + > 415 > > -> 6 libdovecot.0.dylib 0x00000001000ff022 > > io_loop_handle_add + 194 > > -> 7 libdovecot.0.dylib 0x00000001000fb5f1 io_add_file > > + 385 > > -> 8 libdovecot.0.dylib 0x00000001000fb456 io_add + > 118 > > -> 9 libdovecot.0.dylib 0x0000000100102b83 > > lib_signals_set_handler + 355 > > -> 10 dovecot 0x0000000100027070 main_init + > > 112 > > -> 11 dovecot 0x0000000100026628 main + 2024 > > -> 12 libdyld.dylib 0x00007fff889ac5ad start + 1 > > > > > > It looks similar to this report: > > > > > > > http://article.gmane.org/gmane.mail.imap.dovecot/86319/match=panic+kevent > > > > HomeBrew installed 2.2.24, and it works in my Mac. Can someone confirm > this > > is a bug? > > > > I also built 2.2.25 with debug, but can't make it break at line > > iolook-kqueue.c:67 > > > > i_panic("kevent(EV_ADD, READ, %d) failed: %m", io->fd); > > > > Thanks > > > > --mc > > . > > > > -- > > > > > > CONFIDENTIALITY NOTICE: This e-mail, including attachments, is for the > sole use of the intended recipient(s) and may contain confidential and > privileged information or otherwise be protected by law. Any unauthorized > review, use, disclosure or distribution is prohibited. If you are not the > intended recipient, please contact the sender and destroy all copies and > the original message. > > -- CONFIDENTIALITY NOTICE: This e-mail, including attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information or otherwise be protected by law. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender and destroy all copies and the original message. From tss at iki.fi Wed Jul 27 17:42:36 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 27 Jul 2016 20:42:36 +0300 Subject: Opportunistic quota recalc In-Reply-To: <1be5374fc0a063ebf552e75187df05e4@tomsommer.dk> References: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> <37a6b68e75d99db0507399edf935f73b@tomsommer.dk> <11b843dcfa9d753dcaeeab033a7f0dfa@tomsommer.dk> <52ae60ac161aa885a83e02f6d8e3f94f@tomsommer.dk> <1be5374fc0a063ebf552e75187df05e4@tomsommer.dk> Message-ID: <82B72ACA-3E51-446C-B377-9FFB7BCD60C4@iki.fi> On 27 Jul 2016, at 17:34, Tom Sommer wrote: > > > On 2016-07-27 16:32, Tom Sommer wrote: >> On 2016-04-07 15:02, Timo Sirainen wrote: >>> On 07 Apr 2016, at 14:49, Tom Sommer wrote: >>>> On 2016-04-06 21:09, Tom Sommer wrote: >>>>> On 2016-04-06 20:38, Timo Sirainen wrote: >>>>>> On 06 Apr 2016, at 13:43, Tom Sommer wrote: >>>>>>> I'm switching quota backend to redis (from maildir++), so all my current usages are reset. >>>>>>> I get that I can do "doveadm quota recalc -A", but it takes forever (and auth processes time out/crash). >>>>>>> It would make much more sense to recalc the usage on login if the current usage is unset. Is there no way to do a recalc-quota-on-first-login? >>>>>> I'd actually recommend switching to "count" quota: >>>>>> http://wiki2.dovecot.org/Quota/Count >>>>> I tried count, but it crashes because of dotlocks :) There is another >>>>> post about it :) >>>> Any change you will have time to fix this? Because I would really love to switch to "count". >>> Looks unlikely right now, but lets see. You could also in theory just >>> mount with -o nolock and use fcntl/flock locking so each server does >>> the locking internally only. Having director working correctly is of >>> course even more important in that case. >> I tried to disable dotlocks and enable "count" with vsizes. > > Oh, and since vsizes create .vsize.lock files in the Maildir folders, I now get a ton of errors: > > Jul 27 14:44:19 imap(xxxx): Error: stat(/xxxxx/Maildir/.vsize.lock3a32c03afb509d28/tmp) failed: Not a directory This can be avoided with maildir_stat_dirs=yes, although it makes LIST performance a bit worse. I guess another alternative would be to store index files to a separate location. From stephan at rename-it.nl Wed Jul 27 19:23:25 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 27 Jul 2016 21:23:25 +0200 Subject: Sieve vacation address problem In-Reply-To: References: Message-ID: Op 7/27/2016 om 12:46 PM schreef Harald Leithner: > Hi, > > it seams I have a problem with the vacation script. > > The problem is that the vacation answers to a address that is not > listed in the sieve script. I checked the postfix master.conf which > delivers to lda correct parameter. > > In the logfile you can see that that office at example.com received a > message that get delivered to user at example.com (with the sievescipt) > and to office at example.com (another user without script). > > The sieve script has the :addresses parameter only set to > user at example.com > > Is something wrong with my setup? > > We use roundcube + sievemanage to create sieve scripts. > [...] > -------------- > postfix master.conf > dovecot unix - n n - - pipe > flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -f > ${sender} -a ${original_recipient} -d ${user}@${nexthop} -e First of all, the ":addresses" argument is not an exclusive list of which addresses the vacation action will respond for. It is a list of alternative addresses, for when the message headers have no address that is recognized as the envelope recipient. So, even when ":addresses" does not list a particular recipient address, the vacation action will still respond for it if the message is addressed at that recipient explicitly in the headers. Read https://tools.ietf.org/html/rfc5230#section-4.5 for more info. Due to the way you invoke dovecot-lda, Sieve only gets to see the original recipient address, which is "office at example.com". I am assuming, that is what is in either the "To" or "Cc" headers of the message, which means that vacation will respond. This problem is probably fixed by using a -r ${recipient} parameter for dovecot-lda, in addition to the existing -a argument. This way, vacation will use the final recipient address instead. LDA parameters are documented here: http://wiki2.dovecot.org/LDA#Parameters . There is additional info in the description of the sieve_vacation_use_original_recipient setting (http://wiki2.dovecot.org/Pigeonhole/Sieve/Extensions/Vacation#Configuration). Leave this at the default "no" though, as "yes" would negate the fix described above. Regards, Stephan. From leithner at itronic.at Wed Jul 27 19:59:17 2016 From: leithner at itronic.at (Harald Leithner) Date: Wed, 27 Jul 2016 21:59:17 +0200 Subject: Sieve vacation address problem In-Reply-To: References: Message-ID: <396fde12-5fe3-40de-394e-259031c79fbb@itronic.at> Hi, now it works perfect, thx for your answer. I miss understood this dovecot-lda option. regards, Harald Am 27.07.2016 um 21:23 schrieb Stephan Bosch: > Op 7/27/2016 om 12:46 PM schreef Harald Leithner: >> Hi, >> >> it seams I have a problem with the vacation script. >> >> The problem is that the vacation answers to a address that is not >> listed in the sieve script. I checked the postfix master.conf which >> delivers to lda correct parameter. >> >> In the logfile you can see that that office at example.com received a >> message that get delivered to user at example.com (with the sievescipt) >> and to office at example.com (another user without script). >> >> The sieve script has the :addresses parameter only set to >> user at example.com >> >> Is something wrong with my setup? >> >> We use roundcube + sievemanage to create sieve scripts. >> > [...] >> -------------- >> postfix master.conf >> dovecot unix - n n - - pipe >> flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/dovecot-lda -f >> ${sender} -a ${original_recipient} -d ${user}@${nexthop} -e > > First of all, the ":addresses" argument is not an exclusive list of > which addresses the vacation action will respond for. It is a list of > alternative addresses, for when the message headers have no address that > is recognized as the envelope recipient. So, even when ":addresses" does > not list a particular recipient address, the vacation action will still > respond for it if the message is addressed at that recipient explicitly > in the headers. Read https://tools.ietf.org/html/rfc5230#section-4.5 for > more info. > > Due to the way you invoke dovecot-lda, Sieve only gets to see the > original recipient address, which is "office at example.com". I am > assuming, that is what is in either the "To" or "Cc" headers of the > message, which means that vacation will respond. > > This problem is probably fixed by using a -r ${recipient} parameter for > dovecot-lda, in addition to the existing -a argument. This way, vacation > will use the final recipient address instead. LDA parameters are > documented here: http://wiki2.dovecot.org/LDA#Parameters . > > There is additional info in the description of the > sieve_vacation_use_original_recipient setting > (http://wiki2.dovecot.org/Pigeonhole/Sieve/Extensions/Vacation#Configuration). > Leave this at the default "no" though, as "yes" would negate the fix > described above. > > Regards, > > Stephan. > -- Harald Leithner ITronic Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner at itronic.at | itronic.at From jerry at ieee.org Wed Jul 27 21:03:11 2016 From: jerry at ieee.org (Jerry Krinock) Date: Wed, 27 Jul 2016 14:03:11 -0700 Subject: Client app says my chained Comodo cert is invalid Message-ID: <9313D410-36BE-4B7A-B6D6-AA97BE138515@ieee.org> I?ve configured Dovecot and Postfix on a new VPS running Ubuntu 16.04, using Linode?s tutorial [1], to require authentication and SSL encryption for both POP3 and SMTP. All looks OK to me except, when my email client app (macOS Mail.app) tries to log in, it says that my cert is invalid. The trouble appears when I attempt to configure a client account in Mail.app on my Mac. For the POP server name, I enter my VPS? ?45.56.81.181", because public DNS is still pointing to my existing host. I set the account to use the Apple TLS certificate, and then click to save this new account info. Before saving, Mail.app checks my entries by attempting to log in. The result is: ?The identify of server 45.56.81.181 cannot be verified. The certificate for this server is invalid.? At the same time, on my new server, some entries appear in /var/log/mail.log [2]. The certificate in question is a new PositiveSSL/Comodo cert I bought the other day. It works OK for serving web pages - I mean, on this same Mac, when I visit my under-construction site at https://45.56.81.181 in Safari or Firefox, I get the padlock icon and no warnings. Comodo gave me two two files, a ?.crt? which contains my cert, and a ?.ca-bundle.crt? which contains their certs. Per Dovecot documentation, I concatenated these into a ?chained? file containing all 3 certs, starting with mine. In /etc/dovecot/conf.d/10-ssl.conf, I set ssl_cert = this ?chained? file. I tried adding the two original cert files to macOS Keychain.app with ?Always trust? but that did not help. Being new at this, I would appreciate any suggestions. My `dovecot -n` output is below [3]. Thank you very much! Jerry Krinock [1] https://www.linode.com/docs/email/postfix/email-with-postfix-dovecot-and-mysql ************************************************** [2] /var/log/mail.log entries when client attempts login Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x10, ret=1: before/accept initialization [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x2001, ret=1: before/accept initialization [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x2001, ret=1: unknown state [24.4.251.228] Jul 27 12:22:19 bird dovecot: message repeated 6 times: [ pop3-login: Debug: SSL: where=0x2001, ret=1: unknown state [24.4.251.228]] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x2002, ret=-1: unknown state [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL: where=0x2002, ret=-1: unknown state [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Warning: SSL failed: where=0x2002: unknown state [24.4.251.228] Jul 27 12:22:19 bird dovecot: pop3-login: Debug: SSL error: Disconnected Jul 27 12:22:19 bird dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=24.4.251.228, lip=45.56.81.181, TLS handshaking: Disconnected, session=<8HuX76I4p8gYBPvk> Yes, 24.4.251.228 is the IP address of my Mac. ************************************************** [3] Output from `dovecot -n` # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.5.5-x86_64-linode69 x86_64 Ubuntu 16.04 LTS ext4 auth_mechanisms = plain login mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap pop3 lmtp service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 995 } } ssl = required ssl_cert = References: <8bbc2e86-7cbf-34ad-be55-17bf47f58987@mx24.net> <94489cea-5a4b-de32-3201-4e096d5762aa@mx24.net> Message-ID: <74ad7ea7-573e-81b1-f536-e6df63d31d69@mx24.net> Hi, [Steffen Kaiser] - [2016-07-26 09:05] >>>> I am running a dovecot server and have set up an external >>>> monitoring, where every five minutes a login with SSL on port >>>> 993 is done. I usually get once a day an error "connection >>>> reset by peer - SSL connect", which goes away until the next >>>> monitor is executed. >>> that looks like a basic networking issue to me. Do you have logs >>> how many users try to connect at this time? Is it always the same >>> time range? Is the server load very high? >> My server has nice specs (in fact a 30 times lower scaled server >> never had this kind of problems), I also don't host many domains >> and users, therefore I doubt that some kind of limit might be >> touched. I also suspected some internal system load, but >> unfortunately the error occurs arbitrarily, which makes me think >> that no scheduled process is responsible for this. I also ran 'top' >> during such an event without any obvious load tasks. The system >> statistics also show no weird peaks. I read about the "running out >> of random" phenomenon, but during such an event there were still >> enough resources random-wise. > what about the network itself? Does the monitor crosses a firewall? I do not know all the details about my provider's data center, but the monitor is an internal one running on one of their machines in their infrastructure. I therefore doubt that this error could be related to some network issue. The monitor just makes a normal IMAP login and fails with the SSL error - and a few minutes later everything is fine again. >> Could it be that I need to offer more login processes or that I >> should raise some of my configuration values? The >> mail_max_userip_connections does not seem to solve the problem. > usually you get some warning in the logs, if such limit is reached. I desperately searched all kinds of logs - but nothing indicates a problem that would explain these arbitrary logon errors. I always thought that I should be more generous with login processes or other system resources in order to overcome this - but it seems that I am on the wrong track, if my doveconf -n does not show any oddities. I fear I will have to accept this error as being "normal" - which is really odd as my former server ran for years with the same config without any warning at all. Maybe the next will do it again ... :))) -- Cheers, \\|// Vince (o o) ----------------------------ooO-(_)-Ooo------------------------- ''' (o)_(o) [ ][0][ ] ??? (=?o?=) World Domination by Copy and Paste [ ][ ][0] - (")_(") [0][0][0] () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments Ooo. ---------------------------.ooO----( )------------------------- ( ) (_/ \_) From jtam.home at gmail.com Wed Jul 27 22:20:48 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Wed, 27 Jul 2016 15:20:48 -0700 (PDT) Subject: Client app says my chained Comodo cert is invalid In-Reply-To: References: Message-ID: > The trouble appears when I attempt to configure a client account in > Mail.app on my Mac. For the POP server name, I enter my VPS? > ?45.56.81.181", because public DNS is still pointing to my existing > host. I set the account to use the Apple TLS certificate, and then > click to save this new account info. Before saving, Mail.app checks my > entries by attempting to log in. The result is: ?The identify of > server 45.56.81.181 cannot be verified. The certificate for this > server is invalid.? Well, yes, that's what you would expect. You've told your mail client to connect to "45.56.81.181", the client starts the SSL negotiation and finds the certificate is made out for "sheepsystems.com", and your mail client complains about the mismatch (a possible MITM attack). This is what you want SSL enabled system to do. Since 45.56.81.181 does not map to "sheepsystems.com" yet, you can short-circuit DNS and add a direct mapping to your Mac by adding this to /etc/hosts: 45.56.81.181 sheepsystems.com then reconfiguring your mail client to use the server "sheepsystems.com". This will appease the SSL constraint. > appear in /var/log/mail.log [2]. Don't know what this is about -- probably your Mac bailing out on authentication. Joseph Tam From jerry at ieee.org Wed Jul 27 23:36:47 2016 From: jerry at ieee.org (Jerry Krinock) Date: Wed, 27 Jul 2016 16:36:47 -0700 Subject: Client app says my chained Comodo cert is invalid In-Reply-To: References: Message-ID: <4B4588F8-9AD6-4AA6-91F2-E1D96B35B3A4@ieee.org> > On 2016 Jul 27, at 15:20, Joseph Tam wrote: > > Well, yes, that's what you would expect. You've told your mail client > to connect to "45.56.81.181", the client starts the SSL negotiation > and finds the certificate is made out for "sheepsystems.com", and your > mail client complains about the mismatch (a possible MITM attack). > This is what you want SSL enabled system to do. Very sensible - I hadn?t thought of that. > Since 45.56.81.181 does not map to "sheepsystems.com" yet, you can > short-circuit DNS and add a direct mapping to your Mac by adding this > to /etc/hosts: > > 45.56.81.181 sheepsystems.com > > then reconfiguring your mail client to use the server "sheepsystems.com". > This will appease the SSL constraint. I did that, and it appears working now ? logging in, finding no messages and logging out. Of course, I?d been using that private/etc/hosts patch to test my new web pages, but it didn?t seem to work with email ? it was still hitting my existing server. It now appears that, with Mail.app, unlike with Safari and Firefox, one must flush the DNS cache (sudo killall -HUP mDNSResponder), and/or relaunch Mail.app, after changing /private/etc/hosts. > Don't know [those log entries] this is about -- probably your Mac bailing out on authentication. Yes, that?s what I thought - when it didn?t like the cert it just aborted and the server logged a timeout. Well, definitely you?ve gotten me over one hurdle and I?m on to the next one :) Thank you, Joseph! From jerrykrinock at gmail.com Wed Jul 27 23:30:21 2016 From: jerrykrinock at gmail.com (Jerry Krinock) Date: Wed, 27 Jul 2016 16:30:21 -0700 Subject: Client app says my chained Comodo cert is invalid In-Reply-To: References: Message-ID: > On 2016 Jul 27, at 15:20, Joseph Tam wrote: > > Well, yes, that's what you would expect. You've told your mail client > to connect to "45.56.81.181", the client starts the SSL negotiation > and finds the certificate is made out for "sheepsystems.com", and your > mail client complains about the mismatch (a possible MITM attack). > This is what you want SSL enabled system to do. Very sensible - I hadn?t thought of that. > Since 45.56.81.181 does not map to "sheepsystems.com" yet, you can > short-circuit DNS and add a direct mapping to your Mac by adding this > to /etc/hosts: > > 45.56.81.181 sheepsystems.com > > then reconfiguring your mail client to use the server "sheepsystems.com". > This will appease the SSL constraint. I did that, and it appears working now ? logging in, finding no messages and logging out. Of course, I?d been using that private/etc/hosts patch to test my new web pages, but it didn?t seem to work with email ? it was still hitting my existing server. It now appears that, with Mail.app, unlike with Safari and Firefox, one must flush the DNS cache (sudo killall -HUP mDNSResponder), and/or relaunch Mail.app, after changing /private/etc/hosts. > Don't know [those log entries] this is about -- probably your Mac bailing out on authentication. Yes, that?s what I thought - when it didn?t like the cert it just aborted and the server logged a timeout. Well, definitely you?ve gotten me over one hurdle and I?m on to the next one :) Thank you, Joseph! From news at mefox.org Fri Jul 29 03:20:20 2016 From: news at mefox.org (Michael Fox) Date: Thu, 28 Jul 2016 20:20:20 -0700 Subject: POP3 & IMAP inbox setting for virtual Message-ID: <02ab01d1e948$237eba80$6a7c2f80$@mefox.org> Posted Monday 7/25. Haven't seen a response. Trying again: --- This is a noobie question, so bear with me if it's not worded correctly: Primary Requirements: 1) I'd like to have two namespaces - one private/per-user, and one public (visible by all logged-in users). The public mailbox(s) would be used to distribute information to all users. 2) I'd like both POP3 and IMAP users to see both namespaces. As I understand it, this requires the use of the virtual plugin for POP3, in order to create a virtual namespace which would mix together the private and public namespaces into one mailbox. I have read: http://wiki.dovecot.org/Plugins/Virtual https://sys4.de/de/blog/2013/02/11/dovecot-virtual-setup-mit-globaler-sieve- spamfilter-regel-fur-pop3-nutzer/ (via Google translation) The example uses a CASE statement in the MySQL userdb query. As I understand it, this is done to set which namespace contains the inbox: the private namespace or the virtual namespace -- depending on if the user is connected via the imap or pop3 service, respectively. Question: how do I accomplish the same goal (setting the proper namespace for the inbox) when using a passwd-file style flat file userdb? Thanks, Michael From skdovecot at smail.inf.fh-brs.de Fri Jul 29 07:03:30 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 29 Jul 2016 09:03:30 +0200 (CEST) Subject: POP3 & IMAP inbox setting for virtual In-Reply-To: <02ab01d1e948$237eba80$6a7c2f80$@mefox.org> References: <02ab01d1e948$237eba80$6a7c2f80$@mefox.org> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 28 Jul 2016, Michael Fox wrote: > 2) I'd like both POP3 and IMAP users to see both namespaces. > > As I understand it, this requires the use of the virtual plugin for POP3, in > order to create a virtual namespace which would mix together the private and > public namespaces into one mailbox. > I have read: > > http://wiki.dovecot.org/Plugins/Virtual > > https://sys4.de/de/blog/2013/02/11/dovecot-virtual-setup-mit-globaler-sieve- > spamfilter-regel-fur-pop3-nutzer/ (via Google translation) > > The example uses a CASE statement in the MySQL userdb query. As I > understand it, this is done to set which namespace contains the inbox: the > private namespace or the virtual namespace -- depending on if the user is > connected via the imap or pop3 service, respectively. > Question: how do I accomplish the same goal (setting the proper namespace > for the inbox) when using a passwd-file style flat file userdb? you can select the passwd-file by %u , e.g. see the first example of passdb's on http://wiki2.dovecot.org/AuthDatabase/PasswdFile So, generate a passwd-file with namespace/inbox/inbox, make a script to strip this settings from it and dump into another file. This script is to run each time, the main file changes (or by cron), in order to keep both files in sync. Then: userdb { driver = passwd-file args = username_format=%n /etc/passwd.%s # default_fields = uid=vmail gid=vmail home=/home/vmail/%u } Then symlink /etc/passwd.POP3 to the file with and /etc/passwd.IMAP (and any other that generates not-found errors) to the file without the virtual namespace. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBV5r/wnz1H7kL/d9rAQIpkQgAyFra84aSp8q/osbQyI0J0Z+pEmcGGHeu stQmW/VLD9Nwtzlg2yLlFs6gUUBNaFhn0bREj0ZKB476lv1mjuY9/blanJFdn1zL sDGuWrNU+HbrG5aKusp/o3j5Box9YzkCxpVuxBOHvV+11uG1uWxiUkQ+o3tL/+K+ mJq1Hy9ADHan/yUfneJ+S4PFa3EeGYw1DX/iUwnNhILEwd4xY1ZunhSHVwpoKBhj sxkS4RmTzmCwcQ6qyLXXQAPM7zTsXkK5/uxzQlZC0TB9pTDLlyv5FFf8vH/fQIq8 CHOjC7Mgl4yXnYcA2m8QuQvB9VS8ae6Yy+1QO2/kaaPLQhZvT2HrQQ== =OrWi -----END PGP SIGNATURE----- From bra at fsn.hu Fri Jul 29 12:35:27 2016 From: bra at fsn.hu (Nagy, Attila) Date: Fri, 29 Jul 2016 14:35:27 +0200 Subject: Dict protocol changes string Message-ID: <09ccc308-80b2-f245-00f4-8134e7f7ab96@fsn.hu> Hi, I use pass and userdb with dict protocol in a similar way: key passdb { key = passdb^MAuth-User: %u^MAuth-Pass: %w^MAuth-Protocol: %s^MClient-IP: %r format = json } (^M is an \r character, inserted with vi CTRL-v + enter) Until 2.2.24 this has worked, but 2.2.25 seems to convert that ASCII 13 into an ASCII 1 and an "r". Python printout from what I get with 2.2.25: 'Lshared/passdb\x01rAuth-User: user\x01rAuth-Pass: pass\x01rAuth-Protocol: pop3\x01rClient-IP: 1.2.3.4' Is this change intentional? Why? From rick at havokmon.com Fri Jul 29 13:04:33 2016 From: rick at havokmon.com (Rick Romero) Date: Fri, 29 Jul 2016 08:04:33 -0500 Subject: Master-Master replication question In-Reply-To: <20160711124650.Horde.1-H5SA0uh808x8k83FI_mw9@www.vfemail.net> References: <1304695756.35.1467803735221@openexchange.elvandar.org> <20160711105305.Horde.9o17R_pwGjMK5I9_aMqYCQ6@www.vfemail.net> <20160711124650.Horde.1-H5SA0uh808x8k83FI_mw9@www.vfemail.net> Message-ID: <20160729080433.Horde.OAWnwjkd9cWKfHekflv6OQ1@www.vfemail.net> Quoting Rick Romero : > Quoting "William L. Thomson Jr." : > >> On Monday, July 11, 2016 10:53:05 AM Rick Romero wrote: >> >>> I don't think that'll help.? From what I understand, LMTP is required >>> for >>> replication on delivery. >> >> Where did you come across that requirement? I do not recall that.? > > Hmmm I can't seem to find any reference to it.? Maybe it was from the > old blog - > http://blog.dovecot.org/2012/02/dovecot-clustering-with-dsync-based.html? > My understanding/assumption is that LDA delivers and updates indexes. I > assume using LMTP delivers, updates indexes and kicks off a quick sync. > ? > > Out of curiousity, why do you use SMTP from the MX to the destination > >>> server instead of LMTP? >> >> My reason is because qmail does not support that. I am not sure if I will >> migrate to exim or postfix. Seems others have inquired about LMTP with >> qmail, >> might be something out there. > > > I use qmail as well - that's why I wrote/hacked the LMTP script :)? I've gotten replication working with both LDA and LMTP.? Though I believe the LDA replication that I've seen is actually from the IMAP notify/replicaiton plugin. I've only done some preliminary testing. LMTP replication is imemdiate when I use my LMTP perl script instead of procmail or vdelivermail. Otherwise, as I said with LDA above, I'm not sure how dovecot would know the indexes change from the front-end NFS mounted MX. In any case, what I got stuck on was the mail_plugins.? The Replication page seems to just refer to the global plugin settings, but you also have to add them to each service.? That finally worked. protocol imap { ? imap_client_workarounds = delay-newmail tb-extra-mailbox-sep ? mail_max_userip_connections = 25 ? mail_plugins = " quota zlib stats notify replication imap_zlib quota imap_quota NOTIFY REPLICATION" } protocol pop3 { ? mail_max_userip_connections = 25 ? mail_plugins = quota NOTIFY REPLICATION ? pop3_client_workarounds = outlook-no-nuls oe-ns-eoh ? pop3_uidl_format = %08Xu%08Xv } protocol lda { ? mail_plugins = sieve REPLICATION NOTIFY ? userdb { ??? args = /usr/local/etc/dovecot/dovecot-sql.conf ??? driver = sql ??? name = ? } } protocol lmtp { ? info_log_path = /var/log/dovecot-lmtp.log ? mail_plugins = sieve quota REPLICATION NOTIFY ? userdb { ??? args = /usr/local/etc/dovecot/dovecot-sql.conf ??? driver = sql ??? name = ? } } Rick From thomas at brix.si Fri Jul 29 19:59:14 2016 From: thomas at brix.si (=?UTF-8?B?VG9tYcW+?=) Date: Fri, 29 Jul 2016 21:59:14 +0200 Subject: Dovecot Director self ip Message-ID: <579BB592.2060702@brix.si> Hello everybody! I kindly ask somebody to help me with this problem. I'm trying to configure Dovecot proxy with Director. On the same machine is KeepAlived that needs this configured to bind non local IP: sysctl net.ipv4.ip_nonlocal_bind=1 But as already mentioned in this email: http://www.dovecot.org/list/dovecot/2012-November/087033.html Dovecot Director needs sysctl net.ipv4.ip_nonlocal_bind=0 (if this is set, everything works ok, but we break keepalived) because otherwise the second server uses IP from the first server as "self". Is it possible to configure this some other way, so Dovecot Director doesn't try to bind to all IPs and because of above configuration, uses the first one that binds. This is the result from director status on server 1: root at u1:~# doveadm director ring status director ip port type last failed status 172.16.100.191 9090 self never handshaking 172.16.100.192 9090 never handshaking and server 2: root at u2:/var/log# doveadm director ring status director ip port type last failed status 172.16.100.191 9090 self never handshaking 172.16.100.192 9090 never My dovecot config: http://pastebin.com/RnmHRWhY Thank you very much! Thomas From news at mefox.org Fri Jul 29 23:31:01 2016 From: news at mefox.org (Michael Fox) Date: Fri, 29 Jul 2016 16:31:01 -0700 Subject: POP3 & IMAP inbox setting for virtual In-Reply-To: References: <02ab01d1e948$237eba80$6a7c2f80$@mefox.org> Message-ID: <1b9a01d1e9f1$44960e90$cdc22bb0$@mefox.org> Thanks Steffen. > you can select the passwd-file by %u , e.g. see the first example of > passdb's on http://wiki2.dovecot.org/AuthDatabase/PasswdFile I think you mean by %s. Correct? > So, generate a passwd-file with namespace/inbox/inbox, make a script to > strip this settings from it and dump into another file. This script is to > run each time, the main file changes (or by cron), in order to keep both > files in sync. > > Then: > > userdb { > driver = passwd-file > args = username_format=%n /etc/passwd.%s > # default_fields = uid=vmail gid=vmail home=/home/vmail/%u > } > > Then symlink /etc/passwd.POP3 to the file with and /etc/passwd.IMAP (and > any other that generates not-found errors) to the file without the virtual > namespace. Hmm. But the goal is for both POP3 and IMAP to see both namespaces. POP3 would see both via the virtual namespace. So, following the idea of passwd-file per %s, it seems like I should do something like: .../passwd.pop3: Set the "extra fields" = userdb_namespace/virtual/inbox=yes .../passwd.imap: Set the "extra fields" = userdb_namespace/inbox/inbox=yes Does that make sense? Michael From mfoley at ohprs.org Sat Jul 30 06:00:38 2016 From: mfoley at ohprs.org (Mark Foley) Date: Sat, 30 Jul 2016 02:00:38 -0400 Subject: IMAP flags and dovecot-keywords not working as expected Message-ID: <201607300600.u6U60cCJ011737@mail.hprs.local> I've converted most of our users from Outlook to Thunderbird. One important feature of Thunderbird is that it pays attention to the IMAP non-standard message flags via the 'tags' feature (see http://wiki2.dovecot.org/MailboxFormat/Maildir). This is important because 2 users make extensive use of Outlook categories (Tags, in Thunderbird). I found that when I set a message to the 1st Tbird tag 0 (Important), the corresponding IMAP file got an 'a' suffix. Likewise, if I manually added an 'a' suffix to an IMAP file the corresponding tag was set displayed in Thunderbird. This made it easy for me to exports Outlook Categories and set IMAP messages flags accordingly. This worked perfectly on the user I was experimenting with (me). Recently, I converted one of these Outlook 'categories' users to Thunderbird. I added the appropriate flag letters to their IMAP messages, changed their tag names in Thunderbird, and created the following dovecot-keywords file as: 0 Board_and_Committee 1 Completed 2 Health_Care_meetings 3 Notifications 4 OSHP-DAS 5 personal_or_To_Do 6 Retirement_exits 7 $label5 8 Junk 9 $Forwarded 10 $MDNSent 11 $label2 However, none of the tags show up correctly in Thunderbird. If I manually set a message to have a tag of 0, the corresponding IMAP file gets a flag of 'm', not 'a' and the following is added to the dovecot-keywords files: 12 $label1 How can I fix this? Where is "$label1" text defined? Why did Thunderbird not snag the text for '0' from the dovecot-keywords file and give the IMAP file a tag of 'a'? My current theory is that the "Default" Thunderbird Tags corresponding to IMAP flags are not changeable and if new tags are create in Tbird, they get new flag letters. That would, of course, mean that if a user changes Thunderbird tag name, they would lose all tag settings on existing message. That doesn't seem right and I hope my theory is wrong. Any insight would be appreciated. --Mark From pch at myzel.net Sat Jul 30 09:26:09 2016 From: pch at myzel.net (Peter Chiochetti) Date: Sat, 30 Jul 2016 11:26:09 +0200 Subject: IMAP flags and dovecot-keywords not working as expected In-Reply-To: <201607300600.u6U60cCJ011737@mail.hprs.local> References: <201607300600.u6U60cCJ011737@mail.hprs.local> Message-ID: <2e9ce2f2-2666-187e-896c-0dcbbb54d062@myzel.net> Am 2016-07-30 um 08:00 schrieb Mark Foley: ? > > However, none of the tags show up correctly in Thunderbird. If I manually set a message to > have a tag of 0, the corresponding IMAP file gets a flag of 'm', not 'a' and the following is > added to the dovecot-keywords files: > > 12 $label1 > > How can I fix this? Where is "$label1" text defined? Why did Thunderbird not snag the text for > '0' from the dovecot-keywords file and give the IMAP file a tag of 'a'? Thunderbird flags are stored in the users prefs.js, eg: - user_pref("mailnews.tags.$label1.tag", "Important"); - user_pref("mailnews.tags.$label1.color", "#FF0000"); A kind of key->value assignment. The "$label[1-9]" keys are special, where the number magically corresponds to the keyboard shorcut to tag messages, 0 meaning clear all tags. There can be more than nine tags, but they wont have a shortcut then: - user_pref("mailnews.tags.ten.tag", "ten"); 1) The server will only ever see the key. The user will only ever see the value. 2) If you rename a label in TB, then only the value will change and the server will still see the same key as before. 3) If you rename a key in dovecot, TB will not create a label for it and the affected messages will no longer appear tagged, if TB does not know about the key. 4) Dovecot adds to the keywords as it receives requests from clients: Very likely there is a limit of 26 (letters of the alphabet) per account; a-d=0-3 are already taken for internal use, so 22 remain. > My current theory is that the "Default" Thunderbird Tags corresponding to IMAP flags are not > changeable and if new tags are create in Tbird, they get new flag letters. That would, of > course, mean that if a user changes Thunderbird tag name, they would lose all tag settings on > existing message. That doesn't seem right and I hope my theory is wrong. I think you are mostly wrong: as long as you only use TB to work and as long as you do not exceed the limit you should be save. Notice that tags are a scarce resource: any key you ever created counts toward the limit - reusing old tags requires you to text-edit both dovecot-keywords and TB prefs.js. -- peter From reuben-dovecot at reub.net Sun Jul 31 02:27:02 2016 From: reuben-dovecot at reub.net (Reuben Farrelly) Date: Sun, 31 Jul 2016 12:27:02 +1000 Subject: Sieve Script Replication Gliches (Report #2) Message-ID: <4ece61c7-5950-9231-7efe-cf2eb9e270b1@reub.net> Hi, I've observed some odd behaviour with dsync replication between two hosts, specifically to do with sieve script replication. In short, I have two hosts which replicate in a master-master type setup where almost all of the reads and writes happen to just one of the two hosts. They are both running 2.2.devel (9dc6403), which is close to the latest 2.2 -git . Pigeonhole is running master-0.4 . This is on x86_64 Gentoo. Normal mail replication between Maildir's for all users works fine, however it appears that something recently committed to the code has broken sieve script replication between the two. I am sure this did once work. Replication is via tcps: . Sieve scripts on the lesser-used host are not up to date by an order of days/weeks with the main host and they don't seem to re-replicate - even if the rules don't exist at all on the replica. The symptoms and effects look to be the same as this (unanswered) post from December: http://dovecot.org/list/dovecot/2015-December/102690.html I am not sure how to view the transaction log files, but I am seeing the same symptoms, ie no live replication, and on the lesser-used host almost all the scripts were old and some had the 1970 date on them. Even after forcing a [dsync replication replicate '*'] the scripts are not replicated. As it stands now there are no sieve scripts on one of the two members and the system seems unable to replicate by itself. Secondly, I am also seeing some doubled up outputs if I run 'doveadm sieve list -A': thunderstorm reuben # doveadm sieve list -A reuben rules ACTIVE liam rules ACTIVE kaylene rules ACTIVE reuben rules ACTIVE liam rules ACTIVE kaylene rules ACTIVE ... Has anyone else experienced the replication problem? Are sieve scripts actually replicating in live time for other 2.2.24/2.2.25 users as well? For me I didn't notice this till I went looking so I wonder if other people are experiencing this but just not aware of it yet...? Reuben From reuben-dovecot at reub.net Sun Jul 31 02:44:46 2016 From: reuben-dovecot at reub.net (Reuben Farrelly) Date: Sun, 31 Jul 2016 12:44:46 +1000 Subject: Occasional lock timeouts on Linode VM with Dovecot Replication In-Reply-To: References: Message-ID: <53e6b07d-7a7c-5ca4-eb88-2a6dd763b75f@reub.net> Hi again, Thanks for your response William, answers inline: On 21/07/2016 1:58 AM, William L. Thomson Jr. wrote: > Reuben, > > On Sunday, July 17, 2016 04:18:45 PM Reuben Farrelly wrote: >> I've been seeing periodic entries in my dovecot logs like this: >> >> dovecot[3464]: dsync-server(kaylene): Error: Couldn't lock >> /home/kaylene/.dovecot-sync.lock: Timed out after 30 seconds: 3 Time(s) >> dovecot[3464]: dsync-server(reuben): Error: Couldn't lock >> /home/reuben/.dovecot-sync.lock: Timed out after 30 seconds: 1 Time(s) >> >> They occur several times per day, but don't appear to have any obvious >> cause and I am not aware of any problems this is causing. [They could >> be the cause of some reappearing UID type messages that also >> periodically are logged, but I can't be sure] >> >> They occur on a lightly loaded Linode VM, KVM Paravirtualised and with >> only local SSD disk storage. The VM is a Gentoo Linux VM running the >> latest kernels that Linode provide. I also saw this problem under Xen. > > I am running the same, Gentoo, replicating Dovecot, on Linode VMs. Only > difference is I am using NFS, it seems you are using local disk. I have never > had issues like your experiencing. My mail VMs get pretty loaded at times due > ASSP and mail volume. I would not think it to be load related what so ever. Thanks - yes - looks to be unrelated to load then. > If you feel it might be specific to that VM you might request Linode move it to > a new host machine. I have had one of my mail servers have some issues before > and it was host related. Linode opened a ticket and migrated it about the time > I got the first Nagios notification. If you get Linode to migrate the VM and it > continues, you can rule out the host at least. I've already ruled out the host. I had this Linode in the Freemont farm all of last year, and migrated it to Singapore earlier this year. The errors remained, which to me more or less rules out the hardware on the host as a problem (I suppose it is possible both were about equally impacted but it's not so likely). I've also moved from Xen to KVM and the problem didn't go away either. >> Is this a common warning to see in cloud hosted/shared environments? > > Not to my knowledge, I have never seen that error before. I am not seeing it on VMware here on my main host (I don't think the error has ever been logged here. It has the same filesystem, same version of dovecot, same arch, the only difference that I can think of is the latency of about 130ms between the two replica hosts. Can anyone advise what I can do to further debug the problem? The error message isn't helping much determine where to look next. Thanks, Reuben From hanasaki at gmail.com Sun Jul 31 02:54:56 2016 From: hanasaki at gmail.com (hanasaki at gmail.com) Date: Sat, 30 Jul 2016 22:54:56 -0400 Subject: self signed certs and dovecot imaps : howto? tlsv1 alert unknown ca Message-ID: <511c80d5-3f38-d051-d538-ac22c2891d3c@gmail.com> How do you setup dovecot to use a self signed cert? One server will be connected to the internet. One will be totally internal and have no runtime access to the internet. Getting the below error msg. Also, I think I have a TLS 1.0 and need a 1.2 cert?... Thank you. Jul 28 20:09:27 host dovecot: imap-login:: user=<>, rip=10...., lip=10...., TLS: SSL_read() failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca: SSL alert number 48, session= From vstargben at gmail.com Sun Jul 31 10:20:53 2016 From: vstargben at gmail.com (vstargben at gmail.com) Date: Sun, 31 Jul 2016 12:20:53 +0200 Subject: migration from cyrus; seg fault at mail_namespaces_get_root_sep Message-ID: <579DD105.90907@gmail.com> Hi all, I am currently trying to migrate from cyrus to dovecot on a new system. Though only few accounts, I decided to use the mdbox format. To convert I use cyrus2dovecot first, then I use dsync to import the mailboxes. For compatibility I set the namespace of inbox to prefix = INBOX. and separator = . (as described here: http://wiki2.dovecot.org/Migration/Cyrus http://wiki.dovecot.org/Namespaces). This works except that the clients (mutt and Thunderbird) show an additional folder/mailbox "INBOX" below the inbox. How can I fix that? Should I add a prefix during conversion and not change the namespace config? On disk, the subfolders are next to INBOX. Well, I then tried to set list = children instead of "yes" for namespace inbox. On login a segfault occurs with this setting. See the information and backtrace below. Regards, Vincent ########################################################### linux-server2:~ # dovecot --version 2.2.25 (7be1766) linux-server2:~ # dovecot -n # 2.2.25 (7be1766): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: Linux 4.1.21-14-default x86_64 openSUSE 42.1 (x86_64) btrfs base_dir = /data/mail/dovecot/ disable_plaintext_auth = no mail_debug = yes mail_gid = dovecot mail_location = mdbox:/data/mail/dovecot/maildat/%u mail_privileged_group = dovecot mail_uid = dovecot managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes list = children location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX. separator = . } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap lmtp ssl = no ssl_dh_parameters_length = 2048 ssl_options = no_compression ssl_prefer_server_ciphers = yes userdb { driver = passwd } ################################################################ GNU gdb (GDB; openSUSE Leap 42.1) 7.9.1 Copyright (C) 2015 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-suse-linux". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/lib/dovecot/imap...Reading symbols from /usr/lib/debug/usr/lib/dovecot/imap.debug...done. done. [New LWP 8366] Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. #0 mail_namespaces_get_root_sep (namespaces=0x0) at mail-namespace.c:601 601 mail-namespace.c: Datei oder Verzeichnis nicht gefunden. Missing separate debuginfos, use: zypper install glibc-debuginfo-2.19-19.1.x86_64 (gdb) bt full #0 mail_namespaces_get_root_sep (namespaces=0x0) at mail-namespace.c:601 No locals. #1 0x0000559bfb1792a5 in cmd_list_ref_root (ref=0x559bfd155d78 "", client=0x559bfd155020) at cmd-list.c:324 ns = 0x0 ns_prefix = 0x559bfb1963ea "" ns_sep = str = #2 cmd_list_full (cmd=0x559bfd155c00, lsub=) at cmd-list.c:461 client = 0x559bfd155020 args = 0x559bfd1289b8 list_args = 0x7f02a7ab0093 arg_count = 21915 patterns = {arr = {buffer = 0x559bfd155d88, element_size = 8}, v = 0x559bfd155d88, v_modifiable = 0x559bfd155d88} ref = 0x559bfd155d78 "" pattern = 0x559bfd155d80 "" str = #3 0x0000559bfb1818ed in command_exec (cmd=cmd at entry=0x559bfd155c00) at imap-commands.c:180 hook = 0x559bfd125110 finished = cmd_start_timeval = {tv_sec = 1469732468, tv_usec = 662738} cmd_start_bytes_in = 29 cmd_start_bytes_out = 746 __FUNCTION__ = "command_exec" #4 0x0000559bfb17fe4f in client_command_input (cmd=cmd at entry=0x559bfd155c00) at imap-client.c:969 client = 0x559bfd155020 command = __FUNCTION__ = "client_command_input" #5 0x0000559bfb17fedf in client_command_input (cmd=0x559bfd155c00) at imap-client.c:1029 client = 0x559bfd155020 command = __FUNCTION__ = "client_command_input" #6 0x0000559bfb180285 in client_handle_next_command (remove_io_r=, client=0x559bfd155020) at imap-client.c:1069 No locals. #7 client_handle_input (client=client at entry=0x559bfd155020) at imap-client.c:1081 _data_stack_cur_id = 3 remove_io = false handled_commands = true __FUNCTION__ = "client_handle_input" #8 0x0000559bfb180785 in client_input (client=0x559bfd155020) at imap-client.c:1128 cmd = 0x559bfd136130 output = 0x559bfd155a40 bytes = 36 ---Type to continue, or q to quit--- __FUNCTION__ = "client_input" #9 0x00007f02a7ac49dc in io_loop_call_io (io=0x559bfd155b10) at ioloop.c:564 ioloop = 0x559bfd124740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #10 0x00007f02a7ac5ce7 in io_loop_handler_run_internal (ioloop=ioloop at entry=0x559bfd124740) at ioloop-epoll.c:220 ctx = 0x559bfd126260 list = 0x559bfd127c90 io = tv = {tv_sec = 1799, tv_usec = 999471} events_count = msecs = ret = 1 i = 0 call = __FUNCTION__ = "io_loop_handler_run_internal" #11 0x00007f02a7ac4a65 in io_loop_handler_run (ioloop=ioloop at entry=0x559bfd124740) at ioloop.c:612 No locals. #12 0x00007f02a7ac4c18 in io_loop_run (ioloop=0x559bfd124740) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #13 0x00007f02a7a5a1e3 in master_service_run (service=0x559bfd1245e0, callback=) at master-service.c:640 No locals. #14 0x0000559bfb173eb2 in main (argc=1, argv=0x559bfd124390) at main.c:460 set_roots = {0x559bfb39c520 , 0x7f02a8274b20 , 0x0} login_set = {auth_socket_path = 0x559bfd11c050 "\210\300\021\375\233U", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x559bfb18cbd0 , failure_callback = 0x559bfb18c560 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 auth_socket_path = 0x559bfb19530e "auth-master" c = (gdb) From me at junc.eu Sun Jul 31 13:04:53 2016 From: me at junc.eu (Benny Pedersen) Date: Sun, 31 Jul 2016 15:04:53 +0200 Subject: dovecot runs on a pbl listed ip ? Message-ID: X-Spam-Report: * 3.3 RCVD_IN_PBL RBL: Received via a relay in Spamhaus PBL * [52.178.156.48 listed in zen.spamhaus.org] * 3.6 FS_REPLICA Subject says "replica" * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's * domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature * 0.8 RDNS_NONE Delivered to internal network by a host with no rDNS Received: from talvi.dovecot.org (unknown [52.178.156.48]) by wursti.dovecot.fi (Postfix) with ESMTP; Sun, 31 Jul 2016 04:27:22 +0200 (CEST) sorry if its not just me :( make sure all wan ips is in trusted-networks / internal-networks atleast in spamassassin who will make a bug for replica ? :=) From trashcan at ellael.org Sun Jul 31 14:18:21 2016 From: trashcan at ellael.org (Michael Grimm) Date: Sun, 31 Jul 2016 16:18:21 +0200 Subject: Sieve Script Replication Gliches (Report #2) In-Reply-To: <4ece61c7-5950-9231-7efe-cf2eb9e270b1@reub.net> References: <4ece61c7-5950-9231-7efe-cf2eb9e270b1@reub.net> Message-ID: Reuben Farrelly wrote: > I've observed some odd behaviour with dsync replication between two hosts, specifically to do with sieve script replication. [?] > Has anyone else experienced the replication problem? Are sieve scripts actually replicating in live time for other 2.2.24/2.2.25 users as well? For me I didn't notice this till I went looking so I wonder if other people are experiencing this but just not aware of it yet...? Welcome to the club: http://dovecot.org/list/dovecot/2016-July/105014.html If I am not mistaken you are the fourth now reporting this issue. No solution yet. Regards, Michael From aki.tuomi at dovecot.fi Sun Jul 31 14:36:40 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 31 Jul 2016 17:36:40 +0300 (EEST) Subject: any news Enterprise Repository Access? In-Reply-To: References: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> <4023f52c-0fe0-d995-4c70-3e568583979b@uni-x.org> <46fba39b-8783-cb3e-72f4-120424071704@filmakademie.de> Message-ID: <659614438.3504.1469975801766@appsuite-dev.open-xchange.com> We are discussing about making ce repos at some point. This would probably help some people. Aki > On July 27, 2016 at 6:03 PM KT Walrus wrote: > > > > That dovecot offers still EE build for free is great, but a road map on > > what the future subscription plans are would be nice; e.g low cost fee > > for just the repos, higher fees for support etc. That's what I missed. > > I?d like to see Dovecot distributed in the Docker Store (coming soon) or the Docker Hub. Most enterprises are moving to deploying their apps in containers and these containers can run on your laptop the same as they run in production. Most modern Linux distributions support Docker these days. > > I build and run Dovecot in Docker now (built from latest released sources against Ubuntu 16.04), and while I am still in development, I?m sure Docker is the way to run my apps and will run great for deployment and maintenance. > > Kevin > > > On Jul 27, 2016, at 2:31 AM, G?tz Reinicke - IT Koordinator wrote: > > > > Am 26.07.16 um 21:12 schrieb Alexander Dalloz: > >> Am 26.07.2016 um 14:41 schrieb Sami Ketola: > >>> > >>>> On 26 Jul 2016, at 09:18, G?tz Reinicke - IT Koordinator > >>>> wrote: > >>>> > >>>> Hi, > >>>> we had access to the repository and it was working fine. But as we cant > >>>> get the 2.2.25 update I was looking into the repofolders and there are > >>>> RPMs "just" for RHEL 6// but not 5 any more. > >>>> > >>>> My be I missed the latest discussions or announcements? Could you give > >>>> me an update on information and may be the RHEL 5 RPMs too? > >>>> > >>>> Thanks a lot and regards . G?tz > >>> > >>> > >>> Dovecot EE build support for RHEL 5 / CentOS 5 is going away soon > >>> even if we still made one more build for CentOS 5. Please upgrade > >>> your system. > >>> > >>> Sami > >> > >> Not only because of dovecot > >> > >> [21:09:27 CEST] CentOS 5 will go EOL on 31 March, 2017 -- in > >> 35 weeks, 2 days, 4 hours, 50 minutes, and 47 seconds but be aware > >> that it is now in production phase 3 and only receives critical updates > >> > >> Alexander > > Thx for your both feedback, and yes, it is EOL but as you mentioned in > > 35+ weeks. O.K. Redhat never did a dovecot update to the current version > > and as a lot of customers we think the update policy for some software > > should be changed too to support more modern versions of "core" server > > services. But that's not a dovecot topic ;) > > > > That dovecot offers still EE build for free is great, but a road map on > > what the future subscription plans are would be nice; e.g low cost fee > > for just the repos, higher fees for support etc. That's what I missed. > > > > Regards . G?tz > > > > > > > > > > From aki.tuomi at dovecot.fi Sun Jul 31 14:39:57 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 31 Jul 2016 17:39:57 +0300 (EEST) Subject: New password hashing scheme as plugin In-Reply-To: References: Message-ID: <424914848.3507.1469975998263@appsuite-dev.open-xchange.com> > On July 27, 2016 at 2:08 AM Andreas Meyer wrote: > > > Hi, > > > I want to add a new password hashing scheme as plugin and provide it for > the dovecot project, so that it will be included as optional plugin in > future releases. > > Yet the plugin compiles fine and the .so file gets created. > > My approach is to call the functions password_scheme_register() and > password_scheme_unregister() (src/auth/password-scheme.c) inside the > plugin's _init() and _deinit() functions. > > When a client tries to login via imap the log shows an error message: > > Error: Couldn't load required plugin > /usr/local/lib/dovecot/lib20_newauth_plugin.so: dlopen() failed: > /usr/local/lib/dovecot/lib20_newauth_plugin.so: undefined symbol: > password_scheme_unregister > > That error obviously occurs, because the required lib is not linked into > the plugin. > > > Now my problem is to understand, whether this approach (via .so file) can > be successful at all and if so, how? > Do I need to link libs into it? Which would that be and how do I specify > them in the Makefile.am? > > I assume, I don't need to link a lib, but need to use a hook to register > the new hashing scheme, since the plugin is loaded into an already existing > process, which needs to get extended. If this is true, which hook would > that be and how do I register the new scheme? > > Or is there no way to accomplish this via a separated .so plugin? Should I > extend the sources in /src/auth instead? (separat file for the hashing > scheme with preprocessor instructions to include it only on demand) > > > > Thank you very much, > > Andreas Can you publish your code in, say, github.com and provide link to it? New password scheme is doable as plugin but it needs to placed in different place and it will be autoloaded. Aki From aki.tuomi at dovecot.fi Sun Jul 31 14:40:45 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 31 Jul 2016 17:40:45 +0300 (EEST) Subject: dovecot runs on a pbl listed ip ? In-Reply-To: References: Message-ID: <1706623964.3510.1469976045739@appsuite-dev.open-xchange.com> > On July 31, 2016 at 4:04 PM Benny Pedersen wrote: > > > X-Spam-Report: > * 3.3 RCVD_IN_PBL RBL: Received via a relay in Spamhaus PBL > * [52.178.156.48 listed in zen.spamhaus.org] > * 3.6 FS_REPLICA Subject says "replica" > * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% > * [score: 0.0000] > * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from > author's > * domain > * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily > * valid > * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature > * 0.8 RDNS_NONE Delivered to internal network by a host with no rDNS > Received: from talvi.dovecot.org (unknown [52.178.156.48]) > by wursti.dovecot.fi (Postfix) with ESMTP; > Sun, 31 Jul 2016 04:27:22 +0200 (CEST) > > sorry if its not just me :( > > make sure all wan ips is in trusted-networks / internal-networks atleast > in spamassassin > > who will make a bug for replica ? :=) We'll have a look. Aki From lists at merit.unu.edu Sun Jul 31 17:04:33 2016 From: lists at merit.unu.edu (mj) Date: Sun, 31 Jul 2016 19:04:33 +0200 Subject: any news Enterprise Repository Access? In-Reply-To: <659614438.3504.1469975801766@appsuite-dev.open-xchange.com> References: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> <4023f52c-0fe0-d995-4c70-3e568583979b@uni-x.org> <46fba39b-8783-cb3e-72f4-120424071704@filmakademie.de> <659614438.3504.1469975801766@appsuite-dev.open-xchange.com> Message-ID: Hi, On 07/31/2016 04:36 PM, aki.tuomi at dovecot.fi wrote: > We are discussing about making ce repos at some point. This would probably help some people. > > Aki We're following this thread with interest. What exactly is a "ce repository"? (google doesn't help) MJ From lists at merit.unu.edu Sun Jul 31 18:18:39 2016 From: lists at merit.unu.edu (mj) Date: Sun, 31 Jul 2016 20:18:39 +0200 Subject: any news Enterprise Repository Access? In-Reply-To: References: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> <4023f52c-0fe0-d995-4c70-3e568583979b@uni-x.org> <46fba39b-8783-cb3e-72f4-120424071704@filmakademie.de> <659614438.3504.1469975801766@appsuite-dev.open-xchange.com> Message-ID: <1e9e5cc4-9c9f-9550-54b3-81975bde5308@merit.unu.edu> On 07/31/2016 07:04 PM, mj wrote: > What exactly is a "ce repository"? Guessing now: Community Edition... Such a repo would be very much welcomed by us! (currently running wheezy with it's original dovecot, 2.1.7) MJ From aki.tuomi at dovecot.fi Sun Jul 31 20:19:12 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 31 Jul 2016 23:19:12 +0300 (EEST) Subject: any news Enterprise Repository Access? In-Reply-To: <1e9e5cc4-9c9f-9550-54b3-81975bde5308@merit.unu.edu> References: <4ba0135b-ec88-7225-148f-fc1c2a08cf39@filmakademie.de> <843AB705-0CEC-439A-838D-26CD83C3E8A5@dovecot.fi> <4023f52c-0fe0-d995-4c70-3e568583979b@uni-x.org> <46fba39b-8783-cb3e-72f4-120424071704@filmakademie.de> <659614438.3504.1469975801766@appsuite-dev.open-xchange.com> <1e9e5cc4-9c9f-9550-54b3-81975bde5308@merit.unu.edu> Message-ID: <2072963351.3563.1469996353684@appsuite-dev.open-xchange.com> > On July 31, 2016 at 9:18 PM mj wrote: > > > > > On 07/31/2016 07:04 PM, mj wrote: > > What exactly is a "ce repository"? > > Guessing now: Community Edition... > > Such a repo would be very much welcomed by us! (currently running wheezy > with it's original dovecot, 2.1.7) > > MJ Yes. Similar to xi.dovecot.net but officially maintained by dovecot oy. Hopefully we are able to provide one. Aki