July 2016 - dovecot - dovecot.org

duplicated mail in users inbox only
by Tom Priebe 07 Jul '16

07 Jul '16

Hello, one of my users has the issue that some mails seem to get doubled -- but only in their inbox. The mail is bcc'd to them and the original recipient receives one copy as intended. The log shows nothing extraordinary, postfix, dovecot and sieve are certain that they received and delivered one single mail (per user). Further research showed that the doubled mails' mailbox files have the same inode, which seems inexplicable. I'm using dovecot 2.2.13 replicated over two servers (Master-Master). Duplication seems to happen regardless of the receiving server, yet still not all mails they receive with them in bcc are duplicated. Here's doveconf -n > # 2.2.13: /etc/dovecot/dovecot.conf > # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.3 > auth_gssapi_hostname = mail.net.t-labs.tu-berlin.de > auth_mechanisms = login plain gssapi > auth_username_format = %n > auth_verbose = yes > default_client_limit = 1024 > default_process_limit = 1024 > default_vsz_limit = 512 M > doveadm_password = supersecretpassword > listen = *, [::] > log_timestamp = "%Y-%m-%d %H:%M:%S " > login_log_format_elements = user=<%u> method=%m rip=%r lip=%l > %c % > mail_location = maildir:~/Maildir > mail_plugins = " notify replication" > mail_privileged_group = mail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded- > character vacation subaddress comparator-i;ascii-numeric relational > regex imap4flags copy include variables body enotify environment > mailbox date ihave > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = failure_show_msg=yes dovecot > driver = pam > } > plugin { > mail_replica = remote:vmail@mail1.inet.tu-berlin.de > sieve = /mail/home/%u/.dovecot.sieve > sieve_dir = /mail/home/%u/sieve > sieve_max_redirects = 20 > } > postmaster_address = postmaster(a)net.t-labs.tu-berlin.de > protocols = imap sieve > service aggregator { > fifo_listener replication-notify-fifo { > user = vmail > } > unix_listener replication-notify { > user = vmail > } > } > service anvil { > chroot = empty > client_limit = 4096 > process_limit = 1 > } > service auth { > client_limit = 4096 > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-master { > mode = 0600 > user = vmail > } > unix_listener auth-userdb { > mode = 0600 > user = vmail > } > user = root > } > service doveadm { > inet_listener { > port = 12345 > ssl = yes > } > } > service imap-login { > client_limit = 1024 > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > process_limit = 100 > process_min_avail = 2 > service_count = 50 > } > service imap { > process_limit = 1024 > } > service managesieve-login { > client_limit = 1024 > executable = /usr/lib/dovecot/managesieve-login > inet_listener sieve { > port = 4190 > } > process_limit = 1024 > process_min_avail = 20 > service_count = 1 > } > service managesieve { > process_limit = 1024 > } > service pop3-login { > client_limit = 1024 > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > process_limit = 100 > process_min_avail = 2 > service_count = 50 > } > service pop3 { > process_limit = 1024 > } > service replicator { > process_min_avail = 1 > unix_listener replicator-doveadm { > group = vmail > mode = 0660 > } > } > ssl = required > ssl_ca = </etc/ssl/certs/TUB-CA.pem > ssl_cert = </etc/ssl/certs/mail.inet.tu-berlin.de.crt > ssl_cipher_list = > EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+S > HA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+aRSA+RC4:EECDH:EDH+aR > SA:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!SRP:!DSS:!RC4 > ssl_client_ca_dir = /etc/ssl/certs > ssl_key = </etc/ssl/private/mail.inet.tu-berlin.de.pem > ssl_prefer_server_ciphers = yes > ssl_protocols = !SSLv2 !SSLv3 > userdb { > driver = passwd > override_fields = home=/mail/home/%u uid=vmail gid=vmail > allow_all_users=yes > } > protocol lda { > auth_socket_path = /var/run/dovecot/auth-master > mail_plugins = " notify replication sieve" > } > protocol sieve { > managesieve_logout_format = bytes=%i/%o > managesieve_max_line_length = 65536 > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope encoded- > character vacation subaddress comparator-i;ascii-num eric relational > regex imap4flags copy include variables body enotify environment > mailbox date ihave > } Has anyone any suggestions what went wrong? Is this a dovecot configuration issue or is something broken? Regards, Tom -- Group "Intelligent Networks" (INET) Technische Universität Berlin Marchstr. 23 MAR4-4 D-10587 Berlin TEL: +49-30-314-78537

1 0

Re: Compile error Dovecot2-pigeonhole
by Мунголин Максим 07 Jul '16

07 Jul '16

1) I was trying to compile from ports: make (without any flags) Got an error: cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier" *** [edit-mail.lo] Error code 1 *** [program-client-local.lo] Error code 1 *** [program-client-remote.lo] Error code 1 *** [rfc2822.lo] Error code 1 4 errors *** [all-recursive] Error code 1 1 error *** [all-recursive] Error code 1 1 error *** [all-recursive] Error code 1 1 error *** [all] Error code 2 1 error ===> Compilation failed unexpectedly. Try to set MAKE_JOBS_UNSAFE=yes and rebuild before reporting the failure to the maintainer. *** [do-build] Error code 1 Stop in /usr/ports/mail/dovecot2-pigeonhole. *** [stage] Error code 1 2) When, I was trying to add flag -k (force). Same error. 3) When, I was trying to add flag MAKE_JOBS_UNSAFE. Same error.

1 0

Re: Compile error Dovecot2-pigeonhole
by Aki Tuomi 07 Jul '16

07 Jul '16

Please keep replies on-list. If you removed the compiler flag, how can you get error about compiler flag? Perhaps you need to contact package maintainer? Aki On 07.07.2016 10:23, Maximus wrote: > Sure. > Same error. > > -----Original Message----- > From: dovecot [mailto:dovecot-bounces@dovecot.org] On Behalf Of Aki Tuomi > Sent: Thursday, July 07, 2016 9:24 AM > To: dovecot(a)dovecot.org > Subject: Re: Compile error Dovecot2-pigeonhole > > > > On 07.07.2016 08:35, Maximus wrote: >> FreeBSD 9.3 >> >> Dovecot 2.25 (7be1766) >> >> >> >> >> >> I'm trying to install Dovecot2-pigeonhole-0.4.14_2 from ports. >> >> Get an error: >> >> cc1: error: unrecognized command line option > "-Wno-duplicate-decl-specifier" >> >> >> With options MAKE_JOBS_UNSAFE=yes: >> >> > Hi! > > Try removing that superfluous compiler flag? > > Aki

1 0

Configure Dovecot for GSSAPI [formerly: Looking for GSSAPI config]
by Mark Foley 06 Jul '16

06 Jul '16

After a over a year and a half struggling to get Dovecot to do either NTLM or GSSAPI authentication with Samba4 AD/DC, I believe I've finally got it! Thanks to all those in this list who helped: Jan Jurkus, Edgar Pettijohn, Gregory Sloop, Tom Talpey especially Aki Tuomi; and infinite thanks to Achim Gottinger on the SambaList for his patience in working this through with me. Although my purpose was for Dovecot to authenticate mail clients, the configuration settings needed were on the Samba side. I hope a variation of these instructions can eventually make it into: http://wiki2.dovecot.org/Authentication/Kerberos What is essentially missing from the wiki is how to set up the proper Service Principal Names and the subsequent creation of a dovecot useable kerberos keytab file. The wiki comment on "k5principals passdb" was not helpful and largely unintelligble to me. Perhaps like many of you, I have switched from Microsoft SBS and Exchange to Samaba4 and Dovecot/IMAP. The transition was completely transparent to my users, except they needed a separate password for email authentication in the absence of NTLM or GSSAPI working with Dovecot. A mild inconvenience, but I have been on a "quest" to fill that gap. This solution finally takes care of that last piece. The following describes how to create the SPNs and krb5 keytab files using Samba4 which has its own built-in (Heimdal) kerberos. The procedures are probably similar for other facilities such as setspn for Windows, but I've not used those so I won't attempt to discuss those mechanism here. You do need kerberos as the Samba built-in kerberos does not have needed commands like `klist`. My distro (Slackware 14.1) does not come with kerberos (nor, I think, does Ubuntu), but is easily found at: https://slackbuilds.org/repository/14.1/network/krb5/ Ubuntu/Debian: apt-get install krb5-config libpam-krb5 krb5-user ssh-krb5 (perhaps more) After provisioning Samba4, copy the krb5.conf template to /etc/krb5.conf. (Note: the actual docs advise symlinking: ln -sf /usr/local/samba/private/krb5.conf /etc/krb5.conf but I prefer making a copy in case I need to modify things). I've set The /etc/krb5.conf file to world readable. It's default contents are (and these do not need to be changed): [libdefaults] default_realm = HPRS.LOCAL dns_lookup_realm = false dns_lookup_kdc = true where HPRS.LOCAL is my realm, of course use your own. Now, we need a samba user in order to create the necessary SPNs (Server Principal Names): $ samba-tool user create dovecot New Password: Retype Password: User 'dovecot' created successfully Next, add the SPN(s), and create the keytab: $ samba-tool spn add imap/mail.hprs.local dovecot $ samba-tool domain exportkeytab --principal imap/mail.hprs.local /etc/dovecot/dovecot.keytab Dovecot does not do my (outgoing) SMTP serving, only (incoming) IMAP, but if it did I'd have to create another SPN for smtp: $ samba-tool spn add smtp/mail.hprs.local dovecot $ samba-tool domain exportkeytab --principal smtp/mail.hprs.local /etc/dovecot/dovecot.keytab Dovecot needs to be able to read the keytab file: $ chgrp dovecot /etc/dovecot/dovecot.keytab $ chmod g+r /etc/dovecot/dovecot.keytab my new keytab: $ klist -Kek /etc/dovecot/dovecot.keytab Keytab name: FILE:/etc/dovecot/dovecot.keytab KVNO Principal ---- -------------------------------------------------------------------------- 1 imap/mail.hprs.local(a)HPRS.LOCAL (des-cbc-crc) (0x232616c2a4fd08f7) 1 imap/mail.hprs.local(a)HPRS.LOCAL (des-cbc-md5) (0x232616c2a4fd08f7) 1 imap/mail.hprs.local(a)HPRS.LOCAL (arcfour-hmac) (0x9dae89a221dc374a39f560833352f60f) (and if I also created the spn for smtp I would also have these:) 1 smtp/mail.hprs.local(a)HPRS.LOCAL (des-cbc-crc) (0x232616c2a4fd08f7) 1 smtp/mail.hprs.local(a)HPRS.LOCAL (des-cbc-md5) (0x232616c2a4fd08f7) 1 smtp/mail.hprs.local(a)HPRS.LOCAL (arcfour-hmac) (0x9dae89a221dc374a39f560833352f60f) DOVECOT SETTINGS: My version: 2.2.15 Of crucial importance is to build dovecot with GSSAPI! That is NOT one of the default settings. In the dovecot build directory: ./configure --with-gssapi=yes Other than that serious build gotcha, settings are pretty simple. Add the following 3 settings to 10-auth.conf: auth_gssapi_hostname = "$ALL" auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_mechanisms = plain login gssapi The auth_gssapi_hostname is supposedly not required according to some of the above-listed commentors, but my 10-auth.conf template implies differently, so it can't hurt. gssapi does not require a passdb. Use whatever userdb you want. The dovecot wiki doc has some suggestions, not of which I've tried. I use the 'driver = passwd' for my userdb for unrelated reasons. I couldn't get any of this working until I rebooted the Samba AD/DC-Dovecot server, but that just may have been me not stopping/starting Samba and Dovecot in the right sequence (or, everything happened to start working with a concurrent upgrade to Samba 4.2!). In my WIN7 and Ubuntu Thunderbird clients I selected gssapi/kerberos for the IMAP authenticate method and it works! I've even changed the test user's AD password, just to make sure. Someone please put at least the required info on creating the SPNs and krb keytab file for other poor schmucks like me. Now, if I can get NTLM figured out for the remaining Outlook users ... ! --Mark

4 9

Compile error v2.2.25 MacOS X
by James Brown 06 Jul '16

06 Jul '16

Tried to update from 2.2.24 to 2.2.25 using same configure command as previously. make ends with: In file included from guid.c:6: sha1.h:80: error: static or type qualifiers in abstract declarator make[4]: *** [guid.lo] Error 1 make[3]: *** [all] Error 2 make[2]: *** [all-recursive] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 Mac OS X 10.7.5 Configure statement was: ./configure --with-mysql --with-ssl=openssl Any suggestions? Thanks, James.

3 3

Dovecot2-pigeonhole
by Maximus 06 Jul '16

06 Jul '16

Got an error then I'm trying to upgrade to version 0.4.14: cc1: error: unrecognized command line option "-Wno-duplicate-decl-specifier"

1 0

Postfix/dovecot: user unrecognized, file permissions being misread
by C. Andrews Lavarre 06 Jul '16

06 Jul '16

Hello all. Have spent several days following the excellent tutorial: http://www.binarytides.com/install-postfix-dovecot-debian/ but still fail to have the user recognized and am getting log entries that the mail directories are 0755 when I can clearly see that they are 0774. Very puzzling, any help would be deeply appreciated. Best regards, Andy =========== Details =========== • I can add directories under IMAP, so my IMAP login and permissions must be correct. • I can create an outgoing message under IMAP, but clicking SEND just hangs. Logs do not indicate problem. • I clearly can send it a message with smtp. The message is delivered to postfix, but then dovecot fails to deliver it to a mailbox. ------------------------------------ Log Entries --------------------- --------------- # tail /var/log/mail postfix/qmgr[16390]: 9D6E8C1A77: from=<alavarre(a)gmail.com>, size=2794, nrcpt=1 (queue active) Message has been received postfix/lmtp[16770]: C218DC197D: to=<alavarre(a)privustech.com>, relay=mail.privustech.com[private/lmtp], delay=2560, delays=2260/0.01/300/0, dsn=4.4.2, status=deferred (conversation with mail.privustech.com[private/lmtp] timed out while receiving the initial server greeting) lmtp is not working ------------------------------------ # tail /var/log/dovecot.log auth-worker(16612): Info: pam(alavarre(a)privustech.com,98.179.190.111): unknown user imap-login: Info: Login: user=<alavarre(a)privustech.com>, method=PLAIN, rip=98.179.190.111, lip=70.186.159.22, mpid=16615, TLS, session=<ad;slfj;asfa;> imap(alavarre(a)privustech.com): Error: mkdir(/var/mail/vhosts/privustech.com/alavarre/cur) failed: Permission denied (euid=5000(vmail) egid=5000(vmail) missing +w perm: /var/mail/vhosts/privustech.com/alavarre, dir owned by 0:0 mode=0755) However, the mail directory /var/mail/vhosts/privustech.com/alavarre is -rwxrwxr-- vmail:vmail and I have restarted both postfix and dovecot. ========================= System is openSUSE Leap 42.1 (64). postfix and dovecot with SASL authentication, connecting through a Unix socket: /etc/postfix/main.cf: virtual_transport = lmtp:unix:private/lmtp /etc/dovecot/conf.d/10-master.cf: service lmtp { unix_listener /var/spool/postfix/private/lmtp { mode = 0600 user = postfix group = postfix } The lmtp socket is owned by postfix, while the mail system is owned by vmail, per the tutorial. ------------------------------ I am using virtual users (not system users) defined in /etc/dovecot/dovecot-users: alavarre@privustech.com:{plain}ksaj;flkasjd;ds;f Thanks in advance, Andy

2 6

Dovecot delete and expunge loop
by Il Neofita 05 Jul '16

05 Jul '16

Hi I am using dovecot 2.0.9 with redhat 6.8 One client with Outlook 2013 is deleting and expunging and email over and over changing the uid. I am not able to understand how to solve it.

2 1

kqueue crash on FreeBSD with 2.2.25
by Adam Weinberger 05 Jul '16

05 Jul '16

Hi, 2.2.25 crashes on FreeBSD with a kqueue-related message. I see references to something similar (http://www.dovecot.org/list/dovecot/2012-February.txt) from a couple years ago. I get: Jul 1 10:07:27 imap dovecot: master: Panic: kevent(EV_ADD, READ, 54) failed: Bad file descriptor It's not dumping core, and I get the message even with "protocols =" Downgrading back to 2.2.24 fixes it. What info would be helpful for me to provide here? # Adam -- Adam Weinberger adamw(a)adamw.org http://www.adamw.org

5 11

duplicate Mails with dsync replication
by Dennis Kuhn 05 Jul '16

05 Jul '16

Hi! We have some strange replication issues. Some mails are duplicated when expunged. This bug is quite hard to reproduce, it just happens occasionally. It seems somehow related to sieve. When i deleted the sieve script i could not reproduce this behavior. Here are some logs, mjm-100010(a)mydomain.com is an alias for mjm(a)mydomain.com: # Master Jun 23 00:51:41 dobby4 dovecot: lmtp(mjm-100010(a)mydomain.com): copy from <lmtp DATA>: box=INBOX, uid=7816, msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>, size=8933 Jun 23 00:51:41 dobby4 dovecot: lmtp(mjm-100010(a)mydomain.com): 4N23HaMVa1fpmQEAJEBNLA: sieve: msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>: stored mail into mailbox 'INBOX' Jun 23 04:52:57 dobby4 dovecot: pop3(mjm(a)mydomain.com): expunge: box=INBOX, uid=7816, msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>, size=8933 Jun 23 04:52:57 dobby4 dovecot: dsync-local(mjm(a)mydomain.com): save: box=INBOX, uid=7817, msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>, size=8933 Jun 23 04:55:21 dobby4 dovecot: pop3(mjm(a)mydomain.com): expunge: box=INBOX, uid=7817, msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>, size=8933 # Replica Jun 23 00:51:42 dobby5 dovecot: dsync-server(mjm-100010(a)mydomain.com): save: box=INBOX, uid=7816, msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>, size=8933 Jun 23 04:52:57 dobby5 dovecot: dsync-server(mjm(a)mydomain.com): copy from INBOX: box=INBOX, uid=7817, msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>, size=8933 Jun 23 04:52:57 dobby5 dovecot: dsync-server(mjm(a)mydomain.com): expunge: box=INBOX, uid=7816, msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>, size=8933 Jun 23 04:55:22 dobby5 dovecot: dsync-server(mjm(a)mydomain.com): expunge: box=INBOX, uid=7817, msgid=<20160623005132EE517444BB$3A04DF25DD@ABRAHAM>, size=8933 The problem is the "dsync-server(mjm(a)mydomain.com): copy from INBOX: box=INBOX, uid=7817" on dobby5 at 04:52:57. This creates a new uid 7817 and the new mail is replicated back to dobby4. But i have no idea what triggers this copy. Any ideas? The dovecot version is 2.2.24. Thanks Dennis

1 0