July 2015 - dovecot - dovecot.org

Questions about hardlinks, alternate storage and compression
by Gionatan Danti 06 Jul '15

06 Jul '15

Hi all, I have some questions about hardlinks, alternate storage and compression. I already scanned the list for related information and I have an idea of how things works, but I would like to have a definite answer. System spec: - CentOS 6.6 x64 - dovecot-2.0.9-8.el6_6.4.x86_64 RPM package/version - sdbox mail store 1) About hardlinks: when sending the same message to two different recipients, I see that the two u.x files are created as two different files. Diffing them, I see that the only difference is a single char (see [1] for an example). My questions are: a) it is possible to tell dovecot to create a single file + a single hardlink (linkref=2)? As other IMAP servers support that features (eg: Cyrus, CommunigatePro, etc) I am wondering if I missed something in configuring dovecot... b) If it is not possible, can I run a script that compare the various files and substitute equal ones (minus the changing line) with hardlinks, or it will confuse dovecot? As a side note, why the changing line ever exists? 2) About alternate storage and compression: actually, I use a single mail_location without compression. I would like to have an alternate storage and to enable compression on it only, leaving the main location without compression. I if understand it correctly, it _should_ be done using a command similar to "doveadm -Dv -o "plugin/zlib_save=gz" altmove -uu testuser sentbefore 8d". I'm right thinking that it should work? I will really end with a primary uncompressed mail store and an alternate, zlib-compressed one? Thank you all and sorry if I did some naive questions. [1] 63c63 < G2fd0811c64be8e553d970000eaa8309f --- > G2ed0811c64be8e553d970000eaa8309f -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti(a)assyoma.it - info(a)assyoma.it GPG public key ID: FF5F32A8

1 2

Dovecot LMTP tries to access a directory of a different user, than the one it actually changed to.
by Ernest Deak 06 Jul '15

06 Jul '15

Hello, I encountered a problem when trying to send an email to multiple recipients. === LOG === ... cut ... Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: none: root=, index=, control=, inbox= Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Connect from local Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: Loading modules from directory: /usr/lib64/dovecot Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: auth input: han.solo system_groups_user=han.solo uid=805 gid=800 home=/home/han.solo Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: auth input: tester system_groups_user=tester uid=802 gid=800 home=/home/tester Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Debug: auth input: vader system_groups_user=vader uid=804 gid=800 home=/home/vader Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: Effective uid=805, gid=800, home=/home/han.solo Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: fs: root=/home/han.solo/mail, index=, control=, inbox=/var/mail/han.solo Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user's script path /home/han.solo/.dovecot.sieve doesn't exist (using global script path in stead) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user has no valid personal script Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: no scripts to execute: reverting to default delivery. Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, han.solo): 70NxN1FlllUqXgAA0vrzwA: msgid=<55966551.IfKOMu/T0WTB9M5x%vader at dhcp90.#####>: saved mail to INBOX Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: Effective uid=802, gid=800, home=/home/tester Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: fs: root=/home/tester/mail, index=, control=, inbox=/var/mail/tester Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user's script path /home/tester/.dovecot.sieve doesn't exist (using global script path in stead) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user has no valid personal script Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: no scripts to execute: reverting to default delivery. Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Error: stat(/home/han.solo/mail/.imap/INBOX/dovecot.index.log) failed: Permission denied (euid=802(tester) egid=800(kerber) missing +x perm: /home/han.solo, euid is not dir owner) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): Error: open(/home/han.solo/mail/.imap/INBOX/dovecot.index) failed: Permission denied (euid=802(tester) egid=800(kerber) missing +x perm: /home/han.solo, euid is not dir owner) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, tester): 70NxN1FlllUqXgAA0vrzwA: msgid=<55966551.IfKOMu/T0WTB9M5x%vader at dhcp90.#####>: save failed to INBOX: BUG: Unknown internal error Jul 3 12:34:57 dhcp90 sendmail[24121]: t63AYvn5024116: to=<tester at dhcp90.#####>, ctladdr=<vader at dhcp90.#####> (804/800), delay=00:00:00, xdelay=00:00:00, mailer=local, pri=91062, relay=localhost, dsn=4.2.0, stat=Deferred: 451 4.2.0 <tester> BUG: Unknown internal error Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: Effective uid=804, gid=800, home=/home/vader Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: fs: root=/home/vader/mail, index=, control=, inbox=/var/mail/vader Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user's script path /home/vader/.dovecot.sieve doesn't exist (using global script path in stead) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: user has no valid personal script Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Debug: 70NxN1FlllUqXgAA0vrzwA: sieve: no scripts to execute: reverting to default delivery. Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Error: stat(/home/han.solo/mail/.imap/INBOX/dovecot.index.log) failed: Permission denied (euid=804(vader) egid=800(kerber) missing +x perm: /home/han.solo, euid is not dir owner) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): Error: open(/home/han.solo/mail/.imap/INBOX/dovecot.index) failed: Permission denied (euid=804(vader) egid=800(kerber) missing +x perm: /home/han.solo, euid is not dir owner) Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106, vader): 70NxN1FlllUqXgAA0vrzwA: msgid=<55966551.IfKOMu/T0WTB9M5x%vader at dhcp90.#####>: save failed to INBOX: BUG: Unknown internal error Jul 3 12:34:57 dhcp90 sendmail[24121]: t63AYvn5024116: to=<vader at dhcp90.#####>, ctladdr=<vader at dhcp90.#####> (804/800), delay=00:00:00, xdelay=00:00:00, mailer=local, pri=91062, relay=localhost, dsn=4.2.0, stat=Deferred: 451 4.2.0 <vader> BUG: Unknown internal error Jul 3 12:34:57 dhcp90 sendmail[24121]: t63AYvn5024116: to=<han.solo at dhcp90.#####>, ctladdr=<vader at dhcp90.#####> (804/800), delay=00:00:00, xdelay=00:00:00, mailer=local, pri=91062, relay=localhost, dsn=2.0.0, stat=Sent Jul 3 12:34:57 dhcp90 dovecot: lmtp(24106): Disconnect from local: Client quit =========== The setup is as follows: All users have /bin/false instead of a shell. Each user has a unique UID but they all have 1 GID (800) My MTA is sendmail I am using dovecot-lmtp for local delivery Mailbox format is mbox Configured managesieve plugin to listen on 4190. (not sure if this is even related but it might) The problem I see is that lmtp(user1) tries to access the home directory /home/user2 and I cannot figure out the reason why. This only happens when sending mails to multiple recipients. I see the that lmtp complains that it doesn't have execute permissions. But I don't want to place execute permissions for others on the entire /home/* dir structure. Also, 700 are the default creation permissions. So new users would have to be chmod'ed manually. (unless there is a setting in dovecot) I used "mailx" to send a test email to multiple recipients `echo "test message" | mailx -s "subject" -r vader at dhcp90.##### han.solo at dhcp90.##### vader at dhcp90.##### tester at dhcp90.#####` The only one who actually receives the message is han.solo at dhcp90.##### and The same happens with aliases in /etc/aliases. `echo "group test" | mailx -s "subject" -r vader at dhcp90.##### grouplist at dhcp90.#####` "grouplist" is defined in /etc/aliases and contains the same users as in the log Any help with this is greatly appreciated. Here is my dovecot configuration: === `dovecot -n` === # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-504.12.2.el6.x86_64 x86_64 CentOS release 6.6 (Final) auth_debug = yes auth_mechanisms = plain login disable_plaintext_auth = no lda_mailbox_autocreate = yes mail_debug = yes mail_full_filesystem_access = yes mail_gid = mail mail_location = mbox:~/mail:INBOX=/var/mail/%u managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service lmtp { client_limit = 1 executable = /usr/libexec/dovecot/lmtp -L inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } process_min_avail = 1 } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve" postmaster_address = postmaster } =============== `rpm -qa | grep dovecot` dovecot-pigeonhole-2.0.9-8.el6_6.4.x86_64 dovecot-2.0.9-8.el6_6.4.x86_64 Thanks in advance.

3 3

FW: Help needed to use dovecot from scratch
by Sachin Kulkarni1 06 Jul '15

06 Jul '15

Hello All, Can anybody help in this please? Thanks and Regards, Sachin Kulkarni -----Original Message----- From: Sachin Kulkarni1 Sent: Tuesday, June 30, 2015 6:13 PM To: dovecot(a)dovecot.org Cc: 'dovecot-owner(a)dovecot.org'; 'dovecot-request(a)dovecot.org' Subject: Help needed to use dovecot from scratch Hello, I need to use Dovecot. So need to install it from scratch on Solaris 10. Please help. Thanks and Regards, Sachin Kulkarni ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html externally http://tim.techmahindra.com/tim/disclaimer.html internally within TechMahindra. ============================================================================================================================

2 1

Google like searches from Roundcube
by Kevin Laurie 05 Jul '15

05 Jul '15

hi, trying to get fast searches on roundcube. would like if it could work like gmail (using multiple keywords to perform search) if not wrong, i think this is called fuzzy search(i do have dovecot_fts running)? please advise if anyone has managed to get this? thanks kevin

2 1

outlook downloading duplicate emails on particular days
by Rajesh M 04 Jul '15

04 Jul '15

hi centos 6 with qmail toaster and dovecot 2.2.7 for pop3 and imap i have a strange issue which happens on all 4 of my servers for POP3 users -- on any random day ie once in a while users spread across multiple domains will face a problem of outlook re-downloading ALL the emails in the inbox -- not just a few duplicate emails but the entire inbox. This happens for multiple email users spread across multiple domains sitting in different locations. i am searching for a solution for the last several months but nothing yet require help please my dovecot config file # Settings for 'stock' qmail-toaster disable_plaintext_auth = no default_login_user = vpopmail mail_max_userip_connections = 50 service imap-login { service_count = 0 client_limit = 256 process_min_avail = 4 vsz_limit = 384M process_limit = 400 } service pop3-login { service_count = 0 client_limit = 1000 process_min_avail = 12 vsz_limit = 512M process_limit = 400 } auth_cache_size = 0 auth_cache_ttl = 0 auth_cache_negative_ttl = 0 auth_mechanisms = plain login digest-md5 cram-md5 auth_username_format = %Lu first_valid_uid = 89 first_valid_gid = 89 log_path = /var/log/dovecot.log login_greeting = ready. mail_plugins = $mail_plugins quota plugin/quota = maildir protocols = imap pop3 ssl_cert = </var/qmail/control/servercert.pem ssl_key = </var/qmail/control/servercert.pem # the following will likely be the default at some point ssl_dh_parameters_length = 2048 namespace { inbox = yes location = prefix = # prefix = INBOX. # Use 'prefix = INBOX.' for Courier-IMAP compatible transparent migration. # This forces all client apps to create subfolders underneath/within # the inbox instead of adjacent to it. It's not necessary to be that way. # FWIW, shubes thinks this setting is annoying/rediculous/retarded. # As a practical example, having no prefix allows mobile users to select # which folders get synchronized. Otherwise their whole mailbox is # synchronized, and they have no way to choose which folders they want sync'd. separator = . type = private } passdb { args = cache_key=%u webmail=127.0.0.1 driver = vpopmail } protocol imap { imap_client_workarounds = "delay-newmail" mail_plugins = $mail_plugins imap_quota } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_fast_size_lookups = yes pop3_lock_session = no # pop3_uidl_format = UID%u-%v pop3_no_flag_updates=yes } userdb { args = cache_key=%u quota_template=quota_rule=*:backend=%q driver = vpopmail } plugin { quota = maildir:ignore=Trash quota_rule = ?:storage=0 } thanks raj

1 0

Re: dovecot auth using 100% CPU
by Edward Betts 03 Jul '15

03 Jul '15

Jorge Bastos <mysql.jorge(a)decimal.pt> wrote: > What do you see in the logs? > My guess is that someone is trying a brute force auth against you, Thanks Jorge, I think this is the answer. I'm using dovecot for exim4 SMTP authentication. The exim4 logs show brute force attacks. -- Edward.

3 4

autocreating folders with special chars stored in mysql-userdb
by Hajo Locke 03 Jul '15

03 Jul '15

Hello, i use dovecot 2.2.18 and do some tests with an utf8 mysqlbackend. I use MySQL to authenticate Users and for retrieving some individual settings like autocreating folders etc. by userdb-settings in user-query. Yet no problems with standard language. Now i try to provide userdb-settings in exotic languages. My MySQL table uses utf8 charset. I store some data in my userdb-column. Here an polish example: "namespace/inbox/mailbox=example namespace/inbox/mailbox/example/name=postępować namespace/inbox/mailbox/example/auto=subscribe" Result is a new folder in dovecot, but in client every special char ę and ć is replaced with a "?" I seems that at some point a conversion to latin1 is performed which ruins the utf8 chars. Creating a folder postępować by imap-client is no problem. Hmm, what should i do now? I dont know how to influence dovecot to process retrieved utf8 data furthermore as utf8. Which charset is using dovecot when connecting to mysqldb and how to take influence? Thanks, Hajo

1 1

the file dovecot-uidlist.lock appear then deadlock
by 刘莹莹 03 Jul '15

03 Jul '15

hi: sometimes i can't use imap command to get mails, when this problem appear i find out the file dovecot-uidlist.lock appear at the same time . I don't know Why is this happening ? can you help me ? thanks !

2 2

Dovecot auth username mapping
by Laz C. Peterson 02 Jul '15

02 Jul '15

I have an interesting case here … Virtual mailboxes, domain/username/aliases stored in MySQL, authentication done using PAM. PAM authenticates through Kerberos, which are internal realms and not the email domains — for example, my username would be laz(a)PARAVIS.LOCAL <mailto:laz@PARAVIS.LOCAL> and my email address would be laz(a)paravis.net <mailto:laz@paravis.net>. All of this works just fine. But what I want to do is allow the users to log in using their email address and not their full Kerberos name. It is becoming laborious to help the users understand the difference between their username(a)LOCAL.REALM and username(a)email.address <mailto:username@email.address> and why we have to have two separate identities that mean the same thing. I have the SQL statements to convert either the Kerberos login or the email address to the actual Kerberos login (so they may use either). But I cannot seem to figure out how to get Dovecot to acknowledge this as the mapped username. I’m sure there has to be a way. Any help will be greatly appreciated. Thank you! ~ Laz Peterson Paravis, LLC

4 7

Outlook 2013 not fetching new mail/synchronization issues
by Dragos Pacher 02 Jul '15

02 Jul '15

Hi all, Dovecot 2.2.10 CentOS 6 64 bit. We are having terrible synchronization issues with Outlook 2013 (all updates) on Windows 7 SP1 and 8.1 hosts (all updates). Scenario: 1. Emails were sent since user closed Outlook 2. Next day: start computer, open outlook 3. No new email (even though email were sent overnight) 4. half a day later Outlook fetches emails like nothing happened Second issue: folders created or email send in Outlook 2013 does not synchronize on IMAP, they remain only local .. But I am mostly interested into finding a fix for the first synchronization issue described in scenario. Second is also important but I have a feeling its connected to the first. Any help will be highly appreciated! dovecot.conf listen = * #base_dir = /var/run/dovecot # Enabled mail protocols. #protocols = pop3 imap sieve protocols = pop3 imap # User/group who owns the message files: mail_uid = 89 mail_gid = 89 # Assign uid to virtual users. first_valid_uid = 89 last_valid_uid = 89 mail_max_userip_connections = 200 default_client_limit = 3000 namespace inbox { separator = . prefix = INBOX. inbox = yes # These mailboxes are widely used and could perhaps be created automatically: mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Trash { special_use = \Trash } # For \Sent mailboxes there are two widely used names. We'll mark both of # them as \Sent. User typically deletes one of them if duplicates are created. mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } } # Logging. Reference: http://wiki2.dovecot.org/Logging log_path = /var/log/dovecot.log mail_debug = no auth_verbose = no auth_debug = no auth_debug_passwords = no auth_verbose_passwords = no auth_worker_max_count = 2048 # SSL: Global settings. # Refer to wiki site for per protocol, ip, server name SSL settings: # http://wiki2.dovecot.org/SSL/DovecotConfiguration ssl = yes verbose_ssl = no ssl_ca = </etc/ssl/savvy.cz-CA.pem ssl_cert = </etc/ssl/savvy.cz.crt ssl_key = </etc/ssl/savvy.cz.key disable_plaintext_auth = no # Mail location and mailbox format. #mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_location = maildir:~/Maildir:INDEX=/home/dovecotindex/%Lh/Maildir/ # Authentication related settings. # Append this domain name if client gives empty realm. auth_default_realm = # Authentication mechanisms. auth_mechanisms = PLAIN LOGIN service imap-login { client_limit = 3024 process_limit = 2048 process_min_avail = 64 vsz_limit = 64 M } service auth { client_limit = 3072 unix_listener auth-userdb { } inet_listener { port = 12345 } } service imap { vsz_limit = 256M # Max. number of IMAP processes (connections) process_limit = 2048 #imap_idle_notify_interval = 2 mins } service pop3 { # Max. number of POP3 processes (connections) process_limit = 1024 } # Virtual mail accounts. userdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } passdb { args = /etc/dovecot/dovecot-mysql.conf driver = sql } plugin { auth_socket_path = /var/run/dovecot/auth-master # Plugin: autocreate. Create and subscribe to default IMAP folders. autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk # Plugin: expire. expire = Trash 7 Trash/* 7 Junk 30 expire_dict = proxy::expire # Pigeonhole managesieve service. # Reference: http://wiki2.dovecot.org/Pigeonhole/Sieve/Configuration # Per-user sieve settings. sieve_dir = /%Lh/sieve sieve = /%Lh/sieve/dovecot.sieve # Global sieve settings. sieve_global_dir = /home/vpopmail/sieve sieve_global_path = /home/vpopmail/sieve/dovecot.sieve #sieve_before = #sieve_after = } service dict { unix_listener dict { # mode = 0660 # user = vmail # group = vmail } } protocol lda { # Reference: http://wiki2.dovecot.org/LDA #mail_plugins = quota sieve autocreate #auth_socket_path = /var/run/dovecot/auth-master #log_path = /var/log/sieve.log #lda_mailbox_autocreate = yes #postmaster_address = root } protocol imap { mail_max_userip_connections = 2048 imap_client_workarounds = tb-extra-mailbox-sep #mail_plugins = quota imap_quota autocreate #mail_plugins = autocreate } protocol pop3 { #mail_plugins = quota pop3_uidl_format = UID%u-%v pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } Regards, Pacher Dragos

3 12