December 2010 - dovecot

[Dovecot] SSL issues on separate IPs
by Tim Traver 03 Dec '10

03 Dec '10

Hi Timo, I have set up 2.07 to answer on several different IP's with different SSL certs, like the following : local 209.132.xx.4 { ssl_cert = </shared/templates/res/1040/certs/*.xxxxx.com.crt-pem-298 ssl_key = </shared/templates/res/1040/certs/*.xxxxx.com.key-298 } I have several of these, and there appears to be a problem with one in particular that is dropping connections, and I'm not sure why. In this case it is a wildcard cert issued from godaddy, and I have the cert file in pem … [View More]format with the chain on it. I have another completely separate local IP setup with a different cert on it that works without any problems. This particular one drops the connection when I try to connect to IMAP using TLS on port 143, or using the IMAP SSL port of 993. When I try it using Thunderbird, I am using the default settings for both tests. The Thunderbird error I get is "The server has disconnected. The server may have gone down or there may be a network problem." I don't see any errors in the dovecot error log or the system error log, and when using doveadm who to view the current connections, it does not show a connection. I tried enabling the logs for SSL errors, but nothing appears for my IP when attempting to connect. FreeBSD 8.1 with openssl 0.9.8n. The IP's are on the box and are on the loopback interface if that makes any difference for a direct server return load balancing system. But, I don't know how that would make a difference since one of the separated IP's works with its cert, and the other one disconnects. Thanks, Tim. Here is my dovecot -n output : # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.1-STABLE i386 auth_username_format = %Lu auth_username_translation = %@ auth_verbose = yes disable_plaintext_auth = no dotlock_use_excl = yes first_valid_uid = 100 listen = * lock_method = dotlock log_path = /local/logs/dovecot.errors mail_fsync = always mail_gid = 100 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota" mail_uid = 100 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify mmap_disable = yes passdb { args = /bin/checkpassword_dovecot_auth driver = checkpassword } plugin { quota = maildir:User quota quota_rule = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_after = /home/mailboxes/sieve/to_spam_folder.sieve sieve_dir = ~/Maildir/sieve sieve_extensions = +notify +imapflags } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = sn mode = 0600 user = sn } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = prefetch } userdb { args = /bin/checkpassword_dovecot_deliver driver = checkpassword } verbose_proctitle = yes verbose_ssl = yes protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { info_log_path = /local/logs/dovecot-deliver.log log_path = /local/logs/dovecot-deliver-errors.log mail_plugins = " quota sieve" } protocol imap { mail_plugins = " quota imap_quota" } protocol sieve { managesieve_sieve_capability = comparator-i;ascii-numeric fileinto reject vacation imap4flags notify include envelope body relational regex subaddress copy } local 209.132.77.4 { ssl_cert = </shared/templates/res/1040/certs/*.xxxxx.com.crt-pem-298 ssl_key = </shared/templates/res/1040/certs/*.xxxxx.com.key-298 } local 209.132.79.1 { ssl_cert = </shared/templates/res/1000/certs/*.ssl.xxxxx.com.crt-278 ssl_key = </shared/templates/res/1000/certs/*.ssl.xxxxx.com.key-278 } [View Less]

3 7

[Dovecot] Static userdb with LDAP passdb but without "allow_all_users=yes"?
by Andreas Ntaflos 03 Dec '10

03 Dec '10

Hi, Is it possible to have a static user database along with an LDAP password database and *not* be forced to set "allow_all_users=yes" for the userdb? The wiki page on static user database says "Normally static userdb handles this by doing a passdb lookup instead." How should the passdb behave in order for this to work? In my tests (on a test server) I am using Dovecot 2.0.7 and Postfix 2.7.0 on Ubuntu 10.04.1. I use (or am trying to use) LMTP with Dovecot and Postfix according to … [View More]the HOWTO in the wiki [1] as well as dynamic address verification with LMTP [2]. Users are virtual, using a static userdb and passwords from LDAP. I also serve local system users which is why I also have userdb and passdb pam, but this isn't the issue here. Delivering mail to an existing virtual user works fine as far as I can see but when a non-existent user is the recipient Dovecot complains that the passdb doesn't support lookups: postfix/smtpd[26469]: connect from remote-smtp.example.net[10.0.0.10] postfix/cleanup[26474]: 772A760B25: message- id=<20101125172409.772A760B25(a)mailtest.example.com> postfix/qmgr[27672]: 772A760B25: from=<double- bounce(a)mailtest.example.com>, size=276, nrcpt=1 (queue active) dovecot: lmtp(22109): Connect from local dovecot: auth: Error: static(not-a-user(a)test01.example.com): passdb doesn't support lookups, can't verify user's existence dovecot: lmtp(22109): Error: user not-a-user(a)test01.example.com: Auth USER lookup failed dovecot: lmtp(22109): Disconnect from local: Client quit postfix/lmtp[26475]: 772A760B25: to=<not-a-user(a)test01.example.com>, relay=mailtest.example.com[private/dovecot-lmtp], delay=0.18, delays=0.17/0.01/0/0, dsn=4.3.0, status=undeliverable (host mailtest.example.com[private/dovecot-lmtp] said: 451 4.3.0 <not-a- user(a)test01.example.com> Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command)) postfix/qmgr[27672]: 772A760B25: removed postfix/smtpd[26469]: NOQUEUE: reject: RCPT from remote- smtp.example.net[10.0.0.10]: 450 4.1.1 <not-a-user(a)test01.example.com>: Recipient address rejected: unverified address: ho st mailtest.example.com[private/dovecot-lmtp] said: 451 4.3.0 <not-a- user(a)test01.example.com> Internal error occurred. Refer to server log for more information. (in reply to RCPT TO command); from=<andreas.ntaflos(a)example.net> to=<not-a-user(a)test01.example.com> proto=ESMTP helo=<remote-smtp.example.net> postfix/smtpd[26469]: disconnect from remote-smtp.example.net[10.0.0.10] I've uploaded this log file excerpt for your viewing convenience to https://daff.pseudoterminal.org/misc/dovecot/failed_delivery.log More relevant information (doveconf -n, dovecot-ldap.conf) is found below. I can also provide a log excerpt from a successful delivery to an existing virtual user, if needed. To summarise: I want to use LMTP, dynamic address verification, a static user database and an LDAP password database. Can it be done without having to rely on the MTA (Postfix) to verify existing users? Thanks in advance! Andreas [1] http://wiki2.dovecot.org/HowTo/PostfixDovecotLMTP [2] http://wiki2.dovecot.org/LDA/Postfix dovecot-ldap.conf: uris = ldap://ldap.example.com:389 tls = yes tls_ca_cert_file = /etc/ssl/certs/ca-certificates.crt base = ou=virtualDomains,dc=example,dc=com dn = uid=dovecot,ou=services,dc=example,dc=com dnpass = xxx pass_attrs=uid=user, userPassword=password pass_filter=(&(objectClass=hostedAccount)(uid=%u)(accountEnabled=TRUE)) iterate_attrs = uid=user iterate_filter = (objectClass=hostedAccount) doveconf -n: https://daff.pseudoterminal.org/misc/dovecot/doveconf-n.txt -- Andreas Ntaflos Vienna, Austria GPG Fingerprint: 6234 2E8E 5C81 C6CB E5EC 7E65 397C E2A8 090C A9B4 [View Less]

2 4

Re: [Dovecot] Indexes.
by Robert Schetterer 03 Dec '10

03 Dec '10

Am 02.12.2010 14:53, schrieb Henrique Fernandes: > I have abou 9000 clients. many clients > > 500 GB of storage used small store anyway you shouldnt run into problems with that > > About the mail option at ocfs2 store creating, i guess the other guy > that format the storage system did not use. what a pitty , mail option help with small files performance like indexes and mail etc as far i remember > > We are looking into ocfs2 1.6 that was out few months ago. But … [View More]we are > not able to get it running on or Centos5.5 yet. hm centos is more redhat style i speculate Red Hat GFS would have been the better choice is there a list at centos/redhat/ocfs you might can asked about bugs with your ocfs2/distro combination ? > > Are you talking abvout this optimizations? > > Dovecot supports reading a few fields from the <base filename>: > > * > > ,S=<size>: <size> contains the file size. Getting the size > from the filename avoids doing a stat(), which may improve the > performance. This is especially useful with Maildir++ quota > <http://wiki.dovecot.org/Quota/Maildir>. > > * > > ,W=<vsize>: <vsize> contains the file's RFC822.SIZE, ie. the > file size with linefeeds being CR+LF characters. If the > message was stored with CR+LF linefeeds, <size> and <vsize> > are the same. Setting this may give a small speedup because > now Dovecot doesn't need to calculate the size itself. > > A maildir filename with those fields would look something like: > 1035478339.27041_118.foo.org > <http://1035478339.27041_118.foo.org>,S=1000,W=1030:2,S as far i remember keep close to nfs recommands http://wiki2.dovecot.org/NFS FS caching problems NFS caching is a big problem when multiple computers are accessing the same mailbox simultaneously. The best fix for this is to prevent it from happening. Configure your setup so that a user always gets redirected to the same server (unless it's down). This also means that mail deliveries must be done by the same server, or alternatively it shouldn't update index files. Dovecot flushes NFS caches when needed if you set mail_nfs_storage=yes, but unfortunately this doesn't work 100%, so you can get random errors. Disabling NFS attribute cache helps a lot in getting rid of caching related errors, but this makes the performance MUCH worse and increases the load on NFS server. This can usually be done by giving actimeo=0 or noac mount option. Index files As described above, it's better to redirect users to the same server whenever possible. If you do this, it might also be a good idea to keep index files stored locally in that server. If user gets occasionally redirected to another server, the indexes will then be created locally there. This isn't a problem. However you might want to create a cronjob to delete old index directories. If you choose to keep the index files stored in NFS, you'll need to set mmap_disable=yes. Both the mmap_disable and indexing to NFS will result in a notable performance hit. If you're not running lockd you'll have to set lock_method=dotlock, but this degrades performance. Note that many NFS installations have problems with lockd. If you're beginning to get all kinds of locking related errors, try if the problems go away with dotlocking. ------------- but i agree, there should be more info with cluster file systems in the wiki perhaps Timo has time to send recommands by mail, i am not sure that mine are optimal ( whatever i have no problems yet ) > > > I will try send an image on the load of machine. > > > []'sf.rique > > > On Thu, Dec 2, 2010 at 11:25 AM, Robert Schetterer > <robert(a)schetterer.org <mailto:robert@schetterer.org>> wrote: > > Am 02.12.2010 14:10, schrieb Henrique Fernandes: > > With recomendation settings do you have ? > > http://wiki2.dovecot.org/MailLocation/SharedDisk > > and a few more optimizes about maildir > > > > how many clients ? > > i started the server not long ago so they are less yet ( about 100 > maildirs ) > but i have my own account in it which has massive mails ( 10 GB store > with over 1000 mails daily in out , and perhaps 10000 mails in store) > > > > > sorry, i did not say i use dovecot 2.0.6 > > looks fine, update to 2.0.8 if ready > > > did you use the mail option at ocfs2 store creation ? > > what os/distro do you use , i remember bugs with ocfs with some distro > versions > > > > > []'sf.rique > > > > > > On Thu, Dec 2, 2010 at 10:40 AM, Robert Schetterer > > <robert(a)schetterer.org <mailto:robert@schetterer.org> > <mailto:robert@schetterer.org <mailto:robert@schetterer.org>>> wrote: > > > > Am 02.12.2010 13:13, schrieb Henrique Fernandes: > > > Hello people! > > > > > > I have huge problems with IO wait becase dovecot configured > to use > > maildir > > > is under OCFS2 1.4. Now i have an question to OCFS2 each disk > > action is > > > really heavy becaue it has no index. > > > > > > Now i am thinking in what can be done to heltp my system to use > > less disk. > > > > > > Looking for index and etc in dovecot i found this, this > disables > > the index > > > file on disk and leave it on ram or it disable the index files ? > > > > > > If you really want to, you can also disable the index files > > completely by > > > appending :INDEX=MEMORY > > > > > > > > > I am only trying to get dovecot to work faster. Right now we > have > > to waing > > > some seconds to dovecot list all emails or read an email. > > > > > > I am also thinking in right index to an NFS but i don't know if > > this makes > > > any diferences in performance. > > > > > > Thanks to all! > > > > > > I use 3 servres wrinting on OCFS2 one is mailman, and other two > > are to > > > email, I have ipvs to load balance the conections. > > > > > > > > > []'sf.rique > > > > > > > hm , i have no problems with ocfs2 (1.4.3-1: amd64 ) on drbd > ubuntu > > lucid > > using dovecot vers 2 recommended settings for cluster file systems > > i have my index files in the maildir dir > > > > -- > > Best Regards > > > > MfG Robert Schetterer > > > > Germany/Munich/Bavaria > > > > > > > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria [View Less]

3 2

[Dovecot] Virtual folder root cannot be opened, virtual folders ok
by Tom Talpey 02 Dec '10

02 Dec '10

I am running dovecot 1.2.16 and not able to figure out an error that happens whenever I select the root of a virtual mailbox tree. At the moment I have a simple maildir store, accessed via IMAP, and have successfully added a virtual fs namespace with two subdirectories. I have created dovecot-virtual entries in the subdirs and they are working fine; they show the expected messages, etc. My problem is with the top-level virtual directory. If I happen to select it in Thunderbird (Eudora, … [View More]actually), I receive a popup "The current command did not succeed. The mail server responded:Mailbox doesn't exist: Mobile." It also fails in the same way during search, which interrupts it and makes other client operations fail. I have tried placing a dovecot-virtual rule in the directory, leaving the directory empty, moving it in or out of the maildir tree, tweaking namespace and INDEX/LAYOUT options all with the same result - the subdirs are fine, the virtual root fails. I must be missing something obvious. Clue, please? Thanks! Relevant configuration: [~] # dovecot -n # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.33.2 i686 ext4 ... mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir mail_executable: /usr/libexec/dovecot/imap mail_plugins: fts fts_squat virtual namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: Mobile/ location: virtual:%h/Mobile:INDEX=MEMORY list: yes subscriptions: yes ... [~] # ls -lsaR /var/MailRoot/domains/<d>/<u>/Maildir/Mobile Mobile: 4 drwx------ 4 xmail xmail 4096 Nov 30 16:06 ./ 20 drwx------ 243 xmail xmail 20480 Nov 30 20:55 ../ 4 -rw------- 1 xmail xmail 19 Nov 26 17:18 .virtual-subscriptions 4 drwx------ 2 xmail xmail 4096 Nov 29 10:54 Mail1/ 4 drwx------ 2 xmail xmail 4096 Nov 29 10:54 Mail2/ 4 -rw------- 1 xmail xmail 14 Nov 30 16:06 dovecot-virtual Mobile/Mail1: 4 drwx------ 2 xmail xmail 4096 Nov 29 10:54 ./ 4 drwx------ 4 xmail xmail 4096 Nov 30 16:06 ../ 4 -rw------- 1 xmail xmail 27 Nov 26 17:16 dovecot-virtual Mobile/Mail2: 4 drwx------ 2 xmail xmail 4096 Nov 29 10:54 ./ 4 drwx------ 4 xmail xmail 4096 Nov 30 16:06 ../ 4 -rw------- 1 xmail xmail 22 Nov 26 17:16 dovecot-virtual [~] # [View Less]

2 2

[Dovecot] Virtual mailboxes and subfolders
by François-Xavier Payet 02 Dec '10

02 Dec '10

Hello again, I'd like to know if there is a way to have subfolders in virtual mailbox? In my virtual namespaces, I have some virtual maiboxes named like this : Mailbox Mailbox.SubMailbox (the separator is '.') But when I try to access the submailbox, depending on my client, it either : - Tells me the mailbox doesn't exists (Roundcube) - Don't show me any error, but don't display any mail in the mailbox (Apple Mail.app) So I'd like to know if this is because I can'… [View More]t make subfolders of virtual mailboxes, or if I'm doing something wrong. Thanks. François-Xavier Payet dovecot -n : # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-bpo.5-amd64 x86_64 Debian 5.0.7 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps managesieve login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): virtual mail_plugins(imap): virtual mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: . location: virtual:/var/vmail/%d/%n/Maildir/virtual:INDEX=MEMORY inbox: yes list: yes subscriptions: yes namespace: type: private separator: . prefix: RealMail. location: maildir:/var/vmail/%d/%n/Maildir hidden: yes list: no subscriptions: yes lda: log_path: /var/vmail/dovecot-deliver.log auth_socket_path: /var/run/dovecot/auth-master postmaster_address: foux(a)da-foux-server.tfdn.org mail_plugins: sieve virtual auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/var/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: sieve: /var/vmail/%d/%n/sieve sieve_dir: /var/vmail/%d/%n/.sieve [View Less]

2 2

[Dovecot] Have inbox at the same place
by Spyros Tsiolis 02 Dec '10

02 Dec '10

Hello again, I have an installation with dovecot and I am accessing it through linux mint and thunderbird v3.0.10 As thunderbird "subscribes" to dovecot, it does the following : Inbox Trash MyName(a)Mydomain.gr Local Folders Local Folders MyName(a)Mydomain.gr subfolder A Subfolder B Subfolder C Subfolder D Subfolder E Local Folders Outbox OK, I have to admit a have a couple of folders more than what I need. But this is fine. My problem is that *everything* is in its … [View More]

1 2

[Dovecot] how do I fix this
by donovan jeffrey j 02 Dec '10

02 Dec '10

Greetings yesterday i was resetting an account from a script. and the user was deleted an re-added. subsequently the user now has two dovecot directories. One is active and working, accepting mail, and the other sits with all previous messages. is there anyway to merge these two buggers ? /Volumes/x/var/spool/imap/dovecot mail:dovecot root# ls -la | grep jsmith drwx------ 16 jsmith mail 544 Dec 2 08:39 330CE746-6F8D-4708-8877-A97FAFB9AADD drwx------ 20 jsmith mail … [View More]

2 1

[Dovecot] Permission denied error log messages
by Tim Traver 02 Dec '10

02 Dec '10

Hi Timo, ok, I have a large 2.07 NFS setup, and I have been monitoring error messages to make sure I catch things, and I've come across a lot of messages that come in pairs and look like this : Dec 01 17:48:35 lda(paul(a)xxxxxx.com): Error: write(/home/mailboxes/data/301/paul@xxxxxx.com/Maildir/tmp/1291254514.M620308P83269.mta2.scaledsystems.com) failed: Permission denied Dec 01 17:48:35 lda(paul(a)xxxxxx.com): Error: sieve: msgid=unspecified: failed to store into mailbox 'INBOX': Internal … [View More]error occurred. Refer to server log for more information. [2010-12-01 17:48:34] I run the dovecot installation as a single user, and that user owns ALL of my virtual accounts directories. I checked, and there aren't any permissions that aren't correct. All the way up the tree has the same owner and group, and there are plenty of messages that make it through without any issue. The NFS servers don't have enough load on them to return errors for file operations, so I don't believe it is that. We use high end NetApp equipment and have never had any problems with them. I'm baffled as to why it gets permission denied message on the tmp directory. There does not seem to be a recognizable pattern for times, or particular accounts. I've just got a heck of a lot of these messages in the deliver log error files... I use qmail control files to feed the lda delivery for messages. When these errors happen, is the message lost? or is it still queued up in qmail's queue when the lda gives a fatal error like that? Thanks, Tim. here is my dovecot -n output : # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.0-RELEASE-p3 i386 auth_username_format = %Lu auth_username_translation = %@ auth_verbose = yes disable_plaintext_auth = no dotlock_use_excl = yes first_valid_uid = 100 listen = * lock_method = dotlock log_path = /local/logs/dovecot.errors mail_fsync = always mail_gid = 100 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota" mail_uid = 100 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify mmap_disable = yes passdb { args = /bin/checkpassword_dovecot_auth driver = checkpassword } plugin { quota = maildir:User quota quota_rule = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_after = /home/mailboxes/sieve/to_spam_folder.sieve sieve_dir = ~/Maildir/sieve sieve_extensions = +notify +imapflags } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = sn mode = 0600 user = sn } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = prefetch } userdb { args = /bin/checkpassword_dovecot_deliver driver = checkpassword } verbose_proctitle = yes protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { info_log_path = /local/logs/dovecot-deliver.log log_path = /local/logs/dovecot-deliver-errors.log mail_plugins = " quota sieve" } protocol imap { mail_plugins = " quota imap_quota" } protocol sieve { managesieve_sieve_capability = comparator-i;ascii-numeric fileinto reject vacation imap4flags notify include envelope body relational regex subaddress copy } [View Less]

3 5

[Dovecot] default directory for sent,trash,..
by spamvoll＠googlemail.com 02 Dec '10

02 Dec '10

hi.. is there any way to set default pathes for sent,trash and so on ? Every Client that connects uses different dirs (Outlook, Thunderbird, Android,..) thx

2 1

[Dovecot] All messages in double in a virtual mailbox.
by François-Xavier Payet 02 Dec '10

02 Dec '10

Hello, I've got some virtual maiboxes that are configured as follows : !RealMail.Sent RealMail.Sent all In all those mailboxes, all the messages appears in double. I don't think it's the expected behaviour, but I perhaps missed something. Here's my dovecot -n : # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-bpo.5-amd64 x86_64 Debian 5.0.7 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps managesieve login_dir: /var/run/dovecot/login login_executable(default): /usr/… [View More]

2 2