August 2012 - dovecot

[Dovecot] Antispam only when LMTP delivers some specific messages
by Sandro Tosi 03 Aug '12

03 Aug '12

Hello, we're setting up a weird platform where every incoming email is passed from the MTA directly to a tool that then uses dovecot LMTP to deliver the message into the user mailbox. We are legally *not* allowed to run antispam on all the incoming messages, but only on some of them, as they are recognized by the aforementioned tool; but given that tool directly uses LMTP to delivers the mail we need to find a way to parse the messages passing thru LMTP and run spamassassin only on those matching some regex on subject and mail body. Is is possible to do that with some dovecot LMTP feature? i've read a lot of documentation about how to possibly implement it and it *seems* there would be a way using pigeonhole sieve and extprograms - what do you think? The idea I have in mind is something like: 1. identify the mails we want to scan with spamassassin (using regex or whatever else to precisely pin-point them) 2. run SA on those 3. in case it's spam, rewrite the subject (or similar) Do you think it's something doable with dovecot? Thanks in advance, -- Sandro Tosi Product Engineer Shared Hosting Products R&D | Dada.pro eml sandro.tosi(a)register.it

3 3

[Dovecot] dovecot-lda setting quota rules
by Lazy 03 Aug '12

03 Aug '12

Hi, in my setup dovecot-lda reads user and home from environment, and dosn't perform userdb lookup Jul 18 03:09:47 thebe2 dovecot: lda(lazytest_test): Debug: Effective uid=300, gid=300, home=/vmail/la/lazytest_test Jul 18 03:09:47 thebe2 dovecot: lda(lazytest_test): Debug: Quota root: name=User quota backend=maildir args= Jul 18 03:09:47 thebe2 dovecot: lda(lazytest_test): Debug: Quota warning: bytes=0 (95%) messages=0 reverse=no command=quota-warning 95 lazytest_test Jul 18 03:09:47 thebe2 dovecot: lda(lazytest_test): Debug: Quota warning: bytes=0 (80%) messages=0 reverse=no command=quota-warning 80 lazytest_test Jul 18 03:09:47 thebe2 dovecot: lda(lazytest_test): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes l ocation=maildir:~/Maildir:INDEX=/var/dovecot_indexes/vmail/la/lazytest_test Jul 18 03:09:47 thebe2 dovecot: lda(lazytest_test): Debug: maildir++: root=/vmail/la/lazytest_test/Maildir, index=/var/dovecot_indexes/vmail/la/lazytest_tes t, control=, inbox=/vmail/la/lazytest_test/Maildir, alt= Jul 18 03:09:47 thebe2 dovecot: lda(lazytest_test): Debug: userdb lookup skipped, username taken from USER environment Jul 18 03:09:47 thebe2 dovecot: lda(lazytest_test): Debug: Quota root: name=User quota backend=maildir args= I wan't it to stay that way. The problem is that it dosn't update the quota rules in Maildir when quota is changed in userdb. I have the rules avaiable in qmail-lda's environment, but I need an idea on how to feed the quota rule string to quota plugin without doing userdb lookup. What whould be the best way to do this, maybe in plugins/quota/quota.c:quota_root_add_rules() ? Regards, Michal Grzedzicki

2 4

[Dovecot] managesieve segfault with gold linker
by Eray Aslan 03 Aug '12

03 Aug '12

dovecot-2.1.8 sieve-0.3.1 binutils-2.22 When dovecot and sieve is linked with ld.gold I get a segfault in checkscript command: $ telnet localhost 4190 [some output] authenticate "PLAIN" "<base64_username_password>" [some more output] checkscript "foobarscript" connection closed Logs: 2012-07-12T19:30:23.624158+00:00 bob dovecot: master: Dovecot v2.1.8 starting up 2012-07-12T19:31:22.548913+00:00 bob dovecot: managesieve-login: Login: user=<username>, method=PLAIN, rip=192.168.122.1, lip=192.168.122.64, mpid=12169, session=<YGo2AqfEcwDAqHoB> 2012-07-12T19:31:34.636747+00:00 bob dovecot: managesieve(username): Fatal: master: service(managesieve): child 12169 killed with signal 11 (core dumped) make check also fails (thank you for that): [...] Test case: ./tests/execute/errors.svtest: 1: Test 'Action conflicts: reject <-> fileinto' SUCCEEDED 2: Test 'Action conflicts: reject <-> keep' SUCCEEDED 3: Test 'Action conflicts: reject <-> redirect' SUCCEEDED 4: Test 'Action limit' SUCCEEDED 5: Test 'Redirect limit' SUCCEEDED /tmp/work/dovecot-2.1-pigeonhole-0.3.1/src/testsuite/.libs/lt-testsuite: symbol lookup error: /tmp/work/dovecot-2.1-pigeonhole-0.3.1/src/lib-sieve/.libs/libdovecot-sieve.so.0: undefined symbol: mail_deliver_get_log_var_expand_table make: *** [tests/execute/errors.svtest] Error 127 Backtrace is attached. -- Eray Aslan <eras(a)gentoo.org>

2 4

[Dovecot] LZMA2 (xz) support for Dovecot?
by Brad Smith 02 Aug '12

02 Aug '12

Timo, Thoughts on adding LZMA2 (xz) support via liblzma to Dovecot? -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

2 1

[Dovecot] imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory
by Frank Bonnet 02 Aug '12

02 Aug '12

hello I see this message in the dovecot error log every time a user connect to IMAP service. imap(xxxxxxxx): Error: opendir(/user/xxxxxxxx/.imap) failed: No such file or directory In the server's config I've this mail_location = mbox:%h/:INBOX=/var/mail/%u:INDEX=/var/spool/dovecot/index/%u As we can see INDEX files are not living in user's home directories but in /var/spool/dovecot/index/%u so why this error message ? BTW : users access normally to their IMAP folders , I'm just curious about this message which is not marked as warning but error Thank you

4 14

[Dovecot] Problem with preserving MIME format with Dovecot IMAP and MS Outlook client
by Peter Grimmond 01 Aug '12

01 Aug '12

Hello all, Apologies for the repost, but I am really struggling to solve this problem... I have installed Dovecot 2.0.19 on Ubuntu 12.04 LTS. I have set up a very basic IMAP configuration. I have two different laptops running MS Outlook (one MacOS, one Windows 7) and I have configured both to connect to the Dovecot service. My problem is, emails in MIME format that I synchronise from one MS Outlook client are not being correctly decoded as MIME messages on the other client. Instead, the message is rendered in plaintext, starting with the lines: This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. --B_3426360453_22814Content-type: multipart/alternative; boundary="B_3426360453_4099" --B_3426360453_4099Content-type: text/plain; charset="ISO-8859-1"Content-transfer-encoding: quoted-printable Can anyone help me understand why this might be happening? The output from dovecot -n is: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-26-generic-pae i686 Ubuntu 12.04 LTS auth_debug = yes auth_verbose = yes disable_plaintext_auth = no mail_location = maildir:~/Maildir passdb { driver = pam } protocols = " imap" ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } Thanks! PG ___ Peter Grimmond

2 1

[Dovecot] Problem with preserving MIME format with Dovecot IMAP and Outlook
by Peter Grimmond 01 Aug '12

01 Aug '12

1 0

[Dovecot] can't recieve emails to inbox
by Rafael Nathan 01 Aug '12

01 Aug '12

Hi, I am unable to send emails to virtual users I created. Here is my output for dovecot -n # 1.0.7: /etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log ssl_disable: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:~/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: verbose: yes passdb: driver: passwd-file args: /etc/dovecot/passwd passdb: driver: pam userdb: driver: passwd userdb: driver: static args: uid=vmail gid=vmail home=/home/vmail/%u == Contents of my passwd file located at /etc/dovecot/passwd user1(a)mydomain.com user2(a)mydomain.com I sent an email to user1(a)mydomain.com from gmail.com but can view it anywhere. Please suggest. Where am I going wrong?

2 1

[Dovecot] Erroneous operation not permitted when deleting mailbox with mdbox
by Nikolai Schupbach 01 Aug '12

01 Aug '12

I'm seeing the following error in our logs when removing mailboxes (we are using mdbox and dovecot 2.1.8): Aug 1 20:03:36 msgsrv dovecot: imap(test(a)test.com): Error: stat(/mailstore/domains/test.com/test/mdbox/mailboxes/Spam) failed: Operation not permitted Aug 1 20:03:36 msgsrv dovecot: imap(test(a)test.com): Mailbox deleted: Spam When I run truss against the process it appears the error relates to attempted unlink of a directory, not a stat of it, as reported by the log. However the mailbox does appear to be deleted fine, so it appears to be an erroneous error. Here is the truss output from the "3 DELETE INBOX.Spam" IMAP command: gettimeofday({1343808204.962165 },0x0) = 0 (0x0) gettimeofday({1343808204.962351 },0x0) = 0 (0x0) kevent(9,0x0,0,{0xb,EVFILT_READ,0x0,0,0x15,0x21c17a40},6,{1786.679649000 }) = 1 (0x1) gettimeofday({1343808216.031493 },0x0) = 0 (0x0) gettimeofday({1343808216.031676 },0x0) = 0 (0x0) read(11,"3 DELETE INBOX.Spam\r\n",8179) = 21 (0x15) getpid() = 6293 (0x1895) __sysctl(0x7fffffffd850,0x4,0x0,0x0,0x21c8f000,0x2a) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam",{ mode=drwx------ ,inode=28760,size=3,blksize=131072 }) = 0 (0x0) open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",O_RDWR,037777753160) = 10 (0xa) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) pread(0xa,0x21c30000,0x90,0x0,0x1000,0x0) = 144 (0x90) open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index",O_RDWR,037777731760) ERR#2 'No such file or directory' open("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2",O_RDWR,037777731520) ERR#2 'No such file or directory' fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) unlink("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam") ERR#1 'Operation not permitted' stat("/usr/share/nls/C/libc.cat",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/share/nls/libc/C",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/local/share/nls/C/libc.cat",0x7fffffffd0a0) ERR#2 'No such file or directory' stat("/usr/local/share/nls/libc/C",0x7fffffffd0a0) ERR#2 'No such file or directory' write(2,"\^A\b6293 prefix=imap(test@test."...,36) = 36 (0x24) write(2,"\^A\^D6293 stat(/mailstore/domai"...,99) = 99 (0x63) access("/etc/localtime",4) = 0 (0x0) open("/etc/localtime",O_RDONLY,04160026530) = 12 (0xc) fstat(12,{ mode=-r--r--r-- ,inode=16454,size=2434,blksize=4096 }) = 0 (0x0) read(12,"TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0"...,41448) = 2434 (0x982) close(12) = 0 (0x0) issetugid(0x20ee7fd1,0x21e72000,0x0,0xa7,0x4e,0xc) = 1 (0x1) open("/usr/share/zoneinfo/posixrules",O_RDONLY,056) = 12 (0xc) fstat(12,{ mode=-r--r--r-- ,inode=545,size=3519,blksize=4096 }) = 0 (0x0) read(12,"TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0"...,41448) = 3519 (0xdbf) close(12) = 0 (0x0) madvise(0x21eba000,0xb000,0x5,0x2b9,0x17,0x1) = 0 (0x0) madvise(0x21e72000,0x5000,0x5,0x271,0x17,0x1) = 0 (0x0) madvise(0x21e63000,0xc000,0x5,0x262,0x7fffffffcbf0,0x7fffffffcbf0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) gettimeofday({1343808216.048607 },0x0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log.2",0x7fffffffd600) ERR#2 'No such file or directory' setitimer(0,{0.000000, 180.000000 },{0.000000, 0.000000 }) = 0 (0x0) fcntl(10,F_SETLKW,0x7fffffffd520) = 0 (0x0) setitimer(0,{0.000000, 0.000000 },{0.000000, 180.000000 }) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=144,blksize=4096 }) = 0 (0x0) pwrite(0xa,0x21c09000,0xc,0x90,0x10ab6b8,0x2) = 12 (0xc) pwrite(0xa,0x7fffffffd69c,0x4,0x90,0x10ab6b8,0x2) = 4 (0x4) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) fcntl(10,F_SETLK,0x7fffffffd5e0) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) setitimer(0,{0.000000, 180.000000 },{0.000000, 0.000000 }) = 0 (0x0) fcntl(10,F_SETLKW,0x7fffffffd1f0) = 0 (0x0) setitimer(0,{0.000000, 0.000000 },{0.000000, 180.000000 }) = 0 (0x0) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=156,blksize=4096 }) = 0 (0x0) pwrite(0xa,0x21c09400,0x1c,0x9c,0xffff800021c0bea4,0x7fffffffa9f0) = 28 (0x1c) pwrite(0xa,0x7fffffffd57c,0x4,0x9c,0xffff800021c0bea4,0x7fffffffa9f0) = 4 (0x4) clock_gettime(13,{1343808216.000000000 }) = 0 (0x0) fcntl(10,F_SETLK,0x7fffffffd610) = 0 (0x0) stat("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails/dovecot.index.log",{ mode=-rw------- ,inode=28762,size=184,blksize=4096 }) = 0 (0x0) fstat(10,{ mode=-rw------- ,inode=28762,size=184,blksize=4096 }) = 0 (0x0) rename("/mailstore/domains/test.com/test/mdbox/mailboxes/Spam/dbox-Mails","/mailstore/domains/test.com/test/mdbox/..DOVECOT-TrasH") = 0 (0x0) open(".",O_RDONLY,00) = 12 (0xc) open("/mailstore/domains/test.com/test/mdbox/..DOVECOT-TrasH",O_NOFOLLOW,00) = 13 (0xd) fchdir(0xd,0x100,0x0,0x7b30,0x101010101010101,0x8080808080808080) = 0 (0x0) stat(".",{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) open(".",O_NONBLOCK|0x20000,00) = 14 (0xe) fstat(14,{ mode=drwx------ ,inode=28761,size=3,blksize=131072 }) = 0 (0x0) fcntl(14,F_SETFD,FD_CLOEXEC) = 0 (0x0) fstatfs(0xe,0x7fffffffd3a0,0x21c00400,0x29,0x61ff20,0x0) = 0 (0x0) getdirentries(0xe,0x21c31000,0x1000,0x21c284e8,0x61ff20,0x0) = 52 (0x34) unlink("dovecot.index.log") = 0 (0x0) getdirentries(0xe,0x21c31000,0x1000,0x21c284e8,0x61ff20,0x0) = 0 (0x0) close(13) = 0 (0x0) lseek(14,0x0,SEEK_SET) = 0 (0x0) close(14) = 0 (0x0) fchdir(0xc,0x0,0x21c07400,0x28,0x61ff20,0x0) = 0 (0x0) close(12) = 0 (0x0) rmdir(0x21c18470,0x0,0x21c07400,0x28,0x61ff20,0x0) = 0 (0x0) rmdir(0x21c184f0,0x4,0x21c18000,0x7af8,0xffffffffffdd6669,0x21c8c298) = 0 (0x0) open("/mailstore/domains/test.com/test/mdbox/dovecot.mailbox.log",O_RDWR|O_APPEND,0125337603) = 12 (0xc) write(12,"\^A\0\0\0\M^L\M-M%\^E\M^F\M-b\^X"...,24) = 24 (0x18) fstat(12,{ mode=-rw------- ,inode=28751,size=144,blksize=4096 }) = 0 (0x0) rmdir(0x21c186d0,0x21e41eb8,0x21c186d0,0x7918,0xffffffffffdd6849,0x21c8c298) ERR#2 'No such file or directory' write(12,"\^B\0\0\0\M-Xb\M^JRY\M-I{x\M--C"...,24) = 24 (0x18) fstat(12,{ mode=-rw------- ,inode=28751,size=168,blksize=4096 }) = 0 (0x0) write(2,"\^A\^B6293 Mailbox deleted: Spam"...,29) = 29 (0x1d) gettimeofday({1343808216.058749 },0x0) = 0 (0x0) madvise(0x21e65000,0x1000,0x5,0x264,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21e63000,0x1000,0x5,0x262,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21e41000,0x2000,0x5,0x240,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21d8d000,0x4000,0x5,0x18c,0x7fffffffcfa0,0xffffffff) = 0 (0x0) madvise(0x21c91000,0x2000,0x5,0x90,0x7fffffffcfa0,0xffffffff) = 0 (0x0) gettimeofday({1343808216.059531 },0x0) = 0 (0x0) getpid() = 6293 (0x1895) __sysctl(0x7fffffffd830,0x4,0x0,0x0,0x21c8f000,0x23) = 0 (0x0) write(11,"3 OK Delete completed.\r\n",24) = 24 (0x18) gettimeofday({1343808216.060105 },0x0) = 0 (0x0) Regard, Nikolai.

2 1

[Dovecot] ntlm auth / usernames with white spaces
by Matthias Lay 01 Aug '12

01 Aug '12

Hi, we experienced some problems with white spaces in usernames (this was NOT our idea) authenticated bei dovecots ntlmhelper I wrote a little patch fixing this, if you would like. patch applies on 2.1.7 and 2.1.8 (tested those) diff -up ./src/auth/mech-winbind.c.username ./src/auth/mech-winbind.c --- ./src/auth/mech-winbind.c.username 2012-07-27 09:52:33.422553807 +0200 +++ ./src/auth/mech-winbind.c 2012-07-27 14:23:03.718619388 +0200 @@ -239,8 +239,16 @@ do_auth_continue(struct auth_request *au return HR_FAIL; } else if (strcmp(token[0], "AF") == 0) { const char *user, *p, *error; + int ti=1; + + if(gss_spnego) + ti=2; + /* some braindead administrators like spaces in usernames */ + user = token[ti]; + while(token[++ti]){ + user = t_strconcat(user, " ", token[ti], NULL); + } - user = gss_spnego ? token[2] : token[1]; i_assert(user != NULL); p = strchr(user, '\\');

2 2