August 2008 - dovecot

[Dovecot] v1.1.2 released
by Timo Sirainen 04 Aug '08

04 Aug '08

http://dovecot.org/releases/1.1/dovecot-1.1.2.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.2.tar.gz.sig Development of new features in this release and the upcoming multi-master replication are sponsored by Directi (www.directi.com) Lucene indexing is currently deprecated in favor of the new Solr indexing. I'm even considering removing the Lucene C++ library support, so if you're interested in keeping it send me a mail. Note that the current fts-lucene is somewhat broken as well as non-optimal. Anyone interested in using zlib plugin with Maildir should read http://wiki.dovecot.org/Plugins/Zlib. I'm hoping to get the first v1.2 betas out in a couple of weeks and an eventual v1.2.0 release in a couple of months. + Added full text search indexing support for Apache Lucene Solr server: http://wiki.dovecot.org/Plugins/FTS/Solr + IMAP SORT: Added X-SCORE sort key for use with Solr searches. + zlib plugin supports now bzip2 also. + quota: All backends now take noenforcing parameter. + Maildir: Add ,S=<size> to maildir filename whenever quota plugin is loaded, even when not using Maildir++ quota. + deliver: Allow lda section to override plugin settings. + deliver: Giving a -m <namespace prefix> parameter now silently saves the mail to INBOX. This is useful for e.g. -m INBOX/${extension} + Added a new maildirlock utility for write-locking Dovecot Maildir. + dict-sql: Support non-MySQL databases by assuming they implement the "INSERT .. ON DUPLICATE KEY" using an INSERT trigger. - SORT: Fixed several crashes/errors with sort indexing. - IMAP: BODYSTRUCTURE is finally RFC 3501 compliant. Earlier versions didn't include Content-Location support. - IMAP: Fixed bugs with listing INBOX. - Maildir: maildirfolder file wasn't created when dovecot-shared file existed on the root directory - deliver didn't expand %variables in namespace location settings. - zlib: Copying non-compressed messages resulted in empty mails (except when hardlink-copying between maildirs). - mbox-snarf plugin was somewhat broken - deliver + Maildir: If uidlist couldn't be locked while saving, we might have assert-crashed - mbox: Fixed an assert-crash with \Recent flag handling

5 8

[Dovecot] Help with auto vacation replies
by CJ Keist 04 Aug '08

04 Aug '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, I'm testing out dovecot with postfix. I'm running postfix 2.5.2 with dovecot version 1.1.1 with dovecot sieve plugin version 1.1.5. I have everything compiled and working except for the sieve plugin. I'm now trying to test out the sieve plugin and having no luck in getting a simple auto vacation reply to work. Here is my .dovecot.sieve script: require ["fileinto", "vacation"]; # BEGIN VACATION vacation :days 30 :subject "Out of Office Reply" :addresses ["cj.keist(a)colostate.edu"] "OUT OF THE OFFICE"; I know the dovecot delivery program is reading my script as the .dovecot.sievec file is being created and there is no .dovecot.sieve.err file. Permissions of the files are in my ownership. The files are located in my home directory as well. The log files simply show delivery of the message and nothing else: Aug 4 09:06:28 mail2.engr.colostate.edu postfix/local[7480]: [ID 197553 mail.info] 622BB59EFA: to=<cjay(a)engr2.colostate.edu>, relay=local, delay=0.89, delays=0 .18/0.08/0/0.64, dsn=2.0.0, status=sent (delivered to command: /userM/mail-services/dovecot/libexec/dovecot/deliver) Aug 4 09:06:28 mail2.engr.colostate.edu postfix/qmgr[4666]: [ID 197553 mail.info] 622BB59EFA: removed Any help as to why it is not sending any replies? Dovecot -n follows: # 1.1.1: /userM/mail-services/dovecot/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 1500). Either grow the limit or change login_max_processes_count and max_mail_processes settings base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key_file: /userM/mail-services/dovecot/etc/ssl/privkey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3-login login_greeting: Cyrus ready. login_max_processes_count: 500 max_mail_processes: 500 mail_location: mbox:~/:INBOX=/userM/mail/%u mmap_disable: yes mail_nfs_index: yes mail_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /userM/mail-services/dovecot/lib/dovecot/pop3 auth default: mechanisms: plain login verbose: yes debug: yes passdb: driver: pam passdb: driver: passwd args: blocking=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /userM/mail-services/postfix/var/private/auth mode: 432 user: postfix group: postfix - -- C. J. Keist Email: cj.keist(a)colostate.edu UNIX/Network Manager Phone: 970-491-0630 Engineering Network Services Fax: 970-491-5569 College of Engineering, CSU Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness' -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIlyB8A29OFr7C6jcRAt5lAKCiP5Zh1WIMrg+QWPprcxi9Gp5Z3QCgxhbj A6ivJ6XeA8MuoA19y2xEFjI= =uT1j -----END PGP SIGNATURE-----

2 2

[Dovecot] bugzilla or other similar bug tracking systems
by Diego Liziero 04 Aug '08

04 Aug '08

I was wondering if it could be useful to use such tools to keep track of users bugs. I find somehow harder to search the mailing list if a bug is known, if it's being worked on, if it needs more feedback, in witch release it has been eventually solved, and so on. Any thoughts? Regards, Diego.

3 3

Re: [Dovecot] how to store flags \Seen into read-only mailbox?
by seriv＠parkheights.dyndns.org 04 Aug '08

04 Aug '08

This problem is apparently about changeset http://hg.dovecot.org/dovecot-1.1/rev/eec74a6ad62e. This change makes dovecot behaviour different from what is described in wiki, about sharing and making private /Seen flags, see http://wiki.dovecot.org/SharedMailboxes?highlight=(flags are shared or private) When I've tried to revert it, first time with my client it worked perfectly. But then clients were not able to open any mail folders, and imap processes were dying. -- Sergey Ivanov. ----- seriv(a)parkheights.dyndns.org wrote: > Hi, > I'm trying to use dovecot for storing mailing lists and read-only > access for users. > The OS is Solaris, authentication for all readers of these lists are > from Ldap through PAM, and one local user "listuser" will receive all > mail and store them into it's folders (Maildirs). These maildirs are > readable (read-only) for all others and they are shared by setting > --- > mail_location: > maildir:/home/vmail/listuser/Maildir:CONTROL=/home/vmail/%u/Maildir/control:INDEX=/home/vmail/%u/Maildir/index > --- > Mail became readable because in each mail folder to be shared there is > dovecot-shared with mode 064, and all users included into his group. > > But this is the problem: how to have flag \Seen stored in read-only > mailbox? As recorded by rawlog, it is ignored now: > --- > bash-3.00# cat 20080724-103219-10616.in > 3 namespace > 4 lsub "" "*" > 5 list "" "INBOX" > 6 list "" "Trash" > 7 create "Trash" > 8 select "OmniTI.FreeLotto.Ops" > 9 UID fetch 1:* (FLAGS) > 10 uid store 1:3 +Flags (\Seen) > 11 IDLE > DONE > 12 close > 13 logout > bash-3.00# cat 20080724-103219-10616.out > * OK [RAWLOG TIMESTAMP] 2008-07-24 10:32:19 > * NAMESPACE (("" ".")) NIL NIL > 3 OK Namespace completed. > * LSUB () "." "OmniTI.FreeLotto.ODS" > * LSUB () "." "OmniTI.FreeLotto.Ops" > 4 OK Lsub completed. > * LIST (\HasNoChildren) "." "INBOX" > 5 OK List completed. > 6 OK List completed. > 7 NO Internal error occurred. Refer to server log for more > information. [2008-07-24 10:32:19] > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) > * OK [PERMANENTFLAGS ()] Read-only mailbox. > * 3 EXISTS > * 0 RECENT > * OK [UNSEEN 1] First unseen. > * OK [UIDVALIDITY 1216906857] UIDs valid > * OK [UIDNEXT 4] Predicted next UID > 8 OK [READ-ONLY] Select completed. > * 1 FETCH (UID 1 FLAGS ()) > * 2 FETCH (UID 2 FLAGS ()) > * 3 FETCH (UID 3 FLAGS ()) > 9 OK Fetch completed. > 10 OK Store ignored with read-only mailbox. > + idling > 11 OK Idle completed. > 12 OK Close completed. > * BYE Logging out > 13 OK Logout completed. > --- > > -- > Sergey ivanov.

2 1

[Dovecot] plus addressing bug in dovecot 1.1.x?
by Jon Fullmer 04 Aug '08

04 Aug '08

I had recently upgraded from Dovecot 1.0.14 to 1.1.0, and then to 1.1.1. Ever since the upgrade to 1.1.0, I noticed that "plus addressing" has failed. In case I'm using a foreign phrase, this is the concept of sending an e-mail to "user+spam(a)domain.com", and having dovecot (dovecot LDA, specifically), deliver this to the "spam" submailbox to "user(a)domain.com". I've been using this successfully since 1.0.3. When I upgraded to 1.1.0, I noticed that e-mails were no longer being delivered to the submailboxes as they had been (though they would arrive in the central INBOX). I checked the "dovecot-deliver.log", and I noticed that, ever since I had brought up 1.1.0, I would see: save failed to spam: Unknown namespace ("spam" is the submailbox) After the upgrade to 1.1.1, I still would see these messages (and behavior). I have since installed 1.0.15. The plus addressing now works again, as it had been. With all of these "upgrades" and "downgrades", the config file has remained exactly the same. There have been no other changes to any components on the host system (i.e., new OS-es, new postfix, etc.). Thoughts? Is this a known issue? - Jon

4 7

[Dovecot] nfs_flush errors
by Hans Wunsch 04 Aug '08

04 Aug '08

I'm looking for some help with an nfs error that is filling our logs. I get a constant stream of these messages: Jul 8 10:47:08 servername dovecot: [ID 107833 mail.error] IMAP(username): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy I have two dovecot IMAP servers. All mailboxes are NFS mounted. The INBOX is /var/mail and the rest are in /home/<user>/mail. It looks like work was done on this back in January: http://www.dovecot.org/list/dovecot-cvs/2008-January/010638.html And again in February: http://hg.dovecot.org/dovecot-1.1/rev/258477a3f1e7 Was a there another fix that I missed or is anybody else is still seeing the same issue? Thanks, Hans

3 4

[Dovecot] Problem: delivery with mode 600 into shared folder
by seriv＠parkheights.dyndns.org 04 Aug '08

04 Aug '08

Hi, I have a problem, delivery called from /etc/aliases file by pipe delivers with mode 0600. I need system users with shared mail folders (Maildir format). When I changed alias to pipe to shell wrapper with mode 002 set in it, nothing changed. MTA is sendmail, OS Solaris, and dovecot version 1.1.1. Can somebody help? Here are dovecot settings: --- /opt/dovecot11/sbin/dovecot -n # 1.1.1: /opt/dovecot11/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log login_dir: /var/run/dovecot//login login_executable: /opt/dovecot11/libexec/amd64/dovecot/imap-login max_mail_processes: 128 mail_location: maildir:/home/vmail/listuser/Maildir:CONTROL=/home/vmail/%u/Maildir/control:INDEX=/home/vmail/%u/Maildir/index mail_debug: yes auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: pam args: imap userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 432 user: daemon group: other plugin: sieve: /opt/dovecot11/sieve-scripts/folders.sieve --- And this is the alias to pipe: --- grep deliver /etc/aliases listuser(a)domain.com: "|/opt/dovecot11/libexec/dovecot/deliver -d listuser" -- Sergey Ivanov.

3 4

[Dovecot] Recieving e-mail is not updating quota
by M. Rodrigo Monteiro 04 Aug '08

04 Aug '08

Hello again. When I send e-mail locally from userX@mydomain to userY@mydomain the quota in userY@mydomain isn't updated with the new message, but the message arrives fine. It's not a userX problem, because it's equal if it's userY sending userX. When I save an message, the quota is updated. Or when the userX sends the e-mail, his quota is updated too. The problem is that the quota don't update when a new message arrives. What could it be? Now I empty the mailbox of the userY, and the maildirsize is like this: 16777216S 0 0 1151862 1 2837616 1 2838683 1 5674797 2 -5674797 -2 -5674797 -2 1151862 1 -1151862 -1 -1151862 -1 The user quota from ldap is 16MB. In the user dir, the size is 452K # du -kh . --max-depth=0 452K . Now, I send an e-mail about 900k from userX to userY, and the quota display still 0M, but the user dir is 1,6M # du -kh . --max-depth=0 1,6M . My confs/logs # /usr/local/dovecot/sbin/dovecot -n # 1.1.1: /usr/local/dovecot/etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login valid_chroot_dirs: /home/vmail/domains verbose_proctitle: yes first_valid_uid: 200 last_valid_uid: 200 first_valid_gid: 200 last_valid_gid: 200 mail_privileged_group: vmail mail_uid: 200 mail_gid: 200 mail_location: maildir:/home/vmail/domains/%d/%n mail_debug: yes mail_plugins: quota imap_quota auth default: user: dovecot-auth passdb: driver: ldap args: /usr/local/dovecot/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/dovecot/etc/dovecot-ldap.conf plugin: quota_rule: *:storage=1G quota_rule2: Trash:storage=10%% quota_rule3: Lixeira:storage=10%% quota_rule4: Spam:storage=10%% quota: maildir # grep -v '^ *$#.*$\?$' /usr/local/dovecot/etc/dovecot-ldap.conf hosts = localhost dn = cn=dovecot,dc=xxxxxx,dc=ce,dc=gov,dc=br dnpass = xxxxx ldap_version = 3 base = o=mail, dc=xxxxxx, dc=ce, dc=gov, dc=br deref = never scope = subtree user_attrs = homeDirectory=home,quota=quota_rule=*:storage=%$M user_filter = (&(objectClass=JammMailAccount)(mail=%u)(accountActive=TRUE)(delete=FALSE)) pass_attrs = userPassword=password pass_filter = (&(objectClass=JammMailAccount)(mail=%u)(accountActive=TRUE)(delete=FALSE)) # tail /var/log/mail.log dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Loading modules from directory: /usr/local/dovecot/lib/dovecot/imap dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib10_quota_plugin.so dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Effective uid=200, gid=200, home=/home/vmail/domains dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota root: name= backend=maildir args= dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=* bytes=16777216 (0%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Trash bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Lixeira bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Spam bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): maildir: data=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): maildir++: root=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo, index=, control=, inbox=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo Regards, Rodrigo. -- M. Rodrigo Monteiro falecom(a)rodrigomonteiro.net "Free as in Freedom, not free as in free beer" Linux User # 403730

2 2

[Dovecot] dovecot 1.1.2 assertion
by Nuno Lopes 04 Aug '08

04 Aug '08

Hi, I've upgraded to last version of dovecot and am now getting the following assertions: Jul 25 00:00:34 bld3 dovecot: Panic: IMAP(example1(a)example.com): file index-sort-string.c: line 542 (index_sort_add_ids_range): assertion failed: (left_idx == 0 && right_idx == rightmost_idx) Jul 25 00:00:34 bld3 dovecot: IMAP(example1(a)example.com): Raw backtrace: imap [0x5555555d30f0] -> imap [0x5555555d3157] -> imap [0x5555555d27d8] -> imap(index_sort_list_finish_string+0xe8e) [0x5555555a01de] -> imap(index_storage_search_next_nonblock+0x432) [0x55555559caa2] -> imap(mailbox_search_next+0x21) [0x5555555a4051] -> imap(imap_sort+0xdc) [0x555555577d3c] -> imap(cmd_sort+0x33d) [0x555555570e1d] -> imap(cmd_uid+0x54) [0x555555571894] -> imap [0x5555555722ac] -> imap [0x555555572362] -> imap [0x555555572b7f] -> imap(client_input+0x62) [0x555555572da2] -> imap(io_loop_handler_run+0xf8) [0x5555555da0c8] -> imap(io_loop_run+0x1d) [0x5555555d918d] -> imap(main+0x462) [0x55555557a552] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2ae31494c154] -> imap [0x55555556c859] in another instance: Jul 25 00:08:48 bld4 dovecot: Panic: IMAP(example2(a)example.com): file index-sort-string.c: line 607 (index_sort_add_ids_range): assertion failed: (skip > 0) Jul 25 00:08:48 bld4 dovecot: IMAP(example2(a)example.com): Raw backtrace: imap [0x5555555d30f0] -> imap [0x5555555d3157] -> imap [0x5555555d27d8] -> imap(index_sort_list_finish_string+0xedc) [0x5555555a022c] -> imap(index_storage_search_next_nonblock+0x432) [0x55555559caa2] -> imap(mailbox_search_next+0x21) [0x5555555a4051] -> imap(imap_sort+0xdc) [0x555555577d3c] -> imap(cmd_sort+0x33d) [0x555555570e1d] -> imap(cmd_uid+0x54) [0x555555571894] -> imap [0x5555555722ac] -> imap [0x555555572362] -> imap [0x555555572b7f] -> imap(client_input+0x62) [0x555555572da2] -> imap(io_loop_handler_run+0xf8) [0x5555555da0c8] -> imap(io_loop_run+0x1d) [0x5555555d918d] -> imap(main+0x462) [0x55555557a552] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b64897fc154] -> imap [0x55555556c859] If this is not enough for you to solve it ... Some problems were solved upgrading from 1.1.1 but these ones remained. Thanks, -- Nuno

2 3

[Dovecot] namespaces at v1.0.15
by Evaggelos Balaskas 04 Aug '08

04 Aug '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, i need to create a public maildir folder for virtual users so i did this: dovecot-1.0.15: namespace public { prefix = public/ separator = / location = maildir:/var/mail/shared:INDEX=/var/mail/shared/%u/index/:CONTROL=/var/mail/shared/%u/control/ } namespace private { separator = / prefix = inbox = yes } umask = 007 and everything works fine, but ... when one user reads an email from the public folder then the status (flag read) changes to all users. How i can fix this? How every virtual user (same uid.gid) can have its own index (perhaps?) Evaggelos Balaskas - Unix System Engineer Informatics Engineer Technological Education http://ebalaskas.gr/wk/ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIku4ZWIK+Pe9twhoRAokDAJ9u2/SjCqgabHvJFlTXlDART6+sngCghNA/ Ufl8U5GQ0mS3tVUU8idtNwY= =BUGu -----END PGP SIGNATURE-----

3 3

[Dovecot] 1.1.2 segfaults when using passdb passwd and md5 mechanism
by Miguel Filho 04 Aug '08

04 Aug '08

Setting passdb to passwd and enabling cram-md5 or digest-md5 makes dovecot crash. The documentation says that I can use md5 with passwd. I had to use strace to figure it, because dovecot segfaults and doesn't log the error. Using CenOS 5.2 x86_64 Regards, Miguel # dovecot -n # 1.1.2: /etc/dovecot.conf listen: 127.0.0.1 login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no mail_max_userip_connections(default): 5 mail_max_userip_connections(imap): 5 mail_max_userip_connections(pop3): 10 verbose_proctitle: yes first_valid_uid: 100 mail_debug: yes mail_executable: /mail/bin/resolv_mailbox.sh mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 auth default: mechanisms: plain login gssapi digest-md5 passdb: driver: passwd args: blocking=yes userdb: driver: passwd args: blocking=yes Backtrace: #0 0x0000000000410337 in hash_lookup (table=0x0, key=0xa85) at hash.c:159 node = <value optimized out> #1 0x0000000000405dae in log_it (log_io=0x1736ee00, line=0x1736f922 "DIGEST-MD5 mechanism can't be supported with given passdbs", continues=false) at log.c:128 process = <value optimized out> log_type = LOG_TYPE_FATAL #2 0x0000000000405e48 in log_write_pending (log_io=0x1736ee00) at log.c:51 _data_stack_cur_id = 3 line = 0x1736f920 "\001FDIGEST-MD5 mechanism can't be supported with given passdbs" #3 0x00000000004060e8 in log_read (log_io=0x1736ee00) at log.c:176 data = <value optimized out> line = <value optimized out> size = 0 ret = <value optimized out> #4 0x0000000000406188 in log_deinit () at log.c:316 next = (struct log_io *) 0xa85 #5 0x000000000040335d in auth_process_destroy (p=0x1736ee60) at auth-process.c:345 iter = <value optimized out> key = (void *) 0x6 value = <value optimized out> pos = <value optimized out> #6 0x00000000004034f9 in auth_process_input (process=0x1736ee60) at auth-process.c:266 line = <value optimized out> #7 0x0000000000412df8 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:201 ctx = <value optimized out> event = (const struct epoll_event *) 0x1736ef0c list = (struct io_list *) 0x17370aa0 io = (struct io_file *) 0x17370a60 tv = {tv_sec = 0, tv_usec = 970535} events_count = <value optimized out> t_id = 2 msecs = <value optimized out> ret = 3 i = 1 call = <value optimized out> #8 0x0000000000411fad in io_loop_run (ioloop=0x1736eab0) at ioloop.c:308 No locals. #9 0x0000000000409f4f in main (argc=<value optimized out>, argv=<value optimized out>) at main.c:558 _data_stack_cur_id = 0 ---Type <return> to continue, or q <return> to quit--- exec_protocol = 0x0 exec_args = (const char **) 0x0 foreground = <value optimized out> ask_key_pass = false log_error = false dump_config = false dump_config_nondefaults = false i = <value optimized out> #10 0x00002b11b72cc8b4 in __libc_start_main () from /lib64/libc.so.6 No symbol table info available. #11 0x0000000000402eb9 in _start () No symbol table info available. -- http://osysadmin.blogspot.com

2 1

[Dovecot] Dovecot doesn't read users and passwords from config files
by Marco Fioretti 04 Aug '08

04 Aug '08

Greetings, I am setting up Dovecot 1.0.15 on my home Fedora Core 8 pc ONLY to access my mail archives across several mail clients. No access from the internet is possible or needed here. I cannot log in with any client, the login always fails. The reason, as I understand, is that when dovecot starts it doesn't read any user name from the userdb file, so when I try to login it doesn't recognize my name and so doesn't even try to verify the password: maillog excerpt: Aug 3 00:06:11 polaris dovecot: Dovecot v1.0.15 starting up Aug 3 00:06:11 polaris dovecot: auth(default): passwd-file /etc/local_dovecot_passwords: Read 0 users Aug 3 00:06:11 polaris dovecot: auth(default): passwd-file /etc/local_dovecot_users: Read 0 users Aug 3 00:06:12 polaris dovecot: auth(default): new auth connection: pid=5150 Aug 3 00:06:12 polaris dovecot: auth(default): new auth connection: pid=5148 Aug 3 00:06:12 polaris dovecot: auth(default): new auth connection: pid=5149 Aug 3 00:06:26 polaris dovecot: auth(default): client in: AUTH#0111#011PLAIN#011service=IMAP#011secured#011lip=127.0.0.1#011rip=127.0.0.1#011resp=AG1hcmNvAGdpZ2V0dG8= Aug 3 00:06:26 polaris dovecot: auth(default): passwd-file(marco,127.0.0.1): lookup: user=marco file=/etc/local_dovecot_passwords Aug 3 00:06:26 polaris dovecot: auth(default): passwd-file(marco,127.0.0.1): unknown user Aug 3 00:06:27 polaris dovecot: auth(default): client out: FAIL#0111#011user=marco Aug 3 00:06:27 polaris dovecot: imap-login: Disconnected: user=<marco>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured the dovecot.conf file, purged by comments, is below. What am I missing? TIA, Marco ############################################################## protocols = imap listen = localhost:143 mail_location = maildir:/home/marco/.MAIL/home_imap/ protocol imap { } protocol pop3 { } protocol lda { postmaster_address = postmaster(a)example.com } auth_debug = yes auth_debug_passwords = yes auth default { mechanisms = plain login passdb passwd-file { args = /etc/local_dovecot_passwords } userdb passwd-file { args = /etc/local_dovecot_users } user = root } dict { } plugin { } ################################################### the local_dovecot_passwords and local_dovecot_users files are identical, and have permission 644: marco:{PLAIN}thepassword:500:500::/home/marco/.MAIL/home_imap/ -- Reality is for those who lack imagination

2 5

[Dovecot] Server power loss and "Dovecot is already running with PID xxx"
by Pekka Savola 04 Aug '08

04 Aug '08

Hi, I'm running Dovecot 1.0.7 (with various patches) on CentOS 5.2. The server has suffered a couple of power loss events. Dovecot is run as a standalone server. The problem is that dovecot refuses to start up at boot because the PID file from before the power loss is left behind. The message is as follows: $ /sbin/service dovecot start Starting Dovecot Imap: Error: Dovecot is already running with PID 10825 (read from /var/run/dovecot/master.pid) Fatal: Invalid configuration in /etc/dovecot.conf [FAILED] (Note: there is nothing wrong in the configuration file so the error message is somewhat misleading.) I looked at the release notes of 1.0.xx releases and they didn't mention this. Is this already a known problem? Should the start-up logic be made more robust (e.g. check whether a process corresponding to the PID actually exists)? -- Pekka Savola "You each name yourselves king, yet the Netcore Oy kingdom bleeds." Systems. Networks. Security. -- George R.R. Martin: A Clash of Kings

4 6

[Dovecot] 1.1.2: imap crash with SIGSEGV
by Ralf Hildebrandt 04 Aug '08

04 Aug '08

GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... Reading symbols from /lib/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/i686/cmov/libdl-2.7.so...done. done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/i686/cmov/libc-2.7.so...done. done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.7.so...done. done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib11_trash_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib11_trash_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib20_mail_log_plugin.so Reading symbols from /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /usr/local/lib/dovecot/imap/lib21_fts_squat_plugin.so Core was generated by `/usr/local/libexec/dovecot/imap'. Program terminated with signal 11, Segmentation fault. [New process 23474] #0 mail_transaction_log_file_lock (file=0x0) at mail-transaction-log-file.c:257 257 if (file->locked) #0 mail_transaction_log_file_lock (file=0x0) at mail-transaction-log-file.c:257 #1 0x080ba2fd in mail_transaction_log_lock_head (log=0x91cfd68) at mail-transaction-log.c:419 #2 0x080ba36d in mail_transaction_log_sync_lock (log=0x91cfd68, file_seq_r=0xbff348a4, file_offset_r=0xbff34880) at mail-transaction-log.c:451 #3 0x080c44bb in mail_index_fsck (index=0x91cf828) at mail-index-fsck.c:424 #4 0x080b0296 in mail_index_map (index=0x91cf828, type=MAIL_INDEX_SYNC_HANDLER_HEAD) at mail-index-map.c:888 #5 0x080acde3 in mail_index_try_open (index=0x91cf828) at mail-index.c:290 #6 0x080ad0a7 in mail_index_open (index=0x91cf828, flags=49, lock_method=FILE_LOCK_METHOD_FCNTL) at mail-index.c:338 #7 0x080a1112 in index_storage_mailbox_open (ibox=0x91d02b0) at index-storage.c:383 #8 0x0807094b in maildir_open (storage=0x91bacc0, name=0x91bf6ee "Drafts", flags=0) at maildir-storage.c:448 #9 0x08070ab4 in maildir_mailbox_open (_storage=0x91bacc0, name=0x91bf6ee "Drafts", input=0x0, flags=0) at maildir-storage.c:512 #10 0xb7ea61ca in mail_log_mailbox_open (storage=0x91bacc0, name=0x91bf6ee "Drafts", input=0x0, flags=0) at mail-log-plugin.c:450 #11 0xb7eb761a in quota_mailbox_open (storage=0x91bacc0, name=0x91bf6ee "Drafts", input=0x0, flags=0) at quota-storage.c:366 #12 0x080a51d9 in mailbox_open (storage=0x91bacc0, name=0x91bf6ee "Drafts", input=0x0, flags=0) at mail-storage.c:459 #13 0x08060c89 in cmd_select_full (cmd=0x91bb5f0, readonly=false) at cmd-select.c:32 #14 0x08060e69 in cmd_select (cmd=0x91bb5f0) at cmd-select.c:87 #15 0x0806271c in client_command_input (cmd=0x91bb5f0) at client.c:580 #16 0x080627b3 in client_command_input (cmd=0x91bb5f0) at client.c:629 #17 0x08062d6d in client_handle_input (client=<value optimized out>) at client.c:670 #18 0x080631ee in client_input (client=0x91bb3a8) at client.c:725 #19 0x080dd730 in io_loop_handler_run (ioloop=0x91b79b0) at ioloop-epoll.c:201 #20 0x080dcc10 in io_loop_run (ioloop=0x91b79b0) at ioloop.c:308 #21 0x0806b35a in main (argc=152894696, argv=0xbff34f34, envp=0xbff34f3c) at main.c:293 -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) snickebo(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de "FOOT-AND-MOUTH BELIEVED TO BE FIRST VIRUS UNABLE TO SPREAD THROUGH MICROSOFT OUTLOOK Researchers Shocked to Finally Find Virus That Email App Doesn't Like".

2 2

[Dovecot] related, but off-topic: how to allow users to change password?
by Sahil Tandon 04 Aug '08

04 Aug '08

My dovecot is currently configured to authenticate vs. a userdb/passdb passwd-file that contains, for each user: username:passhash:5000:5000::/path/to/home::userdb_mail=/path/to/maildir Is it possible to let users authenticate and change their passwords? There are some webmail client add-ons that allow such things if users are system accounts or in a MySQL/LDAP db. Does anyone else use passdb/userdb passwd-files like above and have a method for allowing users to change their passwords from the web? Sorry for the slightly off-topic question, but hoping another Dovecot admin has solved this problem. Preference is to not to be tied to any particular webmail client just for this change password feature.

3 7

[Dovecot] Thunderbird and Dovecot on FC5 taking a long time to retrieve message
by Bruen, Mark 02 Aug '08

02 Aug '08

I'm running FC5 (2.6.15-1.2054_FC5smp) and Dovecot dovecot-1.0-0.beta8.2.fc5 with Thunderbird 2.0.0.16. I set up imap (dovecot) so I can access my mail locally or remotely. It seems to take a very long time (minutes sometimes) for an Email to be retrieved after I select it in the folder list and/or in the Email list locally or remotely. I've traced the imap process and found it doing a lot of reading (read() system calls) for a long time. I do have a high message count in some of these folders (i.e.: 20000 or so). Is there any way to improve performance (use more memory, cache indexes, tune I/O parameters, etc...) ? Thanks. -Mark

2 1

[Dovecot] POP3 locking
by Adrian Overbury 02 Aug '08

02 Aug '08

I'm trying to understand what dovecot's behavior will be in a given scenario to see if it will work as a (hopefully better) replacement for the home-grown pop3 server we currently use. User A is on a slow dialup connection, and uses, oh, let's say Outlook, since that's where most of our problems seem to spring from. User A uses outlook to download his mail over pop3. Half way through downloading a particularly large message, Outlook decides that the whole process isn't happening fast enough, so it opens another connection to the server and tries to download (potentially) the same message again. Now, our current server establishes a lock on the mailbox, and when that second connection happens it simply responds that there's no messages to collect... we used to have it terminate the connection, but this brings up confusing error messages on User A's client, and they call up and complain -- not an ideal situation. I've got a dovecot installation on my testing server, and I think I've set everything up correctly; it authenticates from my LDAP database, finds the home directory, lists the mail, all that... I believe somewhere it there it uses fcntl to establish an advisory lock on the mailbox (oh, we're using Maildir, by the way). I'm not sure where, though, or how long the lock persists for, or what its actual purpose is, because my tests show me that I can log the same users in with two concurrent sessions and get the same message twice. It's probably a fault in my understanding of how locking in user sessions of a pop3 server should work, but that doesn't sound right to me. Can someone explain if what I'm seeing is correct, or what problem it may be symptomatic of? Does dovecot even do concurrent-user-session locking? So far I've enjoyed playing with dovecot -- far more than the current server we use. I'd like to use it as our primary pop3 server, but preventing users from having concurrent sessions and getting the same message more than once, and keeping them from seeing errors because of their client trying to open multiple sessions is important. Oh, and I'm user dovecot 1.0.beta3, since I don't really have the option of upgrading the OS on my mail servers any time soon. Adrian

9 13

[Dovecot] Quota warnings wrong behaviour (1.1.2)
by Włodek Waligórski 02 Aug '08

02 Aug '08

Hi, I use the latest version of dovecot 1.1.2. Thanks to the excellent docs I managed to get everything working so far, but ... I'm experiencing such strange behaviour when user gets over 90% of quota (the threshold is such): 1. user uses say 89% of his ~/Maildir 2. message arrives that increases quota usage to 92% 3. quota_warning is _NOT_ triggered 4. user deletes the surplus message and gets back to 89% (quota_rule2: Trash:ignore) 5. quota_warning is triggered and quota warning message arrives So the event gets triggered when user passes the quota threshold, but from a "wrong direction". I would expect that message should arrive together with the surplus message. Below I paste my dovecot.conf and "./configure" opts: -------------------cut--------------------------------------- # dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf base_dir: /usr/local/var/run/dovecot/ log_path: /dev/stderr info_log_path: /dev/stderr log_timestamp: listen: 127.0.0.1:143 ssl_listen: 0:993 ssl_cert_file: /var/qmail/control/servercert.pem ssl_key_file: /var/qmail/control/servercert.pem ssl_cipher_list: ALL:!LOW verbose_ssl: yes login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 89 last_valid_uid: 89 mail_uid: vpopmail mail_gid: vchkpw mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: quota imap_quota imap_client_workarounds: outlook-idle auth default: user: vpopmail verbose: yes debug: yes passdb: driver: vpopmail args: quota_template=quota_rule=*:backend=%q userdb: driver: vpopmail plugin: quota: maildir quota_rule: ?:storage=110485760 quota_rule2: Trash:ignore quota_warning: storage=90%% /usr/local/bin/imap-quota-warning 90 ----------------------------------------------------------------------------------- # grep "./configure" config.log | head -1 $ ./configure --disable-ipv6 --without-passwd --without-passwd-file --without-shadow --without-pam --without-checkpassword --without-bsdauth --without-gssapi --without-sia --without-ldap --with-vpopmail --without-static-userdb --without-prefetch-userdb --without-sql --without-pgsql --without-mysql --without-sqlite --with-ssl=openssl ------------------------------------------------------------------------------------ My system is x86 Debian-testing, SMP. -Włodek

1 0

[Dovecot] Permission denied creating inbox file in /var/mail
by Steve Ochani 01 Aug '08

01 Aug '08

Hello all, I'm using dovecot version 1.07 on CentoOS 5 (clone of RHEL 5). When there is no existing mbox file for a user in /var/mail I get the following error: --------------- Jul 31 16:32:32 newnewton dovecot: imap-login: Login: user=<testm2>, method=PLAIN, rip=::ffff:127.0.0.1, lip=::ffff:127.0.0.1, secured Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): open(/var/mail/testm2, O_CREAT) failed: Permission denied Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): access() failed with mbox file /var/mail/testm2: No such file or directory Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): stat() failed with mbox file /var/mail/testm2: No such file or directory Jul 31 16:32:32 newnewton dovecot: IMAP(testm2): Connection closed ---------------- My persimmons on /var/mail (which is a symlink to /var/spool/mail) : drwxrwxr-x 2 root mail 4096 Jul 31 16:32 mail I have tried adding the mail group as mail_privileged_group, the output of dovecot -n : -------------------- # 1.0.7: /etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_privileged_group: mail mail_location: mbox:~/IMAPmail:INBOX=/var/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd -------------------- Here is the permission on /etc/dovecot.conf -rw-r--r-- 1 root root 42833 Jul 31 15:30 /etc/dovecot.conf I've searched google and the mailing list archive and tried the couple of things commonly suggested. As for a test I changed perms on /var/spool/mail to 777 and then dovecot made the inbox file. The file ended up being owned by the user and the group owner was the group that the user belongs to, not mail. When I create new users using useradd there is a 0 byte file created in /var/mail for the user but I use scripts to create student accounts every semester (about 10,000) so I'm trying to avoid having to add more things that the script will have to create. Any help is greatly appreciated. Thanks -Steve O.

3 4

[Dovecot] dovecot.sieve file location?
by kbajwa 01 Aug '08

01 Aug '08

CentOS 5.2 Postfix-2.3.3 Dovecot-1.1.1 Dovecot.Sieve-1.1.5 I have setup with: home_mailbox = Maildir/ (/etc/postfix/main.cf) & mail-location = maildir:~/Maildir (/etc/dovecot.conf) I have created a 'test' user to test Sieve 'Vacation' setup. My questions are: 1. Which folder '.dovecot.sieve' script is copied into? Is it 'home/test' -or- 'home/test/Maildir' or someplace else? 2. '.dovecot.sieve' script parameter ":days 1" means that the reply is sent once a day. Is it possible to send the reply 'immediately'? Kirti

2 1

[Dovecot] Dovecot load balancing
by Thomas Hummel 01 Aug '08

01 Aug '08

Hello, I'd like to figure out how to set up a site running dovecot on multiple computers for load balancing reasons. I'm currently running dovecot-1.0.14 on a 8GB RAM, 2 quad-core 2.66Ghz Xeon single server which runs FreeBSD 6.2-STABLE SMP. . the mailbox format was mbox and I successfully migrated to Maildir only . mailboxes are on an NFS NetApp server, attribute caching is off . indexes are locally stored . the number of users is around 2500, some of them having huge mailboxes (~ 1 or 2 GB) . a large amount of users is using IMAP but there are also many POP3 users . the passdb/userdb is openLDAP . for now, I neither use namespaces, nor quotas nor deliver, nor any plugin, but I plan to use namespaces and ACL to implement shared mailboxes. The same machine is running postfix-2.4.6 with amavisd-new-2.5.4 (no spamassassin) and clamav-0.93.1. I'm using procmail-3.22 as the LDA. I installed dovecot-1.1.2 on non-standard ports for test and plan to switch to it as I read on this list it performs better, load wise. This setup (1.0.14) works great except that, compared to the time mailboxes were in mbox format, the load average (as shown by 'top') goes higher from a significant amout on a regular basis and sometimes goes over the top. On "normal" circumstances, the number of processes is around 1400 and the load oscillates between 1 to 10 and 30 to 60. Most of the time, I'd say the load average is around 20. Every friday a message (no attachement, decent size) is sent to all users : in such circumstances (but only sometimes, not every time : let's say half the time such a message is sent), the load goes so high that I have to stop dovecot to let procmail deliver the message or even reboot the machine. Sometimes, the load climbs up to something like 150, then goes back to the 'normal' case described above. I know multi-master replication is on the roadmap. I know some dovecot sites use in the meantime several dovecot servers. I'd like to know how those sites do the load balancing, the main problem beeing to be able to direct each user to the same dovecot server each time as stated in the Wiki (http://wiki.dovecot.org/NFS) I don't think that DNS round robin would do the trick because some UA (for instance Thunderbird) often open up to 5 connexions for the same user, unless maybe such UA makes a single 'gethostbyname()', thus connecting 5 times to the same physical server ? What are the options to achieve such a setup ? Any successful experiences ? Thank you -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

8 13