November 2012 - dovecot

[Dovecot] imap-login hanging when firewall blocks ssl handshaking
by Erik A Johnson 04 Dec '12

04 Dec '12

imap-login processes are hanging (using 100% of CPU) when connected from a client that is partially blocked by a firewall. It appears that imap-login is stuck in a loop trying to complete an ssl handshake. imap-login is working fine for other clients not blocked by the firewall (including localhost). This is dovecot 2.1.10 under Mac OS X 10.8.2 (compiled from sources); the firewall is Little Snitch 3.0.1 blocking port 993, which appears to let the connection initiate but then squashes and disconnects the socket during ssl handshaking. gdb backtrace and Activity Monitor's "Sample Process" show that imap-login is stuck calling ioloop-kqueue's io_loop_handler_run -> io_loop_call_io -> ssl_step repeatedly; dtruss shows that it is repeatedly making system calls to kevent and read, the latter returning -1 with errno 57=ENOTCONN="Socket is not connected". (I also tried ./configure --with-ioloop=poll and --with-iopoll=select instead of the default best = kqueue but the results were the same; --with-iopoll=epoll didn't work because epoll is not available on this machine.) The client, initiated by the command "openssl s_client -connect SERVER:993", first responds "CONNECTED(00000003)" but then immediately the error "60278:error:140790E5:SSL routines:SSL23_WRITE:ssl handshake failure:/SourceCache/OpenSSL098/OpenSSL098-44/src/ssl/s23_lib.c:182:". The infinite loop is in src/lib/ioloop.c in the function "io_loop_run" where the statement "while (ioloop->running) io_loop_handler_run(ioloop)" is executed. While I think the firewall is not doing the right thing (i.e., it lets a connection start but then kills it), it seems that imap-login should fail gracefully when the socket is no longer connected. Ideas? Thanks. ----------------------------------- /usr/local/sbin/dovecot -n # 2.1.10: /usr/local/etc/dovecot/dovecot.conf # OS: Darwin 12.2.0 x86_64 default_internal_user = _dovecot default_login_user = _dovenull namespace { hidden = no list = yes location = mbox:/Users/%u/Documents/Mailboxes prefix = mbox/ separator = / type = private } namespace { inbox = yes location = maildir:/Users/%u/Documents/Maildir mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { driver = pam } protocols = imap lmtp ssl = required ssl_cert = </usr/local/etc/dovecot/dovecot.pem ssl_key = </usr/local/etc/dovecot/dovecot.pem userdb { driver = passwd } protocol imap { mail_plugins = " zlib imap_zlib" } ----------------------------------- gdb's "bt full" gives various results depending on where in the loop, but they are they same from ssl23_accept on down. (gdb) bt full #0 0x00007fff92d19f63 in sha1_block_data_order () #1 0x00007fff92d1a4ae in SHA1_Final () #2 0x00007fff92d45430 in EVP_DigestFinal_ex () #3 0x00007fff92d17d7a in ssleay_rand_add () #4 0x00007fff974529be in ssl23_accept () #5 0x000000010cac0729 in ssl_handshake [inlined] () at /private/tmp/johnsone/dovecot-2.1.10/src/login-common/ssl-proxy-openssl.c:465 ret = -949939536 #6 0x000000010cac0729 in ssl_step (proxy=0x7fff53152b90) at ssl-proxy-openssl.c:528 ret = -949939536 #7 0x000000010cb11bd1 in io_loop_call_io (io=0x7f7fa0c1c240) at ioloop.c:379 ioloop = (struct ioloop *) 0x7f7fa0c03b00 t_id = 2 #8 0x000000010cb12c69 in io_loop_handler_run (ioloop=0x0) at ioloop-kqueue.c:148 tv = { tv_sec = 130, tv_usec = 124797 } ctx = (struct ioloop_handler_context *) 0x7f7fa0c1a890 ret = 1 ts = { tv_sec = 130, tv_nsec = 124797000 } events = (struct kevent *) 0x10cb4ee78 #9 0x000000010cb11b88 in io_loop_run (ioloop=0x7fff53152b90) at ioloop.c:398 No locals. #10 0x000000010cafde9b in master_service_run (service=0x7f7fa0c039f0, callback=0x7f7fa0c1c2d8) at master-service.c:543 No locals. #11 0x000000010cabdcd1 in main_deinit [inlined] () at /private/tmp/johnsone/dovecot-2.1.10/src/login-common/main.c:406 set_pool = (pool_t) 0x7f7fa100b420 login_socket = 0x10cb4f7f8 "?9??" #12 0x000000010cabdcd1 in login_binary_run (argc=1, argv=0x7f7fa0c037c0, binary=0x7fff53152b90) at main.c:407 set_pool = (pool_t) 0x7f7fa100b420 login_socket = 0x10cb4f7f8 "?9??" #13 0x00007fff8ac847e1 in start () (gdb) bt full #0 0x00007fff96e4c110 in malloc_zone_malloc () #1 0x00007fff96e4cba7 in malloc () #2 0x00007fff92d2c9e2 in CRYPTO_malloc () #3 0x00007fff92d4535f in EVP_DigestInit_ex () #4 0x00007fff92d17caa in ssleay_rand_add () #5 0x00007fff974529be in ssl23_accept () ... #0 0x00007fff94775ffa in read () #1 0x00007fff92cf41e6 in sock_read () #2 0x00007fff92d15598 in BIO_read () #3 0x00007fff9745294a in ssl23_read_bytes () #4 0x00007fff97452c3e in ssl23_get_client_hello () #5 0x00007fff97452b4d in ssl23_accept () ... -----------------------------------

4 14

[Dovecot] Redelivery of mdbox messages to pass through sieve
by Hugh Davenport 30 Nov '12

30 Nov '12

Hey, I've been slack and haven't updated my sieve script for yonks, and finally got round to it. What I was wondering is whether there was a way to basically take all the messages from a folder and pass it through sieve again. I've found earlier messages in this list, but they were for Maildir format, not mdbox which I use now. Does anyone know of a way to do this? Cheers, Hugh

2 2

[Dovecot] Maildir conversion
by Aristidis Fesarlis 30 Nov '12

30 Nov '12

Hi all, I am using Dovecot 1.2.7, and trying to do my first Mbox to Maildir conversion. So I created a small script: > #!/bin/bash > > ls > userlist.txt > > for i in `cat userlist.txt`; do > echo "---------------------"; > echo "Converting user $i..."; > echo "---------------------"; > > su - $i -s /bin/bash -c "/opt/scripts/mb2md.pl -s mail -R"; > su - $i -s /bin/bash -c "/opt/scripts/mb2md.pl -m -s > /var/mail/$i"; > su - $i -s /bin/bash -c "cp ~$i/mail/.subscriptions > ~$i/Maildir/subscriptions"; > done > > rm -f userlist.txt I would like some help with the following: 1. Trying it, I get multiple warnings for some mailboxes like this: > "WARNING: UID from X-UID: header too low. Ignoring it Is this a problem? Or I can ignore it? 2. I understand that I also have to instruct my MDA (procmail) to deliver mail to the new location. I found that I have to create an /etc/procmailrc with the following line: > DEFAULT=$HOME/Maildir/ My question is: Some users have their own .procmailrc file inside their home directory, to filter mail etc. Their file does not contain the above statement. Would the default procmailrc file be processed for them as well? Or their file takes precedence, causing the default file not to be processed at all? Thank you

2 1

[Dovecot] Newbie Basic ACL issue
by Muhammad Yousuf Khan 30 Nov '12

30 Nov '12

i can not impliment a basic acl to a /public/.News folder. however with out ACL it works great but after implementing acl "Public" folder can be seen while subscribing but i can not create folder inside it nor i can view already created ".News" folder. when i restart dovecot it shows me some thing like this root@mailsrv:/public/.News# /etc/init.d/dovecot restart Restarting IMAP/POP3 mail server: dovecotILoading modules from directory: /usr/lib/dovecot/modules/imap IModule loaded: /usr/lib/dovecot/modules/imap/lib01_acl_plugin.so IModule loaded: /usr/lib/dovecot/modules/imap/lib02_imap_acl_plugin.so IEffective uid=65534, gid=65534, home=/tmp Iacl: No acl_shared_dict setting - shared mailbox listing is disabled root@mailsrv:/public/.News# dovecot -n # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.6 log_timestamp: %Y-%m-%d %H:%M:%S ssl_cert_file: /etc/ssl/certs/postfix.pem ssl_key_file: /etc/ssl/private/postfix.key login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: maildir:~/Maildir:INBOX=~/Maildir/:INDEX=~/Maildir/index mail_debug: yes mbox_write_locks: fcntl dotlock mail_plugins: acl imap_acl namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public/ location: maildir:/public:INDEX=/public/index list: yes subscriptions: yes lda: mail_plugins: acl auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: acl: vfile as i read in few howto's that "dovecot-acl" file should be placed in the mail publish folder like in my case "/public/.News/dovecot-acl" here is the output of my file root@mailsrv:/public/.News# cat dovecot-acl owner lrwstipekxa anyone= lr now after this implimentation i can see the folder "Public" in subscription now when i try to create a new folder inside ".News" folder via outlook 2007 it says "cannot move the item. the server responded: 'NOPERM] Permission denied" i think i am messed up permission actually i have 2 users "tom" and "fmaster" both doing the same thing. weather i write this "anyone lrwstpekxa" or "user=tom lrwstpekxa" it does the same for both user what i want is just a simple thing. i want tom to be the owner of .News and fmaster has read only. so he can only read the news but can not delete even can not change the flag to read or unread. Note: both are system users (not virtual users) Nov 30 20:50:42 mailsrv dovecot: IMAP(fmaster): open(/public/.News/dovecot-uidlist) failed: Permission denied Nov 30 20:50:42 mailsrv dovecot: IMAP(fmaster): open(/public/.News/dovecot-uidlist) failed: Permission denied Nov 30 20:54:45 mailsrv dovecot: IMAP(fmaster): open(/public/index/.News/dovecot.index.log) failed: Permission denied (euid=1001(fmaster) egid=1001(fmaster) missing +w perm: /public/index/.News/dovecot.index.log) Nov 30 20:54:50 mailsrv dovecot: IMAP(fmaster): open(/public/index/.News/dovecot.index.log) failed: Permission denied (euid=1001(fmaster) egid=1001(fmaster) missing +w perm: /public/index/.News/dovecot.index.log) i thought its a system level permission issue so i pass this command "chmod 777 /public -R" but still i receive the same outlook error but no errors in /var/log/mail.err. please hell me what kind of user right should be on the .News folder. for example, tom or root which one should have the "rwx" rights on the folder. and what kind of changes should i made in deovecot-acl any help, tip would be highly appreciated. Thanks,

1 0

[Dovecot] 2.1.12 - Pigeonhole 0.3.3 build failed: /usr/bin/ld: cannot find -lssl -lcrypto
by Tobias Hachmer 30 Nov '12

30 Nov '12

Hello list, Although timos bugfix release this morning I can't build pigeonhole 0.3.3 for dovecot 2.1.12 successfully. I don't know if it is a new bug or if I do something wrong but with dovecot 2.1.10 all worked fine, with the same configure options. configure options (out of debian/rules for building debian package): ./configure --with-dovecot=/usr/lib/dovecot \ --host=$(DEB_HOST_GNU_TYPE) \ --build=$(DEB_BUILD_GNU_TYPE) \ --prefix=/usr \ --sysconfdir=/etc \ --libexecdir=\$${prefix}/lib \ --localstatedir=/var \ --mandir=\$${prefix}/share/man \ --infodir=\$${prefix}/share/info \ --with-moduledir=\$${prefix}/lib/dovecot/modules buildlogextraction with error, the full log is available here: https://launchpadlibrarian.net/124478979/buildlog_ubuntu-precise- amd64.dovecot-2.1-pigeonhole_0.3.3-7~kokelnet~precise_FAILEDTOBUILD.txt.gz Thanks in advance for any help, Tobias Hachmer Making all in lib-sieve-tool make[4]: Entering directory `/build/buildd/dovecot-2.1- pigeonhole-0.3.3/src/lib-sieve-tool' /bin/bash ../../libtool --tag=CC --mode=compile x86_64-linux-gnu-gcc - DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-sieve -I/usr/include/dovecot - D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer- size=4 -Wformat -Wformat-security -Wall -W -Wmissing-prototypes -Wmissing- declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT sieve-tool.lo -MD -MP -MF .deps/sieve-tool.Tpo -c -o sieve-tool.lo sieve-tool.c libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. - I../../src/lib-sieve -I/usr/include/dovecot -D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- aliasing=2 -MT sieve-tool.lo -MD -MP -MF .deps/sieve-tool.Tpo -c sieve-tool.c -fPIC -DPIC -o .libs/sieve-tool.o libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. - I../../src/lib-sieve -I/usr/include/dovecot -D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- aliasing=2 -MT sieve-tool.lo -MD -MP -MF .deps/sieve-tool.Tpo -c sieve-tool.c -o sieve-tool.o >/dev/null 2>&1 mv -f .deps/sieve-tool.Tpo .deps/sieve-tool.Plo /bin/bash ../../libtool --tag=CC --mode=compile x86_64-linux-gnu-gcc - DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-sieve -I/usr/include/dovecot - D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer- size=4 -Wformat -Wformat-security -Wall -W -Wmissing-prototypes -Wmissing- declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT mail-raw.lo -MD -MP -MF .deps/mail-raw.Tpo -c -o mail-raw.lo mail-raw.c libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. - I../../src/lib-sieve -I/usr/include/dovecot -D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- aliasing=2 -MT mail-raw.lo -MD -MP -MF .deps/mail-raw.Tpo -c mail-raw.c -fPIC -DPIC -o .libs/mail-raw.o libtool: compile: x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. - I../../src/lib-sieve -I/usr/include/dovecot -D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict- aliasing=2 -MT mail-raw.lo -MD -MP -MF .deps/mail-raw.Tpo -c mail-raw.c -o mail-raw.o >/dev/null 2>&1 mv -f .deps/mail-raw.Tpo .deps/mail-raw.Plo /bin/bash ../../libtool --tag=CC --mode=link x86_64-linux-gnu-gcc - std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat- security -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime - Wstrict-aliasing=2 -Wl,-Bsymbolic-functions -Wl,-z,relro -o libsieve-tool.la sieve-tool.lo mail-raw.lo -lrt libtool: link: ar cru .libs/libsieve-tool.a .libs/sieve-tool.o .libs/mail- raw.o libtool: link: ranlib .libs/libsieve-tool.a libtool: link: ( cd ".libs" && rm -f "libsieve-tool.la" && ln -s "../libsieve- tool.la" "libsieve-tool.la" ) make[4]: Leaving directory `/build/buildd/dovecot-2.1- pigeonhole-0.3.3/src/lib-sieve-tool' Making all in sieve-tools make[4]: Entering directory `/build/buildd/dovecot-2.1- pigeonhole-0.3.3/src/sieve-tools' x86_64-linux-gnu-gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib-sieve - I../../src/lib-sieve-tool -I./debug -I/usr/include/dovecot - D_FORTIFY_SOURCE=2 -std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer- size=4 -Wformat -Wformat-security -Wall -W -Wmissing-prototypes -Wmissing- declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT sievec.o -MD -MP -MF .deps/sievec.Tpo -c -o sievec.o sievec.c mv -f .deps/sievec.Tpo .deps/sievec.Po /bin/bash ../../libtool --tag=CC --mode=link x86_64-linux-gnu-gcc - std=gnu99 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat- security -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime - Wstrict-aliasing=2 -export-dynamic -Wl,-Bsymbolic-functions -Wl,-z,relro -o sievec sievec.o ../../src/lib-sieve/libdovecot-sieve.la ../../src/lib-sieve- tool/libsieve-tool.la -ldovecot-storage -lssl -lcrypto -ldovecot-lda - L/usr/lib/dovecot -ldovecot -lrt libtool: link: x86_64-linux-gnu-gcc -std=gnu99 -g -O2 -fstack-protector -- param=ssp-buffer-size=4 -Wformat -Wformat-security -Wall -W -Wmissing- prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -Wl,-Bsymbolic- functions -Wl,-z -Wl,relro -o .libs/sievec sievec.o -Wl,--export-dynamic ../../src/lib-sieve/.libs/libdovecot-sieve.so ../../src/lib-sieve- tool/.libs/libsieve-tool.a /usr/lib/dovecot/libdovecot-storage.so -lssl - lcrypto /usr/lib/dovecot/libdovecot-lda.so -L/usr/lib/dovecot /usr/lib/dovecot/libdovecot.so -lrt -Wl,-rpath -Wl,/usr/lib/dovecot /usr/bin/ld: cannot find -lssl /usr/bin/ld: cannot find -lcrypto collect2: ld returned 1 exit status make[4]: *** [sievec] Error 1 make[4]: Leaving directory `/build/buildd/dovecot-2.1- pigeonhole-0.3.3/src/sieve-tools' make[3]: *** [all-recursive] Error 1 make[3]: Leaving directory `/build/buildd/dovecot-2.1-pigeonhole-0.3.3/src' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/build/buildd/dovecot-2.1-pigeonhole-0.3.3' make[1]: *** [all] Error 2 make[1]: Leaving directory `/build/buildd/dovecot-2.1-pigeonhole-0.3.3' make: *** [build-stamp] Error 2

2 2

[Dovecot] v2.1.12 released
by Timo Sirainen 30 Nov '12

30 Nov '12

http://dovecot.org/releases/2.1/dovecot-2.1.12.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.12.tar.gz.sig The dovecot-config file installed by v2.1.11 was missing quotes, which broke building Pigeonhole. This release fixes that.

2 1

[Dovecot] v2.1.11 released
by Timo Sirainen 30 Nov '12

30 Nov '12

http://dovecot.org/releases/2.1/dovecot-2.1.11.tar.gz http://dovecot.org/releases/2.1/dovecot-2.1.11.tar.gz.sig * lmtp/lda: dovecot.index.cache file is no longer fully mapped to memory, allowing mail deliveries to work even if the file is huge. * auth: userdb passwd lookups are now done by auth worker processes instead of auth master process (as it was documented, but accidentally didn't work that way). + lmtp: lmtp_rcpt_check_quota=yes setting checks quota on RCPT TO. - lmtp: After successful proxying RCPT TO, the next one to a nonexistent user gave tempfail error instead of "user not found". - lmtp proxy: Fixed hanging if remote server was down. - imap: Fixed crash when SEARCH contained multiple KEYWORD parameters. - doveadm: Various fixes to handling doveadm-server connections. - -i <instance name> parameter for Dovecot tools didn't work correctly. - director was somewhat broken in v2.1.10. This version also includes various reliability enhancements. - auth: passdb imap was broken in v2.1.10.

2 1

Re: [Dovecot] Tcpflow capture
by Daniel L. Miller 30 Nov '12

30 Nov '12

On 11/29/2012 9:32 PM, Daniel L. Miller wrote: > > I (hopefully) fixed my config - put 'zlib' into 10-mail.conf and > removed it from the others. Re-indexing is now good on some mailboxes > that were broken before - but I still have a fault on others. > Using the tcpflow dump, I found a couple bad messages that I didn't care about storing - so I deleted them. Then, after no change - I remembered to do a "compact" in my MUA. That cleared up one mailbox - then dovecot complained about various errors & corruption on another mailbox. So I'll start a new thread for that as it looks like the solr interface is now good! -- Daniel

2 2

[Dovecot] mdbox corruption
by Daniel L. Miller 30 Nov '12

30 Nov '12

Trying to clean up the last of the corruption caused by my own stupidity. I now have two mailboxes for one user that give errors such as: doveadm(fax(a)amfes.com): Error: zlib.read(/var/mail/amfes.com/fax/mdbox/storage/m.9): gz trailer has wrong CRC value at 20065618 doveadm(fax(a)amfes.com): Error: read(/var/mail/amfes.com/fax/mdbox/storage/m.9) failed: Invalid argument (uid=238) doveadm(fax(a)amfes.com): Error: zlib.read(/var/mail/amfes.com/fax/mdbox/storage/m.9): corrupted data at 20145217 [...] doveadm(fax(a)amfes.com): Error: read(/var/mail/amfes.com/fax/mdbox/storage/m.20) failed: Invalid argument (uid=5155) doveadm(fax(a)amfes.com): Error: zlib.read(/var/mail/amfes.com/fax/mdbox/storage/m.20): corrupted data at 24779604 doveadm(fax(a)amfes.com): Error: Cached message size smaller than expected (1259 < 1260) doveadm(fax(a)amfes.com): Error: Corrupted index cache file /var/mail/amfes.com/fax/mdbox/mailboxes/INBOX/2010/dbox-Mails/dovecot.index.cache: Broken physical size for mail UID 5158 'doveadm force-resync' does not appear to fix these. There appear to be only the two mdbox files affected and I see about 40 errors. I would prefer to salvage as much as possible of these. What options do I have? Do a dsync to another location and take whatever I get? -- Daniel

2 1

Re: [Dovecot] Tcpflow capture
by Daniel L. Miller 30 Nov '12

30 Nov '12

On 11/29/2012 12:49 PM, Timo Sirainen wrote: > On 29.11.2012, at 18.06, Daniel L. Miller wrote: > >> On 11/28/2012 10:37 PM, Timo Sirainen wrote: >>> On 29.11.2012, at 7.47, Daniel L. Miller wrote: >>> >>>>> doveadm fetch text -u amiller(a)amfes.com mailbox-guid a47e4e264aa1c94cc35100003bc41c5f uid 12891 >>>>> >>>> The result of that, when adding a "> test", generates a 11 byte file. >>>> >>>> Hexedit shows me that as: >>>> 74 65 78 74 3A 0A 1F 8B 08 0C 0A >>>> >>>> Otherwise a simple 'less' give me: >>>> text: >>>> ^_<8B>^H^L >>>> >>>> Does this tell you anything? >>> First of all it tells me that you either have some very corrupted messages in your mailbox, or you have some compressed messages but without zlib plugin enabled. >> 10-mail.conf - mail_plugins = fts fts_solr acl >> 15-lda.conf - mail_plugins = $mail_plugins sieve >> 20-imap.conf - mail_plugins = $mail_plugins zlib imap_acl >> 20-lmtp.conf - mail_plugins = $mail_plugins sieve > OK, so all of the compressed mails will be indexed as garbage. > >> My intent was to be able to read zlib mails, but not write new ones. I may change this to just have zlib in 10-mail and start writing compressed. Unless this is/will cause corruption. > Enabling zlib plugin doesn't enable compression on writing. plugin { zlib_save=yes } is required for that. > I (hopefully) fixed my config - put 'zlib' into 10-mail.conf and removed it from the others. Re-indexing is now good on some mailboxes that were broken before - but I still have a fault on others. -- Daniel

1 0